Wednesday, 2017-01-25

*** shardy has quit IRC00:01
*** dmarlin has quit IRC00:01
*** tdasilva has joined #tripleo00:03
*** limao has quit IRC00:04
openstackgerritDan Trainor proposed openstack/puppet-tripleo: Proxy API endpoints that UI  https://review.openstack.org/42490900:05
dtrainorthat took a few attempts, gerritt didn't respond, instead the client gave "internal error"00:05
EmilienMdtrainor: daily db thing, retry again now00:06
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Add support for batched upgrades to composable upgrades  https://review.openstack.org/42316000:06
dtrainorit stuck, thanks.  gotta amend the first line of the commit, that'll give me another chance to try.  thanks!00:06
openstackgerritDan Trainor proposed openstack/puppet-tripleo: Proxy API endpoints that UI uses  https://review.openstack.org/42490900:07
*** lblanchard has quit IRC00:08
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Pass job identifier to testenv-worker  https://review.openstack.org/42473600:11
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add debugging information for bmc issues  https://review.openstack.org/42140900:11
*** Guest9757 is now known as rook00:21
*** sdake has joined #tripleo00:26
*** yamahata has quit IRC00:27
EmilienMdhill_: I didn't yet, maybe you can ask on mailing list, or file a bug00:32
* EmilienM wanders off00:32
dhill_EmilienM, I'll see thanks buddy00:32
openstackgerritDan Trainor proposed openstack/puppet-tripleo: Proxy API endpoints that UI uses  https://review.openstack.org/42490900:37
dtrainorsorry for the noise... trials and tribulations of puppet lint.  i'll look for a local linter for future endeavors.00:38
*** panda is now known as panda|zZ00:42
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: [build-test-packages] make zuul method preferred over jenkins  https://review.openstack.org/42491400:42
*** yolanda has quit IRC00:45
*** limao has joined #tripleo00:46
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419000:51
*** yolanda has joined #tripleo00:51
*** yolanda has quit IRC00:53
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Add scenario005 job (4nodes)  https://review.openstack.org/41809800:53
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Add scenario005 job (4nodes)  https://review.openstack.org/41809800:53
*** dmacpher has joined #tripleo00:53
*** yolanda has joined #tripleo01:00
*** yolanda has quit IRC01:04
*** rajinir has quit IRC01:06
*** dougbtv__ has joined #tripleo01:18
*** dougbtv has quit IRC01:19
*** morazi has joined #tripleo01:21
*** sdake has quit IRC01:22
*** sdake has joined #tripleo01:35
openstackgerrityunfeng zhou proposed openstack/instack: Add four spaces before url.  https://review.openstack.org/41269601:38
openstackgerritAlex Schultz proposed openstack/instack-undercloud: Run yum clean before yum update  https://review.openstack.org/42492401:46
openstackgerritAlex Schultz proposed openstack/instack-undercloud: Run cell v2 setup differently for upgrades  https://review.openstack.org/41912101:46
*** iranzo has quit IRC01:47
openstackgerritAlex Schultz proposed openstack/instack-undercloud: Run yum clean before yum update  https://review.openstack.org/42492401:52
*** sdake has quit IRC02:06
*** pradk has quit IRC02:13
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419002:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: (newton) Import multinode + pingtest from tripleo-ci  https://review.openstack.org/42481102:16
*** karimb has quit IRC02:18
openstackgerritMerged openstack/instack: Replaced e.message with str(e)  https://review.openstack.org/42053502:28
openstackgerritMerged openstack/tripleo-puppet-elements: Change upstream URL for puppet-contrail  https://review.openstack.org/42487302:28
openstackgerritMerged openstack/puppet-tripleo: pacemaker remote profile support  https://review.openstack.org/40096702:28
openstackgerritMerged openstack/tripleo-heat-templates: pacemaker remote profile support  https://review.openstack.org/40097202:29
openstackgerritMerged openstack/puppet-tripleo: Make sure we bind the rabbit inter-cluster to a specific interface  https://review.openstack.org/41575702:29
openstackgerritMerged openstack/tripleo-heat-templates: Fix the rabbitmq/redis pacemaker resource timeouts on updates  https://review.openstack.org/39760802:29
openstackgerritMerged openstack/tripleo-heat-templates: Configure nova neutron parameter for L to M upgrade  https://review.openstack.org/42283702:29
openstackgerritMerged openstack/tripleo-common: Add a 'manage' workflow  https://review.openstack.org/41252502:29
openstackgerritMerged openstack/tripleo-heat-templates: Add glance registry service to disable on upgrade  https://review.openstack.org/42479502:29
openstackgerritMerged openstack-infra/tripleo-ci: Clean up testenv if Jenkins instance goes away  https://review.openstack.org/42434302:29
*** fzdarsky_ has joined #tripleo02:39
*** fzdarsky has quit IRC02:42
*** pradk has joined #tripleo02:43
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud: Add release notes for Ocata 6.0.0  https://review.openstack.org/42474602:45
*** sudipto has joined #tripleo02:47
*** sudipto_ has joined #tripleo02:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Fix for AllNodesExtraConfig and fix environment files to create swap files/partitions  https://review.openstack.org/42407902:52
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Set manila default_share_type config option  https://review.openstack.org/42340502:53
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: ceph-rgw: add missing user parameter  https://review.openstack.org/42352602:53
tbarronEmilienM: thanks for the rebase on 42340502:54
openstackgerritBen Kero proposed openstack/tripleo-quickstart: Add optional undercloud-setup role to quickstart-extras playbook  https://review.openstack.org/42494702:54
EmilienMtbarron: cool np, I'm trying to get the stable/newton Ci jobs passing again02:54
tbarronEmilienM: and I appreciate all you do to keep the production pipeline going02:55
EmilienMtbarron: it's a team work :)02:55
tbarronEmilienM: we're trying to get that one back downstream for an async release ...02:56
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Replace custom multinode oooq playbook with default quickstart playbook  https://review.openstack.org/42468302:56
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud: Ensure Aodh uses its own mysql db  https://review.openstack.org/42495002:57
openstackgerritLeehom Li proposed openstack/diskimage-builder: Fix problem unable disable iptables service  https://review.openstack.org/41970302:58
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Replace multinode playbook with default quickstart playbook  https://review.openstack.org/42468302:58
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Add support for batched upgrades to composable upgrades  https://review.openstack.org/42316003:02
*** tzumainn has quit IRC03:05
openstackgerritJason E. Rist proposed openstack/tripleo-ui: Adds ids namespaced artifacts on plans page.  https://review.openstack.org/41110203:11
*** pradk has quit IRC03:15
*** sdake has joined #tripleo03:21
*** nmathew has joined #tripleo03:23
*** thrash is now known as thrash|g0ne03:33
*** udesale has joined #tripleo03:33
openstackgerritMerged openstack/tripleo-heat-templates: Remove spurious for loop from post deploy j2  https://review.openstack.org/42489603:36
openstackgerritMerged openstack/puppet-tripleo: Clean TLS proxy-related setup for glance api profile  https://review.openstack.org/40856503:36
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Add support for calling validations in deploy and introspect workflows  https://review.openstack.org/41628403:38
*** cmyster has joined #tripleo03:45
*** cmyster has quit IRC03:45
*** cmyster has joined #tripleo03:45
*** bfournie has quit IRC03:45
*** psahoo has joined #tripleo03:58
larsksEmilienM: when you're around again, the ci check on https://review.openstack.org/#/c/411048/ is failing due to package installation errors, possibly because the images being used were generated before https://review.openstack.org/#/c/409192/ merged. Does that seem likely? How often are new images built?04:00
openstackgerritLars Kellogg-Stedman proposed openstack/tripleo-heat-templates: implement a collectd composable service  https://review.openstack.org/41104804:00
openstackgerritMerged openstack-infra/tripleo-ci: Prepare TripleO CI for stable/ocata  https://review.openstack.org/42463704:02
*** sdake has quit IRC04:08
*** rlandy has quit IRC04:15
*** skramaja has joined #tripleo04:17
*** bfournie has joined #tripleo04:18
*** bfournie has quit IRC04:20
*** sdake_ has joined #tripleo04:40
*** sdake_ has quit IRC04:40
*** sdake_ has joined #tripleo04:40
*** gkadam has joined #tripleo04:46
*** yamahata has joined #tripleo04:56
*** prateek has joined #tripleo05:11
*** udesale__ has joined #tripleo05:17
*** udesale has quit IRC05:17
*** udesale has joined #tripleo05:19
*** udesale__ has quit IRC05:21
openstackgerritSaravanan KR proposed openstack/puppet-tripleo: Add support to changing the Rabbitmq password on update  https://review.openstack.org/40206105:39
*** sudswas__ has joined #tripleo05:47
*** sudipto has quit IRC05:50
*** sudipto_ has quit IRC05:50
*** sudipto has joined #tripleo05:50
*** abregman has joined #tripleo05:55
openstackgerritDan Trainor proposed openstack/puppet-tripleo: Proxy API endpoints that UI uses  https://review.openstack.org/42490905:57
openstackgerritDan Trainor proposed openstack/instack-undercloud: Add additional proxy and config endpoints for UI  https://review.openstack.org/42490305:59
*** nyechiel_ has joined #tripleo06:06
openstackgerritIan Wienand proposed openstack/diskimage-builder: Merge remote-tracking branch 'origin/master' into merge-branch  https://review.openstack.org/42498806:08
*** skramaja has quit IRC06:09
*** pgadiya has joined #tripleo06:10
*** nyechiel_ has quit IRC06:14
*** slagle has quit IRC06:15
*** jaganathan has joined #tripleo06:16
*** zoli|gone has quit IRC06:17
*** slagle has joined #tripleo06:17
*** zoli has joined #tripleo06:18
*** jpena|off has quit IRC06:18
*** jpena|off has joined #tripleo06:20
openstackgerritDan Trainor proposed openstack/instack-undercloud: Add additional proxy and config endpoints for UI  https://review.openstack.org/42490306:27
*** crenguta has joined #tripleo06:28
*** pgadiya has quit IRC06:30
*** dsneddon has quit IRC06:31
*** noama has joined #tripleo06:37
*** pgadiya has joined #tripleo06:41
*** gkadam is now known as gkadam|lunch06:47
*** Nisha_Agarwal has joined #tripleo06:50
*** yolanda has joined #tripleo06:51
*** udesale__ has joined #tripleo06:56
*** sdake_ has quit IRC07:01
*** nyechiel_ has joined #tripleo07:03
*** mrunge has quit IRC07:08
*** mrunge has joined #tripleo07:09
*** nmathew- has joined #tripleo07:09
*** nmathew has quit IRC07:11
*** nmathew has joined #tripleo07:12
*** sudipto_ has joined #tripleo07:13
*** sudipto has quit IRC07:14
*** jprovazn has joined #tripleo07:14
*** nmathew- has quit IRC07:14
*** sudswas__ has quit IRC07:14
*** sudipto has joined #tripleo07:14
*** jprovazn has quit IRC07:26
*** jprovazn has joined #tripleo07:26
*** pcaruana has joined #tripleo07:28
*** iranzo has joined #tripleo07:32
*** ealcaniz has joined #tripleo07:33
*** nmathew- has joined #tripleo07:33
*** tesseract has joined #tripleo07:34
*** nmathew has quit IRC07:35
*** ealcaniz has quit IRC07:37
*** ealcaniz has joined #tripleo07:38
*** masco has joined #tripleo07:39
openstackgerritJan Provaznik proposed openstack/tripleo-heat-templates: Deploy Manila with CephMDS in scenario004  https://review.openstack.org/42338607:41
*** dmacpher has quit IRC07:44
*** lblanchard has joined #tripleo07:46
openstackgerritMerged openstack/diskimage-builder: Update hpssacli to ssacli in proliant-tools element  https://review.openstack.org/39650407:48
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates: Dump and run puppet after each compute upgrade  https://review.openstack.org/42466107:49
*** yprokule has joined #tripleo07:50
*** aufi has joined #tripleo07:50
*** morazi has quit IRC07:51
*** panda|zZ is now known as panda07:51
*** ebarrera has joined #tripleo07:52
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates: Dump and run puppet after each compute upgrade  https://review.openstack.org/42466107:52
*** lblanchard has quit IRC07:57
*** jlinkes has joined #tripleo07:58
*** tremble has joined #tripleo07:59
*** tremble has joined #tripleo07:59
*** gkadam|lunch is now known as gkadam08:06
*** saneax-_-|AFK is now known as saneax08:06
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart: Add composable deployment config files and mixed release  https://review.openstack.org/41083108:07
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart: Add composable deployment config files and mixed release  https://review.openstack.org/41083108:11
*** abehl has joined #tripleo08:11
*** masco has quit IRC08:15
openstackgerritDougal Matthews proposed openstack/tripleo-common: Use the builtin Mistral engine command 'fail' to fail workflows  https://review.openstack.org/42504708:18
*** rasca has joined #tripleo08:18
*** shardy has joined #tripleo08:19
*** ealcaniz has quit IRC08:21
openstackgerritDougal Matthews proposed openstack/tripleo-common: Use the builtin Mistral engine command 'fail' when failing workflows  https://review.openstack.org/42504708:21
*** zoli is now known as zoli|wfh08:25
*** suuuper has joined #tripleo08:28
*** ealcaniz has joined #tripleo08:30
*** abregman has quit IRC08:32
openstackgerritDougal Matthews proposed openstack/tripleo-common: [Experimental] Use ad-hoc actions to reduce zaqar post duplication  https://review.openstack.org/42505608:38
openstackgerritDougal Matthews proposed openstack/tripleo-common: [Experimental] Use ad-hoc actions to reduce zaqar post duplication  https://review.openstack.org/42505608:41
openstackgerritDougal Matthews proposed openstack/tripleo-common: [Experimental] Use sub-workflows to reduce zaqar post duplication  https://review.openstack.org/42506008:47
*** abregman has joined #tripleo08:47
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart  https://review.openstack.org/41648008:48
*** sshnaidm|afk is now known as sshnaidm08:48
bandinihohum my undercloud installs are failing iwth some python2-pandas issue. anyone seen that?08:49
*** dsariel has joined #tripleo08:50
ccamachohi bandini not yet man08:51
bandiniccamacho: morning sir ;)08:51
bandinifull error is here ftr: http://paste.openstack.org/show/596382/08:51
bandiniin case anyone else is hitting it08:51
*** akrivoka has joined #tripleo08:52
*** lblanchard has joined #tripleo08:54
*** pgadiya has quit IRC08:54
*** iranzo has quit IRC08:54
*** bfournie has joined #tripleo08:54
*** jpich has joined #tripleo08:55
ccamachobandini Im asking to some RDO guys, let me see if they know something about it08:56
bandiniI just pinged in #rdo too08:56
bandinihopefully we get some love soon ;)08:56
*** b00tcat has joined #tripleo08:58
*** b00tcat has quit IRC08:58
*** b00tcat has joined #tripleo08:58
*** lblanchard has quit IRC08:58
d0ugalWhy does the undercloud need Pandas??08:58
bandiniprobably some weird dep (or because they are so *cute* ;)08:58
*** abregman has quit IRC08:58
d0ugallol08:58
d0ugalpandas is awesome, but se3ems very unrelated to what we are doing :-/08:59
bandinitotally, yeah08:59
ccamachoyeahp there08:59
*** zzzeek has quit IRC09:00
*** abregman has joined #tripleo09:00
*** zzzeek has joined #tripleo09:00
*** dtantsur|afk is now known as dtantsur09:02
*** cylopez has joined #tripleo09:03
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart: Add composable deployment config files and mixed release  https://review.openstack.org/41083109:07
*** pgadiya has joined #tripleo09:09
*** percevalbot has quit IRC09:10
*** jpena|off is now known as jpena09:11
*** pmannidi has quit IRC09:14
*** newmember has joined #tripleo09:14
*** florianf has joined #tripleo09:16
*** b00tcat has quit IRC09:20
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Fix logging issues for quickstart jobs  https://review.openstack.org/42263809:25
*** jpena is now known as jpena|off09:25
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Conntainers with multi-nic and net-iso  https://review.openstack.org/42244809:27
*** percevalbot has joined #tripleo09:27
*** hjensas has joined #tripleo09:27
*** lucas-afk is now known as lucasagomes09:27
*** percevalbot has quit IRC09:28
*** dsariel has quit IRC09:28
openstackgerritOpenStack Proposal Bot proposed openstack/instack: Updated from global requirements  https://review.openstack.org/42210009:28
*** limao has quit IRC09:31
*** jpena|off is now known as jpena09:31
*** percevalbot has joined #tripleo09:33
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart  https://review.openstack.org/41648009:35
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/42462709:38
openstackgerritSteven Hardy proposed openstack/tripleo-common: Add support for rendering j2.fragment files  https://review.openstack.org/42508609:39
*** mcornea has joined #tripleo09:39
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Disable puppet on upgrade for roles not upgrading  https://review.openstack.org/42490509:41
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart  https://review.openstack.org/41648009:41
shardymarios: Hey good morning, see ^^ for my first pass at the disable puppet thing09:43
shardymarios: basically I moved the application of puppet into major_upgrade_steps and used j2 to control which roles it runs on09:43
shardynot fully tested yet but feedback welcome09:43
shardymarios: it makes me wonder if we should have a different CLI option e.g openstack overcloud upgrade, which passes a flag in that influences the j2 templating (or a heat conditional)09:45
shardyAs the main disadvantage of this is we'll end up needing a converge update just to reset OS::TripleO::PostDeploySteps to puppet/post.yaml09:46
shardyI guess we can figure that out after this is proven though, as it's convenience not functional09:46
*** udesale__ has quit IRC09:47
*** udesale has quit IRC09:47
*** derekh has joined #tripleo09:47
*** fzdarsky_ is now known as fzdarsky|afk09:50
mariosshardy: o/ hey I had a first pass at https://review.openstack.org/#/c/424905/ and left some initial comments09:51
*** masco has joined #tripleo09:51
*** hewbrocca_afk is now known as hewbrocca09:52
*** athomas has joined #tripleo09:53
*** abregman has quit IRC09:53
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add snmp service support for composable upgrades  https://review.openstack.org/40525009:54
*** lblanchard has joined #tripleo09:54
*** fzdarsky|afk has quit IRC09:55
*** Nisha_Agarwal has quit IRC09:55
mariosshardy: i see the latest revision moves the puppet for upgrades out of the composable steps09:56
marioshttps://review.openstack.org/#/c/424905/2..3/puppet/post-upgrade.j2.yaml09:56
shardymarios: yeah, that was required because otherwise we don't serialize the upgrade->puppet steps correctly09:57
shardyunless we copy the entire fragment and mangle things with depends_on09:57
*** salmankhan has joined #tripleo09:57
shardyI think this approach is cleaner, what do you think?09:57
*** morazi has joined #tripleo09:57
mariosshardy: i see... in https://review.openstack.org/#/c/424905/2/puppet/major_upgrade_steps.j2.yaml we can't enforce a 'depends on' for example09:58
mariosshardy: me looking at latest version09:59
shardyas mentioned above, a further cleanup in future might be to move everything into post.j2.yaml but that will require additional data to tell us when an upgrade is happening09:59
*** lblanchard has quit IRC09:59
shardye.g from the CLI09:59
shardymarios: ack, yeah that was the problem - you can't do depends_on for the j2 include09:59
shardywell, you could, but it gets really ugly ;)10:00
*** pgadiya has quit IRC10:00
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras: Fixing setuptools version  https://review.openstack.org/42509710:02
openstackgerritSanjay Upadhyay proposed openstack/os-net-config: Remove child members activation for OVS-DPDK bond  https://review.openstack.org/42510110:07
*** dbecker has joined #tripleo10:08
openstackgerritSanjay Upadhyay proposed openstack/os-net-config: Remove child members activation for OVS-DPDK bond  https://review.openstack.org/42510110:09
*** pgadiya has joined #tripleo10:12
d0ugalLooks like CI is having issues.10:13
d0ugaloh, it's the pandas thing that was mentioned earlier :)10:14
pandad0ugal: new package is ready, it will be in place in ~1 hour10:15
*** dougbtv__ has quit IRC10:15
*** openstackgerrit has quit IRC10:17
*** skramaja has joined #tripleo10:18
*** nmathew has joined #tripleo10:19
*** openstackgerrit has joined #tripleo10:20
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras: Fixing setuptools version  https://review.openstack.org/42509710:20
jpichDid we figure out where the dep comes from?10:22
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add upgrade support for ceph OSD service  https://review.openstack.org/42335010:22
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add ironic service support for composable upgrades  https://review.openstack.org/40524810:22
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add telemetry service support for composable upgrades  https://review.openstack.org/40524910:22
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Skip upgrade steps where no tasks are defined  https://review.openstack.org/42338410:22
*** nmathew- has quit IRC10:23
*** nmathew- has joined #tripleo10:24
*** nmathew- has quit IRC10:24
*** tosky has joined #tripleo10:25
*** nyechiel_ has quit IRC10:29
*** owalsh-afk is now known as owalsh10:30
*** dougbtv__ has joined #tripleo10:31
*** abregman has joined #tripleo10:34
d0ugalpanda: great, thanks10:35
*** jpich has quit IRC10:35
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart: Add composable deployment config files and mixed release  https://review.openstack.org/41083110:36
*** dsariel has joined #tripleo10:37
*** b00tcat has joined #tripleo10:38
*** b00tcat has joined #tripleo10:38
b00tcatHi, I'm building the overcloud RHEL images for the Newton release and the --config-file flag that is passed to the "openstack overcloud image build" command seems to be deprecated somehow10:39
b00tcathow can I pass now YAML config files to the command?10:39
b00tcatis it through the image builder options?10:39
openstackgerritMarios Andreou proposed openstack/instack-undercloud: Adds release note for 6.0.0 Ocata release  https://review.openstack.org/42511310:40
d0ugalb00tcat: where does it say it is deprecated?10:40
sshnaidmpanda, we need a news ticker here with current status of CI10:40
*** gfidente has joined #tripleo10:40
*** gfidente has quit IRC10:40
*** gfidente has joined #tripleo10:40
b00tcatd0ugal: it doesn't "say so", but when using "-h" on "openstack overcloud image build" the option is just not there10:41
b00tcatd0ugal: and when I execute the command I get openstack overcloud image build: error: unrecognized arguments: --config-file /usr/sh...10:41
d0ugalb00tcat: oh, is --config-file new in Ocata?10:42
b00tcatd0ugal: ah, that might be it.. as the docs are only branched master I realized, no?10:43
d0ugalb00tcat: it was only added in October: https://github.com/openstack/python-tripleoclient/commit/aac64ef8c3148156edfc3d232e292f9fd249602710:44
gfidentejprovazn looks like it'd be worth have a single environment file which enables cephmds and manila/cephfs10:44
d0ugalb00tcat: I think the docs should also cover the current release, but I'm a bit confused about that.10:44
gfidentewdyt?10:44
b00tcatd0ugal: I suspect the docs only cover the current release (at least I didn't see a dropdown to check in between releases)10:45
b00tcatd0ugal: thanks for that link though, I'll try to see what was the equivalent before by looking at the history of the docs10:46
d0ugalb00tcat: some parts of the docs do cover stable - see the "Stable Branch" note here for example: http://docs.openstack.org/developer/tripleo-docs/basic_deployment/basic_deployment_cli.html#register-nodes10:46
shardyb00tcat: Yeah I think the docs are too new for your CLI, but you may be able to work around it by using the tripleo-build-images CLI tool directly10:46
d0ugalbut it wouldn't surprise me if that is only done in a few places.10:46
pandasshnaidm: we can make ooolpbot make regular announcement10:46
shardythat takes the same config-file option the openstack image build now takes IIRC10:47
sshnaidmpanda, yep, or just answering on "!status" command10:47
jprovazngfidente, yes, it would be nice - it would be nice to auto-include cephmds if ceph *and* manila is used10:47
shardyb00tcat, d0ugal: yeah we could add an admonition to the docs to explain this10:47
jprovazngfidente, but my understanding was that this is not possible and it's fine to include mds explicitly10:48
pandasshnaidm: regular is better, can't wait for ooolpbot state "keep calm and recheck" every hour when everything is ok10:48
b00tcatthanks shardy and d0ugal - also, I would put in the suggestions box to branch the docs as you do with everything else, that might be helpful for some people :)10:48
gfidentejprovazn yes I think we only need to figure how to split the env files so that it's still possible to have manila/cephfs with external ceph10:48
*** tosky has quit IRC10:48
shardyb00tcat: Yeah, we did discuss it but we have a hard time keeping up with reviews for tripleo-docs as it is, so we decided to have one branch with admonitions for now10:49
gfidentejprovazn as I understand it, we have one for ceph, one for mds and one for manila/cephfs now, is that correct?10:49
shardyb00tcat: if you'd like to push a patch with a note referring to the stable branch that would be very welcome :)10:49
jprovazngfidente, eventually there could be an additional extra env file for "manila with internal cephfs" which would include what cephmds and manila_native env files include10:49
jprovazngfidente, yes, the above three10:50
gfidentejprovazn so it sounds like we need to have two different env files for manila/externalmds and manila/managedmds10:50
b00tcatshardy: will do!10:50
shardyb00tcat: https://github.com/openstack/tripleo-docs is the repo, and you'll see there are existing stable branch admonitions you can use to highlight things that are different for stable releases10:50
*** nyechiel_ has joined #tripleo10:51
jprovazngfidente, supposing that managedmds means what I meant with "manila with internal cephfs", yes10:52
b00tcatshardy: ack10:52
gfidentejprovazn yep, that, would you add that?10:52
jprovazngfidente, sure10:53
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add ceph support to major upgrade job  https://review.openstack.org/42338310:53
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add Ironic support to major upgrade CI  https://review.openstack.org/42428710:53
shardyd0ugal: is there a solution to the pandas dep breakage?10:54
shardyCI is all broken now10:54
d0ugalshardy: Yeah, panda said there is a new package on its way10:55
*** lblanchard has joined #tripleo10:55
d0ugal10:15 <panda> d0ugal: new package is ready, it will be in place in ~1 hour10:55
d0ugalso ~20 mins to go10:55
shardyd0ugal: Ok, cool, I'll wait for recheck then, thanks!10:56
d0ugalnp10:56
* d0ugal didn't actually do anything10:56
* shardy doesn't see a bug, but assumes there is one somewhere10:56
*** yamahata has quit IRC10:56
jprovazngfidente, the existing environments/manila-cephfsnative-config.yaml should probably not be renamed for renaming backward compatibility10:57
gfidentejprovazn should we just add cephmds into storage-environment ? maybe commeting it out ?10:58
bandinishardy, d0ugal: sorry only got around doing it now. I opened https://bugs.launchpad.net/tripleo/+bug/1659260, once the rdo folks give us the green light I will close it10:59
openstackLaunchpad bug 1659260 in tripleo "python-pandas broken deps" [Undecided,New]10:59
jprovazngfidente, drawback would be that you are then expected to change a storage env file, instead of just combining existing env files10:59
bandiniapparently we're waiting on some cdn sync10:59
*** newmember has quit IRC11:00
*** lblanchard has quit IRC11:00
shardybandini: thanks!11:02
*** thrash|g0ne is now known as thrash11:06
owalshshardy: for j2 includes in t-h-t, I had a patch to use a custom j2 loader that fetches from swift. Works for relative paths IIRC11:08
shardyowalsh: Ok, nice - got a link?11:10
*** ooolpbot has joined #tripleo11:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165926011:11
*** ooolpbot has quit IRC11:11
openstackLaunchpad bug 1659260 in tripleo "python-pandas broken deps" [Critical,Triaged]11:11
owalshshardy: no, I'll need to dig out the repo. I'll post it once I find it :-)11:11
shardyowalsh: I've tested that patch and it works, but happy to improve it - making relative paths would be nice, and we could use the FileLoader in process-templates.py to do the same11:11
*** panda is now known as panda|afk11:12
shardyowalsh: Ok cool - if necessary we can always switch to that as a followup11:12
shardyI agree it'd be nice, I just didn't need it for this case11:12
owalshyea, I was looking at custom roles at the time and DRY11:13
shardyowalsh: how is the nova upgrade patch looking now?11:15
shardyI've been focussing on ceph/ironic/telemetry instead as it seemed we needed time to work out the cells stuff11:15
owalshshardy: which one :-)11:15
shardywhen you're ready we can revive https://review.openstack.org/#/c/421369/ and test it in CI11:16
shardyowalsh: the composable overcloud upgrades patch11:16
shardyhttps://review.openstack.org/#/c/405241/11:16
shardyI'm trying to get the stars aligned so we can land the remaining overcloud upgrade patches :)11:16
shardyslow progress this week due to CI issues11:17
owalshshardy: I think the final 2 ansible steps can go as puppet will handle it11:18
owalshshardy: but that's all that remains to do AFAICT11:18
shardyowalsh: yeah just commented - we can definitely remove step6, and yeah we can probably remove the DB sync too, although most other services do that atm11:18
shardypreviously we were trying to do everything in the ansible tasks, but starting the services just doesn't work as we need the new config from puppet in some cases11:19
shardyyou're right that we can probably remove all the DB syncs too, but lets just remove step6 and get it working, then we can have another patch which removes all the DB syncs and we can prove puppet does the right thing via CI11:20
shardyowalsh: Ok, thanks for the update, I'll test it locally then revive the CI patch when CI gets going again11:20
shardythanks!11:20
owalshshardy: the main db sync must stay, it's part of the cell v2 migration steps. The api db sync can be removed.11:21
shardyowalsh: ack - do you want to push another revision or shall I?11:21
shardyowalsh: thanks for your help with this, good to see it's close to working now11:21
owalshshardy: would you mind, I have to afk for a few minutes11:21
shardyowalsh: np, will do11:22
owalshshardy: thanks, I'll dig up that j2 loader code when I'm back online11:22
*** owalsh is now known as owalsh-afk11:23
*** chem has quit IRC11:24
lhindsping shardy11:25
*** dtantsur is now known as dtantsur|lunch11:27
*** chem has joined #tripleo11:28
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test dlrn logs  https://review.openstack.org/42435411:28
*** owalsh-afk has quit IRC11:28
*** paramite_ has joined #tripleo11:33
shardylhinds: hi!11:33
*** paramite has joined #tripleo11:33
lhindsThe AuditD patches are ready now, could I drop you an email with the links to reviews?11:34
lhindsshardy: forgot to tag you nick ^11:34
lhindsyou/your11:35
*** hjensas has quit IRC11:35
gfidentejtomasek can I go make changes into capabilities_map at will? :(11:35
gfidente;)11:35
shardylhinds: sure, but we may need to find some additional reviewers since I was a co-author on a couple of them11:35
jtomasekgfidente: you mean create a patch for it?11:35
lhindsshardy: thats true. I will try and ping some other cores too.11:36
jtomasekgfidente: or just locally to include some additional environment file?11:36
gfidentejtomasek yeah I wanted to see if I could add a particular combination of env files to deploy manila with cephfs11:36
gfidentejprovazn ^^11:36
*** hjensas has joined #tripleo11:37
jtomasekgfidente: both is possible, you just need to make sure you update the plan with changed capabilities map11:37
bandinisshnaidm: is https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/common_vars.bash#L31 the right line if I wanted to add a specific folder to be collected on all overcloud nodes?11:37
*** jkilpatr_ has quit IRC11:37
jtomasekgfidente: UI will then read it and display options according the changed capabilities map11:37
gfidentejtomasek so to enable ceph, i see that storage-environment.yaml has no-gui11:37
sshnaidmbandini, take into account that this command will run on undercloud too11:38
jtomasekgfidente: to configure parameters of that specific environment?11:38
gfidentejtomasek no in the capabilities_map it says no-gui11:38
* jtomasek checks11:38
gfidenteI was wondering if it's useful to have a smaller env file which is just meant to enable ceph?11:39
sshnaidmbandini, oh, wait, lemme check.11:39
jtomasekgfidente: it definitely is useful, yes, that is exactly the intent - to have small granular env files which enable certain features11:40
ansiwenCould someone +A that? https://review.openstack.org/#/c/39863411:40
bandinisshnaidm: thanks :)11:41
jtomasekgfidente: no-gui is ignored by UI anyway, please ignore it. and file a bug if you have time:)11:41
sshnaidmbandini, which folder do you want to save?11:41
ansiwenEmilienM: already awake? ^^^11:41
ansiwengfidente: you can +A, right?11:42
openstackgerritFlavio Percoco proposed openstack/python-tripleoclient: Deploy the undercloud with Heat  https://review.openstack.org/35135111:42
openstackgerritFlavio Percoco proposed openstack/python-tripleoclient: Add `--keep-running` flag to undercloud deploy  https://review.openstack.org/41449011:42
ansiwensorry for being pushy, I'm just very excited that this months long pain is so close to an end11:42
bandinisshnaidm: so I'd like to add /var/lib/pacemaker/cib/cib*raw which only exists on controllers11:43
bandiniit would help me debug any ha issues, quite a bit11:43
*** panda|afk is now known as panda11:44
*** chem has quit IRC11:44
*** chem has joined #tripleo11:44
bandinisshnaidm: so tar returns 2 if a folder does not exist. if that is a problem I'll need a different solution11:44
shardyansiwen: we can't approve it until https://bugs.launchpad.net/tripleo/+bug/1659260 is fixed or it'll just fail the gate checks11:48
openstackLaunchpad bug 1659260 in tripleo "python-pandas broken deps" [Critical,Triaged] - Assigned to Michele Baldessari (michele)11:48
ansiwenshardy: I see, thanks for the heads up11:49
shardyI'm sure we can approve it later today when that is fixed tho :)11:49
* bandini just updated that lp bug11:49
bandinipython-pandas is still broken11:49
shardyansiwen: FYI it's worth checking http://tripleo.org/cistatus.html11:49
ansiwenshardy: the champagne is ready here... ;-)11:49
shardyif it's all red, generally we've got issues and approving things won't be a good idea11:50
ansiwenshardy: yes, I do whenever I have CI issues11:50
*** larstobi has quit IRC11:54
*** jkilpatr has joined #tripleo11:54
*** gkadam has quit IRC11:55
*** larstobi has joined #tripleo11:56
*** lblanchard has joined #tripleo11:56
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Describe use of Manila/CephFS in capabilites_map  https://review.openstack.org/42514911:57
gfidentejtomasek jprovazn ^^ can you see how it looks?11:57
sshnaidmbandini, we have "set +e", so just try to add this path to TARCMD, and we'll see11:57
bandinisshnaidm: ack, thanks. Will do11:58
*** dtantsur|lunch is now known as dtantsur11:58
*** zoli|wfh is now known as zoli|lunch12:00
jprovazngfidente, great, thanks12:00
*** lblanchard has quit IRC12:00
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Describe use of Manila/CephFS in capabilites_map  https://review.openstack.org/42514912:01
*** lucasagomes is now known as lucas-hungry12:01
gfidentelucas-hungry when you are hungry, do you actually go to eat something?12:03
openstackgerritMichele Baldessari proposed openstack-infra/tripleo-ci: Collect /var/lib/pacemaker/cib/cib*raw in the tar files from nodes  https://review.openstack.org/42515112:03
jtomasekgfidente: I'll test it in a moment12:03
*** owalsh-afk has joined #tripleo12:05
*** owalsh-afk is now known as owalsh12:05
EmilienMhello12:06
*** ealcaniz has quit IRC12:06
bandini'lo EmilienM12:07
shardymorning EmilienM!12:08
matbuEmilienM: hello12:08
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Use the new hiera hook in all remaining templates  https://review.openstack.org/42515412:09
matbuEmilienM: i have made the BP you'were talking about yesterday, but it's the 1st i'm doing that, so probably full of mistake: https://blueprints.launchpad.net/tripleo-quickstart/+spec/tripleo-composable-upgrade-job12:09
mariosEmilienM: hey man, had a go at https://review.openstack.org/425113 cos i said I'd poke, i just went on git log. looks like reno support landed yesterday .. :) so there were no notes yet12:09
marioss/were/are12:09
gfidentejtomasek updated to fix a bit title/description12:10
*** fzdarsky has joined #tripleo12:10
*** d0ugal has quit IRC12:10
* matbu brb lunch12:10
*** ooolpbot has joined #tripleo12:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165926012:11
*** ooolpbot has quit IRC12:11
openstackLaunchpad bug 1659260 in tripleo "python-pandas broken deps" [Critical,Triaged] - Assigned to Michele Baldessari (michele)12:11
lhindsEmilienM: when you get a chance, this has the action addressed now: https://review.openstack.org/#/c/420040/12:11
*** paramite has quit IRC12:14
*** paramite_ has quit IRC12:14
*** pgadiya has quit IRC12:16
*** florianf has quit IRC12:16
*** masco has quit IRC12:17
*** d0ugal has joined #tripleo12:19
*** shardy is now known as shardy_lunch12:20
*** ealcaniz has joined #tripleo12:20
EmilienMmatbu: it would be great to have the blueprint under tripleo, not oooq12:22
EmilienMmatbu: please remove this one and do it in /tripleo (and desactivate blueprints / bugs in this launchpad)12:23
EmilienMmarios: ok I'll look12:23
EmilienMmarios: have you looked at release note logs, It's failing now.12:23
EmilienMmarios: and https://review.openstack.org/#/c/425113/1/releasenotes/notes/6.0.0_Ocata_release_notes-b0c79a6c67d67cf2.yaml12:24
EmilienMthis is unreadable ....12:24
EmilienMlhinds: puppet module is in RDO?12:25
lhindsEmilienM: yup, link in comment12:26
lhindsEmilienM: https://review.rdoproject.org/r/#/c/4474/12:26
EmilienMI don't see it in https://trunk.rdoproject.org/centos7-master/current/12:26
EmilienMlhinds: did you check it was built and it contains the right files?12:26
*** psahoo has quit IRC12:27
lhindsEmilienM: I will have to ping jpena and find out why12:27
*** florianf has joined #tripleo12:27
jpenalhinds: we're half-way through the process. You need to follow step 4 in https://www.rdoproject.org/documentation/rdo-packaging/#how-to-add-a-new-package-to-rdo-trunk12:28
lhindsjpena: ok, got you12:28
*** rbowen has quit IRC12:29
lhindsjpena: why the need for a second spec review in bugzilla too?12:31
EmilienMtrown, adarazs, I thought we agreed on moving bugs from oooq into tripleo and I still see https://bugs.launchpad.net/tripleo-quickstart -- can you please give an update?12:31
mariosEmilienM: ok will have another pass later then12:32
jpenalhinds: it seems to be a legal thing, to make sure some boxes are ticked if there's a later import into RHOSP12:32
EmilienMtrown, adarazs: the main reason is milestone target with other projects in TripleO12:32
EmilienMmarios: thx12:32
*** ccamacho is now known as ccamacho|lunch12:33
openstackgerritAnshul Jain proposed openstack/diskimage-builder: Update to python-brickclient element to accommodate python2/3 changes  https://review.openstack.org/42516212:35
*** sudipto has quit IRC12:39
*** sudipto_ has quit IRC12:39
*** pkovar has joined #tripleo12:39
lhindsjpena: just seen this: https://bugzilla.redhat.com/show_bug.cgi?id=1408254#c312:39
openstackbugzilla.redhat.com bug 1408254 in Package Review "Review Request: puppet-systemd - puppet module to customize systemd services" [Unspecified,Assigned] - Assigned to amoralej12:39
lhindsjpena: trozet 's comment12:39
*** pradk has joined #tripleo12:40
jpenalhinds: mmm... that rdoinfo review shouldn't have been approved before approving the bz12:43
*** rbowen has joined #tripleo12:43
*** sdake has joined #tripleo12:45
lhindsjpena: did you see the comment about spec files being auto created from metadata.json file?12:45
lhindsjpena: I honestly don't mind putting them up, its just I have a new machine and don't have build tools set up yet :-/12:46
jpenalhinds: yes, that's why there is no need to add the spec at the beginning. But we need it to close the bug12:46
lhindsjpena: understood, and np. Is there a SPRM I can pull down from anywhere, just to save me setting up mock for now?12:47
*** nmathew- has joined #tripleo12:48
lhindsI have the spec file posted now.12:48
-openstackstatus- NOTICE: Gerrit is going to be restarted due to slow performance12:48
jpenain these cases, we add the link to the approved spec, in the case puppet-auditd of it's https://raw.githubusercontent.com/rdo-packages/puppet-auditd-distgit/rpm-master/puppet-auditd.spec12:48
jpenafor the srpm, we use the latest built one by the CI in the spec review, let me find the url12:48
jpenalhinds: http://46.231.132.68:8080/v1/AUTH_b50e80d3969f441a8b7b1fe831003e0a/rdoartifacts/74/4474/2/gate/DLRN-rpmbuild/Z48d2593e240b40749270a241f9de9580/artifacts/centos/repos/cb/ed/cbeda30952eaa244785082be5fdcd85f47c2f0bf_dev/puppet-auditd-2.2.0-0.20170124164949.cbeda30.el7.centos.src.rpm12:49
lhindsjpena: thx!12:49
*** zoli|lunch is now known as zoli|wfh12:50
-openstackstatus- NOTICE: Gerrit has been successfully restarted12:51
*** nmathew has quit IRC12:51
*** nmathew- has quit IRC12:55
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Fix logging issues for quickstart jobs  https://review.openstack.org/42263812:55
*** lblanchard has joined #tripleo12:57
*** sshnaidm is now known as sshnaidm|afk12:57
*** rbowen has quit IRC12:58
*** lucas-hungry is now known as lucasagomes13:00
lucasagomesgfidente, lol yes13:00
*** lblanchard has quit IRC13:01
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras: Fix ansible-lint.sh script for roles.  https://review.openstack.org/42178813:04
*** ealcaniz has quit IRC13:06
*** ansmith has joined #tripleo13:06
*** ealcaniz has joined #tripleo13:06
*** arxcruz has quit IRC13:08
*** arxcruz has joined #tripleo13:10
*** ooolpbot has joined #tripleo13:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165926013:11
*** ooolpbot has quit IRC13:11
openstackLaunchpad bug 1659260 in tripleo "python-pandas broken deps" [Critical,Triaged] - Assigned to Michele Baldessari (michele)13:11
*** rbowen has joined #tripleo13:12
*** ccamacho|lunch is now known as ccamacho13:19
*** katkapilatova has joined #tripleo13:20
*** sshnaidm|afk is now known as sshnaidm13:21
bandiniok I think with python2-pandas-0.19.1-2.el7.2.x86_64 in the repos the bug above is fixed for me (at least the undercloud install is fine now)13:21
* bandini removes alert and will close once a couple of jobs pass13:22
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart: Add composable deployment config files and mixed release  https://review.openstack.org/41083113:22
ccamachobandini yeahp I think my UC is about to finish and no pandas error yet..13:23
bandiniccamacho: nice ;)13:23
gfidentewhoever reviews https://review.openstack.org/#/c/407039/ gets free hugs13:24
gfidenteand I promise it's not a complicated one13:24
bandinidamn, I already reviewed that one13:25
bandinino free hugs for bandini!13:25
trownEmilienM: we have a bug triage call for quickstart today, we can use that to move over... I now we talked about doing it, but didnt know it was priority13:26
*** jayg|g0n3 is now known as jayg13:26
*** shardy_lunch is now known as shardy13:26
EmilienMtrown: it's not urgent13:26
EmilienMtrown: it's a good to have13:26
pandatrown: when ?13:27
*** rlandy has joined #tripleo13:27
trownpanda: oh... that is on friday13:27
pandatrown: and was canceled ...13:28
trownpanda: friday 4pm UTC13:28
pandatrown: you still have it on the calendar ?13:29
trownpanda: ya it is on my calendar... rlandy ^ is still on?13:29
matbuEmilienM: i retarget the BP, should be good now, https://blueprints.launchpad.net/tripleo/+spec/tripleo-composable-upgrade-job13:29
openstackgerritJaganathan Palanisamy proposed openstack/os-net-config: Network service is failing with DPDK  https://review.openstack.org/42244913:30
rlandytrown: panda: missed which exact meeting you are talking about. Friday this week, we have a bug triage, Friday two weeks time, we have retrospective13:31
EmilienMmatbu: awesome, thx13:31
*** liverpooler has quit IRC13:31
trownrlandy: perfect that is what I was looking to confirm... panda thought bug triage is cancelled13:32
*** liverpooler has joined #tripleo13:32
florianfjtomasek: I'd like to continue with the i18n patch for notifications. Do you have time to have a look at the latest patch set and see if it answers the concerns you had? https://review.openstack.org/#/c/419469/13:32
rlandytrown: weshay wanted only core members on the bug triage13:32
panda...13:32
jtomasekflorianf: ok, will take a look in a moment, I'll just finish something13:33
*** udesale has joined #tripleo13:33
florianfjtomasek: Thanks!13:33
rlandypanda: before the whole TC thing, I was unaware that most people had officially moved teams and that RDO-CI was left with around 6 people13:34
gfidentebandini can you ask for me13:35
gfidentemaybe they are more willing to accept your hughs13:35
gfidente*hugs13:36
ansiwenso, is it correct, that tripleo CI directly depends on RDO packages, which again are not gated by tripleo tests? to guarantee stability, wouldn't  it be necessary to only use "tripleo-tested" packages in CI? probably you will tell me now, that this is already the case... >_<13:38
*** rhallisey has joined #tripleo13:38
*** fultonj has joined #tripleo13:40
*** jlinkes has quit IRC13:40
derekhansiwen:  that this is already the case13:41
bkerosmall meeting13:41
derekhansiwen: tripleo ci depends on a snapshot of RDO packages that have passed periodic tripleo tests13:41
derekhansiwen: layered on top of those RDO packages we use the most recent package for projects that gate on tripleo ci13:42
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419013:44
ccamachojust checked https://review.openstack.org/#/c/407039/ gfidente http://i.imgur.com/cmDuckN.gif13:45
openstackgerritFlavio Percoco proposed openstack/tripleo-quickstart-extras: WIP: Use openstack deploy to install the undercloud  https://review.openstack.org/41904013:45
gfidenteccamacho priceless13:46
gfidentethanks13:46
*** jmelvin has joined #tripleo13:47
*** mcornea has quit IRC13:47
*** mcornea has joined #tripleo13:48
ansiwenderekh: thanks for the explanation! how can the python-panda problem happen then, for example?13:48
pandaansiwen: because we update to the latest available packages every run13:49
trownlol panda I bet you love this python-panda issue :{13:49
pandamy irc client is on fire13:50
ansiwenpanda: latest available tripleo-gated package, or lastest RDO package?13:50
openstackgerritLuke Hinds proposed openstack/tripleo-heat-templates: Add release notes for Ocata 6.0.0  https://review.openstack.org/42436513:50
derekhI'm not familiar with the problem just jumped in to answer your question,13:50
*** jpena is now known as jpena|lunch13:50
derekhif we don't gate on python-panda we shouldn't update to latest every time (13:51
pandaansiwen: latest RDO packages13:51
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo: Fix wrong hiera key in ceph_rbdmirror  https://review.openstack.org/42518213:51
* derekh will bbiab13:51
*** dmarlin_ has quit IRC13:52
ansiwenpanda: so we updated to ungated packages... so that seems to be a problem in my eyes...13:52
*** ipsecguy has quit IRC13:53
pandaansiwen: I don't think python-pandas (I swear I have nothing to do with it) is directly included in the list of packages to update13:54
*** ansmith has quit IRC13:55
bandinipanda: do we know why we hit the packaging issue today? maybe some odd dependency?13:56
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras: Remove hardcoded instances of `stack` from roles  https://review.openstack.org/42146313:56
pandaansiwen: IIUC python-pandas was a new package created as a dependency to gnocchi, we always include the repo with the latest packages , set a priority to it limited to the packages we want13:56
pandaso, what I think it happened is that a package we catually include, was depending on python-pandas, and the latest version was the only one available13:57
pandaand it was broken13:58
EmilienMpanda: sshnaidm, do we know why promotion is blocking today?13:59
pandaEmilienM: because of python-pandas13:59
EmilienMpanda: !!!!!!13:59
EmilienMpanda: your fault!13:59
sshnaidmEmilienM, because of those pandas13:59
*** panda is now known as notpython-panda13:59
EmilienMlol13:59
EmilienMpanda, sshnaidm: what is the status on the rpm + deps?13:59
notpython-pandaEmilienM: looks like it is fixed14:00
EmilienMpanda: can we run a manual promotion job please?14:00
notpython-pandaEmilienM: by all means14:00
* apetrich writes a python-gabrielle and adds as a requirement14:00
notpython-pandaapetrich: with a single "l"14:01
*** ipsecguy has joined #tripleo14:01
gfidenteEmilienM I think this needs a rebase https://review.openstack.org/#/c/423526/ ?14:01
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK or REVIEW: periodic jobs  https://review.openstack.org/35921514:01
shardyIt is confusing how this passed promotion, as we don't include python-gnocchi or anything it depends on in the delorean-current whitelist14:01
*** dmsimard|off is now known as dmsimard14:02
EmilienMshardy: pandas package is not part of promotion pipeline AFIK14:02
EmilienMshardy: it's in delorean deps14:02
notpython-pandashardy: openstack-gnocchi-indexer-sqlalchemy depends on python-pandas14:02
notpython-pandaoh14:02
EmilienMshardy: and in the future, it will be part of promotion pipeline, with RDO cloud14:03
EmilienMthat's all I know :D14:03
*** jcoufal has joined #tripleo14:03
EmilienMgfidente: ok?14:03
EmilienMgfidente: no rebase14:03
shardyEmilienM: Ok, so we're only pinning delorean and not delorean-deps14:03
EmilienMgfidente: stable/newton is currently red, and i'm on it14:03
shardythat explains it14:03
notpython-pandayeah, that explains it, delorean-dep is usually a source of problems ..14:03
EmilienMgfidente: it will be fixed by https://review.openstack.org/42481114:03
EmilienMnotpython-panda: all the time14:03
EmilienMand RDO folks knows it14:04
EmilienMit will (or should) be fixed in Pike14:04
gfidenteEmilienM oh the error said it depended on a change that failed to merge so I thought it was a rebase issue14:04
EmilienMlet me rebase it so you'll see green CI14:04
EmilienMgfidente: ah I already did it14:04
gfidenteah okay14:04
gfidenteso that's why14:04
gfidentecool14:05
*** notpython-panda is now known as panda14:05
*** dmarlin_ has joined #tripleo14:05
EmilienMshardy: quick question, do we want to enable voting on upgrde job?14:05
EmilienMshardy: is it reliable enough?14:05
shardyEmilienM: it's been broken by non-upgrade things for the last two days, so I think we need to get it working again and monitor it14:05
*** bfournie has quit IRC14:05
EmilienMshardy: ok14:05
shardybefore these regressions it was working great for a week14:05
EmilienMshardy: during CI freeze, I would be OK to make an exception on this job14:06
shardyI'll monitor it and we can revisit the decision next week after o314:06
EmilienMworks for me14:06
shardyEmilienM: Ok, yeah I think it'd be good to get it voting soon14:06
EmilienMshardy: maybe an email to openstack-dev to let our reviewers know about this job14:06
apetrichpanda, sorry14:06
shardyEmilienM: ack, yeah as when it's passing again later I'll email openstack-dev with an explanation of what it tests (and current limitations e.g all in one)14:07
EmilienMok14:07
sshnaidmshardy, which job is it?14:07
shardysshnaidm: gate-tripleo-ci-centos-7-multinode-upgrades-nv14:07
shardysshnaidm: it does an all-in one deploy of a newton overcloud, then upgrades it to ocata14:08
shardywhich somewhat proves the new composable upgrades code14:08
sshnaidmshardy, ok14:08
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Adds a AllNodesPreUpgradeConfig before the upgrade steps  https://review.openstack.org/41988614:10
mariosshardy: rebased onto your disable puppet ^^ when you get a chance thanks14:10
*** pradk has quit IRC14:11
shardymarios:  ack will do14:12
*** zzzeek has quit IRC14:12
*** Goneri has joined #tripleo14:13
*** zzzeek has joined #tripleo14:14
*** jaganathan has quit IRC14:16
openstackgerritDan Radez proposed openstack/tripleo-heat-templates: adding Congress Support  https://review.openstack.org/33005014:16
*** pkovar has quit IRC14:17
chemgfidente: hi, for ocata what is the targeted ceph release ?14:17
b00tcatI had a running overcloud (everything by default), then I customized the base images, uploaded them to the undercloud's image service and tried to redeploy the overcloud14:18
*** hjensas has quit IRC14:18
b00tcathowever I got this: Node uuid=fe0e4ccd-8133-448c-93ff-7310dbb88df6 has an incorrectly configured driver_info/deploy_kernel. Expected "6e05b081-4f53-453e-8209-d55ca7214:18
b00tcat4e1f0" but got "08470890-1b9b-463b-9904-14bd2d610516".14:18
b00tcatI had to removes the nodes from ironic, and only then I was able to redeploy the overcloud with my custom base images14:18
b00tcatis this normal? I remember this not happening in Mitaka (in Newton now)14:19
*** skramaja has quit IRC14:19
shardyb00tcat: did you change the deploy kernel/ramdisk and forget to run openstack baremetal configure boot again?14:19
*** ansmith has joined #tripleo14:20
shardyb00tcat: you shouldn't need to remove the nodes, but if you do ironic node-show on them you'll see there's a ramdisk and kernel ID there which I assume was wrong14:20
b00tcatshardy: right, I re-uploaded *all* images (including those)14:21
b00tcatshardy: that makes sense, thanks!14:21
*** dprince has joined #tripleo14:21
shardyb00tcat: also make sure you use openstack overcloud image upload not glance directly14:21
*** zoli|wfh is now known as zoli|afk14:22
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: [build-test-packages] combine all methods of providing changes  https://review.openstack.org/42491414:22
EmilienMNg: are we on track for https://bugs.launchpad.net/tripleo/+bug/1649695 ?14:22
openstackLaunchpad bug 1649695 in tripleo "Fencing configuration should be automatically generated" [Medium,In progress] - Assigned to Chris Jones (cmsj)14:22
NgEmilienM: I believe so, I need to talk some more with thrash and rbrady, but the tripleo-common part has two +2s and is waiting on CI to pass, and I'm getting the tripleoclient part back in shape after some changes to the -common part last night14:23
EmilienMhttps://review.openstack.org/#/c/417898/ is very red14:23
Ngyeah that's the part I'm working on right now14:24
EmilienMNg: quick reminder, we aim to release python tripleoclient *tomorrow*14:24
EmilienMNg: please let me know if any blocker14:24
NgEmilienM: yep. what sort of time are you looking at doing that?14:24
socialEmilienM: can you have look at https://review.openstack.org/#/c/422610/14:24
gfidentechem still jewel14:25
EmilienMNg: I don't get the question14:25
NgEmilienM: I mean roughly which part of tomorrow will the release happen?14:25
EmilienMsocial: done14:25
EmilienMNg: my end of afternoon14:25
Ngok14:26
Ngthanks14:26
socialEmilienM: thanks14:26
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Replace multinode playbook with default quickstart playbook  https://review.openstack.org/42468314:26
socialEmilienM: I'm making backport for newton14:27
EmilienMthrash: are we still on track for https://bugs.launchpad.net/tripleo/+bug/1638697 ?14:27
openstackLaunchpad bug 1638697 in tripleo "tripleoclient checks and validations should be mistral actions" [High,In progress] - Assigned to Brad P. Crochet (brad-9)14:27
thrashEmilienM: part of it is implemented. But not really the bug itself.14:27
*** lblanchard has joined #tripleo14:28
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: [build-test-packages] combine all methods of providing changes  https://review.openstack.org/42491414:28
EmilienMthrash: should we postpone its target to pike-1 with ocata-backport-potential tag?14:28
chemgfidente: thanks14:28
thrashEmilienM: +114:29
EmilienMthrash: ok doing it.14:29
thrashEmilienM: It's not critical.14:29
EmilienMthrash: ok14:29
Ngthrash: morning :) would you have time in about an hour to talk about my patches? :)14:30
thrashNg: probably not until about 11:30am EST.14:31
Ngthrash: ok, that works :)14:31
thrashNg: ack14:31
openstackgerritAlejandro Andreu proposed openstack/tripleo-puppet-elements: Install Curator from RPM in MidoNet element  https://review.openstack.org/42520514:32
EmilienMbandini: https://blueprints.launchpad.net/tripleo/+spec/composable-ha - is there any code to write? or is it only patches ready for review?14:33
bandiniEmilienM: two patches left to review/merge. I will bang on scenario005 today and once it is green we can +A both, I'd say14:34
EmilienMbandini: ok I'll change status of blueprint to "Need review"14:35
EmilienMbandini: I think patches will get merged very soon if not today14:35
bandiniack14:35
*** udesale has quit IRC14:36
openstackgerritLukas Bezdicka proposed openstack/puppet-tripleo: [keepalived] fix netmask for vip  https://review.openstack.org/41857714:36
EmilienMlarsks: doing recheck and +2 on https://review.openstack.org/#/c/41104814:36
*** pkovar has joined #tripleo14:36
EmilienMlarsks: I think I missed your ping last night, what's up?14:37
EmilienMtrozet, fpan: are we still on track for https://review.openstack.org/#/c/424426/ and https://blueprints.launchpad.net/tripleo/+spec/fdio-integration-tripleo ?14:38
socialEmilienM: pls manifests/pacemaker/haproxy_with_vip.pp14:38
socialgrr14:38
socialEmilienM: pls https://review.openstack.org/#/c/418577/14:39
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates: Ignore systemctl return code in yum_update.sh  https://review.openstack.org/42520914:39
*** bfournie has joined #tripleo14:40
fpanEmilienM: it's taking a while to get puppet-fdio package reviewed so I haven't started integrating VPP service in puppet-triple and tht yet, so I do think it'll be a while14:41
larsksEmilienM: I think maybe you've already addressed it.  I was asking about the CI failures last night, which were due to packages missing on the overcloud.  I assume that was because the images hadn't been built after that puppet-elements change merged?14:42
EmilienMfpan: pike-1 then14:42
fpanEmilienM: It would be fine to push it out to next release14:42
EmilienMlarsks: yes14:42
fpanEmilienM: sounds good, thanks14:42
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras: [WIP] Send mail tool  https://review.openstack.org/42334014:43
EmilienMlarsks: ok, let me know if anything14:43
*** cdearborn has joined #tripleo14:43
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: [build-test-packages] combine all methods of providing changes  https://review.openstack.org/42491414:44
EmilienMlucasagomes: https://blueprints.launchpad.net/tripleo/+spec/switch-to-virtualbmc14:45
EmilienMare we on track? I see some patches in bad shape now14:45
EmilienMdtantsur: ^14:45
EmilienMpike-1 or FFE request for ocata?14:45
* dtantsur defers to lucasagomes 14:46
lucasagomesEmilienM, yeah apparently we don't need to install it in the overcloud as dtantsur pointed out (I will abandon those patches)14:46
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: [build-test-packages] combine all methods of providing changes  https://review.openstack.org/42491414:46
lucasagomesEmilienM, other than that, tripleo-quickstart and RDO should already be good for it except for ironic in the overcloud14:46
EmilienMlucasagomes: so? blueprint implemented ?14:47
lucasagomesEmilienM, not sure if there's any other place where we depend on *_ssh drivers directly14:47
*** abehl has quit IRC14:47
shardymatbu, marios: Hey so https://review.openstack.org/#/c/423160/ conflicts with https://review.openstack.org/#/c/424905/14:47
EmilienMlucasagomes: I'll let you update the blueprint please14:47
shardyI was hoping https://review.openstack.org/#/c/423160/ and the following patches would land yesterday or today, but if they don't, I can rebase those into one branch so folks can test easier14:47
EmilienMdprince: https://blueprints.launchpad.net/tripleo/+spec/heat-undercloud do we want to postpone it to pike?14:48
lucasagomesEmilienM, unless I'm missing other places where the ssh driver is used that I don't know about14:48
lucasagomesEmilienM, does the tripleo-ci uses quickstart ?14:48
shardyI just didn't really want to put more patches ahead of the ceph/ironic ones as I know those work14:48
EmilienMlucasagomes: it's in progress14:48
EmilienMlucasagomes: but we don't gate on it yet14:48
lucasagomesEmilienM, right, you gate on instack ? or ... ?14:48
dprinceEmilienM: sure, WHen I say "finished by Ocata" I think I really mean we'll have it in trunk by the Ocata release, no need to actually backport these patches into Ocata proper14:49
dprinceEmilienM: and nobody is asking for this in Ocata anyways. In fact nobody asked me to build a containerized undercloud. I just want it14:49
dprinceEmilienM: so bump away14:49
EmilienMlucasagomes: yes14:50
EmilienMdprince: bump away means? postpone? close it?14:51
dprinceEmilienM: bump it to pike14:51
EmilienMas long as we don't gate on it, I don't think we can considered as implemented14:51
EmilienMyes, it makes sense14:51
EmilienMdprince: thx14:51
lucasagomesEmilienM, ok, and the idea is to replace it with ooo-quickstart next cycle ? if not, I suspect we need to change instack-undercloud to use the ipmitool drivers14:52
EmilienMlucasagomes: yes14:52
dprinceEmilienM: I don't think we are that far from CI, once it works locally for me I will push hard on this.14:52
dprinceEmilienM: having CI on a partial undercloud is sort of difficult fwiw14:52
*** rbrady is now known as rbrady-brb14:52
lucasagomesEmilienM, ok. So it's grand. The ssh driver will stay in the Ironic tree for one more cycle ( we couldn't change the grenade job to use ipmitool yet)14:52
EmilienMdprince: we are never far from there, it's just ocata-3 is next week, we need to keep realistic.14:52
lucasagomesand considering ooo-quickstart is already updated we should be good14:53
EmilienMlucasagomes: ok, please update the bp14:53
lucasagomesEmilienM, will do14:53
mariosshardy: looking14:54
weshaydprince, EmilienM to get it properly into CI we need to make sure we're not checking out src in the CI and not running as root14:54
EmilienMweshay: YOU. I was about pinging you14:54
EmilienMweshay: status on https://blueprints.launchpad.net/tripleo/+spec/use-tripleo-quickstart-and-tripleo-quickstart-extras-for-the-tripleo-ci-toolset ?14:54
weshaylolz14:54
EmilienMweshay: pike-1?14:55
mariosshardy: can we get away with a simpler approach (e.g.a  single softwareconfig to deal with the ceph-mon as before which uses the native batch?14:55
weshayso I think we are in pretty good shape.. we have successful runs of multinode nodepool + oooq for about a week now14:55
weshayovb has been solid14:55
EmilienMweshay: do you want to set it as Implemented? do we cover all items?14:56
shardymarios: not really because we have no way of knowing which role the ceph-mon is running on?14:56
weshaypanda, and I are creating list features currently covered by tripleo-ci and which oooq jobs will cover them14:56
*** salmankhan has quit IRC14:56
shardymarios: we probably could reduce the number of batch steps to two though14:56
*** jpena|lunch is now known as jpena14:56
shardymarios: I was thinking we could possibly look at moving some other services which support rolling upgrades to that interface over time, hence leaving the extra steps14:57
weshayhrm.. EmilienM maybe we can set it as implemented.. need to see what trown thinks14:57
EmilienMI'll let you some time to think14:57
EmilienMplease ping me when done14:57
shardybut we could probably validate the actual number of steps needed during plan creation and avoid the empty steps14:57
openstackgerritOliver Walsh proposed openstack/tripleo-common: Add support for jinja2 includes  https://review.openstack.org/42522014:57
* trown thinks targeting to pike-1 is better14:57
trown"Use TripleO-Quickstart-Extras as the CI tool set for TripleO-CI." is not complete14:58
trownit is in progress14:58
openstackgerritJames Slagle proposed openstack/instack-undercloud: Remove setup-neutron  https://review.openstack.org/42522214:59
EmilienMtrown: ok14:59
EmilienMpike-114:59
*** sai is now known as smalleni14:59
shardymarios: also note https://review.openstack.org/#/c/423384/ which skips the batch steps completely for roles where there's nothing using them14:59
yolandahi, asking for more reviews... https://review.openstack.org/419486, https://review.openstack.org/420698. They already have +2 from EmilienM14:59
mariosshardy: looking14:59
*** suuuper has quit IRC14:59
mariosshardy: i have to go afk for a while will be biab15:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates: Ignore systemctl return code in yum_update.sh  https://review.openstack.org/42520915:00
*** udesale has joined #tripleo15:00
*** smalleni is now known as sai15:00
*** sai is now known as smalleni15:00
*** suuuper has joined #tripleo15:01
ansiwenEmilienM: CI seems green again, would you do me the last favor of a +A? https://review.openstack.org/#/c/39863415:01
matbushardy: hey how many are you behind your laptop :), i can't follow all your stuffs :)15:01
EmilienMansiwen: let me look15:01
EmilienMansiwen: approved. congrats!15:02
*** dougbtv__ is now known as dougbtv15:02
EmilienMansiwen: now we need to patch zuul/layout.yaml in project-config to add ec2 profiles for scenario002. Do you need help?15:03
ansiwenEmilienM: \o/ thanks!15:03
yolandatrown, thx15:03
EmilienMansiwen: example: https://review.openstack.org/#/c/424710/15:03
*** pkovar has quit IRC15:03
EmilienMansiwen: please do it for scenario002/ec2api and add me as reviewer or ping me15:03
*** dtantsur is now known as dtantsur|brb15:04
trownyolanda: ya, I will check on the other one a bit later... want to make sure CI actually built an image for that patch before merging15:04
ansiwenEmilienM: ok!15:04
trownyolanda: the first one was easier :)15:04
shardymatbu: hehe, sorry ;)15:04
shardymatbu: I hope we can just land some of it today, then I'll rebase everything that remains onto one branch tomorrow15:05
*** ealcaniz has quit IRC15:05
*** tzumainn has joined #tripleo15:05
*** crenguta has quit IRC15:05
*** thrash is now known as thrash|biab15:05
*** pkovar has joined #tripleo15:06
*** ealcaniz has joined #tripleo15:06
EmilienMansiwen: if you could add tripleo scenario job to puppet-ec2 too, that would be awesome but if you don' tknow, I'll do it15:08
*** egafford has joined #tripleo15:08
openstackgerritMartin AndrĂ© proposed openstack-infra/tripleo-ci: Allow to use an RDO review to fix a packaging issue  https://review.openstack.org/38879115:08
shardyansiwen: also if you can pls post a followup that adds upgrade_tasks for the ec2api that would be great15:08
*** suuuper has quit IRC15:09
shardyansiwen: good work on getting that patch finished tho :)15:09
*** salmankhan has joined #tripleo15:10
*** jaosorior has joined #tripleo15:10
*** karimb has joined #tripleo15:11
ansiwenshardy: thanks, it was an embarrasingly long journey, but I'm glad I finished it eventually. :-)15:12
openstackgerritKaterina Pilatova proposed openstack/tripleo-validations: prevent validations from failing  when undercloud.conf is missing:  https://review.openstack.org/40709815:13
*** zoli|afk is now known as zoli|wfh15:13
*** saneax is now known as saneax-_-|AFK15:15
chemmatbu: for upstream upgrade setting the repo http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tripleo/delorean.repo should do it right ?15:17
slaglebnemec: re: https://review.openstack.org/#/c/290571/, since we deprecated in Newton, can't we remove the keystone init in Ocata?15:18
slaglei was thinking i'd remove this code in ocata, but the comment indicates it should stay until pike?15:19
slagleif we remove this code, i think we can also deprecated os-cloud-config entirely15:19
slagleand then kill that in pike15:20
bnemecslagle: Backwards compatibility.  If someone is using an Ocata undercloud to manage a Newton overcloud deployed before the deprecation it would break if we remove that.15:21
bnemecslagle: We could deprecate os-cloud-config anyway though.15:22
bnemecIf we're anticipating it going away in Pike it seems fine to deprecate it now.15:22
*** arxcruz has quit IRC15:23
slaglebnemec: how would it break if the newton cloud is already deployed15:24
shardybnemec: note the upgrades job does deploy a newton overcloud with an ocata undercloud, so we'll need to keep that working15:24
matbuchem: yep15:24
slaglethe keystone init via puppet was in newton15:24
shardyslagle: Ok, cool, no problem then15:24
* shardy couldn't remember exactly when it landed15:25
*** thrash|biab is now known as thrash15:26
bnemecslagle: True, so I guess the only issue would be deploying a back-level set of newton templates with an ocata undercloud which is...unlikely.15:26
EmilienMjtomasek: https://blueprints.launchpad.net/tripleo/+spec/deployment-configuration-improvements - are we on track? what items need to be done?15:27
*** arxcruz has joined #tripleo15:27
bnemecI'd still rather just leave it to be safe, but if there's a reason to get rid of it I could live with it.15:27
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Ensure basic Ceph configuration is performed by RBD mirror  https://review.openstack.org/42523615:27
*** rajinir has joined #tripleo15:27
jtomasekEmilienM: it should be all done now. (last of the patches merged yesterday. I'll update the blueprints accordingly15:28
slagleEmilienM: where does multinode netconfig live in tht?15:28
slagleEmilienM: i still see it in tripleo-ci15:28
slagleand the templates still refer to the netconfig from tripleo-ci15:28
slaglebnemec: ok. well i'll just deprecate os-cloud-config, and we can remve this keystone init in pike15:29
bnemecslagle: That sounds good.  We can't drop occ until then anyway.15:30
EmilienMslagle: I'm working on the move15:30
*** nyechiel_ has quit IRC15:30
slagleoh, so you went ahead and -1'd my patch anyway :)15:31
slaglethis has been out there since the first week of december15:31
EmilienMslagle: https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/multinode.yaml#L2-L315:31
EmilienMslagle: sorry. If you want I can take care of the move of your patch15:31
slagleEmilienM: go for it15:32
EmilienMok I'll15:32
EmilienMslagle: can we close your blueprint?15:33
slagleEmilienM: that's up to you. it's not done, but i've removed it from ocata and unassigned, https://blueprints.launchpad.net/tripleo/+spec/multinode-ci-os-net-config15:33
EmilienMok, let me look15:34
slagleEmilienM: as i said in the patch, it's probably a quickstart thing at this point15:34
openstackgerritMerged openstack/puppet-pacemaker: Do not apply the cib via --config when pcs does not support diffing  https://review.openstack.org/42470815:34
slagleso would need to be prioritized among that work, if there is still a desire to use os-net-config in multinode jobs15:34
*** pradk has joined #tripleo15:36
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Use os-net-config in multinode jobs  https://review.openstack.org/42524115:37
EmilienMslagle: I did that for now ^ and if we don't want it, we can abandon it15:37
EmilienMjtomasek: thanks15:38
bnemeclucasagomes: EmilienM: Noticed your earlier conversation.  We're already using ipmitool in tripleo-ci.15:42
bnemecI think the only concern would be local developer setups.15:42
EmilienMbnemec: indeed15:42
lucasagomesbnemec, oh, that's great!15:42
lucasagomesbnemec, oh that should be good when setup with ooo-quickstart, right ?15:43
lucasagomestho, the code for virtualbmc has been moved to ooo-quickstart-extras15:43
bnemeclucasagomes: It would have to.  OVB only provides IPMI credentials to the test node, so there's no way for it to use the ssh driver.15:43
lucasagomesbnemec, that's all good15:44
openstackgerritFrank Zdarsky proposed openstack/tripleo-validations: Add reno for release notes management  https://review.openstack.org/42524515:45
*** hjensas has joined #tripleo15:45
*** hjensas has quit IRC15:45
*** hjensas has joined #tripleo15:45
fzdarskyEmilienM, wow, really fast review on 425245, thanks; what is the tag you'd like to see?15:51
EmilienMfzdarsky: what is the next tag for final ocata?15:51
*** owalsh_ has joined #tripleo15:52
fzdarskyEmilienM, yes, that's the question15:52
EmilienMfzdarsky: put 5.4.0 now15:53
EmilienMI'll change it if needed15:53
fzdarskyunderstood, thanks15:53
*** owalsh has quit IRC15:53
*** sdake_ has joined #tripleo15:53
openstackgerritLuke Hinds proposed openstack/tripleo-heat-templates: Manage password_validator regex  https://review.openstack.org/41364415:54
openstackgerritFrank A. Zdarsky proposed openstack/tripleo-validations: Add reno for release notes management  https://review.openstack.org/42524515:55
*** sdake has quit IRC15:56
*** dtantsur|brb is now known as dtantsur15:56
*** milan has joined #tripleo15:56
openstackgerritDan Radez proposed openstack/puppet-tripleo: Adding tacker service  https://review.openstack.org/42264415:56
EmilienMfzdarsky: did you see my second comment?15:56
openstackgerritDan Radez proposed openstack/puppet-tripleo: Adding congress service  https://review.openstack.org/41388115:57
bandinianyone already seen jobs failing with: /tmp/in_target.d/finalise.d/98-regenerate-initramfs: line 13: IRONIC_AGENT_MULTIPATH_DRIVERS: unbound variable while building the ipa ramdisk?15:57
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Remove double include of neutron::server class  https://review.openstack.org/42525015:58
*** abregman has quit IRC15:59
*** suuuper has joined #tripleo16:00
*** abregman has joined #tripleo16:01
openstackgerritLuke Hinds proposed openstack/tripleo-heat-templates: Manage password_validator regex  https://review.openstack.org/41364416:01
*** dsneddon_afk is now known as dsneddon16:02
*** ealcaniz has quit IRC16:02
*** aufi has quit IRC16:04
*** toure|biab is now known as toure16:05
*** derekh has quit IRC16:05
*** prateek has quit IRC16:08
fzdarskyEmilienM, I'm sorry, I did not. Will fix. Thanks for the example.16:09
*** ealcaniz has joined #tripleo16:09
*** ebarrera has quit IRC16:10
*** suuuper has quit IRC16:12
cschwedeIf someone has a bit of time to review this short t-h-t patch, i'd be more than happy: https://review.openstack.org/#/c/413601/16:16
*** owalsh has joined #tripleo16:16
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test with scheduler hints  https://review.openstack.org/37804016:18
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add feature testing matrix to readme  https://review.openstack.org/39926916:18
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add support for testing predictable placement  https://review.openstack.org/37801416:18
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test hostname map  https://review.openstack.org/37801716:18
*** owalsh_ has quit IRC16:19
jaosoriorcschwede: done16:20
cschwedejaosorior: now that was quick, thx a lot!16:21
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: POC: Use tripleo-repos in tripleo.sh  https://review.openstack.org/39581316:23
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Use TLS proxy for neutron server's internal TLS  https://review.openstack.org/42526716:24
*** tremble has quit IRC16:25
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job  https://review.openstack.org/41952916:25
*** karimb has quit IRC16:26
*** udesale has quit IRC16:26
*** karimb has joined #tripleo16:29
*** ealcaniz has quit IRC16:30
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient: Add support for calling validations from introspection  https://review.openstack.org/41950616:31
EmilienMnote for everyone: stable/newton jobs are still failing but it's under control, I have a fix in the gate now16:31
openstackgerritOliver Walsh proposed openstack/tripleo-common: Run nova manage cell_v2 discover_host after ironic nodes are registered  https://review.openstack.org/42527316:31
cschwedeEmilienM: thx a lot too!16:32
jaosoriorEmilienM: what's the fix?16:33
jaosoriorEmilienM: need reviews?16:33
*** rbrady-brb is now known as rbrady16:34
EmilienMjaosorior: still https://review.openstack.org/42419016:34
jaosoriorah, that one16:34
EmilienMjaosorior: but it should have merged last night but zuul was restarted16:34
EmilienMyeah16:34
jaosoriordammit16:34
EmilienMI had to reapprove it16:34
EmilienMit will land today for sure16:34
jaosoriorpradk: wouldn't we need some db migration bits to move the stuff from the neutron db to the aodh db?16:37
pradkjaosorior, netron?16:38
jaosoriorceilo16:38
pradkneutron? i hope not :)16:38
jaosoriorhaha16:38
jaosoriorsorry16:38
pradkno we dont plan on providing any data migration16:38
jaosoriorpradk: regarding this commit https://review.openstack.org/#/c/424950/116:38
pradkjaosorior, nop, we dint do that for overcloud either .. there is a script user can run manually if they want16:39
*** lblanchard has quit IRC16:39
jaosoriorI'm not sure; but it would sound like it would be a bit problematic for deployers16:39
pradkjaosorior, we just doc it .. dont think anyone is using alarms on undercloud afaik anyway16:39
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test dlrn logs  https://review.openstack.org/42435416:39
jaosoriorhewbrocca: ^^16:39
hewbroccahmmm16:40
hewbroccajaosorior: I dunno... shardy ^^^ ?16:40
jaosoriorlol16:40
*** leanderthal has joined #tripleo16:40
*** abregman has quit IRC16:40
bnemec<EmilienM> it will land today for sure16:43
bnemecJust _had_ to say that, didn't you?16:43
bnemecNo way it lands today now. :-P16:43
*** dsariel has quit IRC16:44
EmilienMahah16:45
openstackgerritLuke Hinds proposed openstack/tripleo-heat-templates: Manage password_validator regex  https://review.openstack.org/41364416:45
*** owalsh_ has joined #tripleo16:48
*** leanderthal has quit IRC16:48
*** owalsh_ has quit IRC16:48
*** owalsh has quit IRC16:51
*** owalsh_ has joined #tripleo16:51
*** owalsh_ is now known as owalsh16:52
b00tcatI built from scratch an overcloud image (with no customization), and when trying to deploy it the deploy process seems to be stuck - is it possible to debug the deployment to know what's happening under the hood?16:52
shardydprince: Hey, when you get a moment can you check out the openstack-dev thread from marios re the hiera hook?16:53
shardydprince: it seems like we perhaps failed to consider the migration path for any out-of-tree users of the old hook, and we need to figure out a solution before the release16:53
shardydprince: atm I can't think of a good way to keep both hooks functional, but clearly that would be ideal so we can properly deprecate it16:53
shardyso the least-bad thing seems to be a hack to 99-refresh-completed that signals failure if folks try to use it16:54
shardyany other ideas/patches much appreciated!16:54
*** katkapilatova has left #tripleo16:54
shardyb00tcat: I'd start by looking at the primary console of the node during the deploy, to figure out if the deploy ramdisk is working and deploying the OS16:55
shardyb00tcat: if that's working then I'd use virt-customize to add a root password and log in to look at /var/log/messages when the overcloud deploy is happening16:56
shardyb00tcat: where does it get stuck in the overcloud deploy event output?16:56
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Add support for upgrading ec2-api  https://review.openstack.org/42528516:57
b00tcatshardy: just after [overcloud.allNodesConfig]: CREATE_COMPLETE  state changed16:58
b00tcatshardy: that seems like a reasonable debug process, thanks16:58
shardyb00tcat: Ok at that point you can probably just log in as heat-admin and look at the logs16:58
shardyb00tcat: sounds like puppet is stuck but hard to be sure without more detail16:59
EmilienMccamacho: can you please add release notes in THT for ec2api?16:59
EmilienMI think ansiwen missed it16:59
pradkshardy, jaosorior, hewbrocca,  so, talking to fbaudin (telemetry pm) we dont care much about data migration for undercloud being integrated into the workflow. Happy with just documenting clearly that if you care about old alarm data, run this command after undercloud upgrade finishes.16:59
shardyb00tcat: also do ps ax | grep heat on the node, it should show any heat deployment hook that is running16:59
ccamachoSure, Ill add it to the missing upgrade bits16:59
ccamachopatch16:59
pradkshardy, hewbrocca, jaosorior, But if you guys strongly feel, I'm happy to integrate it into the workflow16:59
ccamachoEmilienM ^16:59
*** athomas has quit IRC16:59
b00tcatshardy: ps ax on the undercloud or the node being deployed? undercloud, no?16:59
ansiwenEmilienM: I can still do it, or is ccamacho preparing something anyway?17:00
shardypradk, jaosorior, hewbrocca: Yeah I agree documenting the migration should be OK - I was trying to disable all telemetry services by default a while back because they aren't widely used17:00
ccamachohey ansiwen Ill start checking the upgrades job with this new service17:00
shardyfor those downstream users that do require them, a manual migration seems reasonable17:00
pradk*thumbs up* from me17:00
EmilienMansiwen: do you have the patch for project-config ready yet?17:00
*** leanderthal has joined #tripleo17:00
ccamachoSo I can add the release note there17:00
ansiwenEmilienM: I'm just trying to fix a bit of the undercloud upgrade, because I though it might be more urgent right now17:01
EmilienMansiwen: upgrade is more urgent than everything. Let me do the zuul thing17:01
openstackgerritDan Trainor proposed openstack/instack-undercloud: Add additional proxy and config endpoints for UI  https://review.openstack.org/42490317:02
ansiwenEmilienM: ok, thanks!17:02
*** mburned is now known as mburned_out17:02
dprinceshardy: ack, will look at the thread17:04
*** panda is now known as panda|bbl17:04
*** dbecker has quit IRC17:04
EmilienMansiwen: https://review.openstack.org/42528717:05
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Add release notes for Ocata 6.0.0  https://review.openstack.org/42436517:06
openstackgerritDan Trainor proposed openstack/puppet-tripleo: Proxy API endpoints that UI uses  https://review.openstack.org/42490917:06
ccamachoHEy EmilienM added the ec2-api release note here https://review.openstack.org/#/c/424365/17:06
EmilienMccamacho: is it a controller service?17:06
EmilienMccamacho: I don't like the notion of controller17:06
EmilienMjust say, add EC2API composable service support17:06
ccamachoEmilienM, coll17:07
shardydprince: cool - I'm wondering if there's maybe a transitional shim we can write to ensure any old templates still work for a while17:07
ccamachocool changing it17:07
EmilienMthx17:07
shardye.g wire the old data into the new hook, or something17:07
*** mburned_out is now known as mburned17:07
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Conform CephExternal template to the new hiera hook  https://review.openstack.org/42528817:07
*** owalsh_ has joined #tripleo17:07
*** ansmith has quit IRC17:07
ccamachodone17:08
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Add release notes for Ocata 6.0.0  https://review.openstack.org/42436517:08
*** owalsh_ has quit IRC17:08
*** owalsh_ has joined #tripleo17:08
*** owalsh has quit IRC17:10
*** owalsh_ is now known as owalsh17:10
*** b00tcat has quit IRC17:10
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Force MySQL users to use SSL if internal TLS is enabled  https://review.openstack.org/42529217:11
openstackgerritFrank A. Zdarsky proposed openstack/tripleo-validations: Add reno for release notes management  https://review.openstack.org/42524517:11
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: [build-test-packages] combine all methods of providing changes  https://review.openstack.org/42491417:12
openstackgerritEmilien Macchi proposed openstack/tripleo-specs: Create a new squad for Python 3  https://review.openstack.org/42529417:12
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job with MySQL  https://review.openstack.org/42529517:12
fzdarskyEmilienM, [x] done (I hope :))17:13
*** newmember has joined #tripleo17:13
*** social has quit IRC17:13
*** dtantsur is now known as dtantsur|brb17:14
openstackgerritMartin AndrĂ© proposed openstack/puppet-tripleo: Rename controller_admin_vip to controller_admin_host  https://review.openstack.org/42529617:15
openstackgerritMartin AndrĂ© proposed openstack/instack-undercloud: Move Docker registry setup into its own profile  https://review.openstack.org/41743717:16
*** hewbrocca is now known as hewbrocca_afk17:16
*** b00tcat has joined #tripleo17:16
EmilienMfzdarsky: thx! lgtm17:17
*** social has joined #tripleo17:17
*** yolanda has quit IRC17:18
*** ccamacho has quit IRC17:19
*** jaosorior has quit IRC17:22
*** ramishra_ has joined #tripleo17:23
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Add release notes for Ocata 6.0.0  https://review.openstack.org/42436517:23
*** social has quit IRC17:23
*** hjensas has quit IRC17:24
*** ramishra has quit IRC17:25
*** mburned is now known as mburned_out17:26
*** morazi has quit IRC17:26
*** mburned_out is now known as mburned17:26
*** fzdarsky is now known as fzdarsky|afk17:27
*** social has joined #tripleo17:27
chemmwhahaha: hi, I'm trying your patches and it passes nova-db but I'm bumping now in aodh-db problem, I tried adding https://review.openstack.org/#/c/424950/ but it's not enough17:29
chemmwhahaha: I kinda remember you had the issue yesterday, is there already a fix for it or is it todo ?17:30
*** jaosorior has joined #tripleo17:32
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: [build-test-packages] combine all methods of providing changes  https://review.openstack.org/42491417:32
owalshmarios: still here?17:33
*** dtantsur|brb is now known as dtantsur17:33
*** tesseract has quit IRC17:33
*** karts has quit IRC17:34
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates: Adds a AllNodesPreUpgradeConfig before the upgrade steps  https://review.openstack.org/41988617:36
owalshmarios: FYI ^^ https://review.openstack.org/#/c/419886/13..14/overcloud.j2.yaml17:37
*** rasca has quit IRC17:37
openstackgerritJames Slagle proposed openstack/os-cloud-config: Officially deprecate os-cloud-config  https://review.openstack.org/42531517:39
mwhahahachem: still working on it17:39
*** florianf has quit IRC17:41
*** yolanda has joined #tripleo17:41
chemmwhahaha: ah, well, I have to leave right now, I may bug you about it later, maybe I can help (or at least test)17:42
*** mburned is now known as mburned_out17:43
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Pass parameters for TLS proxy in front of neutron server  https://review.openstack.org/42531717:43
*** mburned_out is now known as mburned17:43
*** zoli|wfh is now known as zoli|gone17:44
dtantsurlucasagomes, could you please check if https://blueprints.launchpad.net/tripleo/+spec/ironic-driver-composition makes sense to you?17:44
dtantsurthis is a tripleo follow-up for the driver composition reform17:44
lucasagomesdtantsur, looking17:45
lucasagomesdtantsur, it does makes sense yeah, but I'm familiar with the work in ironic17:46
lucasagomesas long as ppl read the spec in ironic I think they will be fine17:46
dtantsurwell, I can't copy-paste the whole spec there, I guess :D17:46
*** zaneb has quit IRC17:46
pradkEmilienM, we'll need this soon to unstuck upgrades -> https://review.openstack.org/#/c/424950/17:47
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Clean TLS proxy-related setup for neutron-server profile  https://review.openstack.org/42532017:48
*** b00tcat has quit IRC17:48
lucasagomesdtantsur, heh yeah, the link is fine17:49
lucasagomes(it's arleady there)17:49
*** dprince has quit IRC17:53
ansiwenowalsh: do you know how to make sure in the exec, that the stackrc is sourced? nova::config::end  is probably the config after the upgrade17:53
*** lucasagomes is now known as lucas-afk17:54
*** karimb has quit IRC17:55
owalshansiwen: don't need stackrc to run nova-manage17:55
ansiwenowalsh: oh, cool17:55
openstackgerritSven Anderson proposed openstack/instack-undercloud: Add a pre-upgrade online_data_migration step for undercloud  https://review.openstack.org/42532317:58
ansiwenowalsh:  https://review.openstack.org/#/c/425323/17:58
*** beagles is now known as beagles-biab17:59
openstackgerritBen Kero proposed openstack/tripleo-quickstart: Add optional undercloud-setup role to quickstart-extras playbook  https://review.openstack.org/42494717:59
*** ansmith has joined #tripleo18:00
*** gfidente is now known as gfidente|afk18:01
owalshansiwen: gotta step away for a while, gave it a very quick review18:03
*** owalsh is now known as owalsh-afk18:03
*** yolanda has quit IRC18:06
bnemecBleh, I think mitaka is broken again18:07
*** owalsh-afk has quit IRC18:08
jaosoriorwhen was the last promotion?18:08
*** tremble has joined #tripleo18:08
openstackgerritBen Nemec proposed openstack/python-tripleoclient: Make overcloud image upload honor --image-path  https://review.openstack.org/40726118:08
*** owalsh-afk has joined #tripleo18:09
*** dtantsur is now known as dtantsur|afk18:09
openstackgerritHonza Pokorny proposed openstack/tripleo-ui: Add developer docs  https://review.openstack.org/42100018:11
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Use versionless keystone endpoint for barbican-related configurations  https://review.openstack.org/40789818:11
EmilienMpradk: ok18:17
*** jlinkes has joined #tripleo18:18
EmilienMpradk: how database is migrated?18:18
pradkEmilienM, you mean data?18:18
pradkEmilienM, see above discussion, we wont .. we'll let user handle it if they care about data. We ship a script with aodh.18:19
EmilienMpradk: ah cool18:21
bnemecOkay, I take it back.  Both of the stable branches are broken. :-(18:21
bnemecFailing on snmp setup problems in puppet.18:22
openstackgerritJames Slagle proposed openstack/instack-undercloud: Remove setup-neutron  https://review.openstack.org/42522218:22
shardyugh18:22
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Add telemetry service support for composable upgrades  https://review.openstack.org/40524918:23
pradkshardy, ^^ fixed the mongod18:23
EmilienMbnemec: please do not debug newton yet, my patch is still in gate18:23
EmilienMbnemec: oh wait, you mean new failure?18:23
bnemecEmilienM: Oh, so this is fixed?18:23
bnemecI don't know.  What problem did you fix?18:23
* bnemec doesn't see a critical bug open for this18:24
EmilienMbnemec: the fact multinode env in tripleo-ci was not deploy glance registry18:24
EmilienMand we need this service in newton18:24
bnemecEmilienM: Oh, no, this is different.18:24
EmilienMok18:24
bnemecThis is ovb jobs.18:24
* bnemec opens bug18:24
EmilienMbnemec: damn !18:25
EmilienMbnemec: can I see logs please?18:25
bnemecEmilienM: https://bugs.launchpad.net/tripleo/+bug/165938418:26
openstackLaunchpad bug 1659384 in tripleo "Stable jobs failing to set up snmp" [Critical,Triaged]18:26
*** cylopez has quit IRC18:26
EmilienMNo such file or directory - /etc/snmp/snmptrapd.conf18:27
EmilienMsounds like a packaging update in snmp18:27
*** ansmith has quit IRC18:27
EmilienMbnemec: can you check if package version changed lately?18:28
bnemecEmilienM: Yeah, I'll need to find a passed job to compare.18:29
EmilienMI hvae one18:30
shardypradk: ack, thanks - testing with the fixed service name gets me further locally, but ceilometer-upgrade fails when run by puppet18:30
shardystrangely it then works if I run it manually18:30
shardyso we may have an ordering issue there, investigating/re-testing18:30
pradkshardy, whats the error?18:30
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: [build-test-packages] combine all methods of providing changes  https://review.openstack.org/42491418:32
EmilienMbnemec: I wonder which package manage it18:32
shardypradk: http://paste.openstack.org/show/596502/18:32
EmilienMnet-snmp net-snmp-utils ?18:32
shardyevidently transient error with the db sync18:32
pradkshardy, wnats in /var/log/ceilometer/ceilo-upgrade.log18:33
EmilienMbnemec: net-snmp-utils was same18:33
*** pkovar has quit IRC18:34
EmilienMbnemec: https://github.com/razorsedge/puppet-snmp/blob/master/manifests/init.pp#L457-L46618:35
shardypradk: http://paste.openstack.org/show/596503/18:35
bnemecEmilienM: net-snmp is completely missing on mitaka: https://www.diffchecker.com/0G8UzuGU18:36
pradkshardy, hmm all that looks fine18:36
shardypradk: it looks like the ceilometer-upgrade via ansible worked, then the run from puppet broke18:36
shardywithout any errors18:36
pradkweird18:36
EmilienMbnemec: I confirm  net-snmp is missing on Mitaka, it's probably the root cause18:36
shardyI'll try it again, otherwise looks good18:36
EmilienMbnemec: for Newton i'm not sure we have the same bug. Do you have a trace?18:36
pradkok18:36
shardywe can probably look at just moving all the db syncs to puppet18:37
shardyor rather not duplicating them in the ansible tasks18:37
bnemecEmilienM: The newton failure is what I posted in the bug.  I compared mitaka because that was the first passing stable job I came across.18:37
*** trown is now known as trown|lunch18:37
EmilienMbnemec: OVB / Newton passed last night18:38
EmilienMbnemec: see http://logs.openstack.org/11/424811/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/d427b78/18:38
EmilienMbnemec: tha's newton ^18:38
*** sdake_ has quit IRC18:39
*** sdake has joined #tripleo18:39
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: [build-test-packages] combine all methods of providing changes  https://review.openstack.org/42491418:39
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add Ironic support to major upgrade CI  https://review.openstack.org/42428718:39
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add telemetry services to major upgrade test  https://review.openstack.org/42533418:39
bnemecEmilienM: Ditto.  net-snmp is not installed in the failing job: https://www.diffchecker.com/nNJkL3Ao18:40
shardypradk: ^^ I've pushed a WIP patch to add telemetry to the upgrade CI18:40
pradkshardy, cool18:40
shardypradk: any ideas on additional sanity tests in tripleo.sh would be appreciated18:40
EmilienMbnemec: wtf?18:40
*** yolanda has joined #tripleo18:40
EmilienMbnemec: newton diff https://www.diffchecker.com/65iWQn3x18:41
EmilienMyou're very right,  net-snmp is missing now18:41
EmilienMshould we just add it in puppet-element and backport the fix?18:41
*** dprince has joined #tripleo18:41
bnemecEmilienM: I guess so.  I don't see any explicit install of net-snmp, so it must have been getting pulled in accidentally by something else.18:43
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add wait_for from tripleo-incubator  https://review.openstack.org/42533518:43
*** yamahata has joined #tripleo18:43
EmilienMbnemec: can you send it to master? so we'll backpor tit18:44
bnemecEmilienM: Working on it.18:45
*** jpena is now known as jpena|off18:45
bnemecEmilienM: I'm going to add it to the base element since I think this needs to end up on all node types.18:46
*** tremble has quit IRC18:46
jaosoriorbnemec: aren't we using the controller image for all node types?18:46
EmilienMbnemec: ++18:47
openstackgerritMerged openstack/tripleo-validations: Add reno for release notes management  https://review.openstack.org/42524518:47
EmilienMbnemec: nice catch btw18:48
bnemecjaosorior: Well, it's a composition of all the overcloud node types since we only use one image.18:49
*** yprokule has quit IRC18:49
bnemecovercloud-base gets pulled in by all the other overcloud-* elements.18:50
openstackgerritJames Slagle proposed openstack/instack-undercloud: Deprecate instack-virt-setup  https://review.openstack.org/42533818:51
EmilienMslagle: could we have a release note please?18:51
*** leanderthal has quit IRC18:52
jaosoriormwhahaha: could you check this out https://review.openstack.org/#/c/425250/ ?18:52
openstackgerritBen Nemec proposed openstack/tripleo-puppet-elements: Add explicit install of net-snmp  https://review.openstack.org/42533918:52
EmilienMslagle: also, could we have a release note about split-stack-software-configuration in THT please?18:52
*** pcaruana has quit IRC18:53
openstackgerritBen Nemec proposed openstack/tripleo-puppet-elements: Add explicit install of net-snmp  https://review.openstack.org/42534318:53
openstackgerritJames Slagle proposed openstack/tripleo-docs: Document instack-virt-setup deprecation  https://review.openstack.org/42534418:54
jaosoriorquick review  https://review.openstack.org/#/c/425250/18:54
openstackgerritBen Nemec proposed openstack/tripleo-puppet-elements: Add explicit install of net-snmp  https://review.openstack.org/42534618:55
jaosoriorbnemec: I thought that package wasn't available for mitaka18:55
jaosorioror did I misunderstand?18:55
bnemecjaosorior: It's not present on newly built mitaka images.  It was in the past though, so it must exist there.18:56
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Set the correct default for gnocchi workers  https://review.openstack.org/42534718:56
jaosoriorohh, ok ok18:56
bnemecIt's going to take a long time to get results back on those patches. :-(18:58
EmilienMbnemec: super funny, latest newton is 1h30 ago18:58
EmilienMyou cought something that just happenned18:58
openstackgerritDan Radez proposed openstack/puppet-tripleo: Adding congress service  https://review.openstack.org/41388118:58
EmilienMbnemec: latest success I meant18:58
openstackgerritDan Radez proposed openstack/puppet-tripleo: Adding tacker service  https://review.openstack.org/42264418:59
bnemecEmilienM: I caught it quickly because suddenly half our testenvs went away due to the stable branch failures.18:59
bnemecWhich is...suspicious.18:59
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: [build-test-packages] combine all methods of providing changes  https://review.openstack.org/42491418:59
EmilienMbnemec: it would be fun to have a bot that notify (here?) on these events19:00
EmilienMbnemec: do we have sensu deployed on the testenvs?19:01
*** shardy is now known as shardy_afk19:01
bnemecEmilienM: No, although zoli|gone is working on adding more monitoring to rh1.19:01
*** jlinkes has quit IRC19:01
bnemecThat wouldn't help here though since it's intended to monitor the host cloud, not the jobs running on it.19:01
openstackgerritMerged openstack/tripleo-docs: Add docs for using already deployed servers  https://review.openstack.org/42036919:02
bnemecI'm not sure how we would write a bot smart enough to figure this out either.19:02
bnemecIt would almost certainly have triggered yesterday when a big patch series got rebased too.19:03
*** mcornea has quit IRC19:03
jaosoriorpradk: still around?19:04
bnemecI have thought about doing graphite metrics for the number of active heat stacks and such though.19:04
pradkjaosorior, yea19:04
jaosoriorpradk: do you review puppet code?19:04
pradkjaosorior, sure19:04
jaosoriorpradk: could you check this out https://review.openstack.org/#/c/425250/1 ?19:04
pradklooking19:05
jaosoriorpradk: thanks dude :D19:05
bnemecEmilienM: Oh, you might be interested in http://zuul-status.nemebean.com/19:06
bnemecThat also shows the massive rash of stable job failures pretty well.19:06
EmilienMbnemec: oh nice, it would be nice to have it in tripleo.org, no?19:07
pradkjaosorior, np19:08
jaosoriorpradk: thanks dude19:08
jaosorioraah, had said thanks already haha19:08
jaosorioranyway19:08
*** jlinkes has joined #tripleo19:08
openstackgerritJames Slagle proposed openstack/instack-undercloud: Deprecate instack-virt-setup  https://review.openstack.org/42533819:08
jaosoriorpradk: soo... what was the resolution? should the data migration be added? or is the commit fine as it is?19:08
pradkjaosorior, did you check shardy_afk's comments above19:09
*** akrivoka has quit IRC19:09
jaosoriorpradk: no, which?19:09
pradkjaosorior, we dont need it imo, we can document saying if you care about your old data run this script after undercloud upgrade19:09
bnemecEmilienM: It's a little hacky, but I could propose adding a link.19:09
jaosoriorpradk: ok, can you pass me the commit link again to review it?19:09
*** jmelvin has quit IRC19:10
pradkjaosorior, <shardy> Yeah I agree documenting the migration should be OK - I was trying to disable all telemetry services by default a while back because they aren't widely used19:10
pradk<shardy> for those downstream users that do require them, a manual migration seems reasonable19:10
pradksure one sec19:10
pradkhttps://review.openstack.org/#/c/424950/19:10
pradkjaosorior, ^^19:11
*** ooolpbot has joined #tripleo19:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165938419:11
*** ooolpbot has quit IRC19:11
openstackLaunchpad bug 1659384 in tripleo "Stable jobs failing to set up snmp" [Critical,In progress] - Assigned to Ben Nemec (bnemec)19:11
EmilienMbnemec: +119:11
pradkthe ci job seems to be stuck19:11
pradkwell its moving now, just slow19:11
bnemecOh goody, another alert bug assigned to me.19:13
jaosoriorradez: hey dude, is it possible to run tacker or congress over httpd?19:14
pradkif others can pile on these releasenotes we can get it in https://review.openstack.org/#/c/424746/19:15
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras: Fix overcloud-scale failure msg and regression  https://review.openstack.org/42535219:15
radezjaosorior: not sure, why do you ask?19:15
jaosorior  radez cause it would make life pretty easy to get TLS in the internal network on those services19:16
radezah, I'm not sure. I'd have to talke to someone in the project19:16
pradkjaosorior, by pile on i meant more notes :)19:16
pradki just added telemetry stuff, we need other changes from instack-undercloud i believe19:17
*** salmankhan has quit IRC19:17
*** crenguta has joined #tripleo19:18
*** jmelvin has joined #tripleo19:18
*** jaosorior has quit IRC19:21
EmilienMany change to have a review on this tripleoclient patch, blocking the release https://review.openstack.org/#/c/422806/19:26
*** lblanchard has joined #tripleo19:29
*** jlinkes has quit IRC19:30
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: [build-test-packages] combine all methods of providing changes  https://review.openstack.org/42491419:30
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Composable HA  https://review.openstack.org/36238919:32
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Add scenario005 job (4nodes)  https://review.openstack.org/41809819:32
*** abregman has joined #tripleo19:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Add scenario005 scenario  https://review.openstack.org/41809919:33
*** trown|lunch is now known as trown19:33
openstackgerritDan Trainor proposed openstack/puppet-tripleo: Proxy API endpoints that UI uses  https://review.openstack.org/42490919:37
dsneddonbnemec, Many thanks for your review of the DPDK changes for os-net-config.19:39
*** mjblack has joined #tripleo19:39
dsneddonbnemec, If you have a moment, perhaps you could also look at https://review.openstack.org/#/c/425101/19:41
*** jprovazn has quit IRC19:46
*** dmarlin has joined #tripleo19:47
*** dprince has quit IRC19:48
*** dprince has joined #tripleo19:49
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Conform CephExternal template to the new hiera hook  https://review.openstack.org/42528819:54
*** leanderthal has joined #tripleo19:54
openstackgerritChris Jones proposed openstack/python-tripleoclient: Add overcloud_parameters.GenerateFencingParameters.  https://review.openstack.org/41789819:58
*** akuznetsov has joined #tripleo19:58
openstackgerritMerged openstack/python-tripleoclient: Remove redundant 'the'  https://review.openstack.org/42398519:59
openstackgerritMerged openstack/python-tripleoclient: Add release notes for my changes in Ocata  https://review.openstack.org/42474220:00
openstackgerritChris Jones proposed openstack/python-tripleoclient: Add overcloud_parameters.GenerateFencingParameters.  https://review.openstack.org/41789820:00
openstackgerritAlex Schultz proposed openstack/instack-undercloud: Run cell v2 setup differently for upgrades  https://review.openstack.org/41912120:01
sshnaidmEmilienM, trown can we please merge it? https://review.openstack.org/#/c/422638/ https://review.openstack.org/#/c/423870/4 ? Everything is solved there I think20:02
*** ooolpbot has joined #tripleo20:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165938420:11
openstackLaunchpad bug 1659384 in tripleo "Stable jobs failing to set up snmp" [Critical,In progress] - Assigned to Ben Nemec (bnemec)20:11
*** ooolpbot has quit IRC20:11
*** crenguta has quit IRC20:12
*** jaosorior has joined #tripleo20:12
*** abregman has quit IRC20:13
openstackgerritTim Rozet proposed openstack/puppet-tripleo: Enables OpenDaylight Clustering in HA deployments  https://review.openstack.org/42538320:13
*** abregman has joined #tripleo20:13
EmilienMsshnaidm: looking now20:13
*** crenguta has joined #tripleo20:14
*** beagles-biab is now known as beagles20:16
EmilienMpatches have been in gate forever20:17
*** jaosorior has quit IRC20:17
openstackgerritChris Jones proposed openstack/python-tripleoclient: Add overcloud_parameters.GenerateFencingParameters.  https://review.openstack.org/41789820:19
bnemecThe gate queue is ridiculously long right now.20:19
bnemecMy suspicion is that it's the sshd bug causing random gate resets on a semi-regular basis.20:19
bnemecWhich restarts the jobs on _all_ the subsequent patches in the queue.20:20
*** akuznetsov has quit IRC20:24
*** jaosorior has joined #tripleo20:24
*** leanderthal has quit IRC20:27
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Support exclude list for logs collecting  https://review.openstack.org/42539520:27
jaosoriorEmilienM: can you revisit this https://review.openstack.org/#/c/407898/ ?20:27
*** abregman has quit IRC20:28
*** Goneri has quit IRC20:29
EmilienMjaosorior: done20:29
openstackgerritJames Slagle proposed openstack/os-cloud-config: Officially deprecate os-cloud-config  https://review.openstack.org/42531520:29
openstackgerritJames Slagle proposed openstack/os-cloud-config: Fix usage of glanceclient exceptions  https://review.openstack.org/42539620:29
jaosoriorEmilienM: thanks20:29
sshnaidmtrown, EmilienM thanks!20:30
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-validations: Updated from global requirements  https://review.openstack.org/42462820:31
*** salmankhan has joined #tripleo20:31
slaglea good indication that no one is using a piece of software: you try and deprecate and realize it's been broken for 2 months20:32
mwhahahaindeed :o20:32
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Clean TLS proxy-related setup for neutron-server profile  https://review.openstack.org/42532020:33
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Use TLS proxy for neutron server's internal TLS  https://review.openstack.org/42526720:33
EmilienMbnemec: do we want to release tripleo-repos ?20:33
EmilienMor do you prefer to wait for Pike where we could use it somewhere for the first time (in CI, etc)?20:34
bnemecEmilienM: I'd probably say let's wait for Pike at this point.  I'm not a fan of making major changes late in the cycle.20:34
bnemecI can still make progress on it in the background so it's ready to go as soon as Pike opens.20:35
EmilienMbnemec: good20:35
*** salmankhan has quit IRC20:35
bnemecI've got an rpm spec ready for it and am trying to test it in https://review.openstack.org/#/c/395813/20:35
EmilienMjrist: do you have progress on preparing tripleo-ui for release notes? i don't see progress on it20:35
bnemecHaving issues with the fact that requests is installed from pip though. :-/20:35
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Add a release note for using deployed-servers (aka split-stack)  https://review.openstack.org/42540120:36
*** jmelvin has quit IRC20:36
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add wait_for from tripleo-incubator  https://review.openstack.org/42533520:39
jristEmilienM: oh, no - I didn't know that was up to me. sorry to miss that. what can I do?20:42
openstackgerritSven Anderson proposed openstack/instack-undercloud: Add a pre-upgrade online_data_migration step for undercloud  https://review.openstack.org/42532320:42
jristEmilienM: [openstack-dev] [tripleo] Release notes in TripleO20:43
jristEmilienM: ^ this email?20:43
EmilienMjrist: no worries. Yes it would be great to create reno files and add notes for Ocata20:43
sshnaidmweshay, EmilienM can you comment please? https://review.openstack.org/#/c/423519/11/zuul/layout.yaml20:43
jristEmilienM: ok!20:43
jristEmilienM: I will do that today20:43
EmilienMjrist: if you volunteer to do it, you can copy paste what I did for tripleo-heat-templates for ex20:43
EmilienMjrist: it takes 5 min20:43
jristok - where is that?20:43
EmilienMjrist: see for ex20:44
EmilienMhttps://review.openstack.org/#/c/424686/20:44
jristk20:45
jristslowwwww gerrit20:45
EmilienMsshnaidm: he's right20:45
jristEmilienM: so it is against the particular repo?20:45
EmilienMsshnaidm: you need to be exclusive so we can run it for stable/ocata stable/pike, etc20:45
EmilienMsshnaidm: so please exclude stable/mitaka and stable/newton and we're good20:46
*** saneax-_-|AFK has quit IRC20:46
EmilienMjrist: indeed20:46
sshnaidmEmilienM, ok20:46
jristEmilienM: i.e. /tripleo-ui/realeasenotes/20:46
openstackgerritMerged openstack/instack-undercloud: Run yum clean before yum update  https://review.openstack.org/42492420:46
openstackgerritMerged openstack/tripleo-ui: Adds ids namespaced artifacts on plans page.  https://review.openstack.org/41110220:46
EmilienMjrist: you got it20:46
openstackgerritMerged openstack/tripleo-ui: Add i18n strings to the navigation bar  https://review.openstack.org/41857020:46
mwhahahabandini: http://logs.openstack.org/03/424903/4/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/b3da062/logs/postci.txt.gz#_2017-01-25_20_02_22_000 looks like ovh ha job is unhappy20:46
openstackgerritMerged openstack/tripleo-ui: Fix introspection failure  https://review.openstack.org/41739120:47
openstackgerritMerged openstack/tripleo-ui: Display Role tag when role is not available  https://review.openstack.org/42417420:47
openstackgerritMerged openstack/tripleo-ui: Update fetchNodes action to call detailed nodes list  https://review.openstack.org/42454620:47
openstackgerritMerged openstack/tripleo-ui: i18n for minor string on DeployStep  https://review.openstack.org/42021220:47
openstackgerritMerged openstack-infra/tripleo-ci: Use the Newton node management commands  https://review.openstack.org/41698220:47
openstackgerritMerged openstack/python-tripleoclient: Deprecate legacy 'baremetal' commands  https://review.openstack.org/41622920:48
openstackgerritMerged openstack/tripleo-heat-templates: Ignore systemctl return code in yum_update.sh  https://review.openstack.org/42261020:48
*** dprince has quit IRC20:48
*** dprince has joined #tripleo20:48
openstackgerritMerged openstack/tripleo-heat-templates: Add metadata settings for needed kerberos principals  https://review.openstack.org/41134020:49
openstackgerritMerged openstack/tripleo-image-elements: Add element to rebuild dracut enabling modules  https://review.openstack.org/41948620:49
openstackgerritMerged openstack/tripleo-heat-templates: Add ec2-api service  https://review.openstack.org/39863420:49
*** panda|bbl is now known as panda20:50
openstackgerritMerged openstack/tripleo-heat-templates: Add Octavia API service definitions  https://review.openstack.org/41187220:50
*** ansmith has joined #tripleo20:50
dtrainormwhahaha, i see other gate-tripleo-ci-centos-7-ovb-ha jobs failing in check-tripleo as well20:51
*** mrunge has quit IRC20:51
mwhahahayea i saw a few others of just the HA failing20:52
mwhahahamight have  been related to https://review.openstack.org/#/c/424708/20:52
mwhahahaand it might clear up when https://review.openstack.org/#/c/362389/28 lands20:52
mwhahahabut not sure20:53
openstackgerritChris Jones proposed openstack/python-tripleoclient: Add overcloud_parameters.GenerateFencingParameters.  https://review.openstack.org/41789820:53
*** owalsh-afk is now known as owalsh20:53
dtrainor10-4 thx20:54
*** panda is now known as panda|zZ20:54
*** mrunge has joined #tripleo20:55
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add novajoin entries to the TLS-everywhere environment file  https://review.openstack.org/42157520:55
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test dlrn logs  https://review.openstack.org/42435420:56
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test dlrn logs  https://review.openstack.org/42435420:56
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job novajoin metadata  https://review.openstack.org/42541120:57
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Set the correct default for gnocchi workers  https://review.openstack.org/42534720:58
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Use versionless keystone endpoint for barbican-related configurations  https://review.openstack.org/40789821:00
bandinimwhahaha: looking21:00
*** crenguta has quit IRC21:03
*** shardy_afk has quit IRC21:03
beaglespradk: crap.. I was thinking that it was only os_service_default getting by this but I bet you all of the workers configurations that aren't using conditionals are broken at the moment21:03
bandinimwhahaha: yes https://review.openstack.org/#/c/362389/ should fix that specific race21:03
* beagles *facepalm*21:03
mwhahahabandini: ok thanks, dtrainor looks like just wait21:03
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add upgrade support for ceph-mon service  https://review.openstack.org/42318221:04
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add upgrade support for ceph OSD service  https://review.openstack.org/42335021:04
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add ironic service support for composable upgrades  https://review.openstack.org/40524821:04
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add telemetry service support for composable upgrades  https://review.openstack.org/40524921:04
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Skip upgrade steps where no tasks are defined  https://review.openstack.org/42338421:04
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add support for batched upgrades to composable upgrades  https://review.openstack.org/42316021:04
*** shardy_afk has joined #tripleo21:05
pradkbeagles, yep21:05
*** shardy_afk is now known as shardy21:07
beaglesfrickin stuff doesn't get caught by CI since it is explicitly set...21:09
openstackgerritMerged openstack/tripleo-heat-templates: Auto-set SwiftMountCheck and SwiftUseLocalDir settings  https://review.openstack.org/41360121:10
jaosoriorbeagles: ??21:10
beaglesjaosorior: the api workers, etc. in newton, setting the empty string was the same as not setting anything but that's changed.21:10
*** ooolpbot has joined #tripleo21:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165938421:11
openstackLaunchpad bug 1659384 in tripleo "Stable jobs failing to set up snmp" [Critical,In progress] - Assigned to Ben Nemec (bnemec)21:11
*** ooolpbot has quit IRC21:11
jaosoriorbeagles: aren't there reasonable defaults in the puppet manifests?21:11
beaglesjaosorior: so the approach taken to "just use the puppet defaults" of setting an empty string doesnt' work21:11
beagles.. anymore that is21:11
jaosoriorwhy?21:11
beaglesjaosorior: good question. It could be how we are writing the hieradata now.21:12
bnemecNow that we have 8 GB per ci node, I wonder if we could get away with shutting off the low memory setting for one of the jobs.21:13
bnemecThis does seem to keep happening.21:13
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add telemetry services to major upgrade test  https://review.openstack.org/42533421:14
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: Add release notes for Ocata 6.0.0  https://review.openstack.org/42474621:15
*** Goneri has joined #tripleo21:17
EmilienMpradk: https://review.openstack.org/42474621:17
pradkcool, pile on people ;)21:17
EmilienMshardy: aren't you scared to overload the upgrade job with all services?21:18
EmilienMshardy: it sounds like you're adding services from all scenarios in this job21:18
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates: Enables support for configuring Cinder with a ScaleIO storage backend.  https://review.openstack.org/42223821:19
*** dsneddon is now known as dsneddon_afk21:21
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates: Enables support for configuring Cinder with a ScaleIO storage backend.  https://review.openstack.org/42223821:22
*** dprince has quit IRC21:23
*** dsneddon has joined #tripleo21:23
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Don't set worker counts in nonha jobs  https://review.openstack.org/42542021:24
bnemecbeagles: Trying out the default counts ^21:24
beaglesbnemec: quite possibly it'll run out of memory :(21:25
bnemecbeagles: It may, but we've increased the ci resources by quite a bit since that was first added.21:26
beaglesbnemec: but then, it might not be too bad since the default  is now a constrained value instead of "processorcount"21:26
beaglesbnemec: ack21:26
bnemecI'm hoping the nonha jobs are light enough that we can get by.21:26
bnemecWe'll need to recheck that patch a few times before it merges, even if it does pass.21:26
shardyhttps://review.openstack.org/#/c/413644 needs a second reviewer if anyone has a moment21:27
*** iranzo has joined #tripleo21:29
*** jayg is now known as jayg|g0n321:29
Ngit seems like the ovb-ha and nonha CI jobs are failing pretty consistently atm, do we know what's wrong there, before I start spelunking through the logs?21:31
*** jaosorior has quit IRC21:31
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: Use conditionals for neutron and glance worker defaults  https://review.openstack.org/42542321:33
*** owalsh is now known as owalsh-brb21:35
bnemecNg: It looks like the net-snmp bug from the alert is now affecting master jobs as well.21:36
EmilienM:(21:36
EmilienMNg, owalsh, thrash, cschwede, rbrady, radez: I reviewed tripleo-common patches, merged or/and in progress and some of them didn't have a release note. I've -1 them. I would like you to add release notes of things you did in Ocata-3 for the things that merged and for the patches in progress, please propose a top patch or include it in next patchset.21:37
EmilienMoh and thanks21:37
Ngooh damn, I didn't realise the -common part needed a release note too. I'll do a top patch for mine21:37
EmilienMany tht core can review this release note patch please? https://review.openstack.org/#/c/424365/21:38
radezEmilienM: ack, will do21:38
*** jmelvin has joined #tripleo21:39
*** jidar has quit IRC21:39
*** jidar has joined #tripleo21:40
*** karimb has joined #tripleo21:40
*** lblanchard has quit IRC21:41
dtrainorbandini, thanks for the update21:43
EmilienMbnemec: approving21:44
bnemecEmilienM: You're gonna have to be more specific. :-)21:44
EmilienMbnemec: your patch on master for net-snmp21:45
*** shardy has quit IRC21:45
bnemecUnless you literally mean you're approving of me, in which case thank you. :-D21:45
bnemecEmilienM: Do we know if it fixed the problem yet?  Last I looked the ovb job is still running.21:45
EmilienMbnemec: http://logs.openstack.org/46/425346/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/bb4284e/console.html#_2017-01-25_21_06_18_71819121:45
EmilienMthat's mitaka21:45
EmilienMhave you seen it before?21:45
bnemecEmilienM: epel screwed us: Cannot retrieve metalink for repository: epel/x86_64. Please verify its path and try again21:46
EmilienMyes we are at step 221:46
bnemecI already rechecked the mitaka one, I believe.21:46
EmilienMI think the problem is solved21:46
bnemecIt doesn't fail until step 4.21:46
EmilienMah21:46
EmilienMok let's see21:47
bnemecIf I'm not confusing this problem with one of the other dozen I've looked at in the past few days.21:47
openstackgerritBrent Eagles proposed openstack/puppet-tripleo: Add initial profiles for rest of Octavia services  https://review.openstack.org/41142221:47
openstackgerritChris Jones proposed openstack/tripleo-common: Add action for generating fencing parameters.  https://review.openstack.org/42232121:47
*** gfidente|afk has quit IRC21:49
*** shinobu_ has quit IRC21:49
bnemecGiven that it's taking 4 hours to get things through the gate queue, getting this patch in there early probably isn't the worst thing anyway.21:51
EmilienMbnemec: once it pass step5, I'll approve it21:51
*** milan has quit IRC21:52
openstackgerritd.marlin proposed openstack/diskimage-builder: diskimage-builder - Add AArch64-specifics to finalize the bootloader  https://review.openstack.org/42543221:54
*** fultonj has quit IRC21:54
*** owalsh-brb is now known as owalsh21:55
*** smalleni is now known as sai121:57
*** sai1 is now known as smalleni21:57
jristEmilienM: "tripleo_ui" a good slug?21:58
*** zaneb has joined #tripleo21:58
EmilienMjrist: for what?21:58
jristEmilienM: or "openstack_tripleo_ui"21:58
jristreno21:58
jrist`reno new ...`21:58
jristtrying to follow a convention21:58
EmilienMjrist: please look at https://github.com/openstack/puppet-nova/tree/master/releasenotes/notes21:59
openstackgerritDan Trainor proposed openstack/puppet-tripleo: Proxy API endpoints that UI uses  https://review.openstack.org/42490921:59
openstackgerritIan Main proposed openstack/tripleo-heat-templates: Add docker nova services  https://review.openstack.org/42092121:59
openstackgerritIan Main proposed openstack/tripleo-heat-templates: Add Rabbit to the endpoint map  https://review.openstack.org/42092021:59
openstackgerritIan Main proposed openstack/tripleo-heat-templates: Add docker Glance API service  https://review.openstack.org/40087021:59
openstackgerritIan Main proposed openstack/tripleo-heat-templates: Add docker mysql service  https://review.openstack.org/41460121:59
openstackgerritIan Main proposed openstack/tripleo-heat-templates: Add docker ironic services  https://review.openstack.org/42151721:59
openstackgerritIan Main proposed openstack/tripleo-heat-templates: docker: eliminate copy-json.py in favor of json-file  https://review.openstack.org/41642021:59
openstackgerritIan Main proposed openstack/tripleo-heat-templates: Enable docker services in the registry  https://review.openstack.org/42156721:59
openstackgerritIan Main proposed openstack/tripleo-heat-templates: docker: new hybrid deployment architecture and configuration  https://review.openstack.org/41642121:59
openstackgerritIan Main proposed openstack/tripleo-heat-templates: Add docker neutron services  https://review.openstack.org/42299921:59
openstackgerritIan Main proposed openstack/tripleo-heat-templates: Add docker heat services  https://review.openstack.org/41763921:59
openstackgerritIan Main proposed openstack/tripleo-heat-templates: Add docker keystone service  https://review.openstack.org/41660521:59
openstackgerritIan Main proposed openstack/tripleo-heat-templates: WIP: Containerized Swift Services.  https://review.openstack.org/42543421:59
Slowerhrrm, hopefully I did that right :)22:00
jristEmilienM: not sure what I'm looking at22:00
jristSlower: lol22:00
EmilienMSlower: :( our gate was already very slow today22:00
Slowerhaha22:00
bnemecWell, time to go.  That's the end of ci results for today. :-)22:00
EmilienMI think we're even slower now ;-)22:00
jristSlower: how do you do 12 things at once?22:00
EmilienMSlower: keep in mind we are in release time, any saving of CI would be helpful ;-)22:00
jristEmilienM: currently looking at this22:00
jristEmilienM: http://docs.openstack.org/developer/reno/usage.html#creating-new-release-notes22:00
Sloweryeah sorry I messed that up22:00
jristEmilienM: I'm on step 2.22:01
jristbnemec: haha22:01
EmilienMjrist: so you want to create a rleease note for all ocata-3 work?22:01
jristEmilienM: honestly I don't know, do I? :)22:01
EmilienM...22:01
jristEmilienM: I have almost no idea what you're expecting22:01
openstackgerritDan Radez proposed openstack/tripleo-common: Adding release nodes for Congress and Tacker  https://review.openstack.org/42543622:02
EmilienMjrist: http://lists.openstack.org/pipermail/openstack-dev/2017-January/109946.html22:02
jristEmilienM: no patches so far in Ocata have done release notes for TripleO-UI22:02
jristI'm looking at that email22:02
EmilienMjrist: yes, so add them. Please run "reno new blablablabla" and in the new YAML files, put all stuffs for Ocata 322:02
EmilienMjrist: like we did for THT:22:03
EmilienMhttps://review.openstack.org/#/c/424365/22:03
jristEmilienM: so for a particular feature22:03
EmilienMplease look the patch22:03
radezEmilienM: is that correct? https://review.openstack.org/42543622:03
jristEmilienM: ah, so just for 3.022:03
jristmy god gerrit is so painful22:04
EmilienMradez: yes thx22:04
radezyou bet22:04
jristradez: so you did `reno new 5.8.0`22:05
EmilienMno22:05
EmilienMhe edited an existing note22:05
jristah22:05
EmilienMbut he could have create a new note22:05
jristEmilienM: so you did `reno new 6.0.0`22:05
EmilienMbecause nobody created notes in ocata-3, we have to write eveything now22:05
jristEmilienM: tripleo-ui is 3.0.0?22:05
EmilienMjrist: yes22:05
EmilienMjrist: not sure, let me check22:05
jristwhere do I find that?22:05
EmilienMjrist: dude you UI guy?22:05
EmilienMlol22:05
radezEmilienM: would a new note have been preferred?22:05
EmilienMlet me check for you22:06
EmilienMradez: no, we don't care22:06
jristEmilienM: haha yeah, but I'm not super familiar with the workings of the repos22:06
radezright on22:06
EmilienMwell, it's a YAML file22:06
EmilienMand it's doc22:06
jristradez: I think they are looking for the existence22:06
EmilienMthere i no magic :)22:06
EmilienMjrist: what is the next tag for tripleo-ui?22:06
EmilienMfor ocata-3?22:06
EmilienM2.0.2 ?22:06
bnemectpe is looking promising.22:07
bnemecnonha job passed ceph step 4, which I think is where it failed before.22:07
*** rbrady is now known as rbrady-afk22:08
EmilienMSlower: more seriously, we need to take care of rebases, etc Please do not rebase a patch if you're not sure about the lower patchers in the git order. Keep in mind your last rebase costs around ~180 jobs22:08
EmilienMjrist: "reno new 2.0.2" for ex22:10
jristEmilienM: so 3.0 is only for final Ocata release?22:10
EmilienMI don't know, maybe?22:10
EmilienMwhy would we bump to 3.0for ocata?22:10
EmilienMwe already have milestones on 2.x22:11
EmilienMpike would be 3.x no?22:11
*** ooolpbot has joined #tripleo22:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165938422:11
openstackLaunchpad bug 1659384 in tripleo "All ovb jobs failing to set up snmp" [Critical,In progress] - Assigned to Ben Nemec (bnemec)22:11
*** ooolpbot has quit IRC22:11
jristhttps://bugs.launchpad.net/tripleo/+bug/165775922:11
jristEmilienM: ^22:11
openstackLaunchpad bug 1657759 in tripleo "Update UI version to match rest of tripleo" [Medium,Triaged] - Assigned to Honza Pokorny (hpokorny)22:11
jristEmilienM: this doesn't seem to have been cleared up22:11
jristEmilienM: I am looking to you for guidance22:11
EmilienMok, works for me22:11
jristbefore I start building release notes on the wrong version22:11
EmilienMI'll tag it with what you guys want22:11
* bnemec needs to do a "rebase your patch on someone else's" youtube video22:12
EmilienMjrist: as long as you update package.json befor ethe release22:12
EmilienMjrist: and put the right version in releasenotes/config22:12
EmilienMI'm happy22:12
*** ansmith has quit IRC22:13
jristyou know what they say22:13
jristhappy EmilienM, happy life22:13
openstackgerritGonĂ©ri Le Bouder proposed openstack/tripleo-quickstart-extras: tempest: keep Ansible running after err  https://review.openstack.org/42543822:13
EmilienMlol22:13
trownlol22:13
dtrainorheh22:14
EmilienMbnemec: step 5, I'm approving it22:14
bnemecEmilienM: Already done :-)22:14
EmilienMbnemec: excellent22:14
bnemecI'm literally sitting here watching telnet sessions.22:14
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419022:15
*** rhallisey has quit IRC22:18
jristEmilienM: so you will tag within openstack/releases ?22:19
jristEmilienM: for 3.0.0 for tripleo-ui22:19
jrist.yaml22:19
EmilienMjrist: I will, just for you22:20
jristawwwww22:21
* jrist bluehes22:21
jristals;kjdf22:21
jristblushes22:21
jristfail22:21
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: POC: Use tripleo-repos in tripleo.sh  https://review.openstack.org/39581322:21
jristEmilienM: do you do a bunch of projects at once, or should I open a pull request for deliverables/ocata/tripleo-ui.yaml ?22:21
openstackgerritDan Radez proposed openstack/tripleo-heat-templates: adding Congress Support  https://review.openstack.org/33005022:22
EmilienMjrist: I'll do all in one next week22:24
jristok cool22:24
EmilienMI keep track of tripleo release management in this doc https://docs.google.com/spreadsheets/d/1qsp528xrYtTt5s6kdHrLEhIqFekbV4IxAFkfjGozH74/edit#gid=022:24
*** bfournie has left #tripleo22:26
ansiwenowalsh: I just copied that from the other patch, don't know if I need refresh22:28
ansiwenowalsh: sorry, retry22:28
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud: Add release notes for Ocata 6.0.0  https://review.openstack.org/42474622:30
*** bfournie has joined #tripleo22:31
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud: Add release notes for Ocata 6.0.0  https://review.openstack.org/42474622:31
openstackgerritOliver Walsh proposed openstack/instack-undercloud: Run cell v2 setup differently for upgrades  https://review.openstack.org/41912122:34
EmilienMlhinds: -2 removed on https://review.openstack.org/#/c/420040/22:34
EmilienMsince you made good progres on the package22:34
openstackgerritIan Main proposed openstack/tripleo-heat-templates: Add option to diff containers after config stage.  https://review.openstack.org/42544222:34
Slowerwoot! that's better22:36
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates: Enables support for configuring Cinder with a ScaleIO storage backend.  https://review.openstack.org/42223822:43
*** cdearborn has quit IRC22:45
EmilienMmwhahaha, sshnaidm : when we have the upgrade job passing, I propose to add it to the promotion pipeline22:46
EmilienMwdyt?22:46
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud: Add release notes for Ocata 6.0.0  https://review.openstack.org/42474622:46
EmilienM(undercloud and overcloud)22:46
*** owalsh_ has joined #tripleo22:46
*** owalsh has quit IRC22:46
sshnaidmEmilienM, I think we need to monitor them before, at least couple of weeks22:46
EmilienMsshnaidm: ok22:47
*** owalsh_ is now known as owalsh22:47
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart: WIP: Extend devmode to run with OVB  https://review.openstack.org/42544722:47
sshnaidmEmilienM, I'm not so familiar with them, need some time to look and learn22:47
EmilienMsshnaidm: they deploy newton and upgrade to ocata :)22:47
sshnaidmEmilienM, and when we will release ocata?22:48
sshnaidmEmilienM, will it upgrade from ocata to master?22:48
EmilienMsshnaidm: it will22:49
EmilienMsshnaidm: https://releases.openstack.org/ocata/schedule.html22:49
owalshansiwen: donno why the original retries... I don't see why it would need to22:50
EmilienMok I have to go now, I'm back later in the evening22:50
owalshansiwen: unless maybe something takes a while to come up, or it's waiting on something to happen on a different host22:50
ansiwenowalsh: I don't have an opinion...22:50
owalshansiwen: retry can't hurt I guess22:51
*** bfournie has quit IRC22:51
ansiwenowalsh: and refreshonly?22:52
ansiwenowalsh: oh, because there are no subscribes...22:52
*** jmelvin has quit IRC22:53
mwhahahaEmilienM: sshnaidm i'd like to see the upgrade in the promotion pipeline so we can escalate when people add breaking upgrade stuff again22:54
owalshansiwen: uh huh (is that how it's spelt? looks wrong)22:54
ansiwenand for the timeout I just use 300, which is the default in the other case22:54
ansiwenowalsh: I'm not a native speaker, and I mean subscribe values... I know many are "subscriptions"22:55
ansiwen:-)22:55
owalshansiwen: I mean is that how "uh huh" is spelt, I've never typed it22:56
ansiwenowalsh: oh, you are talking about the spelling of "uh huh"... I understood22:56
ansiwenyes22:56
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: POC: Use tripleo-repos in tripleo.sh  https://review.openstack.org/39581322:56
owalshansiwen: 5 minute timeout looks ok I think, it might take a little while but it's just migrating flavors22:57
openstackgerritMerged openstack/puppet-tripleo: Fix wrong hiera key in ceph_rbdmirror  https://review.openstack.org/42518222:57
openstackgerritMerged openstack/puppet-tripleo: Remove double include of neutron::server class  https://review.openstack.org/42525022:58
bnemecEmilienM: I'm going to let you do the honors on https://review.openstack.org/#/c/424746  I don't know if there was anything else planned for that.23:00
*** jkilpatr has quit IRC23:00
openstackgerritMerged openstack/instack-undercloud: Fix typo in undercloud.py  https://review.openstack.org/42373123:01
openstackgerritMerged openstack/tripleo-common: Add a delete stack workflow  https://review.openstack.org/42265823:01
ansiwenowalsh: btw: do you know a simple command to rebase a patch that is based on another patch?23:01
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: break out general_config into config, topology and provisioner  https://review.openstack.org/42545123:02
openstackgerritMerged openstack/python-tripleoclient: Migrate overcloud update to a mistral workflow  https://review.openstack.org/38135123:03
openstackgerritMerged openstack-infra/tripleo-ci: Fix logging issues for quickstart jobs  https://review.openstack.org/42263823:03
openstackgerritMerged openstack/puppet-tripleo: Composable HA  https://review.openstack.org/36238923:04
owalshansiwen: err... I've been using gerrit for a couple of months... cherrypick the other patch maybe23:05
*** egafford has quit IRC23:05
*** Goneri has quit IRC23:07
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras: pass the topology of the overcloud w/ topology vs extra-args  https://review.openstack.org/42545323:09
jristEmilienM: last question, I promise - is there a way to autogenerate the stuff that goes in features: / issues:23:09
bnemecansiwen: It's not exactly simple, but https://www.youtube.com/watch?v=EVE7ePIN3L0&index=5&list=PLR97FKPZ-mD9XJCfwDE5c-td9lZGIPfS5 shows how to do it.23:09
bnemecTo do a rebase that way you'd just need to re-checkout the patch you want as the base.23:10
ansiwenbnemec: I have an not exactly simple way already, thought the git-review tool might have such a feature maybe or so23:10
jristEmilienM: i.e. https://bugs.launchpad.net/tripleo/+bugs?field.searchtext=&orderby=-importance&field.status%3Alist=FIXRELEASED&assignee_option=any&field.assignee=&field.bug_reporter=&field.bug_commenter=&field.subscriber=&field.structural_subscriber=&field.tag=ui+&field.tags_combinator=ANY&field.has_cve.used=&field.omit_dupes.used=&field.omit_dupes=on&field.affects_me.used=&field.has_patch.used=&field.has_branches.used=&field.has_branches=on&field.has_no_branc23:11
jristhes.used=&field.has_no_branches=on&field.has_blueprints.used=&field.has_blueprints=on&field.has_no_blueprints.used=&field.has_no_blueprints=on&search=Search23:11
jristugh23:11
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: break out general_config into config, topology and provisioner  https://review.openstack.org/42545123:11
*** ooolpbot has joined #tripleo23:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165938423:11
*** ooolpbot has quit IRC23:11
openstackLaunchpad bug 1659384 in tripleo "All ovb jobs failing to set up snmp" [Critical,In progress] - Assigned to Ben Nemec (bnemec)23:11
jristhttp://bit.ly/2kuIN4H23:11
jristEmilienM: ^23:11
thrashEmilienM: ack. Will get relnotes done soon23:13
openstackgerritMerged openstack/puppet-tripleo: Adding tacker service  https://review.openstack.org/42264423:13
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras: [WIP] composable scenario tests  https://review.openstack.org/42482723:13
*** jcoufal has quit IRC23:15
openstackgerritDan Sneddon proposed openstack/tripleo-specs: Spec: tripleo-routed-networks-deployment - Routed Spine and Leaf  https://review.openstack.org/42100923:21
openstackgerritDan Sneddon proposed openstack/tripleo-specs: Spec: TripleO Ironic Inspector changes to support routed networks  https://review.openstack.org/42101123:22
*** newmember has quit IRC23:25
*** newmember has joined #tripleo23:25
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: POC: Use tripleo-repos in tripleo.sh  https://review.openstack.org/39581323:29
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/42462723:32
*** iranzo has quit IRC23:33
*** dmarlin has quit IRC23:36
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Add multinode subnodes to inventory  https://review.openstack.org/42387023:39
*** pradk has quit IRC23:40
*** jkilpatr has joined #tripleo23:41
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Collect only logs we need  https://review.openstack.org/42545923:42
openstackgerritMerged openstack/tripleo-heat-templates: Manage password_validator regex  https://review.openstack.org/41364423:50
openstackgerritDan Sneddon proposed openstack/tripleo-specs: Spec: triple-routed-networks-templates Refactor THT for routed nets.  https://review.openstack.org/42546423:53
*** tzumainn has quit IRC23:53
openstackgerritOliver Walsh proposed openstack/tripleo-common: Run nova manage cell_v2 discover_host after ironic nodes are registered  https://review.openstack.org/42527323:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!