Wednesday, 2017-05-31

fultonjmust be verly late for you00:00
owalshfultonj: 1am now... just kicked off kolla image build so time to call it a night :-)00:02
fultonjyep00:02
owalshttyl00:04
*** egafford has quit IRC00:08
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019500:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394500:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169428000:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)00:10
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged] - Assigned to John Trowbridge (trown)00:10
*** itlinux has quit IRC00:11
openstackgerritMerged openstack/diskimage-builder master: Remove dracut-network element  https://review.openstack.org/46893000:14
*** mdnadeem has joined #tripleo00:25
*** ansmith has joined #tripleo00:27
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Enable arp_accept for all interfaces  https://review.openstack.org/46919300:28
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Enable arp_accept for all interfaces  https://review.openstack.org/46919400:28
*** tzumainn has quit IRC00:29
*** egafford has joined #tripleo00:30
*** yamahata has quit IRC00:33
*** maeca1 has quit IRC00:53
*** egafford has quit IRC01:00
*** jmelvin has joined #tripleo01:03
openstackgerritSaravanan KR proposed openstack/tripleo-common master: WIP: Move passwords from mistral environment to swift environment  https://review.openstack.org/46790901:04
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019501:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394501:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169428001:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)01:10
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged] - Assigned to John Trowbridge (trown)01:10
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Refactor mount-point sorting  https://review.openstack.org/46929801:13
*** yamahata has joined #tripleo01:24
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Make BlockDeviceState implement a dict  https://review.openstack.org/46930301:32
*** fzdarsky__ has joined #tripleo01:38
*** fzdarsky_ has quit IRC01:41
openstackgerritMerged openstack/diskimage-builder master: Remove ccache  https://review.openstack.org/46873001:48
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019502:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394502:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169428002:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)02:10
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged] - Assigned to John Trowbridge (trown)02:10
openstackgerritMerged openstack/diskimage-builder master: drop deprecated map-services/packages from zypper element  https://review.openstack.org/45478602:11
*** jrist has quit IRC02:20
*** jaganathan has joined #tripleo02:23
*** jrist has joined #tripleo02:33
*** jrist has joined #tripleo02:33
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019503:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394503:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169428003:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)03:10
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged] - Assigned to John Trowbridge (trown)03:10
*** ramishra has joined #tripleo03:11
*** atheurer has quit IRC03:14
*** atheurer_ has joined #tripleo03:14
*** dmacpher has joined #tripleo03:19
*** dbecker has quit IRC03:20
*** eck` is now known as eck`gone03:22
*** udesale has joined #tripleo03:26
*** ykarel_ has joined #tripleo03:28
*** mdnadeem has quit IRC03:28
*** mdnadeem has joined #tripleo03:30
*** psahoo has joined #tripleo03:31
*** ykarel_ has quit IRC03:31
*** ykarel_ has joined #tripleo03:31
*** udesale has quit IRC03:31
*** udesale has joined #tripleo03:31
*** dbecker has joined #tripleo03:33
*** janki has joined #tripleo03:37
*** prateek has joined #tripleo03:40
*** ratailor has joined #tripleo03:41
*** links has joined #tripleo03:45
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019504:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394504:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169428004:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)04:10
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged] - Assigned to John Trowbridge (trown)04:10
*** jaosorior has quit IRC04:10
*** jaosorior has joined #tripleo04:13
openstackgerritVu Cong Tuan proposed openstack/diskimage-builder master: Trivial fix typos  https://review.openstack.org/46932404:17
*** masco has joined #tripleo04:19
*** dparkes has quit IRC04:36
openstackgerritMerged openstack/diskimage-builder master: Test openSUSE 42.2/42.3 image builds  https://review.openstack.org/46811504:37
*** udesale has quit IRC04:47
*** udesale has joined #tripleo04:48
*** pgadiya has joined #tripleo04:59
*** ramishra has quit IRC05:02
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019505:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394505:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169428005:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)05:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)05:10
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged] - Assigned to John Trowbridge (trown)05:10
*** jaganathan has quit IRC05:18
*** jaganathan has joined #tripleo05:18
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use picked nodes for later cmd_* calls  https://review.openstack.org/46933005:22
*** karthiks has joined #tripleo05:23
openstackgerritLee Yarwood proposed openstack/tripleo-quickstart master: libvirt: Remove use of deprecated state=running  https://review.openstack.org/46933105:25
*** lmiccini has joined #tripleo05:31
*** masco has quit IRC05:33
*** ramishra has joined #tripleo05:37
*** masco has joined #tripleo05:38
*** dparkes has joined #tripleo05:44
*** karthiks has quit IRC05:49
*** yprokule has joined #tripleo05:50
openstackgerritMerged openstack/diskimage-builder master: Add state object, rename "results", add unit tests  https://review.openstack.org/46898005:52
*** janki has left #tripleo05:54
*** janki has joined #tripleo05:54
*** dsneddon has quit IRC05:58
*** karthiks has joined #tripleo06:02
*** jaosorior has quit IRC06:08
*** ebarrera has joined #tripleo06:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019506:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394506:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169428006:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)06:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)06:10
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged] - Assigned to John Trowbridge (trown)06:10
*** rcernin has joined #tripleo06:10
*** yamahata has quit IRC06:11
*** iranzo has joined #tripleo06:17
*** iranzo has joined #tripleo06:17
*** jaosorior has joined #tripleo06:17
*** jprovazn has joined #tripleo06:18
*** ebarrera has quit IRC06:21
*** ebarrera has joined #tripleo06:21
*** hjensas has quit IRC06:23
*** dsariel has joined #tripleo06:26
openstackgerritSaravanan KR proposed openstack/tripleo-common master: Move passwords from mistral environment to swift environment  https://review.openstack.org/46790906:32
*** dsariel has quit IRC06:38
*** chem has quit IRC06:39
*** skramaja has joined #tripleo06:39
*** atoth has quit IRC06:41
*** atoth has joined #tripleo06:42
openstackgerritKarthik S proposed openstack/os-net-config master: MTU setting for OVSDpdkBond  https://review.openstack.org/46905606:43
*** aufi has joined #tripleo06:46
d0ugaldtantsur|afk: sorry, I missed you yesterday - the actions are loaded via $ mistral-db-manage populate06:46
d0ugaldtantsur|afk: I do want to make that automatic at some point (i.e. run at startup or something)06:47
d0ugaljkilpatr: Yeah, the batching was backported. Some issues came up in the review for the retrying part, so I am working on that again.06:48
d0ugaljkilpatr: the ocata backport: https://review.openstack.org/46551806:48
*** jaganathan has quit IRC06:52
*** tesseract has joined #tripleo06:53
*** shardy has joined #tripleo06:54
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: Adding featureset for periodic tempest jobs  https://review.openstack.org/46459806:55
*** bogdando has joined #tripleo07:00
*** lmiccini has quit IRC07:02
*** jaganathan has joined #tripleo07:03
*** kbyrne has quit IRC07:05
*** kbyrne has joined #tripleo07:06
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019507:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394507:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169428007:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)07:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)07:10
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged] - Assigned to John Trowbridge (trown)07:10
bogdandohi folks07:11
bogdando9:07:09 - bogdando: […] Could you please help with --control-flavor oooq_control param quickstart configures for the overcloud-deploy script? My deployment fails with 'OvercloudControlFlavor' is invalid: Error validating value 'oooq_control' ...07:11
bogdando9:07:24 - bogdando: I'm using a custom play07:11
bogdando9:07:39 - bogdando: https://github.com/bogdando/oooq-warp/blob/master/oooq-traas-over.yaml07:11
bogdando9:08:31 - bogdando: UC has no flavors pre-created07:11
bogdando9:08:37 - bogdando: what am I missing?07:11
bogdando9:09:54 - bogdando: what automation steps for extras stand for https://images.rdoproject.org/docs/baremetal/undercloud-post-install.html#flavor-details ?07:11
bogdando9:10:21 - bogdando: actually I'm using deployed-server, so no flavors needed07:11
*** jlinkes has joined #tripleo07:12
bogdandocan I skip flavor_args for deployed-server cases?07:14
shardybogdando: you should be able to, because nova/ironic aren't used07:14
shardyI don't know if there are assumptions in quickstart which prevent it though07:14
bogdandoyeah, just trying to figure out a quickstartish way to do so07:14
*** lmiccini has joined #tripleo07:15
bogdandoperhaps I could just omit this https://github.com/bogdando/oooq-warp/blob/master/vars/overcloud-traas.yaml#L14 and add flavor_args: []07:16
*** flepied has quit IRC07:17
bogdandoanyway, I'm happy I've made a progress with my overcloud deploy journey :)07:17
*** lmiccini has quit IRC07:17
*** lmiccini has joined #tripleo07:17
bogdandoit fails much further now from the point it used to a few weeks ago07:17
bogdandogiven my special pre-provisioned vanilla centos7, it's not bad07:17
*** florianf has joined #tripleo07:18
*** chem has joined #tripleo07:18
*** lmiccini has quit IRC07:18
*** lmiccini has joined #tripleo07:19
openstackgerritAdriano Petrich proposed openstack/tripleo-common master: use Result from mistral_lib instead of mistral  https://review.openstack.org/45471907:19
*** lmiccini has quit IRC07:20
*** lmiccini has joined #tripleo07:21
*** lmiccini has quit IRC07:22
*** lmiccini has joined #tripleo07:22
*** lmiccini has joined #tripleo07:22
*** lmiccini has quit IRC07:23
bogdandoshardy: thank you for help, I have a confirm flavor_args should be empty for deployed-server07:25
*** pcaruana has joined #tripleo07:26
EmilienMhellow07:26
bogdandohi07:27
*** lmiccini has joined #tripleo07:27
shardyHey EmilienM07:27
EmilienMadarazs: if you have time, maybe you can review https://review.openstack.org/#/c/469261/207:27
EmilienMit would unblock stable/newton ovb jobs07:27
*** amoralej|off is now known as amoralej07:30
*** ccamacho has quit IRC07:31
*** dtantsur|afk is now known as dtantsur07:31
*** jaganathan has quit IRC07:31
*** jaganathan has joined #tripleo07:32
dtantsurd0ugal: thanks!07:33
*** mcornea has joined #tripleo07:34
*** suuuper has joined #tripleo07:35
*** zoli|gone is now known as zoli07:36
*** zoli is now known as zoli|wfh07:37
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Use dynamic include for conditional/tagged tasks  https://review.openstack.org/46400507:38
*** hjensas has joined #tripleo07:40
*** hjensas has quit IRC07:40
*** hjensas has joined #tripleo07:40
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Bump Ansible to 2.3  https://review.openstack.org/45819307:41
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Fix dynamic include for conditional/tagged tasks  https://review.openstack.org/46935907:41
*** egonzalez has joined #tripleo07:44
*** ramishra has quit IRC07:44
*** flepied has joined #tripleo07:46
*** tosky has joined #tripleo07:47
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Add Introspection status to Nodes  https://review.openstack.org/46787207:48
*** jlinkes_ has joined #tripleo07:50
*** apevec has joined #tripleo07:51
*** jpena|off is now known as jpena07:52
*** milan has joined #tripleo07:52
*** sid1 has joined #tripleo07:53
*** ramishra has joined #tripleo07:53
*** jlinkes has quit IRC07:54
*** paramite has joined #tripleo07:55
*** jpich has joined #tripleo07:56
*** zzzeek has quit IRC08:00
*** zzzeek has joined #tripleo08:01
*** ccamacho has joined #tripleo08:03
*** tvignaud has quit IRC08:03
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Add openstack undercloud backup  https://review.openstack.org/46621308:06
*** root has joined #tripleo08:06
*** root is now known as Guest5381608:06
*** fragatina has joined #tripleo08:07
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Make containers use MySQL client configuration file  https://review.openstack.org/46937208:08
*** fragatina has quit IRC08:09
*** Guest53816 has quit IRC08:09
*** fragatina has joined #tripleo08:09
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019508:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394508:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169428008:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)08:10
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged] - Assigned to John Trowbridge (trown)08:10
*** Chao has joined #tripleo08:11
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Add openstack undercloud backup  https://review.openstack.org/46621308:13
Chaois there redhat prodsupport für tripple  o based openstack installations? is there an anssible based installation automation, pls dont name aio08:14
*** kbyrne has quit IRC08:14
*** tvignaud has joined #tripleo08:14
*** lucas-afk is now known as lucasagomes08:15
*** kbyrne has joined #tripleo08:17
shardyChao: Hi, this isn't really the place for product discussion, but FYI the Red Hat OSP director tool is based on TripleO:08:17
shardyhttp://redhatstackblog.redhat.com/2016/07/25/introduction-to-red-hat-openstack-platform-director/08:17
*** b00tcat has joined #tripleo08:21
Chaothey have a lot of shady products but delivier them with dev or no support, the question was is the director a full supported one?08:21
*** skramaja_ has joined #tripleo08:21
openstackgerritNuman Siddique proposed openstack/puppet-tripleo master: Pacemaker support for OVN DB servers  https://review.openstack.org/37227408:22
shardyChao: if you google "Red Hat OSP director" you'll find all the official docs08:22
*** skramaja has quit IRC08:23
*** jaganathan has quit IRC08:32
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Support composable roles for deploying overcloud  https://review.openstack.org/45571908:33
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Specify custom role data for multinode jobs  https://review.openstack.org/45573008:35
sri_shardy_: hi, is there any way I can install bare minimal overcloud with nova , neutron, glance,cidner and heat ? I have a 6GB memory in my controller when i run overcloud deploy I getting erros like08:35
sri_Error: /Stage[main]/Neutron::Agents::Dhcp/Service[neutron-dhcp-service]: Failed to call refresh: Cannot allocate memory - fork(2)     Error: /Stage[main]/Neutron::Agents::Dhcp/Service[neutron-dhcp-service]: Cannot allocate memory - fork(2)     Error: /Stage[main]/Neutron::Server/Service[neutron-server]: Could not evaluate: Cannot allocate memory - fork(2)08:35
*** cylopez has joined #tripleo08:35
sri_shardy_: Maybe install mininal overcloud should solve this issue !!08:37
*** jaganathan has joined #tripleo08:42
*** derekh has joined #tripleo08:44
*** akrivoka has joined #tripleo08:46
*** gbarros has joined #tripleo08:46
openstackgerritSaravanan KR proposed openstack/tripleo-common master: WIP: Derive Parameters workflow input and output functionalities  https://review.openstack.org/46938408:47
EmilienMjistr: we approved a bunch of things with mandre (I'm sit close to him right now), let me know if there is more things08:51
*** udesale__ has joined #tripleo08:52
shardysri_: yes you can reduce the number of workers e.g include this environment file:08:52
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/environments/low-memory-usage.yaml08:53
shardysri_: also you can use composable services to disable services you don't want08:53
shardyhttps://docs.openstack.org/developer/tripleo-docs/advanced_deployment/composable_services.html08:53
*** dobson has joined #tripleo08:54
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Add openstack undercloud backup  https://review.openstack.org/46621308:54
shardyhttps://docs.openstack.org/developer/tripleo-docs/advanced_deployment/custom_roles.html08:54
shardysri_: the easiest way is copy the default roles_data.yaml, remove the services/roles you don't want, then pass -r my_roles_data.yaml to the deploy command08:54
*** remixtj has joined #tripleo08:55
sri_shardy_: got it thanks08:55
*** ramishra_ has joined #tripleo08:56
*** strigazi_ has joined #tripleo08:56
*** brault has quit IRC08:58
*** sid2 has joined #tripleo08:58
*** rasca_ has joined #tripleo08:59
*** hewbrocc` has joined #tripleo08:59
*** dtantsur_ has joined #tripleo09:00
*** zzzeek_ has joined #tripleo09:00
*** numans_ has joined #tripleo09:00
*** hexo- has joined #tripleo09:00
*** radez` has joined #tripleo09:00
*** zoli has joined #tripleo09:00
*** akrivoka has quit IRC09:01
*** zzzeek has quit IRC09:01
*** ramishra has quit IRC09:01
*** sid1 has quit IRC09:01
*** udesale has quit IRC09:01
*** links has quit IRC09:01
*** numans has quit IRC09:01
*** pblaho has quit IRC09:01
*** athomas has quit IRC09:01
*** remix_tj has quit IRC09:01
*** zoli|wfh has quit IRC09:01
*** hexo_ has quit IRC09:01
*** radez has quit IRC09:01
*** dobson` has quit IRC09:01
*** hewbrocca_afk has quit IRC09:01
*** rasca has quit IRC09:01
*** strigazi has quit IRC09:01
*** jistr has quit IRC09:01
*** dtantsur has quit IRC09:01
*** dtantsur_ is now known as dtantsur09:01
bogdandofolks, what deployed-server cases expect for http://codesearch.openstack.org/?q=OvercloudControlFlavor&i=nope&files=&repos= ?09:01
bogdandomy overcloud stack fails with 'baremetal' default flavor not found. I have no flavors, as I do pre-provisioned (deployed-server) nodes09:02
*** jistr has joined #tripleo09:02
bogdandocan I just say 'null' somehow? tripleo client looks like does not expect it tho09:03
shardybogdando: https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data_undercloud.yaml#L309:03
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Make containers use MySQL client configuration file  https://review.openstack.org/46937209:03
shardyI think you need to specify disable_constraints which stops the heat constraint checking with glance09:03
*** _milan_ has joined #tripleo09:03
*** andreaf has quit IRC09:03
*** beagles has quit IRC09:03
*** limao has joined #tripleo09:03
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/role.role.j2.yaml#L809:04
bogdandoshardy: oh indeed! I forgot to disable it for overcloud09:04
*** milan has quit IRC09:04
shardybogdando: yeah, I'm not exactly sure how slagle wanted that to work for the overcloud deployed server case, I think we probably use baremetal because most underclouds will have the default flavor, even if we don't actually use it09:05
*** skramaja has joined #tripleo09:05
bogdandomine one is very special09:05
bogdandoit has no flavors :D09:05
*** b3nt_pin has joined #tripleo09:06
*** b3nt_pin is now known as Guest4632509:06
*** andreaf has joined #tripleo09:06
*** links has joined #tripleo09:06
*** athomas has joined #tripleo09:07
bogdandoso yeah, I need jistr 's composable roles patch it seems09:07
*** pblaho has joined #tripleo09:07
*** akrivoka has joined #tripleo09:07
*** skramaja_ has quit IRC09:07
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019509:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394509:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169428009:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)09:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)09:10
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged] - Assigned to John Trowbridge (trown)09:10
openstackgerritJulie Pichon proposed openstack/tripleo-common master: Use Swift to store Plan environment  https://review.openstack.org/45229109:10
*** ckyriakidou has joined #tripleo09:11
*** masco is now known as masco_afk09:11
openstackgerritMerged openstack/tripleo-quickstart-extras master: Implement different approach to modify image  https://review.openstack.org/46897509:11
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Add release note for image_build  https://review.openstack.org/46938809:11
EmilienMmatbu: ^ done sir09:11
openstackgerritMerged openstack-infra/tripleo-ci master: Use "manual" image modification method for OVB jobs  https://review.openstack.org/46897609:12
matbuEmilienM: cool thank you09:12
EmilienMmy pleasure09:12
*** salmankhan has joined #tripleo09:13
EmilienMcan someone review https://review.openstack.org/#/c/469261/ ASAP please?09:13
*** jaosorior is now known as jaosorior_lunch09:19
*** fzdarsky__ is now known as fzdarsky|afk09:19
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs  https://review.openstack.org/35921509:19
*** gbarros has quit IRC09:21
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/newton: Newton CI testing  https://review.openstack.org/46925409:21
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: WIP add docker template for octavia services  https://review.openstack.org/46725409:23
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: DO NOT MERGE: testing octavia containers  https://review.openstack.org/46939209:23
openstackgerritOpenStack Release Bot proposed openstack/puppet-pacemaker master: Update reno for stable/0.6.x  https://review.openstack.org/46939709:27
EmilienMbandini: puppet-pacemaker released, branch in progress09:28
EmilienMhttps://github.com/openstack/puppet-pacemaker/tree/stable/0.6.x09:28
bandiniEmilienM: thanks so much!!09:28
bandinidciabrin: ^09:28
*** limao has quit IRC09:29
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Ocata upgrades testing - DNM  https://review.openstack.org/46305009:31
openstackgerritKarthik S proposed openstack/os-net-config master: Multiqueue support for OvsDpdkBond  https://review.openstack.org/46916409:32
*** masco_afk is now known as masco09:33
*** jaganathan has quit IRC09:45
openstackgerritMartin André proposed openstack/tripleo-common master: Add missing cinder container images  https://review.openstack.org/46940109:45
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Move iscsid to a container  https://review.openstack.org/46253809:46
mrungehello, there is a collectd container in kolla. unfortunately, it is not deployed in a containerized deployment via tripleo. how to debug this?09:47
*** prateek has quit IRC09:47
EmilienMmrunge: I think you need to patch tripleo-common/container-images/overcloud_containers.yaml09:48
mrungethanks EmilienM, looking09:48
yolandahi, EmilienM et al... do you know why selinux-permissive is added when generating the tripleo images on centos? i am working with the security hardened images, so it looks opposite to the concept, to include selinux-permissive, but i'd like to know the reasons why it was included09:49
EmilienMyolanda: tbh, I don't know09:51
EmilienMyolanda: have you look at git blame?09:52
bogdandohm, does this error msg means I can't deploy a composed overcloud w/o nova?  https://pastebin.com/rdbFhbum shardy jistr ^^09:52
bogdandoshardy, jistr: here is my template https://github.com/bogdando/oooq-warp/blob/master/custom.yaml_example#L80 (it has Nova anyway...)09:53
bogdandoand my custom role is here https://github.com/bogdando/oooq-warp/blob/master/vars/overcloud-traas.yaml09:56
*** gbarros has joined #tripleo09:56
jistrbogdando: it means that you wanted to deploy 'Nova' service but it doesn't exist / isn't in the resource registry09:56
jistrbogdando: https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml#L173-L18209:56
yolandaEmilienM, seems it has been there forever09:56
bogdandojistr: strange, I use a default one from tht09:57
yolandasince https://review.openstack.org/#/c/290468/4/image-yaml/overcloud-images-centos7.yaml09:57
jistrbogdando: so maybe you meant NovaApi + the other controller nova services?09:57
jistrbogdando: we don't have one named just 'Nova' afaik09:57
bogdandojistr: does you custom roles patch overrides   ServicesDefault: from tht's role_data?09:57
bogdandoif so, I missed the whole thing haha09:57
*** jaganathan has joined #tripleo09:58
openstackgerritMerged openstack/puppet-pacemaker master: Update reno for stable/0.6.x  https://review.openstack.org/46939709:58
bogdandojistr: I followed an example https://review.openstack.org/#/c/455730/6/toci-quickstart/config/testenv/multinode.yml, it has no ServicesDefault derived from tht's role_data, shall it?09:59
jistrbogdando: the patch it overrides the whole roles_data file, so yea either one has to provide the default set of services there, or use the composable_services params09:59
bogdandooops! jistr thanks10:00
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Containerized Sensu client  https://review.openstack.org/46408510:00
bogdandojistr hm, but I use composable_services10:00
bogdandoit seems these two can't be merged well10:00
bogdandoor I do this wrong :)10:00
jistrbogdando: yea that should be fine. I still think the main problem is that 'OS::TripleO::Services::Nova' simply doesn't exist :)10:00
jistrbogdando: see https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml#L173-L18210:01
bogdandoit seems you patch should consider merging overcloud_services to overcloud_roles10:01
bogdandoyour*10:01
bogdandojistr: oh, indeed!10:01
*** karimb has joined #tripleo10:01
bogdandoso strange it's not there10:02
*** prateek has joined #tripleo10:02
jistrbogdando: overcloud_roles can fill both roles, but we need overcloud_services for backward compatibility at the very least, or it can be useful for cases when you really just want to tweak the services but not roles. But yea it's a thin line...10:02
jistrs/both roles/both use cases/  for more clarity :)10:03
bogdandojistr: I think, if ServicesDefault is missing for the custom_roles, it shall fallback to those from overcloud_services10:03
bogdandoor do deep merge10:04
jistrbogdando: yea it should fall back. That's what i'm relying on here and it passed CI like that before https://review.openstack.org/#/c/455730/6/toci-quickstart/config/testenv/multinode.yml10:04
bogdandofor some strange reason it doesn't try to merge for me it seems, but let me try with missing OS::TripleO::Services::Nova10:05
bogdandohm, which file this needs to be mapped with?10:05
openstackgerritMerged openstack/tripleo-heat-templates master: Containerized nova-compute working with Deployed Server  https://review.openstack.org/46839110:05
jistrbogdando: i think what you have here should work https://github.com/bogdando/oooq-warp/blob/master/custom.yaml_example#L74-L8710:07
bogdandobut it fails with missing resource...10:07
jistrbogdando: and judging by the error with non-existing Nova, the list did get used indeed10:07
*** salmankhan has quit IRC10:07
jistrbogdando: i mean it should work in terms of respecting that list, but yea if there's a non-existent service in that list, things will fail10:08
* bogdando confused and staggering10:08
bogdandojistr: the error says it founds the resource, but not the map for it resources.PuppetServices: The Resource Type (OS::TripleO::Services::Nova) could not be found.10:09
jistrbogdando: i think you should remove 'OS::TripleO::Services::Nova' from that list and add 'OS::TripleO::Services::NovaApi', 'OS::TripleO::Services::NovaConductor', ...10:09
bogdandoso wondering, which map it wants? tht has none as well10:09
bogdandooh, good idea10:09
bogdandobad paste from quickstart/ci defauls haha10:09
jistr:))10:10
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019510:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394510:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169428010:10
*** ooolpbot has quit IRC10:10
* jistr lunch bbl10:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)10:10
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged] - Assigned to John Trowbridge (trown)10:10
*** akrivoka has quit IRC10:10
*** prateek has quit IRC10:10
*** prateek has joined #tripleo10:11
openstackgerritMerged openstack/tripleo-image-elements master: Add overcloud-secure element  https://review.openstack.org/44912210:12
openstackgerritOliver Walsh proposed openstack/puppet-tripleo stable/newton: SSHD Service extensions  https://review.openstack.org/46941010:15
openstackgerritOliver Walsh proposed openstack/puppet-tripleo stable/newton: Stop SSHD profile clobbering SSH client config  https://review.openstack.org/46941110:15
openstackgerritOliver Walsh proposed openstack/puppet-tripleo stable/newton: Refactor SSHD config to allow both SSHD options and banner/motd to be set  https://review.openstack.org/46941210:15
openstackgerritOliver Walsh proposed openstack/puppet-tripleo stable/newton: Configure migration SSH tunnel  https://review.openstack.org/46941310:15
*** links has quit IRC10:16
*** akrivoka has joined #tripleo10:16
openstackgerritSteven Hardy proposed openstack/tripleo-common master: Pass all role data into role templates when rendering  https://review.openstack.org/46941610:18
*** jaganathan has quit IRC10:21
*** jaganathan has joined #tripleo10:21
*** salmankhan has joined #tripleo10:22
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Convert role templates to consume roles_data map  https://review.openstack.org/46942110:35
*** links has joined #tripleo10:36
*** gbarros has quit IRC10:37
*** atoth has quit IRC10:38
*** jaosorior_lunch is now known as jaosorior10:41
*** shardy has quit IRC10:44
*** jkilpatr has quit IRC10:47
openstackgerritOliver Walsh proposed openstack/puppet-tripleo stable/ocata: Restrict nova migration ssh tunnel  https://review.openstack.org/46942310:48
*** iranzo has quit IRC10:49
openstackgerritMerged openstack/diskimage-builder master: Decode string to bytes in dracut-regenerate  https://review.openstack.org/46917210:49
openstackgerritMerged openstack/diskimage-builder master: Refactor mount-point sorting  https://review.openstack.org/46929810:50
*** cylopez has quit IRC10:52
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates stable/ocata: Restrict nova migration ssh tunnel  https://review.openstack.org/46942510:53
openstackgerritMerged openstack/diskimage-builder master: Make BlockDeviceState implement a dict  https://review.openstack.org/46930310:55
*** jpena is now known as jpena|lunch10:56
yolandahi, can i get a second +2 on https://review.openstack.org/448528 ? for the security hardened images to land10:57
*** jkilpatr has joined #tripleo11:00
openstackgerrityolanda.robla proposed openstack/tripleo-common master: Add creation of security hardened images  https://review.openstack.org/44852811:02
openstackgerritMerged openstack/tripleo-quickstart master: featureset001: don't use disable-telemetry.yaml on stable/newton  https://review.openstack.org/46926111:06
openstackgerritMerged openstack/puppet-tripleo master: Add missing octavia mysql user creation  https://review.openstack.org/46768011:06
bogdandojistr: do you know how I should merge  -r /usr/share/openstack-tripleo-heat-templates/deployed-server/deployed-server-roles-data.yaml with the custom_roles?11:08
bogdandoshould I pass both role files?11:08
*** sshnaidm|off has quit IRC11:08
bogdandoor merge deployed server content into the custom_roles?11:08
*** zoli is now known as zoli|lunch11:09
bogdandointo the overcloud_roles.yaml?11:10
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019511:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394511:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169428011:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)11:10
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged] - Assigned to John Trowbridge (trown)11:10
bogdandojistr: or if I put both role files, the latter always wins?11:12
*** liverpooler has quit IRC11:13
jistrbogdando: i think you can only use a single role file, not sure which one would win though11:13
bogdandoso composable deployed server roles...11:13
*** rbrady has quit IRC11:14
bogdandoit seems I need to sed Controller to ControllerDeployedServer and the remaining role to get what I want as quickstartish overcloud_roles!11:16
bogdandoroles*11:16
*** pradk has joined #tripleo11:18
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates stable/ocata: Add ignore_projects to filter gnocchi events  https://review.openstack.org/46920211:19
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Upgrade gnocchi without skip-storage  https://review.openstack.org/46816511:19
*** kbyrne has quit IRC11:23
jistrbogdando: could you feed in only deployed-server/deployed-server-roles-data.yaml, and then use overcloud_services to customize the service list? Or do you need to override the roles too?11:24
*** thrash|g0ne is now known as thrash11:25
*** oneswig has joined #tripleo11:29
*** oneswig has quit IRC11:29
*** oneswig has joined #tripleo11:29
bogdandojistr: default deployed-server-roles-data.yaml tries to deploy all roles11:31
bogdandoso I'm testing right now https://github.com/bogdando/oooq-warp/blob/37d697ad7481fadf03bfdfbca9c25b9135f68294/vars/overcloud-traas.yaml#L24-L5911:32
*** fzdarsky|afk is now known as fzdarsky11:33
adarazsEmilienM: hi, I'm looking into what's blocking TripleO promotion (I mean issue or bug) but I'm none the wiser... I don't see anything here: https://trello.com/b/WXJTwsuU/tripleo-and-rdo-ci-status -- the long virt-customize thing should not affect the periodic jobs... so do you know which bug I can point at?11:36
*** salmankhan has quit IRC11:39
*** atoth has joined #tripleo11:39
*** social has joined #tripleo11:40
*** ansmith has quit IRC11:40
*** Guest46325 is now known as beagles11:41
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: create history for the overcloud deploy command  https://review.openstack.org/44661711:43
*** bfournie has quit IRC11:43
jistrbogdando: yup imo that should work. Not 100% sure if the services combination is enough for all steps to succeed, but conceptually lgtm.11:44
bogdandojistr, thanks a lot11:45
openstackgerritMerged openstack/tripleo-quickstart-extras master: deploy_args order to support scenarios with containers  https://review.openstack.org/46673111:45
openstackgerritMerged openstack/tripleo-quickstart master: Featureset010 for multinode containers  https://review.openstack.org/46709411:46
*** salmankhan has joined #tripleo11:47
Chaois ooo production ready, does anyone offer support for it, maybe even prod support, redhat ops director notes dont say anything about it11:47
*** cylopez has joined #tripleo11:48
openstackgerritMerged openstack/python-tripleoclient stable/newton: Remove "baremetal show capabilities" command  https://review.openstack.org/42088311:48
*** pkovar has joined #tripleo11:48
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Refactor setup_docker_host.sh as host_prep_tasks  https://review.openstack.org/46916311:48
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Containerize virtlogd  https://review.openstack.org/46911611:48
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Containerized Sensu client  https://review.openstack.org/46408511:53
EmilienMadarazs: I'm not sure either yet11:54
adarazsEmilienM: looks like we have a bunch of issues layered up.11:54
*** jaganathan has quit IRC11:54
*** _milan_ is now known as milan11:54
honzaweshay: Sorry for the late reply.  No, I haven't tested ssl lately.11:54
EmilienMadarazs: yeah we have a bunch of things but it should be more stable now11:55
*** abishop has joined #tripleo11:56
atothstill looking for reviewers for lbaasV2 https://review.openstack.org/#/c/31422511:57
adarazsEmilienM: http://status-tripleoci.rhcloud.com/ -> looks like all the master periodic jobs have some ironic related overcloud deployment problem and I don't see a bug open about it. I'll look into it a bit more.11:57
EmilienMadarazs: it's on my list for today too, but please look and let's sync before EOD11:57
bogdandoChao: AFAIK, quickstart is a development and CI only tool, although the docs https://www.rdoproject.org/tripleo/ didn't state that well11:57
*** egafford has joined #tripleo11:58
adarazsEmilienM: ack. I'm trying to figure out before pgm call because we don't have a new promote since the 21st.11:58
bogdandoplease correct me folks, but quickstart is not for production deployments11:58
atothbogdando, from rdoproject page "Deploy a production cloud with the TripleO Quickstart."11:59
atothhttps://www.rdoproject.org/12:00
bogdandoatoth: oh well, then my answer was incorrect, sorry Chao ^^12:00
*** morazi has joined #tripleo12:02
openstackgerritAlex Schultz proposed openstack/puppet-tripleo stable/ocata: Dell SC: Add exclude_domain_ip option  https://review.openstack.org/46107612:02
bogdandoI think quickstart roles are ready for production deployments, but some of the pre-defined plays may be missing to address multiple nodes deployments. Like running ansible by chunks of nodes, in parallel... what do you think folks, am I right?12:03
*** chlong has quit IRC12:03
*** udesale__ has quit IRC12:03
*** ramishra_ has quit IRC12:03
*** ramishra has joined #tripleo12:04
*** amoralej is now known as amoralej|brb12:04
Chaosry i need a reference to a page that points out a price to a decent level of support for this project12:05
*** jayg|g0n3 is now known as jayg12:06
*** jaganathan has joined #tripleo12:06
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Provide commands for example roles  https://review.openstack.org/46690012:07
*** trown|outtypewww is now known as trown12:07
*** jpena|lunch is now known as jpena12:08
*** kbyrne has joined #tripleo12:08
*** prateek has quit IRC12:08
*** lucasagomes is now known as lucas-hungry12:09
*** mdnadeem has quit IRC12:09
*** ratailor has quit IRC12:09
*** psahoo has quit IRC12:10
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Allow depending on changes we dont actually build  https://review.openstack.org/45332612:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019512:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394512:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169428012:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)12:10
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged] - Assigned to John Trowbridge (trown)12:10
*** cylopez has quit IRC12:10
*** links has quit IRC12:11
*** karimb has quit IRC12:12
*** ykarel__ has joined #tripleo12:13
*** cylopez has joined #tripleo12:14
*** ykarel_ has quit IRC12:15
*** maeca1 has joined #tripleo12:16
ansiwendoes the containerized CI use environment/docker.yaml? I added my service there, but I don't see it deployed...12:16
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: TEST ONLY: Check telemetry container upgrades  https://review.openstack.org/46762112:16
openstackgerritMerged openstack/tripleo-quickstart-extras master: get_host_info: sort rpm -qa  https://review.openstack.org/46764812:18
*** bfournie has joined #tripleo12:22
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Implement Upgrade workflow via the tripleo cli  https://review.openstack.org/46372812:22
openstackgerritAlan Bishop proposed openstack/tripleo-common master: Derive Params (part 2): Get services and feature list  https://review.openstack.org/45647112:23
socialskramaja: ping re https://review.openstack.org/#/c/468960/12:24
*** psahoo has joined #tripleo12:25
*** janki has quit IRC12:26
socialskramaja: just to get some hints - I should create new workplan just for that swift container and somehow call it from the deploy and plan_management?12:26
*** ykarel__ has quit IRC12:28
*** dprince has joined #tripleo12:29
*** jmelvin has quit IRC12:29
*** jmelvin has joined #tripleo12:30
*** zoli|lunch is now known as zoli|wfh12:32
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Adjust package installation for openSUSE  https://review.openstack.org/46873412:35
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart master: Switch to "ipmi" hardware type by default for >= Pike  https://review.openstack.org/46890712:35
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Drop support for Ubuntu precise  https://review.openstack.org/46818612:36
*** pchavva has joined #tripleo12:37
*** psahoo has quit IRC12:38
*** ecerquei has joined #tripleo12:39
*** ansmith has joined #tripleo12:41
honzad0ugal: is there a standard way of configuring workflows using mistral's cron trigger?  tripleo standard?  i didn't see anything in tripleo-common12:43
*** rbrady has joined #tripleo12:45
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Add openstack undercloud backup  https://review.openstack.org/46621312:47
*** liverpooler has joined #tripleo12:47
*** athomas has quit IRC12:48
*** sshnaidm has joined #tripleo12:48
*** sshnaidm is now known as sshnaidm|off12:49
*** athomas has joined #tripleo12:49
adarazsdtantsur: hi, could you take a look at some ironic error that we have in the master promotion jobs? seems like it cropped up yesterday and we fail to promote due to it.12:49
dtantsuradarazs: sure, what's it?12:50
adarazsdtantsur: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha/44d2533/logs/undercloud/var/log/ironic/ironic-conductor.txt.gz?#_2017-05-31_07_49_17_12612:50
adarazsdtantsur: looks like a timeout, but I can't make it out why.12:50
adarazsdtantsur: I'll open a bug if it's not apparent what could cause it, but I thought I try first with you :)12:51
skramajayes social, an internal workflow in the same workbook should be good enough. sample for invoking an internal workflow is - https://github.com/openstack/tripleo-common/blob/master/workbooks/plan_management.yaml#L1812:51
dtantsuradarazs: it seems that it does not PXE boot. it could be problems with OVB/whatever you use for power or PXE.12:51
*** psahoo has joined #tripleo12:52
*** trown is now known as trown|brb12:52
adarazsdtantsur: hm, okay, thanks. /me is not that much into the OVB stuff, will have to get somebody to look at it more closely. :)12:52
dtantsuradarazs: could be valuable to look at node's console, but it seems that tripleo CI does not publish it..12:53
adarazsyeah, I don't think we have it.12:53
dtantsuradarazs: if it's possible, I *highly* recommend you enable it. this is often the key component to debugging12:53
dtantsuradarazs: in devstack CI we're redirecting qemu virtual console to files. here you'll probably have to fetch nova serial console.12:54
honzadtantsur: Just wondering --- do you have any patches up yet for auto registration?12:54
adarazsdtantsur: hmm, I think we're going to implement this in quickstart. I add a card for it. thanks for the suggestion.12:54
openstackgerritSanjay Upadhyay proposed openstack/tripleo-heat-templates master: WIP - Role Specific parameters for neutron-sriov-agent service  https://review.openstack.org/46946412:54
dtantsurhonza: you mean, via enumerating IPMI addresses? I have, but I never came to even trying it..12:55
honzadtantsur: ok12:55
dtantsuradarazs: cool! this will help with this debugging too: we'll know if it even powered on, and whether there are any problems with PXE process12:55
adarazsright.12:55
*** psahoo has quit IRC12:56
openstackgerritMatthias Runge proposed openstack/tripleo-heat-templates master: Containerized collectd  https://review.openstack.org/46946512:58
openstackgerritSanjay Upadhyay proposed openstack/tripleo-heat-templates master: WIP - Role Specific parameters for neutron-sriov-agent service  https://review.openstack.org/46946412:58
*** manous_ has joined #tripleo12:59
*** trown|brb is now known as trown13:03
*** cdearborn has joined #tripleo13:05
*** manous_ is now known as manous13:06
*** Goneri has joined #tripleo13:07
d0ugalhonza: we don't use the cron trigger yet AFAIK13:07
*** dtantsur is now known as dtantsur|brb13:08
*** lucas-hungry is now known as lucasagomes13:08
*** masco has quit IRC13:09
openstackgerritCarlos Camacho proposed openstack/instack-undercloud master: Stop OpenStack services before the Undercloud upgrade.  https://review.openstack.org/46947413:09
*** yamahata has joined #tripleo13:09
*** anton has left #tripleo13:10
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019513:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)13:10
*** cdearborn__ has joined #tripleo13:10
*** karimb has joined #tripleo13:12
mandretrown: hi! do you have an idea how we can expand the disk space for the undercloud? we're close to capacity https://bugs.launchpad.net/tripleo/+bug/169470913:12
openstackLaunchpad bug 1694709 in tripleo "Reaching disk space capacity for containers job" [High,Triaged]13:12
socialskramaja: thx13:13
trownmandre: hmm the undercloud is a nodepool node... not sure we can get more disk space13:14
socialskramaja: I tested that the patches do fix the issue so now I'd like to make it more sane :)13:14
*** strigazi_ is now known as strigazi13:15
*** lifeless has quit IRC13:15
mandretrown: what a bummer :(13:17
mandreneed to send those images on a diet13:17
ansiwenmandre: can you tell me, if it is enough to add the service to environments/docker.yaml in order to let CI test the container deployment? I can't see it in my test commit.13:20
openstackgerritOliver Walsh proposed openstack/puppet-tripleo stable/newton: SSHD Service extensions  https://review.openstack.org/46941013:21
mandreansiwen: right, normally if you add a service to environments/docker.yaml it's enabled in your overcloud deployment13:22
slagleEmilienM: when you setup to the coresec group, did you susbscribe it to all tripleo bugs?13:22
mandreansiwen: what's the review?13:22
slagleEmilienM: i'm getting spammed on every tripleo bug launchpad update13:22
EmilienMslagle: me too13:22
EmilienMslagle: I had to update my launchpad filter13:22
EmilienMbut now this is ok13:22
ansiwenmandre: https://review.openstack.org/#/c/46920113:22
slagleEmilienM: is it something in launchpad or do you just mean a local email filter?13:23
ansiwenmandre: this is just a tester commit to enable the previous commit (because it's an opt-in service)13:23
EmilienMslagle: the old gmail label rule wasn't matching the new emails with the new group (I can't figure why but now launchpad sends emails on this group)13:23
EmilienMslagle: I use Gmail filters13:23
ansiwenmandre: not sure, which job should test it then13:23
slagleyea ok. to trash it is13:23
*** masco has joined #tripleo13:23
*** karimb has quit IRC13:23
EmilienMslagle: lol13:23
*** tzumainn has joined #tripleo13:24
*** cdearborn has quit IRC13:25
ansiwenmandre: anyway I'm confused, undercloud-containers-nv also does an overcloud deployment with containers, I don't understand the naming I guess13:25
mandreansiwen: so... looks like this job timed out before it even went to testing your service, but it wouldn't have worked anyway13:26
mandreansiwen: you need to add your container images to tripleo-common so that it can be picked up by CI13:26
mandreansiwen: https://github.com/openstack/tripleo-common/blob/master/container-images/overcloud_containers.yaml13:27
ansiwenmandre: ok, I see. I asked yesterday about any intermediate steps. is this documented anywhere?13:27
mandreansiwen: it's well hidden in the docs, https://docs.openstack.org/developer/tripleo-docs/containers_deployment/tips_tricks.html#testing-in-ci13:28
ansiwenmandre: will the images automatically be built? or do I have to also add it somewhere else?13:28
mandreansiwen: in your case since it's a new kolla image we'll need to push it to the registry13:29
mandrehas your kolla patch merged already?13:29
ansiwenmandre: yes, it merged13:29
*** chlong has joined #tripleo13:29
ansiwenmandre: didn't know that doc page, thanks!13:30
mandreansiwen: cool, so we'll need to build a new batch of container images first13:30
florianfbnemec: Hi, I have a quick question on one of the pre-upgrade validations you proposed (disk space). Whenever you have a minute... :-)13:30
mandreI know sensu is also missing13:31
ansiwenmandre: while you are at it, I also need nova-consoleauth and nova-vnc-proxy13:32
mandredprince: how do we build images these days? is it ok from a fresh tripleo-common checkout?13:32
ansiwenmandre: nova-novncproxy13:33
*** lifeless has joined #tripleo13:33
ansiwenmandre: pushing new images is a manual step?13:33
*** eck`gone is now known as eck`13:34
mandreansiwen: it's still manual, but not for long thanks to the good work of dmsimard13:35
ansiwenmandre: so what you are talking about is a full run of "docker build" commands for all the tripleo images?13:35
mandreansiwen: nova-novncproxy and nova-consoleauth are already there, you should be good13:36
mandreansiwen: https://hub.docker.com/r/tripleoupstream/centos-binary-nova-novncproxy/13:36
ansiwenmandre: great... oh, this is all on the official docker registry? I wasn't aware of that!13:36
EmilienMnew CI thing: ovb-updates is now failing on pingtest, when uploading image to Glance: http://logs.openstack.org/00/461000/19/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates/8e8955b/console.html#_2017-05-31_12_35_16_94668613:36
mandreansiwen: right, a full kolla rebuilt with our tripleo customization applied, https://github.com/openstack/tripleo-common/blob/master/container-images/tripleo_kolla_template_overrides.j213:37
ansiwenmandre: do I have to do a "customization" for the ec2-api as well? or are these generic customizations?13:37
mandreansiwen: you shouldn't have to, we try to stick as close to the vanila kolla images as possible13:40
*** ecerquei has quit IRC13:40
ansiwenmandre: cool13:41
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: DNM : debug why ovb-updates job fails in pingtest  https://review.openstack.org/46948413:41
*** chlong has quit IRC13:43
openstackgerritSven Anderson proposed openstack/tripleo-common master: Add EC2-API container image  https://review.openstack.org/46948613:44
*** lblanchard has joined #tripleo13:46
*** chlong has joined #tripleo13:46
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates master: DONT MERGE - Test for Ib96040c2e27ad76b1fa6ecb9468bb9d97b3c4518  https://review.openstack.org/46920113:47
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates master: Add Ec2Api to container based deployment  https://review.openstack.org/46920013:47
*** cylopez has quit IRC13:48
ansiwenmandre: am I allowed to add several images to overcloud_containers.yaml, or do I need three changes?13:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Ability to enable/disable debug mode per OpenStack service  https://review.openstack.org/46769813:50
openstackgerritSven Anderson proposed openstack/tripleo-common master: Add container image for nova-consoleauth and nova-novncproxy  https://review.openstack.org/46949413:54
mandreansiwen: you can of course add a couple of images in the same commit if they're related13:54
*** amoralej|brb is now known as amoralej13:56
openstackgerritSanjay Upadhyay proposed openstack/tripleo-heat-templates master: WIP - Role Specific parameters for neutron-sriov-agent service  https://review.openstack.org/46946413:58
*** atheurer_ has quit IRC13:58
*** jefrite has quit IRC14:02
ansiwenpradk: what do you mean with "API is not enabled by default"? why did I need the OS::Heat::None in the non-container case?14:03
*** jmelvin has quit IRC14:04
openstackgerritKarthik S proposed openstack/tripleo-heat-templates master: Fix the constraints for THT params NeutronDpdkCoreList and HostCpusList  https://review.openstack.org/46949814:04
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357614:05
*** Chao has quit IRC14:05
*** cdearborn__ is now known as cdearborn14:05
*** atheurer has joined #tripleo14:07
dprincemandre: yes, I just rebuilt yesterday14:07
dprincemandre: and it was from a fresh checkout of the tripleo kolla overrides from tripleo-common14:08
dprincemandre: no cherry picks, etc14:08
*** cylopez has joined #tripleo14:08
*** eck` is now known as eck`gone14:08
mandredprince: perfect! I have built locally new images (sensu and ec2-api kolla images were merged in the meantime), ok if I push?14:09
dprincemandre: ack, feel free14:09
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests  https://review.openstack.org/40373114:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019514:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)14:10
*** ooolpbot has quit IRC14:10
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Providing parameters specific to a workflow via plan-environment  https://review.openstack.org/45787414:12
skramajaabishop fultonj ^ updated14:13
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add novajoin docker service  https://review.openstack.org/46950314:13
*** yamahata has quit IRC14:13
*** gbarros has joined #tripleo14:14
*** gbarros has quit IRC14:15
openstackgerritPradeep Kilambi proposed openstack/puppet-tripleo master: DNM: Test gnocchi api issue  https://review.openstack.org/46950614:15
*** atheurer has quit IRC14:16
*** lblanchard has quit IRC14:17
*** atheurer has joined #tripleo14:17
*** lblanchard has joined #tripleo14:18
jpichhonza: About the zaqar issue at https://bugs.launchpad.net/tripleo/+bug/1693862 , have you looked into the Mistral logs as well? I wonder if it may be the same as https://bugs.launchpad.net/tripleo/+bug/1691951 , with a different error showing up from the UI14:19
openstackLaunchpad bug 1693862 in tripleo "Zaqar messages cannot be enqueued" [High,Triaged]14:19
openstackLaunchpad bug 1691951 in tripleo "Lost connection to MySQL during query" [Medium,Triaged] - Assigned to Michele Baldessari (michele)14:19
*** lblanchard has quit IRC14:20
honzajpich: logs have been useless, i'll check out the other bug14:20
*** lblanchard has joined #tripleo14:20
jpichhonza: There's no solution yet, but using the CLI I've definitely hit that second one a lot14:20
honzajpich: hmm, interesting... I have definitely seen this bug, too.14:20
jpichhonza: Do you mean, seen that error pop up on the UI as well?14:21
*** jlinkes_ has quit IRC14:22
*** eck`gone is now known as eck`14:22
honzajpich: no, cli14:22
jpichhonza: The end result of  no message enqueued is kinda similar so I wonder if they're related14:22
jpichok14:22
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Fix ansible-lint.sh to check playbooks  https://review.openstack.org/44652514:24
*** iranzo has joined #tripleo14:25
*** iranzo has quit IRC14:26
*** iranzo has joined #tripleo14:26
apevecEmilienM, matbu - how come this is not upstream ? https://github.com/redhat-openstack/tripleo-upgrade14:26
EmilienMouch, yeah why did we create this repo?14:26
EmilienMapevec: see https://review.openstack.org/#/c/459762/ - we didn't agree on creating the repo14:27
adarazstrown: is there an easy way to run quickstart with the latest unpromoted hash locally?14:27
EmilienMmatbu: please remove it, this is not the right place to have a tripleo repo. Thanks14:28
*** croelandt has joined #tripleo14:28
croelandtHello! I'm trying to run TripleO. I see that this command fails: "set -o pipefail && /home/stack/undercloud-install.sh 2>&1 | awk '{ print strftime(\"%Y-%m-%d %H:%M:%S |\"), $0; fflush(); }' > /home/stack/undercloud_install.log", but I cannot find /home/stack/undercloud-install.sh nor /home/stack/undercloud_install.log, is this normal?14:29
mandreansiwen: is ec2-api running eventlet or on top of apache?14:33
matbuEmilienM: hey, it's just experimental for now14:34
ansiweneventlet14:34
ansiwenmandre: ^14:34
matbuEmilienM: we want to see how we can converge all together (qe/eng)14:34
EmilienMmatbu: well, it always starts as experimental :-)14:34
EmilienMmatbu: I asked something here https://review.openstack.org/#/c/459762/ and I didn't have a reply14:34
mandreansiwen: ok, so it means the kolla image is good, but not the t-h-t one14:34
matbuEmilienM: yep, but we know we aim to remove this one and create something upstream14:34
*** iranzo has quit IRC14:34
mandreeasier to fix :)14:34
*** dsneddon has joined #tripleo14:35
EmilienMmatbu: tbh, I'm not in favor of this new repo and it's not something we've agreed :(14:35
*** jmelvin has joined #tripleo14:35
matbuEmilienM: which one ? the upstream or this github one ?14:36
EmilienMmatbu: both14:36
EmilienMI don't think we agreed on having a tripleo-upgrade repository14:36
EmilienMbefore we know what we actually put in there14:36
EmilienMI made it clear on https://review.openstack.org/#/c/459762/14:37
EmilienMand you went ahead and created the repo in redhat organization :(14:37
ansiwenmandre: could you sanity-check this here, can this be functional? https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/nova-metadata.yaml#L42-L5914:38
matbuwe don't know either, as i said its experimental, its not for bypass upstream, see that for a temporary infrared pluging14:38
openstackgerritMerged openstack/tripleo-common master: Add creation of security hardened images  https://review.openstack.org/44852814:38
matbuchem: ^14:38
openstackgerritMerged openstack/tripleo-quickstart master: Bump Ansible to 2.3  https://review.openstack.org/45819314:39
ansiwenmandre: I think I got it: "pass-thru configuration for metadata (it simply enables metadata to be configured as part of the nova-api)"14:42
EmilienMmatbu: it can be a "playground" but I don't want to see anything that could live in another place. Like I don't want to see any workaround, etc14:42
mandreansiwen: that's correct14:45
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates master: Fix log path typo  https://review.openstack.org/46951914:46
*** flepied has quit IRC14:46
*** pblaho has quit IRC14:46
*** pblaho has joined #tripleo14:46
*** pblaho has quit IRC14:51
*** pblaho has joined #tripleo14:51
*** pblaho has quit IRC14:54
*** pblaho has joined #tripleo14:54
ansiwenmandre: yeah, I realized, I shouldn't have used the panko file as a base, because it is apache based. nova-scheduler seems to be a good base though14:56
openstackgerrityolanda.robla proposed openstack/tripleo-common master: Update security hardened images with latest content  https://review.openstack.org/46952814:56
*** dtantsur|brb is now known as dtantsur14:58
*** pblaho has quit IRC14:58
*** pblaho has joined #tripleo14:59
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Adjust package mapping for SUSE family  https://review.openstack.org/46953315:00
*** pblaho has quit IRC15:00
EmilienMgithub is having networking issues FYI, please "recheck" if you find some clone issues15:01
*** pblaho has joined #tripleo15:02
ansiwenmandre: how do I determine, if my service also need a DockerNovaConfigImage like _some_ of the other nova services?15:02
adarazsEmilienM: so a quick update about the promotion job: the ironic logs don't seem to give any good guesses about what's wrong, the instances just time out starting. it might be related to some PXE booting issue, we don't have enough logging from the OVB instances (console output) to decide what's wrong.15:02
EmilienMadarazs: yeah I saw it on the ovb-updates15:02
EmilienMadarazs: I did recheck to see if it's consistent15:02
EmilienMadarazs: if yes, I'll file a bug and ask ironic experts probably15:03
adarazsEmilienM: ack, thanks.15:03
EmilienMadarazs: this is what I found : http://logs.openstack.org/15/359215/103/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates/5632a0a/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-05-31_11_49_51_52915:03
EmilienMadarazs: same thing for you?15:04
adarazslet me check, just a sec.15:04
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Adjust package mapping for SUSE family  https://review.openstack.org/46953315:05
adarazsEmilienM: FWIW I added a card to include the console dump of instances to quickstart when we're running on OVB to have some better logging next time this happens (when we transition the promotion jobs to Quickstart) suggested by Dimitry https://trello.com/c/dPNcMCJ515:05
openstackgerritBogdan Dobrelya proposed openstack/tripleo-specs master: Best practices for logging of containerized services  https://review.openstack.org/46290015:07
adarazsEmilienM: yep, looks the same to me in the periodic job: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha/78acd34/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-05-31_07_42_41_82315:07
EmilienMadarazs: :(15:08
*** pblaho has quit IRC15:08
EmilienMadarazs: weird, the promotion job passed on ovb-ha for me15:08
EmilienMadarazs: see https://review.openstack.org/#/c/359215/15:08
*** pblaho has joined #tripleo15:08
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019515:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)15:10
*** ooolpbot has quit IRC15:10
adarazsEmilienM: interesting. I'm looking at http://status-tripleoci.rhcloud.com/ and all three OVB periodic seems to have the same error for yesterday and today.15:10
EmilienMadarazs: well, we fixed a bunch of things this morning15:10
adarazsokay, let's hope it will work on the next run then :)15:11
EmilienMbut I'll double check the rpm versions making sure ovb-ooq-ha is still testing trunk15:11
adarazsack.15:11
* adarazs has to log off now.15:11
adarazssee you!15:11
*** florianf has quit IRC15:11
adarazsshoot me an email if I should pick something up regarding this tomorrow morning.15:12
EmilienMadarazs: oops15:12
EmilienMjobs didn't test the same thing15:12
EmilienMhttps://www.diffchecker.com/f74tsiHb15:12
apevecEmilienM, can you force periodic promotion?15:12
EmilienMapevec: yes but bad idea15:12
*** pblaho has quit IRC15:12
EmilienMapevec: jobs are failing15:12
adarazsEmilienM: I was unsure that that job will work as is :)15:12
adarazsbut I didn't know enough to question it.15:12
EmilienMit sounds like gate-tripleo-ci-centos-7-ovb-ha-oooq doesn't pick latest package15:12
*** limao has joined #tripleo15:12
*** pblaho has joined #tripleo15:12
EmilienMapevec: do you want to force something broken? :)15:13
apevecno, I mean force trigger of the periodic jobs15:13
*** dmacpher_ has joined #tripleo15:13
apevecnot force promote!15:13
EmilienMapevec: yes I can with https://review.openstack.org/#/c/359215/15:13
EmilienMit sounds like something bad blocking us now15:14
EmilienMapevec: nova/ironic timeout to build servers for overcloud15:14
trozetdprince, Slower: for hte puppet-tripleo stuff with containers, is that still stored in the overcloud-full qcow for generating the configs.  I want to modify the disk image with the puppet-tripleo from my patch, so just verifying it should go there or if it is stored in a container somewhere now..15:14
trownEmilienM: afaik we dont have oooq jobs in promote... panda|pnq was working on that15:14
trownEmilienM: which means https://review.openstack.org/#/c/359215/ is not actually doing the same thing as promote15:15
EmilienMtrown: ok, I didn't know. thanks15:15
EmilienMlooking at https://status-tripleoci.rhcloud.com/ - it seems like something merged very recently that brok eus15:15
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Refactor setup_docker_host.sh as host_prep_tasks  https://review.openstack.org/46916315:16
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Containerize virtlogd  https://review.openstack.org/46911615:16
*** flepied has joined #tripleo15:16
dprincetrozet: yes, we bind mount in puppet-tripleo from the host ATM15:16
*** dmacpher has quit IRC15:16
trozetdprince: cool, thanks15:16
*** limao_ has joined #tripleo15:16
dprincetrozet: http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/docker-puppet.py#n21615:17
*** limao has quit IRC15:17
trozetdprince: ty15:18
*** florianf has joined #tripleo15:18
EmilienMtrown: I'm debugging it now but I'll probably create a new bug in Launchpad with alert tag and escalate to nova/ironic folks if I don't have any clue.15:18
bogdandois this a timed out job http://logs.openstack.org/92/450792/28/check-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq-nv/92e0bc7/console.html#_2017-05-31_10_08_16_761934 ?15:19
trownEmilienM: k I will try to setup reproducer on rdocloud, so we can give access if we need to15:19
bogdandodeploy log looks not finished http://logs.openstack.org/92/450792/28/check-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq-nv/92e0bc7/logs/oooq/undercloud/home/jenkins/overcloud_deploy.log.txt.gz, so is it a timeout?..15:20
*** Guest21633 has joined #tripleo15:20
EmilienMdtantsur: you still around by any chance?15:21
dtantsurEmilienM: hi, I totally am15:21
dtantsur(though on meeting)15:21
*** Guest21633 has quit IRC15:22
EmilienMdtantsur: we're seeing ironic conductor timeouts when testing recent packages (promotion pipeline) : http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha/78acd34/logs/undercloud/var/log/ironic/ironic-conductor.txt.gz#_2017-05-31_07_42_41_35515:22
trozetdoes anyone know if undercloud installs with ocata are working within the last couple days?  I am hitting errors keystone starting, Table 'keystone.token' doesn't exist15:22
EmilienMdtantsur: I'm not sure if it's the pxe timeout which is too short?15:23
dtantsurEmilienM: yeah, I've seen it. nodes never post back, I can't tell why from stating at empty logs. hence I asked adarazs if it's possible to store node's consoles as part of CI runs.15:23
dtantsurEmilienM: IIRC they timed out after 30 minutes, which is way more than enough15:23
dtantsurI'll check the recent changes, but it can be anything, including e.g. neutron15:23
ansiwenmandre: I guess "bootstrap_host_exec panko_api su panko..." needs root privileges, no?15:23
EmilienMdtantsur: ok, I'll keep digging then15:24
sri_trozet_: I've installed the undercloud two day ego15:24
dtantsurEmilienM: when exactly was the first failure?15:24
trozetsri_: ok thanks.  must be on my end then15:24
EmilienMdtantsur: around 26 or 27th May15:25
dtantsurack15:25
EmilienMit's hard to tell because we had issues before ironic15:25
EmilienMbut it's not before 26th for sure15:25
mandreansiwen: exact, but it's ok, the panko-api default user is root15:25
EmilienMwe have a window of 4 days of commits15:25
ansiwenmandre: but I'm using a comparable line for ec2api15:26
*** pblaho has quit IRC15:26
dtantsurEmilienM: nothing suspicious in openstack/ironic, checking other stuff15:27
*** pblaho has joined #tripleo15:28
saibnemec: if i see a node consistently failing with "No valid host found" on TripleOCapabilities filter even when using scheduler hints are being udes, what should i be looking at?15:28
trowndtantsur: I am setting up reproducer on rdocloud now15:28
dtantsurtrown++15:28
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates master: Add Nova Consoleauth service to containerized deployment  https://review.openstack.org/46954115:28
dtantsurbut we totally need ramdisk logs in the CI15:28
bnemecsai: Make sure your node tag matches the scheduler hint you're passing in an environment.15:30
bnemecAlso make sure some other filter isn't removing the node that should match before it gets to the capabilities filter.15:30
*** pblaho has quit IRC15:30
bnemecI've seen that happen too.15:30
saibnemec: thanks, there are 12 machine swith the same tag, 11 of them succeed just the same one fails always..maybe i should look at extras[ecs15:30
bnemecsai: That's not how the capabilities filter works.  Each node has to have a unique tag if you're trying to use predictable placement.15:31
*** pblaho has joined #tripleo15:31
bnemeccompute-0, compute-1, etc.15:31
saibnemec: yeh, guess u put it the wrong way, r730ceph-0, r730ceph-1...is what i had15:32
sais/u/i15:32
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Providing parameters specific to a workflow via plan-environment  https://review.openstack.org/45787415:32
*** dciabrin has quit IRC15:32
*** cylopez has quit IRC15:32
bnemecsai: Okay, can you paste an ironic node-show one a node and the environment file you're using to set the scheduler hint?15:33
dtantsurEmilienM: it does not look like it even came to iPXE stage: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha/78acd34/logs/undercloud/var/log/httpd/ipxe_vhost_access.txt.gz15:33
saibnemec: sure, one moment15:33
*** skramaja has quit IRC15:33
dtantsurI wonder if it even received any DHCP15:34
EmilienMdtantsur: yeah15:34
bnemecIs it possible we're being bitten by the pxe_ipmitool to ipmi transition somehow?15:35
saibnemec: https://gist.github.com/smalleni/5ad5e96cd842cbc391e54e24f9c6903715:35
*** jlinkes has joined #tripleo15:35
saii have all nodes go into active except this one r730ceph-315:36
saithe deploy failed on the same node twice15:36
trozettrown: hi15:37
*** mcornea has quit IRC15:37
bnemecsai: Oh, it's just one node?  The rest are being scheduled correctly?15:38
saibnemec: correct15:38
trowntrozet: hello fellow tro*15:38
EmilienMdtantsur: VIF 08caf34a-436b-4aec-b71e-c50b7a2847b6 successfully detached from node 136efc68-30ce-41a1-bb79-aa500a2a6d87 - sounds like neutron might be fine15:38
trozetdprince: dumb question...how do i tell which kolla containers were actually uploaded15:39
trozetdprince: cant find a list command15:39
dtantsurunless it's broken in a weird way..15:39
bnemecsai: Hmm, that's very strange.  It looks like the node is configured correctly.  Can you paste me the nova-scheduler log too?15:39
bnemecJust the relevant bit. :-)15:39
trozettrown: heh15:39
trozettrown: it looks like there are missing packages in OOO undercloud image for ocata15:39
trowntrozet: like?15:40
trozettrown: openstack-tripleo-validations, openstack-ironic-inspector, subunit-filters, docker-distribution15:41
dprincetrozet: on your undercloud do 'docker images'15:41
dprincetrozet: actually, no. You can't list the registry easily15:41
dprincetrozet: just local docker images15:41
trozetdprince: oh they are uploaded into docker? i thought they would be in openstack15:41
dprincetrozet: there aren't good CLI tools for docker-distribution yet15:41
dprincetrozet: well, I haven't found them at least15:42
trowntrozet: those get installed by instack-undercloud if the features are enabled15:42
dprincetrozet: images are cached in a local docker registry on the undercloud. Those are what you are asking about right?15:42
trozetdprince: right, i want to make sure the opendaylight container is there15:43
*** aufi has quit IRC15:43
trozetdprince: doing docker images it doesnt look like it is there15:43
EmilienMdtantsur: i'm creating a bug in /tripleo for now15:43
dtantsur++15:44
dtantsurI cannot make any sense out of logs.. I guess we need to reproduce it and/or tcpdump15:44
*** thrash is now known as thrash|biab15:44
dtantsurbtw, we need to run tcpdump on the CI and save its results. that would help A LOT15:44
trozetdprince: so i can just docker pull it, and then it should work?15:44
*** dciabrin has joined #tripleo15:44
*** bogdando has quit IRC15:47
EmilienMdtantsur: sounds like mwhahaha already reported one like this: https://bugs.launchpad.net/tripleo/+bug/166472715:47
openstackLaunchpad bug 1664727 in tripleo "ovb fails with CREATE_FAILED ResourceInError: resources.Controller: Went to status ERROR due to "Message: Failed to provision instance ... Timeout reached while waiting for callback"" [High,Triaged]15:47
EmilienMlet's re-use it15:47
pradkdprince, can we get the tacker and congress container patches in, they have been sitting for a while now15:48
dprincetrozet: you'd have to docker pull it and then get it into your docker-registry on the undercloud15:49
EmilienMdtantsur: ouch http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha/78acd34/logs/undercloud/var/log/neutron/openvswitch-agent.txt.gz#_2017-05-31_06_24_10_49615:49
dprincetrozet: docker puppet, docker tag <IP>:container_name, docker push <IP>:container_name15:49
dprincetrozet: something like that15:49
EmilienMdtantsur: and http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha/78acd34/logs/undercloud/var/log/neutron/server.txt.gz#_2017-05-31_08_16_19_96615:49
trozetdprince: if I just add it to /usr/share/openstack-tripleo-common-containers/container-images/overcloud_containers.yaml, and do the right openstack overcloud container command, will it do it for me?15:50
dprincepradk: yes, in a meeting and then I'll review again15:50
*** rcrit has joined #tripleo15:50
pradkdprince, thx!15:51
trozetdprince: oh i see overcloud-prep-containers.sh, this looks like waht i want openstack overcloud container image upload --verbose --config-file /usr/share/openstack-tripleo-common/container-images/overcloud_containers.yaml15:52
EmilienMdtantsur: you were right, probably not in ironic :P15:53
dprincetrozet: perhaps, also this: http://git.openstack.org/cgit/openstack/tripleo-common/tree/container-images/overcloud_containers.yaml15:53
dtantsurEmilienM: right :) the only ironic problem (which we're aware of) is that it's not explicitly checking for port binding result. otherwise we could have a better error message.15:54
apevecEmilienM, could that be neutron bug that amoralej reported?15:56
openstackgerritDmitry Tantsur proposed openstack/tripleo-docs master: Document hardware types for the undercloud and virtualbmc  https://review.openstack.org/46891015:57
pradkEmilienM, mwhahaha, can you guys review this https://review.openstack.org/#/c/468165/ again15:57
mwhahahapradk: did we ever figure out the update issue on that one?15:57
EmilienMapevec: I'm on #openstack-neutron15:57
pradkmwhahaha, setting '' had the same impact.. but we need this for regular install to work for gnocchi, so lets not block this15:58
mwhahahapradk: ok15:58
*** sid2 has quit IRC15:58
*** yamahata has joined #tripleo15:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK  https://review.openstack.org/43027716:00
*** sid1 has joined #tripleo16:00
pradkmwhahaha, EmilienM, now we also need this .. https://review.openstack.org/#/c/469506/  (I put a DNM for now to see what ci says) .. i recall you said this causes apache restarts. We need to figure something out for this.16:01
pradkstarting gnocchi api in step 3 is not going to work for us.. as the storage is only initialized in step416:01
pradkif you guys can add some thoughts to this test patch16:01
pradkcurrently we're starting the api even before swift or ceph are initialized.. so api thinks we're using file driver16:02
pradkbut the config later gets configured to swift/ceph16:02
pradkso we have to either restart the api again or move this to step 4 like we had before16:03
pradkor move gnocchi out of apache entirely (which is a bigger change, i'm looking into it)16:03
openstackgerritBen Kero proposed openstack/tripleo-quickstart-extras master: Create new arg for composable services  https://review.openstack.org/46928616:03
*** yamahata has quit IRC16:04
chemEmilienM: matbu sorry missed the notif.  Yeah, we think that as we couldn't easily define the scope of the project ex nihilo, sharing some upgrade code between infrared and oooq could be a way to better define the project.  It has the advantage to share some code with infrared, which is step in right direction anyway.16:04
*** ebarrera has quit IRC16:04
*** b00tcat has quit IRC16:04
ansiwendprince: the service is called nova-vnc-proxy.yaml but the kolla image is called nova-novncproxy. Question: do I set role_data/kolla_config in nova-vnc-proxy.yaml to /var/lib/kolla/config_files/nova_vncproxy.json or .../nova_novncproxy.json ? :-)16:05
*** yamahata has joined #tripleo16:05
*** karimb has joined #tripleo16:05
honzad0ugal: rbrady: jpich: do you have any high-level thoughts on where the crontrigger code the gui logging should go? puppet-tripleo?16:05
*** milan has quit IRC16:06
*** rcernin has quit IRC16:07
*** limao_ has quit IRC16:07
*** tesseract has quit IRC16:08
dprinceansiwen: you can name the actual kolla_config file to whatever you want, so long as it is mapped into the container (bind mounted) like this:16:10
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019516:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169452416:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)16:10
openstackLaunchpad bug 1694524 in tripleo "Neutron OVS agent fails to start when neutron-server is not available" [Critical,Triaged]16:10
*** trown is now known as trown|lunch16:10
dprinceansiwen: http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/services/neutron-api.yaml#n13616:10
jpichhonza: I'm not actually familiar with it, no thoughts at this point16:12
honzajpich: thanks!16:12
jpichhonza: Good luck!16:12
ansiwendprince: so, the role_data/kolla_config defines where the config file is _created_, not where it is _found_?16:12
*** jpich has quit IRC16:14
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Fix inventory without existing stack  https://review.openstack.org/46955416:14
ansiwendprince: yeah, I think that was my misunderstanding, it's a directive for config creation. thanks for the hint! :-)16:14
*** dparkes has quit IRC16:15
*** yprokule has quit IRC16:16
openstackgerritPradeep Kilambi proposed openstack/puppet-tripleo master: DNM: Test gnocchi api issue  https://review.openstack.org/46950616:18
rbradyhonza:I have an idea, but I'm looking for the exact place it should go (and making sure I'm not sending you to /dev/null)16:19
honza:)16:19
*** sshnaidm|off has quit IRC16:21
rbradyhonza: essentially, it has to happen after the workflows are added to the db which happens here: https://github.com/openstack/instack-undercloud/blob/c984ea9b356b7e89748119122a97cfc54e532c47/elements/undercloud-install/os-refresh-config/post-configure.d/98-undercloud-setup#L93-L10216:22
*** akrivoka has quit IRC16:22
rbradyhonza: but I don't know how future-proof that location is atm16:23
honzarbrady: cool!16:23
*** maeca1 has quit IRC16:23
karimbping ccamacho16:25
karimbis there somedoc on how to use os-net-config-mappings.yaml16:25
*** oneswig has quit IRC16:25
karimbNetConfigDataLookup to be accurate16:25
*** oneswig has joined #tripleo16:26
*** lucasagomes is now known as lucas-afk16:26
*** oneswig has quit IRC16:26
*** maeca1 has joined #tripleo16:27
openstackgerritOliver Walsh proposed openstack/puppet-tripleo stable/newton: Stop SSHD profile clobbering SSH client config  https://review.openstack.org/46941116:29
trozettrown: sorry didnt see your response16:30
trozettrown|lunch:^16:30
openstackgerritOliver Walsh proposed openstack/puppet-tripleo stable/newton: Refactor SSHD config to allow both SSHD options and banner/motd to be set  https://review.openstack.org/46941216:31
openstackgerritOliver Walsh proposed openstack/puppet-tripleo stable/newton: Configure migration SSH tunnel  https://review.openstack.org/46941316:31
*** florianf has quit IRC16:33
*** egafford has quit IRC16:34
*** egafford has joined #tripleo16:35
*** pblaho has quit IRC16:41
*** rcernin has joined #tripleo16:46
*** jkilpatr has quit IRC16:47
*** sid1 has quit IRC16:48
*** jlinkes has quit IRC16:49
*** pcaruana has quit IRC16:50
*** ckyriakidou has quit IRC16:54
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Add ssh tunneling for TripleO-UI  https://review.openstack.org/40773316:54
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add steps to enable tripleo_ui  https://review.openstack.org/45906116:54
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add steps to enable tripleo_ui  https://review.openstack.org/45906116:55
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Add ssh tunneling for TripleO-UI  https://review.openstack.org/40773316:55
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates stable/ocata: Expose metric delay processing metric  https://review.openstack.org/46921716:55
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates stable/newton: Expose metric delay processing metric  https://review.openstack.org/46922616:55
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add steps to enable tripleo_ui  https://review.openstack.org/45906116:59
*** suuuper has quit IRC17:03
*** agopi has joined #tripleo17:03
*** jkilpatr has joined #tripleo17:04
openstackgerritJaganathan Palanisamy proposed openstack/python-tripleoclient master: WIP: Invoking the derive parameters workflow during overcloud deployment.  https://review.openstack.org/46959617:04
*** maeca1 has quit IRC17:04
*** egonzalez has quit IRC17:09
*** jpena is now known as jpena|off17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019517:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169452417:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1694524 in tripleo "Neutron OVS agent fails to start when neutron-server is not available" [Critical,Triaged]17:10
*** gbarros has joined #tripleo17:11
*** thrash|biab is now known as thrash17:11
*** gbarros has quit IRC17:12
rcritI'm working on a new container, novajoin, in kolla, and don't want to run as root but when I set a USER (currently to nova) I can't read the bind-mounted files17:13
rcritis there some common solution to this?17:13
*** agopi has quit IRC17:14
jaosoriordprince mandre ^^17:14
*** salmankhan has quit IRC17:15
jaosoriorjistr: ^^17:15
*** agopi has joined #tripleo17:15
*** fragatin_ has joined #tripleo17:15
*** fragatina has quit IRC17:19
hamzymwhahaha, I ran "openstack overcloud image" on a ppc64le machine but when I try and import them on an x86_64 machine with "openstack overcloud image upload" it complains "overcloud-full.vmlinuz does not exist." http://paste.openstack.org/show/611123/17:19
hamzyam I missing something?17:20
*** zoli|wfh is now known as zoli|gone17:20
mwhahahahamzy: it doesn't look like it built it?17:20
hamzyyes but it did build overcloud-full.qcow217:21
mwhahahahamzy: but not .vimlinuz17:21
mwhahahawhich is what it wants?17:21
hamzyI suspect it wants initrd vmlinuz and qcow217:21
hamzybut only built qcow217:22
*** dparkes has joined #tripleo17:22
bnemechamzy: Oh, you're doing ppc?  Maybe something isn't extracting the kernel and ramdisk properly for ppc image builds?17:23
hamzybnemec, yeah trying out overcloud ppc64le and undercloud x86_6417:24
*** karthiks has quit IRC17:24
*** trown|lunch is now known as trown17:25
trown[11:42:45] <trown> trozet: those get installed by instack-undercloud if the features are enabled17:25
bnemechamzy: You'll probably have to figure out why dib isn't extracting the files then.  I wouldn't be surprised if there's an assumption of x86 somewhere in there.17:25
hamzyprobably more than one :)17:25
*** gbarros has joined #tripleo17:26
*** gbarros has quit IRC17:28
*** manous has quit IRC17:29
*** ipsecguy_ has quit IRC17:30
openstackgerritMatthias Runge proposed openstack/tripleo-heat-templates master: Containerized collectd  https://review.openstack.org/46946517:30
*** ipsecguy has joined #tripleo17:30
dprincepradk: CI failures on the congress patches look unrelated. But we could be hitting space issues on the undercloud for some of the jobs soon17:33
dprincepradk: ditto for tacker17:33
pradkdprince, ok so you mean we should hold out on merging these?17:35
dprincepradk: I'm inclined to send them all because the t-h-t patches seem to be fine actually17:36
dprincepradk: and those Depend-On the other patches anyways...17:36
pradkok17:36
*** pkovar has quit IRC17:36
*** jaosorior is now known as jaosorior_away17:44
*** athomas has quit IRC17:44
trozettrown: but why should they not already be built into the image so you dont require internet access to install?17:51
*** atoth has quit IRC17:53
*** jprovazn has quit IRC17:55
openstackgerritHonza Pokorny proposed openstack/tripleo-common master: Add GUI logging workflow  https://review.openstack.org/46919617:57
*** fragatin_ has quit IRC17:57
*** fragatina has joined #tripleo17:58
pradktrown, did we expose any flag to enable telemetry in ovb jobs if i want to test/check ha?17:58
trowntrozet: because then we have to maintain a list of packages... and some are not needed on every job17:58
trozettrown: so it is ok for the install witht eh disk image to require internet?17:59
trowntrozet: ya... we have never had the requirement of no internet18:00
trowntrozet: you could always modify the image18:00
trozettrown: ok, then we will add the packages in OPNFV build system18:00
*** sshnaidm|off has joined #tripleo18:00
openstackgerritJames Slagle proposed openstack/puppet-tripleo master: Install rsync package for galera  https://review.openstack.org/46736218:04
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Conditional nodepool logic  https://review.openstack.org/46339218:05
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Support passing in $EXTRA_VARS  https://review.openstack.org/46339318:05
*** chlong has quit IRC18:05
openstackgerritHonza Pokorny proposed openstack/instack-undercloud master: Add an hourly cron trigger for tripleo-ui logging  https://review.openstack.org/46960818:09
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019518:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169452418:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)18:10
openstackLaunchpad bug 1694524 in tripleo "Neutron OVS agent fails to start when neutron-server is not available" [Critical,Triaged]18:10
openstackgerritBen Kero proposed openstack/tripleo-quickstart master: Clean up incorrect comment relating to unused variable test_tempest  https://review.openstack.org/46230618:12
*** cdearborn_ has joined #tripleo18:15
trownpradk: whoops missed your ping... removing https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset001.yml#L20-L26 would enable telemetry18:15
pradktrown, hmm ok, so i'll need a test patch with dependson18:16
openstackgerritMatt Young proposed openstack/tripleo-quickstart master: Migrate quickstart-extras.yml --> TQE  https://review.openstack.org/46961118:18
trownEmilienM: is there a different bug for the ironic issue? I think https://bugs.launchpad.net/tripleo/+bug/1694524 is something different18:20
openstackLaunchpad bug 1694524 in tripleo "Neutron OVS agent fails to start when neutron-server is not available" [Critical,Triaged]18:20
openstackgerritBen Kero proposed openstack/tripleo-quickstart-extras master: Clean up unused variables in defaults and comments  https://review.openstack.org/46230718:20
openstackgerritMatt Young proposed openstack/tripleo-quickstart master: Migrate quickstart-extras.yml --> TQE  https://review.openstack.org/46961118:21
*** chlong has joined #tripleo18:22
openstackgerritMatt Young proposed openstack/tripleo-quickstart-extras master: Migrate quickstart-extras.yml --> TQE  https://review.openstack.org/46961418:22
openstackgerritMatt Young proposed openstack/tripleo-quickstart-extras master: Migrate quickstart-extras.yml --> TQE  https://review.openstack.org/46961418:23
openstackgerritMatt Young proposed openstack/tripleo-quickstart-extras master: Migrate quickstart-extras.yml --> TQE  https://review.openstack.org/46961418:24
EmilienMtrown: I'm ack but back in 2h. Dinner time18:25
EmilienMAfk18:25
bkeroYou take dinner early on the east coast18:25
apevecbkero, he's in France these days18:26
* apevec heads to diner too18:26
bkeroOh okay18:26
bkeroThat makes more sense18:27
EmilienMYeah I'm in family 2 weeks18:28
openstackgerritMatt Young proposed openstack/tripleo-quickstart-extras master: Migrate quickstart-extras.yml --> TQE  https://review.openstack.org/46961418:29
openstackgerritMatt Young proposed openstack/tripleo-quickstart master: Migrate quickstart-extras.yml --> TQE  https://review.openstack.org/46961118:30
*** cdearborn has quit IRC18:32
*** derekh has quit IRC18:39
*** dtantsur is now known as dtantsur|afk18:40
*** ramishra has quit IRC18:44
openstackgerritMatt Young proposed openstack/tripleo-quickstart-extras master: Migrate quickstart-extras.yml --> TQE  https://review.openstack.org/46961418:45
openstackgerritPradeep Kilambi proposed openstack/puppet-tripleo master: DNM: Test gnocchi api issue  https://review.openstack.org/46950618:46
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Adjust package mapping for SUSE family  https://review.openstack.org/46953319:08
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019519:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169452419:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1694524 in tripleo "Neutron OVS agent fails to start when neutron-server is not available" [Critical,Triaged]19:10
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Adjust package mapping for SUSE family  https://review.openstack.org/46953319:10
*** jaganathan has quit IRC19:21
*** lmiccini has quit IRC19:22
*** amoralej is now known as amoralej|off19:27
*** salmankhan has joined #tripleo19:35
*** eck` is now known as eck`gone19:35
*** yamahata has quit IRC19:39
*** jkilpatr has quit IRC19:41
*** pcaruana has joined #tripleo19:45
*** dsneddon has quit IRC19:48
*** karimb has quit IRC19:49
*** karimb has joined #tripleo19:50
*** jkilpatr has joined #tripleo19:54
*** fzdarsky has quit IRC19:54
*** jkilpatr has quit IRC19:54
*** jkilpatr has joined #tripleo19:54
*** paramite has quit IRC19:57
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila Scheduler service  https://review.openstack.org/45575619:59
*** pcaruana has quit IRC20:02
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila API service  https://review.openstack.org/44929220:02
*** salmankhan has quit IRC20:05
*** liverpooler has quit IRC20:06
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019520:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169452420:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1694524 in tripleo "Neutron OVS agent fails to start when neutron-server is not available" [Critical,Triaged]20:10
*** oneswig has joined #tripleo20:11
*** rbowen has quit IRC20:13
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila API service  https://review.openstack.org/44929220:13
*** dprince has quit IRC20:13
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila API service  https://review.openstack.org/44929220:14
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila Scheduler service  https://review.openstack.org/45575620:15
*** noslzzp has quit IRC20:16
*** rcernin has quit IRC20:21
*** eck`gone is now known as eck`20:22
*** rcernin has joined #tripleo20:22
weshaytrown, do you have a logstash query for the ping test issue? the one I'm using only has two hits in the last 30 days20:22
*** Goneri has quit IRC20:23
openstackgerritJohn Fulton proposed openstack/tripleo-common master: Add Mistral workbook to call ceph-ansible to install Ceph  https://review.openstack.org/46964420:25
trownweshay: hmm... I dont have any logstash queries20:30
weshaytrown, wondering if the ping test is still failing jobs?20:30
weshaytrown, was trying build_name: *tripleo-ci* AND build_status: FAILURE AND message: "Destination Host Unreachable"20:30
trownwe have much more success today then the past week http://tripleo.org/cistatus.html20:31
weshayhrm.. actually see two failed today on ovb20:32
weshaynot showing up in logstash20:32
*** pkovar has joined #tripleo20:32
trownfirst couple fails are timeouts during deploy20:32
weshay 05-31 10:17 || 156 min || /home/jenkins/overcloud-validate.sh fail. Overcloud pingtest FAILED. || 449122,13 ? || Logs || tripleo-image-elements || master || Logstash |20:33
weshay| 05-31 10:05 || 146 min || /home/jenkins/overcloud-deploy.sh fail. Overcloud stack: FAILED. || 454719,12 ? || Logs || tripleo-common || master || Logstash |20:33
weshaythat job is very busted atm20:33
weshaygate-tripleo-ci-centos-7-ovb-ha-oooq20:35
*** ansmith has quit IRC20:39
*** pchavva has quit IRC20:39
ansiwenpradk: ping, re panko dbsync in container20:40
pradkansiwen, pong, ok20:41
ansiwenpradk: in panko-api.yaml for docker you have a db_sync step. I wonder if I need that as well for ec2-api. Because the puppet-module already contains a db_sync. isn't that executed while configuring the container?20:42
*** rcernin has quit IRC20:42
ansiwenpradk: or does puppet-panko not have such a db_sync command?20:42
*** salmankhan has joined #tripleo20:43
openstackgerritMatthias Runge proposed openstack/tripleo-heat-templates master: Containerized collectd  https://review.openstack.org/46946520:43
pradkansiwen, we define the class in puppet module, but db sync is invoked from tripleo at various steps20:43
*** apevec has quit IRC20:44
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila Scheduler service  https://review.openstack.org/45575620:45
hamzymwhahaha, building overcloud-full on x86_64 doesn't produce the vmlinuz or initrd images either20:46
hamzyis an option missing in https://git.openstack.org/cgit/openstack/tripleo-common/tree/image-yaml/overcloud-images-centos7.yaml ?20:48
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila API service  https://review.openstack.org/44929220:48
ansiwenpradk: "various"? so, for ec2api I have it in the service profile: https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/nova/ec2api.pp#L3220:49
ansiwenpradk: can I assume that I don't need the step in the docker service template then?20:50
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila Scheduler service  https://review.openstack.org/45575620:50
pradkansiwen, right, we dont use puppet-tripleo steps in container stuff20:50
pradkansiwen, you will have to define that in the docker ec2api template before api starts20:50
pradkansiwen, you could probably use the kolla bootstrap stuff if its executed there20:51
mwhahahahamzy: i wonder if the upload tool tries to extract it. unfortunatly that's not my world of knowledge20:51
pradkansiwen, but i think we're moving away from that and prefer to execute that in the docker template now20:51
hamzymwhahaha, do you know what the difference is between overcloud-images.yaml and overcloud-images-centos7.yaml?20:52
*** morazi has quit IRC20:52
*** b00tcat has joined #tripleo20:52
hamzyof course it sounded like I needed centos7 since that is my environment20:53
*** chlong has quit IRC20:53
*** egafford has quit IRC20:53
pradkansiwen, what you did in your patch makes sense to me20:53
ansiwenpradk: hmm... how does the puppet configuration work then? I have this here, is it ignored? https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/ec2-api.yaml#L13620:53
mwhahahahamzy: i do not20:54
hamzythis would be an open question for everyone on the channel then :)20:54
ansiwenpradk: well, I copied it from panko-api without knowing what I did. :-)20:54
pradkansiwen, yea i think just use that to generate the config files and copy them over to the /var/lib/config-data .. you have to run the db sync and api service in the docker template20:56
openstackgerritJohn Fulton proposed openstack/tripleo-common master: Add Mistral workbook to call ceph-ansible to install Ceph  https://review.openstack.org/46964420:57
*** oneswig has quit IRC20:59
ansiwenpradk: and if you say that tripleo::profile::base::nova::ec2api is not used in the container case... then I would also have to do other stuff that is included there? keystone::authtoken?20:59
ansiwenpradk: I though tripleo::profile::base::nova::ec2api is the only entry point into the puppet config file generation20:59
ansiwenpradk: and another question: why do you use user root and "su" to run the db_sync? mandre reviewed, that I should remove the root privileges and the "su" command21:01
pradkansiwen, so we include the step_config and do a get attr on it21:02
pradkansiwen, check out docker/services/README.rst .. that explains what you are asking21:02
ansiwenpradk: ok, sorry, didn't know that... will read it21:03
pradkansiwen, ah that part i think dprince added as part of this  https://github.com/openstack/tripleo-heat-templates/commit/51da97d04a2cbc81ad4b56a8a91c6dd43d5afe8121:03
*** jmelvin has quit IRC21:03
pradkansiwen, he might be able to answer better21:04
*** chlong has joined #tripleo21:05
ansiwenpradk: aha! so that is important knowledge. people are reviewing against that, because they don't know it21:05
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019521:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169452421:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)21:10
openstackLaunchpad bug 1694524 in tripleo "Neutron OVS agent fails to start when neutron-server is not available" [Critical,Triaged]21:10
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: DO NOT MERGE -1 WIP tripleo docs have overcloud image build instructions, add that option  https://review.openstack.org/44329421:10
*** pcaruana has joined #tripleo21:12
*** lblanchard has quit IRC21:12
*** gbarros has joined #tripleo21:18
EmilienMtrown: back21:19
EmilienMtrown: I investigated the ironic thing and found out the ovs agent was failing21:20
EmilienMtrown: the error I saw: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha/78acd34/logs/undercloud/var/log/neutron/openvswitch-agent.txt.gz#_2017-05-31_06_24_10_49621:21
EmilienMtrown: Ihar and amoralej|off told me it was the thing fixed in Neutron21:21
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila API service  https://review.openstack.org/44929221:23
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila Scheduler service  https://review.openstack.org/45575621:27
*** pcaruana has quit IRC21:29
*** abishop has quit IRC21:33
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: WIP rdo built containers config and updates:  https://review.openstack.org/46966521:36
*** itzikb has joined #tripleo21:37
*** oneswig has joined #tripleo21:37
*** bfournie has quit IRC21:39
*** karimb has quit IRC21:39
*** gbarros has quit IRC21:46
*** tbonds has quit IRC21:47
*** dsneddon_ has joined #tripleo21:49
*** jmelvin has joined #tripleo21:49
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates master: DONT MERGE - Test for Ib96040c2e27ad76b1fa6ecb9468bb9d97b3c4518  https://review.openstack.org/46920121:53
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates master: Add Ec2Api to container based deployment  https://review.openstack.org/46920021:53
*** salmankhan has quit IRC21:57
*** rwsu has quit IRC22:06
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019522:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169452422:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1694524 in tripleo "Neutron OVS agent fails to start when neutron-server is not available" [Critical,Triaged]22:10
*** bfournie has joined #tripleo22:14
*** bfournie has quit IRC22:15
*** bfournie has joined #tripleo22:16
*** oneswig has quit IRC22:16
*** oneswig has joined #tripleo22:17
*** cdearborn_ has quit IRC22:19
*** yamahata has joined #tripleo22:19
dweeksIs there a proper way to configure the overcloud for an external Ceph cluster? I follow RHEL's documentation but the routes estableshed by the compute nodes don't make sense for such heavy traffic.22:19
*** oneswig has quit IRC22:21
*** jkilpatr has quit IRC22:23
*** jmelvin has quit IRC22:28
EmilienMdweeks: yes, with https://github.com/openstack/tripleo-heat-templates/blob/cf5e77cbefa46650dc8ddc9493a2ea4c8925076b/environments/puppet-ceph-external.yaml22:33
EmilienMit's documented here: https://git.openstack.org/cgit/openstack/tripleo-docs/tree/doc/source/advanced_deployment/ceph_external.rst22:33
dweeksYes but doesn'22:33
dweeksYes but doesn't that still does not talk about the compute nodes external network for routing to the external Ceph cluster, right?22:34
openstackgerritMerged openstack/puppet-tripleo stable/newton: Create /etc/my.cnf.d/tripleo.cnf with proper bind-address  https://review.openstack.org/44745322:35
*** itzikb has quit IRC22:36
*** jkilpatr has joined #tripleo22:38
*** limao has joined #tripleo22:39
*** pkovar has quit IRC22:39
*** limao_ has joined #tripleo22:42
*** limao has quit IRC22:44
dweeksYes, that documents the same thing the RHOSP documentation does for external ceph which is basically the configuration of the Ceph cluster information but it does not show how the Ceph drives are attached on the compute node.22:44
dweeksThe standard compute node routing is done via the provisioning network and not via the storage network and the storage network terminates on the controller. Is it standard practice to provide and external route from the compute node for the Ceph traffic?22:46
dweeksOr is there a better way to do that?22:46
*** agopi has quit IRC22:55
*** ekoorjr has joined #tripleo22:59
*** chlong has quit IRC23:00
*** rwsu has joined #tripleo23:08
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019523:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169452423:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169484723:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1694524 in tripleo "Neutron OVS agent fails to start when neutron-server is not available" [Critical,Triaged]23:10
openstackLaunchpad bug 1694847 in tripleo "pingtest fails on ipv6/ssl: glanceclient fails to upload pingtest_initramfs" [Critical,Triaged]23:10
*** pradk has quit IRC23:13
*** tosky has quit IRC23:21
*** liverpooler has joined #tripleo23:36
*** noslzzp has joined #tripleo23:39
*** limao_ has quit IRC23:40
*** dcritch has quit IRC23:40
*** limao has joined #tripleo23:44
*** limao has quit IRC23:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!