Thursday, 2018-02-15

openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add tls roles for undercloud  https://review.openstack.org/51707900:00
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Undercloud: fix stackrc TLS URL detection  https://review.openstack.org/53548000:02
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Fix PublicVirtualFixedIPs in envs  https://review.openstack.org/54474400:03
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Undercloud: support for external VIP for SSL  https://review.openstack.org/53547900:03
hjensasIs there a way to specify alternative tht when installing containerized undercloud?00:03
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud_config: setup VIPs, haproxy, etc  https://review.openstack.org/52688100:04
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM - run ovb-ha with a containerized undercloud  https://review.openstack.org/54255600:05
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM - run ovb-ha with a containerized undercloud  https://review.openstack.org/54255600:05
EmilienMhjensas: let me check00:06
*** jobewan has quit IRC00:06
EmilienMhjensas: I see some work in https://review.openstack.org/#/c/54287500:07
EmilienMbut let me check if that's what you need00:07
EmilienMthe --templates interface should work00:07
EmilienMbut I haven't tested it personaly00:08
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933500:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)00:10
*** ooolpbot has quit IRC00:10
*** jcoufal_ has joined #tripleo00:12
*** jcoufal has quit IRC00:12
*** psahoo has joined #tripleo00:14
*** jcoufal has joined #tripleo00:15
hjensasEmilienM: thanks, I thin I need to use openstack undercloud deploy --templates ... undercloud install --use-heat looks like just calls that. I will give it a go.00:18
*** jcoufal_ has quit IRC00:18
EmilienMhjensas: keep in mind we want our operators to use "undercloud install" and not "undercloud deploy" directly00:19
EmilienMwhich means we have to maintain the undercloud.conf in tripleoclient for the containerized undercloud00:19
*** jcoufal_ has joined #tripleo00:22
*** rbrady is now known as rbrady-afk00:22
*** jcoufal has quit IRC00:23
*** jcoufal has joined #tripleo00:27
hjensasEmilienM: yes, it will be a pain to get routed networks going with the config in one repo and the templates using the config in a different repo.00:27
EmilienM:-/00:28
*** jcoufal_ has quit IRC00:28
openstackgerritRyan Brady proposed openstack/tripleo-common master: Deprecates tripleo.roles.list action  https://review.openstack.org/54475100:30
*** jcoufal_ has joined #tripleo00:31
*** jcoufal has quit IRC00:32
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Remove neutron-managed firewall rules from /etc/sysconfig/iptables  https://review.openstack.org/54184900:32
hjensasEmilienM: Not sure yet, still early to tell. But we may want to consider making jobs non voting to land one side of the things, and then re-enable voting.00:32
EmilienMhjensas: which job?00:33
hjensasEmilienM: containerised undercloud jobs.00:34
EmilienMhjensas: we'll make it voting very soon00:34
*** jcoufal has joined #tripleo00:34
EmilienMhjensas: the reason, people ignore non voting jobs00:34
hjensasEmilienM: yes, and I am all for it. But I don't think I will manage to get the routed networks changes for container undercloud before voting is enabled.00:35
*** jcoufal_ has quit IRC00:36
EmilienMhjensas: we can find some way, no worries00:36
*** mcornea has quit IRC00:37
hjensasEmilienM: Let's see how it goes. Step 1, make it work in lab ... then figure out how to land it. :)00:37
*** jcoufal_ has joined #tripleo00:38
EmilienMhjensas: we can still create an experimental CI job if you need00:40
EmilienMso you can develop on it00:40
EmilienMand once it works, we make it voting, etc00:40
*** jcoufal has quit IRC00:40
EmilienMexperimental jobs aren't voting and run on demand, looks like that's what you need00:40
*** jcoufal has joined #tripleo00:42
*** jcoufal_ has quit IRC00:44
*** jcoufal_ has joined #tripleo00:45
*** Goneri has quit IRC00:47
*** moshele has joined #tripleo00:47
*** jcoufal has quit IRC00:48
*** tosky has quit IRC00:50
*** jcoufal has joined #tripleo00:51
*** jcoufal_ has quit IRC00:52
*** jcoufal_ has joined #tripleo00:55
*** jcoufal has quit IRC00:56
*** gvrangan has joined #tripleo01:08
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933501:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)01:10
*** gvrangan has quit IRC01:11
*** jcoufal has joined #tripleo01:18
*** jcoufal_ has quit IRC01:20
*** jcoufal_ has joined #tripleo01:21
*** gvrangan has joined #tripleo01:22
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Update jobname for containerized undercloud  https://review.openstack.org/54475401:22
EmilienMweshay: ^01:22
*** jcoufal has quit IRC01:23
*** jcoufal has joined #tripleo01:26
*** jcoufal_ has quit IRC01:27
EmilienMslagle: it sounds like a containerized undercloud + a containerized overcloud with config download explode the zaqar message size01:30
EmilienMhttp://logs.openstack.org/06/542906/14/check/tripleo-ci-centos-7-containers-multinode/8b014c4/logs/undercloud/var/log/extra/docker/containers/mistral_engine/log/mistral/executor.log.gz#_2018-02-15_01_13_38_66801:30
*** jcoufal_ has joined #tripleo01:30
*** jcoufal has quit IRC01:32
EmilienMI wonder if we need to increase (again?) zaqar::max_messages_post_size01:33
*** numans has quit IRC01:34
*** jcoufal has joined #tripleo01:34
EmilienMdefault in zaqar.conf: #max_messages_post_size=26214401:35
EmilienMand the message is Description: Message collection size is too large. Max size 26214401:36
EmilienMon the undercloud we use to configure 104857601:36
EmilienMso I guess we need parity on THT01:36
*** jcoufal_ has quit IRC01:36
EmilienMthis one was tricky :D01:37
*** jcoufal_ has joined #tripleo01:38
*** moshele has quit IRC01:40
*** jcoufal has quit IRC01:40
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Align zaqar max_messages_post_size with undercloud  https://review.openstack.org/54475601:40
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: WIP - run container-multinode (fs010) with a containerized undercloud  https://review.openstack.org/54290601:41
*** jcoufal has joined #tripleo01:41
EmilienMhopefully someone makes this channel alive at this time of the day :P01:42
*** jcoufal_ has quit IRC01:45
*** jcoufal_ has joined #tripleo01:47
*** itlinux has joined #tripleo01:48
*** jcoufal has quit IRC01:48
*** jcoufal has joined #tripleo01:50
*** jcoufal_ has quit IRC01:52
*** jcoufal_ has joined #tripleo01:53
sai___Hi everyone, I have a question regarding docker/services/horizon.yaml,01:56
sai___There is a parameter called HorizonVhostExtraParams which sets horizon::vhost_extra_params in puppet/services/horizon.yaml.01:56
sai___But, horizon::vhost_extra_params is hardcoded in docker/services/horizon.yaml, which is overwitting the values passed to HorizonVhostExtraParams.01:56
*** jcoufal has quit IRC01:56
EmilienMsai___: you probably found a bug01:56
EmilienMsai___: can you file a bug please? I'm working on a patch01:58
sai___I have a patch for that01:58
openstackgerritMerged openstack/tripleo-heat-templates master: Do not depends on the order of the hash vars in ffu repo switching.  https://review.openstack.org/54422901:58
EmilienMoh yeah? show me01:58
EmilienMsai___: ^01:58
*** jcoufal has joined #tripleo01:58
sai___one sec01:58
*** jcoufal_ has quit IRC02:00
*** gvrangan has quit IRC02:00
*** yamahata has quit IRC02:01
*** jcoufal_ has joined #tripleo02:02
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker: don't override horizon::vhost_extra_params  https://review.openstack.org/54475802:02
EmilienMsai___: ^ that should fix it02:02
*** jcoufal has quit IRC02:04
sai___yes, mine is also same idea, Thank you02:05
EmilienMI couldn't find your patch so I sent one02:05
EmilienMsai___: do you have a bug report?02:05
EmilienMwill need one if you need backport02:05
sai___No, I have a patch but didn't opened a review02:05
*** jcoufal has joined #tripleo02:06
sai___I will open the bug and will let you know02:06
EmilienMsai___: if you can do it now, it would be great, we're in the end of the release, we probably need one bug report if we want this patch merged.02:07
sai___sure02:07
*** jcoufal_ has quit IRC02:08
*** jcoufal_ has joined #tripleo02:10
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933502:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)02:10
*** jcoufal has quit IRC02:12
*** fzdarsky_ has joined #tripleo02:12
EmilienMsai___: bugs can be created here: https://bugs.launchpad.net/tripleo/+filebug02:14
sai___https://bugs.launchpad.net/tripleo/+bug/174962702:14
openstackLaunchpad bug 1749627 in tripleo "Duplicate of horizon::vhost_extra_params in docker/services/horizon.yaml" [Undecided,New]02:14
EmilienMawesome02:14
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker: don't override horizon::vhost_extra_params  https://review.openstack.org/54475802:15
EmilienMdone ^02:15
*** fzdarsky has quit IRC02:16
sai___Thanks02:16
EmilienMsure thing!02:19
*** ihrachys has quit IRC02:20
*** abishop has joined #tripleo02:24
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud: introduce deployment_user parameter  https://review.openstack.org/54475902:34
*** ebarrera_ has quit IRC02:34
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates master: Unify the Cinder HA and non-HA docker configurations  https://review.openstack.org/54242502:34
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Skip SSH host key check during FFU  https://review.openstack.org/54476002:37
*** ramishra has joined #tripleo02:43
*** gkadam_ has quit IRC02:43
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: docker: configure group/user for deployment_user  https://review.openstack.org/54416702:43
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker: configure group/user for deployment_user  https://review.openstack.org/54476102:46
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: WIP - run container-multinode (fs010) with a containerized undercloud  https://review.openstack.org/54290602:47
EmilienMstevebaker: what we talked yesterday ^02:47
EmilienMhope that's good02:47
stevebakerooo02:47
EmilienMstevebaker: I've almost deployed an overcloud with the containerized undercloud btw02:47
stevebakerEmilienM: nice02:48
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud: introduce deployment_user parameter  https://review.openstack.org/54475902:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker: configure group/user for deployment_user  https://review.openstack.org/54476102:50
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Deploy container-multinode (fs010) with a containerized undercloud  https://review.openstack.org/54290602:51
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: DNM. Test tripleo-upgrade workarounds.  https://review.openstack.org/54460402:51
*** abishop has quit IRC02:52
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Remove neutron-managed firewall rules from /etc/sysconfig/iptables  https://review.openstack.org/54184902:58
*** jcoufal has joined #tripleo02:58
openstackgerritMerged openstack/tripleo-quickstart-extras master: remove duplicate README file (part deux)  https://review.openstack.org/54434403:00
openstackgerritMerged openstack/tripleo-heat-templates master: Disable SNMP service in all CI jobs  https://review.openstack.org/54456703:00
*** jcoufal_ has quit IRC03:00
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Restrict SNMP to internal network  https://review.openstack.org/54453003:00
*** jcoufal_ has joined #tripleo03:05
*** jcoufal has quit IRC03:08
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933503:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)03:10
*** jcoufal has joined #tripleo03:11
*** jcoufal_ has quit IRC03:12
*** jcoufal_ has joined #tripleo03:14
*** jcoufal has quit IRC03:16
*** yamahata has joined #tripleo03:17
*** jcoufal has joined #tripleo03:27
*** jcoufal_ has quit IRC03:28
*** rlandy|bbl is now known as rlandy03:30
*** jcoufal_ has joined #tripleo03:31
*** jcoufal has quit IRC03:32
*** jcoufal has joined #tripleo03:34
*** ykarel|away has joined #tripleo03:34
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: Remove hardcoded relese variable in quickstart run  https://review.openstack.org/54476703:35
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud: introduce deployment_user parameter  https://review.openstack.org/54475903:35
EmilienMstevebaker: is it better? ^03:35
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: set the openstack release dynamically  https://review.openstack.org/54303103:35
EmilienMhttps://review.openstack.org/#/c/544759/2..303:35
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud: introduce deployment_user parameter  https://review.openstack.org/54475903:36
EmilienMsorry I forgot one thing03:36
stevebakerEmilienM: remove the PARAMETER_MAPPING entry?03:36
*** jcoufal_ has quit IRC03:36
EmilienMstevebaker: yeah done03:37
*** itlinux has quit IRC03:37
stevebakerEmilienM: boom. I thought you were gone?03:37
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: docker: configure group/user for deployment_user  https://review.openstack.org/54416703:38
EmilienMstevebaker: I lied03:38
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker: configure group/user for deployment_user  https://review.openstack.org/54476103:39
EmilienMstevebaker: I wanted this thing done this week :D03:39
EmilienMstevebaker: next week I need to start looking how we can upgrade the undercloud03:39
EmilienMfrom non containerized to containerized03:39
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Deploy container-multinode (fs010) with a containerized undercloud  https://review.openstack.org/54290603:39
stevebakernice03:39
EmilienMstevebaker: I'm really off now :D see you in the morning03:40
*** jcoufal_ has joined #tripleo03:45
*** skramaja has joined #tripleo03:46
*** jcoufal has quit IRC03:48
*** jcoufal has joined #tripleo03:50
*** skramaja has quit IRC03:51
*** skramaja_ has joined #tripleo03:51
*** jcoufal_ has quit IRC03:52
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: DNM, testing 525765  https://review.openstack.org/54477103:53
*** jcoufal_ has joined #tripleo03:55
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Integrate Validate-HA work into OVB jobs  https://review.openstack.org/53766903:57
*** jcoufal has quit IRC03:58
*** bkopilov has quit IRC04:00
*** itlinux has joined #tripleo04:00
*** jcoufal has joined #tripleo04:02
*** bkopilov has joined #tripleo04:03
*** jcoufal_ has quit IRC04:04
*** jcoufal_ has joined #tripleo04:06
*** skramaja_ is now known as skramaja04:06
*** jcoufal has quit IRC04:08
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933504:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)04:10
*** jcoufal has joined #tripleo04:11
*** jcoufal_ has quit IRC04:12
*** udesale has joined #tripleo04:13
*** jcoufal_ has joined #tripleo04:14
*** jcoufal has quit IRC04:16
*** thrash is now known as thrash|g0ne04:16
*** itlinux has quit IRC04:17
*** jcoufal has joined #tripleo04:18
*** jcoufal_ has quit IRC04:20
*** jcoufal_ has joined #tripleo04:21
*** cshastri has joined #tripleo04:22
*** jaganathan has joined #tripleo04:22
*** jcoufal has quit IRC04:24
*** gkadam_ has joined #tripleo04:26
*** jcoufal has joined #tripleo04:26
*** psachin has joined #tripleo04:27
*** jcoufal_ has quit IRC04:28
*** jcoufal_ has joined #tripleo04:30
*** jcoufal has quit IRC04:32
*** jcoufal has joined #tripleo04:34
*** links has joined #tripleo04:34
*** skramaja has quit IRC04:35
*** rlandy has quit IRC04:35
*** gkadam_ has quit IRC04:36
*** jcoufal_ has quit IRC04:36
*** jcoufal_ has joined #tripleo04:38
*** gkadam has joined #tripleo04:38
*** jcoufal has quit IRC04:40
*** skramaja has joined #tripleo04:42
*** links has quit IRC04:42
*** jcoufal_ has quit IRC04:44
*** links has joined #tripleo04:45
*** jcoufal_ has joined #tripleo04:46
*** pdeore has joined #tripleo04:46
*** jcoufal has joined #tripleo04:47
*** dpawar has joined #tripleo04:47
*** aputtur_ has quit IRC04:50
*** jcoufal_ has quit IRC04:50
*** aputtur_ has joined #tripleo04:52
*** jcoufal_ has joined #tripleo04:52
*** jcoufal has quit IRC04:54
openstackgerritRabi Mishra proposed openstack/tripleo-common master: Fix overcloud node delete after an upgrade  https://review.openstack.org/54478104:55
*** jcoufal has joined #tripleo04:56
*** janki has joined #tripleo04:57
*** jcoufal_ has quit IRC04:58
*** jcoufal_ has joined #tripleo05:01
*** janki has quit IRC05:03
*** jcoufal has quit IRC05:03
*** janki has joined #tripleo05:03
*** janki has quit IRC05:06
*** janki has joined #tripleo05:06
*** janki has quit IRC05:08
*** janki has joined #tripleo05:09
*** threestrands_ has joined #tripleo05:09
*** janki has quit IRC05:09
*** threestrands_ has quit IRC05:09
*** threestrands_ has joined #tripleo05:09
*** threestrands has quit IRC05:09
*** pgadiya has joined #tripleo05:10
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933505:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)05:10
*** jcoufal_ has quit IRC05:10
*** janki has joined #tripleo05:10
*** threestrands_ has quit IRC05:10
*** threestrands_ has joined #tripleo05:11
*** jcoufal_ has joined #tripleo05:11
*** threestrands has joined #tripleo05:15
*** threestrands has quit IRC05:15
*** threestrands has joined #tripleo05:15
*** threestrands_ has quit IRC05:18
*** jcoufal has joined #tripleo05:24
*** jcoufal_ has quit IRC05:24
*** jcoufal_ has joined #tripleo05:27
*** threestrands has quit IRC05:28
*** jcoufal has quit IRC05:29
*** karthiks has quit IRC05:30
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: undercloud_post: fix subnet name  https://review.openstack.org/54458705:30
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Align zaqar max_messages_post_size with undercloud  https://review.openstack.org/54475605:30
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Updated tempest plugin names  https://review.openstack.org/54424205:31
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Disable SNMP service in all CI jobs"  https://review.openstack.org/54478405:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Disable SNMP service in all CI jobs"  https://review.openstack.org/54478405:33
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: docker: configure group/user for deployment_user  https://review.openstack.org/54416705:36
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: docker: configure group/user for deployment_user  https://review.openstack.org/54416705:36
*** akane has joined #tripleo05:37
*** jcoufal has joined #tripleo05:37
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker: configure group/user for deployment_user  https://review.openstack.org/54476105:37
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Deploy container-multinode (fs010) with a containerized undercloud  https://review.openstack.org/54290605:37
*** jaosorior has quit IRC05:37
*** jcoufal_ has quit IRC05:39
*** jcoufal_ has joined #tripleo05:39
*** janki has quit IRC05:40
*** janki has joined #tripleo05:40
*** wolverineav has joined #tripleo05:41
*** karthiks has joined #tripleo05:42
*** jcoufal has quit IRC05:42
openstackgerritMerged openstack/tripleo-heat-templates master: Add tls roles for undercloud  https://review.openstack.org/51707905:43
openstackgerritMerged openstack/tripleo-heat-templates master: Undercloud: fix stackrc TLS URL detection  https://review.openstack.org/53548005:43
openstackgerritMerged openstack/python-tripleoclient master: undercloud_config: setup VIPs, haproxy, etc  https://review.openstack.org/52688105:43
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Remove neutron-managed firewall rules from /etc/sysconfig/iptables  https://review.openstack.org/54184905:44
*** jaosorior has joined #tripleo05:44
*** jcoufal has joined #tripleo05:45
*** pdeore_ has joined #tripleo05:45
jaosoriorEmilienM: what's this? container_linux.go:247: starting container process caused \"process_linux.go:258: applying cgroup configuration for process caused \\\"open /sys/fs/cgroup/pids/system.slice/docker-d54761e362a17807c0318b006ab50756b78dcf9998971d516f7650bb4418d466.scope/cgroup.procs: no such file or directory\\\"\""05:46
*** mdnadeem has joined #tripleo05:46
Tenguhello there05:46
*** wolverineav has quit IRC05:46
jaosoriorTengu: sup dude05:46
*** jcoufal_ has quit IRC05:46
EmilienMlaunchpad 174495405:47
openstackLaunchpad bug 1744954 in tripleo "(race condition) oci runtime error when spawning containers" [High,Triaged] https://launchpad.net/bugs/174495405:47
EmilienMjaosorior: this one ^05:47
jaosoriorI see05:47
EmilienMjaosorior: need some reviews05:47
EmilienMone sec05:47
Tengujaosorior: not too bad. Today, I don't really know what was falling from the sky. Was probably rain and snow. Fun with motorbike again :).05:47
Tenguhello EmilienM :)05:48
*** pdeore has quit IRC05:48
*** udesale has quit IRC05:48
*** jcoufal_ has joined #tripleo05:48
EmilienMfirst of all I'm having issues to deploy an overcloud when the undercloud is containerized and TLS is enabled: https://logs.rdoproject.org/56/542556/10/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z43a56c7dd69b494aa319541ca360b54c/undercloud/home/jenkins/undercloud_install.log.gz05:48
EmilienMTengu: hello05:48
*** udesale has joined #tripleo05:48
jaosoriorEmilienM: urlopen error [Errno 2] No such file or directory: '/usr/share/openstack-tripleo-heat-templates/environments/public-tls-undercloud.yaml'05:49
EmilienMyeah thanks I know how to read errors :D05:50
jaosoriorEmilienM: that file is introduced by a commit from pradk or dprince05:50
EmilienMyup and I have it in Dependson05:50
*** jcoufal has quit IRC05:50
jaosoriorah05:50
jaosoriorwhat commit are you using to test that?05:50
EmilienMit's in commit message but I can show it for you05:51
EmilienMusing https://review.openstack.org/#/c/53547905:51
*** jcoufal has joined #tripleo05:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Fix PublicVirtualFixedIPs in envs  https://review.openstack.org/54474405:52
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Undercloud: support for external VIP for SSL  https://review.openstack.org/53547905:52
EmilienMjaosorior: https://review.openstack.org/#/c/544754/ please05:52
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker: configure group/user for deployment_user  https://review.openstack.org/54476105:52
EmilienMand https://review.openstack.org/#/c/544756/05:52
EmilienMand https://review.openstack.org/#/c/544758/05:52
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Deploy container-multinode (fs010) with a containerized undercloud  https://review.openstack.org/54290605:53
*** jcoufal_ has quit IRC05:54
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud: introduce deployment_user parameter  https://review.openstack.org/54475905:54
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker: configure group/user for deployment_user  https://review.openstack.org/54476105:54
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Deploy container-multinode (fs010) with a containerized undercloud  https://review.openstack.org/54290605:55
EmilienMjaosorior: my patch to test TLS + containerized undercloud is here https://review.openstack.org/#/c/542556/05:55
EmilienMbut WIP05:55
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM - run ovb-ha with a containerized undercloud  https://review.openstack.org/54255605:56
EmilienMdoing another test with latest merges ^05:56
EmilienMjaosorior: but this is not working yet, in case you want to help out. Thanks! I'm off now05:56
jaosoriorhave a good one05:57
*** jcoufal_ has joined #tripleo05:57
openstackgerritRabi Mishra proposed openstack/tripleo-common master: Fix overcloud node delete after an upgrade  https://review.openstack.org/54478105:57
EmilienMjaosorior: we also reverted the barbican thing in tripleo-common fyi05:58
jaosoriorEmilienM: yeah, I +2ed that, we talked about it yesterday05:58
EmilienMok good05:58
*** jcoufal has quit IRC05:59
EmilienMjaosorior: we'll still be able to backport a fix in case fix happens after release05:59
EmilienMbut weird issue so far I haven't been able to track down this one05:59
jaosoriorI don't understand it either05:59
jaosoriorgotta poke paramite about it today05:59
jaosoriorI'm on PTO tomorrow though, so someone else might need to get on it05:59
*** jcoufal has joined #tripleo06:00
EmilienMjaosorior: send email or file bug06:01
*** jcoufal_ has quit IRC06:02
*** jchhatbar has joined #tripleo06:09
*** janki has quit IRC06:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933506:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)06:10
*** ooolpbot has quit IRC06:10
*** akane has quit IRC06:11
*** jcoufal_ has joined #tripleo06:12
openstackgerritSai Ram Peesapati proposed openstack/puppet-tripleo master: Conditionally include nova patch config  https://review.openstack.org/54478506:13
*** jcoufal has quit IRC06:13
*** jcoufal has joined #tripleo06:17
*** masco has joined #tripleo06:17
*** jcoufal_ has quit IRC06:18
*** marios has joined #tripleo06:18
*** jcoufal_ has joined #tripleo06:20
*** jcoufal has quit IRC06:22
*** akane_ has joined #tripleo06:22
*** jcoufal has joined #tripleo06:24
*** jcoufal_ has quit IRC06:26
*** jcoufal has quit IRC06:29
*** jcoufal has joined #tripleo06:30
*** numans has joined #tripleo06:34
*** jcoufal_ has joined #tripleo06:35
*** jcoufal has quit IRC06:36
*** rcernin has quit IRC06:44
*** jcoufal has joined #tripleo06:45
*** jcoufal_ has quit IRC06:47
*** masco has quit IRC06:47
*** suuuper has joined #tripleo06:48
*** jbadiapa has joined #tripleo06:48
*** jcoufal_ has joined #tripleo06:48
*** jcoufal has quit IRC06:50
skramajajaosorior: could you take a look at https://review.openstack.org/#/c/543851/?06:51
*** pdeore__ has joined #tripleo06:53
*** alee has quit IRC06:54
*** etingof has quit IRC06:55
*** bfournie has quit IRC06:55
*** pdeore__ is now known as pdeore06:55
*** jchhatbar has quit IRC06:56
*** janki has joined #tripleo06:56
*** pdeore_ has quit IRC06:56
*** masco has joined #tripleo06:59
*** jcoufal has joined #tripleo07:01
*** dparkes has joined #tripleo07:01
*** ccamacho has quit IRC07:02
*** jcoufal_ has quit IRC07:02
*** waleedm has joined #tripleo07:04
*** olivierbourdon38 has quit IRC07:06
*** udesale_ has joined #tripleo07:07
*** dsariel has joined #tripleo07:07
*** dsariel_ has joined #tripleo07:07
jankiHey. Can I get some reviews on https://review.openstack.org/#/c/536907/ plz07:07
*** etingof has joined #tripleo07:07
*** yprokule has joined #tripleo07:08
*** masco has quit IRC07:08
*** udesale has quit IRC07:09
*** threestrands has joined #tripleo07:09
*** janki has quit IRC07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933507:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)07:10
*** janki has joined #tripleo07:10
*** florianf has joined #tripleo07:12
*** jcoufal_ has joined #tripleo07:16
*** moshele has joined #tripleo07:18
*** jcoufal has quit IRC07:19
*** matbu has quit IRC07:22
*** udesale__ has joined #tripleo07:23
*** psachin has quit IRC07:24
*** udesale_ has quit IRC07:26
*** dsariel has quit IRC07:28
*** dpawar has quit IRC07:28
*** rcernin has joined #tripleo07:28
*** dsariel_ has quit IRC07:28
openstackgerritMichele Baldessari proposed openstack/tripleo-quickstart-extras master: WIP DNR Add undercloud ~/.ssh/config to simplify development  https://review.openstack.org/51033207:29
*** matbu has joined #tripleo07:40
*** pcaruana has joined #tripleo07:40
*** sai___ has quit IRC07:51
*** cylopez has joined #tripleo07:52
*** dpawar has joined #tripleo07:53
*** gfidente has joined #tripleo07:55
*** gfidente has quit IRC07:55
*** gfidente has joined #tripleo07:55
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260707:57
*** jcoufal has joined #tripleo07:58
*** psachin has joined #tripleo07:59
*** jcoufal_ has quit IRC07:59
*** jcoufal_ has joined #tripleo08:01
*** jcoufal has quit IRC08:04
*** ykarel|away is now known as ykarel|lunch08:04
*** aufi has joined #tripleo08:04
*** ebarrera has joined #tripleo08:07
*** juriarte has joined #tripleo08:07
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933508:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)08:10
*** bogdando has joined #tripleo08:12
bogdandoPTAL https://review.openstack.org/#/c/542875/08:12
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Adds --all-playbooks option to overcloud upgrade to run all playbooks  https://review.openstack.org/54399008:14
*** ebarrera has quit IRC08:15
*** ebarrera has joined #tripleo08:15
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Autoeval container images for legacy services  https://review.openstack.org/54435708:15
*** tesseract has joined #tripleo08:17
*** olivierbourdon38 has joined #tripleo08:19
*** pmannidi has quit IRC08:22
*** ansiwen has joined #tripleo08:23
*** agurenko has quit IRC08:26
*** jpena|off is now known as jpena08:26
*** agurenko has joined #tripleo08:28
moshelejanki: hi08:35
*** links has quit IRC08:35
*** assassin has joined #tripleo08:36
*** gkadam_ has joined #tripleo08:37
*** gkadam is now known as Guest820708:37
*** gkadam_ is now known as gkadam08:37
*** cshastri has quit IRC08:38
*** ykarel|lunch is now known as ykarel08:40
*** chem|eod is now known as chem08:43
*** lvdombrkr has joined #tripleo08:49
*** links has joined #tripleo08:52
*** cshastri has joined #tripleo08:53
*** matbu has quit IRC08:54
*** sshnaidm|off is now known as sshnaidm|ruck08:55
*** matbu has joined #tripleo08:56
*** jpich has joined #tripleo08:59
*** ccamacho has joined #tripleo09:03
*** shardy has joined #tripleo09:04
*** ccamacho has quit IRC09:04
*** ccamacho has joined #tripleo09:04
*** ykarel_ has joined #tripleo09:06
*** ykarel has quit IRC09:08
*** amoralej|off is now known as amoralej09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933509:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)09:10
*** ooolpbot has quit IRC09:10
*** akane_ has quit IRC09:11
*** oidgar has joined #tripleo09:11
*** derekh has joined #tripleo09:12
*** ykarel_ has quit IRC09:15
*** ukalifon has joined #tripleo09:15
*** jcoufal has joined #tripleo09:16
*** dsariel_ has joined #tripleo09:18
*** jcoufal_ has quit IRC09:18
*** dsariel has joined #tripleo09:18
openstackgerritMerged openstack/tripleo-heat-templates master: Added and modified the services for ComputeLiquidio role  https://review.openstack.org/54423409:19
*** dtantsur|afk is now known as dtantsur09:21
*** jcoufal_ has joined #tripleo09:21
*** threestrands_ has joined #tripleo09:21
*** threestrands has quit IRC09:21
*** holser has joined #tripleo09:22
*** ykarel has joined #tripleo09:22
*** jcoufal has quit IRC09:23
*** akane_ has joined #tripleo09:26
*** masco has joined #tripleo09:27
bogdandoshardy: hi. PTAL https://review.openstack.org/#/c/542875/15 :)09:27
*** jcoufal has joined #tripleo09:32
shardybogdando: ack will do, thanks!09:33
*** oidgar has quit IRC09:34
*** jcoufal_ has quit IRC09:35
*** jcoufal_ has joined #tripleo09:35
*** jcoufal has quit IRC09:38
*** lvdombrkr89 has joined #tripleo09:42
bandiniam I the only one hitting https://bugs.launchpad.net/tripleo/+bug/1749663 quite often?09:43
openstackLaunchpad bug 1749663 in tripleo "openstack overcloud container image upload fails from time to time" [High,Triaged]09:43
*** lvdombrkr has quit IRC09:44
*** masco has quit IRC09:45
*** paramite has joined #tripleo09:54
*** paramite_ has joined #tripleo09:54
*** ykarel is now known as ykarel|away09:58
*** jcoufal has joined #tripleo09:58
*** masco has joined #tripleo09:59
jistrpanda|off: good morning, please let me know when you're panda|on so that we can sync up about the update job :)10:00
mandrebogdando: I'm not sure to understand https://bugs.launchpad.net/tripleo/+bug/1749468, why do you expect to see container images if you specify services *not* using containers?10:00
openstackLaunchpad bug 1749468 in tripleo "Prepare images should autoevaluate container parameters for legacy services" [High,In progress] - Assigned to Bogdan Dobrelya (bogdando)10:00
panda|offjistr: I'm on10:00
*** panda|off is now known as panda10:01
jistrcool :)10:01
*** jcoufal_ has quit IRC10:01
yprokulesshnaidm|ruck: hi, could U please check - https://bugs.launchpad.net/tripleo/+bug/174965610:01
openstackLaunchpad bug 1749656 in tripleo "overcloud_deploy.sh failed : Error finding 'bm-deploy-kernel' in glance." [Undecided,New]10:01
pandajistr: bluejeans/gcerami ?10:02
jistrpanda: ok i was just trying to start mine :D joining yours then10:02
*** jcoufal_ has joined #tripleo10:02
*** oscar____ has joined #tripleo10:02
sshnaidm|ruckyprokule, it's better to ask somebody from df team, like EmilienM, slagle. But from your log image is not a problem: CREATE aborted10:04
*** yamahata has quit IRC10:05
*** jcoufal has quit IRC10:05
sshnaidm|ruckyprokule, images "errors" are expected in multinode, although they don't need to raise exceptions..10:05
*** jcoufal has joined #tripleo10:06
yprokulesshnaidm|ruck: iiuc if images not found - then how introspection succeeded ?10:06
sshnaidm|ruckweshay, rfolco|off, EmilienM fyi https://bugs.launchpad.net/tripleo/+bug/174967110:07
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]10:07
sshnaidm|ruckyprokule, it's multinode job, no introspection there10:07
sshnaidm|ruckyprokule, you don't use ironic at all in multinode job - server is already deployed and ready\10:08
*** ykarel|away has quit IRC10:08
*** jcoufal_ has quit IRC10:08
*** akrivoka has joined #tripleo10:09
yprokulesshnaidm|ruck: ok, who could help with this - this block upgrade 9->1010:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933510:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967110:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)10:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]10:10
*** jcoufal_ has joined #tripleo10:10
sshnaidm|ruckyprokule, anybody from tripleo I guess, you can submit a bug and usual process10:11
sshnaidm|ruckyprokule, but better to find a root cause, because it's not clear what happened, stack was aborted and it could be caused by millions reasons10:12
mandrebogdando: see my comment on https://bugs.launchpad.net/tripleo/+bug/1749468, i think it can be closed10:12
openstackLaunchpad bug 1749468 in tripleo "Prepare images should autoevaluate container parameters for legacy services" [High,In progress] - Assigned to Bogdan Dobrelya (bogdando)10:12
yprokulesshnaidm|ruck: Not enough nodes - available: 0, requested: 110:12
sshnaidm|ruckyprokule, that's fine for multinode..10:13
*** jcoufal has quit IRC10:13
oscar____Hi, trying to deploy overcloud with 1 compute & 1 control but I think I'm having some trouble matching profiles and flavors, always ending up with Error, no valid hosts. Have tried to compare and to me they seem to match, any tips on how to debug?10:13
*** oidgar has joined #tripleo10:14
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates master: Align zaqar max_messages_post_size with undercloud  https://review.openstack.org/54475610:15
paramite_jaosorior, Hey Juan, any idea what is wrong with healthcheck symlink in barbican images? I wonder why it is problem there and not in other images10:17
jaosoriorparamite_: I was about to ask you the same thing haha10:20
paramite_:)10:20
jaosoriorso I looked into it but wasn't able to figure out what the issue is10:20
jaosoriorso, the patch is being reverted10:20
paramite_so AFAIK dangling symling is a symlink with invalid target10:20
jaosoriorwas gonna ask you to take a look, cause I'm honestly really confused10:20
paramite_but ... the target exist right?10:20
paramite_seems like cinder-api has the same problem :/10:21
paramite_the hell10:21
jaosoriorparamite_: it should, unless there is a really funky typo somewhere10:21
shardyoscar____: Hi, I'd start with the ironic troubleshooting docs, ref https://docs.openstack.org/ironic/latest/admin/troubleshooting.html#nova-returns-no-valid-host-was-found-error10:21
shardyoscar____: first step is to do openstack baremetal node list and check the nodes are available and not in maintenance mode10:22
*** salmankhan has joined #tripleo10:22
shardyoscar____: you might also check the nova-scheduler log on the undercloud and look for clues if you think it's a flavor/tagging issue10:22
paramite_jaosorior, so one the only possible explaation would be that openstack-tripleo-common package does not install to /usr/share/openstack-tripleo-common any more10:23
paramite_jaosorior, I'm gonna check tha package10:23
*** jcoufal has joined #tripleo10:24
jaosoriorparamite_: if that was the case, wouldn't all containers have issues with the healthchecks?10:24
paramite_jaosorior, yup, true10:24
paramite_jaosorior, so the latest pike package does not have those scripts10:25
paramite_jaosorior, patch is ok, just old package is used in CI jobs10:25
paramite_EmilienM, ^10:25
jaosoriorparamite_: this is what we do https://github.com/openstack/tripleo-common/blob/master/container-images/tripleo_kolla_template_overrides.j2#L3110:25
bogdandomandre: could you also comment on https://bugzilla.redhat.com/show_bug.cgi?id=1535614 ?10:26
openstackbogdando: Error: Could not parse XML returned by bugzilla.redhat.com: HTTP Error 403: Forbidden (https://bugzilla.redhat.com/show_bug.cgi?id=1535614&ctype=xml)10:26
jaosoriorparamite_: can you comment on the bug?10:26
paramite_doing now10:26
*** jcoufal_ has quit IRC10:27
jaosoriorparamite_: might wanna ask in #rdo to see what we can do about that.10:30
*** udesale_ has joined #tripleo10:30
*** d0ugal has quit IRC10:30
*** skramaja has quit IRC10:31
paramite_jaosorior, one solution could be to split health check patches to 2, eg. one adding script and two actually using those scripts during image build10:32
jaosoriorparamite_: would splitting the patches in two fix the issue?10:32
paramite_yup10:32
jaosoriorI'm down with that10:32
jaosoriorlets let the revert merge and split it then10:32
paramite_jaosorior, the second one would just not pass before it would get all the scripts in base image10:32
paramite_jaosorior, ok, we gonna need to revert more of then unfortunately ... sigh10:33
paramite_cinder-api script is missing too10:33
*** udesale__ has quit IRC10:33
jaosoriorparamite_: if it's a lot of work, I suggest you try talking in #rdo , maybe they can help out10:33
jaosorioror the folks from the CI team10:33
*** moguimar has joined #tripleo10:33
*** moguimar has quit IRC10:33
*** d0ugal has joined #tripleo10:34
paramite_jaosorior, just boilerplate work https://review.openstack.org/#/q/project:openstack/tripleo-common+status:open+owner:mmagr%2540redhat.com10:34
paramite_:)10:34
paramite_some of them are already merged10:34
jaosoriormaaan that's gonna be a bummer10:34
paramite_indeed10:34
jaosoriorshould really try to fix CI then10:34
jaosoriorsounds like the path of least resistance10:34
paramite_ok, let me switch to #rdo10:34
*** moguimar has joined #tripleo10:34
oscar____shardy: Thanks, they are available, in the log I see "Filter ComputeCapabilitiesFilter returned 0 hosts" but I have one node with u'profile:compute specified in properties10:35
shardyoscar____: Ok and what flavor are you using for each role?10:35
oscar____shardy: So my guess is that some other value mismatch, I'm using default flavor compute and control10:36
*** salmankhan has quit IRC10:36
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates master: Add pacemaker upgrade_tasks for P..Q major upgrade  https://review.openstack.org/53924910:37
shardyoscar____: Ok, the default is actually baremetal, so it's worth checking with  openstack stack environment show overcloud | grep Flavor10:37
shardybaremetal should match any host10:38
*** jcoufal_ has joined #tripleo10:38
shardyoscar____: you can then use openstack flavor show and compare the properties/capabilities with the flavors in use10:38
oscar____shardy: it gives: OvercloudComputeFlavor: compute \ OvercloudControlFlavor: control10:38
*** panda is now known as panda|reloc10:40
*** jcoufal has quit IRC10:40
shardyoscar____: did introspection work OK, e.g in openstack baremetal node show <some node> do you see properties including e.g local_gb witha disk that's greater than the disk size in the flavor?10:40
shardyas you say, there must be a mismatch somewhere10:40
shardyopenstack overcloud profiles list can be helpful in checking for that10:41
oscar____shardy: Yes, introspection finished fine, I see all properties I think, sizes seem to match as the default flavors are set low10:41
*** jcoufal has joined #tripleo10:42
oscar____shardy: if I do openstack flavor show compute I do see resources:CUSTOM_BAREMETAL='1', resources:DISK_GB='0', resources:MEMORY_MB='0', resources:VCPU='0'10:44
oscar____shardy: not sure where that comes from10:44
*** psahoo has quit IRC10:44
*** jcoufal_ has quit IRC10:45
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Add check to enable additional ansible tag for updates  https://review.openstack.org/54277210:46
*** jcoufal_ has joined #tripleo10:46
*** tosky has joined #tripleo10:48
shardyoscar____: yeah that's the newer ironic resource class data, ref https://docs.openstack.org/ironic/pike/install/configure-nova-flavors.html#scheduling-based-on-resource-classes10:48
*** zoli is now known as zoli|lunch10:49
oscar____ok so they are probably fine then10:49
*** zoli|lunch is now known as zoli10:49
*** jcoufal has quit IRC10:49
shardyI'm not that familiar with it yet tbh but dtantsur can probably advise - perhaps you can paste your flavor and node information, as well as a section from the nova-scheduler log (the part up until it says zero hosts matched)10:49
shardye.g to paste.openstack.org - perhaps we can figure it out from the logs10:49
*** salmankhan has joined #tripleo10:50
*** jcoufal has joined #tripleo10:50
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart master: Add featureset for overcloud update job  https://review.openstack.org/54277610:51
dtantsuroscar____: hi, https://docs.openstack.org/ironic/latest/admin/troubleshooting.html#nova-returns-no-valid-host-was-found-error may help10:52
*** jcoufal_ has quit IRC10:52
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Fix temp files teardown for undercloud deploy  https://review.openstack.org/54485410:52
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart master: Add featureset for overcloud update job  https://review.openstack.org/54277610:53
*** jaganathan has quit IRC10:54
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart master: Add featureset for overcloud update job  https://review.openstack.org/54277610:54
jistrpanda|reloc: i did the updates for https://review.openstack.org/542776  and  https://review.openstack.org/54277210:54
oscar____dtantsur: shardy I just noticed that on the compute node the resource_class is "baremetal", does that have to match the flavor?10:55
*** jcoufal_ has joined #tripleo10:55
*** jcoufal has quit IRC10:57
oscar____ah, I see the docs now, it seems correct as my flavor has resources:CUSTOM_BAREMETAL='1'10:58
*** jcoufal has joined #tripleo10:59
*** salmankhan has quit IRC11:00
panda|relocjistr thanks looking11:00
*** salmankhan has joined #tripleo11:00
*** jistr is now known as jistr|mtg11:00
*** jcoufal_ has quit IRC11:00
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287511:01
*** jcoufal_ has joined #tripleo11:02
*** ykarel has joined #tripleo11:04
*** lucas-afk is now known as lucasagomes11:04
*** jcoufal has quit IRC11:05
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933511:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967111:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)11:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]11:10
panda|relocjistr is then overcloud update tag already added in the upgrade roles ?11:11
*** jaganathan has joined #tripleo11:11
*** udesale__ has joined #tripleo11:14
*** jcoufal has joined #tripleo11:14
sshnaidm|ruckchandankumar, hi, why do we need this? https://review.rdoproject.org/r/#/c/12229/11:14
chandankumarsshnaidm|ruck: I need to check full tempest run to make sure anything is not failing11:15
chandankumarsshnaidm|ruck: https://bugzilla.redhat.com/show_bug.cgi?id=154515611:15
openstackchandankumar: Error: Could not parse XML returned by bugzilla.redhat.com: HTTP Error 403: Forbidden (https://bugzilla.redhat.com/show_bug.cgi?id=1545156&ctype=xml)11:15
*** jcoufal_ has quit IRC11:15
*** udesale_ has quit IRC11:16
*** adarazs is now known as adarazs_lunch11:17
*** jcoufal_ has joined #tripleo11:17
sshnaidm|ruckchandankumar, we have it in tripleo-ci experimental too, or you need to check exactly patches of python-tempestconf?11:17
chandankumarsshnaidm|ruck: i need to check exactly patches of python-tempestconf11:17
sshnaidm|ruckchandankumar, ok11:17
chandankumarsshnaidm|ruck: is it a good thing to run full tempest on tempest.api/tempest.scenario/tempest.lib on each changes merged?11:18
sshnaidm|ruckchandankumar, not really, very resource expensive11:19
*** jcoufal has quit IRC11:19
sshnaidm|ruckchandankumar, and I don't think it worth it, couldn't it be checked by less tests? Why to run full tempest?11:19
chandankumarsshnaidm|ruck: you mean in tempest or tempest-conf?11:20
*** d0ugal has quit IRC11:20
*** psahoo has joined #tripleo11:20
sshnaidm|ruckchandankumar, everywhere11:21
chandankumarsshnaidm|ruck: currently in each scenario, we are almost running the same tests, if we can changes to different tests, that will solve the problem11:22
*** ykarel has quit IRC11:22
chandankumarthen i donot have to need full tempest11:22
sshnaidm|ruckchandankumar, maybe worth to check if we can do it, it should increase the coverage, right?11:23
*** rfolco|off is now known as rfolco|rover11:27
juriarteHey folks, I'm having some issues with certificates in an SSL enabled overcloud11:27
juriarteI've deployed OpenStack via a Jenkins job that uses infrared, and I've enabled SSL for the overcloud11:27
juriarteThe job deployed 1 undercloud VM, 1 controller VM for overcloud, and 1 compute VM for overcloud11:28
juriartesourcing the overcloudrc on the undercloud VM, I can connect from the undercloud to the overcloud OpenStack.11:28
juriartebut if I deploy a container in the undercloud VM, source the same overcloudrc and try to connect to the overcloud OpenStack, it fails:11:28
juriarteSSL exception connecting to https://10.0.0.101:13000/v2.0/tokens: HTTPSConnectionPool(host='10.0.0.101', port=13000): Max retries exceeded with url: /v2.0/tokens (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'ssl3_get_server_certificate', 'certificate verify failed')],)",),))11:28
juriarteseems that some necessary certificate is missing in the container11:29
juriartehas any of you dealed with this before?11:29
*** udesale__ has quit IRC11:30
juriartejaosorior, could you help with this? ^11:30
*** salmankhan has quit IRC11:34
chandankumarsshnaidm|ruck: yup11:34
*** salmankhan has joined #tripleo11:34
rfolco|roversshnaidm|ruck, any guidance on https://bugs.launchpad.net/tripleo/+bug/1749671 ?11:36
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]11:36
jaosoriorjuriarte: sure11:37
jaosoriorwhat's the output of openssl s_client -connect 10.0.0.101:1300011:37
sshnaidm|ruckrfolco|rover, well, it seems like mess of a lot of errors there, I don't know if you can do much there but you can try to find the root cause11:39
sshnaidm|ruckrfolco|rover, to know at least which squad to ping - network, ironic, compute or whatever11:39
rfolco|roversshnaidm|ruck, reproducer script ?11:40
*** d0ugal has joined #tripleo11:40
*** pgadiya has quit IRC11:40
jaosoriorjuriarte: aaah, now I read the full text haha. Well yeah, the containers don't trust the certificate for the overcloud11:41
juriartejaosorior: https://paste.fedoraproject.org/paste/AQ3zMBouMuRKTmQXHKMB0w11:41
juriartejaosorior: I run openssl s_client from the container11:42
jaosoriorjuriarte: if you want to access the overcloud from a container, you either need to bind-mount the CA certificate that signed the overcloud's server certificate, or you need to bind mount the trusted chain (kinda hacky, but it works)11:42
*** jaganathan has quit IRC11:42
sshnaidm|ruckrfolco|rover, ya11:42
jaosoriorjuriarte: I'm guessing your overcloud's certificate is self-signed, or signed by a self-signed CA cert11:42
juriartejaosorior: not sure about who signed the certificate11:43
jaosoriorjuriarte: ok, gotta figure that out first :)11:44
*** paramite has quit IRC11:44
*** paramite_ is now known as paramite11:44
juriartejaosorior: how can I find it?11:44
jaosoriorjuriarte: beats me11:45
jaosoriorjuriarte: that's not a standard, it can be anywhere :D11:45
jaosoriorjuriarte: but if you deployed with infrared, I suggest browsing the infrared code-base and see where that's set up11:45
*** jcoufal has joined #tripleo11:46
jaosoriorjuriarte: got it11:48
*** jcoufal_ has quit IRC11:48
jaosoriorjuriarte: seems to be a self signed certificate11:49
juriartejaosorior: I've tried mounting /etc/pki/ dir, but didn't work11:49
jaosoriorjuriarte: and it should be here https://github.com/redhat-openstack/infrared/blob/master/plugins/tripleo-overcloud/tasks/ssl.yml#L3011:49
*** jcoufal_ has joined #tripleo11:50
*** jpena is now known as jpena|lunch11:52
*** pdeore has quit IRC11:52
*** jcoufal has quit IRC11:53
*** agopi_out has quit IRC11:56
*** pkovar has joined #tripleo11:56
paramitejaosorior, I believe that it will be even faster when I will submit patch for that as a discussion initiation11:57
jaosoriorok11:58
*** jaganathan has joined #tripleo11:59
*** _sshnaidm_ has joined #tripleo11:59
jaosoriorjuriarte: by the way, a quick and easy way to get it working was docker run -ti -v /etc/pki/:/etc/pki docker.io/redhatcop/control-host-openstack curl https://10.0.0.101:1300012:00
*** jcoufal has joined #tripleo12:02
jpichakrivoka: Hi! I was wondering how it's going with https://bugs.launchpad.net/tripleo/+bug/1745641 ? I'm testing Queens and just noticed it myself, it causes a ton of errors on the UI and is pretty confusing, well spotted12:03
openstackLaunchpad bug 1745641 in tripleo "overcloud-swift-rings incorrectly shows up in plan list" [High,Triaged] - Assigned to Ana Krivokapić (akrivoka)12:03
jaosoriorjuriarte: another way to get it running is:  docker run -ti -v /home/stack/virt/overcloud-cacert.pem:/etc/pki/ca-trust/source/anchors/overcloud-cacert.pem docker.io/redhatcop/control-host-openstack curl https://10.0.0.101:13000 --cacert /etc/pki/ca-trust/source/anchors/overcloud-cacert.pem12:04
*** jcoufal_ has quit IRC12:05
akrivokajpich: I haven't worked on a fix for that yet...12:07
*** jcoufal_ has joined #tripleo12:07
*** jcoufal has quit IRC12:09
akrivokajpich: I remember looking into the code for the create container action and I think the underlying problem is that the create container action attaches the plan related meta information to the container and the author of the swift rings workflow probably used the create container action without realizing that12:09
akrivokajpich: I think the solution should be separating the action of attaching the plan meta info from the create container action, so that we can have an action that creates plain swift containers that are not plans12:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933512:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967112:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)12:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]12:10
jpichakrivoka: Right, that or some kind of flag12:11
*** larsks has joined #tripleo12:11
akrivokajpich: yeah12:11
jpichakrivoka: Do you think this could get in for the RC? I think it's going to cause some grief. This is weird though, I'm fairly sure we had the swift rings containers before and they didn't show12:12
akrivokajpich: I'll try to come up with a quick fix12:12
jpichmaybe a new workflow was added12:12
*** psahoo has quit IRC12:12
jpichakrivoka: That'd be awesome!!12:12
*** janki is now known as janki|aafk12:12
*** janki|aafk is now known as janki|afk12:12
*** raildo has joined #tripleo12:14
akrivokajpich: oh looks like Jirka was faster https://bugs.launchpad.net/tripleo/+bug/174537312:14
openstackLaunchpad bug 1745373 in tripleo "Swift Rings backup workflow creates a deployment plan container" [High,Fix released] - Assigned to Jiri Tomasek (jtomasek)12:14
akrivokafunny I didn't see that bug since I reported just a day after12:14
*** jcoufal_ has quit IRC12:14
jpichakrivoka: Oh, sweet! And nice solution too12:15
jpichYeah only your bug came up when I started writing mine, too :) I guess the system I'm using still has the code for an older promotion12:15
*** panda|reloc is now known as panda12:15
jpichakrivoka: ...well nothing to see here then I guess, sorry for the noise and thank you for the chat :-) :-)12:15
akrivokajpich: no worries, glad it's fixed :)12:16
jpichMe too!!12:16
jpich(and yeah my undercloud still has the old workflow on it)12:17
openstackgerritMarios Andreou proposed openstack/tripleo-common master: Fix Q upgrade converge - re-use package_update  https://review.openstack.org/54488612:18
openstackgerritKeith Schincke proposed openstack/tripleo-common master: Add file type check to upload-swift-artifacts  https://review.openstack.org/54441212:20
*** dpawar has quit IRC12:21
*** jistr|mtg is now known as jistr12:23
*** akane_ has quit IRC12:26
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Adds --all-playbooks option to overcloud upgrade to run all playbooks  https://review.openstack.org/54399012:26
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Fixup converge - re-uses the stack update action instead  https://review.openstack.org/54489412:26
*** salmankhan has quit IRC12:28
*** cylopez has quit IRC12:29
*** salmankhan has joined #tripleo12:30
*** dpawar has joined #tripleo12:30
*** anonpervert has joined #tripleo12:30
*** balthazar_ has quit IRC12:33
*** dpawar has quit IRC12:34
openstackgerritTom Barron proposed openstack/tripleo-heat-templates stable/ocata: DNM - ocata baseline  https://review.openstack.org/54489712:34
*** shardy has quit IRC12:35
jaosoriorbandini, dciabrin how do I get a constraint id?12:37
jaosoriorpcs constraint show doesn't say12:37
bandinijaosorior: pcs constraint --full12:38
jaosoriorthanks12:38
*** pradk has joined #tripleo12:39
*** jcoufal has joined #tripleo12:40
*** bfournie has joined #tripleo12:40
*** bfournie has quit IRC12:40
*** bfournie has joined #tripleo12:41
*** adarazs_lunch is now known as adarazs12:41
paramitejaosorior, hmm, so using delorean-current in kolla-build is failing the whole build for me locally, so not sure if this is the way12:42
paramitedmsimard, Hey David, I noticed that you contribute to rdo-infra/ansible-role-rdo-kolla-build. Can you pls check comments on https://review.openstack.org/#/c/544626, when you will have time? Would it be possible the latest unstable openstack-tripleo-common-container-base in base image, so that I would not need to divide all those in two patches: https://review.openstack.org/#/q/project:openstack/tripleo-common+status:open+owner:mmagr%2540redhat.com ?12:45
*** bfournie has quit IRC12:45
*** oscar____ has quit IRC12:47
*** gkadam has quit IRC12:48
*** abishop has joined #tripleo12:50
*** rbrady-afk is now known as rbrady12:50
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Remove converge env file option and re-use Deploy code  https://review.openstack.org/54492812:54
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Mount netns as shared to persist namespaces  https://review.openstack.org/54285812:57
*** cdearborn has joined #tripleo12:57
*** maeca has joined #tripleo13:00
*** dprince has joined #tripleo13:00
*** thrash|g0ne is now known as thrash13:03
*** mcornea has joined #tripleo13:06
*** wolverineav has joined #tripleo13:06
*** wolverineav has quit IRC13:07
*** wolverineav has joined #tripleo13:07
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933513:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967113:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)13:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]13:10
*** wolverineav has quit IRC13:12
*** jcoufal_ has joined #tripleo13:13
*** jcoufal has quit IRC13:15
*** bfournie has joined #tripleo13:17
*** trown|outtypewww is now known as trown13:23
*** jcoufal has joined #tripleo13:23
*** zoli is now known as zoli|afk13:25
*** zoli|afk is now known as zoli13:25
*** jcoufal_ has quit IRC13:25
*** udesale has joined #tripleo13:25
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Force restart of ipsec in legacy setup  https://review.openstack.org/54495413:26
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Change DPD action policy to restart for VIP tunnels  https://review.openstack.org/54495513:26
*** lvdombrkr89 has quit IRC13:27
*** ohochman has joined #tripleo13:31
*** rlandy has joined #tripleo13:32
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Disable UseDNS in sshd config  https://review.openstack.org/54495713:32
*** pchavva has joined #tripleo13:33
jaosoriorlhinds: can you check this out https://review.openstack.org/#/c/544957/ ?13:35
*** jpena|lunch is now known as jpena13:37
*** jcoufal_ has joined #tripleo13:37
openstackgerritMerged openstack/tripleo-heat-templates master: undercloud_post: fix subnet name  https://review.openstack.org/54458713:38
*** jcoufal has quit IRC13:40
*** jcoufal has joined #tripleo13:41
jruzickaweshay, hey o/ I'd like to help with migration of ooo jobs to zuulv3 and little birtd told me you might be my contact...13:41
*** Goneri has joined #tripleo13:42
weshayjruzicka, oh hey :)13:43
weshayjruzicka, any chance to work with jruzicka I'll take13:43
*** etingof has quit IRC13:43
*** jcoufal_ has quit IRC13:44
jruzickaweshay, oh come one, you're making me blush :-p13:45
jruzickaweshay, pleasure's all mine ;)13:45
weshayjruzicka, do you have the details re: when that's actionable?13:45
jruzickaweshay, well I migrated rdopkg from zuulv2 to zuulv3 so I don't exactly have deep experience, but it's not really a rocket science, I've seen some ansible before :)13:46
*** lblanchard has joined #tripleo13:46
weshayansible is a silly fad13:47
openstackgerritMerged openstack-infra/tripleo-ci master: Update jobname for containerized undercloud  https://review.openstack.org/54475413:47
openstackgerritMerged openstack/puppet-tripleo master: Avoid hard-coded settings in Cinder HA containers  https://review.openstack.org/54242413:47
jruzickaweshay, so the idea was to help you guys who are busy enough with maintaining the system with migrating it to a similar but different system :)13:47
jruzickaweshay, I prefer it to puppet/chef, though.13:48
weshayright.. so we just need to know when to start.. when is zuulv3 avail in rdo sf13:48
*** cshastri has quit IRC13:48
weshayand how is that transition going to work?13:48
weshaymaint window, or live13:48
jruzickaweshay, it would be nice to have at least some PoC job converted before the Brno Production Chain Workshop13:49
weshayjruzicka, so your jobs are running zuulv3?13:50
weshayfor rdopkg?13:50
jruzickaweshay, yes, but it's living on softwarefactory-project.org, now I'm puzzled by not seeing zuulv3 in review.r.o13:50
jruzickalet me get that info :)13:51
lhindsack on that patch jaosorior13:53
*** cylopez has joined #tripleo13:53
lhindsowalsh: https://review.openstack.org/#/c/544957/13:54
lhindsplease verify that won't have an impact on your nova (sshd) migration patch13:54
lhindsjaosorior: looks good to me, just need to check with owalsh as well.13:56
owalshlhinds: shouldn't matter, jaosorior maybe we should leave that enabled when using internal TLS13:56
*** lblanchard has quit IRC13:57
jaosoriorowalsh: why?13:57
openstackgerritMerged openstack/tripleo-heat-templates master: Change type of CephAnsiblePlaybook from string to comma_delimited_list  https://review.openstack.org/53971713:57
owalshjaosorior: because DNS would work13:57
jaosoriorowalsh: well, ideally DNS should always work :D13:57
*** etingof has joined #tripleo13:57
owalshjaosorior: indeed, but it *must* work for TLS13:57
jaosoriorowalsh: well true that13:57
jaosorioralthough, you could still fuck up your TLS everywhere setup, and have a nameserver that doesn't work besides the FreeIPA nameserver that does work13:58
*** salmankhan has quit IRC13:58
jaosoriorbut anyway, sure, I'm fine leaving it on when TLS everywhere is there. commented on the patch13:58
chandankumarkarthiks: hey14:01
chandankumarkarthiks: https://review.rdoproject.org/r/#/c/12172/ we have merged it14:01
karthikschandankumar, hi14:01
chandankumarkarthiks: can you get the upstream review merged asap14:01
karthikschandankumar,  yes ....14:02
owalshjaosorior: meh, openssh changed the default to no now anyway so I wouldn't bother for TLS, it doesn't appear to do anything useful14:02
*** cdearborn has quit IRC14:02
karthikschandankumar, Thanks !14:02
*** tcw has joined #tripleo14:02
jaosoriorowalsh: ok, lets just merge it then14:02
*** dtantsur is now known as dtantsur|brb14:02
*** tcw1 has joined #tripleo14:03
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Retrieve os-extra_specs for Nova flavors  https://review.openstack.org/54359014:05
*** jcoufal_ has joined #tripleo14:05
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Retrieve os-extra_specs for Nova flavors  https://review.openstack.org/54359014:06
*** tcw has quit IRC14:07
*** jcoufal has quit IRC14:07
*** dsariel has quit IRC14:07
*** dsariel_ has quit IRC14:08
*** jcoufal has joined #tripleo14:08
*** salmankhan has joined #tripleo14:08
jruzickaweshay, so if I understand correctly, the destination for the jobs is upstream openstack-infrat/tripleo-ci. review.rdoproject.org doesn't have zuulv3 ATM and it's not clear if/when it will swith.14:09
jruzickahttps://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/base.yaml14:09
*** lucasagomes is now known as lucas-hungry14:09
thrashd0ugal: the node delete is failing on validating the heat stack14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933514:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967114:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)14:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]14:10
*** jcoufal_ has quit IRC14:11
openstackgerritCarlos Camacho proposed openstack/tripleo-docs master: Refactor backup and restore docs  https://review.openstack.org/54497514:12
*** jcoufal_ has joined #tripleo14:13
jruzickaweshay, so dmsimard answered my questions and unblocked me... I'll be back after a fight with the involved systems and then we can unleast the untapped powers of inter-human cooperation :D14:13
jruzicka*unleash14:14
*** jcoufal has quit IRC14:15
*** chlong has joined #tripleo14:15
*** moguimar has quit IRC14:16
*** moguimar has joined #tripleo14:16
*** janki|afk has quit IRC14:16
*** jmelvin has joined #tripleo14:16
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Upgrade UC and OC using tripleo-upgrade role.  https://review.openstack.org/54231114:16
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Use overcloud_templates for deployed server prepare scripts.  https://review.openstack.org/53529914:17
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Add a hook to run a bash script at the end of the overcloud prep.  https://review.openstack.org/53316714:17
*** agurenko has quit IRC14:18
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Find the right release file for ffu mixed version upgrade.  https://review.openstack.org/52600014:18
openstackgerritJiri Stransky proposed openstack/python-tripleoclient master: Add generic method for preserving plan files, use for user-environment.yaml  https://review.openstack.org/54390314:19
openstackgerritJiri Stransky proposed openstack/python-tripleoclient master: Use the generic preservation method for plan-environment.yaml  https://review.openstack.org/54390414:19
openstackgerritJiri Stransky proposed openstack/python-tripleoclient master: Preserve roles_data and network_data  https://review.openstack.org/54390514:19
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing.  https://review.openstack.org/52568614:19
*** jmelvin has quit IRC14:20
*** jmelvin has joined #tripleo14:20
*** agurenko has joined #tripleo14:20
*** yamahata has joined #tripleo14:21
yprokuleEmilienM: hi, it was suggested U can help with https://bugs.launchpad.net/tripleo/+bug/174965614:21
openstackLaunchpad bug 1749656 in tripleo "overcloud_deploy.sh failed : Error finding 'bm-deploy-kernel' in glance." [Undecided,New]14:21
*** larsks has quit IRC14:21
*** pdeore has joined #tripleo14:23
*** jaosorior has quit IRC14:23
*** masco has quit IRC14:24
*** marrusl has quit IRC14:25
*** dhill__ has joined #tripleo14:26
*** alee has joined #tripleo14:26
*** marrusl has joined #tripleo14:28
*** ccamacho has quit IRC14:29
honzajtomasek: have you seen this error?  Plan descriptions could not be loaded TypeError: Cannot read property 'config' of undefined14:30
jtomasekhonza: yes, probably. when does it happen?14:30
honzajtomasek: on page load14:31
jtomasekhonza: what are your deployment plans?14:31
honzajtomasek: swift api error14:31
*** leanderthal has joined #tripleo14:31
*** atoth has joined #tripleo14:32
openstackgerritMichael Chapman proposed openstack/tripleo-heat-templates master: Add OPNFV scenario environment  https://review.openstack.org/48690514:32
honzajtomasek: are you saying my plans are old?14:32
*** psahoo has joined #tripleo14:33
jtomasekhonza: maybe you're hitting the error which akrivoka was hitting today with swift rings being included in deployment plans list14:33
jtomasekhonza: what is the list of your deployment plans?14:33
honzajtomasek: overcloud and overcloud-swift-rings14:34
jtomasekhonza: yeah, that's it14:34
* jpich hit it too today14:34
jtomasekhonza: https://bugs.launchpad.net/tripleo/+bug/174537314:36
openstackLaunchpad bug 1745373 in tripleo "Swift Rings backup workflow creates a deployment plan container" [High,Fix released] - Assigned to Jiri Tomasek (jtomasek)14:36
jtomasekhonza: it is fixed in latest tripleo-common14:37
honzajtomasek: awesome, thanks14:37
*** threestrands_ has quit IRC14:39
*** chlong has quit IRC14:41
*** cdearborn has joined #tripleo14:42
*** cdearborn has quit IRC14:42
*** cdearborn has joined #tripleo14:42
*** pdeore has quit IRC14:43
EmilienMhello14:45
EmilienMsshnaidm|ruck: ack, anything I can help on this one?14:46
*** ccamacho has joined #tripleo14:46
*** dtantsur|brb is now known as dtantsur14:49
*** psahoo has quit IRC14:50
*** ykarel has joined #tripleo14:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Disable SNMP service in all CI jobs"  https://review.openstack.org/54499614:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Disable SNMP service in all CI jobs"  https://review.openstack.org/54499614:51
*** psachin has quit IRC14:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Disable SNMP service in all CI jobs"  https://review.openstack.org/54499614:52
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Disable SNMP service in all CI jobs"  https://review.openstack.org/54499614:52
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Restrict SNMP to internal network  https://review.openstack.org/54453014:52
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Disable SNMP service in all CI jobs"  https://review.openstack.org/54499614:52
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Disable SNMP service in all CI jobs"  https://review.openstack.org/54499714:54
*** dpawar has joined #tripleo14:58
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: docker: configure group/user for deployment_user  https://review.openstack.org/54416714:58
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: docker: configure group/user for deployment_user  https://review.openstack.org/54416714:58
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Return any errors from called actions in node delete  https://review.openstack.org/54499915:01
*** rcernin has quit IRC15:01
*** waleedm has quit IRC15:01
*** pblaho has quit IRC15:05
*** hamzy_ has quit IRC15:10
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933515:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967115:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)15:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]15:10
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing.  https://review.openstack.org/52568615:10
*** mrch has joined #tripleo15:11
*** moguimar has quit IRC15:11
*** yprokule has quit IRC15:12
tdasilvaEmilienM: would you have any cycles to look at https://review.openstack.org/#/c/525324/ ?15:15
tdasilvajust needs one more +2, got one from mwhahaha already...15:15
sri_Hi, I am unable to delete node, can somebody help me with this15:15
sri_(undercloud) [stack@myhost ~]$ openstack baremetal node delete 330876ac-08f1-4f4a-8c73-5287fe366d3015:15
sri_Error contacting Ironic server: Node 330876ac-08f1-4f4a-8c73-5287fe366d30 is locked by host localhost.localdomain, please retry after the current operation is completed. (HTTP 409). Attempt 6 of 615:15
sri_Failed to delete node 330876ac-08f1-4f4a-8c73-5287fe366d30: Node 330876ac-08f1-4f4a-8c73-5287fe366d30 is locked by host localhost.localdomain, please retry after the current operation is completed. (HTTP 409)15:15
*** mdnadeem has quit IRC15:17
*** lucas-hungry is now known as lucasagomes15:18
*** pblaho has joined #tripleo15:21
openstackgerritMerged openstack-infra/tripleo-ci master: Add check to enable additional ansible tag for updates  https://review.openstack.org/54277215:21
*** agopi_out has joined #tripleo15:21
sshnaidm|ruckEmilienM, sorry, on mtg now, but your help is appreciated for that bug, I didn't find where the problem start there..15:22
*** dpawar has quit IRC15:24
*** dpawar has joined #tripleo15:25
*** atoth has quit IRC15:25
*** atoth has joined #tripleo15:27
*** jaosorior has joined #tripleo15:27
*** pblaho1 has joined #tripleo15:27
*** pblaho has quit IRC15:27
*** etingof has quit IRC15:29
*** karthiks has quit IRC15:29
*** dpawar has quit IRC15:30
openstackgerritHarald Jensås proposed openstack/python-tripleoclient master: [WiP] Contanerized Undercloud - Routed Spine-Leaf  https://review.openstack.org/54345515:30
*** sai___ has joined #tripleo15:34
juriartejaosorior: just another question, I'm wondering now why it works from the undercloud without specifying the os-cacert15:34
juriartejaosorior: trying to see the difference between the containter and the undercloud...15:34
jaosoriorjuriarte: the undercloud trusts the certificate and has added it as part of the trusted chain15:34
*** dsariel has joined #tripleo15:35
EmilienMjaosorior: hey! any update on containerized undercloud + tls? otherwise I'll continue to look next week15:35
*** dsariel_ has joined #tripleo15:36
jaosoriorEmilienM: no update :/ couldn't get to that15:36
*** hamzy_ has joined #tripleo15:37
*** hamzy__ has joined #tripleo15:39
*** hamzy__ is now known as hamzy15:39
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates master: Add spacing for readability  https://review.openstack.org/53938215:39
*** hamzy has quit IRC15:39
*** hamzy has joined #tripleo15:39
*** agopi_out is now known as agopi15:41
*** hamzy_ has quit IRC15:41
*** dsariel has quit IRC15:42
*** dsariel_ has quit IRC15:42
*** olivierbourdon38 has quit IRC15:44
*** suuuper has quit IRC15:45
Tenguhello :). Is there some way to validate an overcloud deploy? i.e. whether authentication works, some API calls and so on?15:45
toskyTengu: well, you could configure and run tempest from the undercloud15:47
Tenguhmm.15:47
*** gkadam has joined #tripleo15:47
Tenguwill learn a bit tempest then :). Is it suitble for a vm-based overcloud as well?15:47
toskyyes, sure15:48
Tengucool15:48
* Tengu dives in the doc15:48
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Retrieve os-extra_specs for Nova flavors  https://review.openstack.org/54359015:48
*** hamzy has quit IRC15:49
*** hamzy has joined #tripleo15:50
*** hamzy has quit IRC15:50
*** hamzy has joined #tripleo15:50
juriartejaosorior: both requirements (trust the certificate and add it as part of the trusted chain) are not met by placing the certificate on /etc/pki/ca-trust/source/anchors/ ?15:51
*** moshele has quit IRC15:52
*** oidgar has quit IRC15:56
*** karthiks has joined #tripleo15:57
jaosoriorjuriarte: no15:57
openstackgerritMerged openstack/tripleo-heat-templates master: Align zaqar max_messages_post_size with undercloud  https://review.openstack.org/54475615:57
jaosoriorjuriarte: placing the cert in /etc/pki/ca-trust/source/anchors/ and running "update-ca-trust extract" is the requirement to trust the cert15:58
Tengutosky: hmm, one question though: if the compute nodes are VM, is there a way to run a vm in them? I think I saw something for that "inception"15:59
toskyTengu: recursive virtualization15:59
Tengutosky: it's a setting to push in libvirt or something like that right?16:00
toskynative recursive virtualization may not always work, even if with centos may mostly work16:00
toskyyes, but I don't remember the exact settings right now16:00
Tengutosky: will search for it, thanks for the hint :)16:01
toskybut that's for native virtualization16:01
toskyotherwise it will work with qemu without acceleration, so it will be slower16:01
toskynot really a problem if you need to run cirros images, but you would feel it while running an image with more services16:01
Tenguhmm. not a big deal anyway. as long as it allows to validate the overcloud… my goal is "simple": I have just built a lab, 1:1 copy of the prod, in order to validate upgrades and changes on it.16:02
Tenguso as long as a base image can actually start and connect in this lab infra, well, that's more than sufficient16:02
openstackgerritMerged openstack/tripleo-heat-templates master: Fix PublicVirtualFixedIPs in envs  https://review.openstack.org/54474416:03
Tengutosky: ah, apparently, the "right" terme seems to be "nested virtalization". still digging :)16:05
toskyright16:05
Tenguand it seems to be supported in kvm since 201016:05
Tenguand apparently no specific setting has to be passed.16:05
Tenguwill test that :).16:05
sri_Tengu, Hi, I've used nested  virtalization in my lab, it's work's fine16:06
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart master: Updates OpenDaylight feature set 31 to use tempest  https://review.openstack.org/50087216:06
Tengusri_: great - you're using libvirt for the "lab" construction? any specific setting to set/pass somewhere?16:06
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Remove converge env file option and re-use Deploy code  https://review.openstack.org/54492816:06
*** maeca has joined #tripleo16:07
sri_Tengu, after deploying overcloud I enable kernel virtalization on compute node16:07
sri_http://paste.openstack.org/show/673103/16:08
Tengusri_: oh, great, thank you!16:08
*** moguimar has joined #tripleo16:09
*** pcaruana has quit IRC16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933516:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967116:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)16:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]16:10
Tengusri_: hmm, you're on a debian-based system?16:10
Tenguah, nope, sorry, made a mistake.16:10
sri_No, using centos16:10
*** rlandy is now known as rlandy|rover16:11
Tenguyep, doubled the "vi" in the edit command -.-'16:11
*** rfolco|rover has quit IRC16:11
*** arxcruz is now known as arxcruz|ruck16:11
*** sshnaidm|ruck is now known as sshnaidm|notruck16:12
beaglesjaosorior, do you know if there is an existing pattern for creating docker volumes on nodes?16:12
*** panda is now known as panda|afk16:12
*** rfolco has joined #tripleo16:13
*** sshnaidm|notruck is now known as sshnaidm|mitsubi16:13
*** sshnaidm|mitsubi is now known as sshnaidm16:13
*** marios has quit IRC16:13
*** lblanchard has joined #tripleo16:15
*** aufi has quit IRC16:16
*** aufi_ has joined #tripleo16:16
juriartejaosorior: adding the CA cert to the trusted chain implies changes in the controller node?16:19
*** dpawar has joined #tripleo16:20
*** fpan has quit IRC16:20
*** ukalifon has quit IRC16:21
sri_Tengu, If you want use virtualization on your compute nodes, you also need to enable kernel visualization on the host where your compute node running16:21
*** olivierbourdon38 has joined #tripleo16:21
*** links has quit IRC16:22
Tengusri_: ah, there's a bit more to do : https://www.linuxtechi.com/enable-nested-virtualization-kvm-centos-7-rhel-7/16:22
Tenguyep, saw that :).16:22
*** larsks has joined #tripleo16:22
jaosoriorjuriarte: what do you mean?16:24
jaosorioraaah I gotta go16:24
jaosoriorbeagles: not that I know of16:24
beaglesjaosorior, cool, thanks16:24
jaosoriorI'm off on vacations folks, have a good weekend!16:24
juriartejaosorior, no prob! thanks a lot for your help!16:24
Tengujaosorior: have a good one ;)16:25
beaglesjaosorior, cheers, have a good one16:25
juriartejaosorior: enjoy :)16:25
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud: introduce deployment_user parameter  https://review.openstack.org/54475916:26
sri_Tengu, this is how i setup my virtual env with VBMC16:28
sri_http://paste.openstack.org/show/673106/16:28
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Provide update commands for each upgrade steps  https://review.openstack.org/54502616:29
Tengusri_: ah, already did all the vbmc part - now I'm digging into tempest for the testing16:29
*** jaosorior has quit IRC16:29
sri_i see16:29
Tengusri_: I have an ansible playbook that setup all the things - I just have to add the nested virt into it, and that's done :)16:29
Tengusri_: it works pretty well. My goal was to get a lab that is basically a 1:1 copy of the prod - event for the public IP addresses. I had to create a full isolated network, with double-NAT and so on16:30
Tengupretty proud of that setup I must say :).16:30
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker: configure group/user for deployment_user  https://review.openstack.org/54476116:31
openstackgerritJavier Peña proposed openstack/os-net-config master: Add network objects sriov_vf and sriov_pf  https://review.openstack.org/52757116:31
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Deploy container-multinode (fs010) with a containerized undercloud  https://review.openstack.org/54290616:31
*** leanderthal has quit IRC16:31
apetrichbnemec, I was looking at this deploy script and who is cybertron? :)16:32
*** bogdando has quit IRC16:32
sri_Tengu, sounds awesome :) is there anyway I can found those ansible scripts ?16:33
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Upgrade UC and OC using tripleo-upgrade role.  https://review.openstack.org/54231116:34
dtantsurapetrich: cybertron sounds scary, this must be one of that even transformers :D16:34
dtantsurs/even/evil/ of course16:34
*** ccamacho has quit IRC16:34
apetrichdtantsur, we are using cybertron code to deploy. seems very advanced. Might need more energon cubes to work on my machine though16:35
dtantsur++ never enough of them16:35
*** ramishra has quit IRC16:35
*** jcoufal_ has quit IRC16:35
*** jcoufal_ has joined #tripleo16:36
abishopslagle: pls see https://review.openstack.org/542425 again (I had to fix tox/pep8 error)16:37
*** agurenko has quit IRC16:39
*** tosky has quit IRC16:42
bnemecapetrich: :-)16:44
bnemecThe funny thing is that when I started using that username I didn't even realize the transformers connection.16:44
bnemecAlthough as a child of the 80's that is almost certainly where I got it from, whether I knew it or not.16:44
*** udesale has quit IRC16:44
*** mrch has quit IRC16:45
*** panda|afk is now known as panda16:45
*** aufi_ has quit IRC16:45
*** ykarel has quit IRC16:46
trozethi guys, I pushed a change to update tripleo-common for the ODL container.  How do I get a new container built?  Last one in the docker registry shows 2 months ago: https://hub.docker.com/r/tripleoupstream/centos-binary-opendaylight/16:46
EmilienMmandre: are you still working on https://review.openstack.org/#/c/528679/ ? I'm trying to move forward with this one16:48
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: [WIP] Update tripleo-inventory for extra nodes on OVB  https://review.openstack.org/54144616:49
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: [WIP] Update default supplemental ssh key  https://review.openstack.org/54173116:49
mandreEmilienM: I'm not, feel free to pick it up16:49
openstackgerritMerged openstack/python-tripleoclient master: Inherit UpdateCommand class from overcloud DeployCommand class  https://review.openstack.org/54079816:51
openstackgerritMerged openstack/python-tripleoclient master: Pass the queue_name to messaging_websocket function for update  https://review.openstack.org/54429816:51
EmilienMmandre: i'll try to take over and ask for your help if needed16:52
*** masco has joined #tripleo16:53
Tengusri_: ah, one more question: do you also have ceph-storage nodes in your lab? if so, did you add some additional disks? if so, did you encounter any issue with the deploy? On my side, this is the last point that really blocks me. Probably due to boot order, or something like that16:54
*** salmankhan has quit IRC16:55
*** wolverineav has joined #tripleo16:55
*** olivierbourdon38 has quit IRC16:56
*** trown is now known as trown|lunch16:56
*** salmankhan has joined #tripleo16:57
bnemecDoes the third-party ci respect regular rechecks now?16:57
bnemecI tried check-rdo but it didn't do anything AFAICT.16:58
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP Make sure that ceph-nfs and the VIP start in the right order  https://review.openstack.org/54503516:58
*** oidgar has joined #tripleo16:58
*** gvrangan has joined #tripleo16:59
*** dparkes has quit IRC17:00
openstackgerritMerged openstack/tripleo-ipsec master: Force restart of ipsec in legacy setup  https://review.openstack.org/54495417:01
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs  https://review.openstack.org/49404317:02
*** chlong has joined #tripleo17:02
weshaymwhahaha, EmilienM arxcruz|ruck and rlandy|rover have two new promotion blockers for queens coming in fyi17:03
EmilienMdamn17:03
EmilienMweshay: links please?17:03
d0ugalthrash: did you manage to find a fix?17:03
rlandy|roverhttps://bugs.launchpad.net/tripleo/+bug/174974717:03
openstackLaunchpad bug 1749747 in tripleo "Queens promotion - multinode jobs failing on ControllerDeployment_Step3.0" [Critical,Triaged]17:03
openstackgerritMichael Chapman proposed openstack/tripleo-heat-templates master: Add OPNFV scenario environment  https://review.openstack.org/48690517:03
thrashd0ugal: not yet... I did at least fix it so that it doesn't wait for the timeout.17:03
thrashd0ugal: Something is going on with how we are updating the heat env.17:04
rlandy|roverhttps://bugs.launchpad.net/tripleo/+bug/174967117:04
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]17:04
thrashd0ugal: I'm not sure I know enough to know what the problem is, and I can find zero documentation on how to properly remove a resource.17:04
rlandy|roverEmilienM: mwhahaha: two bugs linked above17:04
d0ugalthrash: sounds about right.17:04
EmilienMok looking17:04
rlandy|roverEmilienM: thanks17:05
EmilienMok the glance one we need someone from storage team17:05
bnemecOkay, it is just recheck now.17:05
thrashd0ugal: I've updated the bug. Heat is complaining about a missing 'resource_id'17:05
*** salmankhan has quit IRC17:06
EmilienMand it sounds fixed in https://bugs.launchpad.net/tripleo/+bug/1747690 no?17:06
openstackLaunchpad bug 1747690 in Glance "master promotion: Failed to call refresh: glance-manage db_sync" [Critical,Fix released] - Assigned to Shilpa Devharakar (shilpasd)17:06
rlandy|roverlooking17:06
EmilienMfor this one we need some nova/ironic folks17:07
EmilienMhttps://bugs.launchpad.net/tripleo/+bug/174967117:07
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]17:07
EmilienMowalsh, dtantsur ^ if you're still around17:07
rlandy|roverI don't see the same "Failed to call refresh: glance-manage  db_sync" error17:09
EmilienMit's the same command that failed17:09
thrashtherve: maybe you can help with this? https://bugs.launchpad.net/tripleo/+bug/174942617:10
openstackLaunchpad bug 1749426 in tripleo "Node delete is broken" [High,In progress] - Assigned to Brad P. Crochet (brad-9)17:10
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933517:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967117:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)17:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]17:10
EmilienMweshay: both issues need to be escalated and assigned to ironic & glance teams - they look upstream issues17:12
thervethrash, Looking for the original error you mean?17:12
thrashtherve: yeah. I'm not really sure why it's throwing that error about resource_id ..17:12
thervethrash, Do you have a full traceback?17:13
thrashIt's failing in the stack validation.17:13
thrashtherve: yeah. Let me pastebin it17:13
therveDatabase errors are always a bug anyway17:13
openstackgerritDmitry Tantsur proposed openstack/tripleo-quickstart-extras master: OVB: use "ipmi" driver instead of "pxe_ipmitool" for >= Queens  https://review.openstack.org/54504217:14
thrashtherve: http://paste.openstack.org/show/673112/17:14
*** atoth has quit IRC17:15
*** juriarte has left #tripleo17:15
dtantsurEmilienM: redirecting to hjensas since I see something related to routed networks17:16
thrashtherve: the setup is that we modify the environment with {'ComputeCount': '1', 'ComputeRemovalPolicies': [{'resource_list': ['1']}]}17:16
thrashtherve: then try to update the stack.17:16
dtantsurhjensas, bfournie: https://bugs.launchpad.net/tripleo/+bug/174967117:16
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]17:16
thrashtherve: it fails on the validation.17:16
thervethrash, Yeah a validation that have a failing insert is highly troubling :/17:17
rlandy|roverweshay: ok if I add glance and ironic branches (accordingly) to those tripleo bugs?17:18
*** wolverineav has quit IRC17:18
*** wolverineav has joined #tripleo17:19
thrashtherve: right? :D17:20
dtantsurEmilienM: I'm afraid we may have a deadlock with https://review.openstack.org/#/c/537830/ required to fix the promotion, but not able to pass the CI because of the promotion :(17:20
thrashtherve: gotta run. Back in about 20 min.17:20
dtantsurI'll leave it up to Harald to comment though17:20
*** thrash is now known as thrash|biab17:20
*** pcaruana has joined #tripleo17:20
*** yamahata has quit IRC17:20
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Skip SSH host key check during FFU  https://review.openstack.org/54476017:21
*** wolverin_ has joined #tripleo17:24
EmilienMdtantsur: damn17:25
dtantsurlet's hope that I'm wrong in my assessment17:25
EmilienMdtantsur: would we have a workaround?17:26
*** atoth has joined #tripleo17:27
*** assassin has quit IRC17:27
dtantsurI would really like to hear from hjensas on it. I think he told me the ironic change is backward compatible17:27
dtantsurI hope the answer is not to revert his instack-undercloud changes introducing routed networks17:27
dtantsurbut it may be17:27
*** dpawar has quit IRC17:28
*** wolverineav has quit IRC17:28
thervethrash|biab, https://review.openstack.org/545056 I think should work17:29
therveGot to go as well17:29
dtantsurbfournie, hjensas, do we have options other than trying to revert https://github.com/openstack/instack-undercloud/commit/46a5df2625b36e3b42b33a4b9f439bab0a87b1c7 ?17:30
dtantsurEmilienM: is it possible to check that reverting ^^ would unblock the promotion?17:30
dtantsurI mean, without actually reverting :)17:30
*** jpich has quit IRC17:32
*** cylopez has quit IRC17:33
*** masco_ has joined #tripleo17:34
*** wolverin_ has quit IRC17:34
*** masco has quit IRC17:34
*** wolverineav has joined #tripleo17:35
EmilienMdtantsur: not that I'm aware of17:37
dtantsursigh17:37
EmilienMdtantsur: unless we carry a revert in the packaging17:37
EmilienMbut that's really bad17:37
dtantsuryep17:37
openstackgerritAlan Bishop proposed openstack/puppet-tripleo master: WIP: Avoid hard-coded settings in Manila HA containers  https://review.openstack.org/54506017:38
EmilienMdtantsur, hjensas : a side comment on https://review.openstack.org/#/c/537830/14/elements/puppet-stack-config/puppet-stack-config.pp17:38
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates master: WIP: Unify the Manila HA and non-HA docker configurations  https://review.openstack.org/54506117:38
weshaycschwede, rlandy|rover fyi.. https://bugs.launchpad.net/glance/+bug/174974717:39
openstackLaunchpad bug 1749747 in tripleo "Queens promotion - error on ControllerDeployment_Step3.0 - error running glance_api_db_sync" [Critical,Triaged]17:39
*** wolverineav has quit IRC17:39
weshaytrozet, can you add trown|lunch to that OPNFV mtg?17:40
hjensasEmilienM: just back from gym, reading ...17:41
*** moshele has joined #tripleo17:41
openstackgerritSergii Golovatiuk proposed openstack/tripleo-quickstart-extras master: Remove deprecation warning  https://review.openstack.org/54506317:41
weshayrlandy|rover, it looks like dtantsur is already looking at the bug17:41
weshayfor ironic17:41
rlandy|roverok, thanks17:42
bfourniedtantsur, EmilienM, hjensas: its really this that is causing the problem https://review.openstack.org/#/c/536040/ since baremetal hasn't been added yet by https://review.openstack.org/#/c/537830/14/elements/puppet-stack-config/puppet-stack-config.pp17:42
dtantsurbfournie: hjensas told me we would not fail if networking-baremetal is not present; we even documented it in ironic17:43
*** thrash|biab is now known as thrash17:43
dtantsurwas it incorrect?17:43
hjensasEmilienM: dtantsur: "is not connected to any segments on routed provider network", we need https://review.openstack.org/#/c/537830/ .17:43
thrashtherve: awesome. I'll try it out.17:43
*** jcoufal__ has joined #tripleo17:43
*** jcoufal_ has quit IRC17:43
*** moshele has quit IRC17:44
*** panda is now known as panda|off17:44
dtantsurhjensas: the question is: why aren't we backward compatible?17:44
dtantsurdoes it mean that ironic in the overcloud is also broken?17:44
EmilienMprobably17:44
EmilienMsigh17:44
EmilienMwhich is why we have feature freeze17:45
hjensasdtantsur: bfournie: the neutron segment service plug in must be enabled, and the ctlplane-subnet is associated with a segment.17:45
hjensasdtantsur: that is a scenario we did support at all previously.17:45
dtantsuraha, okay, this is better17:45
hjensasdtantsur: sorry, did not support at all.17:45
dtantsurso ironic in the overcloud is not broken, because we don't use routed networks there17:45
dtantsurEmilienM: we would get this situation anyway.. the problem is that we merged two changes - to ironic and to tripleo. each of them works, but together they break undercloud.17:46
hjensasdtantsur: yes, when there is no routed network, neutron does not do any segment-to-subnet association filtering and so it works like before.17:46
dtantsurhjensas: given that https://review.openstack.org/#/c/537830/ will not merge until we get a promotion, and we won't get a promotion until https://review.openstack.org/#/c/537830/ is merged..17:47
dtantsuris out only option to revert switching the undercloud to routed networks?17:47
dtantsurs/out/our/17:47
dtantsurthen land https://review.openstack.org/#/c/537830/ then revert the revert?17:47
*** itlinux has joined #tripleo17:47
*** dsneddon_ has joined #tripleo17:48
openstackgerritAlex Schultz proposed openstack/tripleo-puppet-elements master: Create element to purge resolv.conf  https://review.openstack.org/54506717:48
*** sshnaidm is now known as sshnaidm|off17:49
*** holser has quit IRC17:49
hjensasdtantsur: yes, if we cannot get promotion now we should revert https://review.openstack.org/#/c/437544/, then apply https://review.openstack.org/#/c/537830 and re-apply https://review.openstack.org/#/c/437544/ + https://review.openstack.org/#/c/542204/17:49
* hjensas did not anticipate that this would block promotion. :(17:50
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Purge resolv.conf from the overcloud images  https://review.openstack.org/54506817:50
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Purge resolv.conf from the overcloud images  https://review.openstack.org/54506817:51
*** dsneddon_ has quit IRC17:51
dtantsurEmilienM: ^^^17:51
EmilienMyeah I can read17:51
*** zoli is now known as zoli|gone17:51
*** dsneddon_ has joined #tripleo17:51
EmilienMI just don't know what to say17:51
EmilienMwe have FFEs for good reasons17:51
EmilienMpeople still push features17:51
EmilienMshit breaks17:51
EmilienMand now we're stuck17:51
*** zoli|gone is now known as zoli17:52
EmilienMso unless we have a workaround to skip this config, we need a revert I guess?17:52
*** tesseract has quit IRC17:52
dtantsursorry :(17:52
EmilienMso revert what you need to revert, let's get promotion and revert the revert17:52
dtantsurlet the revert party begin17:52
EmilienMwe're suppose to releae queens next week but i don't think that will happen17:52
hjensasEmilienM: I think I may have a patch that makes the segment association optional.17:53
EmilienMhjensas: that would work17:53
dtantsuryeah, it may be less annoying17:53
EmilienMhjensas: so we disable it now and activate once we have promotion17:53
thrashtherve: it's at least trying to complete now. :D17:53
dtantsuror not activate17:53
thrashtherve: fingers crossed17:53
dtantsurlike, leave it off by default for Queens and enable for Rocky17:53
EmilienM++17:54
*** anonpervert has quit IRC17:54
*** thrash is now known as thrash|vet17:55
*** gkadam has quit IRC17:56
*** sshnaidm|off has quit IRC17:56
* mwhahaha thought we talked about always disabling new functionality and only enabling it after it works17:56
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Make routed networks optional  https://review.openstack.org/54221517:57
hjensasEmilienM: dtantsur: ^^ I think that should work.17:58
*** yamahata has joined #tripleo17:58
mwhahahahjensas: you need to genconfig17:58
hjensasmwhahaha: ah, yes. doing.17:58
EmilienMyeah indeed otherwise lgtm hopefully it pass17:58
*** derekh has quit IRC17:59
EmilienMin rocky we'll have to do something else for the containerized undercloud, just to make sure we know that17:59
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Make routed networks optional  https://review.openstack.org/54221517:59
dtantsurmwhahaha: btw oslo.config now can generate fancy pages like https://docs.openstack.org/ironic/latest/configuration/config.html17:59
dtantsurmwhahaha: we ended up removing sample configs in favor of this18:00
dtantsurdunno if it's useful for tripleo, but just making sure you're aware of it18:00
EmilienMit's pretty cool indeed18:00
mwhahahanot that usefull for us, but that's been something i always wish we had when doing puppet stuff18:00
dtantsuroh yeah, would be fantastic18:01
*** _sshnaidm_ has quit IRC18:01
EmilienMmwhahaha: there is puppet-doc stuff18:01
EmilienMlast time I checked what was like 4 years ago18:01
dtantsurit's really cool that you can link to any option https://docs.openstack.org/ironic/latest/configuration/config.html#ansible.playbooks_path18:01
EmilienMmwhahaha: yeah we have "puppet-doc"18:02
EmilienMwe could easily publish that somewhere18:02
mwhahahaEmilienM: no i mean when implementing puppet support for things :D18:02
mwhahahatrying to find the actual configs for services was a damn nightmare18:02
EmilienMyeah18:02
EmilienMI see now, right18:02
dtantsurI have to go, I guess we have the right people working on the right fixes now18:04
*** dtantsur is now known as dtantsur|afk18:04
EmilienMdtantsur|afk: thanks for your help!18:04
dtantsur|afkno problem, sorry for not spotting this potential issue earlier..18:05
*** gvrangan has quit IRC18:05
hjensasEmilienM: mwhahaha: If we leave that option in during queens, can we make sure CI run's with it enabled? A lot of the code in neutron/ironic etc execute even when there is just the one subnet. i.e even current jobs do test most of it.18:06
*** chem has quit IRC18:06
mwhahahahjensas: yea we'll just need to add it to a scenario or come up with an  ironic scenario18:07
* hjensas darn, it fails tox tests ...18:08
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add release role to required playbooks  https://review.openstack.org/54507218:09
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933518:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967118:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,Triaged]18:10
*** wolverineav has joined #tripleo18:11
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Make routed networks optional  https://review.openstack.org/54221518:13
*** jpena is now known as jpena|off18:14
bfourniehjensas: looks good18:15
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/newton: Remove neutron-managed firewall rules from /etc/sysconfig/iptables  https://review.openstack.org/54507518:16
*** oidgar has quit IRC18:20
*** amoralej is now known as amoralej|off18:21
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Restrict SNMP to internal network  https://review.openstack.org/54453018:24
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Disable SNMP service in all CI jobs"  https://review.openstack.org/54499718:24
bfourniehjensas: although I guess the release note could be modified to add the new option https://github.com/openstack/instack-undercloud/blob/master/releasenotes/notes/routed-subnets-undercloud-64bb87222db0555b.yaml#L17. Could do that after this merges18:24
hjensasbfournie: yeah, makes sense. EmilienM, mwhahaha we can still do update to the releasenote ^^?18:26
mwhahahahjensas: yea you can update it18:26
EmilienMhjensas: yes18:26
EmilienMthey get regenerated18:27
EmilienMmwhahaha, weshay : just an FYI reading (nothing urgent) https://review.openstack.org/#/c/54506518:27
weshayheh.. maybe google will contribute cloud resources :)18:29
*** trown|lunch is now known as trown18:30
*** rbowen has quit IRC18:31
*** masco_ has quit IRC18:31
*** ebarrera has quit IRC18:32
openstackgerritMike Fedosin proposed openstack/tripleo-heat-templates master: Enable ipmi_devintf kernel module  https://review.openstack.org/54508418:33
*** _sshnaidm_2 has joined #tripleo18:33
*** jcoufal has joined #tripleo18:37
*** jcoufal__ has quit IRC18:40
*** jcoufal_ has joined #tripleo18:40
*** jcoufal has quit IRC18:41
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Make routed networks optional  https://review.openstack.org/54221518:43
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Update routed network reno  https://review.openstack.org/54508818:43
*** rmascena has joined #tripleo18:43
*** masco_ has joined #tripleo18:44
bfourniehjensas: sorry for not thinking of this earlier but the patch should reference upstream bug18:44
*** jcoufal has joined #tripleo18:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add enpoints for TripleO UI Config  https://review.openstack.org/52867918:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add enpoints for TripleO UI Config  https://review.openstack.org/52867918:46
*** raildo has quit IRC18:46
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Make routed networks optional  https://review.openstack.org/54221518:46
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Update routed network reno  https://review.openstack.org/54508818:46
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: [WIP] tripleo ui docker  https://review.openstack.org/51549018:46
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Add tripleo-ui container  https://review.openstack.org/51540718:46
*** jcoufal_ has quit IRC18:47
EmilienMhjensas: thanks for being responsive and proposing this fix18:47
thrash|vettherve: that did the trick! Thanks!18:48
*** jmelvin has quit IRC18:49
*** fpan has joined #tripleo18:49
*** fpan has quit IRC18:49
*** fpan has joined #tripleo18:50
hjensasEmilienM: yeah, sorry I did'nt realize that it would block promotions. Lesson learned. :)18:50
EmilienMhjensas: every rc time is the same, no worries18:50
bnemecFeature freeze, aka destabilize all the things.18:51
*** gfidente has quit IRC18:53
EmilienMfeature freeze == "oh shit we really follow some milestones and my stuff isn't merged" :-)18:55
EmilienMjoke aside, it happens :-)18:55
*** ddubs has joined #tripleo18:56
*** atoth has quit IRC18:56
ddubshey all, attempting to deploy overcloud and I'm getting: resources.RedisVirtualIP.resources.VipPort: IP address 10.101.225.6 is not a valid IP for any of the subnets, I have InternalApiNetCidr: 10.101.225.0/24 and it is outside of the allocation pool18:57
ddubsany idea's?18:57
*** rbowen has joined #tripleo19:00
*** lucasagomes is now known as lucas-afk19:00
*** thrash|vet is now known as thrash19:00
*** etingof has joined #tripleo19:00
*** wolverineav has quit IRC19:03
*** wolverineav has joined #tripleo19:04
hjensasddubs: If you try to manually create a port and assign a ip address outside of the pool does it work?19:08
*** wolverineav has quit IRC19:08
*** karthiks has quit IRC19:08
ddubshjensas: this is during the overcloud deploy so i cant get that far - i just found the heat resource showing it failed tho19:08
ddubsfor some odd reason the InternalApiVirtualIP in heat is using the ControlPlane Network19:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933519:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174964119:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174964519:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967119:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)19:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1749641 in tripleo "Overcloud deployment failing in promotion jobs at glance-manage db_sync" [Critical,Triaged]19:10
openstackLaunchpad bug 1749645 in tripleo "Overcloud deployment failing in promotion jobs at overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged]19:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,In progress] - Assigned to Harald Jensås (harald-jensas)19:10
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for multipathd  https://review.openstack.org/53918519:11
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for multipathd  https://review.openstack.org/53918519:12
hjensasddubs: hm, I tried it myself. And neutron does allow specifying a fixed-ip outside the pool.19:12
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for Gnocchi API  https://review.openstack.org/53824619:13
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for gnocchi-metricd  https://review.openstack.org/53822819:14
*** jcoufal_ has joined #tripleo19:15
*** dprince has quit IRC19:15
*** jmelvin has joined #tripleo19:16
*** jcoufal has quit IRC19:16
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for Tacker  https://review.openstack.org/53636019:17
ddubshjensas: i may have some junk artifacts leftover from a stack delete, let me clean this up and look around a bit because it makes no sense right now :P19:17
hjensasddubs: by default it does.  overcloud-resource-registry-puppet.j2.yaml: OS::TripleO::Network::Ports::RedisVipPort: network/ports/ctlplane_vip.yaml.19:17
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for gnocchi-statsd  https://review.openstack.org/53825319:18
hjensasddubs: so in some environment file for isolated network it must be set to OS::TripleO::Network::Ports::RedisVipPort: ../network/ports/vip.yaml19:18
ddubsyea im using network isolation19:19
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for Neutron server  https://review.openstack.org/53998619:20
*** etingof has quit IRC19:20
EmilienMslagle: do you remember which mistral service generates /var/lib/mistral/XXX ? I need to know for the containerized undercloud so we can collect these logs as well19:20
EmilienM(I need to collect the config-download bits)19:21
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for Collectd  https://review.openstack.org/53827419:21
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Use Nova profiles in node tagging form  https://review.openstack.org/54509819:21
slagleEmilienM: it's actually the custom ansible action from tripleo-common that creates that dir19:22
slagleEmilienM: the undercloud container install does not use mistral, so you won't have it19:22
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for etcd  https://review.openstack.org/54280319:22
slagleEmilienM: i'd guess that is just uses tripleo-config-download and downloads everything to a local dir somewhere19:23
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for Aodh API  https://review.openstack.org/54284919:23
* fultonj reviewing https://bugs.launchpad.net/tripleo/+bug/1749645 19:23
openstackLaunchpad bug 1749645 in tripleo "Overcloud deployment failing in promotion jobs at overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged]19:23
EmilienMslagle: right, I'll try that, thanks!19:23
openstackgerritMerged openstack/tripleo-heat-templates master: Undercloud: support for external VIP for SSL  https://review.openstack.org/53547919:24
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for Cinder API  https://review.openstack.org/54289519:24
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for iSCSId  https://review.openstack.org/54345019:25
*** ledo_ has joined #tripleo19:26
ddubshjensas: ahh looks like the overcloud deploy isnt creating my subnets in neutron for whatever reason19:26
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for memcached  https://review.openstack.org/54400619:27
paramitesorry for wallpapering19:27
paramitealmost done19:27
openstackgerritMerged openstack/tripleo-heat-templates master: Unify the Cinder HA and non-HA docker configurations  https://review.openstack.org/54242519:27
*** karthiks has joined #tripleo19:28
*** etingof has joined #tripleo19:30
trozetweshay: will do19:30
trozetmwhahaha: can you tell me how to get a container rebuilt in the tripleoupstream docker repo19:31
mwhahahatrozet: i guess it depends on the container19:31
mwhahahatrozet: but i think that's part of the promotion process which the CI team handles19:31
trozetmwhahaha: i updated the opendaylight RPM version in tripleo-common, i want to get the container rebuilt19:32
*** jcoufal_ has quit IRC19:32
mwhahahatrozet: yea unless we have a way to rebuild, it'll just have to follow the promotion process19:32
*** jcoufal has joined #tripleo19:33
trozetmwhahaha: what's that process?19:33
openstackgerritMartin Mágr proposed openstack/tripleo-common master: [WIP] Add missing links to new healthchecks  https://review.openstack.org/53919019:33
mwhahahatrozet: that's the one that runs periodically to promote packages and rebuild the containers with the current one. ie the one that's been broken for like 2+ weeks now19:34
*** dparkes has joined #tripleo19:34
trozetmwhahaha: oh, do you have any links to that job?19:34
*** ledo_ has quit IRC19:36
*** ledo_ has joined #tripleo19:36
trowntrozet: https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-containers-build/ is the build job, all the jobs that run for promote can be found if you click any of the runs19:37
mwhahahatrozet: https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo_trunk-promote-master-current-tripleo/19:37
trownhttps://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-containers-build/657/ for instance19:37
trownmwhahaha: that is rdo promote19:37
ddubshjensas: a jacked up ldap config was knocking out the yaml for my isolated networks :I19:37
mwhahahatrown: yea the issue for him is no promotions19:37
trownmwhahaha: trozet, but you want a new container to be available to tripleo jobs? that would be tripleo promote in software factory ^19:38
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Consume RoleData config from config download files  https://review.openstack.org/54510219:38
mwhahahatrown: no he wants a container rebuilt cause of a change19:39
hjensasddubs: I see, then you can fix it. :)19:39
mwhahahatrown: which would occur during promotion but we're stuck19:39
trozettrown: i just want the container updated in the docker registry19:39
trownmwhahaha: trozet, ok still is the tripleo promotes that matter for that https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-containers-build/657/ but in any case they are indeed stuck19:40
*** dprince has joined #tripleo19:40
*** dprince_ has joined #tripleo19:40
*** dprince_ has quit IRC19:40
trozettrown, mwhahaha: so in that link, the build passed, and promote to ci-testing passed19:41
trozettrown: the other ones are just deployments right? so which job actually updates the container?19:41
trowntrozet: the deploy jobs need to pass, then there is a separate process that pushes the "known good" containers19:42
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Support SshKnownHostsDeployment with config-download  https://review.openstack.org/53931519:42
trowntrozet: each of the jobs reports to an API, and we have a cron that checks that API for passes and does the promote19:42
trozettrown: oh ok19:43
trowntrozet: http://38.145.33.13/master.log is the logs on the promote server ... but probably not all that useful to you19:43
trozettrown: yeah just trying to understand the flow19:43
trowntrozet: important bit is the deploy jobs passing, without that, we cant promote containers or all the gates will be broken19:44
trozettrown: so there are quite a lot of jobs failing here, is it all the same root cause?19:44
trowntrozet: unfortunately no19:45
trowntrozet: looks like 8 issues on the blocker board https://trello.com/b/j4IcIomh/production-chain-escalation?menu=filter&filter=label:TripleO-master19:45
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: add undercloud-setup to default tags  https://review.openstack.org/54510419:45
trozettrown: ok I cant see that trello board19:46
mwhahahathey should all be alert bugs in lp19:46
mwhahahabut yea, there are issues19:46
trozetmwhahaha: ok i'll look on LP, thanks19:47
trowntrozet: hmm... lp has most of the issues under promotion-blocker tag https://bugs.launchpad.net/tripleo/+bugs?field.tag=promotion-blocker19:47
*** maeca has quit IRC19:47
trozettrown: thanks19:48
trownnp19:49
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add spacing for readability  https://review.openstack.org/53938219:51
*** waleedm has joined #tripleo19:52
trozettrown: this one looks invalid, should it be closed? https://bugs.launchpad.net/tripleo/+bug/174685719:54
openstackLaunchpad bug 1746857 in tripleo "pip installs taking too long for jobs to successfully complete" [Critical,Incomplete]19:54
openstackgerritMerged openstack/tripleo-common master: Revert "Add healthchecks for barbican containers"  https://review.openstack.org/54462619:55
*** ledo_ has quit IRC19:55
EmilienMweshay: ^ this one is merged finally19:55
weshaywow.. lots o jobs19:55
trowntrozet: probably... weshay can we close https://bugs.launchpad.net/tripleo/+bug/1746857 ?19:56
openstackLaunchpad bug 1746857 in tripleo "pip installs taking too long for jobs to successfully complete" [Critical,Incomplete]19:56
weshayI think so19:56
trowndone19:56
trozettrown: well thats 1 down, 5 to go :)19:56
*** eck` is now known as eck`gone19:58
itlinuxhello guys.. I got all my 3 controllers crashed and I rebooted one and restarted the network on the other two and all went back but that should not happen.. here is a log I extracted from the ovs-vswitch http://paste.openstack.org/show/673121/19:59
*** eck`gone is now known as eck`19:59
itlinuxany idea on why this could happen?19:59
itlinuxthe env is PIKE in BM19:59
itlinuxall my pcs services went down20:00
*** pchavva has quit IRC20:01
*** jmelvin has quit IRC20:01
*** pcaruana has quit IRC20:03
*** jmelvin has joined #tripleo20:04
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: docker: configure group/user for deployment_user  https://review.openstack.org/54416720:07
*** sshnaidm|off has joined #tripleo20:08
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker: configure group/user for deployment_user  https://review.openstack.org/54476120:08
trozettrown: this one looks fixed right?  Why was it moved back to triage from Fix Released? https://bugs.launchpad.net/tripleo/+bug/174762320:08
openstackLaunchpad bug 1747623 in tripleo "Floating IP doesn't match in tempest test_minimum_basic_scenario" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)20:08
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Deploy container-multinode (fs010) with a containerized undercloud  https://review.openstack.org/54290620:08
trownarxcruz|ruck: https://bugs.launchpad.net/tripleo/+bug/1747623 is fixed or some issue still?20:09
openstackLaunchpad bug 1747623 in tripleo "Floating IP doesn't match in tempest test_minimum_basic_scenario" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)20:09
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933520:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174964120:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174964520:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967120:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)20:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1749641 in tripleo "Overcloud deployment failing in promotion jobs at glance-manage db_sync" [Critical,Triaged]20:10
openstackLaunchpad bug 1749645 in tripleo "Overcloud deployment failing in promotion jobs at overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged]20:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,In progress] - Assigned to Harald Jensås (harald-jensas)20:10
openstackgerritMartin Mágr proposed openstack/tripleo-common master: [WIP] Add missing links to new healthchecks  https://review.openstack.org/53919020:13
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: docker: configure group/user for deployment_user  https://review.openstack.org/54416720:17
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker: configure group/user for deployment_user  https://review.openstack.org/54476120:17
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Deploy container-multinode (fs010) with a containerized undercloud  https://review.openstack.org/54290620:18
*** pkovar has quit IRC20:20
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: set the openstack release dynamically  https://review.openstack.org/54303120:20
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Provide update commands for each upgrade steps  https://review.openstack.org/54502620:21
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: fix feature config doc  https://review.openstack.org/54510820:24
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/newton: Remove neutron-managed firewall rules from /etc/sysconfig/iptables  https://review.openstack.org/54507520:27
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Use ironic::inspector::dnsmasq_ip_subnets  https://review.openstack.org/54358220:29
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Add static routes for routed ctlplane  https://review.openstack.org/54510920:29
*** ebarrera_ has joined #tripleo20:30
*** marrusl has quit IRC20:32
*** wolverineav has joined #tripleo20:32
*** florianf has quit IRC20:33
hjensasLooks like the URL's used by zuul cloner is not right in this job: https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/5879/console20:34
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/newton: firewall: stop using stdlib stages  https://review.openstack.org/54511020:34
*** jtomasek has quit IRC20:34
*** abishop has quit IRC20:35
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/newton: Remove neutron-managed firewall rules from /etc/sysconfig/iptables  https://review.openstack.org/54507520:38
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Purge resolv.conf from the overcloud images  https://review.openstack.org/54506820:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker: don't override horizon::vhost_extra_params  https://review.openstack.org/54475820:43
*** karthiks has quit IRC20:44
*** wolverineav has quit IRC20:45
*** akrivoka has quit IRC20:45
*** wolverineav has joined #tripleo20:45
*** atoth has joined #tripleo20:46
*** wolverineav has quit IRC20:50
EmilienMslagle: I proposed a small suggestion on https://review.openstack.org/#/c/543631/ but I'm fine either way.20:54
*** maeca has joined #tripleo20:55
*** karthiks has joined #tripleo20:56
*** marrusl has joined #tripleo20:57
EmilienMslagle: re: mistral/config-download - I confirm we do have mistral deployed on containerized-undercloud so I think we need to mount /var/lib/mistral to the container if we want to get the config-download logs when deploying the overcloud20:59
EmilienM(and I'm not talking about the config-download logs for the undercloud deployment)21:00
* EmilienM afk lunch21:00
*** etingof has quit IRC21:01
*** karthiks has quit IRC21:02
slaglefor the oc, right21:03
*** holser has joined #tripleo21:05
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933521:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174964121:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174964521:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967121:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)21:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1749641 in tripleo "Overcloud deployment failing in promotion jobs at glance-manage db_sync" [Critical,Triaged]21:10
openstackLaunchpad bug 1749645 in tripleo "Overcloud deployment failing in promotion jobs at overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged] - Assigned to John Fulton (jfulton-org)21:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,In progress] - Assigned to Harald Jensås (harald-jensas)21:10
*** dprince has quit IRC21:13
*** etingof has joined #tripleo21:14
*** karthiks has joined #tripleo21:15
*** waleedm has quit IRC21:23
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Add floating ip connectivity check to common dir and use it for FFU  https://review.openstack.org/54512721:24
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Add floating ip connectivity check to common dir and use it for FFU  https://review.openstack.org/54512721:24
*** pcaruana has joined #tripleo21:31
*** jcoufal has quit IRC21:31
*** tcw1 has quit IRC21:32
*** trown is now known as trown|outtypewww21:35
openstackgerritMerged openstack/tripleo-ipsec master: Change DPD action policy to restart for VIP tunnels  https://review.openstack.org/54495521:37
*** jmelvin has quit IRC21:39
*** rmascena has quit IRC21:41
*** alee has quit IRC21:42
*** openstack has joined #tripleo21:44
*** ChanServ sets mode: +o openstack21:44
*** hamzy has quit IRC21:46
*** pcaruana has quit IRC21:48
*** bfournie has quit IRC21:48
*** oidgar has joined #tripleo21:49
*** rcernin has joined #tripleo21:50
*** marrusl has quit IRC21:50
*** jmelvin has joined #tripleo21:54
openstackgerritMerged openstack/python-tripleoclient master: undercloud: introduce deployment_user parameter  https://review.openstack.org/54475921:55
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Restrict SNMP to internal network  https://review.openstack.org/54453021:55
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Disable SNMP service in all CI jobs"  https://review.openstack.org/54499721:55
*** oidgar has quit IRC21:57
weshayEmilienM, do you recall if ocata had ipv6 support?22:01
weshayEmilienM, https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset024.yml#L1822:02
EmilienMwe have IPv6 support since Liberty AFIK22:02
weshayoof22:02
EmilienMbut with strong testing, not since Liberty22:02
weshayrlandy|rover, ^22:02
EmilienMsince we had ovb-ceph-nonha job22:02
EmilienMif you remember22:02
EmilienMwhich was fs02422:02
EmilienMthis one was testing ipv622:02
rlandy|roveroh dear - not the answer I was looking for22:02
rlandy|roverfs024 is failing in ocata and from the data I can see, there isn't a passing test listed22:03
EmilienMI personally consider fs035 as the strongest ipv6 testing that we have upstream22:03
*** paramite has quit IRC22:03
rlandy|roverfs024 passes for pike22:03
EmilienMrlandy|rover: any link to failure? i can take a look super quickly22:03
rlandy|roverEmilienM: just for you - we have a whole bug to look at - https://bugs.launchpad.net/tripleo/+bug/174980722:04
openstackLaunchpad bug 1749807 in tripleo "gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata is failing on overcloud-validate" [High,Triaged] - Assigned to Ronelle Landy (rlandy)22:04
rlandy|roverI just don't know what the expectation is22:04
rlandy|roverdeploys fine22:04
rlandy|roverit's the work on the overcloud that fails22:04
EmilienM"just for you" lol22:05
*** marrusl has joined #tripleo22:05
EmilienMI have an indigestion of bugs this week22:05
*** holser has quit IRC22:06
* EmilienM looking22:06
rlandy|roverif it should work, we should fix the test so it does22:06
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Add floating ip connectivity check to common dir and use it for FFU  https://review.openstack.org/54512722:07
EmilienMglance logs look good now, in a quick check https://logs.rdoproject.org/97/544897/1/openstack-check/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata/Z71571f070afe47b79338265093bc6c16/overcloud-controller-0/var/log/glance/api.log.txt.gz22:07
*** holser has joined #tripleo22:08
EmilienMrlandy|rover: have you bisected?22:10
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933522:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174964122:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174964522:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967122:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)22:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1749641 in tripleo "Overcloud deployment failing in promotion jobs at glance-manage db_sync" [Critical,Triaged]22:10
openstackLaunchpad bug 1749645 in tripleo "Overcloud deployment failing in promotion jobs at overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged] - Assigned to John Fulton (jfulton-org)22:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,In progress] - Assigned to Harald Jensås (harald-jensas)22:10
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Add floating ip connectivity check to common dir and use it for FFU  https://review.openstack.org/54512722:10
EmilienMif it was working on Feb 1222:11
EmilienMit should be easy to find out what changed22:11
rlandy|roverEmilienM: can you define bisect in this case?22:11
*** jmelvin has quit IRC22:11
rlandy|roverI don't know if it was working on Feb 12 or not22:11
rlandy|roverfirst record of it running is then22:12
*** jmelvin has joined #tripleo22:12
EmilienMahh ok22:12
EmilienMfirst run of this job22:12
EmilienMand we didn't have any ipv6 job before?22:12
EmilienMif no, why to we bother?22:12
rlandy|rovernot that I can tell from sova: http://38.145.34.234/22:12
rlandy|roverchecking jenkins22:13
openstackgerritMerged openstack/tripleo-quickstart master: fix feature config doc  https://review.openstack.org/54510822:13
rlandy|roverEmilienM: that a no - https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata/22:14
EmilienMI have one success22:14
EmilienMhttps://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-master-nv/4736/22:14
EmilienMbut no logs are available :(22:14
EmilienMif we can find it maybe22:14
EmilienMbut it passed on https://review.openstack.org/#/c/519481/22:14
EmilienM1 month ago22:14
rlandy|roveroh ok - then it did pass22:15
rlandy|roverlegit - we should fix it22:15
EmilienMyeah but no logs22:15
rlandy|rovergreen is green22:15
*** marrusl has quit IRC22:15
* rlandy|rover checks the jobs link22:15
EmilienMwe need a jenkins admin maybe to get access to these logs22:15
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: set the openstack release dynamically  https://review.openstack.org/54303122:16
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: Remove hardcoded relese variable in quickstart run  https://review.openstack.org/54476722:16
EmilienMwait it was gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-master22:16
EmilienMnot gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata22:16
weshaywhich jobs?22:16
rlandy|rovermaybe the jobs dashboard has something22:16
weshayhttps://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata/22:17
weshayrlandy|rover, what are you guys missing?22:17
EmilienMlass success: https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata/lastSuccessfulBuild/22:17
*** waleedm has joined #tripleo22:17
EmilienMon (Dec 1422:17
rlandy|roverwe are looking for the logs of the successful run22:17
EmilienMhttps://logs.rdoproject.org/77/528077/1/openstack-check/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata/Zb1752420c7134622ac93a12e3b583b0422:17
EmilienMlogs not found :(22:17
EmilienMI guess it's lost in the black hole22:18
weshaynada22:18
weshayya.. they roll22:18
rlandy|roverhttps://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata/9/console22:20
EmilienMmwhahaha: we really need to prepare the release highlights for openstack/releases22:20
weshayoh my22:20
EmilienMmwhahaha: maybe we can draft something on etherpad22:20
mwhahahaoh all right22:20
EmilienMrlandy|rover, weshay: yeah but no logs22:21
rlandy|roverEmilienM: but at least we know it's legit22:21
rlandy|roverEmilienM: thanks for your help  will try trace the start of failing jobs from jenkins22:21
*** jmelvin has quit IRC22:21
weshayrlandy|rover, EmilienM well.. so we could pin the ocata release back to what ever it was 2 months ago22:22
*** jmelvin has joined #tripleo22:22
rlandy|roverweshay: probably we need to find when the failures started22:22
itlinuxhello any suggestions on this issue http://paste.openstack.org/show/673172/22:23
rlandy|roversearch jenkins22:23
itlinuxthanks22:23
mwhahahaEmilienM: do we want them for each thing or just like THT22:23
itlinuxlooks like it crashed my servers..22:23
*** jmelvin has quit IRC22:23
*** jmelvin has joined #tripleo22:23
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: mistral-executor: mount /var/lib/mistral  https://review.openstack.org/54514322:24
EmilienMmwhahaha: just one I think22:24
EmilienMmwhahaha: we might need to ask Sean22:24
EmilienMlet me poke at it22:24
EmilienMrlandy|rover, weshay : someone needs to debug, sounds like HAproxy doesn't work or something, the client can't reach Glance API. CHecking glance logs, seem ok22:25
mwhahahaEmilienM: going to start https://etherpad.openstack.org/p/tripleo-queens-highlights22:26
EmilienMgood22:26
EmilienMand me asking details on #openstack-release22:26
bnemecitlinux: In my experience lost db connections are generally out of memory errors that kill mysql.22:26
openstackgerritSai Ram Peesapati proposed openstack/puppet-tripleo master: Conditionally include nova patch config  https://review.openstack.org/54478522:26
itlinuxthanks @bnemec I have 400GB or ram though!! what else could create that?22:27
*** apetrich has quit IRC22:27
itlinuxsome other interesting errors http://paste.openstack.org/show/673176/ bnemec:22:28
bnemecitlinux: I would check for other errors in the db logs.  It could be out of connections too, although that shouldn't crash the node.22:28
itlinuxwell it crashed 3 controllers. the compute were still up the controllers could not connect to the default gw.. and all pcs were down.. so I rebooted ctl0 and restart network on ctl1 /2 and all got back to normal22:29
*** jmelvin has quit IRC22:29
*** apetrich has joined #tripleo22:29
*** jmelvin has joined #tripleo22:30
*** rbrady is now known as rbrady-afk22:30
*** marrusl has joined #tripleo22:30
openstackgerritSai Ram Peesapati proposed openstack/puppet-tripleo master: Conditionally include nova patch config  https://review.openstack.org/54478522:30
*** bfournie has joined #tripleo22:32
*** lblanchard has quit IRC22:33
*** _sshnaidm_2 has quit IRC22:37
EmilienMjrist: would you mind to help on https://etherpad.openstack.org/p/tripleo-queens-highlights and write one or 2 lines about what we improved in UI during QUeens?22:37
EmilienMsomething real quick for general release note22:37
*** threestrands has joined #tripleo22:43
*** threestrands has quit IRC22:43
*** threestrands has joined #tripleo22:43
*** etingof has quit IRC22:44
*** cdearborn has quit IRC22:45
*** pmannidi has joined #tripleo22:47
*** jmelvin has quit IRC22:54
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Add non-production ceph defaults to low-memory-usage.yaml  https://review.openstack.org/54458822:56
*** lblanchard has joined #tripleo22:57
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Add non-production ceph defaults to low-memory-usage.yaml  https://review.openstack.org/54458822:59
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Add non-production ceph defaults to low-memory-usage.yaml  https://review.openstack.org/54458823:00
*** etingof has joined #tripleo23:00
*** agopi is now known as agopi_out23:03
*** agopi_out has quit IRC23:07
*** Goneri has quit IRC23:08
*** itlinux has quit IRC23:09
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174933523:10
openstackLaunchpad bug 1749335 in tripleo "Failing to build barbican containers in rdo-kolla-build-integration" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174964123:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174964523:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174967123:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1749641 in tripleo "Overcloud deployment failing in promotion jobs at glance-manage db_sync" [Critical,Triaged]23:10
openstackLaunchpad bug 1749645 in tripleo "Overcloud deployment failing in promotion jobs at overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged] - Assigned to John Fulton (jfulton-org)23:10
openstackLaunchpad bug 1749671 in tripleo "Overcloud installation fails with "Failure prepping block device." error" [Critical,In progress] - Assigned to Harald Jensås (harald-jensas)23:10
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Add floating ip connectivity check to common dir and use it for FFU  https://review.openstack.org/54512723:12
*** ledo_ has joined #tripleo23:21
*** waleedm has quit IRC23:22
*** pradk has quit IRC23:23
*** mcornea has quit IRC23:23
*** masco_ has quit IRC23:34
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: Add --dry-run option to undercloud install  https://review.openstack.org/54408223:50
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: Fix haproxy and keepalived env paths  https://review.openstack.org/54516023:50
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: Populate ContainerImagePrepare variable  https://review.openstack.org/54516123:50
*** ledo_ has quit IRC23:52
*** rlandy|rover is now known as rlandy|rover|bia23:53
*** alee has joined #tripleo23:53
*** rlandy|rover|bia is now known as rlandy|rover|bbl23:53
*** dhill__ has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!