Wednesday, 2018-07-11

tonybWhere are the ansilbe playbooks that get generated with config-download defined (I'm guessing THT) I need to tweak the step that creates /var/liv/ironic/tftpboot00:02
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Switch remaining env files to containers defaults  https://review.openstack.org/56781300:03
openstackgerritMerged openstack/tripleo-heat-templates master: Remove unuseful become: true from deploy-steps  https://review.openstack.org/57512800:03
openstackgerritMerged openstack/tripleo-quickstart master: Enable pipelining for ansible  https://review.openstack.org/57788900:03
openstackgerritMerged openstack/tripleo-ui master: fix tox python3 overrides  https://review.openstack.org/58120800:03
*** moshele has joined #tripleo00:04
tonybOh perhaps it's http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/services/ironic-conductor.yaml#n20000:07
* tonyb wonders why I didn't find that before :/00:14
openstackgerritMerged openstack/puppet-tripleo master: Updates OpenDaylight HA Proxy backend check  https://review.openstack.org/57901100:19
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add network prefix configuration  https://review.openstack.org/58108300:19
openstackgerritMerged openstack/tripleo-heat-templates master: Update standalone role for a cloud  https://review.openstack.org/57586200:19
openstackgerritMerged openstack/tripleo-heat-templates master: standalone run a post config to generate a clouds.yaml  https://review.openstack.org/57559700:19
openstackgerritMerged openstack-infra/tripleo-ci master: Revert "Make tripleo-ci-centos-7-undercloud-oooq non-voting"  https://review.openstack.org/57625800:19
openstackgerritMerged openstack-infra/tripleo-ci master: Enable queens with scenario008  https://review.openstack.org/57899700:19
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: FFU: missing ironic tasks  https://review.openstack.org/58110300:19
*** agopi has quit IRC00:34
*** pradk has joined #tripleo00:39
openstackgerritVu Cong Tuan proposed openstack/instack master: Switch to stestr  https://review.openstack.org/58133300:39
*** moshele has quit IRC00:55
openstackgerritVu Cong Tuan proposed openstack/instack-undercloud master: Switch to stestr  https://review.openstack.org/58132700:57
*** psahoo has joined #tripleo00:59
*** rnoriega has quit IRC01:02
*** pliu has quit IRC01:04
*** aputtur has quit IRC01:04
*** lhinds has quit IRC01:04
*** edmondsw has joined #tripleo01:05
*** faceman has quit IRC01:05
*** yamahata has quit IRC01:08
*** edmondsw has quit IRC01:09
*** agopi has joined #tripleo01:12
*** pliu has joined #tripleo01:16
*** rnoriega has joined #tripleo01:16
*** faceman has joined #tripleo01:17
*** aputtur has joined #tripleo01:18
*** lhinds has joined #tripleo01:19
*** rpioso is now known as rpioso|afk01:19
*** Petersingh has joined #tripleo01:23
*** mrsoul has joined #tripleo01:30
*** mrsoul`` has joined #tripleo01:30
*** mrsoul` has quit IRC01:33
*** mschuppert has quit IRC01:33
*** Petersingh is now known as Petersingh|afk01:50
openstackgerritTony Breeds proposed openstack/python-tripleoclient master: Add support for configuring additional architectures for heat-based installs  https://review.openstack.org/58082702:05
openstackgerritTony Breeds proposed openstack/python-tripleoclient master: Handle mapping multiple heat parameters from one config option  https://review.openstack.org/58082802:05
openstackgerritTony Breeds proposed openstack/python-tripleoclient master: Always set a hardware architecture on uploaded images  https://review.openstack.org/58154502:05
*** psahoo has quit IRC02:09
*** Petersingh|afk is now known as Petersingh02:16
*** psahoo has joined #tripleo02:21
*** rh-jelabarre has joined #tripleo02:21
*** psahoo has quit IRC02:26
*** rlandy|bbl has quit IRC02:30
*** bkopilov has quit IRC02:35
*** psahoo has joined #tripleo02:40
*** rh-jelabarre has quit IRC02:42
*** skramaja has joined #tripleo02:46
openstackgerritAlex Schultz proposed openstack/tripleo-docs master: Update standalone documentation  https://review.openstack.org/58155202:49
*** skramaja has quit IRC02:51
*** edmondsw has joined #tripleo02:53
*** edmondsw has quit IRC02:57
*** noslzzp has quit IRC02:58
*** eck` is now known as eck`gone02:59
openstackgerritAlex Schultz proposed openstack/tripleo-docs master: Update standalone documentation  https://review.openstack.org/58155203:01
*** akrivoka has quit IRC03:02
*** akrivoka has joined #tripleo03:03
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Enforce use-heat=False on 3 jobs  https://review.openstack.org/58146803:15
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Reconfigure undercloud args for scenarios  https://review.openstack.org/57533003:16
*** tzumainn has quit IRC03:16
*** sshnaidm|bbl has quit IRC03:16
*** Petersingh is now known as Petersingh|afk03:16
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch 3nodes and scenario000-upgrades to containerized undercloud  https://review.openstack.org/57975503:17
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Enabling cont/uc on scenario001/002  https://review.openstack.org/58118303:17
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Remove --use-heat usage, as it's deprecated  https://review.openstack.org/58153403:17
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch 3nodes and scenario000-upgrades to containerized undercloud  https://review.openstack.org/57975503:19
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Enabling cont/uc on scenario001/002  https://review.openstack.org/58118303:20
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Remove --use-heat usage, as it's deprecated  https://review.openstack.org/58153403:20
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Enable Ansible pipelining for containerized undercloud & standalone  https://review.openstack.org/58155603:26
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Enable Ansible pipelining for containerized undercloud & standalone  https://review.openstack.org/58155603:27
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Enabling cont/uc on scenario001/002  https://review.openstack.org/58118303:28
EvilienMweshay: ^ pipelining everywhere it seems to improve a bit03:28
*** sshnaidm|bbl has joined #tripleo03:29
openstackgerritMerged openstack/os-collect-config master: Add region support  https://review.openstack.org/58055403:30
openstackgerritMerged openstack/tripleo-heat-templates master: Leave undercloud images locally after prepare  https://review.openstack.org/57825703:30
*** bfournie1 has quit IRC03:31
*** bfournie has joined #tripleo03:32
EvilienMalso that last patch should save us some seconds03:32
* EvilienM disappears03:37
*** med_ has quit IRC03:38
*** ramishra has joined #tripleo03:39
weshayEvilienM, /me looks03:39
*** cshastri has joined #tripleo03:40
*** udesale has joined #tripleo03:49
*** bkopilov has joined #tripleo03:55
*** ykarel|away has joined #tripleo03:56
*** pdeore has joined #tripleo03:57
*** ramishra has quit IRC03:59
*** ykarel|away is now known as ykarel04:00
*** zshi has quit IRC04:05
*** shreshtha_ has joined #tripleo04:08
*** shreshtha_ has quit IRC04:08
*** shreshtha has joined #tripleo04:09
*** mdnadeem has joined #tripleo04:16
*** ykarel is now known as ykarel|afk04:31
*** Petersingh|afk is now known as Petersingh04:32
*** ykarel|afk has quit IRC04:35
*** Petersingh is now known as Petersingh|afk04:42
*** ramishra has joined #tripleo04:51
*** kopecmartin has joined #tripleo04:56
*** links has joined #tripleo05:03
*** ykarel|afk has joined #tripleo05:03
*** Petersingh|afk is now known as Petersingh05:08
Tenguhello there :)05:12
*** psahoo has quit IRC05:15
*** hamzy has quit IRC05:17
*** ratailor has joined #tripleo05:18
*** rodolof has quit IRC05:22
*** dparkes has joined #tripleo05:22
*** moshele has joined #tripleo05:23
*** gvrangan has joined #tripleo05:30
*** colonwq has quit IRC05:31
*** colonwq has joined #tripleo05:33
*** yprokule has joined #tripleo05:33
*** janki has joined #tripleo05:37
*** hamzy has joined #tripleo05:40
*** moshele has quit IRC05:41
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: HA support for OpenShift  https://review.openstack.org/57960905:42
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: Replace raw_get with dict access syntax  https://review.openstack.org/57984305:42
*** holser_ has joined #tripleo05:44
*** ykarel|afk is now known as ykarel05:44
*** sai_p has quit IRC05:55
*** anande has joined #tripleo05:55
*** anande has quit IRC05:57
*** brault has quit IRC05:57
*** anande has joined #tripleo05:58
*** skramaja has joined #tripleo05:58
*** ianw is now known as ianw_pto06:00
*** hjensas has quit IRC06:01
*** jtomasek has quit IRC06:01
Tengufultonj: hello! while reviewing the BP for Rocky, I found this one: https://blueprints.launchpad.net/tripleo/+spec/osds-by-rule - no patch seems attached, is that right?06:02
*** zshi has joined #tripleo06:04
openstackgerritMerged openstack/diskimage-builder master: Update developing_elements  https://review.openstack.org/58071906:06
*** alee has quit IRC06:07
*** ksambor has joined #tripleo06:08
*** radeks has joined #tripleo06:11
*** jchhatbar has joined #tripleo06:14
*** pdeore_ has joined #tripleo06:16
*** quiquell has joined #tripleo06:16
*** pdeore has quit IRC06:17
*** Petersingh is now known as Petersingh|afk06:18
*** janki has quit IRC06:18
*** agurenko has joined #tripleo06:18
*** hamdyk has joined #tripleo06:19
*** mrsoul is now known as mschuppert06:20
*** florianf has quit IRC06:25
*** florianf has joined #tripleo06:25
*** cylopez has joined #tripleo06:27
*** hamzy has quit IRC06:27
*** hamzy_ has joined #tripleo06:27
*** brault has joined #tripleo06:31
openstackgerritTony Breeds proposed openstack/python-tripleoclient master: Always set a hardware architecture on uploaded images  https://review.openstack.org/58154506:32
*** ukalifon has joined #tripleo06:34
*** hamdykhader has joined #tripleo06:36
*** ffiore has joined #tripleo06:37
*** dhill_ has quit IRC06:39
*** udesale has quit IRC06:40
*** hamdyk has quit IRC06:40
*** lvdombrkr has joined #tripleo06:41
*** udesale has joined #tripleo06:42
*** Petersingh|afk is now known as Petersingh06:43
*** jfrancoa has joined #tripleo06:44
*** aufi has joined #tripleo06:45
hamdykhaderHi, we are deploying tripleO containerized NVME (cinder backend) but it fail at step 3 because of file not found (/etc/cinder/cinder.conf), any idea how to debug this issue?06:48
*** moshele has joined #tripleo06:49
*** mrunge_ is now known as mrunge06:50
*** dhill_ has joined #tripleo06:53
*** moshele has quit IRC06:57
*** psahoo has joined #tripleo06:57
*** alee has joined #tripleo06:59
*** ccamacho has joined #tripleo07:02
*** shardy has joined #tripleo07:02
*** psahoo has quit IRC07:02
*** shardy has quit IRC07:03
*** bogdando has joined #tripleo07:03
*** shardy has joined #tripleo07:04
*** alee has quit IRC07:04
*** alee has joined #tripleo07:05
*** zshi has quit IRC07:06
*** hjensas has joined #tripleo07:10
*** hjensas has quit IRC07:10
*** hjensas has joined #tripleo07:10
shardyd0ugal: Hey can you revisit https://review.openstack.org/#/c/578759/ and the other patches in that series when you have time please?07:12
*** tesseract has joined #tripleo07:12
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: use undercloud registry for ceph_namespace in overcloud image prepare  https://review.openstack.org/58160707:12
chkumar|ruckykarel: ^^07:14
ykarelchkumar|ruck, not sure if defaults need to be changed in ^^07:14
ykarelmay be local registry is not set always07:14
ykareland can be at different address07:14
chkumar|ruckykarel: in standalone it is also docker.io/ceph https://github.com/openstack/tripleo-quickstart-extras/blob/46597925da2228f9a8cc276cc9fa9c4e808c54d7/roles/standalone/templates/standalone_config.yaml.j2#L707:16
*** peereb has joined #tripleo07:17
ykarelyup it's as per requirement and can be different, so default should not be changed, if change then all use cases should be considered07:17
ykareland i am not aware of all of that :)07:17
*** psahoo has joined #tripleo07:18
*** gkadam has joined #tripleo07:20
openstackgerritMerged openstack/diskimage-builder master: Add new modprobe element  https://review.openstack.org/57717007:21
openstackgerritBogdan Dobrelya proposed openstack/tripleo-common master: Use oslo log for image_uploader as a library  https://review.openstack.org/58123107:21
*** jcoufal has joined #tripleo07:25
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Log more details for container images prepare  https://review.openstack.org/58095907:26
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates stable/queens: Add environment/services-baremetal/*.  https://review.openstack.org/56779707:32
*** rodolof has joined #tripleo07:34
*** amoralej|off is now known as amoralej07:34
*** tosky has joined #tripleo07:37
*** jchhatbar has quit IRC07:40
*** janki has joined #tripleo07:40
*** cmyster has quit IRC07:43
*** holser_ has quit IRC07:43
*** rodolof has quit IRC07:44
*** ykarel is now known as ykarel|lunch07:49
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Fix variables interpolation for included roles  https://review.openstack.org/58161207:51
openstackgerritBogdan Dobrelya proposed openstack/ansible-role-container-registry master: Improve docker/distribution reload handlers  https://review.openstack.org/58104907:52
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: QDR for metrics collection purposes  https://review.openstack.org/57231207:53
*** jpich has joined #tripleo07:56
*** anande has quit IRC07:57
*** holser_ has joined #tripleo07:57
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO  https://review.openstack.org/56722408:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044508:00
*** rcernin has quit IRC08:03
*** rodolof has joined #tripleo08:04
*** itlinux has joined #tripleo08:05
itlinuxhello has anyone tried the OOO DVR config08:07
itlinuxjust wonder if I need to be aware on anything..08:07
itlinuxor just use the yaml08:07
sri_itlinux, environments/neutron-ovs-dvr.yaml that's it.08:15
itlinuxsri_: should that be before the network iso or before?08:15
itlinuxor does not matter the order08:15
sri_itlinux, I don't think order matter,  i am not sure tho08:16
itlinuxok thanks08:19
sri_np08:20
*** derekh has joined #tripleo08:21
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Report ansible errors in json file for standalone  https://review.openstack.org/58162308:24
holser_bogdando here?08:25
*** paramite has joined #tripleo08:27
*** Petersingh is now known as Petersingh|afk08:32
*** shreshtha has quit IRC08:35
*** shreshtha_ has joined #tripleo08:35
*** morenod has joined #tripleo08:36
*** itlinux has quit IRC08:37
*** panda|off is now known as panda08:40
openstackgerritQuique Llorente proposed openstack/tripleo-common master: Configure ARA in ansible action  https://review.openstack.org/56507708:43
*** bkopilov has quit IRC08:44
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Report ansible errors in json file for standalone  https://review.openstack.org/58162308:44
*** Petersingh|afk is now known as Petersingh08:44
*** Petersingh is now known as Petersingh|lunch08:45
*** quiquell is now known as alfread08:47
*** alfread is now known as quiquell08:47
*** ykarel|lunch is now known as ykarel08:47
flaper8766.187.229.139 doesn't seem to be working for me. Is this a known issue?08:49
*** gvrangan has quit IRC08:50
*** jtomasek has joined #tripleo08:51
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Fix stackviz installation  https://review.openstack.org/58036108:51
*** suuuper has joined #tripleo08:51
*** pblaho has joined #tripleo08:53
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates master: Decrease steps for Swift containers.  https://review.openstack.org/58163008:55
*** itlinux has joined #tripleo08:55
itlinuxsri_: have you experience any issue with the DVR? Or it's pretty stable? Thanks08:55
shardyMorning all, need another review on https://review.openstack.org/#/c/578759/ if anyone has a moment, simple workflow addition to tripleo-common09:00
openstackgerritMerged openstack/tripleo-docs master: Developer docs for updates  https://review.openstack.org/57806909:00
*** gvrangan has joined #tripleo09:02
*** gvrangan has quit IRC09:03
*** gvrangan has joined #tripleo09:04
*** gvrangan has quit IRC09:05
*** gvrangan has joined #tripleo09:06
*** gvrangan has quit IRC09:07
*** avivgt has joined #tripleo09:07
*** cmyster has joined #tripleo09:08
*** cmyster has joined #tripleo09:08
*** gvrangan has joined #tripleo09:08
*** Goneri has joined #tripleo09:09
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP Enforce proper ordering when applying firewall rules  https://review.openstack.org/58163409:09
*** Petersingh|lunch is now known as Petersingh09:15
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: Update rdocloud env: boot_from_volume not required  https://review.openstack.org/58164009:17
flaper87shardy: 66.187.229.139 <- does this work for you?09:18
* flaper87 is trying to rebuild is undercloud09:18
ykarelratailor, ^^ same u faced09:19
ratailorykarel, yea. I used master release in that case.09:20
shardyflaper87: No it's unreachable for me09:24
flaper87darn09:24
flaper87:(09:24
flaper87there goes my hope of having a new undercloud this morning09:24
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Add a networking check for OpenShift on OpenStack  https://review.openstack.org/58164409:29
*** Petersingh is now known as Petersingh|mtg09:31
ykarelflaper87, i think this should work:- overcloud_image_url: https://images.rdoproject.org/master/rdo_trunk/current-tripleo/overcloud-full.tar and overcloud_image_url: https://images.rdoproject.org/master/rdo_trunk/current-tripleo/overcloud-full.tar09:32
flaper87ykarel: thanks09:32
flaper87ykarel: mmh, I think you pasted the same thing twice (overcloud_image_url)09:33
flaper87I guess you meant one of those to be the md509:33
ykarelflaper87, sorry ipa_image_url: https://images.rdoproject.org/master/rdo_trunk/current-tripleo/ironic-python-agent.tar09:34
*** ukalifon has quit IRC09:34
flaper87ykarel: thanks09:34
sri_itlinux, I didn't face any issues but I've only tested in my dev env, the only thing is when we have HA setup and enable DVR, networkL3HA disable by default09:35
*** ukalifon has joined #tripleo09:38
*** hamdykhader has quit IRC09:38
*** hamdyk has joined #tripleo09:39
*** gvrangan_odl has joined #tripleo09:39
*** gvrangan_odl has quit IRC09:40
*** gvrangan_odl has joined #tripleo09:41
*** gvrangan has quit IRC09:41
*** gvrangan_odl has quit IRC09:42
*** gvrangan_odl has joined #tripleo09:43
*** gvrangan_odl has quit IRC09:44
*** gvrangan_odl has joined #tripleo09:44
*** sshnaidm|bbl is now known as sshnaidm|rover09:45
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: FFU Create cell0 db points to the nova-api bootstrap node.  https://review.openstack.org/58136109:52
itlinuxok.. which should be fine since the floating IP goes to the Hypervisor..09:52
itlinuxso you have one or the either is my understanding09:52
openstackgerrityatin proposed openstack-infra/tripleo-ci master: WIP: run repo-setup in pre (and then being able to deploy pkgs in pre)  https://review.openstack.org/58113109:52
itlinuxsri_:09:53
*** assassin has joined #tripleo09:56
*** spsurya_ has joined #tripleo10:09
sri_itlinux, it's up to our environment, we can also have both by enableing l3ha,exp: parameter_defaults: NeutronL3HA: true10:13
itlinuxok I get this error now.. http://paste.openstack.org/show/725547/10:16
openstackgerritQuique Llorente proposed openstack/tripleo-common master: Configure ARA in ansible action  https://review.openstack.org/56507710:18
*** moshele has joined #tripleo10:18
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Collect overcloud statistics with ARA  https://review.openstack.org/57846210:19
sri_itlinux, i think before mitaka release we can't use l3 ha with dvr it's not possible on neutron leval , form newton we can use l3 ha with (snat ha) dvr10:19
openstackgerritQuique Llorente proposed openstack/tripleo-common master: Configure ARA in ansible action  https://review.openstack.org/56507710:19
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: Bump ARA version to 0.15.0  https://review.openstack.org/58098810:19
itlinuxok I am using Pike now. sri_:10:20
*** moshele has quit IRC10:21
* bogdando summons deployment framework yaql ninjas https://review.openstack.org/#/c/581630/10:22
sri_itlinux, ok, regarding your error message, I'm also new here so i might not be the right person10:22
*** waleedm has joined #tripleo10:27
*** pradk has quit IRC10:27
openstackgerritQuique Llorente proposed openstack/tripleo-common master: Configure ARA in ansible action  https://review.openstack.org/56507710:29
*** bkopilov has joined #tripleo10:31
Tenguthank you bogdando for the doc approval :).10:35
*** psachin has joined #tripleo10:35
openstackgerritMerged openstack/tripleo-docs master: Added information regarding system's clock - must be set to UTC  https://review.openstack.org/58109010:36
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Use toci scripts as templates for zuulv3  https://review.openstack.org/58133110:37
chkumar|rucksshnaidm|rover: logs.openstack.org/85/564285/29/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/003d01b/logs/undercloud/var/log/maistral/ceph-install-workflow.log.txt.gz#_2018-07-11_01_26_34_12510:38
chkumar|ruckit comes on stable/pike noop job10:38
chkumar|rucksshnaidm|rover: related to this bz https://bugs.launchpad.net/tripleo/+bug/175287410:38
openstackLaunchpad bug 1752874 in tripleo ""Get https://registry-1.docker.io/v2/: dial tcp: lookup registry-1.docker.io on 127.0.0.1:53: server misbehaving" while Trying to pull repository docker.io/ceph/daemon " [Critical,Fix released] - Assigned to John Trowbridge (trown)10:38
*** yprokule has quit IRC10:39
bogdandohttps://review.openstack.org/#/c/572404/ thingy is good to go again!10:41
bogdandoany cores around?10:41
openstackgerritAna Krivokapic proposed openstack/tripleo-common master: Add support for custom validations  https://review.openstack.org/56951310:43
chkumar|rucksshnaidm|rover: i have proposed a patch for that also https://review.openstack.org/581607 I am not sure it is the correct change please have a look10:43
sshnaidm|roverchkumar|ruck, the log you pasted doesn't open10:43
chkumar|rucksshnaidm|rover: http://logs.openstack.org/85/564285/29/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/003d01b/logs/undercloud/var/log/mistral/ceph-install-workflow.log.txt.gz10:45
sshnaidm|roverchkumar|ruck, yeah, but jobs fail in your patch10:46
sshnaidm|roverchkumar|ruck, did you check it?10:46
chkumar|rucksshnaidm|rover: Could not pull image 192.168.24.1:8787/ceph/daemon10:47
chkumar|rucksshnaidm|rover: http://logs.openstack.org/07/581607/1/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/8d71fb3/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz#_2018-07-11_08_22_2010:47
chkumar|rucksshnaidm|rover: I think it is not built in undercloud registry that's why they pull from docker.io/ceph10:47
*** Guest67898 is now known as rook10:48
*** Petersingh|mtg is now known as Petersingh10:49
*** aufi_ has joined #tripleo10:49
*** Petersingh is now known as Petersingh|away10:51
*** aufi has quit IRC10:52
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Move echo_vars_to_deploy_env_oooq to oooq_common_functions.sh  https://review.openstack.org/58166810:52
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Use toci scripts as templates for zuulv3  https://review.openstack.org/58133110:57
*** morazi has quit IRC10:59
openstackgerrityatin proposed openstack-infra/tripleo-ci master: WIP: run repo-setup in pre (and then being able to deploy pkgs in pre)  https://review.openstack.org/58113110:59
jistrthanks ykarel, i was facing the same issue with unreachable images, and the URLs you suggested seem to work11:00
ykareljistr, cool11:00
*** psahoo has quit IRC11:01
ykareljistr, i had a query around ffu, how it's being tested in oooq and where?11:04
ykarelis queens-undercloud-newton-overcloud release used?11:05
jistrykarel: yes i think that release file is used11:09
*** atoth has quit IRC11:09
jistrykarel: the automation code is here https://github.com/openstack/tripleo-upgrade/tree/master/tasks11:09
jistrand the FFU featureset is https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset036.yml11:09
jistri'm not sure where it's running though. I don't think we have it as a non-voting job. Maybe experimental?  cc jfrancoa chem11:10
ykareljistr, it's non-voting in tripleo-upgrade, found https://logs.rdoproject.org/61/581161/1/openstack-check/legacy-tripleo-ci-centos-7-multinode-1ctlr-featureset036-oc-ffu-queens/6979206/job-output.txt.gz11:11
jistrah cool11:11
ykareljistr, actually i was facing issue while trying libvirt deployment11:14
ykarelissue was mismatch of active kernel and openvwitch modules installed11:15
ykarelso openvswitch and ovs-vswitcd not started11:15
*** Petersingh|away has quit IRC11:15
*** zshi has joined #tripleo11:15
ykarelissue was libvirt specific, so wanted to check if it's being tested somewhere(upstream/downstream)11:16
ykarellibvirt deployment specific11:16
*** bfournie has quit IRC11:18
jistrykarel: in what phase of FFU? initial deployment of Newton, or some time later?11:18
*** bfournie has joined #tripleo11:18
*** bfournie has quit IRC11:18
ykareljistr, undercloud installation11:18
*** pdeore_ has quit IRC11:18
jistrykarel: of Newton undercloud?11:19
ykarelqueens undercloud11:19
*** shreshtha_ has quit IRC11:20
*** maufart__ has joined #tripleo11:20
jistrhm that's quite strange. If that was broken, i guess all of our Queens jobs should be down, as that doesn't sound specific to FFU.11:20
*** shreshtha_ has joined #tripleo11:20
jistrbut they're on multinode, so deployed-server, not via Nova+Ironic+Libvirt11:21
ykareljistr, yes correct11:21
jistrsocial, holser_ ^ does that ring a bell? OVS vs. kernel mismatch on Queens undercloud11:22
*** aufi_ has quit IRC11:23
holser_jistr let me read up11:23
holser_ykarel - do you mean undercloud upgrade?11:24
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Remov common_functions.sh  https://review.openstack.org/58166811:25
*** aufi_ has joined #tripleo11:25
holser_FFW = newton to queens11:25
holser_first undercloud, then overcloud11:25
ykarelholser_, bash quickstart.sh --no-clone -R queens-undercloud-newton-overcloud $VIRTHOST, undercloud fails, openvswitch not started11:26
holser_ykarel - than it's not FFU11:27
*** pradk has joined #tripleo11:27
*** maufart__ has quit IRC11:27
holser_Well, it can be used as FFU upgraded undercloud, but still11:27
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Remov common_functions.sh  https://review.openstack.org/58166811:28
holser_ykarel - it's related to standard queens undercloud deployment11:28
ykarelholser_, ack will check by trying different release11:28
itlinuxsri_: where do to place the NeutronL3HA: true option?11:29
*** udesale has quit IRC11:29
itlinuxcan I just do something like this:11:30
itlinuxhttp://paste.openstack.org/show/725551/11:30
sri_itlinux, that looks ok11:32
*** ramishra has quit IRC11:32
holser_ykarel - try different release11:32
openstackgerritDavid proposed openstack/tripleo-quickstart master: Add doc about to delete ~/.quickstart directory before re-running quickstart.sh  https://review.openstack.org/58169311:32
ykarelholser_, yup trying -R queens11:33
itlinuxthanks11:33
EvilienMhi11:36
*** ansmith has quit IRC11:36
*** EvilienM is now known as EmilienM11:36
*** leanderthal has joined #tripleo11:37
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Fix tempestmail regex  https://review.openstack.org/58169511:39
EmilienMparamite: any chance to look at the telemetry healthchecks?11:40
paramiteEmilienM, yup, I have fix for statsd, working on ceilometer_ipmi now11:42
paramiteEmilienM, regarding sensu, it won't be that easy, check my comment in the bug11:43
paramiteEmilienM, if we want to keep sensu in scenario job, we would need to implement default connection to overcloud rabbit instance if external rabbit connection is not provided11:44
*** ramishra has joined #tripleo11:44
EmilienMparamite: then remove it if not possible asap11:45
EmilienMwe can re-add it later11:45
bogdandowhat I nice ansible bug https://bugs.launchpad.net/tripleo/+bug/1781198 :)11:45
openstackLaunchpad bug 1781198 in tripleo "Ansible docker/registry role tasks are included with "weakly scoped" values for variables" [High,Triaged]11:45
bogdandogoing to report it there now...11:45
EmilienMbogdando: I agree with you on https://review.openstack.org/#/c/581556/2/tripleoclient/v1/tripleo_deploy.py11:46
bogdandoso I'm going to use set_facts until it is fixed, see https://review.openstack.org/#/q/topic:reload_handlers+(status:open+OR+status:merged)11:46
EmilienMbogdando: I prefer your patch11:46
bogdandoEmilienM: ack, thanks!11:46
paramiteEmilienM, ack11:46
bogdandoEmilienM, mwhahaha, shardy: PTAL https://review.openstack.org/#/c/572404/11:47
bogdandoit's been ready to go for quite a while ...11:47
bogdandorebasing/rechecking all of that11:47
bogdandolet's please merge it11:47
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Dropped "command: hiera -c" in favor of ansible native hiera lookup  https://review.openstack.org/58169611:47
*** pchavva has joined #tripleo11:48
bogdandoalso PTAL https://review.openstack.org/#/q/topic:verbose-prepare+(status:open+OR+status:merged)11:49
EmilienMbogdando: will look asap11:49
*** bfournie has joined #tripleo11:49
*** abishop has joined #tripleo11:49
*** rh-jelabarre has joined #tripleo11:49
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Use toci scripts as templates for zuulv3  https://review.openstack.org/58133111:50
openstackgerritMarios Andreou proposed openstack/tripleo-quickstart-extras master: [DNM] skeleton ci sprint 16 design tripleo.sh bootstrap ansible  https://review.openstack.org/58102611:54
*** rfolco has joined #tripleo11:55
*** gvrangan_odl has quit IRC11:55
*** maufart__ has joined #tripleo11:56
*** morazi has joined #tripleo11:56
*** panda is now known as panda|lunch11:57
fultonjTengu: regarding https://blueprints.launchpad.net/tripleo/+spec/osds-by-rule, it was delayed pending ceph-ansible support (hence no pathc) and so it was pushed out to stein; ceph-ansible had something like this in the works, but they scrapped it to take a diff approach and the feature "choose-disk" isn't yet supported.11:57
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Report ansible errors in json file for standalone  https://review.openstack.org/58162311:57
Tengufultonj: ok :)11:58
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Report ansible errors in json file for standalone  https://review.openstack.org/58162311:58
*** aufi_ has quit IRC11:59
lhindsredrobot: are you taking the sec squad meeting?12:00
lhinds#startmeeting Security Squad12:01
openstackMeeting started Wed Jul 11 12:01:32 2018 UTC and is due to finish in 60 minutes.  The chair is lhinds. Information about MeetBot at http://wiki.debian.org/MeetBot.12:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.12:01
*** openstack changes topic to " (Meeting topic: Security Squad)"12:01
openstackThe meeting name has been set to 'security_squad'12:01
moguimaro/12:02
lhindswait for a quorum12:02
lhindshey moguimar12:02
moguimarhi lhinds12:02
*** raildo has joined #tripleo12:02
lhinds  moguimar , let's wait until XX:05 and if no more are here, we can just do topics of interest to us.12:04
moguimarok12:04
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Use toci scripts as templates for zuulv3  https://review.openstack.org/58133112:05
lhindsk, just me and you moguimar12:05
lhindsanything you wanted to update on moguimar ?12:05
moguimarjust the plaintext secrets work12:05
lhinds#topic plain secrets work12:06
moguimarwe're almost geting phase-0 merged into rocky12:06
*** openstack changes topic to "plain secrets work (Meeting topic: Security Squad)"12:06
raildoo/12:06
moguimarit is 99% done12:06
moguimarhi raildo12:06
moguimaronly waiting a few reviews and +w12:06
lhindssounds good!12:06
lhindsdo you have the reviews in the etherpad?12:06
moguimarthen phase-1 is castellan integration, backed by hashicorp vault12:06
moguimar#link https://review.openstack.org/#/q/status:open+project:openstack/oslo.config+branch:master+topic:bp/oslo-config-drivers12:07
moguimar#link https://etherpad.openstack.org/p/oslo-config-plaintext-secrets12:07
moguimarand phase-2 will be finally triple-o integration12:08
lhindscool! it's going well then12:09
lhindsanything else moguimar ?12:09
moguimarnope12:09
moguimaranything to add on that raildo?12:09
lhinds#topic limit sudo use12:10
*** openstack changes topic to "limit sudo use (Meeting topic: Security Squad)"12:10
redroboto/12:10
lhindsI could really use some eyes on the following spec:12:10
raildonothing from my side at this point, you gave a great summary12:10
lhinds#link  https://review.openstack.org/#/c/572760/12:10
lhindsif anyone could add thoughts / reviews that would be great12:10
lhindsother than the above, that's it for me.12:11
raildoI added myself, I'll review it later12:11
lhindsthanks raildo12:11
lhinds#topic any other business?12:11
*** openstack changes topic to "any other business? (Meeting topic: Security Squad)"12:11
moguimarnot on my end12:11
raildonope12:12
lhindscool, i think we can close then.12:12
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Fix stackviz installation  https://review.openstack.org/58036112:12
lhindsthanks all12:12
lhinds#endmeeting12:12
*** openstack changes topic to "Welcome to Rocky. CI status: GREEN | https://docs.openstack.org/tripleo-docs/latest"12:12
*** atoth has joined #tripleo12:12
openstackMeeting ended Wed Jul 11 12:12:58 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)12:13
openstackMinutes:        http://eavesdrop.openstack.org/meetings/security_squad/2018/security_squad.2018-07-11-12.01.html12:13
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/security_squad/2018/security_squad.2018-07-11-12.01.txt12:13
openstackLog:            http://eavesdrop.openstack.org/meetings/security_squad/2018/security_squad.2018-07-11-12.01.log.html12:13
redrobotThat was a fast one.  Thanks lhinds!12:14
*** tzumainn has joined #tripleo12:14
lhindshey redrobot , did you have any topics?12:14
redrobotlhinds, nope, nothing on my end.  Just getting back from vacation so I don't have much to talk about today.12:15
lhindsah cool, nice to have you back redrobot12:15
lhindsredrobot: I think oz is back next week?12:15
redrobotlhinds, yep, I think so.12:16
lhindsredrobot: me too. he can take the reigns again nect week12:17
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Use toci scripts as templates for zuulv3  https://review.openstack.org/58133112:19
*** amoralej is now known as amoralej|lunch12:20
*** agopi has quit IRC12:21
*** dprince has joined #tripleo12:26
itlinuxsri_: hi can you confirm that the IP with DVR will be on the Hypervisor? Thanks12:27
Tengulhinds: hello! care to have another look for the dreadful oslo.privsep integration spec? https://review.openstack.org/580033  - also, do you want me to do anything with the other one, for "sudo"?12:27
Tengulhinds: note: I've updated the BP with correct links to the two reviews.12:27
*** edmondsw has joined #tripleo12:27
*** rlandy has joined #tripleo12:30
*** udesale has joined #tripleo12:31
*** ohochman has joined #tripleo12:34
*** udesale_ has joined #tripleo12:35
*** udesale_ has quit IRC12:36
*** udesale has quit IRC12:36
sri_itlinux, sorry i didn't understand your question !12:38
itlinuxmy understanding is that the floating IP should go to the Hypevisors12:38
sri_itlinux, yes12:38
itlinuxand not stay on the controller..12:38
*** morenod has quit IRC12:39
itlinuxI did an update I see the dvr being set but I do not see the IP on the hypervisor ..12:39
itlinuxso I may have to redeploy from the beginning..12:39
itlinuxnot sure..12:39
sri_it's inside the fip namespace12:39
itlinuxsince I do not see the IP12:39
itlinuxwell ip netns there is nothing on the hypervisor..12:40
itlinuxam I missing something?12:40
itlinuxnot sure how to eval the ftp?12:40
itlinuxalso doing an update since the HA did not get set..12:40
openstackgerritMerged openstack/python-tripleoclient master: Switch --use-heat to take a boolean and deprecate it  https://review.openstack.org/58146712:40
openstackgerritMerged openstack/tripleo-common master: ansible: enable pipelining  https://review.openstack.org/58136212:40
itlinuxso working to set that up aswll.12:40
mandreEmilienM: can we add tripleo cores to ansible-role-tripleo-modify-image? atm I think it's just you and stevebaker12:41
EmilienMoops12:41
EmilienMof course12:41
EmilienMdoing it now12:41
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Fix variables interpolation for included roles  https://review.openstack.org/58161212:41
mandreEmilienM: thanks!12:41
EmilienMmandre: done!!12:41
EmilienMdon't break it!12:41
mandreperfect, thanks!12:42
sri_itlinux, i see, just for reference  https://assafmuller.com/category/dvr/12:42
openstackgerritFlavio Percoco proposed openstack-infra/tripleo-ci master: Move scenario009 to the check queue  https://review.openstack.org/58171412:43
openstackgerritBogdan Dobrelya proposed openstack/ansible-role-container-registry master: Improve docker/distribution reload handlers  https://review.openstack.org/58104912:43
*** med_ has joined #tripleo12:43
*** med_ has quit IRC12:43
*** med_ has joined #tripleo12:43
*** mcornea has joined #tripleo12:46
EmilienMmcornea: hey, I might use your help 5 min12:47
mcorneaEmilienM: hey, sure, what's up?12:48
EmilienMI'm looking why https://review.openstack.org/#/c/576218/ fails on upgrade jobs, while https://review.openstack.org/#/c/579755 is supposed to configure the undercloud correctly. I wonder if I missed a specific ansible param from tripleo-upgrades12:48
itlinuxsri_: so is there a namespace on the hypervisor?12:48
EmilienMhttp://logs.openstack.org/55/579755/11/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/b882011/logs/undercloud/home/zuul/undercloud_install.log.txt.gz12:48
sri_itlinux, yes12:49
EmilienMmcornea: my question for you is:12:49
EmilienMmcornea: are we supposed to deploy a queens or rocky undercloud in this job?12:49
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Remove dependecy on common_functions.sRemove dependecy on common_functions.shh  https://review.openstack.org/58166812:49
itlinuxok I do not have any overcloud hypervisor namespace on the compute nodes..12:49
itlinuxuhm!12:49
mcorneaEmilienM: looking12:49
sri_itlinux, that's only showup when you add a floating ip to the instance12:49
itlinuxI did..12:50
itlinuxI added the floating to the vm checked with VM has it..12:50
itlinuxand see when there..12:50
sri_bfournie, quick question does undercloud need match the network setup with overcloud ? my overcloud failing with error message that it's not able to ping the overcloud node with internal network12:52
mcorneaEmilienM: afaik, this upgrade job should deploy rocky undercloud with queens overcloud and upgrade the overcloud, jfrancoa can you pls confirm?12:53
*** panda|lunch is now known as panda12:53
EmilienMmhh12:53
*** jchhatbar has joined #tripleo12:53
jistrfultonj: thanks for the feedback on the updates/upgrades suggestion12:54
*** trown|outtypewww is now known as trown12:55
fultonjjistr: np, thanks for the wip!12:55
*** janki has quit IRC12:55
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Enabling cont/uc on scenario001/002  https://review.openstack.org/58118312:55
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Remove --use-heat usage, as it's deprecated  https://review.openstack.org/58153412:55
*** ansmith has joined #tripleo12:55
jfrancoaEmilienM: mcornea: checking the job, give me a minute12:55
sri_itlinux, can you check neutron.conf for "router_distributed = True" and l3_agent.ini for "agent_mode = dvr_snat"12:55
itlinuxthose are on the controllers what do you have on the compute nodes?12:56
EmilienMjfrancoa, mcornea: sounds like THT is too old in this job (maybe from queens?)12:56
*** med_ has quit IRC12:56
sri_itlinux,  controllers12:56
jfrancoaEmilienM: I believe we are deploying master undercloud and queens overcloud in this upgrades job, unless this changed recently12:57
*** eck`gone is now known as eck`12:58
EmilienMjfrancoa: mhh something is wrong in the undercloud rpms for this job then12:59
EmilienMjfrancoa: the containerized undercloud fails to deploy12:59
* bogdando sigh13:00
EmilienMopenstack-tripleo-heat-templates-9.0.0-0.20180711002944.9a49791.el7.noarch is deployed13:00
EmilienMit's good, weird13:00
* EmilienM will look later13:00
*** skramaja has quit IRC13:01
*** openstack has joined #tripleo13:03
*** ChanServ sets mode: +o openstack13:03
*** agurenko has quit IRC13:03
itlinuxI may have to restart the neutron services.. I do see the changes in neutron.conf and the L313:03
sshnaidm|roverslagle, EmilienM re: ara on overcloud, I totally agree with issues in https://review.openstack.org/#/c/565077/14/tripleo_common/actions/ansible.py   but I don't know how to pass through arguments in tripleoclient, I'm not familiar with its codebase. I need somebody to walk me through it  Otherwise we are stuck on that and don't have overcloud statistics13:03
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: [DNM] WIP: Replace TOCI_JOBTYPE env variable  https://review.openstack.org/58143113:04
*** lifeless has quit IRC13:04
*** agurenko has joined #tripleo13:05
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: [WIP]Fluentd: add ovn-dbs logging path  https://review.openstack.org/58173113:06
jfrancoaEmilienM: yes, it's what I am checking...by the way, where is this tripleo-heat-installer-templates directory installed from?13:06
sri_bfournie, never mind, ping is disable to my defalut gateway that's why it field13:07
bfourniehi sri_, great, was just responding, glad you found it13:09
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP Enforce proper ordering when applying firewall rules  https://review.openstack.org/58163413:09
*** janki has joined #tripleo13:09
*** jchhatbar has quit IRC13:09
*** yrabl has joined #tripleo13:10
*** amoralej|lunch is now known as amoralej13:13
*** itlinux has quit IRC13:14
*** med_ has joined #tripleo13:14
*** med_ has joined #tripleo13:14
slaglesshnaidm|rover: have a look at how we handle things like --skip-deploy-identifier13:15
slaglesshnaidm|rover: that is pretty much a straight passthrough from the client to the workflow to the action13:15
slaglesshnaidm|rover: i'm thinking something similar for toggling ara13:15
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Prevent triggerring firewall actions in init_bundle  https://review.openstack.org/58174013:16
*** spsurya_ has quit IRC13:18
*** mjturek has joined #tripleo13:19
*** marrusl has quit IRC13:20
sshnaidm|roverslagle, should I use workflow for that? or I can pass it to AnsibleAction? or to AnsiblePlaybookAction? what is the difference?13:21
sri_bfournie, :)13:23
slaglesshnaidm|rover: it has to go through the workflow since that is what is called from tripleoclient13:23
sshnaidm|roverslagle, which workflow should I use? deployment.py?13:26
slaglesshnaidm|rover: yes13:26
sshnaidm|roverslagle, and what is difference between AnsibleAction and AnsiblePlaybookAction?13:26
slagleone calls ansible, and the other calls ansible-playbook13:27
sshnaidm|roverslagle, do we use both and when? so we need to enable ara for both of them, right?13:30
slaglesshnaidm|rover: i'm not sure if both are used across all of TripleO. deployment only uses AnsiblePlaybookAction13:31
*** agurenko has quit IRC13:32
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: [WIP]Fluentd: Set cinder-backup log path  https://review.openstack.org/58143913:33
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: [DNM][WIP] Pass the deploy_type  https://review.openstack.org/58174613:34
openstackgerritDerek Higgins proposed openstack/tripleo-quickstart master: [WIP] Add featureset 054 - overcloud baremetal+ansible-ml2  https://review.openstack.org/57960113:35
*** ohochman has quit IRC13:35
*** cylopez has left #tripleo13:35
*** agopi has joined #tripleo13:37
*** morenod has joined #tripleo13:38
*** ramishra has quit IRC13:38
*** ratailor has quit IRC13:39
dalvarezccamacho: EmilienM folks do we need something for this https://review.openstack.org/#/c/571130/ to be merged?13:42
dalvarezbeagles: ^13:42
*** morenod has left #tripleo13:42
*** yprokule has joined #tripleo13:42
ccamachoerrgggh is not in the gate13:43
beagleswow that's weird13:43
dalvarezbeagles: :( sigh13:43
dalvarezi will give up with this one :p13:43
dalvarezso painful13:43
dalvarezdependent patches are merged13:43
dalvarezccamacho: it got +2 from zuul13:44
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP rate limit iptables logging  https://review.openstack.org/58174813:45
*** mdnadeem has quit IRC13:46
openstackgerritDaniel Alvarez proposed openstack/puppet-tripleo stable/queens: Adding wrapper script for haproxy in OVN metadata agent  https://review.openstack.org/58174913:47
openstackgerritDaniel Alvarez proposed openstack/tripleo-common stable/queens: Add docker packages to OVN metadata agent container  https://review.openstack.org/58175013:47
*** lifeless has joined #tripleo13:47
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: [DNM][WIP] Pass the deploy_type  https://review.openstack.org/58174613:48
bogdandoEmilienM, mwhahaha, shardy, dprince: : PTAL https://review.openstack.org/#/c/567797/, the next step for the container-defaults switching13:49
bogdando(backports)13:50
*** psachin has quit IRC13:51
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: [DNM] WIP: Replace TOCI_JOBTYPE env variable  https://review.openstack.org/58143113:53
EmilienMdalvarez: it's because https://review.openstack.org/#/c/581749/ hasn't merged13:54
EmilienMdalvarez: if you waited to propose the backport it would have merged :-)13:54
EmilienMdalvarez: so now, remove the depends-on, and we'll re-approve13:54
dalvarezEmilienM: nono i just proposed this one13:54
EmilienMand don't give up plz :)13:54
dalvarezhehe13:54
dalvarezEmilienM: i just did it, must be something else13:55
EmilienMdalvarez: anyway, *now* it can't merge13:55
EmilienMbecause of the depends-on13:55
dalvarezEmilienM: but that change id is also for the master branch13:55
dalvarezEmilienM: if i abandon the queens patch it won't merge cause i ran into this twice before proposing the patch (which i just did)13:56
mwhahahayou should wait until everything merges in master before backporting13:56
mwhahahais a good practice to prevent this13:56
dalvarezmwhahaha: ack let me abandon them sorry13:56
EmilienMyes that ^ also13:56
*** jistr is now known as jistr|mtg13:56
EmilienMno, don't abandon13:56
dalvarezmwhahaha: but still that ain't the reason IMHO13:56
EmilienMREMOVE DEPENDSON !!13:56
EmilienMthe patch on master was merged, you don't need depends-on anymore13:57
dalvarezmwhahaha: btw the ones i backported are merged13:57
dalvarezEmilienM: ^13:57
EmilienMjfrancoa: sorry, was in a meeting. I'm not sure what's missing yet13:57
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: [DNM] Try to copy the inventory into undercloud to have it on playbooks  https://review.openstack.org/58175513:58
mwhahahadalvarez: https://review.openstack.org/#/c/571130/ is based on an old patch, it needs to be rebased14:00
mwhahahadalvarez: but the problem is you cherry-picked the stable queens stuff so it won't merge until you remove the depends-on14:01
dalvarezmwhahaha: now i get this but i mean that it wasn't getting merged before i even cherry picked14:01
dalvarezi'll remove the depends-on straight away14:01
mwhahahadalvarez: right because it wasn't rebased on the latest version of https://review.openstack.org/#/c/574472/14:01
mwhahahadalvarez: so there are two problems here14:01
dalvarezmwhahaha: ack all clear now14:02
mwhahahadalvarez: 1) the parent was old (so it didn't merge)14:02
dalvarezthanks14:02
jfrancoaEmilienM: I was investigating a little too, but I couldn't spot anything. the tht version is slightly different in the upgrades job compared to other jobs like tripleo-ci-centos-7-undercloud-containers, but I don't think that could have anything to do14:02
dalvarezmwhahaha++14:02
dalvarezthanks golks14:02
dalvarezfolks*14:02
mwhahahaand 2) the depends on are now active14:02
dalvarez:D14:02
mwhahahaenjoy :D14:02
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: [DNM][WIP] Pass the deploy_type  https://review.openstack.org/58174614:02
mwhahahai'll add myself to review so when you rebase/remove depends-on we can merge it14:02
rh-jelabarreI had done a reboot on my controller node (Queens), and now I cannot log into Horizon.  I get a "Unable to establish connection to keystone endpoint".  It had worked before the reboot, so nothing should have changed in the configuration14:02
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: Generate and mount wrappers for haproxy in OVN metadata agent  https://review.openstack.org/57113014:02
dalvarezmwhahaha: EmilienM ccamacho ^ \o/ :)14:03
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Generate and mount wrappers for haproxy in OVN metadata agent  https://review.openstack.org/57113014:03
mwhahahadalvarez: -^14:03
mwhahaha:D14:03
EmilienMjfrancoa: no the tht version looked good14:03
EmilienMin the rpms at least14:03
dalvarez:P14:03
openstackgerritNguyen Van Trung proposed openstack/tripleo-repos master: Changed the home-page link  https://review.openstack.org/58119014:06
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: [DNM] WIP: Replace TOCI_JOBTYPE logic  https://review.openstack.org/58143114:08
*** zaneb has joined #tripleo14:12
*** akrivoka has quit IRC14:12
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Fix gnocchi_statsd and ceilometer_agent_ipmi healthcheck  https://review.openstack.org/58175914:12
*** zshi has quit IRC14:13
*** akrivoka has joined #tripleo14:14
*** holser_ has quit IRC14:14
*** janki has quit IRC14:15
*** holser_ has joined #tripleo14:16
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: [DNM] WIP: Replace TOCI_JOBTYPE logic  https://review.openstack.org/58143114:16
openstackgerritDavid Sanz Moreno proposed openstack/tripleo-quickstart master: Add doc about to delete ~/.quickstart directory before re-running quickstart.sh  https://review.openstack.org/58169314:18
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: [DNM][WIP] Pass the deploy_type  https://review.openstack.org/58174614:18
*** ykarel has quit IRC14:19
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: use fs config to assign standalone role, tests  https://review.openstack.org/57283014:20
*** quiquell is now known as quiquell|off14:20
jfrancoaEmilienM: I think I got it. During undercloud installation, it's taking the templates from /home/stack (these are the queens templates used for deploying the overcloud)14:21
jfrancoaEmilienM: thats the reason it can't find the tripleo-ui.yaml template.14:21
EmilienMjfrancoa: oups :D14:21
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: Prepare Docker Registry + Containers in pre-run  https://review.openstack.org/58003714:21
jfrancoaEmilienM: we should be using the templates from /usr/share/openstack-tripleo-heat-templates instead14:22
*** suuuper has quit IRC14:22
EmilienMbogdando: can you help on this one if you have time?14:23
openstackgerritHamdy Khader proposed openstack/tripleo-heat-templates master: Remove step_config from NVMEoF cinder backend  https://review.openstack.org/58176314:25
bogdandoEmilienM, jfrancoa: please link a bug with details, to get the context14:25
jfrancoabogdando: jfrancoa: I can open it if there's nothing yet14:26
jfrancoaEmilienM: ^14:26
EmilienMjfrancoa: I'll open it14:26
jfrancoaEmilienM: ok14:26
*** zshi has joined #tripleo14:26
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates master: Increase steps for Gnocchi containers.  https://review.openstack.org/58163014:26
EmilienMbogdando, jfrancoa : https://bugs.launchpad.net/tripleo/+bug/178122714:27
openstackLaunchpad bug 1781227 in tripleo "Overcloud upgrade CI job doesn't load templates from /usr/share/openstack-tripleo-heat-templates" [High,Triaged]14:27
bogdandoseems like we need undercloud_templates_path14:30
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Enable support for running refstack tests in TQE  https://review.openstack.org/57071914:31
*** zaneb has quit IRC14:31
*** zaneb has joined #tripleo14:31
*** dparkes has quit IRC14:31
jfrancoabogdando: where does undercloud install command take the templates directory from? from what is defined under undercloud.conf in templates field (http://logs.openstack.org/55/579755/11/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/b882011/logs/undercloud/home/zuul/undercloud.conf.txt.gz) ?14:32
*** maufart__ has quit IRC14:32
bogdandoso I'm now recalled of https://review.openstack.org/#/c/465047/3/config/general_config/containers_minimal.yml14:34
bogdandosomething similar from the past efforts14:34
bogdandomay be it's worth a rework14:34
bogdandojfrancoa: it takes templates from the same var, overcloud_templates_path14:34
bogdandothere is a config option, templates14:35
bogdandojfrancoa: http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/undercloud-deploy/templates/undercloud.conf.j2#n31114:35
bogdandoso it should be added a custom undercloud_* perhaps14:35
jfrancoabogdando: right, this one I guess https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/undercloud-deploy/templates/undercloud.conf.j2#L311 , which in upgrades release templates it's set to https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master-undercloud-queens-overcloud.yml#L1414:35
bogdandowhich defaults to the overcloud_* by default14:35
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Disable sensu-client in CI  https://review.openstack.org/58176614:35
jfrancoabogdando: yes we need that new variable for the undercloud templates14:36
paramiteEmilienM, fixes for https://bugs.launchpad.net/tripleo/+bug/1781108 submitted14:36
openstackLaunchpad bug 1781108 in tripleo "Telemetry containers are unhealthy after fresh deployment" [High,In progress] - Assigned to Martin Mágr (mmagr)14:36
bogdandojfrancoa: ack, I can make a patch for that tomorrow14:37
*** spsurya_ has joined #tripleo14:37
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Fix gnocchi_statsd and ceilometer_agent_ipmi healthcheck  https://review.openstack.org/58175914:38
openstackgerritHamdy Khader proposed openstack/tripleo-heat-templates master: Remove step_config from NVMEoF cinder backend  https://review.openstack.org/58176314:38
EmilienMparamite: cool14:39
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: [DNM] WIP: Replace TOCI_JOBTYPE logic  https://review.openstack.org/58143114:39
EmilienMmwhahaha: ^14:39
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: [DNM] WIP: Replace TOCI_JOBTYPE logic  https://review.openstack.org/58143114:41
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Check container health as part of the deploy  https://review.openstack.org/56915314:42
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Test scenarios with https://review.openstack.org/#/c/569153/  https://review.openstack.org/58153014:42
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Check container health as part of the deploy  https://review.openstack.org/56915314:42
* mwhahaha slaps EmilienM's hand14:42
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Check container health as part of the deploy  https://review.openstack.org/56915314:42
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Test scenarios with https://review.openstack.org/#/c/569153/  https://review.openstack.org/58153014:42
*** ykarel has joined #tripleo14:42
EmilienMmwhahaha: ^ testing again14:42
EmilienMwith depends-on etc14:42
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Limit deploy health checks to paunch managed ones  https://review.openstack.org/58152914:43
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates master: Increase steps for Gnocchi containers.  https://review.openstack.org/58163014:46
*** hamdyk has quit IRC14:46
*** kopecmartin has quit IRC14:48
EmilienMsshnaidm|rover: I saw some errors on scenario002/tempest14:49
EmilienMin the gate14:49
EmilienMhttp://logs.openstack.org/80/581180/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/6c5be42/logs/tempest.html.gz14:49
*** waleedm has quit IRC14:50
d0ugalrbrady,apetrich,thrash,toure,jtomasek: Workflow Squad meeting in 9 mins. https://etherpad.openstack.org/p/tripleo-workflows-squad-status14:51
sshnaidm|roverchkumar|ruck, can you take a look at tempest failures please? ^^14:51
chkumar|ruckEmilienM: it comes sometime on tempestconf side also, need to check what is the issue14:51
EmilienMack14:52
EmilienMjust reporting here then14:52
*** cdearborn has joined #tripleo14:53
*** ksambor has quit IRC14:53
*** rodolof has quit IRC14:53
*** jistr|mtg is now known as jistr14:54
openstackgerritSergii Golovatiuk proposed openstack/tripleo-docs master: Create a step for monitoring and metering  https://review.openstack.org/58176914:55
trownmandre: good afternoon, I am having some problems getting scenario009 to work locally... I have traced it to http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/ci/environments/disable-unbound.yaml#n57 which knocks out my DNS so then NTP fails in the next task... Is there something special  about 1.1.1.1 that makes this work in CI?14:56
*** cshastri has quit IRC14:58
*** rpioso|afk is now known as rpioso14:58
*** morazi has quit IRC14:59
chkumar|ruckEmilienM: Can i do a recheck on that tempest failure patch?15:00
d0ugalflorianf, akrivoka: Hey, I hear you might be working on improving the output/error from failed validations, is that correct?15:00
*** rodolof has joined #tripleo15:00
florianfd0ugal: not currently working, but it's being discussed15:01
sshnaidm|roverpabelanger, not to interrupt rdo meeting, let's talk here15:02
chkumar|ruckEmilienM: failing in another scenario 2 jobs also15:02
d0ugalflorianf: aha, I heard something about it. I think we should chat about it and see if we the workflows squad or we Mistral can help :)15:02
sshnaidm|roverpabelanger, will be zuul.branch "stable/ocata" or "ocata"?15:02
mandretrown: hey, we had to disable outbound on the deployed nodes in CI as it was conflicting with the dns service that openshift sets up15:02
*** holser_ has quit IRC15:02
pabelangersshnaidm|rover: full branch, stable/ocata so you need to use filter to strip15:02
*** morazi has joined #tripleo15:03
mandreso we also had to provide the nodes with a working resolver, since it was configured to be localhost for outbound15:03
florianfd0ugal: Absolutely! So at least the discussions I had around it were mainly about making the errors/warning more descriptive or generally more useful. I was also thinking about adding json as an optional output format rather than the blob of text we currently have.15:03
trownmandre: where does 1.1.1.1 come from?15:03
pabelangersshnaidm|rover: https://review.rdoproject.org/r/gitweb?p=config.git;a=blob;f=playbooks/distgit-cbs-validate/run.yaml;h=da6ffd50fd28c52c1607121623f533787264a687;hb=HEAD#l415:04
pabelangerfor example15:04
mandretrown: 1.1.1.1 is a public dns, I'm not sure why it's not working for you15:04
mandretrown: ideally we should make this configurable15:04
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Add FS055 job as experimental to run refstack tests  https://review.openstack.org/57089215:04
sshnaidm|roverpabelanger, yeah.. for second thought we actually set release there, not get it.. damn15:04
trownmandre: ok, well that at least helps me understand why it works in CI, I will keep poking at it15:05
d0ugalflorianf: right, makes sense. I guess it can get tricky if ansible fails badly?15:05
mandretrown: maybe your isp has blocked 1.1.1.1?15:05
pabelangersshnaidm|rover: is branch and release always in sync?15:05
florianfd0ugal: yeah maybe. hopefully most of this can be catched be the output plugin15:06
EmilienMchkumar|ruck: sure15:06
trownmandre: it was more that 1.1.1.1 was not resolving pool.ntp.org in the next task15:06
mandretrown: yeah, but was it resolving anything else?15:07
trownmandre: I have a run now where I hacked out the disable unbound service just to see if that is the only thing tripping me up15:07
trownmandre: hmm maybe not, didnt check that15:07
Tengumwhahaha: I gave a round to the BP for rocky this morning (well, during your night, that is). Couldn't comment all of them due to the lack of knowledge, but it should help a bit15:07
*** rodolof has quit IRC15:07
florianfd0ugal: what are your thoughts on the topic?15:08
sshnaidm|roverpabelanger, trying to find job definitions..15:08
sshnaidm|roverpabelanger, where is legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload define for example?15:08
mwhahahaTengu: sounds good. I'll take a look today15:08
*** florianf has quit IRC15:09
Tengumwhahaha: lemme know what I can improve for the next time :).15:09
pabelangersshnaidm|rover: rdo-jobs right now IRK15:10
sshnaidm|roverpabelanger, I don't see here branch: https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/zuul-legacy-jobs.yaml#L509-L52315:11
*** holser_ has joined #tripleo15:11
pabelangersshnaidm|rover: it is part of default zuul variable that zuul will set on each job, see: http://logs.openstack.org/18/580518/4/gate/openstack-zuul-jobs-linters/1ad0c00/zuul-info/inventory.yaml15:13
pabelangersshnaidm|rover: https://zuul-ci.org/docs/zuul/user/jobs.html#zuul-variables15:14
sshnaidm|roverpabelanger, yeah, it's master by default15:14
sshnaidm|roverpabelanger, the job itself runs on master, but we set "release" which actually set branch for tripleo internally15:14
sshnaidm|roverpabelanger, nevermind, will set it..15:14
*** florianf has joined #tripleo15:14
*** holser_ has quit IRC15:15
*** holser_ has joined #tripleo15:15
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates master: OVN: Add env file to deploy SRIOV with OVN.  https://review.openstack.org/57876615:15
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Fix stackviz installation  https://review.openstack.org/58036115:16
*** links has quit IRC15:16
*** holser_ has quit IRC15:16
*** bogdando has quit IRC15:16
*** holser_ has joined #tripleo15:17
*** holser_ has quit IRC15:17
*** holser_ has joined #tripleo15:18
trownmandre: ya 1.1.1.1 just doesnt work for DNS from my ISP... I can hack around that for now though... one other question: there are controller and compute services defined in that scenario, but the job is just a normal multinode job (meaning we never deploy a compute) ... is the intent to make it a 3-node job at some point?15:20
pabelangertrown: mandre: I'd be interested too why unbound needs to be stopped15:21
*** yamahata has joined #tripleo15:21
*** lvdombrkr has quit IRC15:22
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: [DNM] WIP: Replace TOCI_JOBTYPE logic  https://review.openstack.org/58143115:22
shardytrown: I think that is a mistake, I commented on a review a while back that we should probably remove the *Compute stuff15:24
shardya 3 node job might be useful in future, but for now a normal multinode job is probably enough I think15:24
shardyflaper87, mandre: ^^15:24
trownshardy: ah k, makes sense thanks, just getting up to speed on everything15:24
shardytrown: ack, good to have you looking into it :)15:25
shardytrown: also I wanted to look into using roles generate ref https://review.openstack.org/#/c/572713/ instead of overloading the Controller role, but that review's been stalled for a while due to various CI failures on t-q-e15:26
flaper87shardy: when you say 3 nodes you're counting the undercloud, right?15:26
flaper87because it'd be awesome to have a job with 2 masters15:26
shardyflaper87: yeah, but all other scenarios just run 2 nodes, e.g undercloud and all-in-one openstack15:27
flaper87I guess we can have 2 master/worker nodes15:27
trownflaper87: ya undercloud is one of the nodes15:27
openstackgerritMerged openstack/tripleo-common master: Add utility workflow to verify if an object exists  https://review.openstack.org/57875915:27
shardywith the recent work around containerized undercloud and all-in-one, we may eventually be able to make the multinode jobs only use 1 node15:28
shardywhich I expect infra will appreciate ;015:28
openstackgerritMerged openstack/tripleo-common master: Add workflow to get available plans  https://review.openstack.org/57712715:28
shardy:)15:28
sshnaidm|roverpabelanger, ptal now: https://review.rdoproject.org/r/#/c/14786  https://review.rdoproject.org/r/#/c/1478715:28
shardyflaper87: yeah having a proper HA job somewhere would be good, but I was assuming we'd need to do that via RDO third-party or something15:29
mandrepabelanger: openshift sets up a dns service on the deployed nodes and this can't be disabled15:30
flaper87shardy: Running 2 nodes with master/worker colocated might actually be enough to test HA. We can build something more complex in RDO third-party, though15:30
mandreor openshift-ansible I should say15:30
chkumar|rucksshnaidm|rover: why there is no log in swift here http://logs.openstack.org/80/581180/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/6c5be42/logs/subnode-2/var/log/containers/ ?15:30
pabelangermandre: why can't it be disabled?15:30
shardyflaper87: ack, yeah - I guess my point was we're starting with just a single all-in-one like all other scenario jobs15:31
shardyso the *Compute stuff isn't used atm15:31
*** kopecmartin has joined #tripleo15:31
flaper87pabelanger: mandre are we talking about openshift's dnsmasq ?15:31
flaper87shardy: ++15:32
mandreflaper87: yeah, do you recall the details why we couldn't disable the one openshift-ansible sets up?15:32
flaper87it's actually run by openshift, it depends on having dnsmasq15:32
shardycan I get another reviewer for https://review.openstack.org/#/c/577840/ please?15:32
pabelangerflaper87: I'm jumping in mind issue, but trying to understand why jobs disable unbound15:32
flaper87what we can't do with openshift-ansible is setting the port on the dnsmasq service15:33
pabelangergiven the history of tripleo jobs and DNS issues, we should not modify DNS lightly15:33
flaper87pabelanger: tbh, I see this as an interim solution until we have a better way to set this in the job15:33
flaper87that said, openshift has its own dnsmasq process that it depends on and it runs on 127.0.0.1:5315:34
pabelangerflaper87: okay, what are the forwarding servers setup as?15:34
flaper87we can't change the port it listens on as of now but I'd like to work with the openshift team on enabling this in openshift-ansibl;e15:34
Tengusee you tomorrow.15:34
pabelangerflaper87: i am hoping it does enable dns caching right?15:34
flaper87pabelanger: whatever is in the resolv.conf at that point15:34
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: DNM: Test pike->queens upgrades.  https://review.openstack.org/56361615:34
flaper87pabelanger: I believe it does, yes15:34
flaper87but I can double check if you want15:35
*** jcoufal has quit IRC15:35
flaper87and if it doesn't I can help enabling it15:35
flaper87I think15:35
* flaper87 should stop promissing stuff to pabelanger15:35
pabelangerflaper87: okay, with unbound, upstream jobs are configured to have caching enable and forward to google, we should look to see if we can also do this with openshift15:35
flaper87pabelanger: ok, that's good insight. I wrote the bits that disabled unbound so, I don't mind looking into this15:36
flaper87just gimme a couple of days15:36
flaper87:)15:36
trownprobably wont matter much until we are actually validating the openshift deploy though15:36
trownif even then... since I think all the DNS would be local... just openshift talking to openshift15:37
pabelangerright, and failure will be intermittent, just enough to back up the gate15:37
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart-extras master: fix ansible syntax deprecations  https://review.openstack.org/58177915:37
trownya definitely something to sort out before the job is in gate... a ways off from that yet though15:38
flaper87trown: well, some of the tests might require us to download some containers15:38
flaper87dunno, just trying to think about corner cases15:38
chkumar|ruckEmilienM: where can i check what went wrong with swift containers in this job http://logs.openstack.org/44/581344/3/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/4977d68/logs/subnode-2/var/log/swift/15:39
*** leanderthal has quit IRC15:39
*** ukalifon has quit IRC15:40
chkumar|ruckas there is no logs for swift15:40
chkumar|ruckEmilienM: it is failing at this place http://logs.openstack.org/80/581180/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/6c5be42/logs/undercloud/var/log/containers/tempest/tempest.log.txt.gz#_2018-07-11_11_55_40_49815:40
*** med_ has quit IRC15:42
*** radeks has quit IRC15:42
pabelangerflaper87: we have a reverse proxy cache to upstream docker.io, so that will help speed things up a little15:44
flaper87pabelanger: coolio15:44
*** ykarel is now known as ykarel|away15:46
*** peereb has quit IRC15:46
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Reparent scenario007 and 008 to tripleo-ci-base  https://review.openstack.org/58111615:47
*** zaneb has quit IRC15:47
sri_bfournie, hi, I've run it same error again if you have min can you please take look at this http://paste.openstack.org/show/725572/15:47
*** zaneb has joined #tripleo15:48
*** maufart__ has joined #tripleo15:49
*** tcw has quit IRC15:51
*** tcw has joined #tripleo15:51
*** tcw1 has joined #tripleo15:52
*** tcw has quit IRC15:52
sri_bfournie, do i need to Create an Inetnal VLAN on my Undercloud ?15:52
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Add OPNFV scenario environment  https://review.openstack.org/57900215:53
*** morazi has quit IRC15:57
*** morazi has joined #tripleo15:58
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO  https://review.openstack.org/56722416:00
bfourniesri_: will look, but yes its normal that you create an internal vlan on undercloud for reachability, I will post an example of a config I use with an internal vlan16:00
sri_bfournie, I've also tried to ping internal network form one of the overcloud nodes to other overcloud node16:00
sri_its not ping there also16:01
*** tesseract has quit IRC16:01
rh-jelabarreI have a basic overcloud setup (one controller, one compute) that I'm trying to delete, and it seems to be stuck, 30 or so minutes later it hasn't completed the task.  is there a way to nudge the process, or to find where it's hung up?16:01
sri_bfournie, I mean in two overcloud nodes the vlan exists that should be able to ping right ?16:02
*** alee has quit IRC16:02
*** jfrancoa has quit IRC16:04
*** hjensas has quit IRC16:04
mwhahahamatbu: https://blueprints.launchpad.net/tripleo/+spec/major-upgrade-workflow is implemented now right?16:05
*** tcw1 has quit IRC16:05
bfourniesri_: the overloud nodes should be able to ping each other, usually the undercloud is used to access the external network, here is an example config that I've used and the network setup is included, its a bit overkill for you as you are probably not using Ironic in overcloud but gives an idea of networking setup with one controller and one compute.  With all-in-one I haven't done any testing so can't really help you there - http://paste16:09
bfournie.openstack.org/show/725577/16:09
*** tcw has joined #tripleo16:10
*** panda is now known as panda|off16:11
*** tcw has quit IRC16:12
*** jpich has quit IRC16:13
*** tcw has joined #tripleo16:14
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart-extras master: fix ansible syntax deprecations  https://review.openstack.org/58177916:17
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: fix ansible syntax deprecations  https://review.openstack.org/58178816:18
*** ykarel|away is now known as ykarel16:18
*** Goneri has quit IRC16:19
ykareljistr, holser_ i didn't faced the openvswitch issue with -R queens, trying again with queens-undercloud-newton-overcloud16:19
holser_ykarel ack16:21
holser_keep us posted :D16:21
holser_by the way if you have queens undercloud, installing newton overcloud is matter of time16:21
holser_I can do it pretty quick16:21
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: make quickstart.sh more user friendly with pip errors  https://review.openstack.org/58178916:22
openstackgerritTim Rozet proposed openstack/puppet-tripleo stable/queens: Updates OpenDaylight HA Proxy backend check  https://review.openstack.org/58179016:23
openstackgerritTim Rozet proposed openstack/puppet-tripleo stable/queens: Adds scenario008 ODL to zuul check  https://review.openstack.org/58179116:24
ykarelholser_, sure16:24
openstackgerritTim Rozet proposed openstack/puppet-tripleo stable/queens: Updates OpenDaylight HA Proxy backend check  https://review.openstack.org/58179016:24
sri_bfournie, i see, one more question in my overcloud i didn't see any bonds in ip a , but i can see the bonds scripts exists in network-scirpts16:28
sri_http://paste.openstack.org/show/725582/16:28
sri_bfournie, is that expected ?16:29
*** radeks has joined #tripleo16:31
sri_bfournie, this my /etc/os-net-cofig/config.json http://paste.openstack.org/show/725584/16:31
*** florianf has quit IRC16:34
bfourniesri_: as the IP is associated with the vlan in "ip a" I believe the bond won't show there16:34
sri_bfournie, understood, this is full network output http://paste.openstack.org/show/725582/16:35
bfourniesri_: interesting that your bridge is "bridge_name" though, looks like the conversion in nic config script didn't happen16:35
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: [DNM] WIP: Replace TOCI_JOBTYPE logic  https://review.openstack.org/58143116:38
sri_bfournie, so the script is different then /etc/os-net-config/config.json  ?16:38
sri_bfournie, maybe my overcloud failed before that script runs ?16:38
*** yamahata has quit IRC16:39
*** yamahata has joined #tripleo16:39
bfourniesri_: the script (run-so-net-config.sh) is run on undercloud to generate config.json for os-net-config - https://github.com/openstack/tripleo-heat-templates/blob/master/network/scripts/run-os-net-config.sh#L13116:41
*** tzumainn has quit IRC16:44
*** hjensas has joined #tripleo16:45
*** hjensas has quit IRC16:45
*** hjensas has joined #tripleo16:45
sri_bfournie, where does the bride_name comes from ?16:45
*** maufart__ has quit IRC16:46
*** zaneb has quit IRC16:47
*** zaneb has joined #tripleo16:47
sri_bfournie, it seems i miss configure the my controller.yaml16:47
bfourniesri_: bridge_name is in nic config yaml files16:48
sri_bfournie, I've two bonds only one bond get the bridge_name16:51
sri_bfournie, http://paste.openstack.org/show/725588/16:53
*** paramite has quit IRC16:53
mwhahahaarxcruz: chkumar|ruck: so i think we've got a flakey test or race condition in tempest. http://logs.openstack.org/60/572260/4/gate/tripleo-ci-centos-7-scenario002-multinode-oooq-container/0427481/logs/tempest.html.gz16:53
mwhahahaartom: chkumar|ruck: i've seen tihs in the puppet jobs too16:54
mwhahahaartom: sorry worng perosn16:54
mwhahahaarxcruz: -^16:54
chkumar|ruckmwhahaha: https://bugs.launchpad.net/tripleo/+bug/177332516:54
openstackLaunchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)16:54
chkumar|ruckmwhahaha: seen at tempestconf also16:54
mwhahahaoh good it's not just me16:54
arxcruzmwhahaha: yeah, i'll check with lucas-afk what's going on :)16:55
*** ykarel has quit IRC16:57
bfourniesri_: strange, that substitution in script should substitute both, unless there is some issue with yaml17:00
*** derekh has quit IRC17:00
sri_bfournie, for bond2 i've copy the bond1 config and change the nic names17:01
sri_bfournie, maybe I miss something17:02
*** avivgt has quit IRC17:02
bfourniesri_: you can try hardcoding the bridge names17:02
sri_ok, it's br-ex, br-int ?17:03
*** yamahata has quit IRC17:03
*** amoralej is now known as amoralej|off17:05
*** yprokule has quit IRC17:05
*** holser_ has quit IRC17:06
sri_bfournie, is bridge_names like this br-ex, br-int is it matter ?17:06
*** zaneb has quit IRC17:06
*** zaneb has joined #tripleo17:06
bfourniesri_: br-ex17:08
*** trown is now known as trown|lunch17:08
sri_bfournie, for bond1 and bond2 !17:08
sri_bfournie, I think there is going to to bridges for two bonds17:09
bfourniesri_: if you want them on separate bridges you can do that, just set the bridge instead of bridge_name17:09
sri_bfournie, got it17:10
*** sshnaidm|rover is now known as sshnaidm|bbl17:12
*** zaneb has quit IRC17:13
*** zaneb has joined #tripleo17:13
*** moshele has joined #tripleo17:18
fultonjmwhahaha: i'm pushing https://blueprints.launchpad.net/tripleo/+spec/bluestore to stein; the milestone target and series goal is updated accordingly. is there anything else in the blueprint i should update?17:20
mwhahahafultonj: no i usually just add a note in the whiteboard about move it (with a date) for historical sake17:21
*** cdearborn has quit IRC17:21
*** cdearborn has joined #tripleo17:22
fultonjok, i'll add a note, thanks17:22
*** abishop_ has joined #tripleo17:25
*** zbitter has joined #tripleo17:26
*** zaneb has quit IRC17:26
*** abishop has quit IRC17:28
*** chkumar|ruck is now known as chandankumar17:29
*** akrivoka has quit IRC17:32
*** yamahata has joined #tripleo17:37
*** abishop_ has quit IRC17:39
*** ffiore has quit IRC17:39
*** abishop_ has joined #tripleo17:40
*** med_ has joined #tripleo17:41
*** med_ has quit IRC17:41
*** med_ has joined #tripleo17:41
*** moshele has quit IRC17:42
*** sshnaidm|bbl is now known as sshnaidm|rover17:45
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: WIP: test w/ updated registry location  https://review.openstack.org/58052817:49
*** kopecmartin has quit IRC17:57
*** zaneb has joined #tripleo17:58
*** zbitter has quit IRC17:58
sri_bfournie, hardcoding the bridge name seems to work17:59
*** tzumainn has joined #tripleo18:02
bfourniesri_: good18:04
*** morazi has quit IRC18:05
*** asbishop has joined #tripleo18:05
*** edmondsw has quit IRC18:07
*** agopi is now known as agopi|lunch18:07
*** edmondsw has joined #tripleo18:07
*** abishop_ has quit IRC18:08
sri_bfournie, I've one stupid question, can you create bond1 without ovs bridge ?18:16
*** assassin has quit IRC18:18
*** sshnaidm|rover is now known as sshnaidm|off18:19
*** morazi has joined #tripleo18:21
bfourniesri_: you can create a linux bond without using a bridge but the ovs_bonds you are creating in that config require an ovs_bvridge18:21
openstackgerritJill Rouleau proposed openstack/ansible-role-tripleo-keystone master: Add required role repo contents  https://review.openstack.org/58181118:24
*** trown|lunch is now known as trown18:32
*** morazi has quit IRC18:35
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Reparent standalone jobs and use new nodeset  https://review.openstack.org/58181418:41
*** dhill_ has quit IRC18:44
*** dhill_ has joined #tripleo18:45
*** itlinux has joined #tripleo18:49
*** cdearborn has quit IRC19:01
openstackgerritSam Doran proposed openstack/tripleo-common master: Use known_hosts module for tripleo-ssh-known-hosts role  https://review.openstack.org/55027819:01
*** agopi|lunch is now known as agopi19:01
*** itlinux has quit IRC19:02
*** dciabrin has quit IRC19:07
*** dciabrin has joined #tripleo19:07
*** radeks has quit IRC19:12
*** atoth has quit IRC19:14
*** nenad has joined #tripleo19:17
nenadHey all.. I hope somene can shed some light on a problem. I am trying to deploy overcloud with ceph (external) and the deployment is failing on os-collect-config: Jul 11 18:14:08 overcloud-controller-0 os-collect-config[4156]: requests.exceptions.SSLError: ("bad handshake: Error([('SSL routines', 'ssl3_get_server_certificate', 'certificate verify failed')],)",)19:18
nenadThis reminds me of https://bugs.launchpad.net/tripleo/+bug/1712836 buuut I do not understand enough of the nitty-gritty details to be sure if this is the case19:19
openstackLaunchpad bug 1712836 in tripleo "overcloud deployment fails if tls is used with ceph-ansible" [High,Fix released] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)19:19
mwhahahanenad: sounds like the ssl endpoint cert isn't pushed to the nodes. if you've enabled ssl on the undercloud19:24
mwhahahai don't think there's anything special you have to do for that19:24
mwhahahaunless you've given it a bad cert19:25
nenadit was a localy generated one19:25
nenadmwhahaha, it was made by undercloud when it was deployed - did not make any special manual steps. SHould I have done something to make overcloud trust the CA?19:26
mwhahahanenad: no i'd think that was part of the deploy, but i'm not an ssl expert19:26
nenadyes I would have assumed as much. Well I managed to deploy an overcloud from that same undercloud yesterday but without ceph. Today I deleted the overcloud, added ceph config, but it fails with this nice error :)19:27
mwhahahathere might be a parameter to pass the CA in but i guess that depends on your deployment templates19:27
nenadYeah I had very simple set of templates, maybe only 2 custom ones for NICs and general network env. I will try and see if adding something like '/usr/share/openstack-tripleo-heat-templates/environments/ssl/inject-trust-anchor-hiera.yaml' wqould work. Just found some instruction on http://tripleo.org/install/advanced_deployment/ssl.html#getting-the-overcloud-to-trust-cas19:29
nenadIt's just weird that it does not do these things sort of by default. or at least in my case it didn't19:30
mwhahahayes19:30
mwhahahado file a bug19:30
nenadmwhahaha ok, will do.19:37
*** edmondsw has quit IRC19:42
sri_bfournie, sorry for late reply, understood, is it possible to deploy plain linux bond with vlans ?19:42
*** edmondsw has joined #tripleo19:43
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Create classic undercloud hieradata overrides with any cli arg  https://review.openstack.org/58118019:44
bfourniesri_: yes, https://github.com/openstack/os-net-config/blob/master/os_net_config/schema.yaml#L98119:48
*** nenad is now known as nenad|afk19:48
*** raildo has quit IRC19:51
sri_bfournie, cool, thanks for your help and sorry for all the trouble19:53
bfourniesri_: no problem19:54
*** gkadam has quit IRC19:54
*** itlinux has joined #tripleo19:55
*** itlinux has quit IRC19:57
*** zaneb has quit IRC19:59
*** zaneb has joined #tripleo20:00
*** pchavva has quit IRC20:04
*** mjturek has quit IRC20:13
*** dprince has quit IRC20:16
*** holser_ has joined #tripleo20:21
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: Prepare Docker Registry + Containers in pre-run  https://review.openstack.org/58003720:21
*** mjturek has joined #tripleo20:27
*** shreshtha_ has quit IRC20:27
*** mjturek has quit IRC20:28
*** shreshtha_ has joined #tripleo20:34
*** spsurya_ has quit IRC20:36
*** mjturek has joined #tripleo20:36
*** itlinux has joined #tripleo20:38
*** ansmith has quit IRC20:45
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: make quickstart.sh more user friendly with pip errors  https://review.openstack.org/58178920:49
*** mjturek has quit IRC20:50
*** itlinux has quit IRC20:50
*** mjturek has joined #tripleo20:53
*** akhilaki has joined #tripleo20:56
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: Prepare Docker Registry + Containers in pre-run  https://review.openstack.org/58003721:01
*** trown is now known as trown|outtypewww21:03
*** klindgren has joined #tripleo21:04
*** alee has joined #tripleo21:04
*** tvignaud has joined #tripleo21:05
*** mjturek has quit IRC21:08
*** asbishop has quit IRC21:15
*** ccamacho has quit IRC21:19
*** jtomasek has quit IRC21:20
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Update output messaging for standalone/undercloud  https://review.openstack.org/58188921:21
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Reparent 7-3 node jobs for zuul-v3  https://review.openstack.org/58137621:22
*** mjturek has joined #tripleo21:24
*** mjturek has quit IRC21:25
*** mjturek has joined #tripleo21:27
*** bfournie has quit IRC21:30
*** raildo has joined #tripleo21:31
*** athomas has quit IRC21:37
*** agopi is now known as agopi|off21:39
*** holser_ has quit IRC21:42
*** agopi|off has quit IRC21:44
*** brault has quit IRC21:45
*** mjturek has quit IRC21:49
*** morazi has joined #tripleo21:50
*** mjturek has joined #tripleo21:51
*** jcoufal has joined #tripleo21:55
*** rh-jelabarre has quit IRC21:56
*** brault has joined #tripleo22:00
*** brault has quit IRC22:05
*** etingof has quit IRC22:09
*** ansmith has joined #tripleo22:11
*** mjturek has quit IRC22:15
*** rcernin has joined #tripleo22:15
*** agopi has joined #tripleo22:19
*** rmascena has joined #tripleo22:20
*** raildo has quit IRC22:21
*** etingof has joined #tripleo22:22
*** jcoufal has quit IRC22:22
*** holser_ has joined #tripleo22:23
openstackgerritBen Nemec proposed openstack/puppet-tripleo master: Make Designate pools.yaml configurable  https://review.openstack.org/58052422:24
openstackgerritBen Nemec proposed openstack/puppet-tripleo master: Only run designate pool update on bootstrap node  https://review.openstack.org/58189922:24
openstackgerritBen Nemec proposed openstack/puppet-tripleo master: Enable configuration of rndc controls  https://review.openstack.org/58190022:24
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Configure rndc to listen on internal_api network  https://review.openstack.org/58190122:25
*** med_ has quit IRC22:28
*** zshi has quit IRC22:28
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: Prepare Docker Registry + Containers in pre-run  https://review.openstack.org/58003722:29
*** agopi has quit IRC22:32
*** jcoufal has joined #tripleo22:35
*** owalsh_ has joined #tripleo22:39
*** owalsh has quit IRC22:43
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Reduce default services for Standalone  https://review.openstack.org/58190322:46
*** owalsh has joined #tripleo22:47
*** owalsh_ has quit IRC22:48
*** zshi has joined #tripleo22:50
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Update heat container healthchecks  https://review.openstack.org/58190422:57
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Check container health as part of the deploy  https://review.openstack.org/56915322:58
*** mcornea has quit IRC22:58
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Limit deploy health checks to paunch managed ones  https://review.openstack.org/58152922:58
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Test scenarios with https://review.openstack.org/#/c/569153/  https://review.openstack.org/58153022:58
*** rlandy has quit IRC23:10
*** edmondsw has quit IRC23:12
*** edmondsw has joined #tripleo23:13
*** edmondsw has quit IRC23:17
*** jcoufal has quit IRC23:18
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Reparent standalone jobs and use new nodeset  https://review.openstack.org/58181423:19
*** jcoufal has joined #tripleo23:25
*** zshi has quit IRC23:26
*** rmascena has quit IRC23:33
*** tosky has quit IRC23:35
*** holser_ has quit IRC23:37
*** rpioso is now known as rpioso|afk23:44
*** med_ has joined #tripleo23:47
*** med_ has quit IRC23:47
*** med_ has joined #tripleo23:47
*** akhilaki has quit IRC23:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!