Wednesday, 2018-05-23

openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO  https://review.openstack.org/56722400:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044500:00
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Use str_replace for known_hosts  https://review.openstack.org/56991200:00
*** zaneb has joined #tripleo00:02
*** ffiore has quit IRC00:04
*** fragatina has quit IRC00:07
*** bdodd is now known as bdodd|afk00:07
*** fragatina has joined #tripleo00:07
*** rlandy is now known as rlandy|bbl00:09
*** dmacpher has quit IRC00:09
*** fragatina has quit IRC00:12
openstackgerritMerged openstack/tripleo-common stable/queens: Fix redis healthcheck  https://review.openstack.org/56985300:18
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Fix known hosts config script value  https://review.openstack.org/57003000:18
*** mvenesio has quit IRC00:21
*** slaweq has joined #tripleo00:25
*** mmethot has quit IRC00:26
*** mmethot_ has joined #tripleo00:26
*** zshi has quit IRC00:27
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Set default application for Ceph Luminous openstack_pools  https://review.openstack.org/57004300:27
*** mmethot_ has quit IRC00:28
*** zaneb has quit IRC00:30
*** jtomasek has joined #tripleo00:33
*** d0ugal_ has quit IRC00:33
*** d0ugal_ has joined #tripleo00:40
*** yamahata has joined #tripleo00:41
*** spsurya has quit IRC00:41
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Use str_replace for known_hosts  https://review.openstack.org/56991000:44
openstackgerritMerged openstack/tripleo-upgrade stable/queens: Separate scripts creation tasks for under/overcloud.  https://review.openstack.org/56997400:44
*** bnemec has joined #tripleo00:47
*** slaweq_ has joined #tripleo00:54
*** bdodd|afk is now known as bdodd00:56
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Add ability to update containers  https://review.openstack.org/56687700:57
*** pchavva has quit IRC00:57
*** slaweq has quit IRC00:58
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart  https://review.openstack.org/56706001:00
*** mdnadeem has joined #tripleo01:03
*** yamahata has quit IRC01:06
*** dmacpher has joined #tripleo01:08
*** bdodd is now known as bdodd|afk01:13
*** pchavva has joined #tripleo01:15
*** zaneb has joined #tripleo01:15
*** psahoo has joined #tripleo01:21
*** gbarros has joined #tripleo01:23
*** bnemec has quit IRC01:25
*** gvrangan has joined #tripleo01:25
*** slaweq_ has quit IRC01:29
openstackgerritSteve Baker proposed openstack/ansible-role-container-registry master: Use relative paths for data_files  https://review.openstack.org/57008801:30
stevebakerEmilienM: hey, is anything invoking the container-registry role before the undercloud install?01:33
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade stable/queens: DNM: Run enable-ssh-admin.sh script before fast forward run  https://review.openstack.org/57007401:36
EmilienMstevebaker: no01:42
EmilienMstevebaker: I mean... "not yet" ;-)01:42
stevebakerEmilienM: I'm thinking that oooq should install and run a playbook which looks like the tasks in tht01:43
*** gvrangan has quit IRC01:44
EmilienMstevebaker: why oooq01:44
EmilienM?01:44
stevebakerEmilienM: where else would the playbook come from when only packages are installed?01:45
EmilienMstevebaker: tripleoclient?01:46
EmilienMis the playbook static?01:47
EmilienMif default values work, we can even put the playbook in the role01:47
stevebakerEmilienM: static with a couple of variables01:47
*** pchavva has quit IRC01:47
stevebakerEmilienM: tripleo-common playbooks is another option01:47
EmilienMas well01:48
EmilienMbut I really don't want to rely on oooq for that01:48
EmilienMbecause CI/dev isn't the only use case01:48
*** mdnadeem has quit IRC01:48
EmilienMour operators who need to change containers before a deployment don't want oooq I presume01:48
stevebakerEmilienM: on the other hand, the playbook is literally just "set variables, run role container-registry"01:49
EmilienMstevebaker: yeah we can pick the client or common01:49
EmilienMwe can start with client01:49
stevebakersince there is playbooks in common, I'll put it there.01:49
EmilienMok01:50
EmilienMstevebaker: hey can you review this one when you have some spare time this week? https://review.openstack.org/#/c/570076/ to fix the undercloud upgrade CI job01:51
EmilienMthanks01:51
stevebakerEmilienM: sure. Next question would be what oooq task runs this playbook? undercloud-prep-containers.sh?01:51
stevebakereven before that might be better01:52
EmilienMstevebaker: IMHO the playbook should be run by tripleoclient itself01:52
EmilienMmaybe a new command like "openstack tripleo container init" ?01:52
EmilienMthe init would be run by default in the deploy01:53
stevebakerEmilienM: oh, lets just make it an embedded playbook in tripleoclient then01:53
EmilienMbut could be run beforehand the deploy01:53
EmilienMyes!01:53
stevebakergotcha01:53
EmilienMthe "openstack tripleo deploy" would run "openstack tripleo init" by default01:53
EmilienMbut init could be run beforehand01:53
stevebakeryep, ok01:53
EmilienMand init would be a set of playbooks we want before the actual deployment01:53
EmilienMlike, deploy docker01:54
EmilienMit's an idea worth exploring01:54
stevebakerEmilienM: if we had an init, it will inevitably be used for other things ;)01:55
openstackgerritMarius Cornea proposed openstack/tripleo-quickstart-extras master: DNM: export OVERCLOUD_HOSTS when running enable-ssh-admin.sh  https://review.openstack.org/57009101:56
EmilienMstevebaker: we would have "init, deploy, upgrade"01:58
EmilienMit dosn't sound crazy01:58
EmilienMhaving a "pre-init" would be crazy :D01:59
*** d0ugal_ has quit IRC01:59
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade stable/queens: DNM: Run enable-ssh-admin.sh script before fast forward run  https://review.openstack.org/57007402:01
stevebakerEmilienM: pre-init is yum install python-tripleoclient. maybe an init can help it not install every package02:03
stevebakerEmilienM: maybe an init can help the rpm not have to install every package02:03
*** shreshtha has joined #tripleo02:04
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove UpgradeRemoveUnusedPackages from undercloud-upgrade-prepare.yaml  https://review.openstack.org/56932302:06
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Don't use crudini to get rhn server  https://review.openstack.org/56918002:07
*** pradk has joined #tripleo02:07
EmilienMstevebaker: let's propose something basic with an init02:07
EmilienMstevebaker: btw, https://review.openstack.org/#/c/568715/ if you have time as well :D02:07
stevebakerEmilienM: +102:07
EmilienMI'll stop with asking for review today :D02:07
EmilienMand go finish my slides for tripleo project updates, tomorrow02:08
*** bkopilov has quit IRC02:08
*** d0ugal_ has joined #tripleo02:08
stevebakergood luck02:08
*** gvrangan has joined #tripleo02:11
openstackgerritIan Wienand proposed openstack/diskimage-builder master: WIP: native zuulv3 tests  https://review.openstack.org/56677902:11
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Save and close stdout on exit  https://review.openstack.org/57009402:11
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add log directory option to functional tests  https://review.openstack.org/57009502:11
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Rename output log files  https://review.openstack.org/57009602:11
EmilienMthanks!02:12
*** tvignaud has quit IRC02:17
*** tvignaud has joined #tripleo02:18
*** rh-jelabarre has quit IRC02:20
*** gbarros has quit IRC02:30
openstackgerritSagi Shnaidman proposed openstack/tripleo-common master: DNM: test container-check patch  https://review.openstack.org/57010102:38
*** nyechiel_ has quit IRC02:46
*** mdnadeem has joined #tripleo02:48
*** mdnadeem has quit IRC02:52
*** fragatina has joined #tripleo02:56
*** gvrangan has quit IRC02:56
*** gvrangan has joined #tripleo02:58
*** fragatina has quit IRC02:59
*** fragatina has joined #tripleo02:59
*** fragatina has quit IRC03:04
*** fragatina has joined #tripleo03:04
*** shreshtha has quit IRC03:08
*** mdnadeem has joined #tripleo03:09
*** bkopilov has joined #tripleo03:25
*** gvrangan has quit IRC03:29
*** bdodd|afk is now known as bdodd03:32
*** jtomasek has quit IRC03:39
*** ramishra has joined #tripleo03:41
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Rename output log files  https://review.openstack.org/57009603:54
openstackgerritIan Wienand proposed openstack/diskimage-builder master: WIP: native zuulv3 tests  https://review.openstack.org/56677903:54
*** gvrangan has joined #tripleo03:55
*** gvrangan has quit IRC03:57
*** matbu has joined #tripleo04:03
*** tzumainn has quit IRC04:04
*** saneax-_-|AFK has quit IRC04:08
*** bdodd is now known as bdodd|afk04:12
openstackgerritIan Wienand proposed openstack/diskimage-builder master: WIP: native zuulv3 tests  https://review.openstack.org/56677904:14
*** gvrangan has joined #tripleo04:14
*** shreshtha has joined #tripleo04:14
*** gvrangan has quit IRC04:19
*** yprokule has joined #tripleo04:19
*** dxiri has quit IRC04:20
*** cshastri has joined #tripleo04:28
*** dxiri has joined #tripleo04:31
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Save and close stdout on exit  https://review.openstack.org/57009404:33
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add log directory option to functional tests  https://review.openstack.org/57009504:33
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Rename output log files  https://review.openstack.org/57009604:33
openstackgerritIan Wienand proposed openstack/diskimage-builder master: WIP: native zuulv3 tests  https://review.openstack.org/56677904:33
*** udesale has joined #tripleo04:35
*** links has joined #tripleo04:38
*** gvrangan has joined #tripleo04:39
*** yprokule has quit IRC04:40
*** dxiri has quit IRC04:40
*** marios has joined #tripleo04:41
*** bdodd|afk is now known as bdodd04:42
*** jaganathan has quit IRC04:45
*** jaganathan has joined #tripleo04:45
*** ykarel has joined #tripleo04:47
*** gvrangan has quit IRC04:51
*** ratailor has joined #tripleo04:54
*** radeks has joined #tripleo04:58
*** tdasilva has quit IRC04:58
openstackgerritMerged openstack/python-tripleoclient master: Add -y option to "openstack undercloud upgrade"  https://review.openstack.org/57007604:59
*** janki has joined #tripleo05:06
openstackgerritCédric Jeanneret proposed openstack/tripleo-common master: WIP: Set FixedIps by default  https://review.openstack.org/56981805:06
*** radeks has quit IRC05:08
*** gvrangan has joined #tripleo05:09
openstackgerritIan Wienand proposed openstack/diskimage-builder master: WIP: native zuulv3 tests  https://review.openstack.org/56677905:10
openstackgerritIan Wienand proposed openstack/diskimage-builder master: WIP: native zuulv3 tests  https://review.openstack.org/56677905:13
*** gvrangan has quit IRC05:14
*** bdodd is now known as bdodd|afk05:15
*** pdeore has joined #tripleo05:16
openstackgerritIan Wienand proposed openstack/diskimage-builder master: WIP: native zuulv3 tests  https://review.openstack.org/56677905:17
*** jfrancoa has joined #tripleo05:20
*** nyechiel_ has joined #tripleo05:23
*** radeks has joined #tripleo05:24
*** psachin has joined #tripleo05:26
*** tdasilva has joined #tripleo05:27
*** yamahata has joined #tripleo05:31
*** ratailor has quit IRC05:36
*** ratailor has joined #tripleo05:36
openstackgerritIan Wienand proposed openstack/diskimage-builder master: WIP: native zuulv3 tests  https://review.openstack.org/56677905:37
*** dparkes has quit IRC05:39
*** gvrangan has joined #tripleo05:44
*** gbarros has joined #tripleo05:46
*** ratailor has quit IRC05:50
*** yolanda has joined #tripleo05:50
*** nyechiel_ has quit IRC05:50
ramishracontainerized undercloud install fails with http://paste.openstack.org/show/721688/, for local CA, seems the certmonger service could not be restarted05:51
ramishrait goes away after system restart, probably a bug, jaosorior ^^^05:51
jaosoriorramishra: any logs on why certmonger couldn't be restarted?05:52
ramishralooks like https://bugzilla.redhat.com/show_bug.cgi?id=150468805:52
openstackbugzilla.redhat.com bug 1504688 in dbus "certmonger is not able to set well-known bus name "org.fedorahosted.certmonger"" [Urgent,Closed: notabug] - Assigned to dking05:52
jaosoriorramishra: oh, that :/05:53
*** ratailor has joined #tripleo05:53
jaosoriorramishra: can we try to open that again? so we could get a workaround at least :/05:53
jaosoriorramishra: I'm not a certmonger dev :/ but I can try to poke that team05:53
ramishrajaosorior: we need a workaround in tripleo probably05:53
ramishrasure will raise a bug in tripleo atleast;)05:54
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: upgrade: remove packages at step 4  https://review.openstack.org/57011605:56
EmilienMmarios, hey I would like a review on ^ to make sure it's ok for you05:56
EmilienMthanks!05:56
mariosEmilienM: i'll check. first thought is we lose some of the advantage because removal at step2 means we don't have to yum update them (i.e. yum update happens on step3 )05:57
mariosEmilienM: will have a closer look05:57
mariosEmilienM: though having said that i don't think this feature is very widely used if at all (off by default)05:58
EmilienMmarios: oh right05:59
EmilienMmarios: but I actually did this patch because it breaks the upgrade when upgrading the undercloud05:59
openstackgerritIan Wienand proposed openstack/diskimage-builder master: WIP: native zuulv3 tests  https://review.openstack.org/56677905:59
EmilienMmarios: see https://bugs.launchpad.net/tripleo/+bug/1772804 (which is another bug, but see the trace)05:59
openstackLaunchpad bug 1772804 in tripleo "Upgrade process doesn't fail when upgrade_tasks returns 1 in containerized undercloud" [High,Triaged] - Assigned to Emilien Macchi (emilienm)05:59
EmilienMmarios: the package was first removed, and then ansible tries to see if service runs (from another upgrade_task on another service)05:59
ramishrajaosorior: FWIW https://bugs.launchpad.net/tripleo/+bug/177280706:00
openstackLaunchpad bug 1772807 in tripleo "default containerized undercloud with local CA fails with "Error org.freedesktop.DBus.Error.TimedOut"" [Undecided,New]06:00
*** gbarros has quit IRC06:00
jaosoriorramishra: thanks06:02
EmilienMmarios: happy to chat later, /me goes to bed, have a good day ;-)06:02
*** links has quit IRC06:04
*** shreshtha has quit IRC06:04
*** quiquell|off is now known as quiquell06:05
*** shreshtha has joined #tripleo06:05
*** yolanda has quit IRC06:05
*** paramite_ has joined #tripleo06:08
mariosEmilienM: ack good night :)06:09
*** fragatina has quit IRC06:09
*** cshastri has quit IRC06:09
*** fragatina has joined #tripleo06:09
*** udesale_ has joined #tripleo06:16
*** yprokule has joined #tripleo06:16
*** ykarel_ has joined #tripleo06:17
*** udesale has quit IRC06:18
*** rlandy|bbl has quit IRC06:18
*** yolanda has joined #tripleo06:19
*** ykarel has quit IRC06:19
*** links has joined #tripleo06:19
openstackgerritIan Wienand proposed openstack/diskimage-builder master: WIP: native zuulv3 tests  https://review.openstack.org/56677906:21
*** nkinder has joined #tripleo06:26
*** kopecmartin has joined #tripleo06:28
*** cylopez has joined #tripleo06:28
*** ramishra has quit IRC06:28
*** ramishra has joined #tripleo06:31
*** dparkes has joined #tripleo06:31
*** jbadiapa_ has quit IRC06:32
*** _jbadiapa has joined #tripleo06:32
*** pcaruana has joined #tripleo06:33
*** wolverineav has joined #tripleo06:34
*** cshastri has joined #tripleo06:36
*** lvdombrkr has joined #tripleo06:36
*** gfidente has joined #tripleo06:39
*** gfidente has quit IRC06:39
*** gfidente has joined #tripleo06:39
*** radek__ has joined #tripleo06:42
*** cshastri has quit IRC06:43
*** holser__ has joined #tripleo06:44
*** udesale__ has joined #tripleo06:44
*** yamahata has quit IRC06:44
*** udesale_ has quit IRC06:46
*** jchhatbar has joined #tripleo06:50
*** janki has quit IRC06:51
*** jchhatba_ has joined #tripleo06:52
*** udesale__ has quit IRC06:52
*** udesale__ has joined #tripleo06:52
*** ykarel__ has joined #tripleo06:53
*** rajinir has quit IRC06:53
*** shardy has joined #tripleo06:54
*** jchhatbar has quit IRC06:55
*** ffiore has joined #tripleo06:55
*** ykarel_ has quit IRC06:56
*** pmannidi has quit IRC06:57
*** threestrands has quit IRC06:57
*** rcernin has quit IRC06:57
*** dmacpher has quit IRC06:58
*** dmacpher has joined #tripleo06:59
*** cshastri has joined #tripleo07:01
*** ykarel__ is now known as ykarel|mtg07:01
*** pdeore_ has joined #tripleo07:01
*** udesale_ has joined #tripleo07:01
*** pdeore has quit IRC07:04
openstackgerritNuman Siddique proposed openstack/tripleo-quickstart master: Enable OVN DB HA profile in fset30  https://review.openstack.org/52380407:04
*** udesale__ has quit IRC07:04
*** dparkes has quit IRC07:05
*** dparkes has joined #tripleo07:06
*** saneax has joined #tripleo07:06
*** saneax has quit IRC07:08
*** saneax has joined #tripleo07:09
*** dparkes has quit IRC07:10
*** udesale_ has quit IRC07:11
*** udesale has joined #tripleo07:12
*** udesale has quit IRC07:12
*** udesale has joined #tripleo07:12
*** jaosorior has quit IRC07:18
*** jaosorior has joined #tripleo07:19
*** tesseract has joined #tripleo07:20
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Move SSL undercloud validation out of UC script create tasks.  https://review.openstack.org/57013007:20
*** ukalifon has joined #tripleo07:22
*** _jbadiapa has quit IRC07:23
*** dmacpher has quit IRC07:24
openstackgerritpini proposed openstack/tripleo-ha-utils master: switch to use the upstream utils repo  https://review.openstack.org/57013207:26
*** ssbarnea_ has joined #tripleo07:27
*** bogdando has joined #tripleo07:30
*** florianf has joined #tripleo07:36
*** _jbadiapa has joined #tripleo07:38
openstackgerritCédric Jeanneret proposed openstack/tripleo-common master: WIP: Set FixedIps by default  https://review.openstack.org/56981807:41
*** anilvenkata has joined #tripleo07:41
*** amoralej|off is now known as amoralej07:42
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Store UC hosts/portmaps heat params in output_dir  https://review.openstack.org/56413507:42
*** olap has joined #tripleo07:42
bogdandoo/ PTAL https://review.openstack.org/#/c/563988/07:43
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Provide the default roles file for standalone  https://review.openstack.org/56999207:49
*** udesale_ has joined #tripleo07:51
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Fallback the default roles file for UC config  https://review.openstack.org/56999207:51
openstackgerritSergii Golovatiuk proposed openstack/tripleo-common stable/queens: Add special 'all' for deploy_on_servers server name to match all  https://review.openstack.org/56753807:52
*** pdeore__ has joined #tripleo07:52
*** udesale has quit IRC07:54
*** jpena|off is now known as jpena07:54
*** pdeore_ has quit IRC07:55
cgoncalvesshardy, jaosorior: morning :) re: octavia image rpm install, the only way around I found was to use Ansible's raw module "raw: sudo yum -y install octavia-amphora-image" and add that command to the tripleo-common/sudoers file07:55
cgoncalvesshardy, jaosorior: installing the rpm in one of the controller nodes proved not be that feasible because a) node need to be subscribed to OSP channel which in many cases it is not and b) would require a default route to outside which is also unlikely to have07:57
openstackgerritThomas Herve proposed openstack/tripleo-heat-templates master: Trigger scenario003 on designate changes  https://review.openstack.org/57013907:59
openstackgerritThomas Herve proposed openstack/tripleo-heat-templates master: Pass designate configuration to neutron  https://review.openstack.org/56999008:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/ocata: GATE CHECK for TripleO  https://review.openstack.org/56429108:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO  https://review.openstack.org/56428508:00
*** gfidente has quit IRC08:01
*** links has quit IRC08:01
*** d0ugal_ has quit IRC08:08
*** d0ugal has joined #tripleo08:08
*** b00tcat has joined #tripleo08:11
*** marios has quit IRC08:13
*** avivgt has joined #tripleo08:13
*** links has joined #tripleo08:14
*** marios has joined #tripleo08:14
*** gkadam has joined #tripleo08:17
openstackgerritCédric Jeanneret proposed openstack/tripleo-common master: WIP: Set FixedIps by default  https://review.openstack.org/56981808:26
jaosoriorshardy: can you take a look at this? ^^08:27
jaosoriorwe're still missing IPv6 (gonna work on that next)08:27
jaosoriorbut we got IPv4 working in our tests08:28
Tengu\o/08:28
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: Move SSL undercloud validation out of UC script create tasks.  https://review.openstack.org/57013008:28
jaosoriorshardy: IPv6 will come as part of the same patch.08:28
*** gfidente has joined #tripleo08:30
*** psahoo has quit IRC08:31
*** pblaho has joined #tripleo08:31
*** suuuper has joined #tripleo08:35
*** ramishra_ has joined #tripleo08:35
*** ramishra has quit IRC08:35
quiquellHi, some core's love here ?08:38
quiquellhttps://review.openstack.org/#/c/566565/08:38
quiquellIt's part of a CI effort to refactor upgrades/updates08:38
*** shardy has quit IRC08:39
*** ykarel|mtg is now known as ykarel08:39
chandankumarsshnaidm|off: panda|off can we get this merged https://review.rdoproject.org/r/1385108:39
chandankumar?08:39
*** akrivoka has joined #tripleo08:41
*** psahoo has joined #tripleo08:45
*** derekh has joined #tripleo08:50
*** skramaja has joined #tripleo08:50
*** sshnaidm|off is now known as sshnaidm|rover08:52
sshnaidm|roverchandankumar, can you please remove 021 in the same patch?08:52
chandankumarsshnaidm|rover: sure08:53
*** shardy has joined #tripleo08:53
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Add update/upgrade/ffwd tasks for OsloMessagingRpc  https://review.openstack.org/57014809:02
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Add update/upgrade/ffwd tasks for OsloMessagingRpc  https://review.openstack.org/57014809:03
*** pdeore__ is now known as pdeore09:06
*** leanderthal has joined #tripleo09:07
*** salmankhan has joined #tripleo09:09
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Add keystone only upgrade jobs  https://review.openstack.org/55842509:09
*** dparkes has joined #tripleo09:13
*** psachin has quit IRC09:23
*** masco has joined #tripleo09:23
*** dparkes has quit IRC09:24
*** dparkes has joined #tripleo09:26
*** zoli is now known as zoli|lunch09:30
*** udesale__ has joined #tripleo09:31
*** yolanda has quit IRC09:32
*** udesale has joined #tripleo09:32
*** udesale_ has quit IRC09:33
*** salmankhan has quit IRC09:35
*** salmankhan has joined #tripleo09:35
*** nkinder has quit IRC09:35
*** udesale__ has quit IRC09:36
jistrjfrancoa: the mini revert didn't work, it's too tied into other services, e.g. keystone expected it. So i'm trying a full fix instead, so far just took the tasks from rabbitmq: https://review.openstack.org/#/c/57014809:38
*** jchhatba_ has quit IRC09:40
*** jchhatba_ has joined #tripleo09:40
*** CristinaPauna has joined #tripleo09:42
*** yolanda has joined #tripleo09:45
*** cylopez has left #tripleo09:46
jchhatba_Hi. Can I get some reviews for https://review.openstack.org/#/c/567469/09:49
jchhatba_mandre, bogdando skramaja ^09:49
openstackgerritbinhong.hua proposed openstack/tripleo-quickstart-extras master: Move --scale to {{role}}Count  https://review.openstack.org/55757309:51
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add new nova-event-callback validation  https://review.openstack.org/51333309:52
*** jchhatba_ is now known as janki09:52
skramajadone janki09:58
jankiskramaja, thanks10:01
openstackgerritGiulio Fidente proposed openstack/tripleo-docs master: Add instructions for Ceph upgrade in Pike to Queens section  https://review.openstack.org/57015610:01
openstackgerritGiulio Fidente proposed openstack/tripleo-docs master: Add instructions for Ceph upgrade in Pike to Queens section  https://review.openstack.org/57015610:03
jaosoriorshardy: will folks always give the ExternalNetCidr if IPv6 is enabled?10:09
*** bkopilov has quit IRC10:16
*** psahoo has quit IRC10:16
ccamachojaosorior quick question im missing network-environment.yaml in my undercloud10:17
ccamachodo you know how is generated by default?10:18
*** dparkes has quit IRC10:18
ccamachojistr^ maybe ?10:18
jaosoriorccamacho: it's generated by tripleo-quickstart usually10:19
jaosoriorelse you gotta write it yourself10:19
jaosoriorif you use tags all it'll be auto generated10:20
jaosoriorif you don't, then it'll be missing10:20
jaosoriorI usually copy mine from a CI run10:20
ccamachojaosorior yeahp but I cant use all tags, I used   --tags untagged,provision,environment,libvirt,undercloud-scripts,undercloud-inventory,overcloud-scripts10:21
ccamachoAnd now im running10:21
ccamachosudo ./overcloud-prep-containers.sh10:21
ccamacho./overcloud-prep-flavors.sh10:21
ccamacho./overcloud-prep-images.sh10:21
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: Remove tempest compute-feature-enabled.attach_encrypted_volume  https://review.openstack.org/57015810:21
ccamacho./overcloud-prep-network.sh10:21
ccamacho./overcloud-deploy.sh  ---- (fails with the missing network-environment.yaml file )10:21
ccamacho./overcloud-deploy-post.sh10:21
ccamacho./overcloud-validate.sh10:21
jaosoriorccamacho: OK, then grab it from a CI run10:21
jaosoriorccamacho: I don't recall what tag is needed :/10:22
jaosoriorsshnaidm|rover: do you remember? ^^10:22
shardyjaosorior: there will always be a value, but it might be the default from network_data.yaml via the heat default vs a user provided value10:22
*** dparkes has joined #tripleo10:22
sshnaidm|roverjaosorior, overcloud-prep-config?10:22
jaosoriorccamacho: I had tried to add it here https://review.openstack.org/#/c/567202/10:22
jaosorioryes!10:23
jaosoriorshardy: right. I'm trying to figure out how to detect if we'll use IPv610:23
ccamachojaosorior!! woooow so your bug is verified then :P10:23
ccamachothanks man10:23
*** anilvenkata has quit IRC10:24
*** wolverineav has quit IRC10:24
sshnaidm|roverjaosorior, maybe the solution could be tagging generation of network-environments.yaml with tag overcloud-scripts10:24
shardyjaosorior: if you look at the flattened parameters schema we already generate for the UI, I think you can look at either the Value or Default key for the ExternalNetCidr parameter and see if it's an ipv6 address10:24
shardywith the Value taking precedence over the Default10:25
*** wolverineav has joined #tripleo10:25
jaosorioruhm...10:25
jaosoriorI don't think I have access to the heat defaults at that point10:25
Tenguwe will find a way :).10:25
jaosorioronly to the user-provided things, like the parameter_defaults and the resource_registry10:25
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Removing options in configure-tempest  https://review.openstack.org/57015910:25
shardyjaosorior: the heat defaults are in the flattened parameters schema I just mentioned10:26
shardythat's how the UI populates the defaults in all the forms10:26
jaosoriorsshnaidm|rover: I think that would be nicer10:26
ccamachojaosorior im going to grab what's here: https://github.com/openstack/tripleo-quickstart-extras/tree/master/roles/overcloud-prep-config for not doing it all again10:26
shardyjaosorior: yeah there are two things, the merged user environment and the parameters schema from validation10:26
jaosoriorshardy: are those flattened parameters saved somewhere in swift?10:26
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: Remove tempest compute-feature-enabled.attach_encrypted_volume  https://review.openstack.org/57015810:27
shardyI think you need the second one (or perhaps both)10:27
shardyjaosorior: not sure, let me take a look10:27
pdeoreHi everyone, could you please review https://review.openstack.org/#/c/569970/ ?10:27
openstackgerritMerged openstack/tripleo-ha-utils master: switch to use the upstream utils repo  https://review.openstack.org/57013210:27
openstackgerritMerged openstack/tripleo-ha-utils master: Fix the way iptables rules are managed  https://review.openstack.org/56999310:27
*** wolverineav has quit IRC10:29
shardyhttps://github.com/openstack/tripleo-common/blob/master/workbooks/plan_management.yaml#L54910:29
shardyjaosorior: I don't think it's stored although IIRC there's some caching somewhere, I guess the derive parameters model has access to this too, so maybe that's a good place to wire in your changes?10:30
shardysince you're essentially deriving the public VIP IP from the plan and user data?10:30
jaosoriorshardy: but, that's not called at all for the CLI workflow, is it?10:31
shardyjaosorior: yes we should use the same workflows for UI and CLI now10:31
shardyhttps://github.com/openstack/tripleo-common/blob/master/workbooks/derive_params.yaml#L2010:32
*** psachin has joined #tripleo10:32
shardylooks like we call the action there, not looked closely at the caching but we will want to make sure its not calling heat every time as it'a fairly expensive operation10:32
jaosoriorshardy: figuring out where that's called. Cause right now we're calling all this stuff from the deploy workflow10:36
jaosoriorI actually don't see an instance of derive_parameters or derive_params in tripleoclient :/10:37
ccamachosshnaidm|rover please check my comment for https://review.openstack.org/#/c/567202 (Abandoned a few days ago)10:37
openstackgerritCarlos Goncalves proposed openstack/tripleo-common master: Fix Octavia amphora image RPM install  https://review.openstack.org/57016310:38
shardyjaosorior: it'll be called from another workflow I expect10:38
sshnaidm|roverccamacho,  solution could be tagging generation of network-environments.yaml with tag overcloud-scripts10:39
cgoncalvesshardy, jaosorior: https://review.openstack.org/#/c/570163/10:39
jaosoriorshardy: right, just trying to tie everything together to make sure it all works as we expect.10:39
*** udesale has quit IRC10:40
*** zoli|lunch is now known as zoli10:40
shardyjaosorior: ack - tripleoclient has a test (test_invoke_plan_env_workflows) which shows it driving tripleo.derive_params.v1.derive_parameters10:41
ccamachosshnaidm|rover yeah, but just a heads up as it might be a valid bug if either the file isn't generated with the tag  overcloud-prep-config or overcloud-scripts10:41
shardy./tripleoclient/workflows/parameters.py seems to call the workflow based on the plan-environment I think10:42
jaosoriorat what point in the CLI deployment is that called?10:42
shardymaybe skramaja can confirm how that's intended to work as I don't see tripleo.derive_params.v1.derive_parameters in the default plan-environment, possibly you have to add it for DPDK deployments and others that need it?10:43
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: tag creating network environment file with overcloud-scripts  https://review.openstack.org/57016410:43
sshnaidm|roverccamacho, can you try please if it works ^^10:43
jaosoriorthat might be the case10:44
shardyjaosorior: workflow_params.invoke_plan_env_workflows is run in ./tripleoclient/v1/overcloud_deploy.py right before we do the deploy10:44
ccamachosshnaidm|rover sure thing :) /me testing it right now10:44
shardyso sounds like it might fit your use-case10:44
rascahey folks, can I ask you for the last +2 on this https://review.openstack.org/#/c/563104/ since we're all good with the gates?10:45
* skramaja reading throu shardy jaosorior10:48
jaosoriorshardy: OK, we could give it a try10:49
skramajainorder to enable derive params workflow, we use -p option on the deploycommand to override the default plan environment with this one https://github.com/openstack/tripleo-heat-templates/blob/master/plan-samples/plan-environment-derived-params.yaml10:51
skramajathis will have the parameters required for starting the workflow.10:51
skramajahttps://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L21310:52
skramajajaosorior: shardy based on the -p option cli will invoke the workflow.. ^ here.10:53
shardyskramaja: thanks for confirming, sounds like jaosorior can do the same for testing and we can discuss enabling it by default if needed for his requirements10:55
*** shreshtha has quit IRC10:55
jaosoriorskramaja: oh, but we need to pass a plan file then?10:56
*** mdnadeem has quit IRC11:00
*** yprokule has quit IRC11:02
skramajajaosorior: yeah. our is specific to nfv deployments only not common to all. if it is common, we could add it to the default plan environtment file itself..11:04
jaosoriorI see11:04
jaosoriorskramaja: will derive_parameters work even if we don't override the default plan?11:05
shardyjaosorior: No, check the tripleoclient code I linked, it only runs the workflow if it's specified in the plan-environment, so we'd potentially need to update the default plan-environment or it won't run11:06
skramajaderive parameters when invoked, will check the list of roles and their features, if nfv features is present, it will run the formulas to drive the parameters.11:06
skramajawe dont want to invoke by default as it will add additional step for non-nfv deployments too..11:06
skramajahttps://github.com/openstack/tripleo-common/blob/master/workbooks/derive_params.yaml#L43211:07
shardyyeah we may need to revisit that decision if jaosorior needs this to run by default but we'll have to make sure the overhead is fairly small11:07
skramaja^ here where the feature identification is done based on services and parameters. ..11:08
*** shardy is now known as shardy_lunch11:08
skramajayes., we could always enable it by default11:08
jaosoriorso... we're hooking this stuff now qa11:09
skramajaand there is a requirement for the control of using this feature should be with user.. that we can achieve by adding workflow_parameters in the plan environment..11:09
skramajaso it is doable..11:10
jaosorior* to the deploy workflow11:10
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Export ZUUL_CHANGES in the reproducer  https://review.openstack.org/57016711:14
*** dtantsur has joined #tripleo11:18
*** dtantsur has quit IRC11:18
skramajajaosorior: yes, it needs few additional changes on the workflow, we can add it. your requirement is for testing vip?11:18
*** dtantsur has joined #tripleo11:19
jaosoriorskramaja: I'm trying to do predictable VIPs (either the external one or the ctlplane one... depends on the case) by default11:21
jaosoriorand that, because I'm ultimately trying to do TLS by default11:21
jaosoriorso we need a predictable IP for the cert11:21
*** bfournie has quit IRC11:21
skramajaok. derive parameters workflow is more of getting the introspection data to derive the parameteres to get the best performace..11:25
*** pdeore has quit IRC11:27
skramajawhat i see as your requirement is kind of static. may be we need add few customizations to remove unnessary bits out for your requiremtent. it has all the role specific node and parameter checking and deriving.11:27
*** b00tcat has quit IRC11:28
*** rh-jelabarre has joined #tripleo11:29
skramajastatic here i mean is that it is not dependent on the hardware..11:29
bogdandomwhahaha, EmilienM: is ready to restore wf+1 back  https://review.openstack.org/#/c/564135/ :)11:29
*** pcaruana|afk| has joined #tripleo11:29
*** pcaruana has quit IRC11:29
*** wolverineav has joined #tripleo11:29
*** salmankhan has quit IRC11:35
jaosoriorskramaja: right, it isn't11:35
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart  https://review.openstack.org/56706011:35
*** quiquell is now known as quiquell|lunch11:37
skramajalet me know if you need any info, happy to help jaosorior. though most of the work is done by jaganathan and abisop on the workflows.11:38
*** marios has quit IRC11:39
*** raildo has joined #tripleo11:41
*** salmankhan has joined #tripleo11:41
*** marios has joined #tripleo11:41
openstackgerritSergii Golovatiuk proposed openstack/python-tripleoclient master: Replace logging with oslo_log for upgrade classes  https://review.openstack.org/56781911:45
openstackgerritBogdan Dobrelya proposed openstack/puppet-tripleo master: Rework GDPR compliant logrotate config  https://review.openstack.org/56997611:46
*** abishop has joined #tripleo11:46
*** shreshtha has joined #tripleo11:48
*** shreshtha has quit IRC11:48
openstackgerritMarios Andreou proposed openstack/tripleo-docs master: Add developer docs for Pike to Queens upgrade  https://review.openstack.org/56944311:48
*** shreshtha has joined #tripleo11:48
*** dmacpher has joined #tripleo11:48
*** pkovar has joined #tripleo11:49
*** mburned_out is now known as mburned11:50
jaosoriorshardy_lunch: oooh, actually, we had potentially IPv6 working since we're taking the allocation pool into account, which should be ipv6 already11:52
*** amoralej is now known as amoralej|lunch11:52
jaosoriortrying out an ipv6 deployment with the patch11:53
jaosoriorbogdando: I think there's a containerized undercloud bug11:57
jaosoriorbogdando: if you update an action/workflow from tripleo-common, it doesn't get built in CI11:57
jaosoriorwell, the container won't have the new action11:57
jaosoriorEmilienM: ^^11:57
EmilienMhello11:57
*** jpena is now known as jpena|lunch11:58
*** morazi has joined #tripleo11:59
*** bfournie has joined #tripleo11:59
bogdandojaosorior: IIRC applying changes to workflows used to require some dances, already, is it only the containers issue?11:59
jaosoriorbogdando: yes, at least in CI11:59
bogdandoI think there are snippets around, remove workflows, recreate et al11:59
*** tzumainn has joined #tripleo12:00
bogdandoprolly this is only CI case and we can fix that for quickstart only?12:00
jaosoriorbogdando: no idea how that works :D12:00
bogdandoshardy_lunch: ^^ perchance?12:00
jaosoriorbogdando: at least not in containers12:00
bogdandoonce you are back :)12:00
openstackgerritMerged openstack/tripleo-heat-templates master: docker: cleanup update tasks  https://review.openstack.org/56871512:00
openstackgerritMerged openstack/ansible-role-container-registry master: Use relative paths for data_files  https://review.openstack.org/57008812:00
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Modify vhost user socket directory's default value in environment file  https://review.openstack.org/56160212:00
bogdandojaosorior: ok, can you submit a bug?12:01
jaosoriorbogdando: will do12:01
jaosoriorbogdando: we just stumbled upon this :D12:01
*** skramaja has quit IRC12:01
*** dbecker has joined #tripleo12:05
moguimarjaosorior: no meeting today?12:05
jaosoriormoguimar: no, sent a mail about it12:05
moguimark12:06
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common master: Set FixedIp by default for public-facing VIP  https://review.openstack.org/56981812:06
jaosoriorTengu: worked :D ^^12:06
jistransmith, ykarel, bandini: hi guys, we're trying to get an upgrade job working for Q->R upgrade, and we seem to be broken by https://review.openstack.org/#/c/507963/12:08
jistrwe're probably missing upgrade logic from RabbitMQ to OsloMessagingRpc12:09
jistrcan you help me understand what happened, what should be done, and perhaps help with the implementation?12:09
ansmithjistr: would look forward to helping12:10
jistri sorta assumed that we still deploy RabbitMQ as we did via pacemaker bundle, and we just changed how the services are configured to connect to it12:10
jistrso i just copied the upgrade tasks from P->Q upgrade https://review.openstack.org/#/c/57014812:11
jistrbut hit a wall real quick12:11
jistrthe immediate surprise/question i have now is -- are we not managing RabbitMQ via a pacemaker bundle anymore?12:11
ansmiththe intent is that everything stays the same and that oslomsg maps to existing rabbitmq12:11
ansmithit is still the same rabbitmq via pacemaker12:12
ansmithlet me look at the p->q upgrade patch12:12
bogdandoEmilienM, jaosorior: can we merge please https://review.openstack.org/#/c/564135/ ?12:13
*** shardy_lunch is now known as shardy12:13
bogdandobefore I have to rebase it again :)12:13
bogdandomwhahaha: updated https://review.openstack.org/#/c/569992/12:14
jistransmith, bandini: i can't find anything mentioning the rabbitmq_bundle puppet class in the new rpc-rabbitmq template12:14
jistri'd expect this12:14
jistrhttps://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/pacemaker/rabbitmq.yaml#L19812:14
EmilienMbogdando: I think mwhahaha wanted to land https://review.openstack.org/#/c/567951/9 first iirc12:14
jistrbut there's this12:15
jistrhttps://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/messaging/rpc-rabbitmq.yaml#L20612:15
shardyjaosorior, bogdando: Sorry catching up on backscroll what was the question about containerized undercloud?12:15
jistrsimilarly, there's none of the 'pcmklatest' image tagging logic in rpc-rabbitmq12:15
jistrhttps://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/pacemaker/rabbitmq.yaml#L75-L8112:15
jaosoriorshardy: found an issue in CI, where, if you change an action/workbook from tripleo-common, the containerized undercloud won't have the reflected action in the container12:15
bogdandoshardy: it was mainly about how-to test workflow changes in CI12:15
bogdandowe prolly need to add an init container step with some dances12:16
jistransmith, bandini: which leads me to think it's not just missing update/upgrade/ffwd tasks, but there's more stuff that we regressed on (e.g. the various tagging/init containers etc.) when we switched from RabbitMQ to OsloMessagingRpc12:16
bogdandoto populate workflows12:16
shardyjaosorior, bogdando: Ah I see, sorry not sure how that's wired up - for containers we'd build and overlay a tripleo-ci repo, so I guess we need the same for containers but I'm not sure on the details tbh12:16
bogdandoor limit the fix for CI/quickstart only12:16
shardydoesn't the same requirement exist for any container, e.g also any Depends-On for containerized overcloud etc?12:17
*** udesale has joined #tripleo12:17
ansmithjistr: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/pacemaker/rpc-rabbitmq.yaml12:17
bogdandoshardy: I think it is handled by containers yum updates in CI12:18
bogdandobut populating workflows can't be done via yum update AFAIK12:18
jistransmith: oh i'm looking at a completely wrong template, aren't i :) thanks, will look again :)12:18
jistrthat's what i get for using the 'T' search feature on github :D12:19
ansmithjistr: there is a question on how to best consolidate the "redundancy", need to work with bandini and eck on it12:19
ykareljistr, /me no idea about this12:20
shardybogdando: maybe d0ugal can confirm but I thought the workflows were loaded into the DB, which I assume happens after the container starts, e.g the state isn't actually in the container, right?12:20
*** leitan has joined #tripleo12:20
jaosoriorshardy: right, but the actions are python code, which should be in the container12:20
ansmithjistr: let me know if you run into anything next, would like to help out12:21
jaosoriorso even if the workflow definitions are up to date, if the actions don't match they'll fail12:21
openstackgerritOliver Walsh proposed openstack/instack-undercloud stable/ocata: WIP: prevent duplicate default cells being created by ocata upgrade  https://review.openstack.org/57008112:21
shardyjaosorior: right, but the actions will be updated by whatever the yum update method is, right?12:21
shardyas you'll pull in the overlay tripleo-common12:21
jaosoriorthey aren't as far as I can tell12:21
jaosoriorthat's the error log we're seeing12:21
jistransmith: thanks a bunch, for starters i'll try to patch the correct file this time, and see where that gets us with CI :)12:21
jistransmith, ykarel, bandini: sorry for the noise12:21
shardyjaosorior: Ok sounds like a bug, I was confused due to the mention of workflows vs actions above12:22
jaosoriorshardy: was a bit hard to explain12:22
jaosoriorI don't think we do container builds on the fs001 for the undercloud container12:23
*** avivgt has quit IRC12:24
*** trown|outtypewww is now known as trown12:27
beaglesshardy: skramaja: if you get a chance - https://review.openstack.org/#/c/568138/ ... for context related patch https://review.openstack.org/#/c/568089/ (workflowed but latter is dependent on former)12:28
beaglesmarios: I'm trying to sort out an issue with https://review.openstack.org/#/c/567655/ - do you know who could work me through the details of FFU tasks and why running this as a FFU task vs. running it as standalone ansible post-upgrade might differ?12:30
shardybeagles: this changes the defaults in something we already released, what are the upgrade implications?12:32
mariosbeagles: o/ sure, what do you need to know. i can help as can most folks in upgrades squad jistr matbu lbezdick12:33
mariosbeagles: in the review you have the tasks in both upgrade/post-upgrades tasks12:33
mariosbeagles: perhaps this will help? (but not sure what you're after exactly) https://docs.openstack.org/tripleo-docs/latest/install/developer/upgrades/fast_fw_upgrade.html12:34
mariosbeagles: in terms of the steps/what executed when?12:34
beaglesshardy: good question, I've asked nmagnezi to hop in and chat with you on it12:34
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Bring update/upgrade tasks for OsloMessagingRpc up to date  https://review.openstack.org/57014812:34
nmagnezio/12:34
nmagneziwhat is the questions12:34
* nmagnezi scrolls12:34
shardynmagnezi: Hi!  Looking at https://review.openstack.org/#/c/568138/7/docker/services/octavia/octavia-deployment-config.yaml12:34
shardywe already released queens with the defaults that are being changed12:35
*** rlandy has joined #tripleo12:35
shardywhat happens if someone upgrades and those values change?12:35
*** quiquell|lunch is now known as quiquell12:35
beaglesmarios: that actually is one question - do you need both or is it sufficient to simply have it in upgrade tasks as these will be run anyway?12:35
shardyseems like the answer could be "something bad" but I wanted to check :)12:35
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/stable/queens/docker/services/octavia/octavia-deployment-config.yaml#L8012:36
mariosbeagles: right. depends what you need to happen when. if it is enough for it to happen on upgrade tasks, and they stay intact for the duration of ffwd-upgrade tasks (and this doesn't create any problem with other services etc ) then yes12:36
beaglesmarios: I'm guessing it is FFU tasks followed by upgrade tasks maybe?12:36
nmagnezishardy, well, I am no tripleO expect but I think that once that subnet got created that remains the case, no? beagles can keep me honest here12:36
mariosbeagles: exactly see the steps in that doc i linked12:36
jistrbeagles: yes the last step of FFU is "almost normal" upgrade of 12->1312:36
mariosbeagles: step 3 is the ffu tasks and then step 4 is the upgrade tasks and 'normal' config12:36
mariosjistr: s/almost/exactly/12:37
mariosjistr: :) i mean it is literally 'openstack overcloud upgrade run' we use there12:37
beaglesokay so I can ditch the FFU acl settings I think because this is only relevant for upgrading from pike->queens12:37
nmagnezishardy, so for one, we can backport this change to stable/queens. as for  existing deployments we issues a release notes so I guess it's up to operators to change that subnet if they would like not to be limited by low amount of addresses in that regard12:37
jistrmarios, beagles: right it's the same command, but the starting state of the cloud differs... we start with services being stopped. That might or might not make a difference.12:37
shardynmagnezi: well I'm not sure we can backport it (upstream) to queens if we want to follow the stable/maint rules12:38
mariosjistr: ack12:38
shardyhence my question12:38
beaglesjistr: marios: yeah, the acl only matters when moving from a non-containerized to containerized deployment so actually it does matter if someone is going from ocata->queens I think12:38
nmagnezishardy, you got a point there12:38
beaglesjistr: marios: the key point is it needs to happen somewhere around where the neutron agent containers are launched for the first time because that is where the permissions change on /var/lib/neutron occurs12:40
nmagnezishardy, during the upgrade process (I presume you mean queens first release to a newer tag release) do those templates being re-run?12:40
mariosbeagles: if that means it can be 'completely after the containers are launch' then consider post_upgrade_tasks12:41
*** vpickard_ is now known as vpickard12:41
beaglesjistr: marios: which actually probably is in the FFU realm right?12:41
mariosbeagles: otherwise, you may need to add it to the docker config?12:41
shardynmagnezi: yes all config is re-applied, but I'm not certain if there's any conditionals which prevent that in the octavia post-install ansible12:41
mariosbeagles: no the ffu tasks aren't containerizing anything they are mostly concerend with stopping systemd things and running dbsyncs where necessary when going through the intermediary versions12:42
jistrbeagles: i think that would be the pike->queens upgrade i think, both for ffwd-upgrade and slow upgrade. Neutron in Pike is still uncontainerized, even when going with the slow upgrades.12:42
beaglesmarios: ah oikay12:42
jistrbeagles: is "somewhere around" really ok, or do we need it *before* the neutron containers are launched?12:43
nmagnezishardy, you think it would make sense to add a conditional that prevents re-creation in a case where that subnet already exists?12:43
bogdandojaosorior: we do not build containers in CI jobs AFAIK. Instead we use yum update to pull in depends-on changes from repos, where those supposed to sit in12:43
bogdandoso changes gets into rpms, then yum updated in containers, CI only12:44
*** cshastri has quit IRC12:44
bogdandoif something is missing in tripleo common code, we have a bug in the updater logic12:44
mariosjistr: beagles right. i asked if 'after' is ok too so he could consider the post upgrade tasks then12:44
bogdandoEmilienM, sshnaidm|rover: ^^12:44
bogdandoI know there were some changes to how we update packages?12:44
bogdandoin containers12:45
*** ratailor has quit IRC12:45
beaglesshardy: we check for the existence of the networks before we create them so heat parameter changes like this shouldn't affect anything on upgrade12:45
beaglesshardy: if it does it is probably a bug12:45
jaosoriorbogdando: where is that code?12:45
shardybeagles: Ok, so we just need a release note saying the network range changed and that it won't be applied on upgrade from queens I guess12:45
shardyhttps://github.com/openstack/tripleo-common/blob/master/playbooks/roles/octavia-overcloud-config/tasks/network.yml12:46
shardyI see the conditionals there now12:46
bogdandojaosorior: http://git.openstack.org/cgit/openstack/tripleo-common/tree/scripts/container-update.py12:46
bogdandolet me check for oooq...12:46
beaglesmarios: jistr: yeah, that might work - depends how persnickety neutron agents can be in an interval between the time the agents are launched and the acls are modified12:46
beaglesnmagnezi: ^ see shardy's comment on rel note12:47
nmagnezibeagles, ack I'll add something about upgrades12:47
jistrbeagles, marios: so i'm looking at the patch, and if doing the ACLs before the container is started is fine, then i think the patch is already doing it well (but we can drop it from ffwd_tasks, upgrade_tasks should be enough)12:48
beaglesmarios: jistr: what the interesting problem is - when I run the setfacl commands or an acl ansible task, I end up with a different result if I run the tasks via ansible from an undercloud command line12:48
beaglesmarios: jistr: there is something happening with the effective permissions there that I can't quite sort out where is coming from12:49
bogdandojaosorior: http://codesearch.openstack.org/?q=update_containers&i=nope&files=&repos=tripleo-ci,tripleo-quickstart-extras12:49
jaosoriorbogdando: awesome, thanks12:49
mariosbeagles: strange only guess is 'environment variables' maybe vs ansible defaults12:49
jistrbeagles: at which point in the procedure are you running it, when you're running it manually from undercloud?12:49
*** pradk has quit IRC12:49
beaglesmarios: jistr: after the upgrade has completed12:49
bogdandojaosorior: note, http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/overcloud-prep-containers/tasks/overcloud-prep-containers.yml is obsolete now that we have the script moved into tripleo common, there is a patch to address that, not merged yet12:50
beaglesmarios: jistr: yeah, it is strange. I was doing some experimentation with permissions etc try to find an ordering that produced the same results but nada12:50
bogdandojaosorior: btw, PTAL https://review.openstack.org/#/c/569976/ reworked gdpr logrotate12:51
bogdandoI ran out of better ideas12:51
jistrbeagles: and running it after upgrade gives you better/correct results? Could it be that we need to wait for some files to appear (by starting the neutron containers) so that the acl settings work the way we need?12:51
beaglesmarios: jistr: in this case the files are expected to exist so the "default" acl entries should not be relevant. If you log into the machine and run the setfacl as root from the comand line you get what you want too - so it hints at either "order of operations" or enviroment as the difference12:51
beaglesjistr: yeah it might be something like that ... even the mounting of the directory into the container might be messing things up12:52
*** mcornea has joined #tripleo12:53
jaosoriorbogdando: uhm... I guess that makes sense12:53
jaosoriorI can't think of anything better either12:53
beaglesjistr: marios: it's probably worthwhile to try it as a post upgrade task to see if it is ordering. If if still doesn't get the proper result then it hints more strongly to an ansible runtime environment issue12:54
jistrbeagles: if we'd be ok running both containerized and non-containerized alongside *without* the ACL rules in place for a while, then applying it in the post_upgrade_tasks could be an option. It should be closer to what you did manually -- essentially apply the ACLs after the upgrade.12:54
jistrbeagles: yea sounds like a good plan to me12:54
mariosbeagles: ack if i recall post upgrade only has 2 sec let me check (steps i mean) just fyi we can make it what you need though12:54
mariosbeagles: ah 4 in fact https://github.com/openstack/tripleo-heat-templates/blob/6d10c0516b447d2b75dbe184c4097d931e0f0e6f/common/deploy-steps.j2#L2112:55
mariosbeagles: so you can keep it as you already have it with "step2"12:55
mariosbeagles: i mean if you move to postupgradetasks12:55
cgoncalvesbogdando, hi! could you please review https://review.openstack.org/#/c/570163/ ?12:56
*** myoung|ruck is now known as myoung12:56
beaglesmarios: ack12:56
cgoncalvesjaosorior, ^ I'd appreciate your review too, being you a tripleo and security expert :)12:56
beaglesmarios: jistr: quick question - upgrade_tasks happen before the post upgrade tasks?12:57
*** toure|gone is now known as toure12:57
openstackgerritmelissaml proposed openstack/tripleo-quickstart-extras master: fix typos in documentation  https://review.openstack.org/57017812:58
jistrbeagles: yes, it's 1) upgrade_tasks 2) "the normal deploy workflow" -- puppet steps, containers starting steps, ..., and 3) post_upgrade_tasks12:58
*** rbrady has quit IRC12:58
beaglesjistr: okay cool thanks12:58
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: upgrade: remove packages at step 4  https://review.openstack.org/57011612:58
jaosoriorcgoncalves: LGTM12:58
*** jpena|lunch is now known as jpena12:59
*** amoralej|lunch is now known as amoralej12:59
EmilienMmarios: I updated the commit message on https://review.openstack.org/570116 and answered your questions, and also changed the step as agreed on IRC12:59
cgoncalvesjaosorior, thank you, really!12:59
jaosoriorcgoncalves: thanks for coding it :)13:00
mariosbeagles: sorry was getting coffee jistr already answered13:03
mariosEmilienM: ack will check thanks13:03
beaglesmarios :)13:03
*** pchavva has joined #tripleo13:03
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Make standalone role name configurable  https://review.openstack.org/56837813:05
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Start standalone.conf  https://review.openstack.org/56947413:05
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Move undercloud.conf to the undercloud config namespace  https://review.openstack.org/56947713:05
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: WIP: Handle config loading in tripleo deploy  https://review.openstack.org/56953513:05
EmilienMchandankumar: could you help to debug something with containerized tempest?13:07
chandankumarEmilienM: yup log link13:07
EmilienMchandankumar: http://logs.openstack.org/64/560264/27/check/tripleo-ci-centos-7-containers-multinode/d574a5f/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-05-23_04_22_1113:08
EmilienMchandankumar: you can use http://logs.openstack.org/64/560264/27/check/tripleo-ci-centos-7-containers-multinode/d574a5f/logs/reproducer-quickstart.sh to reproduce if you use this tool13:09
*** vpickard has quit IRC13:12
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add acl to paths that are shared among related neutron processes  https://review.openstack.org/56765513:12
*** vpickard has joined #tripleo13:12
EmilienMchandankumar: the IP used to reach keystone is wrong13:12
EmilienMchandankumar: see http://logs.openstack.org/64/560264/27/check/tripleo-ci-centos-7-containers-multinode/d574a5f/logs/undercloud/home/zuul/overcloud_deploy_post.log.txt.gz#_2018-05-23_04_14_3413:12
EmilienMchandankumar: it should be 24.1, not 24.1013:12
*** tcw has quit IRC13:13
EmilienMchandankumar: actually nevermind, it works with 24.10 as well, http://logs.openstack.org/64/560264/27/check/tripleo-ci-centos-7-containers-multinode/d574a5f/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-05-23_04_16_5713:13
chandankumarEmilienM: it takes the value from overcloudrc file13:13
*** tcw has joined #tripleo13:13
EmilienMchandankumar: it's weird that before in the script keystone is reachable13:13
chandankumarEmilienM: is it coming in all jobs or this one only?13:14
EmilienMchandankumar: just for 560264 but I did recheck and obtained the same results13:14
EmilienMchandankumar: the undercloud is containerized in this multinode job13:15
EmilienMchandankumar: note it works fine on OVB job which also containerize tempest AFIK https://logs.rdoproject.org/23/569323/4/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z159930af42e248c294900dc158876b4d/tempest.html.gz13:15
*** wolverineav has quit IRC13:16
*** yolanda has quit IRC13:17
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Honor {{role.name}}ExtraConfig with deprecated params  https://review.openstack.org/57019113:19
*** yolanda has joined #tripleo13:19
*** eck` is now known as eck`gone13:21
*** gvrangan has quit IRC13:21
*** eck`gone is now known as eck`13:22
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo master: Remove support for puppet-ceph  https://review.openstack.org/57019313:22
*** lblanchard has joined #tripleo13:25
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/pike: Remove ceph-osd from the list of packages updated by CephExternal  https://review.openstack.org/57019613:27
chandankumarEmilienM: which other multinode jobs have containerized UC?13:27
jistrbeagles: FYI if you're testing, a small thing that needs fixing (in both files): https://review.openstack.org/#/c/567655/11/docker/services/neutron-l3.yaml13:29
*** janki has quit IRC13:31
*** janki has joined #tripleo13:31
*** psachin has quit IRC13:32
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/ocata: Remove ceph-osd from the list of packages updated by CephExternal  https://review.openstack.org/57019913:33
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/newton: Remove ceph-osd from the list of packages updated by CephExternal  https://review.openstack.org/57020013:35
*** lblanchard1 has joined #tripleo13:36
*** lblanchard has quit IRC13:36
*** ykarel is now known as ykarel|afk13:36
chandankumarsshnaidm|rover: is this familiar with reproducer script http://paste.openstack.org/show/721731/13:38
chandankumar?13:38
*** social has joined #tripleo13:38
*** lblanchard has joined #tripleo13:39
*** lblanchard1 has quit IRC13:39
*** lblanchard1 has joined #tripleo13:41
*** lblanchard has quit IRC13:41
sshnaidm|roverchandankumar, nope13:42
chandankumarsshnaidm|rover: it is coming while creating reproducer env with http://logs.openstack.org/64/560264/27/check/tripleo-ci-centos-7-containers-multinode/d574a5f/logs/reproducer-quickstart.sh13:43
chandankumaron rdocloud13:43
*** wolverineav has joined #tripleo13:43
sshnaidm|roverchandankumar, try to remove you previous work folder13:44
*** pdeore has joined #tripleo13:45
jistrmerge? :) -- multinode NIC config compatible with upgrade jobs https://review.openstack.org/#/c/56978113:46
bogdandoEmilienM, mwhahaha: PTAL https://review.openstack.org/#/c/564135/13:47
bogdandoalso please https://review.openstack.org/#/c/569992/13:48
*** ramishra_ has quit IRC13:49
*** bkopilov has joined #tripleo13:49
mwhahahabogdando: 564135 is going to conflict with 567951 which is in the gate, you may need to rebase it13:50
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade stable/queens: DNM: Run enable-ssh-admin.sh script before fast forward run  https://review.openstack.org/57007413:50
chandankumarsshnaidm|rover: still same issue13:51
*** ramishra has joined #tripleo13:51
EmilienMchandankumar: none13:51
openstackgerritMarius Cornea proposed openstack/tripleo-quickstart-extras master: export OVERCLOUD_HOSTS when running enable-ssh-admin.sh  https://review.openstack.org/57009113:52
openstackgerritNir Magnezi proposed openstack/tripleo-heat-templates master: Make lb-mgmt-subnet a class B subnet  https://review.openstack.org/56813813:52
honzaflorianf: would you mind pushing these 2 patches across the finish line?  https://review.openstack.org/#/c/561211/13:53
nmagnezishardy, beagles updated the release note for https://review.openstack.org/#/c/568138/13:53
openstackgerritNir Magnezi proposed openstack/tripleo-heat-templates master: Make lb-mgmt-subnet a class B subnet  https://review.openstack.org/56813813:54
shardynmagnezi: thanks, +213:55
nmagnezishardy, thank you for the feedback :-)13:56
florianfhonza: yep, let me have a look14:01
*** pradk has joined #tripleo14:01
openstackgerritMarios Andreou proposed openstack/tripleo-common master: Remove the upgrade-non-controller.sh and disable_upgrade_deployment  https://review.openstack.org/55769414:01
florianfhonza: done14:02
honzaflorianf: perfect, thank you14:02
openstackgerritThomas Herve proposed openstack/puppet-tripleo master: Automatically configure neutron with designate  https://review.openstack.org/56998714:03
openstackgerritThomas Herve proposed openstack/puppet-tripleo master: Automatically configure neutron with designate  https://review.openstack.org/56998714:04
*** dbecker has quit IRC14:07
*** janki has quit IRC14:07
*** bdodd|afk is now known as bdodd14:10
*** ohochman has joined #tripleo14:13
openstackgerritThomas Herve proposed openstack/tripleo-heat-templates master: Pass designate configuration to neutron  https://review.openstack.org/56999014:18
*** matbu has quit IRC14:20
*** zoli is now known as zoli|brb14:22
*** rpioso|afk is now known as rpioso14:22
*** matbu has joined #tripleo14:22
*** saneax has quit IRC14:28
*** artom_ is now known as artom14:28
*** slaweq has joined #tripleo14:33
EmilienMbogdando: like I said, rebase on top and https://review.openstack.org/#/c/567951/914:34
bogdandoEmilienM: ack14:34
openstackgerritOliver Walsh proposed openstack/instack-undercloud stable/ocata: WIP: prevent duplicate default cells being created by ocata upgrade  https://review.openstack.org/57008114:34
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart master: Pass tripleo-admin as ssh-user in FFWD job.  https://review.openstack.org/57020814:35
bogdandowhat about https://review.openstack.org/#/c/569992/ ? can it make it w/o rebasing EmilienM?14:35
EmilienMbogdando: yes, gerrit doesn't show conflict on top right14:36
bogdandoindeed, thanks14:36
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Set default application for Ceph Luminous openstack_pools  https://review.openstack.org/57004314:38
*** homegrown has quit IRC14:39
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Set default application for Ceph Luminous openstack_pools  https://review.openstack.org/57004314:39
openstackgerritCédric Jeanneret proposed openstack/tripleo-quickstart master: New config in order to get IPv6 with pacemaker on a single-nic isolated net  https://review.openstack.org/57020914:41
*** janki has joined #tripleo14:43
*** bnemec has joined #tripleo14:44
pdeoreEmilienM, jaosorior, shardy , jistr could please have a look at https://review.openstack.org/#/c/569970 whenever you are free ...14:44
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Store UC hosts/portmaps heat params in output_dir  https://review.openstack.org/56413514:49
*** nyechiel_ has joined #tripleo14:51
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Fix path and wire-in UC deploy role data file  https://review.openstack.org/56398814:51
rascamwhahaha, ok, I confirm that the last failure that I got in RDOPhase2 was not related to the ssh script14:51
rascamwhahaha, about the other issue we were talking about, do we already have some sort of bug?14:52
rascamwhahaha, I'm seeing messages like "Error: Evaluation Error: Error while evaluating a Function Call, Could not find data item oslo_messaging_rpc_password in any Hiera data file and no default supplied at /etc/puppet/modules/tripleo/manifests/profile/base/nova.pp:85:30 on node overcloud-novacompute-1.localdomain"14:53
mwhahaharasca: yea that14:54
mwhahaharasca: so that seems to be a missing environment config of some sport14:54
mwhahaharasca: the jobs might need to be updated for master14:54
mwhahaharasca: it sounds like it's using OS::Tripleo::Service::Rabbitmq instead of the new oslomessaging ones14:55
mwhahaharasca: so i think there needs to be some review of the environment configs14:55
rascamwhahaha, oh it should be the case14:55
rascamwhahaha, I'm using the same roles definitions for both pike and master at the moment so maybe that's the problem14:56
mwhahaharasca: yea that's likely the problem14:56
*** mvenesio has joined #tripleo14:57
rascamwhahaha, ok, let me try to solve that14:57
rascamwhahaha, too many failures today man14:57
*** avivgt has joined #tripleo14:58
openstackgerritMerged openstack/tripleo-quickstart-extras master: Support upgrade_cleanup param in undercloud.conf  https://review.openstack.org/56989815:01
*** pdeore has quit IRC15:01
*** rbrady has joined #tripleo15:02
*** zoli|brb is now known as zoli15:02
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: Do not run nic template conversion on default tht location  https://review.openstack.org/56927215:02
*** rbrady is now known as Guest7598915:02
*** matbu has quit IRC15:07
*** zaneb has quit IRC15:07
mwhahahauh oh15:07
mwhahahaseeing packaging failures on tripleoclient15:08
* mwhahaha sighs15:08
openstackgerritRaoul Scarazzini proposed openstack/tripleo-ha-utils master: Fix the last old repository references  https://review.openstack.org/57021015:08
mwhahahahrm maybe it's my patch15:09
* mwhahaha goes looking at the rebase15:09
openstackgerritHarald Jensås proposed openstack/puppet-tripleo master: Fix duplicate entries in /etc/sysconfig/iptables  https://review.openstack.org/56835115:10
*** noslzzp_ has quit IRC15:11
openstackgerritMerged openstack/tripleo-quickstart master: fs050: enable upgrade cleanup  https://review.openstack.org/56989915:11
openstackgerritMerged openstack/tripleo-upgrade stable/queens: Set mon_max_pg_per_osd to 300 during ceph upgrade  https://review.openstack.org/56998115:11
openstackgerritMerged openstack/tripleo-common master: Update heat api healtchecks  https://review.openstack.org/56985215:11
openstackgerritMerged openstack/tripleo-heat-templates master: Fix known hosts config script value  https://review.openstack.org/57002915:11
openstackgerritMerged openstack-infra/tripleo-ci master: Add ability to use a different release per playbook  https://review.openstack.org/56656515:11
*** yamahata has joined #tripleo15:11
openstackgerritRaoul Scarazzini proposed openstack/tripleo-ha-utils master: Fix the last old repository references  https://review.openstack.org/57021015:12
*** bnemec has quit IRC15:13
openstackgerrityatin proposed openstack/tripleo-heat-templates master: Use /usr/bin/env python to autodetect python  https://review.openstack.org/57021315:17
*** pblaho has quit IRC15:18
*** lvdombrkr has quit IRC15:22
*** ukalifon has quit IRC15:22
openstackgerritRyan Brady proposed openstack/tripleo-common master: [WIP]Fixes ordering of environment files in a deployment plan  https://review.openstack.org/57021515:23
*** pblaho has joined #tripleo15:23
openstackgerritRyan Brady proposed openstack/tripleo-common master: [WIP]Fixes ordering of environment files in a deployment plan  https://review.openstack.org/57021515:24
*** slaweq has quit IRC15:24
*** dbecker has joined #tripleo15:26
*** bogdando has quit IRC15:30
*** mburned is now known as mburned_out15:32
*** dbecker has quit IRC15:32
*** pcaruana|afk| has quit IRC15:33
*** social has quit IRC15:33
*** quiquell is now known as quiquell|off15:34
*** ssbarnea_ has quit IRC15:36
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart master: Unset test_ping in fs051 upgrades job.  https://review.openstack.org/57021615:37
*** ramishra has quit IRC15:37
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: upgrade: remove packages at step 3  https://review.openstack.org/57011615:39
openstackgerritmelissaml proposed openstack/tripleo-heat-templates master: fix a typo in collectd.yaml  https://review.openstack.org/57021815:39
*** matbu has joined #tripleo15:40
*** arxcruz is now known as arxcruz|rover15:42
*** rlandy is now known as rlandy|rover15:42
*** dparkes has quit IRC15:43
*** dbecker has joined #tripleo15:43
*** salmankhan1 has joined #tripleo15:43
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Add keystone only upgrade jobs  https://review.openstack.org/55842515:44
*** salmankhan has quit IRC15:45
*** salmankhan1 is now known as salmankhan15:45
*** etingof is now known as etingof|brb15:45
*** ssbarnea_ has joined #tripleo15:46
*** leitan has quit IRC15:46
*** leitan has joined #tripleo15:46
*** anilvenkata has joined #tripleo15:47
shardyAnyone know the status of tripleo-ui when using a containerized undercloud, jrist perhaps?15:48
*** ssbarnea_ has quit IRC15:48
mwhahahashardy: it should work15:48
mwhahahashardy: at least it was working-ish when emilien last was messing with it15:49
shardymwhahaha: Ok good news, I'm rebasing an older test env and wanted both UI and containers :)15:49
shardymwhahaha: Ok thanks, I'll give it a go15:49
*** slaweq has joined #tripleo15:49
shardyas a side note setting containerized_undercloud: true is no longer enough to actually deploy a containerized undercloud ;)15:49
mwhahahashardy: in oooq?15:50
shardylooks like I'm missing undercloud_install_cli_options: " --use-heat" and maybe some other stuff15:50
jristyeah should work15:50
shardyhttps://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset027.yml#L1615:50
jristshadower: yeah --use-heat for now15:50
jristshardy: ^15:50
shardymwhahaha: yeah, looks like that boolean doesn't set all the right vars, I'll push a patch when I figure out what's missing15:50
jristshadower: disregard :)15:50
mwhahahashardy: yea we haven't fully cut over15:50
*** ssbarnea_ has joined #tripleo15:51
shardyjrist: Ok thanks for confirming, I'll kick off another oooq run :)15:51
*** suuuper has quit IRC15:51
*** leitan has quit IRC15:51
jristgood luck!15:51
jristI'm doing one right now :)15:51
*** zshi has joined #tripleo15:53
*** bdodd is now known as bdodd|afk15:54
EmilienMshardy: I tried last week and it worked15:55
shardyEmilienM: ack thanks for the info15:57
*** mburned_out is now known as mburned15:57
*** ssbarnea_ has quit IRC15:58
*** avivgt has quit IRC15:59
*** ffiore has quit IRC15:59
openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044516:00
*** marios has quit IRC16:01
*** kopecmartin has quit IRC16:03
*** arxcruz|rover is now known as arxcruz|ruck16:03
*** yamahata has quit IRC16:04
*** dprince has joined #tripleo16:04
dpeacockmwhahaha: Ping - can you take another look at https://review.openstack.org/#/c/564830/ when you get a chance please?  I noticed just now it's lingering.16:04
mwhahahadpeacock: it's merged?16:05
*** bdodd|afk is now known as bdodd16:05
dpeacockNot as far as I can tell.16:05
dpeacockThe related patches merged already16:05
*** pchavva has quit IRC16:06
mwhahahadpeacock: May 9 12:44 PM16:06
mwhahahadpeacock: Change has been successfully merged by Zuul16:06
mwhahahadpeacock: now, https://review.openstack.org/#/c/568727 is not merged16:06
mwhahahabut i can't do anything with that16:06
*** udesale has quit IRC16:07
mwhahahathat's something for the TC probably after the summit16:07
dpeacockSorry - think I pasted wrong link - https://review.openstack.org/#/c/564823/16:07
mwhahahai can just +116:07
mwhahahathat's an infra thing, also probably needs to wait for teh summit16:07
dpeacockok - taa16:08
*** zoli is now known as zoli|gone16:11
*** zoli|gone is now known as zoli16:11
*** salmankhan has quit IRC16:12
*** jfrancoa has quit IRC16:15
*** jfrancoa has joined #tripleo16:16
*** links has quit IRC16:16
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add acl to paths that are shared among related neutron processes  https://review.openstack.org/56765516:17
*** slaweq has quit IRC16:19
*** salmankhan has joined #tripleo16:19
*** janki has quit IRC16:19
*** bdodd is now known as bdodd|afk16:21
*** olap has quit IRC16:21
*** bdodd|afk is now known as bdodd16:22
*** morazi has quit IRC16:23
*** ykarel|afk has quit IRC16:24
*** dbecker has quit IRC16:24
*** pkovar has quit IRC16:24
*** slaweq has joined #tripleo16:24
gfidentemwhahaha jaosorior do you guys know if from the output of the heat stack or in hiera we have a list of the IPs member of a given role?16:26
*** gvrangan has joined #tripleo16:26
*** masco has quit IRC16:26
mwhahahagfidente: good question16:26
mwhahahagfidente: i assume we do somewhere because we use it for the inventory building in newer versions16:27
mwhahahacause ansible knows :D16:27
*** dciabrin_ has quit IRC16:27
*** jfrancoa has quit IRC16:27
gfidentemwhahaha ah let me check that code16:27
*** dciabrin_ has joined #tripleo16:27
*** pcaruana|afk| has joined #tripleo16:29
*** nyechiel_ has quit IRC16:30
*** dxiri has joined #tripleo16:31
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Add a way to override base path when file driver is used  https://review.openstack.org/57022616:31
jaosoriorgfidente: you could get that info from ansible using groups16:31
jaosoriornot sure if we have such a thing in hiera though16:32
*** radek__ has quit IRC16:33
*** radeks has quit IRC16:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: upgrade: remove packages at step 3  https://review.openstack.org/57011616:35
*** gvrangan has quit IRC16:36
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Make standalone role name configurable  https://review.openstack.org/56837816:37
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Start standalone.conf  https://review.openstack.org/56947416:37
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Move undercloud.conf to the undercloud config namespace  https://review.openstack.org/56947716:37
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: WIP: Handle config loading in tripleo deploy  https://review.openstack.org/56953516:37
gfidentejaosorior mwhahaha https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L100916:38
gfidentethat's it16:38
mwhahahasee i knew it was there somewhere :D16:39
* mwhahaha keeps pretending like he knows what he's doing16:39
*** gvrangan has joined #tripleo16:40
*** etingof|brb is now known as etingof16:40
*** gbarros has joined #tripleo16:41
*** zshi has quit IRC16:45
*** trozet_ is now known as trozet16:45
openstackgerritCarlos Goncalves proposed openstack/tripleo-common master: Fix Octavia amphora image RPM install  https://review.openstack.org/57016316:45
cgoncalvesshardy, jaosorior, beagles: I'm so sorry. can you revisit https://review.openstack.org/#/c/570163/ ?16:46
*** slaweq has quit IRC16:46
*** zshi has joined #tripleo16:47
*** dprince has quit IRC16:47
*** janki has joined #tripleo16:47
trozetcan someone help me figure out why this job failed?  I see the deploy has RC 1, but I cannot find any indication of what actually failed: http://logs.openstack.org/05/486905/36/experimental/tripleo-ci-centos-7-scenario008-multinode-oooq/ccf868a/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz16:47
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates master: Rename Dell EMC XTREMIO iSCSI environment file  https://review.openstack.org/57023016:48
*** jpena is now known as jpena|off16:49
mwhahahatrozet: Timed out waiting for messages from Execution (ID: 0b0c1f9b-e476-41c1-820c-17c5069bcab4, State: RUNNING). The WebSocket timed out before the Workflow completed.16:51
*** bnemec has joined #tripleo16:51
mwhahahadat stderr/stdout mixing16:51
trozetmwhahaha: yeah i saw that, what does that websocket do...i remember seeing some code around that in tripleo-common16:51
*** slaweq has joined #tripleo16:51
*** pcaruana|afk| has quit IRC16:51
*** sshnaidm|rover is now known as sshnaidm|off16:52
*** gbarros has quit IRC16:52
mwhahahatrozet: so the deploy command polls for results from the workfloows via websocket16:53
*** shreshtha has quit IRC16:53
mwhahahatrozet: so the deploy probably hung and then hit a timeout16:53
mwhahahatrozet: since the last output was host config step3, i'd assume some sort of pacemaker problems16:54
mwhahahatrozet: that's generally what goes wrong around step316:54
trozetmwhahaha: yeah i was just about to say we dont do anything in step 3 for odl16:54
*** dparkes has joined #tripleo16:55
openstackgerritMerged openstack/tripleo-ha-utils master: Fix the last old repository references  https://review.openstack.org/57021016:55
*** elgxl has joined #tripleo16:55
*** janki has quit IRC16:56
trozetmwhahaha: ok thanks i'll try again and see what happens16:56
trozetbtw lol @ Welcome to Rocky. CI status: GREEEEEEEEN (maybe)16:56
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates master: Add OPNFV scenario environment  https://review.openstack.org/48690516:57
*** holser__ has quit IRC16:57
*** slaweq has quit IRC16:58
*** dtantsur is now known as dtantsur|afk16:59
*** derekh has quit IRC17:00
*** shreshtha has joined #tripleo17:00
*** trown is now known as trown|lunch17:00
*** ssbarnea_ has joined #tripleo17:01
*** noslzzp has joined #tripleo17:01
*** pchavva has joined #tripleo17:04
*** florianf has quit IRC17:05
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Fix upgrade_tasks for TripleO UI  https://review.openstack.org/57023717:05
*** shreshtha has quit IRC17:06
*** gbarros has joined #tripleo17:06
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: upgrade: remove packages at step 3  https://review.openstack.org/57011617:07
*** rpioso is now known as rpioso|eat17:09
*** cshastri has joined #tripleo17:09
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: nova-ironic: add support for post-upgrade cleanup  https://review.openstack.org/57024117:10
*** slaweq has joined #tripleo17:11
*** pkovar has joined #tripleo17:11
*** amoralej is now known as amoralej|off17:12
*** gvrangan has quit IRC17:12
*** zaneb has joined #tripleo17:12
*** gvrangan has joined #tripleo17:13
*** salmankhan has quit IRC17:15
*** slaweq has quit IRC17:15
*** homegrown has joined #tripleo17:16
*** anilvenkata has quit IRC17:19
*** elgxl has quit IRC17:23
*** elgxl has joined #tripleo17:24
redrobotOhai, TripleO friends!  I'm new here.  Looking forward to working with y'all.17:24
*** gfidente is now known as gfidente|afk17:26
*** bnemec has quit IRC17:28
*** elgxl has quit IRC17:28
*** leitan has joined #tripleo17:30
mwhahaharedrobot: oh noes not you17:31
mwhahahaalso, welcome17:32
*** gvrangan has quit IRC17:32
*** gvrangan has joined #tripleo17:34
*** matbu has quit IRC17:35
*** noslzzp has quit IRC17:35
*** cshastri has quit IRC17:37
redrobothehe17:37
*** tesseract has quit IRC17:38
*** bdodd is now known as bdodd|afk17:39
*** gbarros has quit IRC17:41
*** gvrangan has quit IRC17:41
*** mvenesio_ has joined #tripleo17:43
*** mvenesio has quit IRC17:43
*** gvrangan has joined #tripleo17:45
*** ssbarnea_ has quit IRC17:45
*** bdodd|afk is now known as bdodd17:45
*** zaneb has quit IRC17:46
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Mount ODL log file on host node  https://review.openstack.org/56746917:48
*** mburned is now known as mburned_out17:48
*** salmankhan has joined #tripleo17:50
*** slaweq has joined #tripleo17:50
*** colonwq has quit IRC17:53
*** pcaruana has joined #tripleo17:55
*** gbarros has joined #tripleo17:56
*** hamzy has joined #tripleo17:56
*** anilvenkata has joined #tripleo17:57
*** elgxl has joined #tripleo17:58
*** matbu has joined #tripleo17:59
*** jtomasek has joined #tripleo18:00
*** ohochman has quit IRC18:02
*** gvrangan has quit IRC18:03
*** gbarros has quit IRC18:03
*** jtomasek has quit IRC18:04
*** dhill_ has joined #tripleo18:05
*** nyechiel_ has joined #tripleo18:08
*** mburned_out is now known as mburned18:08
*** rpioso|eat is now known as rpioso18:12
*** elgxl has quit IRC18:15
*** elgxl has joined #tripleo18:16
*** salmankhan has quit IRC18:17
*** trown|lunch is now known as trown18:17
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Pass --ssh-user option during fast forward upgrade run  https://review.openstack.org/57024518:17
*** slaweq_ has joined #tripleo18:19
*** elgxl has quit IRC18:19
openstackgerritMerged openstack/tripleo-quickstart-extras master: Remove hardcoded cinder v1 option for tempestconf  https://review.openstack.org/56877618:20
openstackgerritMerged openstack/python-tripleoclient stable/queens: Refactor, fix ansible inventory method parameters for ffwd-upgrade run  https://review.openstack.org/56723318:20
openstackgerritMerged openstack/tripleo-common stable/queens: Add special 'all' for deploy_on_servers server name to match all  https://review.openstack.org/56753818:20
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade stable/queens: DNM: Run enable-ssh-admin.sh script before fast forward run  https://review.openstack.org/57007418:22
*** slaweq has quit IRC18:22
*** jtomasek has joined #tripleo18:22
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade stable/queens: DNM: Run enable-ssh-admin.sh script before fast forward run  https://review.openstack.org/57007418:24
*** matbu has quit IRC18:25
*** jtomasek has quit IRC18:26
mcorneaEmilienM: hi could you please check https://review.openstack.org/#/c/570091/ when you get a minute?18:28
*** ohochman has joined #tripleo18:28
*** alee has joined #tripleo18:30
*** pkovar has quit IRC18:31
*** slaweq_ has quit IRC18:34
*** jtomasek has joined #tripleo18:34
*** hamzy has quit IRC18:35
*** slaweq has joined #tripleo18:39
openstackgerritMatt Young proposed openstack/tripleo-quickstart master: DNM: testing rhos-13 thirdparty gate  https://review.openstack.org/56728118:41
*** mburned is now known as mburned_out18:42
*** nyechiel_ has quit IRC18:42
*** hamzy has joined #tripleo18:44
*** leitan has quit IRC18:44
*** leitan has joined #tripleo18:44
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: Disallow SSLv2, SSLv3 and TLS1.0 in rabbitmq for FedRAMP compliance  https://review.openstack.org/56744318:45
*** jtomasek has quit IRC18:46
*** zaneb has joined #tripleo18:47
*** leitan has quit IRC18:49
*** loacker has joined #tripleo18:52
*** slaweq_ has joined #tripleo18:53
*** Guest75989 has quit IRC18:54
*** slaweq has quit IRC18:56
*** zaneb has quit IRC18:58
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Enhance completion message when upgrading non controller nodes  https://review.openstack.org/56979419:01
*** fragatina has quit IRC19:01
*** matbu has joined #tripleo19:02
*** trwyth has joined #tripleo19:03
*** rlandy|rover is now known as rlandy|rover|bia19:04
*** edmondsw has joined #tripleo19:04
*** dpeacock has quit IRC19:04
*** rlandy|rover|bia is now known as rlandy|rvr|biab19:04
*** jaganathan has quit IRC19:06
*** salmankhan has joined #tripleo19:07
*** matbu has quit IRC19:08
*** anilvenkata has quit IRC19:09
*** dpeacock has joined #tripleo19:09
*** leanderthal has quit IRC19:13
*** gkadam has quit IRC19:13
*** edmondsw_ has joined #tripleo19:14
*** jaganathan has joined #tripleo19:14
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Fix 3node deployment  https://review.openstack.org/57025219:15
*** edmondsw has quit IRC19:16
*** trown is now known as trown|brb19:22
*** trwyth has quit IRC19:22
*** bdodd is now known as bdodd|afk19:23
*** bdodd|afk is now known as bdodd19:27
*** radeks has joined #tripleo19:27
*** nyechiel_ has joined #tripleo19:28
*** morazi has joined #tripleo19:29
*** radeks_ has joined #tripleo19:29
*** hamzy has quit IRC19:30
*** slaweq_ has quit IRC19:30
*** edmondsw_ has quit IRC19:31
*** edmondsw has joined #tripleo19:32
*** radeks has quit IRC19:33
*** loacker has quit IRC19:34
*** dhill_ has quit IRC19:35
*** edmondsw_ has joined #tripleo19:36
*** edmondsw has quit IRC19:36
*** alee has quit IRC19:38
*** edmondsw_ has quit IRC19:41
openstackgerritMerged openstack/python-tripleoclient master: Update HostnameMap generation  https://review.openstack.org/56795119:46
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Use str_replace for known_hosts  https://review.openstack.org/56990919:46
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Don't use crudini to get rhn server  https://review.openstack.org/56918019:46
openstackgerritMerged openstack/tripleo-common stable/queens: Add validation for empty file system backup on Undercloud  https://review.openstack.org/56825019:46
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Fix cinder-backup image wrangling on update  https://review.openstack.org/56914619:46
*** trown|brb is now known as trown19:48
*** mburned_out is now known as mburned19:55
*** zshi has quit IRC19:56
openstackgerritMerged openstack/tripleo-common stable/queens: Persist package update ansible logs  https://review.openstack.org/56585319:57
openstackgerritMerged openstack/python-tripleoclient stable/queens: Update Heat stack on update/upgrade/ffwd converge  https://review.openstack.org/56724319:57
openstackgerritMerged openstack/tripleo-validations stable/queens: Fail if the Overcloud inventory is empty  https://review.openstack.org/56688119:57
openstackgerritMerged openstack/python-tripleoclient stable/queens: Add .deployment.v1.deploy_on_servers to ffwd-upgrade prepare  https://review.openstack.org/56860419:57
openstackgerritMerged openstack/python-tripleoclient stable/queens: Add exclude-path to undercloud backups  https://review.openstack.org/56821019:57
openstackgerritMerged openstack/tripleo-common stable/queens: Find deployment name in config download  https://review.openstack.org/56724919:57
openstackgerritMerged openstack/tripleo-heat-templates master: Don't delete br-ex on upgrade in multinode jobs  https://review.openstack.org/56978119:57
openstackgerritMerged openstack/tripleo-ui master: Reinstate logout link id  https://review.openstack.org/56099219:57
openstackgerritMerged openstack/tripleo-ui master: Add an id to the DropdownToggle in UserDropdown  https://review.openstack.org/56121119:57
*** nyechiel_ has quit IRC20:01
*** pchavva has quit IRC20:06
*** salmankhan has quit IRC20:07
*** rlandy|rvr|biab is now known as rlandy|rover20:08
*** slaweq_ has joined #tripleo20:10
*** holser__ has joined #tripleo20:11
*** slaweq_ has quit IRC20:15
*** alee has joined #tripleo20:20
*** hamzy has joined #tripleo20:22
*** eck` is now known as eck`gone20:23
*** eck`gone is now known as eck`20:24
*** trown is now known as trown|outtypewww20:26
*** noslzzp has joined #tripleo20:27
*** mcornea has quit IRC20:28
*** mvenesio_ has quit IRC20:28
*** pcaruana has quit IRC20:28
*** mvenesio has joined #tripleo20:29
*** raildo has quit IRC20:29
*** noslzzp_ has joined #tripleo20:29
*** noslzzp has quit IRC20:30
*** lblanchard1 has quit IRC20:32
*** mvenesio has quit IRC20:33
*** slaweq has joined #tripleo20:34
*** noslzzp_ has quit IRC20:35
*** nyechiel_ has joined #tripleo20:39
*** mcornea has joined #tripleo20:42
*** mburned is now known as mburned_out20:46
*** morazi has quit IRC20:47
*** edmondsw has joined #tripleo20:49
*** bdodd is now known as bdodd|afk20:49
*** slaweq has quit IRC20:49
*** slaweq has joined #tripleo20:51
stevebakermorning20:52
*** edmondsw has quit IRC20:53
mwhahahaahoy20:53
openstackgerritRyan Brady proposed openstack/tripleo-common master: [WIP]Fixes ordering of environment files in a deployment plan  https://review.openstack.org/57021520:55
*** bdodd|afk is now known as bdodd20:55
*** wolverineav has quit IRC20:56
*** wolverineav has joined #tripleo20:56
*** bdodd is now known as bdodd|afk20:56
*** bdodd|afk is now known as bdodd20:56
openstackgerritAlan Bishop proposed openstack/puppet-tripleo master: Add missing parameters for Cinder Netapp backend  https://review.openstack.org/57025620:57
*** rbrady has joined #tripleo21:00
*** wolverineav has quit IRC21:00
*** radeks_ has quit IRC21:00
*** rbrady is now known as Guest1906021:01
*** zshi has joined #tripleo21:01
*** alee has quit IRC21:03
*** fragatina has joined #tripleo21:03
*** slaweq_ has joined #tripleo21:05
*** abishop has quit IRC21:08
*** slaweq has quit IRC21:08
*** trwyth has joined #tripleo21:09
*** edmondsw has joined #tripleo21:09
*** nyechiel_ has quit IRC21:09
*** morazi has joined #tripleo21:10
*** vpickard is now known as vpickard_21:10
*** gfidente|afk has quit IRC21:12
*** nyechiel_ has joined #tripleo21:20
*** nyechiel_ has quit IRC21:25
*** slaweq_ has quit IRC21:30
*** edmondsw has quit IRC21:33
*** wolverineav has joined #tripleo21:34
*** bdodd is now known as bdodd|afk21:36
*** bfournie has quit IRC21:38
*** bfournie has joined #tripleo21:38
*** wolverineav has quit IRC21:38
*** bfournie has quit IRC21:38
*** matbu has joined #tripleo21:38
*** holser__ has quit IRC21:39
EmilienMmcornea: of course21:39
*** zaneb has joined #tripleo21:41
*** slaweq has joined #tripleo21:41
*** pradk has quit IRC21:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove UpgradeRemoveUnusedPackages from undercloud-upgrade-prepare.yaml  https://review.openstack.org/56932321:45
*** zaneb has quit IRC21:47
*** alee has joined #tripleo21:48
*** gunix has left #tripleo21:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Fix upgrade_tasks for TripleO UI  https://review.openstack.org/57023721:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Fix upgrade_tasks for TripleO UI  https://review.openstack.org/57023721:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: upgrade: remove packages at step 3  https://review.openstack.org/57011621:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: nova-ironic: add support for post-upgrade cleanup  https://review.openstack.org/57024121:51
*** zaneb has joined #tripleo21:53
*** morazi has quit IRC21:56
stevebakerEmilienM: hey, do you know what creates br-ctlplane during containerised undercloud install? All I see is instack-undercloud running os-net-config21:58
dsneddonstevebaker, The OVS bridge still gets created outside of the container, because we use "host networking". The problem is that you still can't attach containers directly to VLANs inside the container, so the container host has to be attached to the VLAN through the bridge, and the container inherits that.22:01
EmilienMstevebaker: hey oh hi22:01
EmilienMhttps://github.com/openstack/tripleo-heat-templates/blob/e64c10b9c13188f37e6f122475fe02280eaa6686/net-config-undercloud.j2.yaml#L6322:02
EmilienMthe containerized undercloud uses this net-config22:02
EmilienMin fact in CI we use this one : https://github.com/openstack/tripleo-heat-templates/blob/e64c10b9c13188f37e6f122475fe02280eaa6686/ci/common/net-config-simple-bridge.yaml#L5022:02
*** matbu has quit IRC22:02
stevebakerdsneddon: this is for the undercloud container registry, which binds to the ip on br-ctlplane22:02
stevebakerEmilienM: ok, that sounds like something else which needs to happen during undercloud init22:03
dsneddonstevebaker, I thought you were asking where br-ctlplane is created, and that happens in the os-net-config template that EmilienM pasted.22:03
*** noslzzp has joined #tripleo22:06
EmilienMstevebaker: lol nice one :P22:07
EmilienMstevebaker: network init :)22:07
stevebakerugh, can't we just bind the container registry to *?22:08
EmilienMstevebaker: on 0.0.0.0 ?22:09
stevebakeryeah22:09
EmilienMaccording to doc, yes https://docs.docker.com/registry/deploying/#customize-the-published-port22:10
EmilienMbut I haven't tried22:10
EmilienMI can try, give me one sec22:10
stevebakerhaving to run os-net-config earlier than undercloud install will be a real pita22:11
*** noslzzp has quit IRC22:11
EmilienMyeah it worked22:11
EmilienM/etc/docker-distribution/registry/config.yml22:11
EmilienMI changed to 0.0.0.0 and it worked22:11
stevebakerEmilienM: any objection to 0.0.0.0 being the default in the role instead of localhost?22:12
EmilienMtcp        0      0 undercloud.loca:msgsrvr 0.0.0.0:*               LISTEN      root       50219      14928/registry22:12
EmilienMso yeah it was well binded22:12
EmilienMas msgsrvr is 8787 port in /etc/services22:12
EmilienMstevebaker: I'm fine22:13
stevebakercool22:13
EmilienMmwhahaha: did you have a chance to read our conversation with stevebaker about init steps we want to run before a deploy?22:13
EmilienMin summary, we said:22:13
mwhahahano when was that?22:14
EmilienMwe would like a step, openstack tripleo init, that would do idempotent things like deploy docker, do netconfig22:14
EmilienMand by default it would also run in the deploy in case it wasn't run before22:14
EmilienMmwhahaha: yesterday on IRC around that time or maybe later in the evening I guess22:14
openstackgerritSteve Baker proposed openstack/ansible-role-container-registry master: Listen to all interfaces by default  https://review.openstack.org/57026922:15
mwhahahaEmilienM: do you mean for standalone?22:15
* mwhahaha is unsure context22:15
stevebakermwhahaha: the problem I'm trying to solve is that docker and registry needs to be set up before undercloud install, so the undercloud images can be prepared. So we're proposing a "tripleo init" command be added which invokes the container-registry role22:16
mwhahahai scrolled up and read22:17
stevebakerI'm hoping netconfig can still happen during undercloud install22:17
stevebakerbut container images are becoming as foundational as yum, so it needs to be set up22:17
mwhahahait sounds like we need to extract out the undercloud hostprep but have a hook for container prep things that could be done before the actuald eployment22:18
mwhahahaso i guess the question is what is the use case for this, would we actually customize containers prior to the undercloud install?22:19
mwhahahaor is that only for a standalone context22:19
stevebakermwhahaha: the end goal is a container-check type thing which does *all* required images for undercloud and overcloud in one hit. The output of this needs to be an environment file which both deploys can use. Thats why doing it during undercloud install doesn't quite fit. Its not obvious why an "undercloud install" command would generate an environment file to be consumed by "overcloud install"22:21
*** rcernin has joined #tripleo22:21
mwhahahai don't think you can do both in one hit22:22
mwhahahabecause you don't know what the overcloud is actually going to deploy at undercloud install time22:22
mwhahahabut from a deployment framework standpoint, being able to execute the container bits at any specific point in the deployment could be leveraged for both cases22:22
stevebakerwe could with a bit of oooq refactoring. But maybe it will no longer be practical to filter images by containerised service detection, so it would have to be driven by role data filtering only22:23
mwhahahawhat's the use case? CI only?22:23
stevebakermwhahaha: doing container-check twice for the same images would be quite slow. And yes this is likely a CI use case onely]22:24
mwhahahaif it's not CI only then oooq is not something that should be considered22:24
mwhahahaer that's wrong22:25
*** hamzy has quit IRC22:25
*** slaweq has quit IRC22:25
stevebakerI think its CI only22:25
mwhahahaif it's CI only then oooq is something that could be considered22:25
mwhahahabut if we ever want this to be used by a user (or other downstream process) then we should keep it in tripleo stuff22:25
*** rlandy|rover is now known as rlandy|rover|bbl22:26
mwhahahayou could consider this a standalone thing to standup a seperate repo somewhere, do work, populate it and then just pass it as the source for undercloud/overcloud installations22:26
mwhahahathat would be beneficial if we replaced either the oooq or tripleo containers registry to use something other than docker22:27
* mwhahaha wished we used something like rkt which can pull from an http endpoint22:27
stevebakeractually there might be a way for undercloud and overcloud to do their own prepare, but no duplicate rebuilding to happen. Let me have a think22:27
stevebakermwhahaha, EmilienM: I need a job where both the undercloud and overcloud are containerised, and they both have a container-check job run on them. Is there such a thing yet?22:28
mwhahahano22:29
mwhahahawe don't run container-check on containerized undercloud yet22:29
mwhahahaprimarily because this problem22:29
stevebakerwhich job might that be added to?22:29
mwhahahawell if you wanted to tackle the containerized undercloud problem you could just do that first22:29
*** alee has quit IRC22:29
mwhahahai think that's really the issue22:29
mwhahahatrying to figure out how to populate an outside docker registry with containers then pull it in to the undercloud install22:30
mwhahahabut we provide the container registry file in the undercloud install so it's figuring out how to do that22:30
mwhahahabut then you lose coverage on that part of the installation22:30
* mwhahaha wishes for a whiteboard for this conversation22:31
stevebakermwhahaha: This sounds like it can all be done with the tripleo-modify-image role being invoked during install. It seems to be working on the overcloud tests https://review.openstack.org/#/c/569866/ https://review.openstack.org/#/c/569696/22:31
*** alee has joined #tripleo22:32
mwhahahastevebaker: yea we run that every install, but the problem is where do you stick the output22:33
stevebakermwhahaha: the output images? in the undercloud registry22:33
mwhahahastevebaker: right but that doesn't exist until the undercloud is installed22:33
*** akrivoka has quit IRC22:34
mwhahahastevebaker: so you can't do that for the containerized undercloud install because it doesn't exist yet22:34
stevebakermwhahaha: ok, let me walk you through the sequence22:34
mwhahahayea that's why i wanted a whiteboard :D22:34
stevebaker1. something (oooq) writes out the prepare parameter like this https://review.openstack.org/#/c/569696/3/roles/overcloud-prep-containers/templates/containers-prepare-parameter.yaml.j222:35
stevebaker2. undercloud.conf refers to this file22:36
*** edmondsw has joined #tripleo22:37
stevebaker3. undercloud install starts, some early thing runs the container-registry role (I think this is missing currently)22:37
*** matbu has joined #tripleo22:37
stevebaker4. kolla_builder.container_images_prepare_multi is run during tripleo deploy22:38
stevebaker5. this triggers pull/modify/push to undercloud registry, generates environment parameters pointing to modified images22:38
stevebaker6. ...22:38
stevebaker7. profit22:38
mwhahahaso why does 3 need to happen?22:39
mwhahahahmm ok wait let me think22:39
stevebakerbecause 4. needs a registry to push to22:39
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade stable/queens: DNM: Run enable-ssh-admin.sh script before fast forward run  https://review.openstack.org/57007422:39
mwhahahaok so i think that's my disconnect, wby can't the deploy have 4 injected into it?22:39
mwhahahalike an internal update containers step22:40
stevebakerso either we do 3 early in "undercloud install" or "tripleo deploy", or we create an earlier command like "tripleo init"22:40
mwhahahastevebaker: i'd rather not because then we lose the customer workflow where the install creates the registry in the undercloud22:40
*** mcornea has quit IRC22:40
mwhahahaso my thought is injecting a step into the deployment that maybe calls the tripleo image prepare would work22:41
stevebakermwhahaha: one reason is because the running heat which does the tripleo deploy is containerised, so its too late for heat22:41
mwhahahano22:41
*** alee has quit IRC22:41
mwhahahawe stand up the standalone heat and ansible can call it22:41
stevebakeroh its a host process?22:41
mwhahahalet me describe my thought22:41
mwhahahayea22:41
*** edmondsw has quit IRC22:41
mwhahahaunless you specify to use a heat container22:41
mwhahahabut we don't22:41
stevebakerI thought we were containerised by default22:42
mwhahahaso no22:42
stevebakerok, that changes some22:42
mwhahahathe heat we use in the install is a standalone process22:42
mwhahahathere is an option to use a container but that is not currently enabled22:42
mwhahahabecause it required docker be pre-setup22:42
mwhahahawhich is this problem22:42
openstackgerritRyan Brady proposed openstack/python-tripleoclient master: Changes Creation Of overcloudrc File to Call Workflow  https://review.openstack.org/54535122:42
mwhahahastevebaker: so let me describe what i was thinking22:42
mwhahaha1) same as yours22:42
mwhahaha2) same as yours22:42
mwhahaha3) we update the deployment steps to identify that this configuration is set, inject ansible tasks to perform the prepare after we setup docker in the deployment22:43
*** bfournie has joined #tripleo22:43
mwhahaha4) these commands push to the container registry we setup during the install22:43
mwhahaha5) configure continues22:43
mwhahahaso really it makes docker a hostprep step22:43
mwhahahathose aren't containerized22:43
stevebakerwell isn't it convenient that ContainerImagePrepare is a heat parameter. I never imagined that heat would consume it for real ;)22:44
mwhahahaand so we'd need a host prep task that would be undercloud specific but it runs the image prepare/mangling22:44
mwhahahawhat's missing from the current bits is the ansible needed to run whatever code you have22:44
mwhahahabasically containerized undercloud it's heat generates ansible -> ansible does all the things22:45
mwhahahathe heat instance is a standalone process so we don't need docker up yet22:45
stevebakermwhahaha: I think all it needs is something in t-h-t running "openstack tripleo container image prepare" straight after the registry is set up22:45
mwhahahathere is support in the framework to docker exec a heat container but that's likely something we would not use in ci22:45
mwhahahastevebaker: right so we just need to come up with the host prep steps to do that in the framework22:45
mwhahahastevebaker: for most deploys it would be off (like a customer) but for CI we can enable it and have the containers updated22:46
stevebakermwhahaha: prepare would always run, but customers generally wouldn't have modify_role things in their ContainerImagePrepare, unless they're building a 3rd-party image on the fly22:48
*** lebauce_ has quit IRC22:48
mwhahahastevebaker: yea that's what i mean, the modify bits22:48
mwhahahastevebaker: because the prepare is what we have today where we generate the urls to use the upstream locations22:48
mwhahahastevebaker: the modify is the pull containers from A, apply B changes, upload to C, update references container locations to C/latest22:49
stevebakermwhahaha: yes, default prepare data will pull from upstream, but discover versioned tags22:49
stevebakermwhahaha: ok I'll look into doing this now. Reviews on these would help https://review.openstack.org/#/c/569688/ https://review.openstack.org/#/c/567427/22:50
*** dtrainor has joined #tripleo22:51
stevebakeroh you reviewed the second22:51
stevebakermwhahaha: then the one remaining bit to deal with is some logic in oooq to detect images modified for the undercloud so they don't get modified again for the overcloud, but that is an optimisation22:53
mwhahahastevebaker: so i think we should be able to handle that in the input convention if we like use the tag as a hash of the rpms we're applying or something22:54
mwhahahastevebaker: but yes, we'd only want to do the adjustment once22:54
*** slaweq has joined #tripleo22:54
*** bdodd|afk is now known as bdodd22:55
*** dtrainor has quit IRC22:55
stevebakermwhahaha: I'm thinking we should call prepare here instead of creating a whole new "service" file https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/docker-registry.yaml#L6723:00
mwhahahastevebaker: yes i think that's an OK spot23:00
mwhahahastevebaker: additional services in heat also has an impact on deployment times23:01
* mwhahaha needs to file a bug for that23:01
*** zaneb has quit IRC23:02
stevebakermwhahaha: I think that is a known issue for OS::Heat::ResourceChain which is hard to optimise23:05
mwhahahastevebaker: yea but even if you OS::Heat::None all the services it takes forever23:05
mwhahahaso it's the creation of the heat bits around that23:05
mwhahahawhich is why we've gotten progressively slower in deployments because our resource registry has a bunch of services23:06
mwhahahaso for every 3rdparty entry we add time for heat to process those23:06
mwhahahai tested it on the standalone stuff and it's pretty awful23:06
mwhahahathat's the next thing we need to make dynamic so we don't always include all those services if we don't have to23:06
*** noslzzp has joined #tripleo23:07
stevebakeryep, sounds like a plan23:07
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Don't run swift on 3node  https://review.openstack.org/57027523:07
EmilienMmwhahaha: ^ how do you share images?23:08
mwhahahaEmilienM: ?23:08
mwhahahaEmilienM: so it's about populating the local repository during the deployment23:08
mwhahahaEmilienM: So in what I described, we'd actually switch out the heat references to use the undercloud registry, but populated it during the registry setup23:09
mwhahahaEmilienM: This is an optimization as well because it would preload the images into the local docker registry during installation and then we would fail at that point rather than later during say the nova-api container deployment23:09
mwhahahaEmilienM: so the overcloud gets the updated containers for free since they are already loaded in the undercloud23:10
mwhahahathe docker/docker-registry setup is done before any docker launches23:10
mwhahahabecause it's a hostprep step23:10
*** matbu has quit IRC23:10
mwhahahaessentially being step123:10
*** hamzy has joined #tripleo23:10
stevebakerEmilienM: I think images can be shared, either with a change in tripleo-common or oooq23:11
mwhahahaso at step2 we'd have docker available and the containers loaded into the local repo23:11
mwhahahait's likely an oooq where we populate the container images references ahead of time23:11
mwhahahaor you could add something into the image prepare to layer a query against the underclodu registry first, then fall back to upstream23:12
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add acl to paths that are shared among related neutron processes  https://review.openstack.org/56765523:12
mwhahahakinda like a yum-priorites but for containers23:12
mwhahahaanyway23:12
* mwhahaha wanders off23:12
EmilienMmwhahaha: I was talking about 3nodes23:16
*** lebauce_ has joined #tripleo23:19
*** noslzzp has quit IRC23:20
*** slaweq has quit IRC23:20
*** toure is now known as toure|gone23:21
openstackgerritMarius Cornea proposed openstack/tripleo-quickstart master: DNM: Remove ceph from fast forward upgrade job  https://review.openstack.org/57027823:24
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade stable/queens: DNM: Run enable-ssh-admin.sh script before fast forward run  https://review.openstack.org/57007423:25
openstackgerritMarius Cornea proposed openstack/tripleo-quickstart master: DNM: Remove ceph from fast forward upgrade job  https://review.openstack.org/57027823:33
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade stable/queens: DNM: Run enable-ssh-admin.sh script before fast forward run  https://review.openstack.org/57007423:33
*** nyechiel_ has joined #tripleo23:33
*** slaweq has joined #tripleo23:34
openstackgerritMerged openstack/python-tripleoclient master: Fallback the default roles file for UC config  https://review.openstack.org/56999223:35
*** slaweq_ has joined #tripleo23:37
*** edmondsw has joined #tripleo23:37
*** slaweq has quit IRC23:40
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Save and close stdout on exit  https://review.openstack.org/57009423:40
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add log directory option to functional tests  https://review.openstack.org/57009523:40
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Rename output log files  https://review.openstack.org/57009623:40
openstackgerritIan Wienand proposed openstack/diskimage-builder master: WIP: native zuulv3 tests  https://review.openstack.org/56677923:41
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Reduce path length in PS4 for debug  https://review.openstack.org/57028223:41
*** pmannidi has joined #tripleo23:41
*** rh-jelabarre has quit IRC23:45
*** myoung is now known as myoung|off23:46
*** nyechiel_ has quit IRC23:47
*** bdodd is now known as bdodd|afk23:47
*** slaweq_ has quit IRC23:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - add missing services for upgrade cleanup  https://review.openstack.org/57028323:54
*** trwyth has quit IRC23:54
*** bdodd|afk is now known as bdodd23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!