Tuesday, 2018-10-23

*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791800:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819500:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179866400:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]00:10
openstackLaunchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged]00:10
*** rcernin has joined #tripleo00:11
*** rcernin_ has quit IRC00:12
*** saneax has quit IRC00:13
*** rcernin has quit IRC00:13
*** rcernin has joined #tripleo00:14
*** saneax has joined #tripleo00:14
*** ssbarnea has joined #tripleo00:22
*** mjturek has quit IRC00:22
*** phuongnh has joined #tripleo00:46
*** gouthamr has joined #tripleo00:47
*** dmellado has joined #tripleo00:51
*** matbu has quit IRC00:57
*** matbu has joined #tripleo00:58
*** stevebaker has joined #tripleo01:06
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791801:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819501:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179866401:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]01:10
openstackLaunchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged]01:10
*** Vorrtex has quit IRC01:12
*** mschuppert has quit IRC01:21
*** mrsoul has quit IRC01:21
*** rlandy has quit IRC01:27
*** lblanchard has quit IRC01:29
*** thrash has quit IRC01:40
*** pvc has quit IRC01:43
*** trungnv has joined #tripleo01:44
*** thrash has joined #tripleo01:49
*** jidar has quit IRC01:49
*** saneax has quit IRC01:52
*** saneax has joined #tripleo01:53
*** sanjayu_ has joined #tripleo01:54
*** saneax has quit IRC01:55
*** jidar has joined #tripleo01:56
*** sanjayu_ has quit IRC01:58
*** sanjayu__ has joined #tripleo01:58
*** sanjayu__ has quit IRC02:00
*** saneax has joined #tripleo02:01
*** saneax has quit IRC02:06
*** saneax has joined #tripleo02:06
*** Ritzttk has joined #tripleo02:09
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791802:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819502:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179866402:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]02:10
openstackLaunchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged]02:10
*** saneax has quit IRC02:12
*** sanjayu_ has joined #tripleo02:12
*** jidar has quit IRC02:14
*** sanjayu_ has quit IRC02:25
*** jidar has joined #tripleo02:26
*** trungnv has quit IRC02:36
*** trungnv has joined #tripleo02:36
*** psachin has joined #tripleo02:57
*** hberaud has quit IRC02:58
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791803:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819503:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179866403:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]03:10
openstackLaunchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged]03:10
openstackgerritRabi Mishra proposed openstack/tripleo-heat-templates master: Set hierdata for swift server workers conditionally  https://review.openstack.org/61156803:11
*** ramishra has joined #tripleo03:12
openstackgerritNguyen Quang Huy proposed openstack/tripleo-quickstart master: Update value of VERBOSITY option  https://review.openstack.org/61255403:12
openstackgerritMerged openstack/tripleo-image-elements master: Increase size for security hardened images  https://review.openstack.org/60801503:21
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Use nova_api DB for [placement_database] -> connection  https://review.openstack.org/61161703:23
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Allow setting physical network MTU via heat template  https://review.openstack.org/61179403:23
*** saneax has joined #tripleo03:28
*** sanjayu_ has joined #tripleo03:30
*** saneax has quit IRC03:33
*** partlycloudy has quit IRC03:35
*** udesale has joined #tripleo03:58
openstackgerritMerged openstack/tripleo-heat-templates master: Implements: liquidio-containerization  https://review.openstack.org/60598204:07
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791804:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819504:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179866404:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]04:10
openstackLaunchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged]04:10
*** dsneddon has quit IRC04:11
*** rfolco|rover has quit IRC04:30
jaosorior.away04:32
jaosoriorGood morning folks!04:32
stevebakerjaosorior: hi!04:36
jaosoriorstevebaker: hey man! how's it going? Need any reviews?04:37
stevebakerjaosorior: hey, good here. I've got this refactor patch which I'm developing off locally, so reviews would help https://review.openstack.org/#/c/611237/04:38
stevebakerjaosorior: also this https://review.openstack.org/#/c/602104/04:39
jaosoriorstevebaker: got it, will check it out now (as coffee kicks in)04:39
stevebakerthanks04:40
stevebakerI'm about to knock off04:40
openstackgerritzhulingjie proposed openstack/ansible-role-container-registry master: use include_tasks instead of include  https://review.openstack.org/61256804:40
jaosoriorstevebaker: at this point (in master) we're no longer using skopeo, right?04:40
stevebakerjaosorior: for image inspection, correct04:40
openstackgerritzhulingjie proposed openstack/tripleo-heat-templates master: use include_tasks instead of include  https://review.openstack.org/61259204:41
openstackgerritzhulingjie proposed openstack/tripleo-quickstart master: use include_tasks instead of include  https://review.openstack.org/61259304:41
openstackgerritzhulingjie proposed openstack/tripleo-quickstart-extras master: use include_tasks instead of include  https://review.openstack.org/61259404:41
*** Petersingh has joined #tripleo04:41
jaosoriorstevebaker: I know you're about to log off, but do you have a little time to explain what was the issue there? I heard about it but never quite understood what it was or why.04:42
stevebakerjaosorior: there was 3 minor issues which added up to making it worth doing it in python:04:43
stevebakerjaosorior: 1. skopeo creates an unnecessary docker client, which was interacting poorly when run in the mistral container (bug #1797114)04:45
openstackbug 1797114 in tripleo "running skopeo in podman fails with "Error inspecting image"" [Medium,Fix released] https://launchpad.net/bugs/1797114 - Assigned to Emilien Macchi (emilienm)04:45
stevebakerjaosorior: 2. skopeo inspect wasn't making concurrent requests, so there is a bit of a speed gain in the python version04:46
stevebakerjaosorior: 3. better error path/404 handling, no need to scrape unstructured error output04:46
jaosorioraah got it04:47
jaosoriorstevebaker: thanks, just wanted to know what was up04:47
stevebakerjaosorior: right now I'm implementing "podman push" in python so we're unblocked on moving to buildah based image modify. right now skopeo copying to a registry is slow because it re-uploads every layer04:48
jaosoriorstevebaker: have these issues been raised to the folks working on skopeo? This sounds like quite a bummer :/04:49
stevebakerjaosorior: yes they have, apparently the fix requires quite a bit of pre-work. Having implemented enough of the API I suspect there is a fix which is a handful of lines, but I'll comment on their bug when I've got confirmation04:50
stevebakerjaosorior: there is a good argument for doing it in python anyway, because knowing every image/layer transferred allows extra optimisations to be made. "skopeo copy" only takes one src->dest04:52
stevebakerplus it'll be faaast once the concurrency is tweaked04:52
jaosoriornice :D04:52
ramishrastevebaker: Hey, morning/afternoon. long time... probably I don't understand a lot on the details above, but, are we not re-inventing the wheel to some extent in our way to use podman/buildah etc?04:53
stevebakerramishra: hey04:54
stevebakerramishra: are you talking specifically about image prepare transfers/inspect?04:55
ramishrastevebaker: yeah, sorry about making the general statement. From what I follow, it seems we're re-implementing stuff in python to avoid issues with the tools we're selecting04:56
*** janki has joined #tripleo04:59
stevebakerramishra: I think doing this is justified for the potential speed optimisations alone, and most of this work is just implementing the client side of a REST API. "skopeo copy" is a fine tool, but they didn't really envisage needing to squeeze every second out of transfering ~80 containers which share lots of layers05:02
*** yprokule has joined #tripleo05:02
stevebakerwe can't move to buildah for image modify until its fast enough for CI, so this is quite urgent and there has been no progress on this particular issue, so I'm keen to de-risk this thing05:04
stevebakerI'm retiring for the evening, later all05:07
ramishrastevebaker: OK, possibly makes sense, looking at some of the performace issues with these tools, but may not reduce the risk with fresh implementations:) probably I'll spend time to understand the details.05:07
ramishrastevebaker: bye, sorry to hold u, ttyl05:07
stevebakerramishra: no problem :)05:07
*** jfrancoa has joined #tripleo05:08
jaosoriorstevebaker: have a good one!05:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791805:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819505:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179866405:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]05:10
openstackLaunchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged]05:10
openstackgerritRabi Mishra proposed openstack/tripleo-quickstart-extras master: Set identity.region with tempestconf explicitly  https://review.openstack.org/61224505:13
*** ratailor has joined #tripleo05:18
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: WIP: Flatten Aodh service configuration  https://review.openstack.org/61118805:20
*** Ritzttk has quit IRC05:24
*** agurenko has joined #tripleo05:38
*** quiquell|off is now known as quiquell05:40
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: Adapt tqe for the new fedora28 job  https://review.openstack.org/61239005:48
*** spsurya has joined #tripleo05:49
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: Adapt tqe for the new fedora28 job  https://review.openstack.org/61239005:49
spsuryacores please review https://review.openstack.org/#/c/608888/05:50
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28  https://review.openstack.org/61046805:51
*** ksambor has joined #tripleo05:52
*** tzumainn has quit IRC05:54
*** mmagr has joined #tripleo05:59
*** dsneddon has joined #tripleo05:59
Tenguhello there06:03
jaosoriorTengu: good morning!06:04
*** dsneddon has quit IRC06:04
openstackgerritMartin André proposed openstack/tripleo-heat-templates stable/rocky: Let openshift-ansible configure the firewall  https://review.openstack.org/61260106:04
openstackgerritMartin André proposed openstack/tripleo-heat-templates stable/rocky: Do not modify imagestreams  https://review.openstack.org/61260206:04
openstackgerritMartin André proposed openstack/tripleo-heat-templates stable/rocky: Set openshift_docker_insecure_registries  https://review.openstack.org/61260306:04
openstackgerritMartin André proposed openstack/tripleo-heat-templates stable/rocky: Do not wipe disks on OpenShift gluster nodes  https://review.openstack.org/61260406:04
Tenguhow are you jaosorior ?06:04
jaosoriorall good here06:06
jaosoriorhjensas: around yet?06:06
jaosoriorTengu: what about you?06:06
Tengujaosorior: not bad :). Am late today because I decided to finish a book yesterday nigt - was epic :).06:06
jaosoriorwhich one?06:07
*** cylopez has joined #tripleo06:08
TenguWildcard, by Marie Lu. Sequel of Warcross06:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791806:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819506:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179866406:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]06:10
openstackLaunchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged]06:10
Tengujaosorior: sci-fi in a world where a new tech, NeuroLink, allows to walk through augmented reality or virtual world. And of course there are some issues and hacking :)06:10
*** sai_p has quit IRC06:12
*** cylopez has left #tripleo06:14
openstackgerritMerged openstack/python-tripleoclient stable/rocky: Use sync action get_deployment_failures  https://review.openstack.org/61216506:14
openstackgerritMerged openstack/tripleo-heat-templates master: Support for libvirt volume multipath  https://review.openstack.org/61165506:14
openstackgerritMerged openstack/puppet-tripleo master: Remove default value for cinder RBD backend_host  https://review.openstack.org/60832806:14
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Function to apply workarounds  https://review.openstack.org/61260606:21
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Fix variables for workaround variables.  https://review.openstack.org/61260706:21
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Allow specify Ceph upgrade workarounds.  https://review.openstack.org/61260806:22
*** mschuppert has joined #tripleo06:22
jaosoriormschuppert: hey, good morning06:23
mschuppertjaosorior: hi, morning06:23
jaosoriormschuppert: I think I figured out the issue with the vendor data06:24
mschuppertjaosorior: nice, what you think is it?06:24
jaosoriorhjensas: and this would explain also why the vendordata plugin is called several times06:24
jaosoriormschuppert: so... the configuration is used in two places: The compute driver (e.g. the ironic driver) and the metadata aPI06:25
jaosoriorthe compute driver uses it to generate the config drive, while the metadata api uses it whenever it gets a REST call that requests the vendordata06:25
*** dsneddon has joined #tripleo06:25
jaosoriornow, the way that it used to work was hacky as hell (just figured that out :D)06:25
jaosoriorwe have always configured the config-drive06:26
jaosoriorso it used to work so that the config drive requested the instance metadata which pulled the vendor data as well06:26
*** yolanda has quit IRC06:26
jaosoriorthis would pull the static json configuration from config drive, which configues the cloud-init script for the instance06:26
jaosoriorthe cloud-init script would then run (and remember, this happened because of config-drive)06:27
jaosoriornovajoin's cloud-init script (which was the one that was pulled from vendordata) would then call the metadata api06:27
*** holser_ has joined #tripleo06:27
jaosoriorthe metadata api then would use the vendordata configuration as well06:28
*** holser_ has quit IRC06:28
jaosoriorit used to work because we configured it globally (the metadata api pulled the same file as the compute)06:28
jaosoriorthe reason it doesn't work now, is because config-drive doesn't pull the static json config to load up the cloud-init script anymore06:29
*** holser_ has joined #tripleo06:29
jaosoriormschuppert: does that make sense?06:29
openstackgerritMerged openstack/tripleo-quickstart-extras master: Do not configure ara on undercloud by default  https://review.openstack.org/61171706:30
openstackgerritMerged openstack/tripleo-common stable/rocky: Don't add tarball to config-download dir  https://review.openstack.org/61216306:30
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: check mode: docker_puppet_tasks  https://review.openstack.org/61206806:30
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: check mode: paunch configs  https://review.openstack.org/61206906:30
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Name unnamed tasks  https://review.openstack.org/61207006:30
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Switch OpenShiftGlusterDisks to a single disk  https://review.openstack.org/61210106:30
openstackgerritMerged openstack/python-tripleoclient stable/pike: [Pike Only] Change docker img rendering variable to docker_namespace.  https://review.openstack.org/60864806:30
openstackgerritMerged openstack/puppet-tripleo stable/rocky: ceilometer: escape % in crontab  https://review.openstack.org/61142806:30
openstackgerritMerged openstack/python-tripleoclient stable/rocky: Validate routed networks enabled if multiple subnets in conf  https://review.openstack.org/61200406:30
openstackgerritMerged openstack/tripleo-quickstart master: Run scenario001-multinode-oooq-container job for config/* changes  https://review.openstack.org/60242506:30
openstackgerritMerged openstack/tripleo-common stable/rocky: Run NetworkDeployment as async task  https://review.openstack.org/61238706:30
openstackgerritMerged openstack/tripleo-heat-templates master: Dell EMC Sc: Add support for excluded_domain_ips  https://review.openstack.org/60444706:30
openstackgerritMerged openstack/python-tripleoclient stable/rocky: [Rocky only] Fix the docker registry url.  https://review.openstack.org/61159906:30
jaosoriormschuppert: with this in mind, I think it should be possible to add the vendordata configuration in two places: The metadata api and the compute.06:31
*** ccamacho has joined #tripleo06:31
jaosoriormschuppert: to properly fix this issue we need that, AND we need to make a release of novajoin. Given that hjensas recently added support for novajoin to fetch the metadata it needs from config-drive06:32
jaosoriorthis will ultimately result in fixing the issue of novajoin working with the metadata from two places AND resolve this issue of TLS everywhere not working06:33
mschuppertjaosorior: ok that sounds plausible. I still need to fully get it. I think my env deployed ok last night. need to check it there06:35
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Install ansible with pip  https://review.openstack.org/61229006:37
jaosoriormschuppert: put up a bug here https://bugs.launchpad.net/puppet-nova/+bug/179935206:37
openstackLaunchpad bug 1799352 in puppet-nova "Vendordata plugins are not functional" [Undecided,New]06:37
*** ayoung has quit IRC06:39
mschuppertjaosorior: cool thx06:39
jaosoriormschuppert: when you check your deployment, can you let me know what the value of the cloud-init script is?06:39
*** ramishra_ has joined #tripleo06:40
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Install ansible with pip  https://review.openstack.org/61229006:41
*** huynq has joined #tripleo06:41
*** ramishra has quit IRC06:43
*** slaweq has joined #tripleo06:44
openstackgerritMerged openstack/tripleo-repos master: Don't quote {posargs} in tox.ini  https://review.openstack.org/60888806:48
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Added support for installing tempest plugins from git  https://review.openstack.org/61237706:50
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Remove dependency on github for cloning  https://review.openstack.org/60538806:51
*** pcaruana has joined #tripleo06:56
*** jaosorior has quit IRC07:02
*** jaosorior has joined #tripleo07:05
*** rcernin has quit IRC07:06
*** rdopiera has joined #tripleo07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791807:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819507:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179866407:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]07:10
openstackLaunchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged]07:10
*** hberaud has joined #tripleo07:12
jaosoriorAnybody else getting this issue in quickstart http://paste.openstack.org/show/732687/ ?07:13
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/rocky: Fix tgz plan upload error on some OSes  https://review.openstack.org/61229707:15
*** pvc has joined #tripleo07:17
pvcss07:19
pvcs07:19
pvchi07:19
pvchi /bin/sh: tripleo-container-image-prepare.log: Permission denied", "stderr_lines": ["/bin/sh: tripleo-container-image-prepare.log: Permission denied"],07:19
*** shardy has joined #tripleo07:19
*** yolanda has joined #tripleo07:19
pvcwhen running overcloud deploy07:20
*** amoralej|off is now known as amoralej07:20
*** Petersingh is now known as Petersingh|afk07:21
ramishra_jaosorior: I normally see that error when python3 is default from where quickstart is run, not sure if you've the same issue07:23
jaosorior ramishra_ that's probably the case. I do have python3 by default.07:24
pvcanyone can help me?07:24
*** gfidente has joined #tripleo07:24
jaosoriorramishra_: how do you go around it?07:24
openstackgerritHarald Jensås proposed openstack/puppet-tripleo master: Fix Undercloud masquerading firewall rules  https://review.openstack.org/60985807:24
ramishra_jaosorior: sudo alternatives --config python07:25
ramishra_and change to 2 when running quickstart:)07:25
Tenguoh. Just found why I can't deploy the overcloud with an undercloud podman :].07:25
openstackgerritHarald Jensås proposed openstack/puppet-tripleo master: [WiP] Improve masquerading  https://review.openstack.org/61155707:26
jaosoriorramishra_: I don't get any alternative for python :/07:26
*** huynq has quit IRC07:26
jaosorior(running fedora 28)07:26
*** huy has joined #tripleo07:29
jistrchem: hi07:30
chemjistr: hey07:30
jistrchem: is the 'newest_release_hash=$3' removed here on purpose? https://review.openstack.org/#/c/606996/10/playbooks/tripleo-ci/templates/oooq_common_functions.sh.j207:31
ramishra_jaosorior: you probably  have to register them as alternatives first http://paste.openstack.org/show/732688/07:31
jistrchem: here's the diff i mean https://review.openstack.org/#/c/606996/7..10/playbooks/tripleo-ci/templates/oooq_common_functions.sh.j207:31
chemjistr: nope, it's some kind of rebase magic, that line has been changed in an other review and somehow end up in my history07:32
chemjistr: I've always wanted it there and never removed it07:32
jistrchem: ack that's what i thought07:33
* jistr gonna vote -107:33
*** ramishra_ is now known as ramishra07:33
chemjistr: oh, boy you're starting my days on amazing tracks :)07:34
jistrhaha sorry :)07:34
chemjistr: anyway thanks, I did trust my 3 ways merge interface and didn't spot that the variable definition was gone, thanks.07:36
jaosoriorramishra: seems that didn't fix the issue :(07:36
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Install ansible with pip  https://review.openstack.org/61229007:37
*** pliu has joined #tripleo07:38
ramishrajaosorior: dunno then, may be something to do with https://review.openstack.org/#/c/610475/, the revert of which is blocked for some reason07:39
jistrchem: but we only ever call that function with 2 args anyway? codesearch.openstack.org/?q=get_extra_vars_from_release07:40
jistrhttp://codesearch.openstack.org/?q=get_extra_vars_from_release07:40
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Add MTU to neutron networks and nic-config templates  https://review.openstack.org/59959307:40
*** sshnaidm|afk is now known as sshnaidm|pto07:41
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Fixed stackviz report for standalone  https://review.openstack.org/61261807:42
chemjistr: nope see on the patch above where we use it https://review.openstack.org/#/c/604706/26/playbooks/tripleo-ci/templates/toci_quickstart.sh.j207:42
*** bogdando has joined #tripleo07:42
jistrchem: ah i see, thanks07:43
pvchi07:44
jaosoriorramishra: yep, taking that fix into use worked for me.07:44
pvcchem07:44
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Enable full tempest api and scenario tests for basic services  https://review.openstack.org/60604607:44
pvchi chem07:44
pvcanyone?07:44
pvchow can i add a new bridge on overcloud deploy ( rockey version )07:44
chandankumarjaosorior: sorry I didnot get that, https://review.openstack.org/#/c/612618/1//COMMIT_MSG that is the fix which i proposed07:45
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: [DNM] testing tempest plugin installation from git  https://review.openstack.org/61238607:45
chemjistr: unfortunatly, now I wonder why it worked correctly that time without that, it used to fail systematicly without it07:45
chemjistr: boy07:45
chempvc hi07:45
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Use mtu of Tenant network to control neutron global_physnet_mtu  https://review.openstack.org/61253307:45
pvchi chem i want to add a new bridge for my floating ip07:46
pvclike br-provider07:46
chempvc: I don't know on top of my head, quickly looking07:48
jaosoriorchandankumar: lol, I didn't read the task properly.07:48
chandankumarjaosorior: :-)07:49
Tengubogdando: heya! I've created a new card on the tripleo-podman trello for overcloud specific tasks - and your changes for the non-docker rootwrap support are badly needed :) https://trello.com/c/Gnur7iet/40-overcloud-deploy - do you need any help on them?07:50
jaosoriorchandankumar: commented.07:51
chandankumarjaosorior: sure07:52
chempvc: well not sure about it, but I think that's the right direction https://github.com/openstack/tripleo-heat-templates/blob/stable/rocky/puppet/services/ovn-controller.yaml#L41..L5307:54
pvcchem it creating a br-ex by default and it is the one that map to neutron.conf07:54
chempvc isn't it where you would add you new brigde ?07:55
pvci want to add a new bridge to be map on atacentre07:55
pvcso my flat network would be datacentre:br-provider07:56
pvcbecause br-ex by default is a private subnet of my network and i cant use it as my floating ip since we're not the one managing the network side07:56
chandankumarjaosorior: I will update the patch once full tempest run finishes07:57
*** akrivoka has joined #tripleo07:57
*** tosky has joined #tripleo07:57
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO  https://review.openstack.org/56722408:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044508:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60429808:00
Tenguhey those interested in the validation framework: https://bluejeans.com/164399788  akrivoka florianf chem ccamacho08:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO  https://review.openstack.org/60429308:00
pvcor if ever chem can i add a new bridge manually on my ovs?08:02
chempvc well I shouldn't go down that path, will break at next deployment/upgrade/update08:03
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Force absolute path for CONFIG_VOLUME_PREFIX  https://review.openstack.org/59674408:07
*** jpich has joined #tripleo08:10
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791808:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819508:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179866408:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]08:10
openstackLaunchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged]08:10
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: Adapt tqe for the new fedora28 job  https://review.openstack.org/61239008:10
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Install ansible with pip  https://review.openstack.org/61229008:11
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28  https://review.openstack.org/61046808:11
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: Adapt tqe for the new fedora28 job  https://review.openstack.org/61239008:11
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Install ansible with pip  https://review.openstack.org/61229008:12
*** shardy has quit IRC08:17
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Add podman support to validate-tempest role  https://review.openstack.org/60535608:17
*** dtantsur|afk is now known as dtantsur08:22
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Add standalone upgrade to emit release.  https://review.openstack.org/60699608:27
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: New workflow for standalone upgrade.  https://review.openstack.org/60470608:27
*** derekh has joined #tripleo08:29
*** gouthamr has quit IRC08:32
*** rpittau has joined #tripleo08:33
*** dmellado has quit IRC08:34
*** stevebaker has quit IRC08:35
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Don't install setuptools/pip/virtualenv from RPMs  https://review.openstack.org/61263308:39
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Don't install setuptools/pip/virtualenv from RPMs  https://review.openstack.org/61263308:43
chemjistr: still baffle on why that was failing before and why it has not failed on the last run without the dlrn newest definition08:44
chemjistr: I try to stand my point anyway on the review.08:44
openstackgerritMatthias Runge proposed openstack/tripleo-heat-templates master: Enable ovs-stats by default when using ovs  https://review.openstack.org/61263408:46
*** shardy has joined #tripleo08:49
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: Adapt tqe for the new fedora28 job  https://review.openstack.org/61239008:50
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Install ansible with pip  https://review.openstack.org/61229008:50
jistrchem: there might have been some promotion, pushing current-tripleo closer to current. Otherwise i don't know :) Anyway i agree we should merge it ASAP to keep moving towards having the job.08:52
Tenguerf... images.rdoproject.org is down?08:53
quiquellTengu: https://semaphore.cloud.upshift.engineering.redhat.com/08:53
Tengudamn...08:54
quiquellTengu: amjor outage at rdo-cloud08:54
Tengutime for a cup of tea and some cuddling with the cat then XD08:54
chemjistr: well anyway having them hardcoded at the beginning with emit release is definitively more readable anyway and shield us from those hard to debug stuff08:54
quiquellTengu: if him/her allows you08:54
Tenguquiquell: not a big issue with that one :D. She's right on the desk in fact.08:55
*** dsneddon has quit IRC08:55
chemsshnaidm|pto: ha, so not traction there https://bugs.launchpad.net/tripleo/+bug/1775826 :)08:56
openstackLaunchpad bug 1775826 in tripleo "Can't reproduce more than one stack using reproducer-quickstart." [High,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot)08:56
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add epel element to centos7 testing  https://review.openstack.org/61263608:56
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates stable/rocky: Fix cinder_api_apache error during upgrade.  https://review.openstack.org/61263708:56
chemquiquell: so I guess https://bugs.launchpad.net/tripleo/+bug/177582608:56
chemquiquell: hi ...08:56
chemquiquell: this is not on top of the squad priority I guess :)08:56
chemquiquell: ask because I may put that on top of mine, but don't want to do something that would have been already done08:57
*** cylopez has joined #tripleo08:57
*** dsneddon has joined #tripleo08:58
quiquellchem: you can use the prefix option08:59
quiquellchem: so they don't collide08:59
chemquiquell: I use it08:59
*** dtrainor has quit IRC08:59
quiquellchem: Is not working ?08:59
chemquiquell: and they collide08:59
quiquellchem: It's clear now that I only read the topic of the bug :-)08:59
chemquiquell: hehe08:59
quiquellchem: Humm looks like sshnaidm|pto is already into it09:00
chemquiquell: yeah, but ... well I kinda need this and it's been a long time, so I think I'm going to give it a shoot09:01
quiquellchem: Let me check09:01
chemquiquell: shouldn't be a hard to fix, just give a prefixed name to the floating ip heat ressource09:01
quiquellchem: Looks like it, maybe you find more stuff to prefix, but it's kind of fast iterative thingy09:02
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791809:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819509:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179866409:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]09:10
openstackLaunchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged]09:10
*** gouthamr has joined #tripleo09:11
quiquelljistr: What happend with https://review.openstack.org/#/c/606996/ ? something in the rebase ?09:13
jistrquiquell: yea rebase issue09:15
openstackgerritMerged openstack/diskimage-builder master: Remove redundant sources change/update  https://review.openstack.org/56373909:16
openstackgerritMerged openstack/diskimage-builder master: Add a post-root.d phase  https://review.openstack.org/61180609:16
*** dmellado has joined #tripleo09:18
*** jpena|off is now known as jpena09:22
*** tosky has quit IRC09:24
*** tosky has joined #tripleo09:24
*** naturalblue has quit IRC09:27
quiquelljistr: Have addressed the call order for mocked functions at the test_release_names09:29
quiquelljistr: Will update the review if you are ok09:29
jistrquiquell: that's a Q for chem :)09:33
quiquellchem: ^09:33
chemjistr: I guess quiquell will update your review, so a question for you then :)09:34
jistrquiquell, chem: i'm +1 either way :)09:34
chemquiquell: jistr me too, I'm full of love today09:34
quiquellchem: Don't want to ask09:35
*** stevebaker has joined #tripleo09:36
openstackgerritMartin André proposed openstack/tripleo-quickstart-extras master: Add vars for setting gluster images for openshift  https://review.openstack.org/61264709:37
openstackgerritMartin André proposed openstack/tripleo-quickstart-extras master: Add vars for setting images for openshift 3.11  https://review.openstack.org/61264809:37
*** salmankhan has joined #tripleo09:38
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Fix pip installation  https://review.openstack.org/61264909:47
*** iurygregory is now known as iury|lunch09:49
*** quiquell is now known as quiquell|brb09:50
*** udesale has quit IRC09:51
*** udesale has joined #tripleo09:52
*** jpich has quit IRC09:53
*** jpich has joined #tripleo09:54
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Added support for installing tempest plugins from git  https://review.openstack.org/61237709:54
*** sri_ has joined #tripleo09:54
*** dhill_ has quit IRC09:55
*** shardy has quit IRC09:57
*** shardy has joined #tripleo09:58
bogdandoTengu: only making it passing ci09:58
bogdandobut its blocked by infra / CI alterts related things09:58
bogdandofor local testing, its WFM kinda09:59
bogdandoTengu: https://review.openstack.org/#/c/609947/09:59
*** dciabrin has joined #tripleo09:59
Tengubogdando: hm ok. I found some issues with neutron, trying to figure out what's going on.09:59
bogdandocan't do much but only run it in CI09:59
Tengubogdando: tempest isn't enough to tell "it's working" unfortunately.09:59
bogdandothat's sad10:00
Tenguhave many logs showing "not working" :(10:00
Tenguanyway. lunch time.10:00
bogdandoI think launching instances covers it e2e10:00
Tenguyeah. but undercloud can't launch neutron dhcp agent, so no pxe.10:00
bogdandobeagles: can you think of more testing for root wrappers?10:00
bogdando^^10:00
Tenguso no way to deploy the overcloud for now.10:00
chandankumarTengu: may be neutron tempest plugin tests will help10:01
chandankumarTengu: currently it is added to skip list10:01
bogdandoTengu: if nsenter fails, make sure containers has those caps admin/ptrace and also run as root10:06
openstackgerritNguyen Quang Huy proposed openstack/tripleo-quickstart master: Make the playbook's yaml file start with "---"  https://review.openstack.org/61265310:08
*** quiquell|brb is now known as quiquell10:08
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791810:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819510:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179866410:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]10:10
openstackLaunchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged]10:10
*** rfolco has joined #tripleo10:11
Tengubogdando: hmm, I've taken your t-h-t patch on top of mine.10:14
Tengubogdando: so you should have already pushed the needed things, don't you?10:14
Tenguchandankumar: is it possible to run tempest against the undercloud, btw?10:15
chandankumarTengu: yes10:15
openstackgerritMerged openstack/tripleo-quickstart-extras master: Un-skip manila and sahara tests on master and Rocky  https://review.openstack.org/60955010:15
Tenguchandankumar: oh? care to share how? I would like to add that capability to my lab :). WITH neutron tests :)10:16
chandankumarTengu: https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset027.yml#L9510:16
*** ssbarnea_ has joined #tripleo10:16
chandankumarTengu: for undercloud most of stuff does not work, very limitted tests we run10:16
Tenguchandankumar: not that surprizing ;). still, I think it would be good to be able to run tempest against it in my dev env - that would help me a lot.10:17
chandankumarTengu: Feel free to tweak the test_regex to neutron_tempest_10:17
chandankumarneutron_tempest_plugin10:18
Tenguchandankumar: should I run the tempest from the package, or from the container?10:19
chandankumarTengu: if you use package , then you need to install python-neutron-tests-tempest package also10:19
Tenguchandankumar: I think I get it anyway as I install 'openstack-tempest-all'10:20
chandankumarTengu: sure10:20
chandankumarTengu: but make sure you pass the correct regex https://docs.openstack.org/tripleo-docs/latest/install/basic_deployment/tempest.html#running-tempest-tests10:20
Tenguchandankumar: is there any steps to prepare the undercloud? like specific role or the like?10:20
chandankumarTengu: https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset027.yml#L95 -> running temepst on containerized UC10:21
Tenguoh, ok.10:21
chandankumarthe steps are pretty common10:21
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Add podman support to validate-tempest role  https://review.openstack.org/60535610:25
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Delete novajoin manual setup from freeipa setup script  https://review.openstack.org/61265810:29
*** apetrich has quit IRC10:38
jaosoriorHey folks! could I get a review for https://review.openstack.org/#/c/612658/ ? It's currently not used in CI, but cleaning it up would be a good reference for me to be able to share it around (there are folks asking for this).10:45
*** dtrainor has joined #tripleo10:48
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: Switch default neutron ML2 mechanism driver to OVN  https://review.openstack.org/59305610:51
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Delete empty karaf directory on host  https://review.openstack.org/61266310:52
openstackgerritMerged openstack/tripleo-quickstart master: Revert "Use dnf and python3 on platforms where these are default"  https://review.openstack.org/61228910:53
*** apetrich has joined #tripleo10:54
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Delete empty karaf directory on host  https://review.openstack.org/61266310:55
jistrdalvarez, jfrancoa: so i was looking at the CI failure, and it looks like the patch actually *does* delete the environments/docker.yaml file :)10:59
jistrhttps://review.openstack.org/#/c/593056/3110:59
jistri guess that's just a 'typo' rather than an intention?10:59
dalvarezjistr: sorry?11:00
dalvarezjistr: that patch is rebased on top of yours11:00
dalvarezthat might be it?11:00
dalvarezor perhaps a typo11:00
jistrdalvarez: context -- jfrancoa pinged me to look at http://logs.openstack.org/56/593056/30/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/9cbcf61/logs/undercloud/home/zuul/install-undercloud.log.txt.gz#_2018-10-19_12_57_57_20311:01
jistrwhy it is failing11:01
jistrdalvarez: and your patch deletes environments/docker.yaml -- we should not delete it just yet11:01
dalvarezjistr: let me revert that sry11:02
*** pvc_ has joined #tripleo11:04
pvc_hi guys i successfully installed tripleo11:04
pvc_i want to use vgpu on my instance11:04
pvc_may i know how can i use that11:04
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: Switch default neutron ML2 mechanism driver to OVN  https://review.openstack.org/59305611:04
pvc_i try this doc https://docs.openstack.org/nova/queens/admin/virtual-gpu.html11:04
pvc_but i have an error11:04
bogdandoTengu: I think so11:04
pvc_Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 4c6de80f-cc4d-47c9-a63d-f72a5584ecb6.11:04
dalvarezjistr: jfrancoa fixed11:04
*** iury|lunch is now known as iurygregory11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791811:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819511:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179866411:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]11:10
openstackLaunchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged]11:10
*** chem has quit IRC11:11
*** chem has joined #tripleo11:12
bandinimarios: quick one according to https://bugs.launchpad.net/tripleo/+bug/1794258 it should be fixed, but I am getting the same issue on fs001 https://logs.rdoproject.org/51/611551/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/961ac9b/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-10-23_08_23_4311:13
openstackLaunchpad bug 1794258 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset021-master job fails overcloud deploy as nodes can't reach pool.ntp.org" [Critical,Fix released] - Assigned to Marios Andreou (marios-b)11:13
*** udesale has quit IRC11:14
bandiniwhich is extra weird because fs001 has that patch11:14
mariosbandini: that fix was for fs21 specifically11:15
jankiEmilienM, hi11:15
mariosbandini: s/fix/bug like https://review.openstack.org/#/c/610009/3/config/general_config/featureset021.yml11:16
chandankumararxcruz: please have a look at this https://review.openstack.org/#/c/612618/1/roles/validate-tempest/tasks/stackviz.yml@45 line I am doing somethign wrong there11:16
chandankumararxcruz: : http://logs.openstack.org/46/606046/16/check/tripleo-ci-centos-7-standalone/21d4fe6/job-output.txt.gz#_2018-10-23_10_43_00_92236111:16
bandinimarios: yeah fs001 has that masquerade entry, so not sure wtf is going on here11:16
mariosbandini: might be a different bug then maybe ask new ruck/rover rfolco sshnaidm|pto  ah ... folco should be around in a couple hours... sec https://review.rdoproject.org/etherpad/p/ruckrover-sprint21 here see if there is any new bug (don't see it though)11:18
*** tosky has quit IRC11:18
*** phuongnh has quit IRC11:18
*** tosky has joined #tripleo11:18
bandinimarios: ack, thanks11:20
rfolcomarios, bandini it seems a general issue not specific to any job, am I wrong ?11:21
bandinirfolco: I have not looked much tbh, I just noticed it on one of my reviews. so a general rdo issue?11:22
rfolcobandini, will look at this issue asap, thanks for calling my attention on this one.11:23
*** rfolco is now known as rfolco|rucker11:23
bandinirfolco|rucker: thanks!11:23
*** panda is now known as panda|lunch11:27
jfrancoajistr:  I see now...thanks a lot, I thought that the patch was only rebased on top, I missed that docker.yaml was being removed11:28
jfrancoajistr: that's why I was surprised that the job was failing, if you didn't fully remove it11:28
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Reduce unit testing changes required for emit_releases_file  https://review.openstack.org/61184211:28
*** ratailor has quit IRC11:29
Tenguchandankumar: ok, I apparently am able to run tempest against my undercloud. let's wait.11:32
honzachandankumar: could you point me to the code that actually does the git checkout of the zuul change in the tempest plugin repo?11:33
*** jpena is now known as jpena|lunch11:33
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Reduce unit testing changes required for emit_releases_file  https://review.openstack.org/61184211:33
jistrjfrancoa: yea it surprised me too so i went to double check the patch contents11:33
quiquellchem, jistr: ^11:33
quiquellchem, jistr: Just changed the first ones to check if you like it better now it uses some pytest fixture magic for setup/teardown11:34
chemquiquell: oki, I'll review that in a morning, but hell yes11:38
openstackgerritAthlan-Guyot sofer proposed openstack/instack-undercloud stable/queens: Update stackrc to v3 auth values when --use-heat is false.  https://review.openstack.org/61164711:40
Tengubogdando: ok, so apparently there's something fishy somewhere, I get the following error from a neutron container: setting the network namespace "qrouter-53f39605-5e6d-4dfe-993d-e846c0dd24d4" failed: Invalid argument11:41
*** janki has quit IRC11:41
Tengubogdando: not sure it's 100% linked to "podman" work, but I have to dig a bit in that error.11:42
quiquellchem: Have already check that we don't have false positives there11:42
Tengubogdando: it prevents a dhcp agent to start, and of course this creates some issues.11:42
quiquellchem: In fact after rebasing it's not failing so it's working11:42
Tenguwondering if it might be linked to this AVC: type=AVC msg=audit(1540292684.279:4734): avc:  denied  { search } for  pid=84848 comm="qemu-kvm" name="84573" dev="proc" ino=874292 scontext=unconfined_u:unconfined_r:svirt_tcg_t:s0:c276,c884 tcontext=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 tclass=dir11:43
arxcruzchandankumar: ?11:43
jistrquiquell: thanks, will review too11:47
*** dprince has joined #tripleo11:48
quiquellchem, jistr: If you like the aproach I can refactor the rest11:49
*** ansmith has quit IRC11:52
*** mmethot has joined #tripleo11:54
*** morazi has joined #tripleo11:54
chemquiquell: what is missing, all ordering issues seems gone no ?11:54
quiquellchem: Nop, the test that I have not refactor will have problems,11:56
quiquellchem: I mean the test not using the fixture get_hash_mock_setup11:56
chemquiquell: ah, oki, the diff is kinda hard to read, so I didn't notice, that's why I need a fresh mind, and that is more likely to happen in the morning :)11:57
*** agurenko has quit IRC11:57
quiquellchem: Yep, I also fix some ugly pep stuff11:58
*** dhill_ has joined #tripleo11:59
*** agurenko has joined #tripleo12:00
*** abishop has joined #tripleo12:00
chemjfrancoa: we need to remerge that one https://review.openstack.org/#/c/604757/12:05
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61267712:05
chemjfrancoa: a merge conflict resolution was needed hence the new patchset.12:05
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61267712:05
openstackgerritMerged openstack/tripleo-heat-templates master: Change Swift storage directory to /srv/node/d1  https://review.openstack.org/61130912:06
pvc_hi guys12:07
pvc_anyone using vgpu here?12:07
*** rh-jelabarre has joined #tripleo12:07
pvc_or  anyone handling it12:07
*** amoralej is now known as amoralej|lunch12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791812:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819512:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)12:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]12:10
chandankumararxcruz: I proposed a patch https://review.openstack.org/612618 to fix stackviz added depends on full tempest this is what I have got http://logs.openstack.org/46/606046/16/check/tripleo-ci-centos-7-standalone/21d4fe6/job-output.txt.gz#_2018-10-23_10_43_00_92236112:10
chandankumararxcruz: I need help in order to fix that rc issue12:11
*** janki has joined #tripleo12:14
chandankumarhonza: what I was saying I putted this patch https://review.openstack.org/612386 which depends -on https://review.openstack.org/612377 then zuul cloned the Tripleo quickstart and -extras repo and checkout at depends on review http://logs.openstack.org/86/612386/1/check/tripleo-ci-centos-7-undercloud-containers/f50e815/job-output.txt.gz#_2018-10-22_13_23_10_32091112:15
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61267712:16
chandankumarhonza: which is what i was saying, once my patch merges, through that way we can able to test tripleo ui tempest plugin changes12:16
honzachandankumar: i would like to be able to post a patch to tripleo-ui which adds a new feature; and then, at the same time, i would like to post a patch to tempest-tripleo-ui which adds a test for the new feature in tripleo-ui.  The tripleo-ui patch will have a Depends-On on the tempest-tripleo-ui patch.12:18
*** Petersingh|afk is now known as Petersingh12:18
honzachandankumar: is there a way to have the tempest+git+venv mechanism check out the patch indicated?12:18
chandankumarhonza: pass the patch link we want to test12:19
honzachandankumar: we don't have any yet; at the moment, we can't run our tests in ci yet12:19
chandankumarhonza: or any dummy patch can also work12:20
chandankumarhonza: let me get something for you12:21
*** cylopez has left #tripleo12:21
*** ade_lee has quit IRC12:24
pvc_anyone not busy?12:24
*** abishop has quit IRC12:24
*** janki has quit IRC12:25
*** janki has joined #tripleo12:25
jfrancoachem: ack, reviewig12:26
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Create venv only when virtualenv is not there  https://review.openstack.org/60234712:27
*** janki has quit IRC12:27
chandankumarrfolco|rucker: ssbarnea ^^12:27
rfolco|ruckerchandankumar, thx12:29
*** rlandy has joined #tripleo12:29
*** lblanchard has joined #tripleo12:30
*** abishop has joined #tripleo12:30
jaosoriormarios, bandini: could you check this out https://review.openstack.org/#/c/612658/ ?12:30
*** abishop has quit IRC12:31
*** udesale has joined #tripleo12:31
mariosjaosorior: ack but not right away noted for later12:31
*** eck` is now known as eck`gone12:33
*** janki has joined #tripleo12:34
ssbarneachandankumar thanks for updating it and sorry for not being able to workflow it myself. i am now trying to get it workflowed.12:34
chandankumarssbarnea: :-)12:35
*** jcoufal has joined #tripleo12:37
*** jchhatbar has joined #tripleo12:38
*** jamesdenton has joined #tripleo12:39
openstackgerritYurii Prokulevych proposed openstack/tripleo-heat-templates stable/rocky: Change Swift storage directory to /srv/node/d1  https://review.openstack.org/61268212:39
*** janki has quit IRC12:40
*** jpena|lunch is now known as jpena12:40
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Create venv only when virtualenv is not there  https://review.openstack.org/60234712:43
ssbarneachandankumar: i updated you change as I found few issues with it, one critical (for me)12:44
chandankumarssbarnea: cool, thanks :-)12:44
ssbarneachandankumar shortly, just don't use `-v` test on bash, is not BSD compatible12:45
ssbarneachandankumar there is a reason why that answer got 1700 votes https://stackoverflow.com/questions/3601515/how-to-check-if-a-variable-is-set-in-bash ;)12:46
*** trown|outtypewww is now known as trown12:47
*** lblanchard has quit IRC12:50
*** amoralej|lunch is now known as amoralej12:50
jchhatbardsneddon, hi12:50
*** jchhatbar is now known as janki12:50
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Skip hosts group in ceph-ansible inventory when all are blacklisted  https://review.openstack.org/61073612:50
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Fixed stackviz report for standalone  https://review.openstack.org/61261812:52
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Enable full tempest api and scenario tests for basic services  https://review.openstack.org/60604612:52
openstackgerritHarald Jensås proposed openstack/tripleo-quickstart-extras master: [WiP] - OVB - external network masquerading  https://review.openstack.org/60983012:53
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Remove defaults from masquerade-networks service env  https://review.openstack.org/60984512:53
arxcruzchandankumar: is stats.rc or stat.rc ?12:56
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: [Ocata/Pike/Queens] Make rhel-registration scripts location absolute.  https://review.openstack.org/61185712:57
openstackgerritChristophe Fontaine proposed openstack/tripleo-heat-templates master: Fix NeutronSriovHostConfig path for ODL deployment with SRIOV  https://review.openstack.org/61268512:58
*** huy has quit IRC12:58
*** abishop has joined #tripleo12:58
chandankumararxcruz: patch updated with jaosorior changes12:59
arxcruzchandankumar: ok12:59
arxcruzlet's see if the gods of gate are satisfied with your sacrifice :P12:59
chandankumarI just need exist status so i think only .rc wik  work12:59
pvc_internal error: qemu unexpectedly closed the monitor: 2018-10-23T12:53:40.491086Z qemu-kvm: -device vfio-pci,id=hostdev0,sysfsdev=/sys/bus/mdev/devices/cad68f60-930c-4d9b-b954-3e0cd855651e,bus=pci.0,addr=0x5: vfio error: cad68f60-930c-4d9b-b954-3e0cd855651e: error getting device from group 58: Input/output error13:01
pvc_guys anyone?13:01
arxcruzchandankumar: ok, also, 3 hours for full tempest on standalone, i believe this is a no go13:01
openstackgerritJames Slagle proposed openstack/tripleo-common master: Per server deployments instead of per role  https://review.openstack.org/61268713:01
openstackgerritJames Slagle proposed openstack/tripleo-common master: Remove deployments.yaml from role directory  https://review.openstack.org/61268813:01
arxcruzalthough i'm very happy with full tempest finally running13:01
*** tzumainn has joined #tripleo13:01
chandankumararxcruz: full tempest will run against TQE patches13:02
chandankumararxcruz: for other projects those are customized13:02
pvc_virPidFileAcquirePath:422 : Failed to acquire pid file '/var/run/libvirtd.pid': Resource temporarily unavailable13:02
chandankumararxcruz: https://review.openstack.org/#/q/topic:tempest_standalone+(status:open+OR+status:merged)13:03
arxcruzchandankumar: still, 3 hours...13:03
*** ansmith has joined #tripleo13:04
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61049113:05
openstackgerritChandan Kumar proposed openstack/tempest-tripleo-ui master: [DNM] testing tripleo ui temepst plugin  https://review.openstack.org/61268913:07
chandankumarhonza: ^^13:07
*** bnemec has joined #tripleo13:08
openstackgerritChandan Kumar proposed openstack/tempest-tripleo-ui master: [DNM] testing tripleo ui temepst plugin  https://review.openstack.org/61268913:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791813:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819513:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)13:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]13:10
*** psachin has quit IRC13:10
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates stable/rocky: Change Swift storage directory to /srv/node/d1  https://review.openstack.org/61268213:12
*** quiquell is now known as quiquell|lunch13:13
*** cylopez has joined #tripleo13:16
*** cylopez has joined #tripleo13:16
*** cylopez has left #tripleo13:17
pvc_anyone guys?13:17
pvc_vfio error: cad68f60-930c-4d9b-b954-3e0cd855651e: error getting device from group 58: Input/output error13:17
*** Vorrtex has joined #tripleo13:18
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates master: Add parameters for cinder storage availability zones  https://review.openstack.org/60807513:19
pvc_ Failed to acquire pid file '/var/run/libvirtd.pid': Resource temporarily unavailable13:20
*** ayoung has joined #tripleo13:28
*** eck`gone is now known as eck`13:32
*** naturalblue has joined #tripleo13:35
openstackgerritDan Prince proposed openstack/tripleo-common master: Add tripleoclient container  https://review.openstack.org/61159813:35
*** Vorrtex has quit IRC13:36
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: [Queens/Pike] Re-registry with new rhel_reg parameters on upgrade.  https://review.openstack.org/61185813:38
openstackgerritMerged openstack/tripleo-upgrade stable/queens: Fix variable name for workload_launch task.  https://review.openstack.org/61124513:38
openstackgerritMerged openstack/tripleo-ui stable/rocky: Fix tgz plan upload error on some OSes  https://review.openstack.org/61229713:38
*** agopi has quit IRC13:39
*** jfrancoa has quit IRC13:44
*** mjturek has joined #tripleo13:47
honzachandankumar: ok, cool, that sounds good; but that's still one-sided, right?13:50
*** jfrancoa has joined #tripleo13:50
honzachandankumar: i can write a patch in tripleo-ui, and say 'Depends-on' a patch in tempest-tripleo-ui; and i'll get a ci job that's run with the tempest-tripleo-ui change applied13:56
honzachandankumar: but how do i get the two tempest-tripleo-ui and tripleo-ui patches in the same ci job run?13:57
honzai realize i might be too demanding :)13:57
mwhahahahonza: if they are in dlrn and you use depends-on it just works13:57
mwhahahahonza: we build the rpms and inject them into the containers in CI13:57
pvc_@mwahahaha familiar 2bf12bf5 - default default] Error launching a defined domain with XML: <domain type='kvm'>?13:57
mwhahahapvc_: nope, though is your compute a VM or baremetal? if it's a vm did you specify the libvirt type as qemu?13:58
pvc_my compute is baremetal13:58
pvc_im attaching vgpu on my instance13:58
mwhahahanot sure if we support vgpu, though it sounds like you have questions for nova and not necessarily tripleo13:58
honzamwhahaha: hm, interesting... chandankumar is telling me to not use containers for tempest, and instead use git + venv13:58
mwhahahahonza: so in quickstart we have the ability to do tempest in a container but if you use non-containers it'll probably work better. Not sure if we inject updated rpms into the tempest container13:59
mwhahaha#startmeeting tripleo14:00
mwhahaha#topic agenda14:00
mwhahaha* Review past action items14:00
mwhahaha* One off agenda items14:00
mwhahaha* Squad status14:00
mwhahaha* Bugs & Blueprints14:00
mwhahaha* Projects releases or stable backports14:00
mwhahaha* Specs14:00
openstackMeeting started Tue Oct 23 14:00:13 2018 UTC and is due to finish in 60 minutes.  The chair is mwhahaha. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
mwhahaha* open discussion14:00
mwhahahaAnyone can use the #link, #action and #info commands, not just the moderatorǃ14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
*** openstack changes topic to " (Meeting topic: tripleo)"14:00
openstackThe meeting name has been set to 'tripleo'14:00
*** openstack changes topic to "agenda (Meeting topic: tripleo)"14:00
mwhahahaHi everyone! who is around today?14:00
Tengu«o/14:00
fultonjo/14:00
shardyo/14:00
ksambor\o14:00
d0ugalo/14:00
florianfo/14:00
rlandyo/14:00
dpeacocko714:00
ccamachohi!14:01
slaglehi14:01
chem>o/14:01
matbuo/14:01
marioso/14:01
jfrancoao/14:01
*** sanjayu_ has quit IRC14:01
*** sanjayu_ has joined #tripleo14:02
jristo/~14:02
beagleso/14:02
rfolco|ruckero/14:02
redroboto/14:03
mwhahahaalright decent turnout today, let's go14:03
mwhahaha#topic review past action items14:03
*** openstack changes topic to "review past action items (Meeting topic: tripleo)"14:03
mwhahaharlandy, weshay, dtantsur to look into switching to TCP for IMPI and possibly tuning retries14:03
holser_o/14:03
dtantsuretingof looking into redfish stuff. I did not look into retries, sorry.14:03
mwhahaharlandy: any update on the OVB ipmi issues? (other than rdo cloud failing us on a regular basis)14:03
panda|luncho/14:04
*** panda|lunch is now known as panda14:04
rlandymwhahaha: I have been working on baremetal to track introspection14:04
mwhahahak sounds like we need to continue to leave that on the action item list for next week14:04
rlandyOVB is failing for numerous reasons before we get to introspection :(14:04
mwhahaha#action rlandy, weshay, dtantsur to look into switching to TCP for IMPI and possibly tuning retries - postponed until next time14:04
mwhahahak14:04
mariosmwhahaha: i'm trying to find weshay debug patches not sure they landed yet14:04
*** agurenko has quit IRC14:05
mwhahahamarios: ok let me know if you need assistance on anything14:05
mwhahahaetingof to take a look at OVB+slushy-tools14:05
mwhahahaas dtantsur sounds like that is currently in progress14:05
dtantsurs/slushy/sushy/ (/me has bad associations with "slushy")14:06
* etingof adds sushy-tools into the OVB -- https://github.com/etingof/openstack-virtual-baremetal/blob/add-sushy-emulator/bin/install_openstackbmc.sh14:06
mwhahaha:o14:06
*** ramishra has quit IRC14:06
mariosmwhahaha: reviews still needed here  https://review.openstack.org/#/c/610072/ https://review.openstack.org/#/c/610078/ https://review.openstack.org/#/c/610087/14:06
mwhahahamarios: k i'll take a look14:07
etingofso redfish BMC works in OVB, but it is apparently quite slow14:07
* etingof is still working on it14:07
dtantsurhow slow? seconds, minutes?14:08
chandankumar\o/14:08
*** sanjayu_ has quit IRC14:09
dtantsurmwhahaha: etingof and I are on another meeting, so feel free to not block on our responses14:09
mwhahahadtantsur: got it.14:09
*** quiquell|lunch is now known as quiquell14:10
*** huynq has joined #tripleo14:10
mwhahahasounds like there's at least some progress, etingof do keep us up to date. thanks for your efforts14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791814:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819514:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]14:10
mwhahahamoving on14:10
mwhahaha#topic one off agenda items14:10
mwhahaha#link https://etherpad.openstack.org/p/tripleo-meeting-items14:10
*** openstack changes topic to "one off agenda items (Meeting topic: tripleo)"14:10
mwhahaha(mwhahaha) deployment THT template reorg14:10
mwhahahaI sent a note to the ML about moving the service templates around and cleaning up the puppet/docker templates14:11
mwhahaha#link http://lists.openstack.org/pipermail/openstack-dev/2018-October/135810.html14:11
mwhahahaPlease take a minute to review this email and provide feedback. We'd like to get started on this if it's OK14:11
mwhahaha#link https://review.rdoproject.org/r/#/c/16994/14:11
mwhahahafor the packaging update for it14:11
shardya while back (in Dublin) we discussed the idea of flattening the puppet/docker templates, I wonder if this could be an opportunity to do that14:11
mwhahahashardy: that's exactly what i was proposing14:11
mwhahahashardy: in the email i took a stab at flattening the aodh templates for review14:12
mwhahaha#link https://review.openstack.org/#/c/611188/14:12
shardymwhahaha: ah nice, I only saw dprince's initial comment about the directory structure14:12
shardyFWIW my suggestion to do that was shot down in Dublin as dprince was keen to maintain baremetal puppet support14:13
shardybut since we no longer test it, this is probably a good time to revisit the discussion14:13
mwhahahayea, it was mentioned in the mail thread but that is something i'd like to get consensus around14:13
dprinceif I'm the last man standing up for baremetal support I suppose it isn't worth keeping then14:13
mwhahahasince we don't test it anymore I think it's time to reduce the complexity.14:14
dprincemwhahaha: regarding your patch (I haven't replied yet) does it help identify what we are using for config though?14:14
mwhahahadprince: there are some options on that, yes14:14
dprincemwhahaha: like that was my initial issue... I couldn't easily tell that we no longer used Puppet14:14
*** Petersingh is now known as Petersingh|gone14:14
mwhahahadprince: so if it's not containers it listed the language (puppet/ansible)14:14
dprincemwhahaha: this is why ansible/services made sense to me.14:14
*** Petersingh|gone has quit IRC14:14
mwhahahadprince: though not sure i'm not sure the best way to represent that in containers14:15
dprincemwhahaha: especially for things that will probably always run on baremetal14:15
dprincemwhahaha: chrony14:15
mwhahahadprince: https://review.openstack.org/#/c/588111/14:15
shardydprince: in an ideal world we'd support both, but the CI and template overhead is pretty high - I'd be more convinced about keeping it if we still tested it somewhere14:15
dprincemwhahaha: for containers the other directory is fine I think though14:15
*** Vorrtex has joined #tripleo14:15
mwhahahaso i used deployment/timesync/chrony-ansible.yaml14:15
mwhahahawhich would indicate it's not containerized and uses ansible14:15
mwhahahawhere as for containers, we would have something like deployment/aodh/aodh-api-containers.yaml14:15
dprincemwhahaha: so long as we aren't moving changes environments/ files I think I'm okay with whatever helps at this point14:16
mwhahahadprince: yes environment files should not be moved around (updated yes, moved no)14:16
dprincelast time I touched things I renamed all the env files (because we agreed to do it). But that is so bad as its the only thing users consume14:16
mwhahahait's just puppet/* docker/* combined -> deployment/14:16
dprincewe can rename the other templates as much as we'd like I think but the environment/ files are the ones we should be more careful about14:17
shardythe whole nested stack inheritance thing is a pretty big overhead, I suspect the standalone install will run much faster if we reduce/remove that14:17
mwhahahayea that's my hope to get some perf improvements out of this as well14:17
mwhahahareducing complexity and hopefully some heat processing speedup14:17
dprinceshardy: the killer for the standalone is actually the services too. Having a shim that no-ops out the ones we have set to OS::Heat::None would help us the most I think.14:17
dprinceshardy: if I create my own roles file it runs as fast as always...14:18
* dprince has been wanting to do this in tripleoclient14:18
mwhahahayea we need to reduce the default service definitions in the overcloud-resource-registry14:18
shardydprince: yeah that's why I was trying to get to use server side merging, then we could remove all the OS::Heat::None stuff and just build the list of *Services14:18
shardyhttps://review.openstack.org/#/c/448209/ needs to be revived to do that, it's on my todo list14:19
dprinceshardy: I actually want to do it client side though.14:19
dprinceshardy: does merge server side fix something I'm not aware of?14:20
shardydprince: if we merge server side then you can do -e enable_foo.yaml and have it append to e.g ControllerServices14:20
shardyso you just remove all the disabled by default services from the role definition14:20
shardyand the -e options add them to the list14:20
shardywe could hack around it client side, but my idea was to leverage the heat merging feature instead14:21
*** janki has quit IRC14:21
dprinceshardy: I would rather see us refactor the swift plan storage first (Ian's patch)14:21
shardynot been a super high priority tho tbh, that patch is pretty stale14:21
shardydprince: yeah this can be done after that14:22
mwhahahaso yea sounds like there's some improvements to be had in a few places14:22
dprinceprocess_templates.py is so much easier to understand that the Swift processing code in tripleo-common14:22
mwhahahadprince: where is ian's patch? is it in a decent state still?14:22
dprincemwhahaha: https://review.openstack.org/#/c/581153/ is also stale14:23
dprince:/14:23
dprinceI was trying to pair with him this week to fix it up again!14:23
*** mcornea has joined #tripleo14:24
mwhahahadprince: ok let me know if you need some help14:24
dprincethrash: you around to help us with this too?14:24
mwhahahaanyway that's it on the agenda bits. Please review my ML post and the associated reviews14:24
dprincethrash: pairing on https://review.openstack.org/#/c/581153/14:24
mwhahahai'd like to get some movement on that this week14:24
ksamborshardy, dprince I can help with this one https://review.openstack.org/#/c/448209/14:25
naturalblueHey everyone. Can anyone help with a controller deployment issue.14:25
mwhahahaspecifically if we can get https://review.rdoproject.org/r/#/c/16994/ then that'll help us test the other patches14:25
mwhahahanaturalblue: give us a bit, we're in the middle of a meeting14:25
naturalbluesorry14:25
naturalbluemwhahaha: sorry14:25
mwhahahaalright moving on to status14:25
mwhahaha#topic Squad status14:25
mwhahahaci14:25
mwhahaha#link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting14:25
mwhahahaupgrade14:25
mwhahaha#link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status14:25
*** openstack changes topic to "Squad status (Meeting topic: tripleo)"14:25
mwhahahacontainers14:25
mwhahaha#link https://etherpad.openstack.org/p/tripleo-containers-squad-status14:25
mwhahahaedge14:25
mwhahaha#link https://etherpad.openstack.org/p/tripleo-edge-squad-status14:25
mwhahahaintegration14:25
mwhahaha#link https://etherpad.openstack.org/p/tripleo-integration-squad-status14:25
mwhahahaui/cli14:25
mwhahaha#link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status14:25
mwhahahavalidations14:25
mwhahaha#link https://etherpad.openstack.org/p/tripleo-validations-squad-status14:25
mwhahahanetworking14:25
mwhahaha#link https://etherpad.openstack.org/p/tripleo-networking-squad-status14:25
mwhahahaworkflows14:25
mwhahaha#link https://etherpad.openstack.org/p/tripleo-workflows-squad-status14:25
mwhahahasecurity14:25
mwhahaha#link https://etherpad.openstack.org/p/tripleo-security-squad14:25
mwhahahaany status items folks would like to raise for visibility?14:25
etingoffollowup: a redfish power status call currently takes ~15secs on RDOcloud. the difference wrt ipmi is that you can't ask redfish for just one thing (e.g. power status), you effectively ask many things at once. with the redfish emulator backed by openstacksdk that translates into multiple cloud API calls...14:26
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Added support for installing tempest plugins from git  https://review.openstack.org/61237714:26
*** hgibson has joined #tripleo14:26
*** rpioso|afk is now known as rpioso14:26
*** jfrancoa has quit IRC14:26
pvc_anyone know how to remove a pci_device?14:27
pvc_Device 0003:01:05.1 not found: could not access /sys/bus/pci/devices/0003:01:05.1/config: No such file or directory14:27
pvc_nova_libvirt logs14:27
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: [DNM] testing tempest plugin installation from git  https://review.openstack.org/61238614:27
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: [DNM] testing tempest plugin installation from git  https://review.openstack.org/61238614:28
mwhahahasounds like no on status items14:28
mwhahaha#topic bugs & blueprints14:28
mwhahaha#link https://launchpad.net/tripleo/+milestone/stein-114:28
mwhahahaFor Stein we currently have 28 blueprints and about 740 (-3) open Launchpad bugs.  736 stein-1, 4 stein-2.  102 open Storyboard bugs.14:28
mwhahaha#link https://storyboard.openstack.org/#!/project_group/7614:28
*** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)"14:28
mwhahahaso just to highlight, technically this week is stein m114:28
mwhahahasoooooo yea we're already at milestone 114:28
mwhahahaif your blueprint is targeted to stein-1, you should probably update that14:29
mwhahahaany bug related issues?14:29
*** quiquell is now known as quiquell|off14:29
shardyI have one14:29
shardywe did a revert for bug #179852514:29
openstackbug 1798525 in tripleo "The undercloud-upgrades job is failing during the upgrade with "error was: 'ironic_api_short_bootstrap_node_name' is undefined" " [Undecided,Triaged] https://launchpad.net/bugs/1798525 - Assigned to Marios Andreou (marios-b)14:29
mariosshardy: fyi i filed it here https://tree.taiga.io/project/tripleo-ci-board/issue/219?kanban-status=2027733 so you don't have to explain?14:30
shardybut my revert-revert passes CI ref https://review.openstack.org/#/c/611800/14:30
marios(as much)14:30
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: [DNM] testing tempest plugin installation from git  https://review.openstack.org/61238614:30
shardymarios: Ok thanks, I just wanted to ask for help as I still don't understand why the revert-revert works14:30
shardyor how to proceed14:30
mariosshardy: rlandy and i have had a look and we still don't know why, rlandy suspects the depends-on14:30
mariosshardy: current plan14:30
openstackgerritChandan Kumar proposed openstack/tempest-tripleo-ui master: [DNM] testing tripleo ui temepst plugin  https://review.openstack.org/61268914:30
mariosshardy: unless we get a better one is to make it non voting and move it from gate for now, merge the revert14:31
shardythat series fixes some real issues with bootstrapping and custom roles, so it'd be good to get some eyes on it and agree the way forward14:31
mariosshardy: but the RCA is still ongoing/14:31
shardymarios: Ok thanks for the update14:31
florianfThere are 2 patches related to bug #1798590 (broken default plan creation). If anyone could review them it would be awesome. The second one will also need a backport when merged: https://review.openstack.org/#/c/611011/ and https://review.openstack.org/#/c/611305/14:31
openstackbug 1798590 in tripleo "No default plan is created during the deployment of a containerized undercloud" [Undecided,In progress] https://launchpad.net/bugs/1798590 - Assigned to Florian Fuchs (flo-fuchs)14:31
*** medberry has joined #tripleo14:34
mwhahahaok please take a look at the various patches14:34
mwhahahamoving on14:34
mwhahaha#topic projects releases or stable backports14:34
*** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)"14:34
mwhahahai don't think we have anything note worthy for this. We'll be doing monthly stable releases.14:35
mwhahahalike I said technically M1 is this week14:35
mwhahahaso i'll poke EmilienM and we'll get a release together14:35
mwhahaha#topic specs14:35
*** openstack changes topic to "specs (Meeting topic: tripleo)"14:35
mwhahaha#link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open14:35
mwhahahaany spec related items?14:35
mwhahahasounds like no. please take a moment to review the open specs14:38
mwhahaha#topic open discussion14:38
*** openstack changes topic to "open discussion (Meeting topic: tripleo)"14:38
mwhahahaany other items?14:38
mariosTripleO CI Community Meeting next @  https://bluejeans.com/587845809714:38
rfolco|ruckerI Community Meeting starts now at https://bluejeans.com/5878458097 - agenda: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting ~L3214:39
mwhahahaalright thanks everyone14:39
mwhahaha#endmeeting14:39
*** openstack changes topic to "Welcome to Stein | CI Status: GREENish - don't mess this up | https://docs.openstack.org/tripleo-docs/latest/"14:39
openstackMeeting ended Tue Oct 23 14:39:48 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:39
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-10-23-14.00.html14:39
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-10-23-14.00.txt14:39
openstackLog:            http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-10-23-14.00.log.html14:39
openstackgerritChristophe Fontaine proposed openstack/tripleo-heat-templates master: Per role Numa aware vswitch configuration  https://review.openstack.org/61271914:41
chandankumarmwhahaha: honza Hello14:41
chandankumarmwhahaha: honza regarding testing tripleo ui tempest plugin https://review.openstack.org/#/q/topic:tempest_plugin_venv+(status:open+OR+status:merged)14:42
chandankumarmwhahaha: honza I have some success http://logs.openstack.org/86/612386/2/check/tripleo-ci-centos-7-undercloud-containers/eeb7d0d/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-10-23_12_22_4114:42
honzanice14:42
honzachandankumar: this is definitely useful to us14:43
chandankumarhonza: there is only one test in tripleo-ui tempest, we can make that runniung14:43
TenguHeya! can anyone with some neutron knowledge help me a bit on that issue? https://bugs.launchpad.net/tripleo/+bug/1799484  I'm stuck :(14:44
openstackLaunchpad bug 1799484 in tripleo "[podman] neutron doesn't launch dhcp-agent" [High,Triaged]14:44
dtantsurjistr: hey! have a second to chat about https://bugzilla.redhat.com/show_bug.cgi?id=1641653 ?14:44
openstackbugzilla.redhat.com bug 1641653 in openstack-tripleo-heat-templates "[UPGRADES][14] Failed to upgrade uc post ffwd: The database is not compatible with this release of ironic" [High,New] - Assigned to dtantsur14:44
chandankumarhonza: do we some wip tests review for tripleo-uitempest, I can make it live in action14:44
chandankumarmwhahaha: regarding standalone tempest facing few issues on jobs, need help14:45
chandankumarmwhahaha: http://logs.openstack.org/34/609934/5/gate/puppet-cinder-tripleo-standalone/ad7562a/logs/undercloud/var/log/extra/errors.txt.gz#_2018-10-23_12_54_04_95514:45
jistrdtantsur: in a few mins but feel free to type and i'll answer as soon as i can14:45
chandankumarmwhahaha: second one http://logs.openstack.org/42/609942/4/check/puppet-nova-tripleo-standalone/e62482e/logs/tempest.html.gz after multiple recheck it is timing out14:45
dpeacockTengu: sorry - doesn't look like anything I'm familiar with regarding that tap interface not showing up14:46
Tengudpeacock: ;_;14:46
Tengudpeacock: I'm always hitting some weird corner cases. always.14:46
Tengu;)14:46
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Remove old config/release files  https://review.openstack.org/60694414:46
dpeacockTengu: keep pushing those boundaries man ;-)14:46
dtantsurjistr: I think the right puppet stuff is included in instack-undercloud actually. I wonder if the FFU runs it correctly..14:46
Tengudpeacock: yeah. kind of funny. Sometimes. duh.14:47
chandankumarTengu: seen this issue http://logs.openstack.org/34/609934/5/gate/puppet-cinder-tripleo-standalone/ad7562a/logs/undercloud/var/log/extra/errors.txt.gz#_2018-10-23_12_54_04_955 ?14:47
Tenguchandankumar: hmm, didn't check the nova-compute log, wait14:48
honzachandankumar: we also need this patch https://review.openstack.org/#/c/607323/14:48
honzachandankumar: i've added the selenium job here https://review.openstack.org/#/c/607327/114:49
Tenguchandankumar: apparently it's not the same issue.14:49
Tenguchandankumar: at least I can't grep VirtualInterfaceCreateException in nova logs.14:49
honzachandankumar: and the new featureset https://review.openstack.org/#/c/607325/14:49
honzachandankumar: a wip test for tempest-tripleo-ui is here https://review.openstack.org/#/c/605424/14:49
chandankumarhonza: can we get all stuff on a etherpad so that we can merge and test stuff easily?14:50
honzachandankumar: yes, i'll do that now14:50
chandankumarhonza: thanks :-)14:50
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Remove old config/release files  https://review.openstack.org/60694414:50
jistrdtantsur: i think as far as *undercloud upgrade* is concerned, we just run 3 normal undercloud upgrades in succession for FFU14:51
jistrdtantsur: where is it included btw? i couldn't find the class included from anywhere14:52
dtantsurjistr: see links in https://bugzilla.redhat.com/show_bug.cgi?id=1641653#c614:52
openstackbugzilla.redhat.com bug 1641653 in openstack-tripleo-heat-templates "[UPGRADES][14] Failed to upgrade uc post ffwd: The database is not compatible with this release of ironic" [High,New] - Assigned to dtantsur14:52
*** lblanchard has joined #tripleo14:53
jistrdtantsur: i see..14:53
chandankumarhonza: one more question, do we install tripleo-ui from rpm na?14:54
dtantsurjistr: and I can find traces of online_data_migrations on Queens in the logs14:55
Tenguoh. the tap interface is in ovs. damn thing, I always forget its interfaces are NOT listed in `ip a'.14:55
chandankumarTengu: ack14:55
*** ade_lee has joined #tripleo14:55
jistrdtantsur: yprokule also mentioned that 12->13->14 UC upgrade went fine, but 10->11->12->13->14 got stuck on that error during 13->14 upgrade. I can't piece it together into a coherent view on the problem. If we're missing the mighrations in 12->13, then both of those test scenarios should fail. If we're missing it earlier than 12->13, then the failure should pop up earlier than 13->14.14:55
*** dsneddon has quit IRC14:56
dtantsurjistr: and online data migrations did not exist before 12.....14:56
yprokulejistr: dtantsur it was 10->13(ffwd) + upgrade to 1414:56
dtantsurright, we see. it just does not make sense to us :)14:57
*** ccamacho has quit IRC14:57
jistryprokule: re ffwd, it is just normal UC upgrades right? we don't do anything special AFAIK14:57
yprokulejistr: yeah, 10->11->12->1314:58
naturalblueHey is the meeting finished14:58
dtantsurjistr, something that confuses me in the logs is why ironic-dbsync is called once more *after* online_data_migrations..14:59
jistrdtantsur, yprokule: it's a bit of a stretch, but perhaps there is a real bug that only manifests when we're doing such a long chained upgrade? Something that exists since 10 or 11, and only surfaces as broken on 14?14:59
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Make containerized-undercloud-upgrades job non-voting  https://review.openstack.org/61272415:00
* jistr opening logs15:00
holser_naturalblue it was finished15:00
naturalblueok thanks. I will ask my question now so15:01
rlandyshardy: fyi ... https://review.openstack.org/#/c/612724/ - while we merge your patch and check it doesn't break upgrades15:01
naturalblueI am havng an issue with deploying the overcloud controller on rocky. I imported, introspected and provided15:01
shardyrlandy: ack thanks!15:02
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: Make containerized-undercloud-upgrades job non-voting  https://review.openstack.org/61272415:02
mariosshardy: rlandy added the card shardy revote? ^ sorry15:02
naturalbluethe server. When i deploy to it, it pxe boots and installs the image but then fails and reboots and attempts again. it does this until it fails completely. The server goes back to being available.15:02
jistrdtantsur: looking at ironic-dbsync.log from the sosreport but i'm not familiar enough with it to spot what's dbsync and what's data migration there15:03
dtantsurjrist: https://bugzilla.redhat.com/show_bug.cgi?id=1641653#c715:03
openstackbugzilla.redhat.com bug 1641653 in openstack-tripleo-heat-templates "[UPGRADES][14] Failed to upgrade uc post ffwd: The database is not compatible with this release of ironic" [High,New] - Assigned to dtantsur15:03
* dtantsur looks at the system right now15:04
naturalblueI have gone through the troubleshooting guide but the errors messages i get are useless. the server error is that it reached maximum retries and nothing else. I powered up the server and logged in with heat-admin and ran sosreports but when it gets to the kernel test the ssh connection is dropped and i cannot log back in without a reboot15:04
*** hamzy has quit IRC15:04
naturalblueon reboot i log back in run the sos reports but the same thing happens. So I am at a loss of how to find out what is causing this system to not take the heat templates and finish the deploy. any help appreciated.15:05
dtantsurjistr: on 13->14 upgrade do we run dbsync inside or outside the containers?15:05
honzachandankumar: yes, tripleo-ui is packaged as an RPM in rdo15:06
openstackgerritSorin Sbarnea proposed openstack-infra/tripleo-ci master: Install ansible with pip  https://review.openstack.org/61229015:06
chandankumarhonza: then we can test all stuff together15:06
*** roger2 has quit IRC15:06
jistrdtantsur: inside15:06
chandankumarhonza: using depends-on feature of zuul which is what make Zuul awesome from other gating tools :-)15:07
jistrdtantsur: the BZ failure is from 'docker run ...'15:07
openstackgerritMerged openstack/ansible-role-redhat-subscription master: Configure Satellite using Ansible instead of a script  https://review.openstack.org/61250815:07
dtantsuryeah, but I can reproduce it with $ sudo ironic-dbsync --config-file /var/lib/config-data/ironic_api/etc/ironic/ironic.conf upgrade15:07
dtantsurI guess on upgrade it works in both places15:07
honzachandankumar: https://etherpad.openstack.org/p/selenium-testing-ci15:08
honzachandankumar: that sounds amazing, i have no idea how that works15:09
chandankumarhonza: thanks :-) will get something out tomorrow with selenium15:10
*** yprokule has quit IRC15:10
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791815:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819515:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)15:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]15:10
honzachandankumar: perfect, thanks!15:10
naturalblueanyone ever have an issue like this15:10
*** hberaud has quit IRC15:13
*** ccamacho has joined #tripleo15:17
*** ccamacho has quit IRC15:17
naturalbluei can login into the failed server again. Where would the best place be for looking at the deploy logs to see what is gong wrong15:19
mwhahahanaturalblue: check the compute/ironic scheduler logs to see why it can't find a host15:21
naturalbluemwhahaha: will this log be on the undercloud?15:23
*** mmagr has quit IRC15:25
*** huynq has quit IRC15:25
mwhahahanaturalblue: yes15:25
mwhahahanaturalblue: if rocky, then it's in /var/log/containers/(nova|ironic)/15:26
naturalbluemwhahaha: excellent i will check now.thank you15:26
naturalbluemwhahaha: i see a conductor log but not a scheduler15:28
mwhahahanaturalblue: ironic conductor but nova scheduler15:28
mwhahahanaturalblue: anyway those logs will have any info as to why the hosts could not be provisioned15:28
openstackgerritRabi Mishra proposed openstack/tripleo-heat-templates master: Set hierdata for swift server workers conditionally  https://review.openstack.org/61156815:29
*** hberaud has joined #tripleo15:30
naturalbluemwhahaha: excellent i am reading through the nova log now. I wonder would it be better to attempt a redploy of the controller while tailing the log rather than reading through the old file15:30
* mwhahaha throws things at ssbarnea & quiquell|off 15:31
mwhahahassbarnea, quiquell|off: i rebased those tripleo-quickstart patches for a reason (they need to be on top of each other for testing)15:32
*** dtantsur is now known as dtantsur|brb15:32
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28  https://review.openstack.org/61046815:33
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: Add release file for fedora 28  https://review.openstack.org/61046815:33
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: Remove old config/release files  https://review.openstack.org/60694415:33
*** kopecmartin is now known as kopecmartin|off15:33
mwhahahassbarnea, quiquell|off -^ since they are all in the same repo, they need to be stacked so we can properly test them15:34
*** hamzy has joined #tripleo15:38
mwhahaharlandy, marios: can we land https://review.openstack.org/#/c/591540/ to make progress on the fedora28 items15:39
*** dsneddon has joined #tripleo15:39
rlandylooking15:40
mariosmwhahaha: ack noted for checking tomorrow morning if its still around then15:43
*** dprince has quit IRC15:44
*** gfidente is now known as gfidente|afk15:46
*** agopi has joined #tripleo15:48
naturalbluemwhahaha: this seems to be the issue.  Failed to provision instance 13db16e8-4697-4c15-ba38-a448ab6407b5: Failed to change the boot device to disk when deploying node de196eab-a566-4ffa-a5f7-4d66ab860b6b. Error: IPMI call failed: chassis bootdev disk options=persistent.\n']15:48
naturalbluemwhahaha: i wll look at updating the bios15:49
dpeacockI need another +2 on https://review.openstack.org/#/c/609694/ if any core reviewers have time please.15:49
*** mmagr has joined #tripleo15:52
*** ksambor has quit IRC15:53
rlandyasking ssbarnea15:54
chemmarios: rlandy if you have still bandwidth for one review of the emit release review https://review.openstack.org/#/c/606996/15:56
chemmarios: rlandy the review on top of it has failed for an unrelated reason https://review.openstack.org/#/c/604706/27, see my last comment.15:56
rlandychecking that15:57
marioschem: ack (noted tomorrow morning if still around)15:57
chemmarios: thanks15:58
*** dprince has joined #tripleo15:58
openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044516:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO  https://review.openstack.org/60224816:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60429816:00
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Run DLRN gate role only if to_build is true  https://review.openstack.org/61072816:00
*** rfolco|rucker is now known as rfolco|brb16:01
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Add fedora28 support for quickstart  https://review.openstack.org/59165216:01
rlandychem: revoted on https://review.openstack.org/#/c/606996/16:01
rlandychem: wrt https://review.openstack.org/#/c/604706/ - will keep a watch on your recheck run - agree it's unrelated16:03
chemrlandy: thanks, I think it's better to wait for the final push tomorrow after marios or quiquell|off review.16:03
chemrlandy: yeah, I checked the standalone upgrade job and it looked good.16:04
chemrlandy: mostly the repo setup part16:04
rlandyok16:05
*** udesale has quit IRC16:06
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Fix logging to stdout and file in classes/commands  https://review.openstack.org/61230816:06
bogdandostevebaker: hi, PTAL https://review.openstack.org/#/c/61230816:07
bogdandoI tested it on my local env16:07
*** aedc has quit IRC16:07
bogdandopaunch --log-file /var/log/paunch.log , w/o that file, and with misc combinations of paunch -v or/and paunch --debug16:08
bogdandoand basically I need those logging fixes for https://review.openstack.org/#/c/611911/16:09
pvc_anyone know what is the performance of my instance if ever i use vgpu16:09
*** aedc has joined #tripleo16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791816:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819516:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)16:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]16:10
bogdandostevebaker: I'm used to test these https://review.openstack.org/#/q/owner:bdobreli%2540redhat.com+status:open+project:openstack/paunch in a bunch16:10
chandankumarmwhahaha: rfolco|brb marios rlandy it is good to go https://review.openstack.org/#/c/602347/16:11
*** rdopiera has quit IRC16:15
*** ayoung has quit IRC16:21
*** agopi has quit IRC16:24
ssbarneamwhahaha: if you refer to the one removing the old config files, no its MUST not be stacked.16:32
mwhahahassbarnea: in order to actually have your test patch leverage it, it must be stacked16:33
mwhahahassbarnea: your depends-on would not work16:33
mwhahahassbarnea: depends-on is only fro cross-repo dependencies16:33
ssbarneamwhahaha i know depends would not work but this patch needs to be mergeable ASAP16:33
mwhahahassbarnea: then that should be the first patch not the last patch16:33
mwhahahabut don't remove it because it all goes together16:34
ssbarneait cannot depend on anything else, removing old config is a priority or we will endup with divergent stuff.16:34
mwhahahassbarnea: so then make it the first patch16:34
mwhahahassbarnea: we need to stop messing around with these patches and land them then. thats why i asked what patches were necessary for this fedora work so they can get landed16:34
*** pvc has quit IRC16:34
mwhahahassbarnea: the patches have regressed since we were messing with this at the ptg16:35
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: Remove old config/release files  https://review.openstack.org/60694416:35
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: standalone support for quickstart on libvirt  https://review.openstack.org/59154016:35
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: Add release file for fedora 28  https://review.openstack.org/61046816:35
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: DNM: fedora28 mega-testing change  https://review.openstack.org/61011916:35
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: DNM: fedora28 mega-testing change  https://review.openstack.org/61011916:36
*** dsneddon has quit IRC16:37
ssbarneamwhahaha: stacking didn't work well, this is how we astarted f28 work long time ago, the only thing the merged was the stuff made outside the chain. I do understand why you want to to have a chain (to see the test results), still this would not help with merges. i got often remarks near the end to change something minor on the first patch, ended up spending two days rebasing and getting the results after almost one week (infra didn't help)16:38
*** gfidente|afk has quit IRC16:39
ssbarnea... on the other hand, we can duplicate the having both: a chain, and solitary ones.16:39
mwhahahassbarnea: so i want to test it in ci so we can have something out the door16:39
mwhahahassbarnea: if people are nitpicking these we need to stop that16:39
mwhahahawe need to land functionality and clean it up not make it perfect16:40
ssbarneai totally agree16:40
mwhahahassbarnea: so please let me know what patches need to land and i'll get them landed, it's not clear the state of this and i just want the job defined so we can work on this quickstart stuff16:41
mwhahahait's milestone 1 this week and this should have been in place weeks ago16:41
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Fix logging to stdout and file in classes/commands  https://review.openstack.org/61230816:44
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Fix labels to take a comma-separated list  https://review.openstack.org/61129816:44
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Add missing default-runtime support bits  https://review.openstack.org/60863216:44
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Speed up getting the container name  https://review.openstack.org/61131216:44
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Intoduce caching of podman ps calls in BaseRunner  https://review.openstack.org/61191116:44
bogdandoif anyone struggles to debug wtf paunch does behinds scenes, PTAL ^^)16:45
bogdando*is used to struggle16:45
bogdandoand these to help at least with propper logging16:45
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61267716:46
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Ensure correct tmp ownership for Gnocchi  https://review.openstack.org/61182716:49
*** bogdando has quit IRC16:50
openstackgerritHonza Pokorny proposed openstack/tripleo-quickstart-extras master: Add option to install chrome when running tempest  https://review.openstack.org/60732316:50
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: DNM: fedora28 mega-testing change  https://review.openstack.org/61011916:51
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Adopt use of ansible_pkg_mgr variable  https://review.openstack.org/61275316:53
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Ensure correct tmp ownership for Gnocchi  https://review.openstack.org/61182716:53
*** raildo has joined #tripleo16:55
ssbarneamwhahaha: https://review.openstack.org/#/c/612753/ contains the safe changes from were part of the reverted one, should be safe to fast track and ease further work. can be done without including it in any chain.16:56
mwhahahassbarnea: the other part about stacking them is that it prevents merge conflicts. for example your ansible_pkg_mgr one is going to conflict with everything else16:56
openstackgerritHonza Pokorny proposed openstack/tempest-tripleo-ui master: [DNM] Test new selenium ci job  https://review.openstack.org/61275616:57
ssbarneamwhahaha: not e real conflict, once merged a gerrit rebase will succeed as the other change already contains the isolated one.16:58
*** roger2 has joined #tripleo16:58
*** sl0w has joined #tripleo16:59
sl0wanyone else seeing this?16:59
sl0w  - import_role:16:59
sl0w      name: tripleo-module-load16:59
sl0w            ^ here16:59
sl0wtrying to run the all-in-one16:59
sl0wI'm missing something..16:59
*** derekh has quit IRC17:00
mwhahahasl0w: where does that come from17:00
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Add standalone upgrade role and playbook.  https://review.openstack.org/60473617:00
sl0wmwhahaha: when trying to run the ansible playbooks after we download them from heat17:01
chemrlandy: marios sorry for this but the underlying standalone role has changed and I needed to include them ^17:01
openstackgerritHonza Pokorny proposed openstack/tempest-tripleo-ui master: [DNM] Test new selenium ci job  https://review.openstack.org/61275617:01
chemrlandy: marios that it unrelated with the emit release stuff though17:01
mwhahahasl0w: no i meant that role17:01
openstackgerritHonza Pokorny proposed openstack/tempest-tripleo-ui master: [DNM] Test new selenium ci job  https://review.openstack.org/61275617:01
sl0wmwhahaha: https://paste.fedoraproject.org/paste/YEN3f0q8msbN6gy2fY5fyQ17:01
rlandychem:ok - jus looking through the OVB failures atm - will check that out in a bit17:02
rlandywhere are all our cores??17:02
sl0wmwhahaha: I think it worked the other day.. ?17:02
roger2I have queens/containerized/baremetal undercloud. Is it possible and/or advisable to assign multiple tags to nodes?17:02
mwhahahasl0w: seems like you're missing the role dependency but i don't know where that role comes from17:02
sl0wmwhahaha: this is with tripleo-repos tripleo-current17:03
sl0wmwhahaha: ya me neither :/17:03
mwhahahasl0w: oh we haven't had a promotion in some time, you might need tripleo-current-dev17:03
sl0whmm, I can try that sure17:04
mwhahahasl0w: also what version of ansible do you have?17:04
sl0wansible-2.7.0-1.el7.noarch17:05
sl0wmwhahaha: updated repos, doing update -y17:05
*** holser_ has quit IRC17:05
mwhahahasl0w: tripleo-common provides that role17:06
sl0whrrm17:06
sl0wso version mismatch in the rpms?17:07
mwhahahasl0w: tripleo-current might be too old due to lack of promotions17:07
mwhahahasl0w: but yea basically17:07
sl0wmwhahaha: ok thx, trying -dev17:07
mwhahahasl0w: /usr/share/ansible/roles/tripleo-module-load should exist17:08
sl0wmwhahaha: it does now, thanks!17:09
sl0wmwhahaha: we'll see if it breaks with -dev now :)17:10
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791817:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819517:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)17:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]17:10
*** hamzy has quit IRC17:12
openstackgerritBob Fournier proposed openstack/os-net-config stable/pike: Make onboot parameter for ifcfg configuration configurable  https://review.openstack.org/61276117:12
*** hamzy has joined #tripleo17:12
*** dtantsur|brb is now known as dtantsur17:13
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: DNM - Testing no undercloud cleaning  https://review.openstack.org/61160217:14
*** phuongnh has joined #tripleo17:15
*** dsneddon has joined #tripleo17:16
*** rfolco|brb is now known as rfolco|rucker17:16
sl0wmwhahaha: ah I am using git master tripleo-heat-templates, that's the issue.17:17
sl0wI think17:17
*** phuongnh has quit IRC17:19
*** salmankhan has quit IRC17:20
mwhahahasl0w: yea if you're going to use git tht, you need to use current-tripleo-dev17:20
sl0wmwhahaha: yep, thanks for your help alex! you rock!17:21
mwhahahanp17:21
chandankumarmwhahaha: need +w on this https://review.openstack.org/#/c/602347/17:22
chandankumararxcruz: around?17:25
*** pvc_ has quit IRC17:26
*** dtantsur is now known as dtantsur|afk17:29
*** jpena is now known as jpena|off17:34
*** agopi has joined #tripleo17:34
*** agopi has quit IRC17:39
*** pvc has joined #tripleo17:40
pvchi guys17:40
pvc(51): ip address associated with VRID 51 not present in MASTER advert :17:40
pvcanyone17:40
*** trown is now known as trown|lunch17:42
arxcruzchandankumar: if it's very important :)17:44
chandankumararxcruz: need help on stackviz https://review.openstack.org/612618 I am not sure what i am doinf wrong17:45
chandankumartake your time17:45
arxcruzchandankumar: i'll take a look tomorrow okay? time to play with my daughter :)17:45
chandankumararxcruz: sure17:45
*** hamzy has quit IRC17:59
*** hamzy has joined #tripleo18:00
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Merge new params - nic-config templates  https://review.openstack.org/60580718:00
*** agopi has joined #tripleo18:06
*** morazi has quit IRC18:06
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791818:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819518:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]18:10
roger2I'm confused about server roles/assignments. Other than controller and Compute, is it enough to add Ceph Storage? Or does one still need Block and Object storage as separate assignments?18:11
fultonjroger2: if you're going to use ceph for your storage, then it's not necessary to use the block or object storage roles18:13
roger2fultonj: thank you!18:13
*** apetrich has quit IRC18:16
roger2I'm manually deploying tripleo, queen release, containerized, on bare metal. I don't see how to do it in the GUI, but is it possible and/or advisable to combine ceph-storage roles with compute/controller roles?18:16
*** apetrich has joined #tripleo18:17
*** medberry has quit IRC18:18
fultonjnot sure if you mean combine on one host or deploy together on separate hosts18:19
*** amoralej is now known as amoralej|off18:19
fultonjyou can use composable roles to merge merge services onto one host18:19
*** pvc has quit IRC18:19
*** jpich has quit IRC18:20
fultonji'd recommend deploying 1 compute + 1 controller and once that's working redeploy with 1 compute + 1 controller + 1 ceph18:20
fultonjthen once that's working scale as you need to18:20
fultonjfor 1 compute on controller follow https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/overcloud.html and pages before18:21
fultonjwhen its time to add ceph follow https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ceph_config.html18:21
fultonjroger2: ^18:21
*** hamzy has quit IRC18:23
*** hamzy has joined #tripleo18:24
roger2fultonj: yeah, I hope to have 3 or 4 ceph nodes spread out among other nodes, but was wanting the other nodes to other things too since I don't have that many nodes. And thank you for the links. I like your plan to start simple then scale.18:25
slaglestevebaker: do we have any docs for building your own container images?18:27
*** cylopez has joined #tripleo18:28
mwhahahaslagle: https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/3rd_party.html18:28
mwhahahasl0w: do you mean new images or just running the kolla build bits?18:28
slagleitlinux: ^^18:28
slagleitlinux: https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/3rd_party.html18:28
mwhahahasl0w: sorry meant for slagle18:28
slaglemwhahaha: it's for itlinux, but he asked about removing a package from an existing image18:29
slagleitlinux: let me know if those docs help18:29
mwhahahathat's just the adding layer bits18:30
mwhahahaif you're just messing with a single contianer, you can do it via the adding layers and you'd just do an rpm -e <whatever>18:30
slagleright, that's what i was thinking18:30
*** vinaykns has joined #tripleo18:32
sl0wmwhahaha: fyi, this may be useful to someone.. https://github.com/imain/ocp-doit18:34
sl0wmwhahaha: scripts to set up the all in one.. then ocp but valid just for an example of the all in one18:34
mwhahahasl0w: it's a bit out of date but yea that seems to be most of it18:37
*** chandankumar is now known as chkumar|off18:37
*** weshay has joined #tripleo18:38
sl0wmwhahaha: well feel free to correct me :)18:38
*** cylopez has quit IRC18:42
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: ceilometer: --skip-metering-database is gone  https://review.openstack.org/61277618:42
*** panda has quit IRC18:45
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: ceilometer: --skip-metering-database is gone  https://review.openstack.org/61277618:45
*** panda has joined #tripleo18:45
mwhahahasl0w: https://github.com/imain/ocp-doit/pull/1 there ya go18:46
openstackgerritSam Doran proposed openstack/tripleo-quickstart-extras master: Improve how packages are installed in build-test-packages role  https://review.openstack.org/61277918:49
openstackgerritSam Doran proposed openstack/tripleo-quickstart-extras master: Improve how packages are installed in build-test-packages role  https://review.openstack.org/61277918:50
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: ceilometer: --skip-metering-database is gone  https://review.openstack.org/61277618:51
itlinuxTHANKS all.. I tried some of those steps.. building it now shall see.. if I can find the right path. pauch using a Dockerfile did not work for me.18:57
itlinuxbut working and see to check how it can be changed18:57
sl0wmwhahaha: awesome, thanks mate!19:00
*** agopi has quit IRC19:03
*** salmankhan has joined #tripleo19:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791819:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819519:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]19:10
*** caboucha has joined #tripleo19:11
*** salmankhan has quit IRC19:13
*** hgibson has quit IRC19:14
openstackgerritSam Doran proposed openstack/tripleo-quickstart-extras master: Improve how packages are installed in build-test-packages role  https://review.openstack.org/61277919:20
*** pcaruana has quit IRC19:23
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61267719:26
*** hberaud has quit IRC19:28
openstackgerritRajini Karthik proposed openstack/tripleo-heat-templates master: Added Dell EMC SC multipath support  https://review.openstack.org/61245119:34
*** trown|lunch is now known as trown19:36
*** hberaud has joined #tripleo19:38
*** hberaud has quit IRC19:39
*** mjturek has quit IRC19:46
cabouchaslagle: ping19:48
*** agopi has joined #tripleo19:50
cabouchaslagle: ping. in regards to composable roles.19:52
*** akrivoka has quit IRC19:54
*** openstackgerrit has quit IRC20:06
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791820:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819520:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)20:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]20:10
*** mjturek has joined #tripleo20:14
*** openstackgerrit has joined #tripleo20:17
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: standalone support for quickstart on libvirt  https://review.openstack.org/59154020:17
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: Add release file for fedora 28  https://review.openstack.org/61046820:17
*** medberry has joined #tripleo20:17
slaglecaboucha: hi20:19
cabouchaslagle:  You had a discussion concerning https://review.openstack.org/#/c/582626 with sambetts on Friday.20:20
cabouchaslagle:  I'm the person who's been chasing this down.20:20
cabouchaslagle: I'm having trouble figuring a replacement for mac2host functionality.20:21
*** dprince has quit IRC20:22
cabouchaslagle:  We plan on having 2 service files.  One for UCSM and the other for Nexus.  Currently there exists an extraconfig file for both.20:22
cabouchaslagle:  shardy, emilien suggested using derive_params.yaml. Not sure this will do the trick.20:23
cabouchaslagle:  Was there a replacement written for extraconfig/all_nodes/mac_hostname.j2.yaml?20:24
slaglecaboucha: no. but i could write one.20:25
slaglederived parameters might be an option, or we could try and do it all in ansible20:25
slagleotherwise, you're having to write it in mistral.20:26
cabouchathat would be awesome.  I don't have a lot of experience with tripleo so could use some help.20:26
slaglecaboucha: i was actually going to start by looking at https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/extraconfig/all_nodes/neutron-ml2-cisco-nexus-ucsm.j2.yaml20:27
slaglecaboucha: seems that does something similar to mac_hostname.j2.yaml20:28
slaglecaboucha: are both needed?20:28
cabouchaslagle:  Yes I'm not sure which started first.20:28
slagleok. i think we can do this all in ansible tasks using the composable services host_prep_tasks20:29
cabouchaslagle:  I'm thinking it would be nice to have a generic mac2host mapping that could be picked up by the service files20:29
openstackgerritTim Rozet proposed openstack/puppet-tripleo master: Updates OpenDaylight websocket haproxy healthcheck  https://review.openstack.org/61279420:29
*** hberaud has joined #tripleo20:29
cabouchaslagle:  I'll get familiar with host_prep_tasks20:29
*** hberaud has quit IRC20:30
slaglei think we'd just need each node to run that script via the shell module, and then set_fact the result20:30
slagleand then we could have a task that iterates over all the hosts, gets those fact values, then writes out the mapping files20:31
cabouchaThere's a lot of host_prep_tasks that exist20:31
slaglewe'd use a new composable service for this20:32
cabouchaok20:32
*** gfidente has joined #tripleo20:34
cabouchasimilar to existence of extraconfig/all_modes/mac_hostname.j2.yaml20:34
*** lblanchard has quit IRC20:35
cabouchaWe had a single file mac2host in https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/extraconfig/all_nodes/neutron-ml2-cisco-nexus-ucsm.j2.yaml20:36
cabouchaas opposed to many files done in mac_hostname.j2.yaml20:36
*** ssbarnea_ has quit IRC20:36
*** ansmith has quit IRC20:37
*** mjturek has quit IRC20:39
*** mjturek has joined #tripleo20:40
*** hamzy has quit IRC20:40
*** hamzy has joined #tripleo20:40
*** mjturek has quit IRC20:41
*** agopi has quit IRC20:44
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates master: Fix typo in standalone-tripleo environment  https://review.openstack.org/61280020:44
*** mjturek has joined #tripleo20:44
trownsl0w: mwhahaha https://review.openstack.org/61280020:45
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [wip] Add epel element to centos7 testing  https://review.openstack.org/61263620:46
mwhahahatrown: that's managed in sample-env-generator20:46
mwhahahai'll fixup20:47
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: increase the available ram for the bmc node  https://review.openstack.org/61007820:47
trownmwhahaha: ack, I can fix it quickly too if you havent already20:48
mwhahahafixing right now20:48
trownk20:48
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Fix typo in standalone-tripleo environment  https://review.openstack.org/61280020:48
mwhahahatrown: -^ there ya go20:49
mwhahahawonder how we didn't hit that in ci20:49
trownthat is a bit odd... it blows up pretty clearly20:49
mwhahahaoh cause https://review.openstack.org/#/c/605523/20:50
mwhahahathe quickstart updates never merged :/20:50
* mwhahaha eyeballs responsible parties20:50
sl0wmwhahaha: trown: nice, thanks guys20:51
*** Vorrtex has quit IRC20:55
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Update standalone environment file  https://review.openstack.org/60552320:55
mwhahahasl0w: you can use THT/environment/standalone.yaml as a fallback until that merges. i know i updated your script to the new one cause i didnt' know it wasn't working20:56
sl0wmwhahaha: ya no worries20:59
mwhahahaand this is why it's important to have up to date test coverage :D21:00
sl0wand guinea pig users :)21:01
*** salmankhan has joined #tripleo21:03
trownsl0w: had to start over... docker wouldnt start because the kernel was too old... i updated but didnt restart21:04
sl0wtrown: ok21:05
trownsl0w: running the all-in-one script now though... will check on it a bit later21:05
sl0wtrown: you pulled before you ran it?21:05
trownsl0w: nope...21:05
* trown checks what im missing21:05
sl0wprobably just some config stuff if anything21:05
trownya looks like just some clouds.yaml fixups21:06
sl0wyep21:07
trownsl0w: thanks for getting that going, I will continue to hack on it tomorrow21:07
sl0wtrown: cool beans!21:07
sl0wtrown: I'll let you know when I'm up :)21:07
sl0wtrown: I gotta get my HW provisioned tomorrow I think21:07
trownsl0w: awesome. have a nice evening21:08
*** trown is now known as trown|outtypewww21:08
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791821:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819521:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]21:10
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add v3 project domain settings required for stacks/keypairs  https://review.openstack.org/61167421:10
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Resolve get_build_command output before container_build_id  https://review.openstack.org/60273421:11
*** gfidente has quit IRC21:14
stevebakerslagle: do you mean building images from scratch, or modifying an existing image during prepare21:19
stevebakerslagle: ?21:19
slaglemaybe both, i'm not sure. itlinux was asking21:20
slaglei think the "add a layer" method will be sufficient for now21:20
itlinuxI found a script that builds the kolla image but it failed on zaqar images.. and I notice that the images I pull down are 169 and it built only 119.. on my UC.21:22
itlinuxso testing the horizon since that got built but it is stuck on step 3 now.21:22
*** raildo has quit IRC21:23
itlinuxand I am trying this on a Pike ENV so not sure if things have changed later on but I wonder since my production is BM and need to update to Container and issues I see is Horizon is broken. SQLITE issue and also show UI for trove, cloudkitty, murano etc..21:24
stevebakeritlinux: ok, unless you really need to rebuild from scratch, I'd recommend modifying existing images during prepare (rocky and later) https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/container_image_prepare.html#modifying-images-during-prepare21:24
itlinuxso I have used the Dockerfile to modify the container here is what the Dockerfile looks like..21:25
itlinuxusing pauch http://paste.openstack.org/show/732860/21:26
stevebakeritlinux: for a full build, you might have luck with our kolla-build wrapper openstack overcloud container image build --help21:27
stevebakeropenstack overcloud container image build --help21:27
itlinuxso stevebaker: trying to have a horizon working.. I know mwhahaha: has a patch that is going to be backported so I pull it down and then use a script to build them locally21:27
itlinuxI will check that option as well here is the script that built the local once..21:28
stevebakerok21:28
itlinuxhttp://paste.openstack.org/show/732861/21:28
itlinuxso this did built some of them but stopped at zaqar21:29
itlinuxand trying to update the overcloud now which looks like it's going to time out stuck on step 321:30
itlinuxthe only one I am updating is the horizon container to see if that works..21:30
*** vinaykns has quit IRC21:35
*** mmagr has quit IRC21:38
*** spsurya has quit IRC21:38
*** slaweq has quit IRC21:39
*** roger2 has quit IRC21:41
*** agopi has joined #tripleo21:48
*** ade_lee has quit IRC21:55
*** slaweq has joined #tripleo22:05
*** mjturek has quit IRC22:08
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791822:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819522:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]22:10
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: New workflow for standalone upgrade.  https://review.openstack.org/60470622:10
*** abishop has quit IRC22:13
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: New workflow for standalone upgrade.  https://review.openstack.org/60470622:13
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Add standalone upgrade to emit release.  https://review.openstack.org/60699622:19
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: New workflow for standalone upgrade.  https://review.openstack.org/60470622:19
*** rcernin has joined #tripleo22:24
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [wip] Add epel element to centos7 testing  https://review.openstack.org/61263622:25
*** bnemec has quit IRC22:25
*** rh-jelabarre has quit IRC22:26
*** ansmith has joined #tripleo22:29
*** slaweq has quit IRC22:38
*** caboucha has quit IRC22:44
*** hamzy has quit IRC22:59
*** threestrands has joined #tripleo23:02
*** tosky has quit IRC23:02
*** sanjayu_ has joined #tripleo23:05
*** mcornea has quit IRC23:07
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791823:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819523:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]23:10
*** slaweq has joined #tripleo23:12
*** rlandy is now known as rlandy|bbl23:17
openstackgerritEmilien Macchi proposed openstack/paunch master: podman: stop the docker container during upgrade  https://review.openstack.org/60831923:33
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs050: upgrade the undercloud to Podman containers  https://review.openstack.org/60846323:33
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs010: switch undercloud to podman  https://review.openstack.org/61159723:35
openstackgerritTony Breeds proposed openstack/tripleo-heat-templates master: Add support for configuring ppc64le in ironic  https://review.openstack.org/58082923:38
*** slaweq has quit IRC23:45
openstackgerritBob Fournier proposed openstack/os-net-config stable/pike: Make onboot parameter for ifcfg configuration configurable  https://review.openstack.org/61276123:51
*** mjturek has joined #tripleo23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!