| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 00:00 |
|---|---|---|
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 00:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 00:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO https://review.openstack.org/604293 | 00:00 |
| *** krypto has quit IRC | 00:11 | |
| *** krypto has joined #tripleo | 00:11 | |
| *** sambetts_ has quit IRC | 00:12 | |
| *** sambetts_ has joined #tripleo | 00:13 | |
| *** boazel has joined #tripleo | 00:17 | |
| *** boazel_ has quit IRC | 00:21 | |
| openstackgerrit | Nagasai Vinaykumar Kapalavai proposed openstack/puppet-tripleo master: Add a connector to Qpid router https://review.openstack.org/611979 | 00:56 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Add version to python execution https://review.openstack.org/619124 | 01:58 |
| *** owalsh has quit IRC | 02:25 | |
| *** mrsoul has joined #tripleo | 02:27 | |
| *** mschuppert has quit IRC | 02:31 | |
| *** d0ugal has quit IRC | 02:33 | |
| *** owalsh has joined #tripleo | 02:39 | |
| *** tonyb has quit IRC | 02:49 | |
| *** tonyb has joined #tripleo | 02:52 | |
| *** udesale has joined #tripleo | 03:13 | |
| *** psachin has joined #tripleo | 03:13 | |
| *** ykarel|away has joined #tripleo | 03:40 | |
| *** ykarel|away is now known as ykarel | 03:44 | |
| openstackgerrit | Janki Chhatbar proposed openstack/puppet-tripleo stable/queens: Add support for ODL-OVS IPv6 deployment https://review.openstack.org/612238 | 03:48 |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates stable/queens: Add config option for ODL IPv6 deployment https://review.openstack.org/612242 | 03:48 |
| *** ramishra has joined #tripleo | 04:15 | |
| *** janki has joined #tripleo | 04:29 | |
| *** dtrainor__ has joined #tripleo | 04:42 | |
| *** dtrainor_ has quit IRC | 04:45 | |
| *** radeks__ has joined #tripleo | 04:47 | |
| *** radeks_ has quit IRC | 04:50 | |
| *** dtrainor__ has quit IRC | 04:57 | |
| *** radeks__ has quit IRC | 05:00 | |
| *** pdeore has joined #tripleo | 05:04 | |
| *** ykarel has quit IRC | 05:07 | |
| *** psachin has quit IRC | 05:13 | |
| *** psachin has joined #tripleo | 05:15 | |
| *** ykarel has joined #tripleo | 05:24 | |
| janki | HI. Can I get some reviews for https://review.openstack.org/#/c/618718/ | 05:32 |
| *** saneax has joined #tripleo | 05:44 | |
| *** pcaruana has quit IRC | 05:44 | |
| *** ratailor has joined #tripleo | 05:45 | |
| *** janki has quit IRC | 05:55 | |
| *** janki has joined #tripleo | 05:56 | |
| *** dtrainor__ has joined #tripleo | 05:58 | |
| *** yprokule has joined #tripleo | 06:09 | |
| *** dtrainor__ has quit IRC | 06:11 | |
| *** chandankumar has joined #tripleo | 06:23 | |
| *** chandankumar is now known as chkumar|rover | 06:25 | |
| *** chkumar|rover is now known as chkumar|ruck | 06:25 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-heat-templates master: Adjust haproxy-public-tls-inject.yaml bootstrap variable https://review.openstack.org/619215 | 06:26 |
| openstackgerrit | Chandan Kumar proposed openstack-infra/tripleo-ci master: Mark tripleo-ci-centos-7-scenario007-multinode-oooq to non-voting https://review.openstack.org/619492 | 06:27 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Fixed path for tripleo deployer input file https://review.openstack.org/618994 | 06:27 |
| *** jfrancoa has joined #tripleo | 06:35 | |
| *** ksambor has joined #tripleo | 06:40 | |
| *** quiquell|off is now known as quiquell | 06:41 | |
| openstackgerrit | Kamil Sambor proposed openstack/tripleo-quickstart master: Remove openvswitch tasks https://review.openstack.org/619196 | 06:49 |
| openstackgerrit | Kamil Sambor proposed openstack/tripleo-heat-templates master: Check and enable openvswitch package https://review.openstack.org/619031 | 06:49 |
| *** pcaruana has joined #tripleo | 07:08 | |
| Tengu | hllo there | 07:10 |
| chkumar|ruck | \o/ | 07:12 |
| Tengu | wow, I got a patch merged!! | 07:12 |
| Tengu | this means we currently get haproxy stats in the CI logs \o/ | 07:12 |
| marios | you .. mean... actually merged? ! hey everyone! | 07:13 |
| marios | :D | 07:13 |
| Tengu | marios: gate's happy for now :D | 07:13 |
| marios | nice job chkumar|ruck Tengu ++ | 07:16 |
| Tengu | oh, well, I didn't do anything | 07:16 |
| marios | emotional support | 07:16 |
| Tengu | so long for my "lack of empathy" ;) | 07:17 |
| *** kopecmartin|off is now known as kopecmartin | 07:17 | |
| chkumar|ruck | marios, \o/ | 07:21 |
| *** mschuppert has joined #tripleo | 07:27 | |
| *** skramaja has joined #tripleo | 07:29 | |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Cleanup irrelevant scripts from previous releases. https://review.openstack.org/615370 | 07:36 |
| *** dtantsur|afk is now known as dtantsur | 07:38 | |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Assert workloads are spawned in different stages https://review.openstack.org/600674 | 07:42 |
| *** rcernin has quit IRC | 07:48 | |
| *** cylopez has joined #tripleo | 07:48 | |
| *** slaweq has joined #tripleo | 07:49 | |
| quiquell | Tengu: do you know where I can ask about podman ? | 07:49 |
| Tengu | quiquell: #podman on freenode? but they are mostly US.... | 07:49 |
| Tengu | quiquell: or you can try me - not sure I'll know your answer, but... | 07:49 |
| quiquell | Tengu: latest podman version + f28 = https://bugs.launchpad.net/tripleo/+bug/1804649 | 07:50 |
| openstack | Launchpad bug 1804649 in tripleo "f28 standalon fails at timeout" [High,Triaged] - Assigned to Quique Llorente (quiquell) | 07:50 |
| quiquell | Tengu: tl;dr kernel: overlayfs: unrecognized mount option "nodev" or missing value | 07:51 |
| Tengu | erf... ok. so on that, no clue :( | 07:52 |
| quiquell | Tengu: looks like this kernel version don't support "nodev" at overlayfs ? | 07:52 |
| Tengu | overlay.mountopt=nodev http://logs.openstack.org/98/619598/3/check/tripleo-ci-fedora-28-standalone/ee64c01/logs/undercloud/var/log/extra/podman/podman_allinfo.log.txt.gz | 07:53 |
| quiquell | Tengu: let's compare with centos-7 standalone | 07:53 |
| Tengu | http://logs.openstack.org/75/618975/4/check/tripleo-ci-centos-7-standalone/d6fdd24/logs/undercloud/var/log/extra/podman/podman_allinfo.log.txt.gz | 07:53 |
| Tengu | ye, missing in there | 07:54 |
| Tengu | check at the bottom | 07:54 |
| Tengu | but I don't know "who" sets this for fedora.... | 07:54 |
| quiquell | Tengu: that very good clue, thanks ! will try to find | 07:55 |
| quiquell | ykarel: ^ | 07:55 |
| ykarel | quiquell, yup found same | 07:55 |
| Tengu | but centos is on a 3.10 while fedora is on 4.18. Might be the thing. | 07:55 |
| ykarel | but in #rdo :) | 07:55 |
| Tengu | heh | 07:55 |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud stable/rocky: Fix instack-undercloud nits https://review.openstack.org/619467 | 07:55 |
| quiquell | Tengu: you guys where brain connected, maybe you are drinking same coffe | 07:55 |
| quiquell | ccamacho: Thanks mate :-/ | 07:55 |
| Tengu | didn't take any coffee today :) | 07:55 |
| ykarel | me too :) | 07:56 |
| Tengu | that's it then | 07:56 |
| quiquell | hehe | 07:56 |
| quiquell | same ether | 07:56 |
| quiquell | Go back in a few | 07:56 |
| *** quiquell is now known as quiquell|brb | 07:56 | |
| *** cylopez has quit IRC | 07:56 | |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Move ceph bootstrap tasks to new file for include_tasks standalone https://review.openstack.org/616872 | 07:58 |
| marios | simple change needed for standalone scenario1 and 4 please ^^ if you have some review time thank you | 07:59 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Move ceph bootstrap tasks to new file for include_tasks standalone https://review.openstack.org/616872 | 08:00 |
| marios | just updated commit message thanks | 08:00 |
| *** paramite has joined #tripleo | 08:00 | |
| *** jtomasek has joined #tripleo | 08:04 | |
| *** amoralej|off is now known as amoralej | 08:05 | |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud stable/rocky: Fix instack-undercloud nits https://review.openstack.org/619467 | 08:12 |
| ccamacho | hey quiquell | 08:12 |
| ccamacho | xD | 08:12 |
| ccamacho | morning for you also | 08:12 |
| *** cylopez has joined #tripleo | 08:14 | |
| *** quiquell|brb is now known as quiquell | 08:17 | |
| *** jpena|off is now known as jpena | 08:17 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Fix little typo at pre-commit https://review.openstack.org/619518 | 08:22 |
| openstackgerrit | Merged openstack/tripleo-common master: Do not fail deploy for empty ceph ansible fetch directory https://review.openstack.org/619073 | 08:22 |
| *** ykarel is now known as ykarel|lunch | 08:25 | |
| *** frippe75 has quit IRC | 08:30 | |
| *** akrivoka has joined #tripleo | 08:30 | |
| *** holser_ has joined #tripleo | 08:33 | |
| *** holser_ has quit IRC | 08:33 | |
| *** ramishra has quit IRC | 08:33 | |
| *** holser_ has joined #tripleo | 08:34 | |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud stable/rocky: Fix instack-undercloud nits https://review.openstack.org/619467 | 08:34 |
| *** ramishra has joined #tripleo | 08:38 | |
| *** gfidente has joined #tripleo | 08:46 | |
| *** suuuper has joined #tripleo | 08:52 | |
| *** d0ugal has joined #tripleo | 08:54 | |
| *** brault has joined #tripleo | 08:58 | |
| *** jpich has joined #tripleo | 08:59 | |
| quiquell | Tengu: looking at kernel, looks like now its nodev by default | 09:00 |
| quiquell | Tengu: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/tree/fs/overlayfs/super.c?h=v4.18.20#n1499 | 09:00 |
| Tengu | hmm. so that's probably the issue. | 09:02 |
| Tengu | quiquell: so I think it's worth creating an issue on libpod github for that. | 09:03 |
| quiquell | Tengu: let me just check the centos-7 kernel version, I don't see the nodev option there aither | 09:03 |
| quiquell | Tengu: I mean it's like they are adding an option that is not present at any of centos-7/f28 version but the podman version is the same :-/ | 09:04 |
| Tengu | quiquell: f28 has a newer kernel version than centos7 | 09:04 |
| Tengu | you can see that in the podman info block | 09:04 |
| *** florianf is now known as florianf|pto | 09:04 | |
| quiquell | Tengu: The kernel version is not the problem and podman is not the problem either | 09:05 |
| quiquell | Tengu: both kernel version has no "nodev" option | 09:05 |
| quiquell | Tengu: and podman is exactly the same | 09:05 |
| Tengu | oh, ok. didn't understand that for the kernel/nodev. | 09:05 |
| quiquell | Tengu: The issue is "nodev" is used to mount the overlay think at f28, don't know where, can be another package :-/ | 09:06 |
| Tengu | quiquell: what about conmon / runc versions? | 09:06 |
| quiquell | Tengu: well I se a lot of docker RPMs there | 09:06 |
| quiquell | Tengu: docker RPMs are older at f28 maybe that's the issue :-/ | 09:07 |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates master: Allow overlay tunnel endpoints on IPv6 address https://review.openstack.org/603532 | 09:08 |
| Tengu | hm, I doubt docker rpms have anything to do with that | 09:08 |
| quiquell | Tengu: me too | 09:09 |
| quiquell | Tengu: podman is suppose to replace that | 09:09 |
| openstackgerrit | Pierre Riteau proposed openstack/diskimage-builder master: Fix a typo in the help message of disk-image-create https://review.openstack.org/619679 | 09:09 |
| Tengu | yeah | 09:09 |
| Tengu | quiquell: so maybe, as said, it's related to runc or conmon | 09:09 |
| *** ykarel|lunch is now known as ykarel | 09:10 | |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Move ceph-loop3 to ceph-loop-device role for standalone scenarios https://review.openstack.org/616872 | 09:11 |
| *** tosky has joined #tripleo | 09:15 | |
| *** akrivoka has quit IRC | 09:17 | |
| *** akrivoka has joined #tripleo | 09:17 | |
| quiquell | Tengu: Looks like we have a storage.conf | 09:22 |
| quiquell | Tengu: https://github.com/containers/storage/blob/956a1971694f18fd602b1203c0a2d192e2cc88a1/storage.conf | 09:22 |
| quiquell | Tengu: maybe the RPM do stuff with it depending on the version :-/ | 09:23 |
| quiquell | I am going to reproduce it | 09:23 |
| Tengu | so this storage.conf is provided by skopeo-containers-0.1.31-1.dev.gitae64ff7.el7.centos.x86_64 | 09:23 |
| Tengu | on centos, we don't have the "nodev" in that file either. | 09:24 |
| Tengu | ykarel: care to provide me a link for the skopeo package on f28? | 09:24 |
| quiquell | Tengu: Have it | 09:24 |
| Tengu | ah, cool :) | 09:24 |
| quiquell | Tengu: f28 is using skopeo-0.1.31-13.dev.gite3034e1.fc28.x86_64 | 09:24 |
| quiquell | Tengu: but no trace of skope-containers | 09:25 |
| quiquell | Tengu: Are the same ? | 09:25 |
| ykarel | Tengu, https://trunk.rdoproject.org/fedora/stable-base/latest/Packages/ | 09:25 |
| Tengu | quiquell: skopeo-0.1.31-1.dev.gitae64ff7.el7.centos.x86_64 | 09:25 |
| Tengu | ykarel: ah, cool, thanks | 09:25 |
| quiquell | Tengu: centos and fedora skope are different | 09:25 |
| quiquell | f: skopeo-0.1.31-13.dev.gite3034e1.fc28.x86_64 | 09:25 |
| Tengu | quiquell: yeah. so we probably have something there. | 09:26 |
| quiquell | c: skopeo-0.1.31-7.gitb0b750d.el7.x86_64 | 09:26 |
| quiquell | f is newer | 09:26 |
| Tengu | yeah, lemme download the rpm + un-rpm it | 09:26 |
| *** mrunge_ is now known as mrunge | 09:27 | |
| quiquell | Tengu: ack, I am going to dig in the code | 09:27 |
| Tengu | so. skopeo package doesn't provide the storage.conf, quiquell. that's sure. | 09:27 |
| Tengu | hmmm. and the ./etc/containers/storage.conf provided by the skopeo-containers does not match "nodev" either. | 09:28 |
| *** bogdando has joined #tripleo | 09:28 | |
| quiquell | Tengu: going to reproduce this | 09:28 |
| Tengu | ok | 09:29 |
| quiquell | So we have a life system | 09:29 |
| Tengu | yeah, would be great | 09:29 |
| quiquell | Tengu: btw I have run the same job but with docker, but this is good investigation for rhel8 I suppose | 09:29 |
| Tengu | going to make a teapot. I guess I'll need it. | 09:29 |
| quiquell | Tengu: Yep choose strong tea | 09:29 |
| dtantsur | hi folks! a simple backport if somebody has time: https://review.openstack.org/#/c/618979/ | 09:30 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/rocky: [validation] ignore openstack-neutron-dhcp-agent as it is not restarting https://review.openstack.org/619686 | 09:31 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Make standalone_container_cli overridable https://review.openstack.org/619468 | 09:34 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Drop remaining ssh-user from templates. https://review.openstack.org/617455 | 09:34 |
| Tengu | quiquell: back :). have a green tea, should be enough. | 09:35 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Improve the openshift-nw-openstack validation https://review.openstack.org/619578 | 09:35 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Move ceph-loop3 to ceph-loop-device role for standalone scenarios https://review.openstack.org/616872 | 09:36 |
| quiquell | Tengu: containers.conf is at logs.o.o | 09:36 |
| quiquell | Tengu: f28 storage.conf have the option and c7 don't | 09:36 |
| quiquell | Tengu: http://logs.openstack.org/98/619598/3/check/tripleo-ci-fedora-28-standalone/ee64c01/logs/undercloud/etc/containers/storage.conf.txt.gz | 09:36 |
| Tengu | yeah, well, we could expect that seeing the output of `podman info' | 09:36 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Add new tripleo-ci-centos-7-scenario001-standalone job https://review.openstack.org/619508 | 09:37 |
| Tengu | quiquell: when you have a live system, please let me in, so that I can check a few things. | 09:37 |
| quiquell | Tengu: So you said that skopeo is not installing it ? | 09:37 |
| quiquell | Tengu: Will take time I have to prepare my system for f28 | 09:37 |
| quiquell | Tengu: humm wait my laptop is f28 | 09:37 |
| quiquell | Tengu: Maybe I can just install the RPMs | 09:38 |
| Tengu | http://logs.openstack.org/98/619598/3/check/tripleo-ci-fedora-28-standalone/ee64c01/logs/undercloud/var/log/extra/rpm-list.txt.gz apparently, we don't have skopeo-containers on f28 | 09:38 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Add tripleo-ci-centos-7-scenario004-standalone job https://review.openstack.org/619520 | 09:38 |
| Tengu | I match skopeo... not the other one. | 09:38 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Fix the ceilometerdb-size validation in the containerized undercloud https://review.openstack.org/618210 | 09:38 |
| quiquell | Tengu: centos either | 09:38 |
| Tengu | hmmmmmm are you 100% sur for centos? | 09:38 |
| Tengu | I do have that one on my centos undercloud. | 09:38 |
| chkumar|ruck | marios, needs +w on this one https://review.openstack.org/#/c/619215/ | 09:39 |
| quiquell | Tengu: http://logs.openstack.org/75/618975/4/check/tripleo-ci-centos-7-standalone/d6fdd24/logs/undercloud/var/log/extra/rpm-list.txt.gz | 09:39 |
| Tengu | oh wow. | 09:39 |
| quiquell | Tengu: I don't see skope-containers there | 09:39 |
| Tengu | what.the.actual.fuck?! | 09:39 |
| ykarel | Tengu, quiquell https://trunk.rdoproject.org/fedora/stable-base/latest/Packages/containers-common-0.1.31-13.dev.gite3034e1.fc28.x86_64.rpm | 09:40 |
| ykarel | this has nodev | 09:40 |
| quiquell | ykarel: But we are not installing it at f28 | 09:40 |
| ykarel | # mountopt specifies comma separated list of extra mount options | 09:40 |
| ykarel | mountopt = "nodev" | 09:40 |
| ykarel | quiquell, it's a dep for skopeo | 09:40 |
| Tengu | well, it's not listed in rpm -qa | 09:40 |
| Tengu | ah, damn, coMMon | 09:41 |
| Tengu | was reading coNmon | 09:41 |
| Tengu | -.- damn names | 09:41 |
| ykarel | rpm -qp --requires https://trunk.rdoproject.org/fedora/stable-base/latest/Packages/skopeo-0.1.31-13.dev.gite3034e1.fc28.x86_64.rpm | 09:41 |
| ykarel | containers-common = 0.1.31-13.dev.gite3034e1.fc28 | 09:41 |
| Tengu | yay. so we have our culprite. | 09:42 |
| Tengu | apparently, container-common is NOT on my centos7 | 09:42 |
| Tengu | hey, guess what, I'm pretty sure containers guys changed their packaging for the newer version, and we're just lucky it didn't hit already centos. | 09:43 |
| quiquell | Doing my dummy rpm comparing | 09:44 |
| quiquell | f: containers-common-0.1.31-13.dev.gite3034e1.fc28.x86_64 | 09:44 |
| *** derekh has joined #tripleo | 09:44 | |
| quiquell | c: containers-common-0.1.31-7.gitb0b750d.el7.x86_64 | 09:44 |
| ykarel | Tengu, Changelog * Wed Jul 25 2018 dwalsh <dwalsh@redhat.com> - 0.1.31-13.gite3034e1 | 09:45 |
| ykarel | - Update to latest storage.conf file | 09:45 |
| ykarel | for skopeo package | 09:45 |
| Tengu | wonderful. | 09:45 |
| Tengu | quiquell: that said, on my currently deployed undercloud on centos, I have skopeo-containers, not containers-common | 09:45 |
| quiquell | Tengu: that's weird | 09:46 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Make standalone_container_cli overridable https://review.openstack.org/619468 | 09:46 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Move ceph-loop3 to ceph-loop-device role for standalone scenarios https://review.openstack.org/616872 | 09:46 |
| Tengu | so as soon as we get skopeo 0.1.31-13.gite3034e1 and friends in CI for CentOS, we'll get troubles, right? | 09:46 |
| quiquell | Tengu: yep look like... | 09:47 |
| quiquell | Tengu, ykarel: Is confirmed that 31-13 is the one introducing nodev ? | 09:47 |
| Tengu | so, we might replace the spoon by podman in this movie: https://www.youtube.com/watch?v=9VDvgL58h_Y | 09:47 |
| ykarel | quiquell, yes, see commit: https://src.fedoraproject.org/cgit/rpms/skopeo.git/commit/?id=7c8484c8b1a0fab41e5124ebf4b0d870faf2654f | 09:47 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Add new tripleo-ci-centos-7-scenario001-standalone job https://review.openstack.org/619508 | 09:47 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Add tripleo-ci-centos-7-scenario004-standalone job https://review.openstack.org/619520 | 09:48 |
| ykarel | -Release: 12.dev.git%{shortcommit0}%{?dist} | 09:48 |
| ykarel | +Release: 13.dev.git%{shortcommit0}%{?dist} | 09:48 |
| *** sshnaidm is now known as sshnaidm|off | 09:52 | |
| *** holser_ has quit IRC | 09:52 | |
| *** holser_ has joined #tripleo | 09:52 | |
| marios | gfidente: check it please https://review.openstack.org/#/c/616872/50 | 09:54 |
| marios | (and you better like it0 | 09:54 |
| marios | please thanks | 09:54 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Be explicit when passing vars into deploy steps https://review.openstack.org/613300 | 09:54 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Fix paunch logs verbosity control https://review.openstack.org/612948 | 09:54 |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud stable/rocky: Fix instack-undercloud nits https://review.openstack.org/619467 | 09:54 |
| gfidente | marios or what? | 09:55 |
| *** jfrancoa has quit IRC | 09:55 | |
| marios | gfidente: nothing its friday i'll just carry on with my life | 09:56 |
| * Tengu gives a spoon to marios | 09:56 | |
| marios | gfidente: gona update remove unnecessary line removal | 09:56 |
| Tengu | you know what to do | 09:56 |
| gfidente | marios hey I was thinking if it wouldn't be worth try anything like this https://review.openstack.org/#/c/570473/ in the future? | 09:57 |
| marios | gfidente: is fine no update thanks | 09:57 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Better support for the local devbox cases https://review.openstack.org/605379 | 09:57 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Support virthost localhost via local connection https://review.openstack.org/592996 | 09:57 |
| marios | Tengu: jelly? | 09:58 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Support virthost localhost via local connection https://review.openstack.org/576746 | 09:58 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Become root when doing recursive chown https://review.openstack.org/595265 | 09:58 |
| marios | Tengu: or you thinking more like sugar and absinth type situation? | 09:58 |
| marios | gfidente: yeah i think it makes sense | 09:59 |
| marios | this was also quiquell point. we are doing it in ci cos we were always doing it. but it isn't ci specific | 09:59 |
| marios | anyone deploying ceph has this infra requirement | 09:59 |
| Tengu | marios: nah. I was thinking about the movie I just posted earlier in fact XD. | 09:59 |
| quiquell | marios: Feels like this role moving elsewhere in the future like tq or the like | 10:00 |
| Tengu | marios: although absinth is also a nice solution - know that I come from the region that actually created it? :D | 10:00 |
| marios | Tengu: :D | 10:00 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-common master: Improve exp backoff for images pull/push https://review.openstack.org/575742 | 10:00 |
| janki | marios, hey. Can you help me with some reviews please https://review.openstack.org/#/c/618718/ https://review.openstack.org/#/c/618719/ | 10:01 |
| marios | janki: o/ i've overdone my review quota for now i need to do other stuff but added to my queue for next reviews. | 10:02 |
| janki | marios, thanks :). just cherry-picks both of them | 10:02 |
| marios | janki: oh | 10:02 |
| marios | :) you baited me looking | 10:02 |
| gfidente | marios well, people deploying ceph in theory are using actual disks | 10:02 |
| gfidente | marios it's in CI that we only have the root disk | 10:03 |
| openstackgerrit | chenge proposed openstack/diskimage-builder master: fix links https://review.openstack.org/619699 | 10:03 |
| marios | janki: i don't have +2 there :) so +1 from me looks clean but -1 on queens merge rocky first | 10:04 |
| janki | marios, thanks :) | 10:04 |
| quiquell | ykarel, Tengu: So what do we do, we pin f28 to older version or what ? | 10:06 |
| Tengu | quiquell: we can pin it, but we absolutely need to open an issue against skopeo | 10:07 |
| quiquell | Tengu: ack will do, let's see what else we find with podman + f28 | 10:07 |
| quiquell | ykarel: can we pin it for f28 ? I don't know hwere | 10:07 |
| jistr | bogdando: hi, can you look at this one too please? https://review.openstack.org/#/c/619500/ you've reviewed the backport to Pike of this patch, but we should get it into Queens first | 10:07 |
| *** jfrancoa has joined #tripleo | 10:08 | |
| quiquell | Tengu: humm the bug is at rpms/skopeo.git more than at skope ? | 10:09 |
| Tengu | quiquell: well, where's ykarel has pointed dwalsh commit I'd say? | 10:10 |
| quiquell | Tengu: https://src.fedoraproject.org/rpms/skopeo/commits/master | 10:11 |
| quiquell | "Update to latest storage.conf file" | 10:11 |
| Tengu | although I'd probably open against skopeo in order to know why "nodev" and its implications. | 10:11 |
| *** ramishra has quit IRC | 10:12 | |
| Tengu | the source of the issue is in skopeo//containers-common | 10:12 |
| *** moguimar has joined #tripleo | 10:12 | |
| *** ramishra has joined #tripleo | 10:12 | |
| ykarel | quiquell, to which version u want to pin from https://koji.fedoraproject.org/koji/packageinfo?packageID=21883 | 10:13 |
| ykarel | based on that it would be either copr or patch in fedora-stable-config | 10:13 |
| jaosorior | Hey folks! Could I get a review for this https://review.openstack.org/#/c/619236/ ? | 10:14 |
| openstackgerrit | Natal Ngétal proposed openstack-infra/tripleo-ci master: WIP: Don't use mixed_upgrade special release files https://review.openstack.org/604032 | 10:15 |
| bogdando | jistr: done | 10:17 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Render playbooks minimal, move everything to roles https://review.openstack.org/607288 | 10:17 |
| jistr | bogdando: thanks! | 10:17 |
| bogdando | jistr, jaosorior: PTAL https://review.openstack.org/#/c/614290/ :) | 10:17 |
| quiquell | ykarel: this is the version we are using at centos-7 https://koji.fedoraproject.org/koji/buildinfo?buildID=1101558 | 10:17 |
| jaosorior | thanks jistr | 10:18 |
| jaosorior | bogdando: awwww man, even the label path in json changed? | 10:19 |
| quiquell | jaosorior: Added a comment | 10:19 |
| jaosorior | quiquell: added a resopnse | 10:19 |
| jaosorior | * response | 10:20 |
| quiquell | +2 | 10:21 |
| jaosorior | quiquell: thanks | 10:21 |
| jaosorior | marios: if you have time could you check these out https://review.openstack.org/#/q/topic:bug/1804642+(status:open+OR+status:merged) ? small doc changes. | 10:21 |
| ykarel | quiquell, seeems different, i see skopeo-0.1.31-7.gitb0b750d.el7.x86_64.rpm in CentOS | 10:22 |
| *** chkumar|ruck has quit IRC | 10:22 | |
| ykarel | and u shared link of skopeo-0.1.31-7.git6e23a32 | 10:22 |
| ykarel | some commit differs | 10:22 |
| quiquell | So maybe is better to look if we have <pre>b0b750d</pre> | 10:23 |
| quiquell | The one with same commit hash has also the "nodev" :-( | 10:24 |
| Tengu | can we make this one a success ? https://review.openstack.org/#/c/619565/ thank youuuu | 10:24 |
| quiquell | ykarel: we cannot have the same at fedora | 10:25 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Rework the generated openshift-ansible playbook https://review.openstack.org/619713 | 10:26 |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud stable/rocky: Fix instack-undercloud nits https://review.openstack.org/619467 | 10:26 |
| *** psachin has quit IRC | 10:26 | |
| *** moguimar has quit IRC | 10:27 | |
| ykarel | quiquell, u asking or commenting? | 10:28 |
| *** psachin has joined #tripleo | 10:28 | |
| quiquell | ykarel: commenting | 10:28 |
| quiquell | :-( | 10:28 |
| quiquell | -14 is the only one with same commit hash but it has already "nodev" | 10:29 |
| ykarel | quiquell, what if we can build same centos skopeo for fedora, will that work for u? | 10:29 |
| ykarel | as it was done for podman | 10:29 |
| *** moguimar has joined #tripleo | 10:29 | |
| ykarel | as/same as | 10:29 |
| Tengu | thank you jaosorior :) | 10:30 |
| quiquell | ykarel: Totally if we can do it, but looks like never ending thing | 10:30 |
| ykarel | hmm | 10:30 |
| quiquell | I mean what's going to be the reallity at centos-8 ? | 10:30 |
| ykarel | amoralej, ^^ | 10:30 |
| quiquell | centos is going to break too or they packages are not going to include nodev never ? | 10:30 |
| ykarel | amoralej, CI needs a particular version of skopeo | 10:30 |
| ykarel | amoralej, Fedora build have some issues | 10:31 |
| amoralej | of skopeo? | 10:31 |
| ykarel | amoralej, yes | 10:31 |
| amoralej | omg | 10:31 |
| ykarel | yup we need something better for this third party packages :( | 10:31 |
| ykarel | they are breaking daily | 10:32 |
| Tengu | :3 | 10:32 |
| amoralej | ykarel, it's still under very active development | 10:32 |
| amoralej | so, it's kind of expected | 10:32 |
| Tengu | maybe not daily, but at least we must have a way to validate new versions before they hit the CI | 10:32 |
| amoralej | but | 10:33 |
| amoralej | it's very fragile | 10:33 |
| amoralej | but ykarel we must be very careful rebuilding in copr | 10:33 |
| amoralej | mixing fedora builds and copr is delicate and may break again | 10:33 |
| amoralej | what build of skopeo do we need? | 10:33 |
| ykarel | amoralej, same as CBS one https://cbs.centos.org/repos/virt7-container-common-candidate/x86_64/os/Packages/skopeo-0.1.31-7.gitb0b750d.el7.x86_64.rpm | 10:34 |
| *** chandan_kumar has joined #tripleo | 10:35 | |
| ykarel | http://cbs.centos.org/koji/buildinfo?buildID=24653 | 10:35 |
| bogdando | jaosorior: yes, and there is a libpod issue reported. They want it totally CLI compatible afaik | 10:35 |
| bogdando | but until then... | 10:35 |
| *** chandan_kumar is now known as chkumar|ruck | 10:35 | |
| bogdando | meanwhile the patch just misses a 2nd +2 | 10:35 |
| bogdando | since a month :/ | 10:35 |
| amoralej | ykarel, we can't rebuild skopeo from cbs as-is and mix with buildah or atomic from fedora | 10:36 |
| amoralej | that was the problem last time | 10:36 |
| quiquell | Another option is to just docker for now | 10:36 |
| quiquell | just 'use' | 10:36 |
| quiquell | But don't know if we want to do tha | 10:37 |
| amoralej | no quiquell i don't think that's an option | 10:37 |
| ykarel | amoralej, ack | 10:37 |
| amoralej | as the full porpose of this is to validate using podman | 10:37 |
| amoralej | that's my understanding | 10:37 |
| quiquell | amoralej: We have to do it for scenarios, some services does not support podman yet | 10:37 |
| amoralej | EmilienM, ^ correct me if i'm wrong | 10:37 |
| quiquell | amoralej: Isn't it validating python3 stuff ? | 10:37 |
| amoralej | not only python3 | 10:37 |
| quiquell | amoralej: Ahh wait and revuild docker images... you are right | 10:38 |
| ykarel | amoralej, what if buildah and atomic are also build with skopeo | 10:38 |
| openstackgerrit | Jose Luis Franco proposed openstack/python-tripleoclient stable/rocky: Add 2h timeout when waiting for websocket messages on package_update https://review.openstack.org/619717 | 10:38 |
| amoralej | but all changes | 10:38 |
| amoralej | ykarel, i'd prefer the other way around | 10:38 |
| amoralej | as we may hit other issues | 10:38 |
| amoralej | we also have docker in fedora | 10:38 |
| amoralej | then, we'd have to rebuild docker to from cbs | 10:38 |
| amoralej | but then we may have issues with other OS pieces | 10:39 |
| amoralej | who knows... | 10:39 |
| ykarel | mmm that's a long chain :( | 10:39 |
| amoralej | isn't there a build in fedora which includes the patches we need in skopeo? | 10:39 |
| chkumar|ruck | hjensas, Please have a look at this upgrade failure http://logs.openstack.org/45/560445/201/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/e74e20f/logs/undercloud/home/zuul/overcloud_update_run_Controller.log.txt.gz#_2018-11-23_01_58_58 | 10:40 |
| quiquell | amoralej: the exact same version of skope package, has the bad option at fedora spec version | 10:40 |
| quiquell | amoralej: I am explaining it wrong, the skope commit from centos-7 is at broken package at fedora-28 | 10:41 |
| amoralej | what's the "broken package at fedora-28"? | 10:42 |
| quiquell | amoralej: the one that includes "nodev" at mount options at container.conf | 10:42 |
| quiquell | amoralej: https://src.fedoraproject.org/rpms/skopeo/c/7c8484c8b1a0fab41e5124ebf4b0d870faf2654f?branch=master | 10:42 |
| ykarel | amoralej, -13 build | 10:42 |
| amoralej | but -13 is the one that we have | 10:43 |
| amoralej | right? | 10:44 |
| amoralej | that's broken or that's good? | 10:44 |
| quiquell | amoralej: broken | 10:47 |
| amoralej | and, what's the good one | 10:47 |
| quiquell | -Â13 | 10:47 |
| quiquell | damn | 10:47 |
| amoralej | we have a bunch of newer builds in fedora | 10:47 |
| quiquell | -13 | 10:47 |
| quiquell | joder | 10:47 |
| amoralej | but we have -13 | 10:47 |
| quiquell | -12 | 10:47 |
| amoralej | so -12 is good and -13 is bad? | 10:48 |
| amoralej | we need to move back? | 10:48 |
| quiquell | amoralej: but... -12 use different code base from centos-7 | 10:48 |
| quiquell | I mean skeop code base not skope rpm codebase | 10:48 |
| quiquell | git hash | 10:48 |
| amoralej | yes, but reusing centos-7 in fedora has other issues | 10:49 |
| amoralej | we must try to stick to fedora builds | 10:49 |
| *** sambetts_ has quit IRC | 10:49 | |
| quiquell | amoralej: no, I mean we need a fedora package with same skeop git hash, but with same RPM stuf like -12 | 10:52 |
| quiquell | amoralej: And this does not exists, that's why ykarel is talking about rebuilding it | 10:52 |
| quiquell | amoralej: We can go and try -12 but it has different skope code so we don't know what will happend | 10:52 |
| amoralej | so, you want something like skopeo-0.1.31-7.gitb0b750d.el7 ? | 10:52 |
| quiquell | amoralej: we have not test that at centos-7 | 10:52 |
| amoralej | but in fedora? | 10:52 |
| quiquell | amoralej: -12 I would say | 10:53 |
| amoralej | that's known good? | 10:53 |
| quiquell | amoralej: standalone is working there, but who knows what will happend at f28 | 10:53 |
| quiquell | amoralej: know good at centos-7 | 10:53 |
| amoralej | https://koji.fedoraproject.org/koji/buildinfo?buildID=1131891 is using the same git hash | 10:54 |
| quiquell | amoralej: yep but it has the wrong RPM package stuff, that's what I mean | 10:55 |
| amoralej | because of storage.conf, right? | 10:56 |
| amoralej | we could try to rebuild -14 without that patch | 10:58 |
| quiquell | yep | 10:59 |
| quiquell | That would be sweet, don't know if we can find something else :-( | 10:59 |
| quiquell | amoralej: maybe we can compare what the package has at centos-7 and at fedora-28 | 10:59 |
| amoralej | but if that patch is breaking it | 10:59 |
| amoralej | maybe it should be reported | 10:59 |
| quiquell | I was going to | 11:03 |
| quiquell | but in the same time we need to have a proper package too | 11:03 |
| Tengu | what are the issues with the centos build on fedora? | 11:03 |
| amoralej | quiquell, do you have logs of the issue related to that patch? | 11:03 |
| quiquell | amoralej: https://bugs.launchpad.net/tripleo/+bug/1804649 | 11:03 |
| openstack | Launchpad bug 1804649 in tripleo "f28 standalon fails at timeout" [High,Triaged] - Assigned to Quique Llorente (quiquell) | 11:03 |
| Tengu | amoralej: https://bugs.launchpad.net/tripleo/+bug/1804649 | 11:03 |
| Tengu | :D | 11:03 |
| quiquell | last comments | 11:03 |
| amoralej | i mean, when we move to centos8 we will not have the option to select the builds | 11:04 |
| quiquell | Tengu: now we are connected too !! | 11:04 |
| Tengu | yay :D | 11:04 |
| amoralej | so we need to get good ones built in fedora/centos etc... | 11:04 |
| amoralej | rebuilding is just a very last resort | 11:04 |
| quiquell | amoralej: The think is, event at centos-7 if we put the nodev option it will break too | 11:04 |
| quiquell | s/think/thing/ | 11:04 |
| Tengu | we have to be able to mirror + promote the packages on our own. | 11:05 |
| quiquell | Humm wait, let me check in the latest kernel source | 11:05 |
| amoralej | mmmm | 11:05 |
| amoralej | "kernel: overlayfs: unrecognized mount option "nodev" or missing value" | 11:05 |
| Tengu | else CI will crash again. and again. and again. and-a-gain | 11:05 |
| amoralej | Tengu, no for packges provided by CentOS OS | 11:05 |
| amoralej | for that we can't promote nor mirror | 11:05 |
| amoralej | just use | 11:05 |
| Tengu | more talking about 3rd party packages. | 11:06 |
| Tengu | like podman | 11:06 |
| amoralej | but in fedora podman is not exactly a 3rd party | 11:06 |
| amoralej | is part of OS | 11:06 |
| *** udesale has quit IRC | 11:07 | |
| Tengu | hmmm centos as well. | 11:07 |
| amoralej | and similar for rhel8 | 11:07 |
| Tengu | not the right version though. that's why we're using CBS | 11:07 |
| amoralej | beta includes skopeo, podman and buildah | 11:07 |
| Tengu | centos 7 has 0.9.2-5.git37a2afe.el7_5 | 11:07 |
| amoralej | so, rebuilding it for fedora right now is short-term fix | 11:08 |
| amoralej | may work | 11:08 |
| quiquell | At least it will discover new shit | 11:08 |
| Tengu | amoralej: and what are the issues with the centos pacakge (from CBS) on f-28? | 11:08 |
| amoralej | but we need to ensure that the one provided is good | 11:08 |
| quiquell | Perdon my french | 11:08 |
| *** holser_ is now known as holser|lunch | 11:08 | |
| amoralej | Tengu, we already tried to rebuild skopeo from centos and we broke it | 11:08 |
| Tengu | err.. ok? why rebuild? | 11:09 |
| amoralej | have different subpackages | 11:09 |
| amoralej | it has epoch... | 11:09 |
| quiquell | At the end we are trying to emulate centos with fedora :-/ | 11:09 |
| amoralej | last week breakage was because of that | 11:09 |
| Tengu | well, yeah, on centos. using a mirror with our own promotion will allow to avoid breaking the whole CI. | 11:10 |
| Tengu | instead of just feeding CBS or whatever | 11:10 |
| Tengu | and if we could get the same version on f28 + centos/rhel, it would be a real help. | 11:10 |
| *** cylopez has quit IRC | 11:11 | |
| Tengu | avoiding chasing ghosts and losing time due to differences we should not have :/ | 11:11 |
| Tengu | it's hard enough to get podman integrated without having different versions in the CI :( | 11:11 |
| amoralej | Tengu, the problem is that rebuilding skopeo, i.e. will make force us to rebuild atomic, maybe buildah, docker.... | 11:12 |
| amoralej | who knows | 11:12 |
| amoralej | a distro is a set of very interrelated packages | 11:12 |
| amoralej | changing something in the middle can have unexpected results, as already happened | 11:12 |
| amoralej | last week | 11:12 |
| amoralej | so yeah | 11:13 |
| Tengu | I still don't understand why CBS can't be used for f-28... ? | 11:13 |
| amoralej | you mean packages, as-is? | 11:13 |
| Tengu | yeah | 11:13 |
| *** jchhatbar has joined #tripleo | 11:13 | |
| amoralej | because it's compiled, rebuilt in a different buildroot | 11:13 |
| amoralej | with different libraries, versions of languages, kernels... | 11:13 |
| amoralej | some cases may work | 11:13 |
| Tengu | so that we at least get common base, common version, and if one error hit on centos/fedora, we actually KNOW what it is, and it's just more easy to find out what's going on | 11:13 |
| amoralej | but | 11:13 |
| amoralej | those packages are not an isolated thing, depends on the full distro ecosystem | 11:14 |
| Tengu | the nodev thingy? we spent about 1h to find out it was a version difference for a couple of packages and the like | 11:14 |
| *** janki has quit IRC | 11:15 | |
| amoralej | so, if we want to use same packages, we need to rebuild in f28 buildroot | 11:16 |
| amoralej | last week we did and we broke it | 11:16 |
| amoralej | so we must be very careful | 11:16 |
| amoralej | in fact, reusing the same exact rpm will break it exactly the same | 11:16 |
| Tengu | well, last week, there was an issue with the rpm spec anyway. | 11:16 |
| Tengu | they pushed wrong things and there were file collisions with some docker package. yay. | 11:17 |
| *** akrivoka has quit IRC | 11:17 | |
| Tengu | this week, apparently they pushed a wrong spec for container-selinux and this broke as well due to broken dependencies. | 11:17 |
| *** akrivoka has joined #tripleo | 11:18 | |
| amoralej | yeah, they pushed version for 7.6 | 11:18 |
| amoralej | before having 7.6 available | 11:18 |
| Tengu | one of the many reasons examples we *must* get some mirror and do our own promotion, based on CI run. | 11:18 |
| Tengu | if possible in an automated way. | 11:18 |
| Tengu | I know there are things being discussed right now in RDO for the pipelinin. | 11:18 |
| Tengu | +g | 11:18 |
| amoralej | the right thingk would be they to test before pushing | 11:19 |
| amoralej | not us mirroring | 11:19 |
| amoralej | and forking | 11:19 |
| Tengu | so this kind of things should be taken into account, in order to avoid losing a whole day | 11:19 |
| Tengu | well, apparently they also broke their CI with the last one | 11:19 |
| quiquell | who are they ? | 11:19 |
| Tengu | the previous one wasn't seen as they don't have "docker" installed in // | 11:19 |
| amoralej | right now we are kind of forking fedora | 11:19 |
| Tengu | containers guys | 11:19 |
| amoralej | as a very temporal solution | 11:19 |
| *** raildo has joined #tripleo | 11:20 | |
| amoralej | we are mixing two things | 11:20 |
| amoralej | 1. fedora | 11:20 |
| *** ahosam has joined #tripleo | 11:20 | |
| * Tengu dreams of a pulp instance with mirrored 3rd party repositories with promotion being managed via CI validations..... | 11:20 | |
| amoralej | Tengu, do you want to mirror OS, all deps and manage promotions? | 11:21 |
| amoralej | ceph | 11:21 |
| amoralej | kvm | 11:21 |
| amoralej | everything? | 11:21 |
| Tengu | amoralej: they are in the OS. | 11:21 |
| amoralej | well, anyway, let's go to the point | 11:21 |
| amoralej | about the fedora build | 11:22 |
| amoralej | we need to find out what do we need to rebuild | 11:22 |
| amoralej | in fedora to break as less as possible | 11:22 |
| Tengu | amoralej: well, as said, if podman version could be the same as CBS (meaning,currently, 1-2 version older), that would prevent issues like the one we're hitting today, where a deploy is OK on centos, NOK on fedora, because versions | 11:23 |
| amoralej | iiuc you'd need git hash gitb0b750d | 11:23 |
| Tengu | that's all I ask for fedora : keep version consistent with CBS | 11:23 |
| amoralej | tengu, that's work for fedora/cbs maintainers | 11:24 |
| amoralej | but anyway, i'll do my best to get it on sync as much as possible | 11:25 |
| Tengu | appreciate :) | 11:25 |
| *** psachin has quit IRC | 11:26 | |
| Tengu | and, regarding podman version in centos, since we have to use CBS in order to get a recent version with a lot of bug corrections we're asking (yeah, we're very demanding ;)), and since apparently there are issues with the provided RPM, it would be good to get a way to filter them. that's why I'm talking about pulp, promotion and the like. that way we avoid CI explosion. | 11:27 |
| amoralej | Tengu, there is already a way to manage rpms | 11:28 |
| amoralej | in RDO | 11:28 |
| amoralej | and say what to do and what not | 11:28 |
| amoralej | what to use and what not | 11:28 |
| amoralej | but | 11:28 |
| Tengu | heard so, but also heard "not applicable" or something like that | 11:28 |
| amoralej | we'd need to manage all packages in the repo | 11:28 |
| amoralej | and we try to avoid as much as possible | 11:29 |
| amoralej | as said before | 11:29 |
| Tengu | so no easy way to mirror https://buildlogs.centos.org/centos/7/virt/x86_64/container/ for instance? | 11:29 |
| Tengu | or whatever thing related to containers only ? | 11:29 |
| amoralej | the right way is to test things before promoting in the good repo | 11:29 |
| Tengu | well. we don't have any way to do that | 11:29 |
| *** jchhatba_ has joined #tripleo | 11:29 | |
| Tengu | because this repo is managed by container team | 11:29 |
| amoralej | there may be ways to do it | 11:29 |
| Tengu | and they don't run podman like we do, with many stress and the like. | 11:30 |
| Tengu | so they never hit the issues we get, and as they don't have the same packages, they can't see the conflicts we got. | 11:30 |
| amoralej | they could run openstack job before pushing | 11:30 |
| amoralej | but anyway, out of scope for current discussion | 11:30 |
| Tengu | not sure they have the resources for such a big run. | 11:30 |
| amoralej | let me try to create a good build | 11:30 |
| amoralej | Tengu, then we'll have the same issue the other way around | 11:31 |
| Tengu | but I think RDO and Containers must talk a bit :). | 11:31 |
| amoralej | if we try to validate new builds before publishing | 11:31 |
| Tengu | well, our CI runs standalone deploys all the day long at least | 11:31 |
| Tengu | speaking of CI... | 11:32 |
| *** jchhatbar has quit IRC | 11:32 | |
| Tengu | PTAL guys? https://review.openstack.org/#/c/618975/ thank you :). That will correct some CI outputs when deploying with podman. | 11:32 |
| *** pdeore has quit IRC | 11:35 | |
| chkumar|ruck | marios, panda|rover , https://review.openstack.org/#/c/618994/ needs +w | 11:36 |
| hjensas | ChanServ: https://review.openstack.org/619583 | 11:37 |
| hjensas | chkumar|ruck: ^^ | 11:38 |
| hjensas | chkumar|ruck: the update task fails because the Mistral returns "RUNNING" not "SUCCESS". | 11:38 |
| chkumar|ruck | hjensas, thanks :-) | 11:38 |
| hjensas | chkumar|ruck: therve proposed a patch to fix that. | 11:39 |
| hjensas | chkumar|ruck: I may be wrong, therve's patch is about stack deletes. We may need something similar. | 11:40 |
| chkumar|ruck | hjensas, I have seen this issue, twice i think in ci | 11:41 |
| chkumar|ruck | hjensas, let me open a bug for better clearity | 11:41 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Add new tripleo-ci-centos-7-scenario001-standalone job https://review.openstack.org/619508 | 11:42 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Add tripleo-ci-centos-7-scenario004-standalone job https://review.openstack.org/619520 | 11:43 |
| hjensas | chkumar|ruck: yeah, status is clearly running see: http://paste.openstack.org/show/735970/ (That's the json data from logs converted to yaml, with the "message": string shortened | 11:48 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Invoke redhat-subscription role during upgrade. https://review.openstack.org/610493 | 11:48 |
| quiquell | Tengu: do you know stuff about standalone ? | 11:49 |
| quiquell | Tengu: looks like lint is failing checking "pacemaker_resource" | 11:49 |
| quiquell | Tengu: what do we need to run it as ansible module ? | 11:49 |
| hjensas | chkumar|ruck: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/workflows/package_update.py#L100-L103 <- the code fail's on anything not "SUCCESS", not sure but with "RUNNING" we may want to continue until some other status is returned. | 11:49 |
| chkumar|ruck | hjensas, so basically you mean to say above therve patch fixed the above failed issue till it returns success | 11:50 |
| Tengu | quiquell: hmm I for pacemaker and podman, there's a long-standing patch awaiting to get merged, for some label searching | 11:50 |
| Tengu | quiquell: still, not sure pacemaker is in use on standalone... ? | 11:50 |
| quiquell | Tengu: we are using docker ther for standalone + scenario002 but now we have linting issues | 11:50 |
| hjensas | chkumar|ruck: no, on closer look therve's patch is only related to scale operations. Deleting nodes. | 11:51 |
| quiquell | Tengu: we are starting to activate it is an WIP | 11:51 |
| Tengu | quiquell: any log? | 11:51 |
| quiquell | Tengu: http://logs.openstack.org/09/618709/14/check/tripleo-ci-centos-7-scenario002-standalone/bfc4b09/logs/undercloud/home/zuul/standalone_ansible_lint.log.txt.gz | 11:51 |
| quiquell | Tengu: I think it's complaining abou pacemaker_resource ansible module not present | 11:51 |
| quiquell | Maybe we are missing installing something | 11:51 |
| chkumar|ruck | hjensas, ok ok got it | 11:51 |
| Tengu | quiquell: might be yeah. you might want to ping bandini maybe? | 11:52 |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud stable/rocky: Fix instack-undercloud nits https://review.openstack.org/619467 | 11:53 |
| Tengu | quiquell: hmmm. I think it's a typo in the playbook: http://logs.openstack.org/09/618709/14/check/tripleo-ci-centos-7-scenario002-standalone/bfc4b09/logs/undercloud/home/zuul/undercloud-ansible-cNYyok/Standalone/upgrade_tasks.yaml.txt.gz | 11:53 |
| quiquell | Tengu: were are the RPMs that contains stuff like this https://github.com/redhat-openstack/ansible-pacemaker/blob/master/modules/pacemaker_resource.py ? | 11:53 |
| Tengu | check line 17 | 11:53 |
| Tengu | quiquell: - ignore_errors: true | 11:53 |
| ccamacho | amoralej quiquell about the lower-requirements issue in instack-undercloud | 11:53 |
| quiquell | ahhh | 11:53 |
| ccamacho | amoralej so do you think is an issue in the job definition? | 11:53 |
| Tengu | the "-" is at the wrong line | 11:53 |
| Tengu | should be the line after, for the "name: Check rabbitmq-bundle ..." | 11:53 |
| Tengu | :) | 11:53 |
| * Tengu drinks some more tea | 11:54 | |
| quiquell | Tengu: no, that's ok | 11:54 |
| quiquell | Tengu: you can put ignore_errors there | 11:54 |
| Tengu | o__O | 11:55 |
| Tengu | but that's... horrible ?! | 11:55 |
| quiquell | Well, but should work | 11:55 |
| Tengu | still, it complains around that line. | 11:55 |
| amoralej | ccamacho, what i see is that the job is not using the version of openstacksdk in l-c | 11:55 |
| amoralej | but latest | 11:55 |
| quiquell | It's complaining about not understanding more than not permitted | 11:55 |
| ccamacho | quiquell where I can see what that job is doing? | 11:56 |
| quiquell | Tengu: do you know how we install stuff like https://github.com/redhat-openstack/ansible-pacemaker/blob/master/modules/pacemaker_resource.py ? | 11:56 |
| Tengu | hmm right. | 11:56 |
| Tengu | so "no action detected in task. This often indicates a misspelled module name, or incorrect module path" | 11:56 |
| quiquell | ccamacho: pass me the review | 11:56 |
| Tengu | quiquell: nope. that's probably for the PIDONE guys. | 11:56 |
| Tengu | quiquell: ansible-pacemaker.noarch : Ansible modules for managing Pacemaker clusters | 11:56 |
| ccamacho | quiquell here it is passing the pep8 nit, https://review.openstack.org/#/c/619467/ now still failing the l-c job | 11:57 |
| quiquell | Tengu: ack, let's check our today's frien rpm-list.txt :-) | 11:57 |
| Tengu | quiquell: so it's in delorean-master, and we probably don't install it by default for some reason | 11:57 |
| Tengu | oh. I do have that one on my undercloud. | 11:57 |
| quiquell | Damn it's there | 11:58 |
| quiquell | ansible-pacemaker-1.0.4-0.20180216140440.0e4d7c0.el7.centos.noarch | 11:58 |
| Tengu | no code update since a year.... wow. | 11:58 |
| quiquell | ccamacho: You mean live of pass executions ? | 11:59 |
| quiquell | ccamacho: right now is queued | 11:59 |
| quiquell | Tengu: maybe we have to update that RPM ' | 11:59 |
| quiquell | At least this is not fedora XD | 11:59 |
| Tengu | so I'd say the module is installed in the right path. | 12:00 |
| quiquell | Tengu: maybe that version of the RPM does not include that module | 12:00 |
| quiquell | Tengu: is not the only one there | 12:00 |
| Tengu | quiquell: ansible-pacemaker-1.0.4-0.20180216140440.0e4d7c0.el7.centos.noarch | 12:01 |
| Tengu | /usr/share/ansible-modules/pacemaker_resource.pyc | 12:01 |
| quiquell | Humm I think we can see the places it looks for at the beggining | 12:02 |
| chkumar|ruck | hjensas, https://bugs.launchpad.net/tripleo/+bug/1804812 added a bug with the notes from the discussion | 12:02 |
| openstack | Launchpad bug 1804812 in tripleo "[master][noop] multinode container update job failed with RuntimeError: Update failed with: {u'status': u'RUNNING', while overcloud minor update" [Critical,Triaged] | 12:02 |
| chkumar|ruck | let me fire the reproduce if I can fix it | 12:03 |
| *** ahosam has quit IRC | 12:03 | |
| quiquell | Tengu: stupid question, so we are executing the playbooks and the do the linting ? | 12:03 |
| Tengu | quiquell: hmmm I don't remember who added the lint test. chem` maybe? | 12:04 |
| *** ramishra has quit IRC | 12:04 | |
| quiquell | Tengu, amoralej: I am testing the f28 issue with kernel 4.19.2-200.fc28.x86_64 | 12:11 |
| quiquell | And it accepts the nodev stuff | 12:11 |
| quiquell | :-/ | 12:11 |
| Tengu | ok, so CI f-28 image needs an update? | 12:12 |
| quiquell | Damn... | 12:12 |
| quiquell | It has the kernel: overlayfs: unrecognized mount option "nodev" or missing value | 12:12 |
| quiquell | But deploy is progressing | 12:12 |
| Tengu | yay... | 12:12 |
| amoralej | quiquell, i'm trying to rebuild skopeo without the storage thing | 12:12 |
| quiquell | amoralej: give a min | 12:13 |
| amoralej | ok | 12:13 |
| EmilienM | quiquell: all services support podman, except pacemaker, wip | 12:14 |
| *** EmilienM is now known as EvilienM | 12:14 | |
| Tengu | quiquell: isn't the error more network related though? just reading the logs a bit more carefuly. | 12:15 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Add new tripleo-ci-centos-7-scenario003-standalone job https://review.openstack.org/618761 | 12:15 |
| quiquell | Tengu: but now it fails elsewhere at my machine with newer kernel | 12:15 |
| Tengu | ok.. | 12:15 |
| Tengu | weird. | 12:15 |
| quiquell | Tengu: "b'standard_init_linux.go:203: exec user process caused \"no such file or directory\"\\ | 12:17 |
| quiquell | Tengu: Going to retry removing the nodev stuff from conf | 12:17 |
| quiquell | I can do it manually in the system | 12:17 |
| Tengu | oh. that's a random error I think. | 12:17 |
| Tengu | EvilienM: -^^ | 12:17 |
| quiquell | Tengu: do you want to poke at live system ? | 12:17 |
| Tengu | quiquell: would love to | 12:17 |
| quiquell | Tengu: give me your pub key | 12:17 |
| Tengu | ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk | 12:18 |
| Tengu | quiquell: there's also tmate :). | 12:18 |
| quiquell | Tengu: ok tmate | 12:18 |
| quiquell | Tengu: priv | 12:19 |
| Tengu | I'm in. | 12:19 |
| *** jpena is now known as jpena|lunch | 12:20 | |
| *** shardy has joined #tripleo | 12:20 | |
| Tengu | quiquell: 2s, think it's a transcient error. | 12:21 |
| Tengu | quiquell: https://github.com/containers/libpod/issues/1844 | 12:21 |
| Tengu | so nothing to "worry" about..... just re-run the deploy. | 12:22 |
| Tengu | but if you hit it again, that would be pretty interesting. | 12:22 |
| quiquell | Tengu: but the heat timeout could be the image version ? | 12:23 |
| quiquell | Tengu: I mean the upstream fedora28 zuul version ? | 12:23 |
| quiquell | Tengu: this one is the latest i have take from https://nb02.openstack.org/images/ | 12:23 |
| Tengu | maybe? not sure though. I might give a try on my lab with that. | 12:23 |
| quiquell | Tengu: main difference I see is kernel version | 12:24 |
| Tengu | ah, my cat is also watching the screen. He will find out the issue | 12:24 |
| quiquell | hehe will call mine too | 12:24 |
| quiquell | need to put some cookie to trick her | 12:24 |
| Tengu | she jumps on the desk whenever I'm working. Even has her own cosy place | 12:25 |
| quiquell | EvilienM: we are having linting issues with standalone and scenario002 | 12:26 |
| quiquell | EvilienM: http://logs.openstack.org/09/618709/14/check/tripleo-ci-centos-7-scenario002-standalone/bfc4b09/logs/undercloud/home/zuul/standalone_ansible_lint.log.txt.gz | 12:26 |
| *** pcaruana has quit IRC | 12:26 | |
| quiquell | Looks like it's not understanding pacemaker_resource do you have any clue on that ? | 12:26 |
| quiquell | ccamacho: this ? http://logs.openstack.org/67/619467/9/check/openstack-tox-lower-constraints/d54ef11/job-output.txt.gz | 12:27 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Revert "Verify nova api migration finished before start placement" https://review.openstack.org/619607 | 12:28 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: ceph: allow curl tasks to run in dry run mode https://review.openstack.org/618898 | 12:28 |
| openstackgerrit | Merged openstack/tripleo-common master: Generating fencing for capitalized MACs https://review.openstack.org/613990 | 12:28 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Run online data migrations during undercloud/standalone upgrades https://review.openstack.org/619044 | 12:28 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Python 3 compatibility: fix has_key https://review.openstack.org/610370 | 12:28 |
| ccamacho | quiquell | 12:29 |
| ccamacho | yeahp | 12:29 |
| ccamacho | it looks like is not using correctly the l-r file | 12:30 |
| ccamacho | amoralej ^ | 12:30 |
| amoralej | yeah, it what looks like | 12:31 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-common stable/rocky: Generating fencing for capitalized MACs https://review.openstack.org/619725 | 12:36 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Rework the generated openshift-ansible playbook https://review.openstack.org/619713 | 12:39 |
| EvilienM | Tengu, amoralej : hey - reading all scrollback :) | 12:42 |
| Tengu | :) | 12:42 |
| quiquell | EvilienM: could be a red herring | 12:43 |
| *** moguimar has quit IRC | 12:44 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Install correct python version packages at tempest https://review.openstack.org/618721 | 12:44 |
| chkumar|ruck | EvilienM, small review https://review.openstack.org/#/c/619568/ | 12:47 |
| quiquell | Tengu: faied again | 12:50 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Added support for installing tempest plugins from git https://review.openstack.org/612377 | 12:50 |
| *** moguimar has joined #tripleo | 12:50 | |
| Tengu | quiquell: hmm. | 12:50 |
| Tengu | damn. | 12:51 |
| Tengu | quiquell: don't tell me you have a reproducer for that bloody random issue X( | 12:51 |
| *** jfrancoa has quit IRC | 12:52 | |
| quiquell | Tengu: Using my own zuul using zuul quickstart attacking RDO | 12:52 |
| Tengu | EvilienM: guess we can reproduce the "exec user process caused \"no such file or directory\"" thingy on f-28 | 12:52 |
| Tengu | quiquell: would be interesting to fetch a vanilly f-28 image and push it in vagrant or whatever to deploy the standalone and check what's going on. | 12:53 |
| Tengu | quiquell: I have the resources for that here - just never deployed on fedora. guess repositories are different? | 12:53 |
| EvilienM | bogdando: the patch in paunch is going to break us once they fix libpod with right CLI, right? | 12:53 |
| bogdando | EvilienM: yes | 12:53 |
| quiquell | Tengu: ok, but still why do we have the heat timeout at upstream zuul ? | 12:54 |
| quiquell | Tengu: we don't see it here | 12:54 |
| quiquell | Tengu: maybe I don't do some networking ? | 12:54 |
| *** pbandark has joined #tripleo | 12:54 | |
| Tengu | quiquell: transcient issue? | 12:54 |
| EvilienM | quiquell: sorry, read the backlog here. No, we can't use docker, we try to move our CI forward to use podman, we can't revert easily. We rather need to find solutions even if it's painful. | 12:54 |
| quiquell | Tengu: nope... is consistent | 12:54 |
| Tengu | damn. | 12:54 |
| EvilienM | amoralej: yes you're right, podman is the next default, we need to switch more of our CI jobs to it | 12:54 |
| quiquell | Tengu: main diffence is the kernel | 12:55 |
| Tengu | quiquell: well, seeing how container work with the kernel, a not up-to-date kernel might create some funky things | 12:56 |
| quiquell | Tengu: let me ask guys t infra | 12:56 |
| quiquell | Tengu: also maybe the "nodev" stuff is producing the issue at my environent | 12:56 |
| quiquell | Tengu: let's change config and re-run | 12:56 |
| Tengu | quiquell: we can change that directly in the /etc/containers/storage.conf | 12:56 |
| Tengu | quiquell: it's empty on centos. | 12:57 |
| Tengu | yeah | 12:57 |
| quiquell | Tengu: do we have to restart something ? | 12:57 |
| Tengu | should be ok then. | 12:57 |
| EvilienM | quiquell: "b'standard_init_linux.go:203: exec user process caused \"no such file or directory\ is fixed by my revert that just landed : https://review.openstack.org/#/c/619607/ | 12:57 |
| Tengu | nope, no daemon | 12:57 |
| Tengu | still. | 12:57 |
| Tengu | wait | 12:57 |
| quiquell | Argg | 12:57 |
| Tengu | quiquell: some cleanup ;) | 12:57 |
| EvilienM | bogdando: yes? so what's your plan? Can't we make the code supporting that? | 12:57 |
| quiquell | Can we dirty apply that ? | 12:58 |
| bogdando | EvilienM: I have no plan, sorry. Let's wait for the fix IMO | 12:58 |
| EvilienM | bogdando: you could add an exception in the code... | 12:58 |
| bogdando | or fix FIXMEs once it breaks the w/a | 12:58 |
| Tengu | quiquell: it will take some time due to the way podman locks its state. | 12:58 |
| quiquell | Tengu: ok, let's do this right will re run, so it takes the merged sh../stuff and ask infra about kernel version | 12:58 |
| Tengu | quiquell: but starting over a clean env, it's better. | 12:59 |
| bogdando | right, but I think that too way complicates it, EvilienM | 12:59 |
| quiquell | Tengu: ack ? | 12:59 |
| Tengu | quiquell: yup | 12:59 |
| quiquell | amoralej: ^ we need more time | 12:59 |
| Tengu | quiquell: good for me, if you want to retry the deploy. | 12:59 |
| EvilienM | bogdando: more complicated than dealing with a tripleo gate breaking because a new version of podman? I'm not sure | 12:59 |
| Tengu | quiquell: we can keep the images, they aren't an issue. | 12:59 |
| Tengu | quiquell: you disconnected from the host. | 13:00 |
| bogdando | EvilienM: does it breaks the gate atm? | 13:00 |
| Tengu | ah, ok | 13:00 |
| bogdando | because of the label thing is missing? | 13:00 |
| EvilienM | no | 13:00 |
| EvilienM | I'm just making sure it won't | 13:00 |
| bogdando | neither it would with the thing altered, right? | 13:00 |
| EvilienM | we'll see | 13:00 |
| EvilienM | i'll call you when it does | 13:00 |
| bogdando | :) | 13:00 |
| bogdando | pushing a revert won't be a simple thing IMO | 13:01 |
| quiquell | Tengu: yep, host get destroyed | 13:01 |
| bogdando | will be | 13:01 |
| bogdando | hit it once we have a package and that's prolly it | 13:01 |
| amoralej | quiquell, Tengu, so what will you test? i got lost? | 13:02 |
| bogdando | or keep the patch w/o merging for those who need it currently, and wait the proper fix | 13:02 |
| bogdando | Tengu: ^^ WDYT? | 13:02 |
| quiquell | amoralej: At my system we found an issue but the fix is merged so we are run it again | 13:02 |
| quiquell | amoralej: Meanwhile I want to ask at infra why we are not using the latest fedora they have | 13:02 |
| quiquell | amoralej: And the nodev stuff looks like not related to heat timeout | 13:03 |
| amoralej | quiquell, note we use a "stabilized fedora" with some fixes | 13:04 |
| amoralej | ups | 13:04 |
| amoralej | so root cause may not be the nodev thing? | 13:04 |
| amoralej | ok | 13:04 |
| amoralej | quiquell, there is no a way to manually reproduce it? | 13:04 |
| quiquell | amoralej: was trying to | 13:04 |
| *** jfrancoa has joined #tripleo | 13:06 | |
| Tengu | bogdando: no real idea. although I must confess, having the patch merged will make life easier for testing.... not really sure what's best :/ | 13:08 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: upgrade: remove Docker containers now managed by Podman https://review.openstack.org/615209 | 13:09 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: upgrade: remove Docker containers now managed by Podman https://review.openstack.org/615209 | 13:09 |
| openstackgerrit | Merged openstack/tripleo-validations master: Use the right path for ironic_inspector config file https://review.openstack.org/619603 | 13:14 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations stable/rocky: Use the right path for ironic_inspector config file https://review.openstack.org/619731 | 13:15 |
| *** jpena|lunch is now known as jpena | 13:15 | |
| *** skramaja has quit IRC | 13:18 | |
| *** ratailor has quit IRC | 13:20 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-docs master: Reorganise upgrade/update/ffwd upgrade docs into their own section https://review.openstack.org/619733 | 13:21 |
| marios | jaosorior: my pledge for this week :) ^ | 13:21 |
| jaosorior | marios: nice! I'll check it out! | 13:22 |
| marios | jaosorior: spent over an hour fighting tox fwiw but no content change, just reorganise. i'll point to it and add comment once tox builds | 13:22 |
| jaosorior | marios: yesterday I did a couple of patches just to fix up some outdated content. | 13:22 |
| marios | jaosorior: i saw cool we're good till next week then ;) | 13:22 |
| jaosorior | wow, but your patch seems way more significant! nice! | 13:22 |
| marios | jaosorior: yeah the reorganise was a pain cos it all refers to each other but tox fails on the first error. so i had to go through them all one at a time | 13:23 |
| * marios fetch coffee | 13:23 | |
| jaosorior | I see | 13:23 |
| jaosorior | so you moved all the update bits to be on top | 13:23 |
| jaosorior | and not inside the installation guide | 13:23 |
| jaosorior | got it | 13:23 |
| jaosorior | that makes more sense actually | 13:23 |
| *** hberaud has quit IRC | 13:24 | |
| *** hberaud has joined #tripleo | 13:24 | |
| marios | jaosorior: yeah all in one place. undercloud, overcloud, minor major ffwd and developer | 13:24 |
| marios | jaosorior: there is so much stuff it deserves its own bit i think | 13:24 |
| marios | jaosorior: for visibility | 13:24 |
| marios | jaosorior: anyway this is my proposal perhaps others disagree lets see | 13:25 |
| jaosorior | marios: I'll wait for it to pass CI (to render) and check it out | 13:25 |
| marios | jaosorior: ack no rush thanks | 13:25 |
| marios | just fyi | 13:25 |
| marios | cos i saw your patches and felt pressure to deliver ;) | 13:25 |
| marios | :) | 13:25 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-common master: Add tripleoclient container https://review.openstack.org/611598 | 13:25 |
| jaosorior | lol | 13:25 |
| marios | jaosorior: didn't want to be the one to break our one a week pledge don't wana be that guy right | 13:27 |
| jaosorior | haha true :P | 13:28 |
| marios | jistr: chem` matbu ccamacho holser|lunch jfrancoa o/ folks can you checkout http://logs.openstack.org/33/619733/1/check/openstack-tox-docs/bc5083e/html/ https://review.openstack.org/#/c/619733/1 when you get a chance thanks | 13:31 |
| marios | just reorganise no content change | 13:31 |
| *** holser|lunch is now known as holser_ | 13:31 | |
| ccamacho | hey marios | 13:31 |
| ccamacho | sure thing | 13:31 |
| holser_ | marios looking | 13:31 |
| ccamacho | how are you doing? | 13:31 |
| holser_ | thanks | 13:31 |
| marios | ccamacho: not bad thanks happy friday :) | 13:33 |
| marios | ccamacho: u good? | 13:33 |
| jistr | marios: ah nice! i was meaning to do it with the upgrade docs and dev docs. *meaning* :) Thanks for actually doing it :) | 13:33 |
| marios | jistr: we /me jaosorior anyone welcome to join our effort. we pledge one a week @ https://bugs.launchpad.net/tripleo/+bug/1804642?comments=all | 13:34 |
| openstack | Launchpad bug 1804642 in tripleo "[DOCS] Improve upstream documentation" [Low,In progress] - Assigned to Marios Andreou (marios-b) | 13:34 |
| ccamacho | marios not bad, waiting for quiquell's love xD | 13:34 |
| marios | this is my first one jistr hoping others will be smaller :) | 13:34 |
| jistr | marios: for dev docs i have WIP change at https://review.openstack.org/#/c/611374/ but it needs to be reshuffled. It probably doesn't make sense to have separate "contributor guide" and "developer guide", it's pretty much the same thing i think | 13:34 |
| quiquell | ccamacho: love is in the review | 13:35 |
| openstackgerrit | Emilien Macchi proposed openstack/paunch master: WIP: runner: test if image exists before running inspect https://review.openstack.org/619313 | 13:35 |
| EvilienM | Tengu, ssbarnea|bkp2 ^ wdyt? | 13:35 |
| jistr | or "contributor" is a wider term but probably doesn't make sense to draw a line between the two | 13:35 |
| jaosorior | jistr: agreed | 13:35 |
| jaosorior | they should probably be the same | 13:35 |
| marios | jistr: ah i didn't see your review | 13:35 |
| marios | jistr: but i removed upgrades from the 'other' developer docs | 13:36 |
| Tengu | EvilienM: #lunch - back in ~30 | 13:36 |
| marios | jistr: it is under its own section in upgrades now i mean http://logs.openstack.org/33/619733/1/check/openstack-tox-docs/bc5083e/html/ | 13:36 |
| marios | jistr: oh 'contributor' vs 'developer' yeah agree | 13:36 |
| marios | jistr: and probably doesn't need to be at the top? | 13:37 |
| marios | jistr: i'll checkout your review | 13:37 |
| marios | jistr: do they conflict /me checks | 13:37 |
| jistr | marios: yea that's fine i think (re own section in upgrades) and we can put perhaps dev/contributor docs under one umbrella subsequently | 13:37 |
| jistr | marios: yes i bet they conflict on the dev docs but that's fine, my patch is essentially abandoned at this point, i didn't find time to revisit it | 13:37 |
| marios | jistr: yeah i like your change too with developer a top level citizen | 13:38 |
| marios | jistr: so rebase it when you get a chance anyway no rush on any of this just pinging folks | 13:38 |
| marios | jistr: (it has merge conflict) | 13:39 |
| marios | and -1 from you | 13:39 |
| *** quiquell is now known as quiquell|lunch | 13:39 | |
| openstackgerrit | Emilien Macchi proposed openstack/paunch master: WIP: runner: test if image exists before running inspect https://review.openstack.org/619313 | 13:39 |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: WIP - change step to start nova placement and make compute wait for it https://review.openstack.org/619586 | 13:40 |
| openstackgerrit | Merged openstack/tripleo-validations master: Fix mysql_open_files_limit validation https://review.openstack.org/617603 | 13:42 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations stable/rocky: Fix mysql_open_files_limit validation https://review.openstack.org/619734 | 13:43 |
| quiquell|lunch | ccamacho: Where can I give love ? Don't really know anything about lower constraints issues | 13:44 |
| jistr | marios: just broken links for images but otherwise i'd give +2 | 13:45 |
| ccamacho | quiquell|lunch me neither xD | 13:46 |
| ccamacho | maybe EvilienM can help? | 13:46 |
| ccamacho | or mwhahaha | 13:46 |
| marios | thanks jistr i'll wait for any more and update likely next week | 13:46 |
| jistr | ack | 13:46 |
| ccamacho | we have an issue with the lower constraints job in stable/rocky instack-undercloud | 13:46 |
| ccamacho | amoralejo realized that the job is not using the lower-constraints restriction | 13:47 |
| ccamacho | here is a test review with some fixes https://review.openstack.org/#/c/619467/ | 13:47 |
| marios | quiquell|lunch: woo deployment successful scen 4 http://logs.openstack.org/20/619520/7/check/tripleo-ci-centos-7-scenario004-standalone/9fc5480/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 13:52 |
| marios | quiquell|lunch: but job still failing. anyway rebases worked | 13:52 |
| marios | quiquell|lunch: and http://logs.openstack.org/08/619508/6/check/tripleo-ci-centos-7-scenario001-standalone/25dce6c/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 13:53 |
| *** ksambor has quit IRC | 13:53 | |
| gfidente | I have a story to tell | 13:53 |
| gfidente | one day (exactly one month ago) | 13:54 |
| gfidente | this guy got a w+1 | 13:54 |
| gfidente | https://review.openstack.org/#/c/608300/1 | 13:54 |
| gfidente | since then | 13:54 |
| gfidente | it went through counteless rechecks | 13:54 |
| gfidente | and it ain't been merged yet | 13:54 |
| gfidente | shall we make a netflix series? | 13:55 |
| openstackgerrit | Merged openstack/tripleo-validations master: Avoid Ansible Deprecation Warning https://review.openstack.org/614466 | 13:55 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Adjust haproxy-public-tls-inject.yaml bootstrap variable https://review.openstack.org/619215 | 13:55 |
| openstackgerrit | Merged openstack/tripleo-validations master: Remove checks for boot_option https://review.openstack.org/618725 | 13:55 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Fix containerized ironic bind-mounts https://review.openstack.org/619515 | 13:55 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove validation part of the online database migration pre-upgrade. https://review.openstack.org/619247 | 13:55 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Remove tftp service and package upon upgrade to container https://review.openstack.org/619500 | 13:55 |
| *** moguimar has quit IRC | 13:55 | |
| gfidente | "it's not only about getting the votes" | 13:55 |
| gfidente | looking forward to celebrate merging | 13:56 |
| EvilienM | ccamacho: looking | 13:56 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations stable/rocky: Avoid Ansible Deprecation Warning https://review.openstack.org/619735 | 13:56 |
| *** moguimar has joined #tripleo | 13:58 | |
| openstackgerrit | Mike Fedosin proposed openstack/tripleo-heat-templates master: Set container images for openshift 3.11 https://review.openstack.org/613165 | 13:59 |
| EvilienM | ccamacho: why don't you fix master first? | 13:59 |
| *** amoralej is now known as amoralej|lunch | 14:00 | |
| ccamacho | EvilienM master is empty https://github.com/openstack/instack-undercloud xD | 14:01 |
| *** ykarel is now known as ykarel|away | 14:01 | |
| *** quiquell|lunch is now known as quiquell | 14:01 | |
| quiquell | marios: so you are in the linting problem too now ? | 14:02 |
| EvilienM | ccamacho: yes, I'm stupid | 14:02 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Move ceph-loop3 to ceph-loop-device role for standalone scenarios https://review.openstack.org/616872 | 14:02 |
| marios | chkumar|ruck: as requested ^ | 14:02 |
| marios | quiquell: i am checking now but i assume so. | 14:03 |
| marios | quiquell: i need to rebase the jobs too for ^ | 14:03 |
| quiquell | amoralej|lunch, Tengu: bad news newer kernel still heat issues http://logs.openstack.org/98/619598/3/check/tripleo-ci-fedora-28-standalone/828578b/logs/undercloud/var/log/extra/rpm-list.txt.gz | 14:03 |
| marios | gfidente: quiquell can you please re-add your vote at https://review.openstack.org/616872 added readme blame chkumar|ruck thanks | 14:03 |
| quiquell | Don't know why I don't get them locally | 14:03 |
| Tengu | quiquell: woohoo | 14:03 |
| quiquell | Is exactly the same image same job same evrything | 14:03 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Add new tripleo-ci-centos-7-scenario001-standalone job https://review.openstack.org/619508 | 14:04 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Add tripleo-ci-centos-7-scenario004-standalone job https://review.openstack.org/619520 | 14:04 |
| *** hberaud is now known as hberaud|afk | 14:04 | |
| quiquell | Tengu: Where is the heat port here ? http://logs.openstack.org/98/619598/3/check/tripleo-ci-fedora-28-standalone/828578b/logs/undercloud/var/log/extra/netstat.txt.gz | 14:05 |
| Tengu | quiquell: you might want to check in haproxy.cfg directly. | 14:06 |
| Tengu | wait. | 14:06 |
| *** hberaud|afk is now known as hberaud | 14:06 | |
| Tengu | ohh wait, that's the heat not in container, but ... ok. | 14:06 |
| Tengu | wait | 14:06 |
| Tengu | http://logs.openstack.org/98/619598/3/check/tripleo-ci-fedora-28-standalone/828578b/logs/undercloud/var/log/heat-launcher/undercloud_deploy-_umabn7c/heat.conf.txt.gz | 14:06 |
| marios | Couldn't parse task at /home/zuul/undercloud-ansible-NcEufV/Standalone/upgrade_tasks_playbook.yaml:21 (no action detected in task. This often indicates a misspelled module name, or incorrect module path. this quiquell ? | 14:06 |
| Tengu | quiquell: I'd say heat isn't started. | 14:07 |
| quiquell | marios: Is like the pacemaker_resourc ansible module is not installed or present | 14:07 |
| quiquell | marios: but the RPM is installed :-/ | 14:08 |
| quiquell | Tengu: I see the heat-launcher logs looks ok ? http://logs.openstack.org/98/619598/3/check/tripleo-ci-fedora-28-standalone/828578b/logs/undercloud/var/log/heat-launcher/undercloud_deploy-_umabn7c/heat.log.txt.gz | 14:08 |
| Tengu | yeah... that's weird. that said, they aren't that long.... | 14:08 |
| quiquell | When do we install heat ? | 14:11 |
| Tengu | quiquell: oh, is selinux enforced? | 14:11 |
| *** akrivoka has quit IRC | 14:11 | |
| quiquell | No clue is default stuff | 14:12 |
| *** akrivoka has joined #tripleo | 14:12 | |
| quiquell | Tengu: Is this good ? http://logs.openstack.org/98/619598/3/check/tripleo-ci-fedora-28-standalone/828578b/logs/undercloud/var/log/extra/haproxy-stats.txt.gz | 14:12 |
| quiquell | No HAProxy or no socket on host | 14:13 |
| Tengu | SELINUX=enforcing | 14:13 |
| Tengu | ok, so selinux is enforcing. | 14:13 |
| Tengu | there are some AVC in the audit.log, but nothing related to the issue apparently. | 14:13 |
| Tengu | quiquell: apparently there isn't any haproxy at that time. | 14:13 |
| Tengu | it's a really, really early failure. | 14:13 |
| *** chkumar|ruck has quit IRC | 14:15 | |
| Tengu | quiquell: so heat is installed as a direct dep of tripleoclient or something like that. the tripleoclient will run a standalone heat instance, with the log+config+db in /var/log/heat-launcher/random-name/ as you already saw that. | 14:15 |
| Tengu | so apparently, "something" is preventing the host to talk to it. | 14:15 |
| Tengu | iptables? | 14:15 |
| Tengu | or just heat silently crashing? | 14:16 |
| Tengu | oh. would be lovely to get the iptables output.......... | 14:16 |
| quiquell | Tengu: but there is not much logging at heatl-luncher/ dir | 14:16 |
| quiquell | Is like it's stuck or something | 14:16 |
| quiquell | And I don't see dumps at journal | 14:16 |
| Tengu | yeah. hence my "silently crashing" | 14:16 |
| quiquell | At my local machine is passing heat issue again | 14:17 |
| quiquell | Also pstree does not have heat | 14:18 |
| EvilienM | ccamacho: openstack-tox-lower-constraints is failing :/ | 14:18 |
| quiquell | http://logs.openstack.org/98/619598/3/check/tripleo-ci-fedora-28-standalone/828578b/logs/undercloud/var/log/extra/pstree.txt.gz | 14:18 |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-quickstart-extras master: Allow to collect iptables state https://review.openstack.org/619737 | 14:18 |
| Tengu | quiquell: -^^ | 14:18 |
| Tengu | quiquell: yeah so for some reason it's not running properly. | 14:18 |
| quiquell | Tengu: so no iptables issue heat is not running at all | 14:19 |
| Tengu | quiquell: yeah. still, having iptables state is a good thing | 14:19 |
| quiquell | what was the port for heat ? | 14:20 |
| Tengu | it's in the config. | 14:20 |
| Tengu | 8086 or something like that I think | 14:20 |
| Tengu | http://127.0.0.1:8006/ | 14:20 |
| ccamacho | EvilienM but its a job failure? or something fixable in the repo | 14:20 |
| quiquell | 8006 | 14:20 |
| EvilienM | ccamacho: I didn't look at logs, in a meeting now | 14:21 |
| quiquell | working standalone does not have it open at netsatat log | 14:21 |
| quiquell | :-( | 14:21 |
| Tengu | quiquell: yeah, so the heat instance is just temporary. | 14:21 |
| *** hberaud is now known as hberaud|afk | 14:21 | |
| Tengu | quiquell: it's for the deploy time only | 14:22 |
| quiquell | Tengu: what ansibl task start it up ? | 14:22 |
| *** hberaud|afk is now known as hberaud | 14:22 | |
| Tengu | soooo... oh fuck. yeah, it will probably never show up in netstat nor ps nor anything else. | 14:22 |
| Tengu | quiquell: https://github.com/openstack/python-tripleoclient/blob/2f662a50d6f8f05523d365148d922cdd44e60f58/tripleoclient/heat_launcher.py | 14:22 |
| marios | https://review.openstack.org/#/c/616872/ panda|rover gfidente quiquell please vote here we need it for scen1/4 it had +2 but i added readme thanks https://review.openstack.org/#/c/616872/ | 14:22 |
| Tengu | quiquell: so it will drop the heat-launcher when the script ends (at latest), and as all the other info collection is done AFTER the end of the script, being a success or not, we won't be able to see the open port. | 14:23 |
| quiquell | marios: +2 | 14:23 |
| marios | thanks quiquell | 14:24 |
| marios | and gfidente | 14:24 |
| quiquell | Tengu: so the same openstack deploy thing starts the tempopral heat thing | 14:24 |
| gfidente | marios ty | 14:24 |
| Tengu | quiquell: right | 14:24 |
| quiquell | so standalone_deploy.log is the place | 14:24 |
| Tengu | yeah. | 14:25 |
| *** ykarel|away has quit IRC | 14:25 | |
| Tengu | still... apparently something is preventing that launch in some way. | 14:25 |
| Tengu | and it's NOT selinux: the denials are really short and without consquences on the run, I think: http://logs.openstack.org/98/619598/3/check/tripleo-ci-fedora-28-standalone/828578b/logs/undercloud/var/log/extra/denials.txt.gz | 14:25 |
| Tengu | oh. in fact, there IS iptables rules. | 14:26 |
| Tengu | http://logs.openstack.org/98/619598/3/check/tripleo-ci-fedora-28-standalone/828578b/logs/undercloud/var/log/extra/network.txt.gz | 14:26 |
| Tengu | dropping my change. | 14:26 |
| Tengu | so yeah, basically all localhost connections are OK anyway. | 14:27 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add Prepare Container Images step https://review.openstack.org/619739 | 14:27 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add ContainerImagesWizard https://review.openstack.org/619740 | 14:27 |
| quiquell | Tengu: looks like is timing out very fast, like no timeout at all | 14:27 |
| quiquell | Tengu: have a success deploy at my env :-/ | 14:27 |
| Tengu | EvilienM: I think we will have a small issue with the container repository. again... http://mirror.bhs1.ovh.openstack.org:8080/cbs.centos/virt7-container-common-candidate/x86_64/os/repodata/f3bf3739ad7996fca7cb34c8292424a36a88235ee0d70a1083d8139b69d5ca83-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found | 14:28 |
| Tengu | hopefully I'm wrong. please tell me I'm wrong. | 14:28 |
| EvilienM | Tengu: mhh ok I'll take a look after my mtg | 14:29 |
| Tengu | sorry :( | 14:29 |
| Tengu | quiquell: have to go. | 14:29 |
| quiquell | Tengu: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/utils.py#L1086 | 14:29 |
| quiquell | Tengu: ack | 14:29 |
| quiquell | Tengu: will try to increase that timeout just to test this | 14:29 |
| Tengu | quiquell: hmm, there's a retry anyway. | 14:29 |
| Tengu | but yeah, might be that. | 14:30 |
| quiquell | Tengu: where ? | 14:30 |
| Tengu | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/utils.py#L1082 | 14:30 |
| Tengu | it tries for 30 times with a 1s sleep | 14:30 |
| quiquell | Yep... | 14:30 |
| quiquell | 30 secs | 14:30 |
| Tengu | yeah. | 14:30 |
| Tengu | so try increasing the timeout to, let's say, 5s | 14:30 |
| Tengu | in order to ensure heat is running, loaded and ready. | 14:30 |
| quiquell | Will try, have a good weekend man | 14:31 |
| Tengu | same to you ;). | 14:31 |
| Tengu | will catch you Monday for news :). | 14:31 |
| Tengu | see ya all! | 14:31 |
| quiquell | Humm the time | 14:33 |
| quiquell | between heat-launcher | 14:33 |
| quiquell | Humm they are in the border I think increase timeout can help | 14:34 |
| *** mcornea has joined #tripleo | 14:37 | |
| *** jfrancoa has quit IRC | 14:41 | |
| *** balszoll has joined #tripleo | 14:41 | |
| *** saneax has quit IRC | 14:43 | |
| openstackgerrit | Quique Llorente proposed openstack/python-tripleoclient master: Increase heat api timeout to 5 secs https://review.openstack.org/619741 | 14:43 |
| *** ratailor has joined #tripleo | 14:43 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Enable tempest for fedora28 standalone https://review.openstack.org/618056 | 14:47 |
| *** ykarel|away has joined #tripleo | 14:54 | |
| *** trown|outtypewww has quit IRC | 14:54 | |
| *** jfrancoa has joined #tripleo | 14:55 | |
| *** quiquell is now known as quiquell|off | 14:55 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-common master: Add puppet-tripleo container https://review.openstack.org/619744 | 14:55 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP: Add pre-upgrade validation step for containerized services. https://review.openstack.org/582502 | 14:56 |
| *** trown|brb has joined #tripleo | 14:58 | |
| *** moguimar has quit IRC | 15:05 | |
| jaosorior | dtantsur: around? | 15:05 |
| dtantsur | jaosorior: yep | 15:05 |
| jaosorior | dtantsur: hey, I took a look at your spec and it overall looks fine. I would like the bits about novajoin and some security stuff to be addressed though... Wanna do it in this patch or as part of another review? | 15:06 |
| dtantsur | jaosorior: I'd prefer a new review, since a lot of stuff in the spec is not blocked by the novajoin issue | 15:06 |
| jaosorior | ok, lets do that | 15:07 |
| jaosorior | cores, could I get a review for this? https://review.openstack.org/#/c/618950/ | 15:07 |
| *** mmethot has quit IRC | 15:09 | |
| dtantsur | last time I did such a huge work, the spec required 3-4 amendments based on the actual code and reviews. I find it pretty normal :) | 15:09 |
| dtantsur | thanks jaosorior :) | 15:10 |
| jaosorior | dtantsur: thank you! for this work | 15:10 |
| *** amoralej|lunch is now known as amoralej | 15:11 | |
| fultonj | jaosorior: +2 (I'm not here :) | 15:12 |
| jaosorior | fultonj: thanks! Enjoy your PTO! :D | 15:12 |
| openstackgerrit | Merged openstack/tripleo-ha-utils master: Fix the License mismatch in README https://review.openstack.org/619611 | 15:13 |
| EvilienM | I think we need https://review.openstack.org/#/c/619625/ asap | 15:14 |
| EvilienM | because CBS is causing troubles with what Tengu reported and the 404 issue | 15:14 |
| bogdando | stevebaker: hi, around? | 15:14 |
| *** balszoll has quit IRC | 15:16 | |
| openstackgerrit | Merged openstack/tripleo-specs master: Bare metal provisioning without Nova and Glance https://review.openstack.org/604761 | 15:17 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-common master: Add tripleoclient container https://review.openstack.org/611598 | 15:22 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-common master: Add puppet-tripleo container https://review.openstack.org/619744 | 15:22 |
| jaosorior | EvilienM: if that's needed ASAP, you could request in #openstack-infra for that patch to be prioritized in the queue | 15:24 |
| *** pbandark has quit IRC | 15:27 | |
| marios | gerrit down? | 15:27 |
| EvilienM | jaosorior: it's alraedy in gate | 15:29 |
| EvilienM | marios: no | 15:29 |
| marios | EvilienM: thanks you fixed it | 15:30 |
| EvilienM | jaosorior: but not on top, I think it's fine. No worries I'll monitor it and make sure itl ands today | 15:30 |
| EvilienM | marios: anytime man | 15:30 |
| EvilienM | :D | 15:30 |
| marios | :) | 15:33 |
| *** shardy has quit IRC | 15:36 | |
| *** cylopez has joined #tripleo | 15:40 | |
| *** mmethot has joined #tripleo | 15:41 | |
| *** ade_lee has joined #tripleo | 15:43 | |
| *** ykarel|away has quit IRC | 15:43 | |
| *** ykarel|away has joined #tripleo | 15:45 | |
| *** matbu has quit IRC | 15:45 | |
| *** matbu has joined #tripleo | 15:47 | |
| *** fultonj has quit IRC | 15:57 | |
| *** yprokule has quit IRC | 15:57 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO https://review.openstack.org/602248 | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO https://review.openstack.org/604293 | 16:00 |
| *** pcaruana has joined #tripleo | 16:00 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-common master: Set DeployIdentifier on update/upgrade/ffwd prepare actions https://review.openstack.org/619759 | 16:01 |
| *** kopecmartin is now known as kopecmartin|off | 16:01 | |
| *** jfrancoa has quit IRC | 16:18 | |
| *** iurygregory has quit IRC | 16:20 | |
| *** blinkiz has quit IRC | 16:20 | |
| *** ratailor has quit IRC | 16:29 | |
| jaosorior | O | 16:35 |
| jaosorior | I'm off folks! have a good weekend! | 16:35 |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: Change step to start nova placement and make compute wait for it https://review.openstack.org/619586 | 16:38 |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: Change step to start nova placement and make compute wait for it https://review.openstack.org/619586 | 16:42 |
| *** hberaud is now known as hberaud|afk | 16:44 | |
| *** hberaud|afk is now known as hberaud | 16:51 | |
| *** cylopez has quit IRC | 16:53 | |
| *** jchhatba_ has quit IRC | 16:54 | |
| *** holser_ has quit IRC | 17:00 | |
| *** hberaud is now known as hberaud|gone | 17:02 | |
| *** bogdando has quit IRC | 17:03 | |
| *** jpich has quit IRC | 17:07 | |
| *** dtantsur is now known as dtantsur|afk | 17:07 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Ensure directory exists before trying to use it in a container https://review.openstack.org/619565 | 17:14 |
| *** slaweq has quit IRC | 17:16 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: DNM: Test branches filter for deprecated jobs https://review.openstack.org/619776 | 17:23 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: DNM: Test branches filter for deprecated jobs https://review.openstack.org/619776 | 17:27 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: DNM: Test branches filter for deprecated jobs https://review.openstack.org/619776 | 17:32 |
| *** jpena is now known as jpena|off | 17:33 | |
| *** raildo_ has joined #tripleo | 17:36 | |
| *** raildo has quit IRC | 17:38 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: DNM: Test branches filter for deprecated jobs https://review.openstack.org/619776 | 17:38 |
| openstackgerrit | Mike Fedosin proposed openstack/tripleo-heat-templates master: Set container images for openshift 3.11 https://review.openstack.org/613165 | 17:47 |
| *** derekh has quit IRC | 18:00 | |
| *** ade_lee has quit IRC | 18:14 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Fixed path for tripleo deployer input file https://review.openstack.org/618994 | 18:15 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Run online data migration before update/upgrade converge. https://review.openstack.org/618961 | 18:15 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Drop remaining ssh-user from templates. https://review.openstack.org/617455 | 18:15 |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: Change step to start nova placement and make compute wait for it https://review.openstack.org/619586 | 18:18 |
| *** ykarel|away has quit IRC | 18:22 | |
| openstackgerrit | Merged openstack/tripleo-common stable/rocky: Correct handling of capabilities on node update https://review.openstack.org/618979 | 18:29 |
| openstackgerrit | Merged openstack/tripleo-validations master: Skip schema check in network validation https://review.openstack.org/619184 | 18:29 |
| *** amoralej is now known as amoralej|off | 18:40 | |
| *** d0ugal has quit IRC | 18:41 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Correct some commands from the "Collect container info" tasks https://review.openstack.org/618975 | 18:56 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Set Swift workers to 2 https://review.openstack.org/618966 | 18:56 |
| openstackgerrit | Merged openstack/tripleo-validations master: Fix the ceilometerdb-size validation in the containerized undercloud https://review.openstack.org/618210 | 18:56 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Deprecate unsupported/old stable branch jobs https://review.openstack.org/619337 | 18:57 |
| *** d0ugal has joined #tripleo | 18:57 | |
| *** raildo_ has quit IRC | 19:08 | |
| *** raildo_ has joined #tripleo | 19:08 | |
| *** suuuper has quit IRC | 19:11 | |
| *** paramite has quit IRC | 19:13 | |
| *** akrivoka has quit IRC | 19:18 | |
| *** artom has quit IRC | 19:19 | |
| openstackgerrit | Emilien Macchi proposed openstack/paunch master: runner: test if image exists before running inspect https://review.openstack.org/619313 | 19:19 |
| *** artom has joined #tripleo | 19:19 | |
| *** jtomasek has quit IRC | 19:40 | |
| *** rfolco has quit IRC | 19:40 | |
| *** gfidente has quit IRC | 20:25 | |
| *** mschuppert has quit IRC | 20:25 | |
| *** krypto has quit IRC | 20:30 | |
| *** slaweq has joined #tripleo | 20:40 | |
| *** dtrainor__ has joined #tripleo | 20:41 | |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: Change step to start nova placement and make compute wait for it https://review.openstack.org/619586 | 20:41 |
| *** raildo_ has quit IRC | 20:47 | |
| *** xek__ has quit IRC | 21:01 | |
| *** xek__ has joined #tripleo | 21:02 | |
| *** xek__ has quit IRC | 21:03 | |
| *** xek__ has joined #tripleo | 21:04 | |
| *** xek__ has quit IRC | 21:05 | |
| *** xek has joined #tripleo | 21:06 | |
| *** xek has quit IRC | 21:09 | |
| *** xek has joined #tripleo | 21:09 | |
| *** xek has quit IRC | 21:11 | |
| *** xek_ has joined #tripleo | 21:11 | |
| *** holser_ has joined #tripleo | 21:12 | |
| *** xek_ has quit IRC | 21:12 | |
| *** slaweq has quit IRC | 21:21 | |
| *** fimaz has joined #tripleo | 21:43 | |
| *** pcaruana has quit IRC | 21:46 | |
| *** fimaz has quit IRC | 21:49 | |
| *** fimaz has joined #tripleo | 21:49 | |
| *** chem` has quit IRC | 21:54 | |
| openstackgerrit | Merged openstack/tripleo-common stable/rocky: Fix rotate_fernet_keys workflow to not use heat deployment https://review.openstack.org/618950 | 21:57 |
| *** fimaz has quit IRC | 22:01 | |
| *** mcornea has quit IRC | 22:10 | |
| *** holser_ has quit IRC | 22:10 | |
| *** fimaz has joined #tripleo | 22:11 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: upgrade: remove Docker containers now managed by Podman https://review.openstack.org/615209 | 22:52 |
| *** dhill_ has quit IRC | 22:56 | |
| *** mmethot has quit IRC | 23:13 | |
| *** slaweq has joined #tripleo | 23:18 | |
| *** xek has joined #tripleo | 23:25 | |
| *** slaweq has quit IRC | 23:27 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!