Friday, 2018-09-07

*** hamzy has joined #oooq00:55
*** dtrainor has quit IRC01:19
*** saneax has joined #oooq01:19
*** saneax has quit IRC01:20
*** saneax has joined #oooq01:33
hubbot1FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates (1 more message)01:36
*** apetrich_ has joined #oooq02:04
*** apetrich has quit IRC02:07
*** ykarel|away has joined #oooq02:54
*** ykarel|away is now known as ykarel03:11
*** gkadam has joined #oooq03:21
*** skramaja has joined #oooq03:31
hubbot1FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates @ https://review.openstack.org/560445, stable/queens: tripleo- (1 more message)03:36
*** jaganathan has joined #oooq04:04
*** udesale has joined #oooq04:05
*** pgadiya has joined #oooq04:13
*** pgadiya has quit IRC04:13
*** rlandy has quit IRC04:16
*** ykarel has quit IRC04:24
*** ykarel has joined #oooq04:44
*** ratailor has joined #oooq05:00
*** ssbarnea|bkp has quit IRC05:22
*** sanjayu_ has joined #oooq05:33
*** saneax has quit IRC05:33
hubbot1FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, legacy-tripleo-ci-centos-7-containers-multinode-upgrades-pike-branch, legacy-tripleo-ci-centos-7-container-to-container- (2 more messages)05:36
*** quiquell has joined #oooq05:45
*** gkadam_ has joined #oooq05:46
*** gkadam has quit IRC05:48
*** brault has joined #oooq05:51
*** ratailor has quit IRC06:09
*** ratailor has joined #oooq06:09
*** holser_ has joined #oooq06:29
*** quiquell is now known as quique|rover|bbl06:36
*** sanjayu_ has quit IRC06:40
*** jfrancoa has joined #oooq06:49
*** jtomasek has joined #oooq07:00
*** quique|rover|bbl has quit IRC07:06
*** quiquell has joined #oooq07:06
*** quiquell has quit IRC07:07
*** quiquell|rover has joined #oooq07:07
*** quiquell|rover has quit IRC07:07
*** quiquell|rover has joined #oooq07:08
quiquell|rover0fr33n0d3 ellorent@redhat.com07:09
quiquell|roverups07:09
quiquell|rover:-)07:09
quiquell|rover /msg NickServ REGISTER ******************** ellorent@redhat.com07:10
quiquell|roverdamn sorry07:11
*** quiquell|rover has quit IRC07:11
*** quiquell has joined #oooq07:12
*** quiquell is now known as quiquell|rover07:12
*** ccamacho has joined #oooq07:17
*** tesseract has joined #oooq07:27
hubbot1FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo- (2 more messages)07:36
*** dtantsur|afk is now known as dtantsur07:46
*** tosky has joined #oooq07:59
jfrancoaquiquell|rover: oh, thanks for your password.Going to bbva bank page to give it a try :-D08:00
quiquell|roverjfrancoa: They will make you pay my debts08:01
jfrancoaquiquell|rover: then me not interested08:01
*** chem has quit IRC08:09
*** ssbarnea|bkp has joined #oooq08:11
*** ssbarnea1 has joined #oooq08:11
ssbarnea|bkpmorning guys!08:12
*** ykarel is now known as ykarel|lunch08:13
ssbarnea|bkpi am wondering if I am the only one finding the quickstart banner useless waste of screen space. i wonder if a proposal to remove it would not end up in flame(s)08:13
quiquell|roverssbarnea|bkp:  o/08:13
rascasofthey ssbarnea|bkp08:14
quiquell|roverssbarnea|bkp: You can propose a bigger one, so people yell, and then remove it as solution, so people is happy08:14
rascasoftquiquell|rover++08:14
hubbot1rascasoft: quiquell|rover's karma is now 308:14
rascasoftssbarnea|bkp, we can make it appear just when the debug switch is turned on08:15
ssbarnea|bkpi do remember that ansible also had a cow, but i almost never seen it in builds.08:16
ssbarnea|bkpnobody mentioned the timeouts during the planning yesterday08:21
toskybecause you never installed cowsay08:24
toskythe cow is enabled (or was enabled) when cowsay was found08:25
mariosssbarnea|bkp: i left a comment at https://review.openstack.org/#/c/596428/2 but i think sshnaidm is away today08:33
mariosssbarnea|bkp: i added the trace into the bug from the one Carlos pointed at08:35
*** sanjayu_ has joined #oooq08:37
*** ssbarnea|bkp has quit IRC08:43
*** ykarel|lunch is now known as ykarel08:49
*** ssbarnea|bkp has joined #oooq08:54
ssbarnea|bkpmarios: yeah he did quite a few -2 on the (re)producer-day and didn't bother to press him to fix them but I think that other cores can remove his vote if needed. i cannot remove anyone from a review, even if they didn't vote yet.08:55
ssbarnea|bkpi didn't fix the when cause but I am afraid that even if I fix it, the vote would stick. only the -1 are removed on change if i remember well.08:56
mariosssbarnea|bkp: no thats why i wrote the comment mainly, as far as i know we can't remove the -208:58
mariosssbarnea|bkp: :)08:58
ssbarnea|bkpmarios lets be practical, there are lots of other changes that can be merged, we can deal with these first.08:59
ssbarnea|bkphttps://review.openstack.org/#/c/583984/08:59
mariosack i'll check it on my next reviews run09:00
ssbarnea1who is ruck today? we need to updat the topic09:02
ssbarnea1clearly is outdated09:02
quiquell|roverssbarnea1: I am kind of both now the ruck is busy09:03
quiquell|roverssbarnea1: what's outdated ?09:11
ssbarnea1i am still listed as ruck in channel topic09:27
quiquell|roverssbarnea1: Cannot change the topic has no permissions :-/09:28
quiquell|rovermarios, ssbarnea1: Excuse me I repeat my self, did we have any updates on this ? https://trello.com/c/MbcQXQ5g/717-cixlp1789416tripleociproa-stable-queens-no-image-with-the-name-bm-deploy-kernel-found-make-sure-you-have-uploaded-boot-images09:31
*** sanjayu_ has quit IRC09:31
mariosquiquell|rover: np as i said yesterday it is ssbarnea|bkp bug and i thought we said it didn't happen anymore (i thought ssbarnea|bkp removed alert)09:32
marioschecking09:32
quiquell|roverYep, alert is there removing it.09:33
quiquell|roverand fix released09:33
quiquell|roverok09:33
quiquell|roverthanks man09:33
hubbot1FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo- (2 more messages)09:36
*** ratailor_ has joined #oooq09:39
*** ratailor has quit IRC09:40
ssbarnea|bkpquiquell|rover i have no idea how to elegate your permissions on the channel, i always found IRC commands close to CJK09:44
*** ssbarnea1 is now known as ssbarnea09:53
*** jtomasek has quit IRC09:55
quiquell|roverssbarnea|bkp: updates on this ? https://bugs.launchpad.net/tripleo/+bug/179105310:01
openstackLaunchpad bug 1791053 in tripleo "delorean: Get the non-root user UI fails after user is created" [Undecided,In progress] - Assigned to Sorin Sbarnea (ssbarnea)10:01
quiquell|roverssbarnea|bkp: the job looks like working fine10:02
ssbarnea|bkpquiquell|rover : update is simple: it got verified by zuul, I added 4 reviewers yesterday, nobody reviewed.10:02
quiquell|roverssbarnea|bkp: But the job is not failing10:02
quiquell|roverhttps://ci.centos.org/job/tripleo-quickstart-extras-gate-master-delorean-quick-basic/10:02
ssbarnea|bkpquiquell|rover yeah, not failing now, but you seen the failed one and the CR. maybe it fails randomly. still, if the CR looks ok, we should merge it and close the bug.10:04
ssbarnea|bkpunless you see a problem with it10:04
quiquell|roverssbarnea|bkp: Thinking about removing the promotion-blocker10:04
ssbarnea|bkpis tricky because we all see the failure, we know that a failure on this job counts as a promotion-blocker and we have no flaky-promotion-blocker label to use ;)10:05
quiquell|roverssbarnea|bkp: also the job is failing in the review :-(10:06
ssbarnea|bkpbetter to get it reviewed and merged, is not a hard review10:06
ssbarnea|bkpnot the one that counts, or where it counts, is ignorable. if it gets +W it will merge.10:06
quiquell|roverssbarnea|bkp: This is not the job that get fixed ? https://ci.centos.org/job/tripleo-quickstart-gate-master-delorean-quick-basic/6902/10:07
quiquell|rover"The conditional check 'update_containers and update_containers_append_tag is undefined' failed" ahh show this before10:08
ssbarnea|bkpyep, this is likely because promotion didn't happen10:09
ssbarnea|bkphttps://bugs.launchpad.net/tripleo/+bug/1786106/comments/1110:10
openstackLaunchpad bug 1786106 in tripleo "containers-prep fails w/ update_containers is undefined due to lack of default" [High,Fix released] - Assigned to Quique Llorente (quiquell)10:10
quiquell|roverDamn... bad memory I have, was the same, ok.10:10
ssbarnea|bkpnot sure what recent means but we can retrigger it to check10:10
quiquell|roverssbarnea|bkp: Let's do that10:11
ssbarnea|bkpbut I do see that is easy to reach deadlocks, when you cannot fix promotion because build fails.10:11
ssbarnea|bkpquiquell|rover kick this one too https://review.openstack.org/#/c/583984/10:16
quiquell|roverssbarnea|bkp: this pre-commit thing is cool10:23
ssbarnea|bkpi know, it has lots of time-saving features (and performance), still i don't want to push for it, it takes time for people to get used to it and to adopt.10:24
quiquell|roverssbarnea|bkp: But it's optional feature, if you don't want it you don't install pre-commit10:25
quiquell|roverssbarnea|bkp: Still can do a tox -e ...10:25
quiquell|roverto enforce it10:25
ssbarnea|bkpyep, feel free too read https://medium.com/@sbarnea/embracing-pre-commit-hooks-4ef1f4e72914 -- should explain it (bit of self promoting own blog)10:26
quiquell|roverautobombo in spanish10:26
quiquell|roverssbarnea|bkp: About https://bugs.launchpad.net/tripleo/+bug/179105310:28
openstackLaunchpad bug 1791053 in tripleo "delorean: Get the non-root user UI fails after user is created" [Undecided,In progress] - Assigned to Sorin Sbarnea (ssbarnea)10:28
quiquell|roverssbarnea|bkp: Maybe it was failing because user was not yet created ? but your review should fix it10:28
quiquell|rovermarios: Can you help with your core powers to close promotion blocker ? https://review.openstack.org/#/c/600407/10:29
ssbarnea|bkpquiquell|rover TBH, I have no idea why, but I can suspect two possible reasons: caching/timing, or lack of permissions as the id command was not run as root.10:29
quiquell|roverssbarnea|bkp: But lack of permissions would be deterministic and it's is not always failing10:30
ssbarnea|bkpon NIS systems I could include NIS, but again, I never seen such error before so is only speculation.10:30
quiquell|roverssbarnea|bkp: Bah doesn't matter your fix is the way to go10:31
*** ykarel is now known as ykarel|session10:31
ssbarnea|bkpit could be another reason, bug in ansible module where it fails to create user, but if we read the result from the module, we will be able to know if it that next time.10:32
mariosquiquell|rover: minor gripe on 'result otherwise lgtm10:40
mariosquiquell|rover: would rather fix that before merging imo https://review.openstack.org/#/c/600407/1/roles/provision/remote/tasks/main.yml@46 ssbarnea|bkp10:40
*** ratailor__ has joined #oooq10:42
*** ratailor_ has quit IRC10:45
ssbarnea|bkpi seen that "RDO Third Party CI" downvote does not prevent a +W and a merge from zuul. Obviously that this does not mean we should ignore its result is just that in special cases, we would want to do it.10:45
quiquell|roverssbarnea|bkp: Let's fix the 'result' naming to make marios happy :-) and progress with the review10:49
ssbarnea|bkpresult is the de-factor variable name in ansible, especially for the short leaved ones (used only in the next step(s)). I use it for convenience.10:52
*** jtomasek has joined #oooq10:53
ssbarnea|bkpstill, making our already few reviewers happy is always a good approach10:53
*** ykarel|session is now known as ykarel11:12
mariosssbarnea|bkp: quiquell|rover ftr i +1 it so it is something that is easily overridable if you find 2 other votes. If you decide to update it then I will feel compelled to also revote to +211:12
mariosssbarnea|bkp: quiquell|rover i.e. no strong push back but personally i would prefer to fix the name before merging11:12
*** udesale has quit IRC11:16
ssbarnea|bkpjiri had some questions regarding chrooted variable, does anyone knows how to execute the code using this execution path?11:21
hubbot1FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-containers-multinode-upgrades-pike-branch, legacy- (1 more message)11:36
*** ratailor__ has quit IRC11:38
*** ratailor has joined #oooq11:38
ssbarnea|bkpjiri was right, i need to rework the patch due to this https://bugs.launchpad.net/tripleo/+bug/1676373 -- bogdan made this https://review.openstack.org/#/c/591770/1 -- and i should not break his work.11:38
openstackLaunchpad bug 1676373 in tripleo "[RFE] Allow users to run oooq from any host OS, from a container" [Wishlist,Fix released] - Assigned to Bogdan Dobrelya (bogdando)11:38
*** ratailor_ has joined #oooq11:41
*** ssbarnea|bkp has quit IRC11:43
*** ratailor has quit IRC11:44
weshaymarios, you hit the virt-customize issue carlos was hitting too?11:56
mariosweshay: i have not which issue (is there a bug?)11:57
mariosweshay: ccamacho ? ^11:57
mariosor another carlos sorry11:57
* weshay looks11:58
ccamachoanother carlos might be :)11:58
mariosccamacho: sorry for noise carlos11:58
ccamachocgoncalves ?11:58
ccamachonp11:58
mariosyah maybe11:58
ccamachocool :)11:58
cgoncalvesI'm the other :)12:00
weshayssbarnea, did you test your patch?12:00
weshayhttps://review.openstack.org/#/c/596428/2/roles/fetch-images/tasks/fetch.yml12:00
weshayit's not going to help12:00
cgoncalvesccamacho, you should stop sending patch sets. I get lots of IRC notifications :)12:01
weshaymarios, ah.. I see you marked the bug as a dupe12:01
mariosweshay: oh yeah, now i know what you're talking about. So sshnaidm was right, the context was missing. However https://bugs.launchpad.net/tripleo/+bug/1788919 was older so it won. I copied the context over to it and marked 1790932 as duplicate12:03
openstackLaunchpad bug 1788919 in tripleo "reproducer fails to resize images when run as non root user" [Medium,In progress] - Assigned to Sorin Sbarnea (ssbarnea)12:03
weshaymarios, ssbarnea even if the file is the non-stack-user I still had issues w/ the command12:04
weshaymarios, ssbarnea the virt-customize playbook in the reproducer is all executed w/ become12:04
mariosweshay: ack can you add a comment on the review then? and i will revote with this info12:04
weshaymarios, ssbarnea so it should be infact root12:04
weshayhowever sudo was not working properly on cgoncalves box, however the same reproducer script worked on mine12:05
weshayvery odd12:05
weshaymarios, which brings me back to.. ssbarnea I'd like to get on the virthost where we're seeing this issue12:05
cgoncalvescentos 7.5 (I even reinstalled it and got same result), reproducer ran with venv12:06
ssbarneasure, will change it in 20mins, after finishing lunch. finding a host to reproduce the “id” bug would be interesting12:06
cgoncalvesI can tmate you up in to my box :)12:06
ccamachocgoncalves I think you are speaking about BZ notifications, right?12:07
ccamachoxD the thing is that we have more than 150 BZs xD12:07
cgoncalvesccamacho, no, IRC notifications. I have 'carlos' configured on my IRC client as keyword to highlight12:07
ccamachoxD12:08
*** trown|outtypewww is now known as trown12:15
weshaycgoncalves, ya.. I think I need to reinstall as well12:18
*** jtomasek has quit IRC12:20
*** rlandy has joined #oooq12:40
*** gkadam_ has quit IRC12:50
rlandyweshay: I'm going to start rechecking https://review.openstack.org/#/c/596422/ and dependent patches so we can merge - do you have any review comment to change in the mean time?12:50
rlandymarios: hi - we ditched the THT changes. Too involved atm12:55
*** skramaja has quit IRC12:56
* weshay looks12:56
*** toure has joined #oooq12:59
*** ssbarnea|bkp has joined #oooq12:59
*** ssbarnea|bkp has quit IRC12:59
mariosrlandy: yeah i saw there was a stable/rocky cherrypick at some point but then both were abandoned. i did wondewr what hppened12:59
weshayquiquell|rover, can you look at a dns issue that toure is hitting please12:59
*** ssbarnea|bkp has joined #oooq13:00
weshayrlandy, this looks perfect https://review.openstack.org/#/c/596422/36/playbooks/mock-etc-nodepool/pre.yaml13:00
ssbarnea|bkpi ended up creating new CR for the uid fix as I am not sure become is enough, https://review.openstack.org/#/c/600730/113:00
ssbarnea|bkpi will abandon the other one if this one works.13:00
rlandymarios: when we moved the parameter definitions from puppet/role.role.j2.yaml, undercloud install failed13:01
toureI would like to set a custom nameserve from the cli I past the -e "customer_nameserver=<internal ip>" but this is still not getting set on the undercloud13:01
tourequiquell|rover^13:01
rlandyweshay: just rechecking to get through zuul - then checking merge order13:01
rlandyI think we are safe to merge depends-on patches as they pass in their own right13:02
* rlandy checks reproducer13:02
quiquell|roverweshay, toure: sure13:03
tourequiquell|rover is that the correct method for configuring the /etc/resolv.conf on the undercloud?13:04
quiquell|rovertoure: Let me check13:05
tourethanks13:05
quiquell|rovertoure: -e "custom_nameserver=..."13:06
quiquell|rovernot customer13:06
quiquell|roverAlso I think it has to be a list13:06
toureso what format should that take, ie -e "custom_nameserver=1.1.1.1,2.2.2.2" or -e "custom_nameserver='1.1.1.1,2.2.2.2'"13:08
toureyeah customer was a typo13:08
toure:)13:08
quiquell|rovertoure: '[1.1.1.1,2.2.2.2]' should do the trick13:09
quiquell|rovertoure: also you can use a file and use -e @myawesomednssevers.yaml13:10
*** agopi has quit IRC13:10
tourequiquell|rover cool thanks let me give that a try13:10
quiquell|rovertoure: Let me know if you have still issues13:11
*** myoung has joined #oooq13:13
tourewill do13:14
ssbarneaa big FU to mozilla for their DNS messing, i was hit few minutes ago when FF stopped working 100% due to it, even the way they hidden the mode 5 is kinda dirty. As soon I activated it problem was sorted.13:16
rlandyhmmm ...13:18
*** ratailor_ has quit IRC13:18
*** gkadam has joined #oooq13:19
rlandyweshay: we need a few changes to secure these reviews ... primary node needs to be added https://review.openstack.org/#/c/596887/11/roles/tripleo-inventory/tasks/inventory.yml13:27
rlandy^^ go first13:27
ssbarnea4 solutii listate13:28
ssbarneapresupun ca dc vrei un feature implementat, ar trebui sa existe un bug la https://issues.jboss.org13:29
quiquell|roverssbarnea: wrong chat ? :-)13:29
ssbarneahaha.13:29
quiquell|roverI can of understand it tough :-)13:30
*** agopi has joined #oooq13:30
ssbarneaquiquell|rover: a friend asked me on hot to get a feature implemented in jboss,... mainly telling him to look at the issue tracker.13:30
hubbot1FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-containers-multinode-upgrades-pike-branch, legacy- (1 more message)13:36
*** jtomasek has joined #oooq13:42
rlandyweshay: need your input on https://review.openstack.org/#/c/596887/11/roles/tripleo-inventory/tasks/inventory.yml13:44
rlandyI had this discussion with panda13:44
rlandyI told him I though primary_node was missing here13:45
weshayrlandy, k.. /me looks13:45
rlandyhe said we should just add an alias to the undercloud13:45
weshayin a minute.. talking to matbu13:45
rlandyyour thoughts?13:45
ssbarneaquiquell|rover: regarding the timeout removal patch, which fails with timeout.... on tripleo-ci-centos-7-containerized-undercloud-upgrades ... any chance (or tricks?) to make it happen?13:46
*** gkadam has quit IRC13:47
ssbarneai seen multiple times (3+) timeout on "validate-tempest : Generate XML results file", not sure if this only because other things were slow before, but the result is the same, a "-V" and the need to run again and again.13:48
quiquell|roverssbarnea: What you mean make it happen ?13:49
ssbarnea|bkpmerge13:49
ssbarnea|bkpand second to find a solution to avoid these timeouts, they almost become the norm/rule, not the exception.13:50
ssbarnea|bkpquiquell|rover help wes with that 1mo old review, https://review.openstack.org/580361 -- i see no reason for not having it merged.13:52
quiquell|roverssbarnea|bkp: Let's do some #tripleo propaganda13:53
ssbarnea|bkpi was planning to do exactly that, pinging (annoying) people to do reviews. that's my goal for today.13:55
ssbarnea|bkpon this one is simple, you have both +2 V and +W permissions, so it should be ok.13:55
*** chem has joined #oooq13:55
rlandyweshay: when you are done ... adding something like https://paste.fedoraproject.org/paste/kk7v9RPpfaXvMHaWQn97Bg... I thought we had already added the primary node :(13:58
ssbarnea|bkptrown https://review.openstack.org/580361 - looks safe to +W to me, thanks.13:59
weshayrlandy, that's interesting14:05
weshayre: https://paste.fedoraproject.org/paste/kk7v9RPpfaXvMHaWQn97Bg14:05
rlandyweshay: he's done this to protect deployed server14:05
rlandyhttps://review.openstack.org/#/c/596906/13/roles/overcloud-deploy/tasks/deployed-server.yml14:05
rlandywould have to duplicate that in vxlan networking14:05
rlandyhttps://review.openstack.org/#/c/596906/13/roles/undercloud-setup/templates/vxlan_networking.sh.j214:07
rlandy^^ will fail14:07
rlandyatm14:07
rlandyadding patch14:07
*** quiquell|rover has quit IRC14:08
rlandyweshay: this should be safe now https://review.openstack.org/#/c/596906/14:09
rlandya lot if duplication but we can get rid of it altogether when legacy is gone14:09
rlandyweshay: wrt inventory, it's incomplete atm as I see it - we either need the alias or a whole new add_host from primary_node file14:10
* rlandy need to get merging today so these patches need to be complete14:10
weshayrfolco, marios can you two work w/ rlandy today as much as possible?14:11
weshayrfolco, marios we need to converge on this work and bring it to closure14:12
rlandyrfolco: ^^ pls see my comment above about inventory and primary node14:12
rlandyI made a change to https://review.openstack.org/#/c/596906/14:13
rlandywatching to see legacy multinode there14:13
rlandyneed review on all depends-on patches pls14:13
*** holser_ has quit IRC14:22
*** holser__ has joined #oooq14:22
weshayrfolco, marios rlandy I have reviewed https://review.openstack.org/#/c/596422/14:23
weshayrfolco, marios rlandy I'm not 100% sure I completely understand your latest comments rlandy w/ regards to having to do an add_host14:24
weshayetc14:24
weshayrlandy, is there a failed job log14:24
weshaythat indicates that is an issue14:24
rlandyweshay: looking at your comments now14:27
*** sanjayu_ has joined #oooq14:27
rlandyweshay: wrt adding host ... https://review.openstack.org/#/c/596887/11/roles/tripleo-inventory/tasks/inventory.yml - never adds the primary node14:29
rlandy^^ see that?14:29
rlandyI added a patch at one point to do that and panda objected14:29
rlandysaying an alias is better14:30
rlandynow I see neither has been added14:30
rlandywe need one or the other14:30
weshayrfolco, can you update this https://review.openstack.org/#/c/596887/1114:35
weshaybased on my comment14:35
weshayrlandy, ok.. so can we just add that to rfolco's change?14:35
rlandyweshay: ack - with your comment - we need to add primary node pls14:37
rlandyrfolco: ^^14:37
rlandywhen you are updating14:37
weshayrfolco, marios where are you guys????14:37
mariosweshay: sorry was afk for a bit looking now14:38
weshayssbarnea|bkp, you there?14:38
mariosweshay: wrt https://review.openstack.org/#/c/596422/ what is the question? are we looking to rework the tripleo heat templates patch rlandy ?14:39
mariosweshay: ididn't make comments about that 17:24 < weshay> rfolco, marios rlandy I'm not 100% sure I completely understand your latest comments rlandy w/ regards to having to do an add_host14:39
rlandymarios: we are ditching the THT work for now14:39
rlandysee mock-etc-nodepool role added14:39
mariosrlandy: k sorry i thought weshay was referring to my comments there perhaps but seems not then14:40
ssbarnea|bkpweshay : yep, I am.14:40
mariosrlandy: rfolco let me know how i can help re 17:11 < weshay> rfolco, marios can you two work w/ rlandy today as much as possible?14:41
weshayssbarnea|bkp, https://review.openstack.org/#/c/600546/1/zuul.d/base.yaml14:42
weshaymarios, rfolco rlandy I need all eyes on these patches14:42
weshaythat rlandy is working through14:42
weshaydon't work on anything else until they merge14:43
mariosweshay: ack14:43
weshayssbarnea|bkp, today is your last day as a single man employed by RH right?14:43
ssbarneaweshay: not really, we sign the contract on Tuesday.14:44
weshayssbarnea, so you hit the libvirt reproducer error?14:45
rlandyhttps://review.openstack.org/#/c/596422/ updated14:45
rlandyweshay: ^^14:45
weshayrlandy, +114:46
ssbarnea|bkpweshay nope, I did nothing on that direction. But I wasted time doing something very similar to your change: https://review.openstack.org/#/c/600791/14:46
weshayssbarnea|bkp, ya..14:47
weshayssbarnea|bkp, sorry for being dense14:47
weshayhow many days left before your pto?14:47
rlandyssbarnea|bkp: hi - looking at your comments in https://review.openstack.org/#/c/596906/14/roles/undercloud-setup/templates/vxlan_networking.sh.j214:47
*** dtrainor has joined #oooq14:48
ssbarnea|bkprlandy : is not that your code would not work, but it could be shortened considerably. if time pressured, feel free to ignore the comment.14:48
rlandyyeah - style comments14:48
ssbarnea|bkpyou can use the link wes posted yesterday to test jinja code.14:49
rlandyssbarnea|bkp: https://review.openstack.org/#/c/596906/14/roles/overcloud-deploy/tasks/deployed-server.yml - I vaguely remember we had issues with14:49
rlandythe other one I can change14:49
rlandyweshay: can we skip 1-on-1? too much work to do atm14:50
rlandywe speak all the time :)14:51
ssbarneaweshay: my PTO starts in ~2h  from now and will the entire next week, i may be online during the weekends, trying to finish few things (or to avoid working on preparatory work).14:52
rlandyssbarnea: congrats - send us a photo14:52
rlandyrfolco: any objection to my changing https://review.openstack.org/#/c/596906/14/roles/undercloud-setup/templates/vxlan_networking.sh.j2 per ssbarnea's comment?14:53
mariosssbarnea: nice have fun :) get drunk!14:53
weshayssbarnea, ah.. that's what I thought :)14:53
weshayk k14:53
marios(it helps)14:53
weshaymarios, lolz14:53
*** apetrich_ has quit IRC14:58
weshayrlandy, what else can I do to assist?15:00
weshayrun locally, keep reviewing?15:00
*** gkadam has joined #oooq15:01
ssbarnea~10years ago, I made myself a rule not to merge anything when late && drunk, again ;)15:02
* weshay needs to reload a centos box15:03
*** holser__ has quit IRC15:03
rlandyweshay: um .. https://review.rdoproject.org/r/#/c/16013/15:03
rlandythat ok?15:03
rlandyjust making changes per ssbarnea's comments15:04
*** holser_ has joined #oooq15:04
weshayrlandy, s/tmp/etc15:04
*** d0ugal has quit IRC15:04
rlandyweshay: ?15:05
weshayrlandy, bleu?15:05
weshaysock rey bleu15:05
rlandyin one sec - commit a change15:06
rlandywhatever - joining15:07
rlandyweshay: you wanted to meet?15:08
weshayrlandy, joining15:10
weshaymarios, rfolco ^15:10
*** chem` has joined #oooq15:13
weshayrfolco, marios your response rate on irc is troubling15:13
mariosweshay: its 1814 here, you pinged 4 mins ago. sorry about that? joining your bg?15:14
weshaymarios, k .. move your nick to away please.. I'm just trying to ensure we're supporting each other15:15
*** ykarel is now known as ykarel|away15:15
*** chem has quit IRC15:16
*** jtomasek has quit IRC15:17
*** chem` has quit IRC15:23
*** d0ugal has joined #oooq15:26
*** gkadam has quit IRC15:26
weshayrfolco, ?15:31
mariosweshay: k :) np15:32
rlandyweshay: lastly for the inventory - did we decide on adding the alias or the whole new host like subnodes15:35
rlandydoing that edit now15:35
hubbot1FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-containers-multinode-upgrades-pike-branch, legacy- (1 more message)15:36
*** ssbarnea|bkp has quit IRC15:43
*** ykarel|away has quit IRC15:46
rlandyweshay: rfolco: https://review.openstack.org/#/c/596887/ updated15:51
*** dtantsur is now known as dtantsur|afk15:54
*** holser_ has quit IRC16:14
*** ssbarnea|bkp has joined #oooq16:23
*** ykarel has joined #oooq16:40
*** dtrainor_ has joined #oooq16:41
*** dtrainor has quit IRC16:45
rlandy2018-09-07 16:36:54.152137 | tripleo-ovb-centos-7 | fatal: unable to access 'https://review.rdoproject.org/r/p/rdo-infra/ci-config.git/': Failed connect to review.rdoproject.org:443; No route to host16:50
rlandy^^ anyone see that going on?16:50
*** sanjayu_ has quit IRC16:57
*** jfrancoa has quit IRC16:58
*** myoung is now known as myoung|dr16:59
*** saneax has joined #oooq17:03
weshayrlandy, jebus17:06
weshayrlandy, where are you seeing that?17:06
rlandyweshay: which disaster?17:08
rlandywe have a wealth of them to choose from17:09
weshay018-09-07 16:36:54.152137 | tripleo-ovb-centos-7 | fatal: unable to access 'https://review.rdoproject.org/r/p/rdo-infra/ci-config.git/': Failed connect to review.rdoproject.org:443; No route to host17:09
*** trown is now known as trown|lunch17:09
rlandyoh that - pasted above17:09
rlandyI saw that in one job17:10
* rlandy gets17:10
rlandyweshay: don;t see it now - will keep watching17:10
*** sanjayu_ has joined #oooq17:11
*** saneax has quit IRC17:11
rlandyarxcruz: hi there!!!17:12
arxcruzrlandy: hi17:12
rlandygot a rhos-13 tempest build issue going down ...17:12
rlandyseen this: https://thirdparty.logs.rdoproject.org/jenkins-tripleo-quickstart-rhos-13-passed-p2-baremetal-hp_dl360_envE-single_nic_vlans-2/tempest.html?17:13
rlandytempest.exceptions.BuildErrorException: Server 5e7c244e-c000-4987-9807-f41251b6d7d8 failed to build and is in ERROR status17:13
rlandyDetails: {u'message': u'Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 5e7c244e-c000-4987-9807-f41251b6d7d8.', u'code': 500, u'created': u'2018-09-06T23:39:33Z'}17:13
arxcruzrlandy: it can be concurrency issues17:14
arxcruzor the compute node wen't down17:14
arxcruzrlandy: however, it was only one test17:15
arxcruzlet me check compute node17:15
rlandyarxcruz: workers was set to 417:15
rlandyshould that be less?17:15
arxcruzrlandy: doesn't matter, it was one single test, should not have problem with concurrency17:15
rlandyarxcruz: I only see it on rhos-13 job17:16
* rlandy gets config17:16
rlandyhttp://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/config/release/rhos-13.yml17:16
rlandyused with17:16
arxcruzrlandy: https://thirdparty.logs.rdoproject.org/jenkins-tripleo-quickstart-rhos-13-passed-p2-baremetal-hp_dl360_envE-single_nic_vlans-2/overcloud-compute-0/var/log/containers/nova/nova-compute.log.txt.gz#_2018-09-06_23_39_32_39017:16
rlandyhmmm17:17
rlandyselinux?17:17
arxcruzrlandy: permission denied to execute qemu-kvm17:17
arxcruzrlandy: is this qemu-kvm inside the container ? maybe miss configuration17:18
rlandyhttps://bugzilla.redhat.com/show_bug.cgi?id=149490717:18
openstackbugzilla.redhat.com bug 1494907 in openstack-selinux "Unable to launch nova instance: Instance failed to spawn: libvirtError: internal error: process exited while connecting to monitor: libvirt: error : cannot execute binary /usr/libexec/qemu-kvm: Permission denied" [High,Closed: errata] - Assigned to lhh17:18
rlandylooking at comments there17:18
ykarelweshay, hi, considering master promotion without fs037?17:18
ykarelweshay, other jobs are passing: https://trunk.rdoproject.org/api-centos-master-uc/api/civotes_detail.html?commit_hash=0d5b1d18e88ad27e87368c8844c325cbfe603fdb&distro_hash=e25bec61de5862f347a86f7cdb3cef75ba0b36ee17:18
weshayykarel, certainly17:19
* weshay looks17:19
arxcruzrlandy: seems to be selinux indeed17:19
rlandycharming17:19
*** tesseract has quit IRC17:20
weshayykarel, incoming change17:21
rlandyhttp://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/config/release/rhos-13.yml#n5017:21
rlandyarxcruz" ^^17:21
rlandywe are using enforcing17:21
rlandyweshay:  is selinux enforcing a requirement for rhel/osp testing?17:22
ykarelweshay, ack17:22
weshayykarel, https://review.rdoproject.org/r/1618917:22
weshayrlandy, osp ya17:22
weshayrlandy, why?17:23
weshayrlandy, does it work in permossive but not enforcing17:23
weshay?17:23
rlandyweshay: failing tempest on bm17:23
arxcruzrlandy: https://bugzilla.redhat.com/show_bug.cgi?id=1494907#c1517:23
openstackbugzilla.redhat.com bug 1494907 in openstack-selinux "Unable to launch nova instance: Instance failed to spawn: libvirtError: internal error: process exited while connecting to monitor: libvirt: error : cannot execute binary /usr/libexec/qemu-kvm: Permission denied" [High,Closed: errata] - Assigned to lhh17:23
arxcruznot exactly selinux, but something in selinux that change a directory17:24
*** jtomasek has joined #oooq17:24
* rlandy checks17:24
*** ssbarnea|bkp2 has joined #oooq17:25
rlandyugh - box got reconfigured17:25
rlandywill try again when I can get time on the box17:25
rlandyother than that rhos-13 on bm is a go17:25
*** ssbarnea|bkp has quit IRC17:26
dtrainor_rlandy, fwiw i ran a reproducer for an unrelated job and saw no issues with review.rdoproject.org:443 from rdocloud17:27
*** dtrainor_ is now known as dtrainor17:27
*** ykarel is now known as ykarel|away17:33
hubbot1FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-containers-multinode-upgrades-pike-branch, legacy- (1 more message)17:36
*** ykarel|away has quit IRC17:46
*** dsneddon has joined #oooq17:50
*** sanjayu_ has quit IRC17:57
*** saneax has joined #oooq17:58
*** saneax has quit IRC17:59
*** saneax has joined #oooq18:03
*** jaganathan has quit IRC18:03
*** saneax has quit IRC18:08
rlandyERROR! Unable to retrieve file contents18:08
rlandyCould not find or access '/tmp/deployed_nodes.yml'18:08
rlandy^^ ok - we broke the reproducer18:09
*** trown|lunch is now known as trown18:09
rlandyweshay: ^^ - fixing18:10
weshayrlandy, I have a patch too18:14
weshayrlandy, /me was trying on a clean box18:14
weshayrlandy, https://review.openstack.org/#/c/600836/18:15
rlandyweshay: ok - if your patch is ready, I can  review that - rather than dup18:15
weshayrlandy, it's unrelated to yours18:15
weshaybut still needs review18:15
rlandyweshay: one comment - otherwise looks good18:17
*** dtrainor_ has joined #oooq18:33
*** dtrainor has quit IRC18:35
*** ykarel|away has joined #oooq18:55
*** ykarel|away has quit IRC19:00
rlandytesting fix for reproducer19:11
*** jbadiapa has quit IRC19:36
hubbot1FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo- (2 more messages)19:36
*** agopi is now known as agopi|off20:14
*** agopi|off has quit IRC20:19
rlandyweshay: one more https://review.openstack.org/#/c/600860/20:24
weshayrlandy, k20:24
*** trown is now known as trown|outtypewww20:32
weshayah.. rfolco has carnival20:36
*** jtomasek has quit IRC20:36
rlandywe got a zuul +1 on https://review.openstack.org/#/c/59642220:54
*** jtomasek has joined #oooq20:59
*** holser_ has joined #oooq21:17
rlandyweshay: hi21:18
weshayrlandy, hey21:18
weshayrlandy, I think we are supposed to run as root w/ repro21:19
weshaymeh21:19
rlandyweshay: anything I should do/send for the team for bext week while I ma out?21:19
rlandyI am testing the reproducer change21:19
*** ssbarnea|bkp2 has quit IRC21:19
rlandylooks to be working on multinode21:19
rlandyI need to check ovb21:19
weshayrlandy, please just update the card w/ what your next steps would be21:20
rlandyk - basically get the patches through gatess21:20
weshayk21:20
rlandyI'll be on line some time on sunday21:20
rlandycard is updated21:34
*** holser_ has quit IRC21:35
hubbot1FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-containers- (2 more messages)21:36
*** tosky has quit IRC21:40
rlandyhttps://review.openstack.org/#/c/596422/ - pretty clean21:40
*** myoung|dr is now known as myoung21:49
*** agopi|off has joined #oooq21:52
*** jtomasek has quit IRC21:58
*** rfolco has quit IRC22:15
*** saneax has joined #oooq22:17
*** saneax has quit IRC22:22
*** rlandy has quit IRC22:55
hubbot1FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-containers- (2 more messages)23:36

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!