| *** hamzy has quit IRC | 00:01 | |
| *** hamzy has joined #oooq | 00:14 | |
| *** apetrich has quit IRC | 01:28 | |
| *** skramaja has joined #oooq | 03:21 | |
| *** ykarel has joined #oooq | 03:24 | |
| *** jrist has joined #oooq | 03:31 | |
| *** ykarel has quit IRC | 03:37 | |
| *** skramaja_ has joined #oooq | 03:49 | |
| *** ykarel has joined #oooq | 03:51 | |
| *** skramaja has quit IRC | 03:52 | |
| *** ykarel has quit IRC | 04:08 | |
| *** udesale has joined #oooq | 04:12 | |
| *** agopi has quit IRC | 04:35 | |
| *** ykarel has joined #oooq | 04:37 | |
| *** quiquell has joined #oooq | 05:57 | |
| quiquell | sshnaidm: Good morning | 05:57 |
|---|---|---|
| *** jfrancoa has joined #oooq | 06:02 | |
| *** jfrancoa has quit IRC | 06:06 | |
| *** jfrancoa has joined #oooq | 06:08 | |
| *** jfrancoa has quit IRC | 06:09 | |
| *** agopi has joined #oooq | 06:10 | |
| *** jfrancoa has joined #oooq | 06:17 | |
| *** kopecmartin has joined #oooq | 06:33 | |
| *** apetrich has joined #oooq | 06:59 | |
| *** quiquell has quit IRC | 07:24 | |
| *** quiquell has joined #oooq | 07:25 | |
| *** dtantsur|afk is now known as dtantsur | 07:26 | |
| ssbarnea | mornign everyone! | 07:26 |
| quiquell | ssbarnea: o/ | 07:27 |
| *** ccamacho has joined #oooq | 07:30 | |
| *** holser_ has joined #oooq | 07:33 | |
| ssbarnea | quiquell: https://review.openstack.org/#/c/596428/ should be an easy review for the morning. | 07:33 |
| quiquell | ssbarnea: ack | 07:34 |
| ssbarnea | also this one is waiting for a +W https://review.openstack.org/#/c/571176/ | 07:35 |
| ssbarnea | a promotion-blocker fix also ready to get merged https://review.openstack.org/#/c/599088/ -- ignore unrelated rdo failure, i think is should get the workflow too. | 07:39 |
| *** ykarel is now known as ykarel|lunch | 07:40 | |
| *** apetrich has quit IRC | 07:41 | |
| *** tosky has joined #oooq | 07:41 | |
| sshnaidm | quiquell, hello | 07:42 |
| quiquell | sshnaidm: I checkout the refactoring of timeout review, and I have some concerns, don't know if they have sense | 07:43 |
| quiquell | sshnaidm: Do you have a minute ? is regarding this https://review.openstack.org/#/c/589068/ | 07:44 |
| sshnaidm | quiquell, sure | 07:44 |
| sshnaidm | quiquell, which periodic stuff do you mean? | 07:46 |
| quiquell | sshnaidm: The stuff that is not going to run if zuul's timeout kicks in is | 07:49 |
| quiquell | https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-ci/templates/toci_quickstart.sh.j2#L183 | 07:49 |
| quiquell | This range https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-ci/templates/toci_quickstart.sh.j2#L179-L192 | 07:50 |
| quiquell | If we want to remove timeout we have to do this in the post | 07:50 |
| quiquell | And it' depends on $exit_value | 07:50 |
| quiquell | Have already talk about this with panda|rover | 07:50 |
| quiquell | That's why I didn't remove it | 07:51 |
| quiquell | (I really did want to) | 07:51 |
| sshnaidm | quiquell, lines 179-181 should be in logs collect script, lines 189-190 as well | 07:53 |
| sshnaidm | quiquell, I don't think this periodic stuff (lines 183-187) is used anywhere, iirc it's just for our debug.. but need to check | 07:54 |
| quiquell | sshnaidm: ack, going to move them to the collect script | 07:55 |
| quiquell | sshnaidm: And the periodic maybe we can remove it, and go back to it when we port periodic jobs to zuulv3 | 07:55 |
| quiquell | sshnaidm: I mean new workflow | 07:55 |
| sshnaidm | quiquell, currently I don't find where we use JOB_EXIT_VALUE at all, maybe it could be even removed | 08:00 |
| sshnaidm | quiquell, (and if it breaks, we'll know where it's used) | 08:00 |
| quiquell | sshnaidm: I think it's related to DLRN info | 08:01 |
| quiquell | sshnaidm: To publish job's result at DLRN... | 08:01 |
| quiquell | sshnaidm: maybe zuulv3 give us the run phase result | 08:01 |
| sshnaidm | quiquell, we use "$SUCCESS" for that https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/legacy-tripleo-ci-periodic-base/post.yaml#L11 | 08:01 |
| quiquell | sshnaidm: Yep I don't find it either, let's just remove it. | 08:03 |
| quiquell | sshnaidm: Maybe we can also remove this https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-ci/templates/toci_quickstart.sh.j2#L167-L172 ? | 08:04 |
| quiquell | When we move OVB to the new workflow collect logs will be executed at post | 08:05 |
| quiquell | wdy ? | 08:05 |
| sshnaidm | quiquell, yeah, but let's firstly finish with it and then we'll move OVB to post.. | 08:08 |
| sshnaidm | quiquell, I wouldn't make all in one patch.. | 08:08 |
| quiquell | sshnaidm: Ok, will cleanup the periodic thing, and move the dns cache stuff | 08:09 |
| sshnaidm | quiquell, hmm.. actually seems like ovb does it in post already | 08:10 |
| quiquell | sshnaidm: So we were doing it twice ? | 08:10 |
| sshnaidm | quiquell, need to check, let's leave it for now | 08:11 |
| quiquell | sshnaidm: Ahh we were moving the script so it doesn't execute at post | 08:11 |
| quiquell | sshnaidm: We are not using this for OVB so let's clean this, and fix collect logs at post for OVB | 08:11 |
| quiquell | when we move OVB to the new workflow | 08:11 |
| quiquell | so we move forward | 08:12 |
| quiquell | what do you think ? | 08:12 |
| sshnaidm | quiquell, agree | 08:12 |
| sshnaidm | marios|rover, wrt https://review.openstack.org/#/c/599201/ - it doesn't change any way we test oooq and extras, AT ALL | 08:13 |
| quiquell | ok | 08:13 |
| *** apetrich has joined #oooq | 08:13 | |
| marios | sshnaidm: but it could affect the reproducer you generate right? ssbarnea correct me if i'm wrong | 08:13 |
| marios | sshnaidm: no it doesn't change how we test wrt jobs/since we don't run reproducer in any job | 08:14 |
| marios | sshnaidm: but we do generate it | 08:14 |
| sshnaidm | marios|rover, we clone changes to oooq and extras here: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/nodepool-setup/tasks/clone-ci-repos.yml#L24 | 08:14 |
| sshnaidm | marios, we generate it in create_reproducer role, how is it related?? | 08:15 |
| marios | sshnaidm: so you are saying this https://review.openstack.org/#/c/582963/ is completely unnecesary | 08:15 |
| marios | sshnaidm: i.e. what was the problem ssbarnea was solving with that | 08:15 |
| sshnaidm | folks, please take a look at reproducer code more closely, just go step by step to learn how it works | 08:15 |
| marios | sshnaidm: if we are already applying the changes | 08:15 |
| marios | sshnaidm: i am trying to learn here too | 08:16 |
| sshnaidm | marios, it didn't solve anything, because nothing was to solve | 08:16 |
| marios | sshnaidm: ok, then why don't you write as much on the revert instead of 'we sholdn't do it because its bad imo' which is what it currently sounds like | 08:16 |
| marios | sshnaidm: so you're saying that the changes to oooq/extras are already included , even if they are to reproducer generation , and so https://review.openstack.org/#/c/582963/ is completely redundant and we should revert it with https://review.openstack.org/#/c/599201/ | 08:17 |
| sshnaidm | marios, it may be only useful when your patch in extras change the reproducer script itself and you want to test them on live | 08:18 |
| sshnaidm | marios, in this case it's possible just to add one line to reproducer after cloning extras | 08:19 |
| marios | sshnaidm: k, am gonna copy/paste this stuff into the review ^^^ as extra info, and lets discuss on the community call this afternoon if you're around? | 08:19 |
| marios | with ssbarnea and anyone else interested | 08:19 |
| marios | sshnaidm: thanks for the info | 08:19 |
| *** chem has quit IRC | 08:19 | |
| sshnaidm | marios, the worst case that currently it broke reproducer, so it's pretty urgent | 08:20 |
| marios | sshnaidm: well thats the other thing i wrote there | 08:20 |
| marios | sshnaidm: i.e. unless its a bug | 08:20 |
| marios | sshnaidm: so file the bug i think since it is urgent? | 08:20 |
| ssbarnea | if you read comments from https://review.openstack.org/#/c/582963/ it would be easy to understand why it was needed in the first place. wes also confirmed that before doing it user would have to manually cherry pick zull changes in local repo to be able to run reproducer in the same conditions as the job. | 08:21 |
| marios | sshnaidm: it would increase reviews at least | 08:21 |
| sshnaidm | marios, I also want to reproduce jobs in some time | 08:21 |
| marios | sshnaidm: so yeah if it broke reproducer lets revert it and ssbarnea can fix it before remerging | 08:21 |
| marios | sshnaidm: but imo we need a bug for that | 08:21 |
| *** chem has joined #oooq | 08:21 | |
| ssbarnea | marios: the problem is that I don't see wat is broken. | 08:21 |
| sshnaidm | marios, breaking reproducer for me it's kind of critical, ssbarnea can resubmit his original patch and we'll discuss it on one of team meetings | 08:22 |
| marios | ssbarnea: well that is what the bug will explain | 08:22 |
| marios | sshnaidm: agree but lets at least point to how it broke so we can merge the revert today (please bug with pointer/trace?) | 08:22 |
| ssbarnea | my impression is that we have different expectations regarding the "subject" of the reproducer. I do see it as a "build reproducer" and sshnaidm is seeing it as a "job runner". (the different between build and job being crucial, as build is an instance of a job, one with specific parameters (CRs being the most important ones)). If you just want to run a "job" you have some expectations, if you want to run the same build, you do have other | 08:27 |
| ssbarnea | expections. Anyway, having a bug it would be great as we can post all these on it an have tracebility. | 08:27 |
| sshnaidm | ssbarnea, you didn't understand me and you don't understand how reproducer works | 08:30 |
| quiquell | sshnaidm: Do this https://review.openstack.org/#/c/599088/1 depends on this https://review.openstack.org/#/c/595527/? | 08:35 |
| quiquell | damn... I mean ssbarnea | 08:35 |
| quiquell | ssbarnea: Do this https://review.openstack.org/#/c/599088/1 depends on this https://review.openstack.org/#/c/595527/? | 08:36 |
| ssbarnea | i don't think so | 08:40 |
| *** d0ugal has quit IRC | 08:43 | |
| *** ykarel|lunch is now known as ykarel | 08:45 | |
| sshnaidm | ssbarnea, marios do you know that OVB jobs are broken? | 08:55 |
| marios | sshnaidm: no i did not know that is it from this morning? | 09:03 |
| *** d0ugal has joined #oooq | 09:03 | |
| marios | quiquell: i just updated https://review.openstack.org/595527 ykarel please when you get a chance | 09:03 |
| marios | quiquell: if you agree lets try and merge it today | 09:04 |
| marios | quiquell: the queens and ocata check jobs have been timeout for this since before i left! | 09:04 |
| sshnaidm | marios, https://logs.rdoproject.org/67/599267/2/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/a1884f2/logs/undercloud/home/zuul/repo_setup.log.txt.gz | 09:04 |
| marios | !! | 09:04 |
| openstack | marios: Error: "!" is not a valid command. | 09:04 |
| marios | thanks openstack | 09:04 |
| ykarel | marios, why master/rocky ? i guess config-download is used there all places | 09:05 |
| marios | sshnaidm: actually yeah i saw that earlier this morning | 09:05 |
| marios | i mean 2018-09-03 09:17:43.173965 | primary | TASK [repo-setup : Setup repos on live host] *********************************** | 09:05 |
| marios | 2018-09-03 09:17:43.192326 | primary | Monday 03 September 2018 09:17:43 +0000 (0:00:00.080) 0:00:12.555 ****** | 09:05 |
| sshnaidm | marios, do you have a running host now on rdocloud? | 09:05 |
| marios | 2018-09-03 09:17:44.621980 | primary | fatal: [subnode-2]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} | 09:05 |
| marios | sshnaidm: ack we need a bug for that going to file it | 09:05 |
| marios | sshnaidm: i do not haven't checked my env i was going to wipe them if they are around anyway | 09:06 |
| sshnaidm | marios, yeah, it's because we introduced a new repo, but it doesn't seems that we have a proxy for it in rdo cloud | 09:06 |
| marios | sshnaidm: i was poking earlier because i want to merge https://review.openstack.org/#/c/595527 | 09:06 |
| marios | sshnaidm: and it had fail like the one you are pointing to (iu assume 2018-09-03 09:17:44 | /home/zuul/repo_setup.sh: line 212: NODEPOOL_CBS_CENTOS_PROXY: unbound variable ) | 09:06 |
| marios | is what you mean? ^ | 09:06 |
| sshnaidm | marios, yes | 09:06 |
| ssbarnea | sshnaidm: not all, but this broke them https://review.openstack.org/#/c/598255/1 | 09:07 |
| marios | ssbarnea: do we have bug already? | 09:07 |
| marios | ssbarnea: about to file one | 09:07 |
| ssbarnea | no, we do not, just found it. | 09:07 |
| sshnaidm | ssbarnea, it's code of reproducer at all... please, look carefully | 09:07 |
| marios | ykarel: ah ack ok... i can't vouch without checking that we don't have any featuresets that disable config download there | 09:07 |
| marios | ykarel: but sure if that is 'apparently' the default i can remove from those please comment thanks for your time :) | 09:08 |
| sshnaidm | ssbarnea, you need to separate code of reproducer and code of job, really) | 09:08 |
| marios | ssbarnea: ok | 09:08 |
| sshnaidm | marios, no, this patch is not related | 09:09 |
| sshnaidm | marios, so we need a bug.. | 09:10 |
| marios | sshnaidm: ssbarnea ack filing it now sec | 09:10 |
| ssbarnea | already filled | 09:10 |
| ssbarnea | https://bugs.launchpad.net/tripleo/+bug/1790603 | 09:11 |
| openstack | Launchpad bug 1790603 in tripleo "repo_setup.sh: line 212: NODEPOOL_CBS_CENTOS_PROXY: unbound variable" [Undecided,Triaged] | 09:11 |
| marios | ykarel: actually you're right we really sholdn't need that for master/rocky since they will be using the role which includes the agents | 09:13 |
| marios | ykarel: as per the bug | 09:13 |
| marios | ykarel: i mean https://bugs.launchpad.net/tripleo/+bug/1785067 comment #2 | 09:13 |
| openstack | Launchpad bug 1785067 in tripleo "without bootstrap-subnodes queens/pike/ocata deployment fails for missing os-collect-config" [High,In progress] - Assigned to Marios Andreou (marios-b) | 09:13 |
| ssbarnea | something is weird because i see no place where NODEPOOL_CBS_CENTOS_PROXY is used without fallback for the case where is underfined, still the build has the unbound error. | 09:14 |
| marios | quiquell: going to update https://review.openstack.org/#/c/595527/ | 09:14 |
| ykarel | marios, cool as we are seeing only in older releases so good to change there only | 09:14 |
| marios | ykarel: yes | 09:14 |
| marios | ykarel: doing | 09:14 |
| ykarel | marios, ack | 09:14 |
| quiquell | marios: It's needed for master and rocky ? | 09:14 |
| marios | quiquell: no it is not | 09:14 |
| quiquell | Then we have to remove them from promotion-testing-hash- | 09:15 |
| ykarel | marios, can also skip newton, we don't have promotion job running for those | 09:15 |
| quiquell | ocata/pike/queens are the ones affected at promotion-testing-hash | 09:15 |
| marios | quiquell: yeah we fixed pike but not the promotion hash | 09:16 |
| sshnaidm | ssbarnea, don't you really see that https://review.openstack.org/#/c/598255/ changes reproducer code? | 09:16 |
| marios | quiquell: I mean in the first commit | 09:16 |
| ssbarnea | i fount it. | 09:16 |
| quiquell | marios: Yep, let's fix now the periodic too here | 09:16 |
| marios | quiquell: ykarel so gonna keep all but master rocky agree? | 09:17 |
| ykarel | marios, can remove newton changes as well, and keep ocata/pike/queens | 09:17 |
| marios | ykarel: right i was gonna say no promoition job you said before | 09:18 |
| marios | ykarel: ok | 09:18 |
| quiquell | marios: Also ignore newton | 09:19 |
| marios | quiquell: yes | 09:19 |
| marios | promotion | 09:19 |
| quiquell | marios: As ykarel stated it doesn't have a periodic job | 09:19 |
| marios | quiquell: ykarel thank you see v 4 @ https://review.openstack.org/595527 | 09:20 |
| marios | quiquell: ykarel whenever you next have some time thanks | 09:20 |
| quiquell | marios: Do you know if this https://review.openstack.org/#/c/599088 depends on your change ? | 09:21 |
| ykarel | marios, +1 | 09:21 |
| marios | quiquell: it shouldn't matter | 09:22 |
| ssbarnea | ok, so what happened is that /etc/ci/mirror_info.sh is outdated, not having that inside it. | 09:22 |
| marios | quiquell: i mean if featureset is using config download then mine is redundant at best | 09:22 |
| marios | quiquell: but if it isn't then it needs mine | 09:22 |
| quiquell | marios: The this patch depends on yours, for those featureset that are going to not use config-download | 09:22 |
| quiquell | marios: That's right ? | 09:23 |
| quiquell | marios: +1 | 09:23 |
| marios | quiquell: well yeah , i mean assuming they are hitting the bug like Failed to start os-collect-config.service: Unit not found. on subnode | 09:23 |
| marios | quiquell: like if there is no os-collect-config the heat stack update will be stuck and timout | 09:24 |
| quiquell | marios: All job not using config-download and use ceph are going to hit it ? | 09:24 |
| quiquell | Damn, is review.o.o down ? | 09:24 |
| quiquell | marios, ssbarnea: I have update the review with your comments https://review.openstack.org/#/c/588475/ | 09:29 |
| quiquell | marios, ssbarnea, sshnaidm: ^ | 09:29 |
| marios | quiquell: ack added to next reviews list :) | 09:30 |
| ykarel | marios, i think u need to check other release files(trunk) ones | 09:30 |
| ykarel | those might also be affected, those are generally used by end users | 09:30 |
| quiquell | ykarel: What's the best way to know what releases file matter ? | 09:30 |
| marios | ykarel: ack but i would rather merge this first since it is really killing us on the stats | 09:30 |
| marios | ! | 09:30 |
| marios | :) | 09:30 |
| ykarel | marios, yes agree | 09:31 |
| quiquell | agree | 09:31 |
| quiquell | Let's first fix CI then the real user :-) | 09:31 |
| marios | ykarel: seriously lets fix the ocata/queens | 09:31 |
| marios | quiquell: exactly!" | 09:31 |
| marios | :) | 09:31 |
| ykarel | was just said so we don't let end users suffer, as those files are used by end users | 09:31 |
| ykarel | next PS is ok | 09:31 |
| ykarel | next review | 09:31 |
| ssbarnea | I need some help on the mirror_info.sh bug as I have no idea who is supposed to create/update this file. | 09:33 |
| *** dsneddon has quit IRC | 09:34 | |
| quiquell | ssbarnea: Don't know, ask at #tripleo channel, it has a wider audience | 09:35 |
| ssbarnea | quiquell: sure, tx. | 09:35 |
| quiquell | ssbarnea: #tripleo channel during ruck/rovering is very important | 09:35 |
| quiquell | ssbarnea: also #rdo | 09:35 |
| quiquell | ssbarnea: Also what I usually do is a git blame over related code and ask guys in the logs list | 09:38 |
| quiquell | ssbarnea: Individualized messages have more effect | 09:38 |
| quiquell | This tripleo thing is so massive... | 09:38 |
| quiquell | marios: All the timed out jobs at "noop" are fixed with your stuff ? | 09:41 |
| marios | quiquell: not sure man, at least, they would hit this thing if they don't have os-collect-config installed. if there is then some other issue i don't know | 09:42 |
| marios | we cant say | 09:42 |
| quiquell | pufff a lot of noop is failing a time out... fu... timeout :-/ | 09:43 |
| *** jaosorior has joined #oooq | 09:47 | |
| *** holser_ has quit IRC | 09:48 | |
| quiquell | marios, sshnaidm: "Add another level of parent jobs for zuul v3" https://review.openstack.org/#/c/593063 is good at CI too, let's +2 it | 09:50 |
| sshnaidm | quiquell, done | 09:51 |
| *** holser_ has joined #oooq | 09:52 | |
| sshnaidm | quiquell, let's wait for rlandy to confirm it's what she wants, although I don't see any issues with it | 09:52 |
| quiquell | sshnaidm: sure, just helping moving stuff forward | 09:52 |
| quiquell | sshnaidm: Also "Add a script to compare reviews" https://review.openstack.org/#/c/588475/ is good now | 09:53 |
| quiquell | Puff timed out a lot of jobs... in the bash to ansible commit arggg | 09:54 |
| *** panda|rover has quit IRC | 09:54 | |
| *** saneax has joined #oooq | 09:56 | |
| *** panda has joined #oooq | 09:59 | |
| *** panda has quit IRC | 10:04 | |
| quiquell | rfolco: Have to drop early yesterday so I pushed half backed stuff to the bash to ansible review sorry man :-/ | 10:29 |
| *** dsneddon has joined #oooq | 10:30 | |
| rfolco | quiquell, its ok, thanks for helping. | 10:30 |
| rfolco | quiquell, what a hell is the 'tail' part on https://review.openstack.org/#/c/589068/ ? | 10:31 |
| rfolco | :) | 10:31 |
| rfolco | you made ci sad again | 10:31 |
| quiquell | rfolco: If we remove timeout, there is stuff that it's not executed and have to be move to post | 10:31 |
| quiquell | rfolco: that's the "tail" code | 10:31 |
| quiquell | rfolco: CI broken there ? | 10:32 |
| quiquell | damn | 10:32 |
| quiquell | was looking at other stuff | 10:32 |
| rfolco | quiquell, I don't understand the relation of timeout and that piece of code... | 10:32 |
| rfolco | quiquell, why removing timeout would prevent that to run ? | 10:33 |
| quiquell | rfolco: zuul kill the script | 10:33 |
| quiquell | rfolco: That's why we have an "artifical" timeout smaller than zuul's one | 10:34 |
| quiquell | rfolco: so we kill before zuul kill us and run stuff after it | 10:34 |
| rfolco | quiquell, ok, so that code is part of the run phase | 10:34 |
| quiquell | rfolco: but moving stuff to post, will allow us to continue removing this "artificial" timeout | 10:34 |
| quiquell | rfolco: was part of run, but have move it to collect logs script that run at post | 10:35 |
| quiquell | rfolco: the periodic part is not needed neither the ovb part | 10:35 |
| rfolco | we can cleanup after | 10:36 |
| rfolco | small chunks or we struggle to merge code like the "move bash to ansible" | 10:36 |
| rfolco | becuase its too big | 10:37 |
| rfolco | it was, now its smaller | 10:37 |
| quiquell | just moved and clean | 10:37 |
| quiquell | so we cover the artificial post run | 10:37 |
| rfolco | cool | 10:38 |
| * sshnaidm is listening to song "Release it!" | 10:47 | |
| sshnaidm | looking for songs "Fix it!" and "Deploy it!" | 10:47 |
| quiquell | rfolco: Puff don't understand the issue here http://logs.openstack.org/68/589068/16/check/tripleo-ci-centos-7-scenario008-multinode-oooq-container/efcbf04/job-output.txt.gz#_2018-09-04_08_32_23_981885 | 10:48 |
| quiquell | rfolco: Maybe the new lines that have piping and all are breaking the EOF ? | 10:49 |
| rfolco | sshnaidm, Review it! :) | 10:49 |
| quiquell | rfolco: there is a "while read i" on them | 10:49 |
| sshnaidm | rfolco++ | 10:49 |
| quiquell | rfolco++ | 10:49 |
| quiquell | hubbot-- | 10:50 |
| sshnaidm | hubbot seems not surviving last outage.. | 10:51 |
| rfolco | rip hubbot | 10:51 |
| sshnaidm | he was a hero | 10:52 |
| quiquell | hubbotxx | 10:53 |
| quiquell | rfolco: fixed, heredoc have to ignore special chars | 11:00 |
| quiquell | rfolco: "END" works fine | 11:00 |
| rfolco | quiquell, where is the special char? | 11:01 |
| quiquell | rfolco "<" "|" | 11:03 |
| quiquell | rfolco: It try to do the redirection or piping | 11:03 |
| quiquell | btw I see some "jenkins" stuff in the new workflow execution, I suppose is some legacy from zuul jobs | 11:05 |
| quiquell | Ok create_collect_logs is working now | 11:11 |
| quiquell | marios, ykarel: The config download can be the cause for recent timeouts ? | 11:12 |
| ykarel | quiquell, link for timeouts, which release? | 11:12 |
| quiquell | ykarel: master | 11:13 |
| marios | quiquell: where quiquell there are few different issues afaics some unkown ...i'm currently trying to dig into https://bugs.launchpad.net/tripleo/+bug/1790199 fs035: openstack overcloud deploy returns error code without any signs or error | 11:13 |
| openstack | Launchpad bug 1790199 in tripleo "fs035: openstack overcloud deploy returns error code without any signs or error" [Critical,Triaged] | 11:13 |
| marios | quiquell: which is definitely different to the os-collect-config thing my review addressed | 11:13 |
| marios | quiquell: ah thought the one i'm looking at isnt timeout | 11:14 |
| marios | but anyway quiquell do you have pointer or bug? | 11:14 |
| marios | quiquell: also we can/will find out once alex revert merges? | 11:14 |
| quiquell | marios: Just some executions of sprint review http://logs.openstack.org/48/589448/30/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/48b0a69/ | 11:15 |
| marios | quiquell: hm is that one timing out on the post deploy stuff? looks like deploy was clean exit 0 | 11:17 |
| marios | http://logs.openstack.org/48/589448/30/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/48b0a69/logs/undercloud/home/zuul/overcloud_deploy_post.log.txt.gz | 11:17 |
| marios | quiquell: so anyway not related to my review. might be fixed by the config download revert ? | 11:18 |
| quiquell | marios: timed out at tempest | 11:18 |
| quiquell | http://logs.openstack.org/48/589448/30/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/48b0a69/job-output.txt.gz#_2018-09-04_09_21_13_948389 | 11:18 |
| quiquell | but the problem could be in the time it takes to deploy uc or oc | 11:18 |
| quiquell | And I don't know if the time it takes to deploy them depends on config-download | 11:19 |
| quiquell | (Don't know how config-download works) | 11:19 |
| quiquell | Looks like we are activating it now | 11:19 |
| ykarel | hmm this may be a generic timeout that we are facing in ci from some time | 11:19 |
| quiquell | So maybe that's the cause of problesm | 11:19 |
| quiquell | ykarel: Can it be related to config-download ? | 11:19 |
| sshnaidm | quiquell, we use config-download from rocky | 11:20 |
| sshnaidm | quiquell, it's a default config last release | 11:20 |
| ykarel | quiquell, don't think so, as it's working from quite some time | 11:20 |
| ykarel | yes correct | 11:20 |
| quiquell | Ok | 11:20 |
| sshnaidm | I found strange failure here: http://logs.openstack.org/90/599290/1/gate/tripleo-ci-centos-7-containers-multinode/ace0ab5/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-09-04_10_36_52 | 11:20 |
| sshnaidm | about 1 hour passed and "string indices must be integers" error only | 11:21 |
| sshnaidm | maybe mistral related.. | 11:21 |
| *** udesale has quit IRC | 11:24 | |
| jaosorior | has anybody seen this issue http://paste.openstack.org/show/729395/ ? | 11:33 |
| *** panda has joined #oooq | 11:34 | |
| ssbarnea | sshnaidm: now I finally see the problem, cherry picking fails in your example. that is clearly a breaking bug. i checked and downloading works (git review -d 123). Now the cherry picking fails because of empty commit not because of conflict, so should be fixable. | 11:35 |
| sshnaidm | ssbarnea, the problem is not with specific cherry-pick, but with the fact that you try to cherrypick it at all | 11:35 |
| sshnaidm | ssbarnea, I wrote exactly what's the problem in bullet points. Don't you like bullet points? | 11:36 |
| sshnaidm | ssbarnea, you still don't understand that you mix unmixable things - jobs patches and reproducers code | 11:37 |
| ssbarnea | yeah, l like them. still, I know for sure that we had a case where the tested CR was not used, and cherry picking sorted it. | 11:37 |
| sshnaidm | ssbarnea, was not used - where? | 11:38 |
| ykarel | jaosorior, seems missing repo, shich release u trying | 11:39 |
| jaosorior | ykarel: queens | 11:39 |
| ykarel | jaosorior, mm i can see python2-netaddr: https://trunk.rdoproject.org/centos7-queens/deps/latest/noarch/ | 11:39 |
| sshnaidm | jaosorior, maybe it's python2-netad | 11:40 |
| quiquell | rfolco: Don't know what to do with {{ workspace }}, tripleo-ci doesn't feel like a good place for generated stuff | 11:40 |
| jaosorior | sshnaidm: ...so, where do I try that? | 11:40 |
| ykarel | jaosorior, sshnaidm python-netaddr is provided: https://trunk.rdoproject.org/centos7-queens/deps/latest/noarch/python2-netaddr-0.7.19-5.el7.noarch.rpm | 11:40 |
| ykarel | rpm -qp --provides https://trunk.rdoproject.org/centos7-queens/deps/latest/noarch/python2-netaddr-0.7.19-5.el7.noarch.rpm | 11:40 |
| sshnaidm | ykarel, I think this error is from virthost, not from job | 11:40 |
| sshnaidm | jaosorior, try to install it on your virthost | 11:41 |
| ykarel | sshnaidm, yup good to check if repo is enabled | 11:41 |
| sshnaidm | jaosorior, to see if it fixes | 11:41 |
| sshnaidm | jaosorior, if so, need to fix our deps install | 11:41 |
| jaosorior | sshnaidm: on the virthost I already tried running "yum install python-netaddr" and it said it was already installed. | 11:42 |
| jaosorior | Package python-netaddr-0.7.5-9.el7.noarch already installed and latest version | 11:42 |
| ssbarnea | sshnaidm: I am not sure (as logs were removed even if is only 6weeks old), but i remember that using reproducer from a job like https://review.openstack.org/#/c/581779/ was not running with the change, was using tripleo master, .... so not using the change itself. | 11:43 |
| ssbarnea | wes knows for sure as he confirmed the same issue | 11:43 |
| sshnaidm | jaosorior, and on your host when you run quickstart? | 11:44 |
| sshnaidm | ssbarnea, your patch had nothing to do with that anyway | 11:44 |
| sshnaidm | ssbarnea, I suggest to revert this to get reproducer working, if you think it's still the issue - please submit a bug with a patch and we'll discuss it | 11:45 |
| ssbarnea | in fact he told me to hack reproducer to cherry pick my change and it worked. few days later I ended up creating the cherry picking change in order to force it to use the code from CRs. | 11:45 |
| jaosorior | sshnaidm: it's python2-netaddr or python3-netaddr. I have them installed; but I guess the code in quickstart should change then | 11:45 |
| rfolco | quiquell, we can consolidate a new workspace in a separate patch | 11:47 |
| quiquell | rfolco: ok | 11:48 |
| sshnaidm | ssbarnea, let's talk about it when you have a submitted bug with logs and failures, patch etc | 11:50 |
| sshnaidm | ssbarnea, I can't discuss something unknown | 11:50 |
| sshnaidm | jaosorior, you're right, fixing.. | 11:52 |
| jaosorior | sshnaidm: ended up deleting that statement to move forward | 11:52 |
| ykarel | sshnaidm, but that python- should not have caused that issue, as python- is provided by that package | 11:52 |
| sshnaidm | ykarel, I don't know which distro jaosorior uses, maybe in his repos there is no python- | 11:53 |
| sshnaidm | jaosorior, can you run "yum list python*-netadr"? | 11:53 |
| ykarel | sshnaidm, yes good to confirm that, | 11:54 |
| jaosorior | sshnaidm: fedora 28 | 11:54 |
| ykarel | jaosorior, okk now i got it | 11:54 |
| ykarel | there is a bug in fedora | 11:54 |
| ykarel | it has issue when multiple repos are enabled with source rpms | 11:54 |
| jaosorior | Installed Packages | 11:54 |
| jaosorior | python2-netaddr.noarch 0.7.19-7.fc28 @fedora | 11:55 |
| jaosorior | python3-netaddr.noarch 0.7.19-7.fc28 @fedora | 11:55 |
| ykarel | jaosorior, fetching the fedora bug | 11:55 |
| sshnaidm | hmm.. me too with f28, but didn't see this error | 11:55 |
| ykarel | sshnaidm, only happens with multiple repos with same package | 11:55 |
| sshnaidm | ykarel, ok | 11:56 |
| ykarel | jaosorior, if u disable one repo, u will not see that | 11:56 |
| ykarel | let me find the bug | 11:56 |
| ykarel | sshnaidm, jaosorior https://bugzilla.redhat.com/show_bug.cgi?id=1519325 | 11:57 |
| openstack | bugzilla.redhat.com bug 1519325 in dnf "dnf fails to install a package by a "provides" name" [Unspecified,Closed: rawhide] - Assigned to rpm-software-management | 11:57 |
| ykarel | and changing the package name to python2-netaddr will workaround that | 11:57 |
| sshnaidm | actually we can use "python*-netaddr" and then it will install both python2 and python3 | 12:04 |
| sshnaidm | not sure if it's desirable.. | 12:05 |
| *** ajo has joined #oooq | 12:06 | |
| jaosorior | So... now I don't encounter the python-netaddr issue. But now I have this problem http://paste.openstack.org/show/729399/ | 12:16 |
| jaosorior | is it trying to use rhel images? | 12:17 |
| *** trown|outtypewww is now known as trown | 12:17 | |
| ykarel | nope, possibly all repos are disabled in previous steps | 12:24 |
| sshnaidm | jaosorior, yeah.. it tries to install libguestfs-tools-c and doesn't find it | 12:25 |
| *** rlandy has joined #oooq | 12:30 | |
| quiquell | rlandy: o/ | 12:32 |
| rlandy | quiquell: hey - welcome back! | 12:32 |
| quiquell | rlandy: thanks | 12:33 |
| quiquell | rlandy: The review "Add another level of parent jobs for zuul v3" looks good | 12:34 |
| rlandy | quiquell: thanks - there are still underlying reviews though we need to get in | 12:34 |
| quiquell | rlandy: https://review.openstack.org/#/c/593063 the playbook executions are exactly the same | 12:34 |
| *** ykarel is now known as ykarel|away | 12:34 | |
| quiquell | rlandy: What's missing to merge it ? | 12:34 |
| *** ccamacho has quit IRC | 12:34 | |
| quiquell | rlandy: Stuff about infra ? | 12:35 |
| rlandy | quiquell: the reparent stuff is a huge mess | 12:37 |
| * rlandy gets | 12:37 | |
| rlandy | quiquell: https://bugs.launchpad.net/tripleo/+bug/1789294 | 12:39 |
| openstack | Launchpad bug 1789294 in tripleo "RDO Cloud jobs move to zuulv3 native is blocked by legacy dependencies" [Undecided,Triaged] - Assigned to Ronelle Landy (rlandy) | 12:39 |
| *** jrist has quit IRC | 12:39 | |
| rlandy | quiquell: and we need to get this through zuul | 12:39 |
| rlandy | quiquell: need to touch base with panda about that as well | 12:40 |
| *** jrist has joined #oooq | 12:40 | |
| quiquell | rlandy: Without that we cannot merge the new base jobs ? | 12:40 |
| rlandy | we'll never see them work | 12:40 |
| quiquell | Both at RDO and openstack infra ? | 12:41 |
| quiquell | but CI is working in the review, is RDO the problem ? | 12:41 |
| *** ykarel|away has quit IRC | 12:42 | |
| quiquell | rfolco: https://review.openstack.org/#/c/596422 is huge | 12:44 |
| quiquell | hufff | 12:44 |
| rlandy | one sec - phone | 12:45 |
| rlandy | quiquell: some of the failures are legit and some are blocking what we could see | 12:51 |
| rlandy | quiquell: the problem is we keep uncovering more and more to do here | 12:51 |
| rlandy | quiquell: I am looking now at changing the deploy heat template | 12:51 |
| quiquell | rlandy: It affects all the jobs with base tripleo-ci-base ? | 12:51 |
| quiquell | rlandy: both upstream and RDO ? | 12:52 |
| rlandy | quiquell: just RDO jobs - we can't reconfigure RDO until we get rid of legacy | 12:52 |
| rlandy | that is what https://review.openstack.org/#/c/596422 is all about | 12:52 |
| rlandy | it's killing us | 12:52 |
| quiquell | but RDO is still using the old workflow, we can still merge new workflow improvements while we make it RDO compatible | 12:53 |
| rlandy | https://review.openstack.org/#/c/599076/ | 12:54 |
| * rlandy gets error | 12:55 | |
| sshnaidm | rlandy, agree with quiquell - why not to merge things for upstream CI for now, while working separately for OVB | 12:55 |
| sshnaidm | rlandy, it's independent and we don't break OVB with those changes | 12:55 |
| sshnaidm | rlandy, at least we'll finish one part.. | 12:55 |
| quiquell | Also is good to hub those stuff already in place to reduce rebasing | 12:56 |
| quiquell | s/hub/have/ | 12:56 |
| quiquell | So work for OVB is less painful | 12:56 |
| rlandy | sshnaidm: quiquell: my concern is delaying https://review.openstack.org/#/c/596422 more | 12:57 |
| rlandy | panda has moved and renamed stuff deleted in https://review.openstack.org/#/c/593063 | 12:58 |
| rlandy | is panda around today? | 12:58 |
| rlandy | anyone seen him? | 12:58 |
| sshnaidm | rlandy, I think he's on PTO this week | 12:58 |
| quiquell | rlandy: Merging https://review.openstack.org/#/c/593063 is not going to delay the other imho | 12:58 |
| quiquell | rlandy: It's just a good restructuring of the new workflow already in place | 12:59 |
| quiquell | sure I am missing something | 12:59 |
| sshnaidm | rlandy, this patch - I don't know in which stage is it, but multinode work seems to be close to merge | 12:59 |
| sshnaidm | rlandy, I see it first time.. | 13:00 |
| rlandy | sshnaidm: quiquell: let's bj - so we hash this out quickly | 13:00 |
| sshnaidm | rlandy, sure | 13:01 |
| quiquell | rlandy: Agree my PTO has empty my brains | 13:01 |
| sshnaidm | quiquell, lucky one | 13:01 |
| *** skramaja_ has quit IRC | 13:01 | |
| rlandy | https://bluejeans.com/u/rlandy/ | 13:01 |
| rfolco | rlandy, o/ may I join you guys? | 13:03 |
| rlandy | sure | 13:03 |
| quiquell | rlandy: thanks again, that's a titanic work | 13:17 |
| rlandy | quiquell: it's more like the titanic hitting the iceberg part | 13:18 |
| quiquell | moving the iceberg before hitting it | 13:18 |
| quiquell | rfolco, rlandy: doing a cherry pick of ronelle's changes over "Add another level..." is near trivial so we are good | 13:22 |
| *** vinaykns has joined #oooq | 13:22 | |
| quiquell | rfolco: But it's not the case for the one removing bash variables | 13:23 |
| rlandy | quiquell: ok - great, go ahead | 13:23 |
| rfolco | quiquell, bash vars patch should not be hard, we can resolve conflicts | 13:24 |
| rlandy | rfolco: do you know what is in /etc/nodepool/sub_nodes_private? http://logs.openstack.org/63/593063/11/check/tripleo-ci-centos-7-containers-multinode/387b2e0/logs/undercloud/etc/nodepool/ shows empty archive | 13:24 |
| rfolco | rlandy, yes, wget it and gzip -d... you'll see ip(s) for the subnode(s) | 13:25 |
| quiquell | humm cherry-picking also over "Move toci BASH variables to ansible" is not that bad | 13:26 |
| rlandy | rfolco: fails to open | 13:26 |
| rlandy | rfolco: I need to duplicate this line https://github.com/openstack/tripleo-heat-templates/blob/master/ci/common/net-config-multinode-os-net-config.yaml#L145 | 13:26 |
| rlandy | here | 13:26 |
| rlandy | https://review.openstack.org/#/c/599076/1/roles/overcloud-prep-network/templates/overcloud-prep-network.sh.j2 | 13:26 |
| rfolco | $ cat sub_nodes_private | 13:26 |
| rfolco | 199.204.45.232 | 13:26 |
| rlandy | you see the empty subnode_index? | 13:27 |
| quiquell | marios: Can you help +2 this https://review.openstack.org/#/c/593063 ? rlandy is ok with it | 13:27 |
| rlandy | oh marios is back as well | 13:28 |
| rlandy | yay | 13:28 |
| rfolco | rlandy, subnode_index is empty ? how ? | 13:28 |
| marios|rover | quiquell: i would rather review that properly and since it looks like it is more than 2 mins thing i'll cycle back to it in a bit | 13:29 |
| marios|rover | rlandy: o/ | 13:29 |
| rlandy | rfolco: empty where? https://review.openstack.org/#/c/599076/1/roles/overcloud-prep-network/templates/overcloud-prep-network.sh.j2? | 13:29 |
| marios|rover | \o/ | 13:29 |
| rlandy | just because I didn't know what to put there | 13:29 |
| quiquell | marios|rover: sure, thanks | 13:29 |
| rlandy | rfolco: can you bj with me for a sec? | 13:32 |
| rlandy | just to sort out nodes issue | 13:32 |
| rfolco | rlandy, give me one sec to test your subnodes line locally here | 13:32 |
| rlandy | rfolco: sure - afaict - it would be empty | 13:32 |
| rfolco | rlandy, yes returning empty, I am trying to execute it in parts... confused on what should be the expected output .... 1 <ip> ? | 13:34 |
| rfolco | lets bj | 13:34 |
| rfolco | rlandy, knocking your door | 13:35 |
| rfolco | knock knock | 13:35 |
| rlandy | rfolco: joining | 13:36 |
| rfolco | the door is open, I am getting in | 13:36 |
| quiquell | cherry-picking ronelle's over timeout removal is semy trivial too | 13:36 |
| quiquell | so we are good | 13:36 |
| rfolco | rlandy, my connection is killing me | 13:37 |
| rfolco | oh god | 13:37 |
| rlandy | want to rejoin? | 13:38 |
| rfolco | rlandy, if you change it to... | 13:46 |
| rfolco | grep -n $(cat sub_nodes_private) sub_nodes_private | 13:46 |
| rfolco | 1:199.204.45.232 | 13:46 |
| rfolco | index:ip | 13:46 |
| *** ccamacho has joined #oooq | 13:46 | |
| rlandy | rfolco: yep - but I am just trying to reproduce what is there | 13:47 |
| rlandy | not change it | 13:47 |
| rfolco | rlandy, who said this is right ? https://github.com/openstack/tripleo-heat-templates/blob/master/ci/common/net-config-multinode-os-net-config.yaml#L138 | 13:48 |
| rfolco | it does not make any sense to me | 13:48 |
| rlandy | rfolco: me neither | 13:48 |
| rlandy | but I want to move the code, not change it | 13:48 |
| rlandy | at least at first | 13:48 |
| rfolco | so.. primary_node_private == node_private != sub_nodes_private | 13:50 |
| rfolco | still don't have qe for my cards :( | 13:56 |
| rfolco | https://trello.com/c/WvujKLzl/915-override-featureset-config and https://trello.com/c/ZL2yzSK2/916-define-extra-playbooks-in-job-definition | 13:56 |
| rfolco | any volunteer? ^ | 13:57 |
| quiquell | rfolco: I can get some | 13:57 |
| rfolco | these cards are small patches, and already have test patches to verify | 13:58 |
| rfolco | so would be a 15 min each I believe | 13:58 |
| rfolco | quiquell, you rock | 13:58 |
| quiquell | have already do some reviewing | 13:58 |
| quiquell | rfolco: My brain is still elsewhere | 13:59 |
| *** udesale has joined #oooq | 13:59 | |
| quiquell | ok taking override featureset config | 13:59 |
| rfolco | quiquell, thanks | 14:00 |
| rfolco | sshnaidm, are you overloaded or can be a qe for a small card ? I saw your review already there... please let me know if you can qe https://trello.com/c/ZL2yzSK2/916-define-extra-playbooks-in-job-definition | 14:01 |
| rfolco | will probably need a rebase when we merge reparenting patch | 14:01 |
| sshnaidm | rfolco, exactly wanted to ask about that, I still wonder why we need this | 14:01 |
| rfolco | sshnaidm, even after my beautiful and so awesome commit ? :) kidding... | 14:02 |
| *** Guest58453 has quit IRC | 14:03 | |
| *** stack has quit IRC | 14:04 | |
| sshnaidm | rfolco, wanna to bluej? | 14:04 |
| rfolco | sshnaidm, I agree its not everyday we'll have an extra playbook... and this needs to exist in tqe or gated by extra-requirements.txt... but that happened to browbeat. So how do we add an extra playbook without changing the playbooks logic (manually including it)? | 14:04 |
| rfolco | sshnaidm, ok, your room? | 14:04 |
| sshnaidm | rfolco, ya | 14:04 |
| rfolco | sshnaidm, rlandy if you get 5 min, please join us | 14:05 |
| quiquell | jfrancoa: the container_registry_file review, it's not better to have it in the release files since they have different name per release | 14:05 |
| rlandy | k | 14:05 |
| sshnaidm | rfolco, rlandy https://bluejeans.com/u/sshnaidm/ | 14:05 |
| *** dsneddon has quit IRC | 14:06 | |
| *** dsneddon has joined #oooq | 14:06 | |
| jfrancoa | quiquell: would make sense, but it's not something related to the release itself...if we do it for the container_registry_file, why not doing it too for config_download_args and other variables which change conditionally on the release? | 14:10 |
| quiquell | jfrancoa: Ok, so it's part of the nature of the feature sets ok, kind of blurry. | 14:12 |
| jfrancoa | quiquell: it's a tripleo-upgrade specific parameter that's why I don't think it's a good practice to add it in the release file | 14:13 |
| quiquell | jfrancoa: ack | 14:13 |
| quiquell | jfrancoa: Do you have to change also http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/playbooks/multinode-overcloud-update.yml ? | 14:15 |
| quiquell | or this is obsolete ? | 14:15 |
| jfrancoa | quiquell: oh, good point.Can you please add a comment in the patch? | 14:15 |
| jfrancoa | quiquell: thanks for the catch | 14:16 |
| quiquell | jfrancoa: sure | 14:16 |
| quiquell | jfrancoa: Happy to give you my -1 :-P | 14:17 |
| jfrancoa | quiquell: I accept it with love :-D | 14:17 |
| *** quiquell has quit IRC | 14:21 | |
| *** myoung has joined #oooq | 14:25 | |
| rascasoft | myoung, hey hi! Are you able to share with me sometime to define the status of jobs/logs in the pipelines? I can't figure it out by myself | 14:27 |
| myoung | rascasoft: i can, but i'm booked this morning, TC call at 11 | 14:28 |
| rascasoft | myoung, yeah, me too | 14:28 |
| myoung | rascasoft: i have not been online since friday, so i'm a little out of touch, was holiday here yesterday | 14:28 |
| rascasoft | myoung, I know, but it should be fairly simple | 14:28 |
| sshnaidm | rlandy, well, tried to rebase now and it has conflicts, especially in toci_gate_test.sh.j2. But resolving is not so hard.. | 14:38 |
| rlandy | sshnaidm: ok - as you see fit | 14:39 |
| sshnaidm | rlandy, will try to post a patch that resolves it.. but I don't understand some changed in your patch | 14:39 |
| rlandy | community meeting? off> | 14:39 |
| rlandy | myoung? | 14:40 |
| sshnaidm | rlandy, https://review.openstack.org/#/c/596422/32/playbooks/tripleo-ci/templates/toci_gate_test.sh.j2 | 14:40 |
| *** dtrainor has joined #oooq | 14:42 | |
| myoung | rlandy: #tripleo meeting still going on, I'm going to have to bail for TC meeting at 11, and I didn't announce this week...with holiday and such wasn't sure. We can have it if there's stuff to talk about. joining. | 14:43 |
| marios|rover | rlandy: same as above but tripleo is winding down joining now sorry didn't realise you started | 14:53 |
| rlandy | marios|rover: community meeting is off - we are just chatting there re: reparent stuff | 14:53 |
| marios|rover | rlandy: ack i know ssbarnea and sshnaidm had some beef to discuss | 14:54 |
| marios|rover | ;) | 14:54 |
| marios|rover | (too i mean) | 14:54 |
| marios|rover | fighting bluejeans | 14:54 |
| ssbarnea | marios|rover: ... I would prefer to keep the beef for a steak and do some work instead. | 14:57 |
| ssbarnea | sshnaidm: regarding the "beef", I am ready to give up, not because i was convinced that we shouldn't cherry pick but because you did a better job: you raised a bug, i didn't when I made the original CRs, which makes it harder to track the reasons and history. Also, I seen the cherry pick failure and I agree that that is serious inconvenience. | 15:03 |
| rlandy | sshnaidm: marios|rover: https://github.com/openstack/tripleo-heat-templates/blob/master/ci/common/net-config-multinode-os-net-config.yaml | 15:03 |
| ssbarnea | marios|rover: regarding gate checking, I am bit overwhelmed, the best result so far was to see 1/6 passing. | 15:07 |
| ssbarnea | https://review.openstack.org/#/q/topic:gate-check+status:open | 15:07 |
| ssbarnea | marios|rover: for https://review.openstack.org/#/c/599358/ do you think it makes sense to raise a bug, or that would be enough. i am inclined to say that it does not need a new bug. | 15:10 |
| marios|rover | ssbarnea: do you have time to join? | 15:14 |
| marios|rover | https://bluejeans.com/7050859455 | 15:14 |
| ssbarnea | sure | 15:15 |
| marios|rover | rlandy: which bug were you looking at /we were discussin before please | 15:18 |
| marios|rover | rlandy: i missed the bug number | 15:18 |
| rlandy | marios|rover: https://bugs.launchpad.net/tripleo/+bug/1789294 | 15:19 |
| openstack | Launchpad bug 1789294 in tripleo "RDO Cloud jobs move to zuulv3 native is blocked by legacy dependencies" [High,Triaged] - Assigned to Ronelle Landy (rlandy) | 15:19 |
| marios|rover | rlandy: thanks | 15:19 |
| rlandy | marios|rover; thanks for your help there | 15:19 |
| marios|rover | rlandy: didn't do nuffin :) | 15:20 |
| myoung | ssbarnea, marios|rover, is it known/understood already that rdo2 slaves (rdo-manager-64) all seem to be down/offline? | 15:25 |
| marios|rover | myoung: rdo was down earlier i believe | 15:27 |
| sshnaidm | rlandy, https://review.openstack.org/#/c/599206/ | 15:27 |
| marios|rover | sshnaidm: right? did you say rdo cloud was down at some point | 15:27 |
| * marios|rover checks mail | 15:27 | |
| marios|rover | myoung: we are still on the community call btw | 15:28 |
| marios|rover | but finishing now | 15:28 |
| sshnaidm | rlandy, https://review.openstack.org/#/c/599460/ | 15:28 |
| myoung | marios|rover: didn't realize, I'm on TC global call | 15:28 |
| sshnaidm | marios|rover, ^^ | 15:28 |
| sshnaidm | marios|rover, mm, not aware of that, but jobs were failing | 15:30 |
| sshnaidm | marios|rover, now they should be ok | 15:30 |
| marios|rover | ack sshnaidm thanks myoung sorry not down just some jobs had issues | 15:31 |
| myoung | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/computer | 15:33 |
| marios|rover | rlandy: myoung fyi since i'm almost out waiting for this https://review.openstack.org/#/c/595527/ should hopefully fix timeout on ocata/queens jobs | 15:34 |
| ssbarnea | rlandy: added as https://bugs.launchpad.net/tripleo/+bug/1790667 and linked to both reviews, we should collaboration there to find a better solution for repro cherry picking. | 15:35 |
| openstack | Launchpad bug 1790667 in tripleo "reproducer-quickstart.sh fails to cherry pick changes made to tripleo-quickstart(-extras)" [Medium,Confirmed] - Assigned to Sorin Sbarnea (ssbarnea) | 15:35 |
| sshnaidm | rlandy, so, please take a look at rebased patch https://review.openstack.org/#/c/599628/ in your time. Possibly it'll require some additional work.. | 15:37 |
| *** sshnaidm is now known as sshnaidm|afk | 15:37 | |
| * myoung heads to punishment...err... s/punishment/dentist | 15:38 | |
| *** myoung is now known as myoung|bbl | 15:38 | |
| *** saneax has quit IRC | 15:45 | |
| *** ccamacho has quit IRC | 15:53 | |
| rlandy | sshnaidm|afk: ack - will do | 15:57 |
| rlandy | ssbarnea: thanks | 15:58 |
| rlandy | I see the bug | 15:59 |
| *** holser_ has quit IRC | 16:15 | |
| *** jfrancoa has quit IRC | 16:31 | |
| *** kopecmartin has quit IRC | 16:36 | |
| *** trown is now known as trown|lunch | 16:39 | |
| *** dsneddon has quit IRC | 16:50 | |
| *** udesale has quit IRC | 16:51 | |
| ssbarnea | sshnaidm|afk: https://review.rdoproject.org/r/#/c/15914/ when you have few minutes, please. | 17:02 |
| *** ykarel has joined #oooq | 17:03 | |
| ssbarnea | marios|rover: https://bugs.launchpad.net/tripleo/+bug/1790685 with bugfix linked to it. | 17:11 |
| openstack | Launchpad bug 1790685 in tripleo "creating host via 'add_host': hostname=ip_address" [High,In progress] - Assigned to Sorin Sbarnea (ssbarnea) | 17:11 |
| *** vinaykns has quit IRC | 17:26 | |
| *** dsneddon has joined #oooq | 17:34 | |
| *** dsneddon has quit IRC | 17:51 | |
| *** trown|lunch is now known as trown | 18:03 | |
| *** ykarel is now known as ykarel|away | 18:13 | |
| *** dtantsur is now known as dtantsur|afk | 18:21 | |
| *** dsneddon has joined #oooq | 18:22 | |
| *** myoung|bbl is now known as myoung | 19:46 | |
| *** holser_ has joined #oooq | 20:26 | |
| *** holser_ has quit IRC | 20:49 | |
| *** trown is now known as trown|outtypewww | 21:03 | |
| *** matbu has joined #oooq | 21:20 | |
| *** matbu has quit IRC | 21:25 | |
| *** matbu has joined #oooq | 21:35 | |
| *** rlandy is now known as rlandy|bbl | 22:45 | |
| *** tosky has quit IRC | 23:48 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!