Wednesday, 2019-06-19

*** tosky has quit IRC00:36
*** Goneri has quit IRC00:39
*** vkapalav has quit IRC01:15
*** aakarsh has joined #oooq01:29
*** aakarsh has quit IRC01:34
*** apetrich has quit IRC01:57
*** ykarel|away has joined #oooq03:21
*** dsneddon has quit IRC03:46
*** dsneddon has joined #oooq04:12
*** dsneddon has quit IRC04:17
*** dsneddon has joined #oooq04:17
*** dsneddon has quit IRC04:22
*** raukadah is now known as chandankumar04:31
*** udesale has joined #oooq04:31
*** dsneddon has joined #oooq04:52
*** dsneddon has quit IRC04:57
*** marios has joined #oooq05:09
*** ykarel|away is now known as ykarel05:13
*** irclogbot_1 has quit IRC05:30
*** irclogbot_1 has joined #oooq05:30
*** dsneddon has joined #oooq05:33
*** dsneddon has quit IRC05:38
*** ykarel is now known as ykarel|away05:40
*** skramaja has joined #oooq05:42
*** jfrancoa has joined #oooq05:47
*** ykarel|away has quit IRC05:48
*** ratailor has joined #oooq05:49
*** ykarel|away has joined #oooq06:02
*** ykarel|away is now known as ykarel06:05
*** dsneddon has joined #oooq06:11
*** dsneddon has quit IRC06:16
*** apetrich has joined #oooq06:30
*** kopecmartin|off is now known as kopecmartin06:32
*** dsneddon has joined #oooq06:49
*** amoralej|off is now known as amoralej06:51
*** dsneddon has quit IRC06:54
*** jtomasek has joined #oooq07:07
*** tosky has joined #oooq07:15
*** bogdando has joined #oooq07:16
*** tesseract has joined #oooq07:20
*** dsneddon has joined #oooq07:21
*** dsneddon has quit IRC07:26
*** ccamacho has quit IRC07:27
*** ccamacho has joined #oooq07:27
*** saneax has joined #oooq07:38
*** dsneddon has joined #oooq07:39
*** jpena|off is now known as jpena07:43
*** dsneddon has quit IRC07:44
*** jfrancoa has quit IRC07:50
arxcruzsshnaidm https://review.rdoproject.org/r/#/c/21186/07:51
arxcruzsshnaidm can i add a review.rdoproject.org depends-on on a patch on review.opendev.org ?07:51
arxcruzi know the opposite wirks07:51
arxcruzworks*07:52
sshnaidmarxcruz, nope07:55
sshnaidmarxcruz, +w, when it's merged let's just recheck the patch07:56
*** dtantsur|afk is now known as dtantsur07:56
arxcruzsshnaidm ok07:56
*** ykarel is now known as ykarel|lunch07:57
*** gkadam has joined #oooq08:00
chandankumarmarios: I am updating this patch08:13
chandankumarhttps://code.engineering.redhat.com/gerrit/#/c/172857/08:14
*** dsneddon has joined #oooq08:15
zbr|rucksshnaidm: arxcruz : my impression was that depends on works only from rdo to upstream08:15
arxcruzzbr|ruck yup08:16
sshnaidmzbr|ruck, config is trusted repo, depends don't work there08:16
marioschandankumar: ack08:18
zbr|rucksshnaidm: can youy please help me merge https://review.opendev.org/#/c/664947/ and https://review.opendev.org/#/c/665981/ ? easy job rename.08:39
zbr|ruckrelated to avoiding run of branch-jobs on branched-repos / aka "less jobs" task.08:40
zbr|ruckassures that only "tripleo-ci-" prefixed jobs can endup in "-{branch}"08:41
*** holser_ has joined #oooq08:45
sshnaidmzbr|ruck, it failed in ci, rechecking08:46
zbr|ruck... like all the jobs i left running since last night.08:46
zbr|rucknot feeling lucky today08:47
arxcruzbrb08:47
*** arxcruz is now known as arxcruz|brb08:47
zbr|ruckthe rax mirrors were down yesterday again, apparently there are lots of issues with the AFS08:47
zbr|rucki keep seeing infra having to manually resync it on various nodes08:48
*** dsneddon has quit IRC09:17
*** ykarel|lunch is now known as ykarel09:19
*** derekh has joined #oooq09:39
*** yolanda has quit IRC09:41
*** tosky has quit IRC09:47
*** tosky has joined #oooq09:48
*** dsneddon has joined #oooq09:53
*** dsneddon has quit IRC09:57
*** dsneddon has joined #oooq10:07
*** dsneddon has quit IRC10:14
*** dsneddon has joined #oooq10:20
*** sshnaidm is now known as sshnaidm|afk10:24
*** dsneddon has quit IRC10:25
*** saneax has quit IRC10:26
*** saneax has joined #oooq10:26
*** sanjayu_ has joined #oooq10:34
*** sanjayu_ has quit IRC10:34
*** sanjayu_ has joined #oooq10:35
*** saneax has quit IRC10:35
*** jfrancoa has joined #oooq10:37
*** sanjayu__ has joined #oooq10:37
*** sanjayu_ has quit IRC10:40
*** dsneddon has joined #oooq10:49
*** dsneddon has quit IRC10:53
*** jfrancoa has quit IRC10:57
*** jfrancoa has joined #oooq11:12
*** holser_ is now known as holser|lunch11:13
*** yolanda has joined #oooq11:17
chandankumarykarel: Do we have proper fix for undercloud install failure?11:18
chandankumarmarios: Hello11:18
marioschandankumar: o/11:18
chandankumarmarios:11:18
chandankumar    https://trunk.rdoproject.org/rhel8-master/consistent/11:18
chandankumar    https://trunk.rdoproject.org/rhel8-master/deps/latest (for deps)11:18
chandankumarmarios: rhel-8 based trunk rdo repo public available now11:19
marioschandankumar: oh cool ok i can update the rhos-release patch then nice11:19
chandankumarmarios: yes11:19
*** jpena is now known as jpena|lunch11:19
marioschandankumar: am trying to focus on the containers one a bit today but will revisit that later11:19
chandankumarmarios: https://trello.com/c/tnRGWMVj/53-public-rhel-8-train-dlrn-server11:19
chandankumarmarios: sure11:19
chandankumarmarios: rhos-release repo has got the zuul based jobs also11:20
chandankumarwe can enable it in other jobs11:20
ykarelchandankumar, yes11:22
ykarelu mean duplication mount issue, right?11:22
ykarelif yes, fix is https://review.opendev.org/#/c/666220/11:23
chandankumarykarel: yes11:25
ykarelchandankumar, thant needs to be cherry-pikced to stein also,11:26
ykarelstein is also affected11:26
*** dsneddon has joined #oooq11:28
*** ykarel is now known as ykarel|afk11:33
chandankumarmarios: yesterday trackback in the logs now https://sf.hosted.upshift.rdu2.redhat.com/logs/57/172857/19/check/tripleo-buildimage-overcloud-train-rhel-8/a8186e7/job-output.txt.gz#_2019-06-19_07_33_28_23380211:34
*** ykarel_ has joined #oooq11:34
*** ykarel_ has quit IRC11:36
chandankumar* seen11:36
*** ykarel|afk has quit IRC11:37
marioschandankumar: ack nice seems same as issue 6 https://tree.taiga.io/project/tripleo-ci-board/task/111411:43
chandankumarmarios: do we need to involve rhos-delivery guys?11:46
marioschandankumar: i have a bug for it there for escalation https://bugs.launchpad.net/tripleo/+bug/183320911:48
openstackLaunchpad bug 1833209 in tripleo "[rdotrunk][rhel8] dependency errors for overcloud image build" [Undecided,Triaged] - Assigned to Marios Andreou (marios-b)11:48
weshayzbr|ruck how goes it?11:49
marioschandankumar: i think weshay said reldel and sf folks for those so yeah i filed the bug with the intention of escalating if you have time to harrass folks go ahead :D11:49
weshaymarios can you  please make sure the repos on  the rhel 8 job are sane.. rlandy and I found it had devel or pre-release 8.1 content11:50
weshaypanda if you have time..  in the next 5 min11:50
weshayI'm going to make some coffee and we should sync for a few11:51
mariosweshay: ok you mean the ones from http://10.0.76.170/repos/ ?11:51
mariosweshay: btw 14:19 < chandankumar>     https://trunk.rdoproject.org/rhel8-master/consistent/11:51
marios14:19 < chandankumar>     https://trunk.rdoproject.org/rhel8-master/deps/latest (for deps)11:51
marios14:20 < chandankumar> marios: rhel-8 based trunk rdo repo public available now11:52
zbr|ruckweshay: ... good idea. i am still waiting for my lunch. but we clearly need to sync.11:52
weshaymarios no no.. I'll show you11:52
weshaymarios yours looks ok11:52
weshaymarios https://code.engineering.redhat.com/gerrit/#/c/173724/2/nodepool/elements/virt-customize/rhel8-cloud.yaml11:52
weshaymarios http://file.rdu.redhat.com/~sct/redhat-release-devel/noarch/ this installs 8.111:53
mariosweshay: ah i see11:53
*** udesale has quit IRC11:53
mariosweshay: from the 'fake' element virt-customize11:53
*** arxcruz|brb is now known as arxcruz11:53
weshayaye11:53
*** udesale has joined #oooq11:53
weshayzbr|ruck ?11:53
mariosweshay: ack thanks11:54
*** rfolco has joined #oooq11:54
weshayzbr|ruck hey.. brb11:54
zbr|ruckweshay: i joined, will wait for you11:56
*** ykarel has joined #oooq12:01
weshayykarel did the podman update come through centos channels and supersede rdoinfo deps?12:12
weshayykarel ya.. that's what you said in the bug it seems12:13
ykarelweshay, yes12:13
ykarelit pushed to centos-extras, and it was higher version than in RDO12:13
*** udesale has quit IRC12:20
*** udesale has joined #oooq12:21
*** amoralej is now known as amoralej|lunch12:25
*** udesale has quit IRC12:25
*** udesale has joined #oooq12:25
weshayykarel so f28 is not cooperating, looks podman related http://logs.openstack.org/60/636860/7/check/tripleo-ci-fedora-28-standalone/2565b12/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz12:26
ykarelweshay, but in fedora podman is not updated afaik, but let me cross check12:27
*** rlandy has joined #oooq12:27
ykarelyes it's the old one podman-0.12.1.1-1.git66d3499.fc28.x86_6412:28
mariossshnaidm|afk: o/ hey do you remember where the secret is for rdoregistry login (I see your name there hence the ping https://github.com/rdo-infra/review.rdoproject.org-config/commit/0b947b61a4093033d46a67c4d1c2e74c3b4fbf33 ) I want to encrypt it for internal sf but i can't see which one it is in https://docs.google.com/document/d/1E7aKYYF67uHvauN4sw6qeEX_iy1MxgXUKoxRwCZ3Q0w/edit (or maybe isn't in that12:28
*** holser|lunch is now known as holser_12:28
mariosdocument)12:28
zbr|ruckweshay: i am back, rejoining?12:28
weshayya12:28
weshayzbr|ruck ya12:29
*** sshnaidm|afk is now known as sshnaidm12:29
*** jpena|lunch is now known as jpena12:29
weshaypodman                      x86_64 0.12.1.1-1.git66d3499.fc2812:30
weshay                                                     delorean-master-deps 7.0 M12:30
*** dsneddon has quit IRC12:32
sshnaidmmarios, posted in priv, look for rdoproject_password12:32
mariossshnaidm: thank you looking12:33
mariossshnaidm: do you remember if you did --infile or pasted that to standard in12:36
mariossshnaidm: gonna try stdin12:36
sshnaidmmarios, I  think to file, but it doesn't matter12:36
mariossshnaidm: thanks12:36
rlandyrfolco: I reverted your change12:37
rlandybecause it broke the other jobs in internal12:37
rfolcoI saw rlandy. Thanks, will check why not pulling containers from standalone job.12:38
rlandyrfolco: weshay sent an email I think12:38
rlandywill also need to be excluded from baremetal jobs12:38
sshnaidmzbr|ruck, https://review.opendev.org/#/c/645273/18/roles/repo-setup/tasks/main.yml doesn't test at all, it just checks if repo exists, and it always exists.12:38
rfolcomarios, why you need a new secret ?12:39
rfolcomarios, just use the one in config, it works fine12:39
mariosrfolco: so we can login from tripleo-ci-internal-jobs12:39
mariosrfolco: but its a different zuul does it already work? i don't see the login from the rhel7 internal sf contaienr build job12:40
rfolcomarios, parent your job from -job to your job in -config (that calls the login playbook w/ the secret)12:40
rfolcomarios, see that the parent is in -config, and it calls the playbook login to rdo registry.... this works just fine, it is pushing to rdo registry12:41
mariosrfolco: yeah i thought about going the reparent route too.. but not sure if its gonna get messy. the login is done via pre on that config job12:41
mariosrfolco: yeah i know i mean i added the login stuff on the rdo config side12:41
weshayykarel f28 is failing in updating the contianers, investigating http://logs.openstack.org/60/636860/7/check/tripleo-ci-fedora-28-standalone/2565b12/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz12:42
mariosrfolco: so we need to decide if we will reparent all the sf jobs onto rdo jobs (and if that is possible/not messy etc)12:42
mariosrfolco: vs sf-jobs and rdo jobs both inherit from upstream independently12:42
mariosrfolco: cos of the second way is we need different login for sf jobs12:42
ykarelweshay, ack12:43
pandarfolco: marios consider most of the work for rdo on rhel will be moved to rdosf once we have the infrastructure12:43
mariosrfolco: let me post what i'm working on so we have a specific example. i take it you're working on reparent? in any case we can talk about it once we have reviews?12:43
pandaso it makes sense to reparent, and even more than that, makes sense to start making space in rdosf jobs themselves12:43
weshayzbr|ruck https://github.com/openstack/ansible-role-tripleo-modify-image12:43
rfolcomarios, for now the only way is to reparent to config and reuse the secret/playbook to login12:44
mariosrfolco: ack are you already working on that?12:44
mariosack panda12:45
rfolcomarios, look at the build container job, its merged and it works, it pushes to rdo registry12:45
rfolcomarios, I am working on the standalone consuming these containers12:45
*** tcw has joined #oooq12:45
pandarfolco: does it take form tripleo-ci-testing ?12:45
mariosrfolco: periodic-tripleo-build-containers-rhel-7-rocky that one?12:45
mariosrfolco: i didn't see login there12:46
rfolcomarios, the child is -push in config12:46
rfolcoit parents off that one -rocky in -jobs repo12:46
mariosrfolco: https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-config.git;a=blob;f=zuul.d/jobs.yaml#l124 ack  isee it12:47
rfolco-push (config) child job runs, login to rdo registry, then calls parent in -jobs12:47
mariosrfolco: but then its the other way around there12:47
rfolcomarios, need to be... build in kolla is atomic operation12:47
mariosrfolco: oh no its stilll tripleo-ci-internal-config12:47
rfolcowhen you run openstack command, if you push-true it tries to push, so you must have logged into rdo registry at that point12:48
mariosrfolco: ack ok no i meant the parenting12:48
rfolcomarios, define a child in config to login and reuse the secret, and a parent in -jobs to build.12:49
mariosrfolco: ack yeah i missed that you already have one in tripleo-ci-internal-config.12:49
weshayhttp://logs.openstack.org/60/636860/7/check/tripleo-ci-fedora-28-standalone/2565b12/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz12:49
weshayzbr|ruck ^12:49
mariosrfolco: i thought you were referring to the secret in https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/secrets.yaml  that config12:50
rfolcomarios, it is tricky12:50
rfolcomarios, can't12:50
mariosrfolco: i thought you hadn't added the push yet for this rhel7 job12:50
rfolcoeach zuul needs its own secret12:50
mariosrfolco: right12:50
mariosrfolco: ack yeah thats why i wanted to create on for internal sf thought you hadn't added it yet12:50
rfolcomarios, -push is working fine... it is not in the pipeline yet12:51
rfolcobut the job works12:51
mariosrfolco: so to be clear about th eparenting... when we were discussing before i *thought* we were talking about parenting the internal SF job onto the rdo-config stuff.... you were talking about parenting the tripleo-ci-internal-jobs job onto tripleo-ci-internal-config which is fine yes agree on that !12:53
marios:D12:53
rfolcowe may need to restructure that. I mean, the reparenting work to rdo-config is under discussion. The hard part is that we're mixing zuuls... and each zuul needs its own secrets.... and also we reparent upstream jobs... I think panda is beating his head against the wall to solve this equation12:55
rfolcomarios, ^12:55
mariosrfolco: ack but for now its all internal i mean this sprint/first iterations at least12:55
mariosrfolco: unless panda eureka12:56
rfolcomarios, yeah we continue on internal sf unless panda and weshay tells the opposite12:56
rfolcokeep walking, jhonny12:56
pandamarios: rfolco the most difficult part is activating loging for all the jobs12:58
rfolcopanda, indeed. coz every job has its own parent, different hierarchy12:59
pandarfolco: not only that12:59
pandarfolco: login requires python*-docker12:59
mariospanda: but that bit maybe not for py3 right ? ^12:59
pandarfolco: which is available in deps after we initialize the repos. But in most jobs the repo is initialized in quicksrart itself12:59
rfolcoand that would require the repo setup  before the login12:59
weshaypanda 1-113:00
pandarfolco: exaclty, so probably the only way is to add it to quickstart, not to zuul playbook13:00
chandankumarweshay: https://trunk.rdoproject.org/rhel8-master/consistent/ is the same of http://10.0.76.170/repos/ ?13:02
*** ratailor has quit IRC13:02
*** dsneddon has joined #oooq13:05
*** skramaja has quit IRC13:12
*** yolanda has quit IRC13:13
*** Goneri has joined #oooq13:14
rfolcomarios, question...13:15
rfolcopodman pull works on rdo registry, docker pull does not....13:16
rfolcodocker is default in rocky13:16
rfolcohttps://github.com/openstack/tripleo-quickstart/blob/6fb68de195caa264759515a7d3a2bf1fd4dd444a/config/general_config/featureset052.yml#L4013:16
rfolcopodman pull docker://trunk.registry.rdoproject.org/tripleorocky/rhel-binary-cinder-api:8befbdbe5af74fcce2f0e5468d9f291e40b65c27_b01817dd13:16
rfolcomy standalone job fails...13:16
rfolcohttps://sf.hosted.upshift.rdu2.redhat.com/logs/28/172928/25/check/periodic-tripleo-ci-rhel-7-standalone-rocky/b26407f/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2019-06-18_10_12_2713:16
rfolcomarios, thoughts ?13:17
*** yolanda has joined #oooq13:17
mariosrfolco: looking13:19
mariosrfolco: weird skopeo inspect works for that skopeo inspect docker://trunk.registry.rdoproject.org/tripleorocky/rhel-binary-cinder-api:8befbdbe5af74fcce2f0e5468d9f291e40b65c27_b01817dd13:20
weshayrfolco marios rlandy fyi.. panda and I are chatting in my blue re: promotion jobs13:20
weshayif we want to sync up13:20
weshayyou guys are welcome13:20
mariosrfolco: not sure what we can do about it though i mean,13:20
mariosweshay: do you need us otherwise would rather carry on with things13:20
mariosfeeling like we're really behind on everything this sprint13:21
mariosrfolco: so13:21
mariosrfolco: what do you propose, i mean we can't change the availability of podman cli in rocky if docker is still used there13:21
mariosrfolco: so is there a bug in docker pull or they work differently ? i.e. why is docker pull failing for that13:22
weshaymarios because there is no mirror13:22
rfolcomarios, just asking if you know why docker does not work.... maybe jpena knows ?13:22
pandaattendance is now non-optional :)13:22
rfolcoweshay, that is not the case IMHO13:23
mariosweshay: do you mean re docker/podman pull?13:23
weshayrfolco if you try to manually pull the containers it works if you retry13:23
mariospanda: why?13:23
weshaymarios yes... for internal13:23
mariospanda: what happened13:23
rfolcoweshay, no, it does not work with docker pull from my lapto13:23
rfolcolaptoo13:23
pandacome to me!13:23
mariosrfolco: haha13:23
rfolcolaptop****13:23
pandatripleo-ci: the gathering13:25
pandaby the power of greyskull!13:25
pandacome on guys13:25
jpenarfolco: hm, it works fine for me using both podman and docker (local fedora 29 laptop)13:26
sshnaidmrfolco, do we have master rhel containers?13:26
weshaysshnaidm I think just rocky at this point13:26
mariosrfolco: yah me too [m@localhost ~]$ docker pull docker://trunk.registry.rdoproject.org/tripleorocky/rhel-binary-cinder-api:8befbdbe5af74fcce2f0e5468d9f291e40b65c27_b01817dd13:27
mariosError parsing reference: "docker://trunk.registry.rdoproject.org/tripleorocky/rhel-binary-cinder-api:8befbdbe5af74fcce2f0e5468d9f291e40b65c27_b01817dd" is not a valid repository/tag: invalid reference format13:27
rfolcomarios, jpena, could be docker version...13:27
sshnaidmmarios, strip "docker://"13:27
rfolcodon't know13:27
*** amoralej|lunch is now known as amoralej13:27
jpenarfolco: what sshnaidm said13:27
chandankumarmarios: check #rhos-delivery channel13:27
marioschandankumar: what is happening there13:28
marioschandankumar: (joined)13:28
chandankumarregarding https://bugs.launchpad.net/tripleo/+bug/183320913:28
openstackLaunchpad bug 1833209 in tripleo "[rdotrunk][rhel8] dependency errors for overcloud image build" [Undecided,Triaged] - Assigned to Marios Andreou (marios-b)13:28
mariossshnaidm: thanks13:28
rfolcojpena, yep it works.... perhaps my standalone job is using docker://13:29
weshayrfolco jpena rocky uses docker13:30
rfolcoyes it does13:30
rfolcoI am talking about prefix13:30
rfolcodocker://<registry>/<container>:<tag>13:30
rlandychandankumar: sshnaidm: rfolco: weshay: panda: I'd like to try this change to default to logging to downstream and allow for rdocloud logging option. If it kills anything, I'll revert ... https://code.engineering.redhat.com/gerrit/#/c/171284/13:35
sshnaidmrfolco, "docker://" is podman syntax: https://github.com/containers/libpod/blob/master/docs/podman-pull.1.md13:37
mariosok thanks chandankumar at least mburns is aware of it now13:39
marioschandankumar: i want to poke a bit at that new public repo and see if there is any diff13:39
chandankumarmarios: https://code.engineering.redhat.com/gerrit/#/c/173984/13:42
*** vinaykns has joined #oooq13:44
weshaysshnaidm can you join my blue for a hot sec13:45
*** ykarel is now known as ykarel|afk13:45
weshaysshnaidm question about mirror/proxies13:45
weshayrfolco https://sf.hosted.upshift.rdu2.redhat.com/logs/28/172928/25/check/periodic-tripleo-ci-rhel-7-standalone-rocky/b26407f/job-output.txt.gz#_2019-06-18_10_06_06_42098513:45
marioschandankumar: looking13:46
*** aakarsh has joined #oooq13:48
weshayjpena you have a minute?13:49
jpenaweshay: now I do13:52
weshayhttps://bluejeans.com/u/whayutin/13:52
weshayjpena I'll keep it brief :)13:52
*** sanjayu__ has quit IRC13:55
chandankumarmarios: feel free to add a new job also in rhos-release patches to see what is going on there14:00
chandankumarweshay: by the way rhos-release is now gated by zuul and is merged now14:01
zbr|rucki think we are very close to reach the 666666 review number...., I wonder who will be the lucky uploader.14:02
weshaylolz14:02
rlandychandankumar: sshnaidm: rfolco: weshay: panda: logging is merging - if it's a problem, I'll revert14:04
*** dsneddon has quit IRC14:08
chandankumarrlandy: is it going to upload the logs for all the jobs or only rhos-15 one?14:09
rlandychandankumar: it's going to do nothing by default14:09
rlandyit defaults to internal logs14:09
rlandyit allows the option to use the rdocloud log server14:10
rlandyI just want to make sure the default situation works atm14:10
rlandychandankumar: if your logging starts failing, ping me14:13
chandankumarrlandy: sure14:17
rlandyI am testing with rhos-15 atm14:17
chandankumarrlandy: I am currently working on enabling zuul jobs against tempest downstream patches branches14:19
pandaI got bluejeansed14:20
rlandyhmm ... post failure14:20
pandait kicked me out, can't reconnect14:20
rlandymust have messed something up14:20
*** dsneddon has joined #oooq14:23
rlandyreverting logging change - I need to correct something14:26
*** dsneddon has quit IRC14:29
*** dsneddon has joined #oooq14:33
*** ykarel|afk is now known as ykarel14:42
rlandylogging change reverted14:42
rlandywill have to rework it14:43
mariosrlandy: is that why i had finger urls in https://code.engineering.redhat.com/gerrit/#/c/172857/ or that is sthing else?14:47
mariosrlandy: (like tripleo-buildimage-overcloud-train-rhel-8 finger://managesf.sf.hosted.upshift.rdu2.redhat.com:7979/1688dc522f83460c865536629cb64d6f : RETRY_LIMIT in 1m 49s (non-voting)14:47
*** dsneddon has quit IRC14:48
rlandymarios: you can recheck14:50
rlandythere is no good way to test this config mess14:51
mariosrlandy: ok thanks14:53
*** ykarel has quit IRC14:55
*** ykarel has joined #oooq14:55
*** ykarel has quit IRC14:57
*** ykarel has joined #oooq14:57
*** PagliaccisCloud has joined #oooq15:04
*** dsneddon has joined #oooq15:04
*** dsneddon has quit IRC15:10
*** Vorrtex has joined #oooq15:12
*** gkadam has quit IRC15:19
*** holser_ has quit IRC15:30
matbumarios: o/ hey man still here ?15:32
*** holser_ has joined #oooq15:32
*** PagliaccisCloud has quit IRC15:33
marioso/ matbu15:33
matbumarios: hey, i was reading the reproducer doc and i swa your nick, so you are the GUY :)15:34
mariosmatbu: well that is obviously wrong :D you mean the one in the job itself right?15:34
matbumarios: i'm trying to reproduce a queens failure15:35
matbumarios: yep15:35
matbubut every thing has changed :) so what script should i use for my rdocloud account from my laptop ?15:35
matbuI tried several, but looks like he wants to do sudo stuffs... and i don't like that :)15:36
mariosmatbu: well if its your laptop you need to follow the instructions under "pet"15:36
mariosmatbu: and there is no script for the initial setup, precisely so you dn't have to run 'sudo stuffs' but you'll have to do a few one off manual setup steps15:37
mariosmatbu: like make sure you have the right network setup on rdo cloud and key etc15:37
*** holser_ has quit IRC15:37
mariosmatbu: does it make sense what i'm saying (i.e. there are two main bits 'pet' is for your laptop, 'cattle' is if you want to run on a temp/disposable machine like rdo cloud)15:37
matbuyep sounds clear :)15:37
matbubut just when it says run the reproducer15:38
matbuwhich script is THE reproducer ?15:38
weshayrlandy++15:38
weshaymarios++15:38
weshayfound a needs_images job for osp15 that has container updates :)15:38
weshay<weshay>  https://sf.hosted.upshift.rdu2.redhat.com/logs/35/173835/3/check/periodic-tripleo-ci-rhel-8-standalone-need-images-rhos-15/f606a4f/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz15:38
weshay09:33 <weshay>  https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=periodic-tripleo-ci-rhel-8-standalone-need-images-rhos-1515:38
mariosmatbu: give me link to the job you're reproducing15:39
weshayand spoke to it w/ rel-del folks15:39
mariosmatbu: its one of the files you should have extracted15:39
weshaythanks for your work in enabling that15:39
matbumarios: https://logs.rdoproject.org/67/664567/9/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/8a916bb/logs/15:39
matbumarios: actually any failling jobs here: https://review.opendev.org/#/c/664567/ :)15:39
mariosweshay: thanks but rlandy did all the needs images stuff wasn't me!15:39
chandankumarmatbu: weshay rlandy https://code.engineering.redhat.com/gerrit/173989 and https://code.engineering.redhat.com/gerrit/174005 please have a look thanks!15:40
mariosmatbu: so if you wget https://logs.rdoproject.org/67/664567/9/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/8a916bb/logs/reproducer-quickstart/reproducer-zuul-based-quickstart.tar15:40
mariosmatbu: then you will have a script called https://logs.rdoproject.org/67/664567/9/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/8a916bb/logs/reproducer-quickstart/reproducer-zuul-based-quickstart.sh15:40
*** dsneddon has joined #oooq15:40
matbumarios: ack ok cool15:40
matbumarios: i will try that, thanks a lot :)15:40
mariosmatbu: i mean reproducer-zuul-based-quickstart.sh15:40
mariosmatbu: ack15:41
mariosmatbu: should be in that readme https://logs.rdoproject.org/67/664567/9/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/8a916bb/logs/README-reproducer.html15:41
matbumarios: and (i guess so but..) all the gerit stuff is present in the tar ball ? (i mean change ID & any specific to the review itself)15:42
mariosmatbu: yeah but you'll have to watch out for things like     ./reproducer-zuul-based-quickstart.sh --workspace WORKSPACE -ug slim_shady -rg slim_shadier  (e.g. -ug and -rg for example)15:42
rlandychandankumar: why did we ass these other projects to config and not jobs?15:43
rlandyadd15:43
mariosmatbu: but what you mean by 'the gerrit stuff'15:43
mariosmatbu: yeah it should be all included there anyway15:43
matbumarios: ack, i mean the change id to build the patched t-h-t package15:43
weshaymatbu you may need to update the requirements.txt on ansible-role-tripleo-reproducer to use ansible 2.815:44
marioschandankumar: weshay added some more info on that deps issue there https://bugs.launchpad.net/tripleo/+bug/1833209 comment #1 the conflict is between delorean-deps and the rhos-release8 repo15:44
openstackLaunchpad bug 1833209 in tripleo "[rdotrunk][rhel8] dependency errors for overcloud image build" [Undecided,Triaged] - Assigned to Marios Andreou (marios-b)15:44
weshaymatbu ping me if you have issues15:44
matbuweshay: ack thx15:45
weshaymatbu hey15:45
weshayone more thing15:45
chandankumarrlandy: https://code.engineering.redhat.com/gerrit/173989 here we are adding to sf-config sot hat zuul knows about that15:45
weshaymatbu the read through that doc and the known issues15:45
rlandychandankumar: that part is fine15:46
chandankumarrlandy: and in config we are adding them so that jobs should run15:46
rlandyyeah15:46
rlandymaybe it has to be in config15:46
weshaymatbu it's best if the linux username matches your gerrit name..   auth to upstream and rdo gerrit is required15:46
* rlandy just hates adding stuff to config15:46
rlandyno good testing15:46
*** holser_ has joined #oooq15:46
weshaymatbu you can fire up a vm.. and run the reproducer from it.. if needed...15:46
matbuweshay: yep it might be a better solution15:47
matbuweshay: im trying to run it from my laptop atm15:47
*** holser_ has quit IRC15:47
chandankumarrlandy: if we put in tripleo-ci-internal-jobs projects dpes it will work?15:47
rlandyidk15:47
rlandychandankumar: I +2'ed your changes15:47
matbuand it installing python3 stuff :)15:48
*** holser_ has joined #oooq15:48
chandankumarrlandy: ack, thanks :-)15:48
weshaymatbu I have your failed job running in a repro now on my laptop15:57
*** ykarel is now known as ykarel|away15:58
*** bogdando has quit IRC16:02
zbr|ruckweshay: I wonder if we should do something about f28 job because https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-fedora-28-standalone -- looks more like 50% failure rate to me, which is really high.16:07
*** aakarsh has quit IRC16:07
zbr|ruckrlandy: weshay : let me know what you think about proposed https://review.opendev.org/#/c/666283/ -- about making buildah more verbose on retries. it is bit ugly but ansible has no support for checking the loop attempt (already asked)16:10
matbuweshay: ha nice, it has just failed few minutes ago on m laptop16:11
weshayk.. I'll share w/ you in a sec16:11
weshayon a call.. surprisingly16:12
matbuhehe16:12
matbuthx a lot16:12
matbuweshay++16:12
*** udesale has quit IRC16:12
* matbu brb16:13
*** jfrancoa has quit IRC16:15
weshaysshnaidm have you seen ? 2019-06-19 16:06:38.980941 | [primary] Waiting on logger16:17
*** marios has quit IRC16:18
chandankumarGood night guys see ya tomorrow16:21
*** chandankumar is now known as raukadah16:21
sshnaidmweshay, where?16:24
weshayreproducer zuul console16:24
*** rfolco has quit IRC16:25
*** rfolco has joined #oooq16:26
sshnaidmweshay, didn't run it recently, with all this rhel7 stuff16:30
*** kopecmartin is now known as kopecmartin|off16:31
*** dsneddon has quit IRC16:40
*** jpena is now known as jpena|off16:45
*** tosky has quit IRC16:47
raukadahrlandy: weshay gates are now working against downstream tempest patches branches https://code.engineering.redhat.com/gerrit/#/c/174011/16:47
rlandynice16:47
rfolcoweshay, can you please show again where do I install rhui from? I missed the doc/link16:48
rfolcorlandy, do you know ? ^16:52
rlandyno idea16:52
*** dtantsur is now known as dtantsur|afk16:56
*** dsneddon has joined #oooq17:00
*** derekh has quit IRC17:00
rlandyweshay: sshnaidm: rfolco: panda: https://code.engineering.redhat.com/gerrit/#/c/174013/ - pls review - I messed this up the first time, due to ansible vars17:07
rlandyI made the tox jobs non-voting so we could revert17:07
rlandyI had to ask admins to revert my last change17:07
rlandythis version is a lot more verbose but I hope it's safer17:08
rlandyI am looking into testing this with jobs if possible17:08
rlandyie: changing the vars in a job rather than config17:08
*** aakarsh has joined #oooq17:11
rfolcosshnaidm, panda: where do I get rhui from ?17:16
sshnaidmrfolco, https://docs.google.com/document/d/1qynC51Dj_68J4ajTySg7HEA9Hb-_nIrXEnAQXe5JUcM/edit17:17
*** tesseract has quit IRC17:21
*** ykarel|away has quit IRC17:25
*** tesseract has joined #oooq17:36
rfolcosshnaidm, thanks17:37
*** amoralej is now known as amoralej|off17:40
*** aakarsh has quit IRC17:45
*** aakarsh has joined #oooq17:48
*** holser_ has quit IRC17:49
*** holser_ has joined #oooq17:54
*** holser_ has quit IRC17:59
*** holser_ has joined #oooq18:00
*** holser_ has quit IRC18:05
rlandy weshay: sshnaidm: rfolco: panda: in an effort to avoid another logging disaster, please look over https://code.engineering.redhat.com/gerrit/#/c/174013/18:07
rlandyI think making the tox jobs voting false will allow the revert18:07
rfolcorlandy, you gonna revert if it works ? I don't get it18:11
rfolcoThis change should be reverted18:11
rfolcoif logging is working.18:11
rlandyrfolco: yes - the last time I tried to revert it I could not because the tox jobs failed18:11
rlandyI had to bed fbo to help18:11
rlandybeg18:11
rlandyso - if I set those to non-voting18:11
rlandyI hope that I can revert if need be18:12
rlandyI will revert the tox job settings if the logging works18:12
rfolcorlandy, aaah the tox settings not the change18:12
rfolcoThis is my confusion18:12
rfolcook18:12
rfolcorlandy, so you can't revert the whole thing... its not a revert then18:13
rlandyno - I wil just commit a change to set the tox jobs back18:13
rlandyif logging works18:13
rfolcorlandy, ok, the revert comment makes me think on a full revert18:14
rfolcothx18:14
rfolcorlandy, done, pls see my comment18:21
rlandylooking18:23
*** Goneri has quit IRC18:24
*** dtrainor has quit IRC18:36
*** dtrainor has joined #oooq18:36
*** dtrainor has quit IRC18:42
*** dtrainor has joined #oooq18:43
*** tesseract has quit IRC18:49
rlandyresponded18:50
weshayrlandy is that change impossible to test w/ a check?19:05
weshayah ya it is19:06
*** aakarsh has quit IRC19:07
rlandyweshay: unfortunately19:09
*** chem has quit IRC19:09
rlandythe problem I had before is that check/gate jobs failed19:09
rlandydue to log19:09
rlandyI need to get by that19:09
weshayrlandy the jobs in sf-internal19:09
rlandyyes19:10
*** tcw has quit IRC19:10
*** Goneri has joined #oooq19:10
weshayrlandy how can I help? I looked at the code..  first pass looks good19:11
weshayis the issue w/ variable substitution?19:11
rlandyweshay: the last failure - due to using if/esl line continuations, the varaible was considered a string19:13
rlandythe current version of the patch is not optimized19:13
rlandybut I hope it's safer19:13
rlandyrfolco, has the suggestion to set fact19:13
weshaythat's fine.. better to use just strings or simplify it on the first pass19:13
weshaythat is also a good idea19:14
rlandybut we would need to set fact on the right host19:14
rlandyall I want is to get the vars in19:14
rlandyso we can override them19:14
weshayright19:15
weshayperhaps your first change is just one that produces debug info19:15
rlandyweshay: this biggest question is this ...19:15
rlandyhttps://code.engineering.redhat.com/gerrit/#/c/174013/3/zuul.d/projects.yaml19:15
weshayverify the vars w/o changing the workflow19:15
rlandyif I set these to non-voting19:15
rlandythen I should be able to revert19:16
rlandythat was the blocker last time19:16
rlandyI could not undo my mess19:16
weshayyou and tox19:16
weshaya battle ROyal19:16
rlandyI know, right19:17
weshaywould additional eyes on tox failures help?19:17
rlandythe fault was actually mine19:17
weshayrfolco where did you see rhui-set-release?19:26
rfolcoweshay, its installed by rdo-rhui package19:27
rfolcoin /usr/bin/rhui-set-release19:27
rfolcoweshay, to tell yum where it gets packages from....19:28
weshaythat's has to be a custom script that alan added19:28
weshayrfolco ah I see it19:29
weshayrfolco that does not need to be executed19:29
weshayrfolco https://access.redhat.com/documentation/en-us/red_hat_update_infrastructure/3.0/html-single/system_administrators_guide/index19:29
weshay10.4. Working with the EUS Channel19:29
rfolcoweshay, right, are you able to navigate the rhui-cds repo?19:31
weshayvia httpd?19:32
rfolcobrowse19:32
rfolcohttps://rhui-cds/pulp/repos/content/dist/rhel8/rhui19:32
rfolcowith rhui-cds ip in /etc/hosts19:32
weshayrfolco you browsing from a system w/ the certs?19:35
rfolcono, I just want to make my yum install work somehow.19:35
rfolconot necessarily need to browse through the repo19:37
weshayrfolco did you try a yum install?19:37
rfolcoweshay, yes, but from rhel7 box yet, thats why I tried to set release19:38
weshayrfolco why not rhel 819:38
weshayit's for rhel 819:38
rfolcohttps://rhui-cds/pulp/repos/content/dist/rhel8/rhui/7Server/x86_64/appstream/os/repodata/repomd.xml19:38
weshaythere are no rhel7 repos19:39
rfolcosee 7Server19:39
rfolcoI know19:39
rlandyweshay: rfolco: https://code.engineering.redhat.com/gerrit/174033 Temp disable zuul voting so we can revert changes in logging19:39
rlandylet's try that first19:39
rlandyto check I can disable zuul testing temp19:39
rlandythat will make an easier revert19:39
rlandyrfolco: I didn't ignore your comment - I just want to do this as safely as possible first while we test19:52
rfolcorlandy, no worries. Keep going :)19:52
rlandyweshay: rfolco:ok - I'm going to try this merge again ... https://code.engineering.redhat.com/gerrit/#/c/174013 with any luck, it won;t burn the house down19:53
* rlandy will test it afterwards19:53
*** holser_ has joined #oooq19:56
rlandydamage is donw19:59
rlandydone19:59
*** holser_ has quit IRC20:00
weshayrlandy need your help in merging this.. https://review.rdoproject.org/r/#/c/21099/20:04
weshayrlandy I need to rebase first I guess20:04
rlandyyep - pls20:04
weshayrlandy need it to determine reproducer health for matbu20:04
*** matbu has quit IRC20:09
*** Vorrtex has quit IRC20:10
rlandyso better but no cigar20:14
weshayrlandy so I was slow, sorry.. can you wf https://review.rdoproject.org/r/#/c/21099/20:14
rlandyk - let's try it20:15
weshayrlandy have you seen this?20:23
weshaystack_status          | CREATE_FAILED                                                                                                                                                                                              |20:23
weshay| stack_status_reason   | Resource CREATE failed: resources.baremetal_env: Property error: resources.bmc_server.properties.image: Error validating value 'bmc-template': No images unique match found for {'name': u'bmc-template'}. |20:23
weshay| parameters            | OS::project_id: 4baea7454bf4451aa56da82fc5baf6f620:23
rlandyweshay: ack20:23
rlandysomeone mus have uploaded new image with same name20:24
rlandyyou can refer to the image id20:24
rlandy or remove old one20:24
rlandyweshay: sec - just fixing logging20:24
weshayrlandy k20:24
rlandyone monent and I will look more20:24
weshayrlandy dupe names would cause that right?20:26
weshaywhayutin•/tmp ᐅ  openstack image list | grep bmc                                                                                                                                                thinkdoe ⌚ 14:25:2820:26
weshay| c59224e2-c5df-4a86-b7b6-49556d8c7f5c | bmc-base                                  | active |20:26
weshay| b145783b-07e0-4e4a-b99a-d094cdbb6386 | bmc-template                              | active |20:26
weshay| c1f9afa1-2f96-4264-8e06-5c111a9966ba | bmc-template                              | active |20:26
weshaywhayutin•/tmp ᐅ20:26
rlandyweshay: exactly20:26
weshayrfolco20:26
weshay<@nhicher>  thanks weshay, I will try to set it up20:26
weshay14:20 <@nhicher>  weshay: dns is mirror-rdo.usersys.redhat.com, but it's not yet available20:26
weshay14:21 <@nhicher>  weshay, rlandy: you will have to update mirror_fqdn on ./playbooks/configure-mirrors.yaml and ./playbooks/tripleo-rdo-base/pre.yaml on tripleo-ci-internal-config20:26
weshay14:22 <@nhicher>  weshay, rlandy: I will ping you when the dns record will work20:26
weshay14:22 <@nhicher>  weshay, rlandy: it works20:26
rlandyweshay: see two options above20:27
weshayrfolco can you try that mirror w/ your standalone job?20:27
rlandyrfolco:hang on one min20:28
rfolcoweshay, I have to convince my patch to accept me back. I abandoned it.20:28
rlandyreverting logging again20:28
rlandyneeds another patch20:28
weshayrlandy k20:28
weshayrlandy any idea how to tell which is the right one?20:28
weshaymaybe the public one20:28
rlandyweshay: one more minute to merge this and let's bj to check20:29
weshayI nuked the shared one :)20:29
* rlandy hates config20:29
rlandyI would look at dates20:29
rlandythere may be an update20:29
weshayya.. didn't see date :(  I had the same thought :)20:30
*** matbu has joined #oooq20:31
rlandyweshay:ok - can look now if you still need20:32
weshayrlandy giving it a go, will holla if I see another ovb issue20:32
rlandyok20:32
rlandyrfolco: you can run jobs again20:32
rlandyreverted to fix secret20:32
rfolcook, thx rlandy20:33
rlandygetting there slowly20:33
*** jtomasek has quit IRC20:38
rlandyrfolco: ping - can you create a secret for me? mine is getting decryption failed20:50
rlandyhttps://code.engineering.redhat.com/gerrit/#/c/174036/20:50
rlandyI want to check20:51
rfolcorlandy, how did you execute the encrypt command ?20:51
rlandysending in pvt20:51
rfolcok20:51
weshayrlandy do you have two bmc-templates in your personal tenant?20:52
rlandychecking20:52
rlandybmc-template Image Active shared No QCOW2 1.34 GB20:53
rlandybmc-template Image Active Public Yes QCOW2 1.44 GB20:53
rlandyweshay:yes - weird20:53
rlandyCreated At20:54
rlandy    2017-06-06T16:51:59Z20:54
rlandyUpdated At20:54
rlandy    2019-05-10T11:32:15Z20:54
weshayprimary node is marked unreachable20:55
weshayoh they do have dates :)20:55
rlandyweshay:a public image has to be added by admins20:55
rlandythat must have been recent20:55
rlandyI think we shared the bmc_template within the team20:55
weshayya..20:56
weshay019-06-19 20:56:26.017993 | primary | Output suppressed because no_log was given20:57
weshay2019-06-19 20:56:26.050790 |20:57
weshay2019-06-19 20:56:26.050969 | TASK [mirror-info : Create /etc/ci]20:57
weshay2019-06-19 20:56:50.226007 | primary | ERROR20:57
weshay2019-06-19 20:56:50.226281 | primary | {20:57
weshay2019-06-19 20:56:50.226344 | primary |   "msg": "SSH Error: data could not be sent to remote host \"38.145.34.185\". Make sure this host can be reached over ssh",20:57
weshay2019-06-19 20:56:50.226427 | primary |   "unreachable": true20:57
weshay2019-06-19 20:56:50.226477 | primary | }20:57
weshay2019-06-19 20:56:50.253249 |20:57
weshay2019-06-19 20:56:50.253422 | PLAY RECAP20:57
weshay2019-06-19 20:56:50.253526 | localhost | ok: 3 changed: 0 unreachable: 0 failed: 020:57
weshay2019-06-19 20:56:50.253609 | primary | ok: 21 changed: 11 unreachable: 1 failed: 020:57
rlandydiff problem20:58
weshayrlandy I wonder what that ip is20:58
weshay11 unreachable, 1 failed20:58
rlandyrfolco: thanks - I think that worked21:00
rfolco\o/21:01
rlandyweshay: that's weird21:01
weshay2019-06-19 20:55:06.447287 | LOOP [emit-job-header : Print node information]21:02
weshay2019-06-19 20:55:06.542560 | localhost | ok:21:02
weshay2019-06-19 20:55:06.542745 | localhost | # Node Information21:02
weshay2019-06-19 20:55:06.542797 | localhost | Hostname: tripleo-ovb-centos-7-localhost-rdo-cloud-000000000521:02
weshay2019-06-19 20:55:06.542842 | localhost | Provider: localhost-rdo-cloud21:02
weshay2019-06-19 20:55:06.542883 | localhost | Label: tripleo-ovb-centos-721:02
weshay2019-06-19 20:55:06.542922 | localhost | Interface IP: 38.145.34.18521:02
weshay2019-06-19 20:55:06.573006 |21:02
weshaywhayutin•RDO-CI/TRIPLEO-QUICKSTART/review.rdoproject.org-config ᐅ  openstack server list                                                              review/arx_cruz/periodic-reproducer-job✔ thinkdoe ⌚ 15:03:0621:03
weshay+--------------------------------------+-----------------------------------------------------+--------+----------------------------------+-----------------------------+----------+21:03
weshay| ID                                   | Name                                                | Status | Networks                         | Image                       | Flavor   |21:03
weshay+--------------------------------------+-----------------------------------------------------+--------+----------------------------------+-----------------------------+----------+21:03
weshay| c9335b54-ce67-4571-a22b-9e5d3aa66845 | tripleo-ovb-centos-7-localhost-rdo-cloud-0000000006 | ACTIVE | private=10.0.0.18, 38.145.34.12  | upstream-cloudinit-centos-7 | m1.large |21:03
weshay| 79dae56c-5056-4a6f-90d1-ad10e624f3a9 | tripleo-ovb-centos-7-localhost-rdo-cloud-0000000003 | ACTIVE | private=10.0.0.20, 38.145.33.142 | upstream-cloudinit-centos-7 | m1.large |21:03
weshayweird21:03
rlandynothing to do with bmc21:06
weshaynope21:06
* weshay goes for a run21:06
weshaybbiab21:07
rlandyrfolco: going to try the logging patch again21:21
rlandyjust fyi - in case I break something else21:21
rfolcorlandy, I gotta go ttyl21:26
*** rfolco is now known as rfolco_off21:26
rlandyrfolco: k - have a good night21:27
rfolco_offrlandy, thx you too21:27
rlandywoohoo21:29
rlandyI think default may be ok21:30
zbr|ruckweshay: rlandy : see if you can wf https://review.opendev.org/#/c/666283/1 -- it can prove useful tomorrow.21:53
rlandydone21:54
rlandyweshay: have a doctor's appointment tomorrow morning - will be in later22:01
zbr|ruckthanks. also https://review.opendev.org/#/c/664947/ would use a wf in case all starts would align and it would pass.22:02
rlandyzbr|ruck: I w+ - but it failed22:14
zbr|ruckhopefully it will pass over the night and it will go into the gate. i am switching to suspend mode now...22:16
*** aakarsh has joined #oooq22:16
*** zbr|ruck has quit IRC22:17
*** aakarsh has quit IRC22:22
*** rlandy is now known as rlandy|bbl22:24
*** aakarsh has joined #oooq22:26
*** aakarsh has quit IRC22:35
*** vinaykns has quit IRC22:55
*** rfolco_off has quit IRC22:56
*** aakarsh has joined #oooq23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!