Thursday, 2021-10-28

*** pojadhav|out is now known as pojadhav|ruck02:46
*** ysandeep|out is now known as ysandeep05:06
chandankumardpawlik: hello05:07
chandankumardpawlik: I am running cs9 container multinode job here https://review.rdoproject.org/r/c/testproject/+/34926, during Remove the build SSH key from all nodes task, connection to node is timing out https://review.rdoproject.org/r/c/rdo-jobs/+/36460/1#message-78690e2d2839ac5d536d040b33125a191e52b097 please have a look, when free , thanks !05:09
ysandeepchandankumar, thanks for workflowing c9 standalone in integration line, I am also adding standalone in all components and component promotion criteria so that components keep promoting in c9.05:11
chandankumarysandeep: awesome :-)05:11
chandankumar++05:11
chandankumarsc1 to 4 is also in good shape05:12
chandankumarhttps://review.rdoproject.org/r/c/rdo-jobs/+/3646405:12
chandankumarsorry not in good shape taking a look at failure https://review.rdoproject.org/r/c/testproject/+/3646505:13
chandankumarfrenzy_friday: \o morning05:13
frenzy_fridaychandankumar, hey, good morning05:13
frenzy_fridayc9 scenario001 and scenario004 failed finally05:13
chandankumar"Not found image: https://trunk.registry.rdoproject.org/v2/tripleomastercentos9/openstack-collectd/manifests/336a068c9e6198e5f6a04848dc579371", "msg": "Error running container image prepare: Not found image: https://trunk.registry.rdoproject.org/v2/tripleomastercentos9/openstack-collectd/manifests/336a068c9e6198e5f6a04848dc579371", "params": {}, "success": false}05:14
chandankumar2021-10-27 23:40:33.263973 | fa163ecb-4646-d937-e815-00000000166b |     TIMING | tripleo_container_image_prepare : Container image prepare | undercloud | 0:05:16.464123 | 114.27s05:14
chandankumarfrenzy_friday: collectd container is not built which is expected05:15
frenzy_fridayyep,  Non-2xx: id b6c292f414b36a95a611d60d4628a022a756892a, status 404, reason Not Found05:15
frenzy_fridaybut scenario002 and 003 do not need collectd?05:16
chandankumarfrenzy_friday: nope05:16
frenzy_fridayok05:16
chandankumarfrenzy_friday: https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/ci/environments/scenario001-standalone.yaml#L1505:16
frenzy_fridaychandankumar, oh, ok. thanks05:17
chandankumarfrenzy_friday: sc4 have different issue https://logserver.rdoproject.org/65/36465/1/check/periodic-tripleo-ci-centos-9-scenario004-standalone-master/1aadd0d/logs/undercloud/home/zuul-worker/standalone_deploy.log05:17
chandankumar FATAL | set tripleo-ansible ceph dashboard vars | undercloud | error={"changed": false, "msg": "No key/value pairs provided, at least one is required for this action to succeed"}05:17
chandankumarfrenzy_friday: please open a bug for sc4 and cix it05:18
ysandeepchandankumar, frenzy_friday I see other scenarios standlone tasks in mini integration story.. imho.. those should go to "build out full integration line" story.  If you agree we can move them under that story.05:18
chandankumarysandeep: yes, we can close out the mini integration line, and move remaining tasks in full integration line05:19
ysandeepiirc.. mini integration line is .. container/image build and vanilla stanalone only.. 05:19
chandankumarysandeep: for image build, we need to add the jobs to the integration line05:19
chandankumarhttps://review.rdoproject.org/r/c/config/+/3623405:19
ysandeepchandankumar, ack, I can propose a patch to add in the integration line 05:21
chandankumarysandeep: awesome ++05:21
* ysandeep updating board05:21
*** ykarel|away is now known as ykarel05:46
ysandeepchandankumar, for component jobs we need first current-tripleo promotion for c9 master.05:52
chandankumarysandeep: yes05:53
chandankumarysandeep: may be we can add full tempest api, scenario and vanila stnadalone to promotion criteria05:53
chandankumarit will create current tripleo05:53
chandankumarBut we merged the cs9 promoter config changes05:54
chandankumarlet me take a look at promoter config05:54
ysandeepack, sound good.. for now i think just first promotion is enough, I don't want c9 master hashes to be ahead of c8 master hashes... (last time in wallaby branching we hit some issues in wallaby integration which were hidden in master component lines)05:57
chandankumarysandeep: something is not good there http://promoter.rdoproject.org/promoter_logs/centos9_master.log05:57
chandankumarhttp://promoter.rdoproject.org/config/CentOS-9/master.yaml05:58
ysandeephmm.. promote-promoted-components should not be in criteria.. 06:00
chandankumaryes,06:00
ysandeepchandankumar, let me put a patch to add standalone and remove promote-promoted-components 06:01
ysandeepfull tempest api, scenario - do we have patches to add job definition? otherwise I can put them06:02
chandankumarlet me find out those patches06:02
chandankumarysandeep:  https://review.rdoproject.org/r/c/rdo-jobs/+/36363 and https://review.rdoproject.org/r/c/testproject/+/3636406:02
chandankumarysandeep: for api there is no review for job definition06:04
chandankumarhttps://review.rdoproject.org/r/c/testproject/+/35229/29/.zuul.yaml06:04
ysandeepchandankumar, ack i can add that06:04
ysandeepchandankumar, ^^ bhagyashri patch is in merge conflict.. let me add api in same patch as well06:07
chandankumarok06:07
akahatchandankumar, why we are using centos8 jobas a parent in c9 jobs?06:09
akahatlike it's in the above patch: https://review.rdoproject.org/r/c/rdo-jobs/+/36363/2/zuul.d/integration-jobs-cs9-master.yaml#1406:10
chandankumarakahat: good question, for initial mini integration line, we have started using cs8 job as a parent and we have not created cs9 base job as upstream nodes were not available06:11
chandankumarakahat: we will revisit that once we have nodes available06:11
chandankumarand then replace the parent06:12
chandankumarakahat: if you want to replace those parent from upstream to downstream, Please go ahead and propose the patches06:13
chandankumarlet me add a card06:13
akahatokay. thanks for clarification.06:13
akahatsure. 06:13
chandankumaranother to take into account06:13
chandankumarcurrently we are using virt customized nodepool image in rdo side it will change to dib some day06:14
chandankumar*another thing06:14
ysandeepchandankumar, fyi.. https://review.rdoproject.org/r/c/rdo-jobs/+/36363 updated for api/scenario.. rerunning testproject 06:36
ysandeepfrenzy_friday, ^^  fyi.. 06:37
ysandeepchandankumar, frenzy_friday i have moved the tasks from mini-integration story to full-integration line story (those should belong there)06:42
chandankumarysandeep: frenzy_friday marios I have added a tech debt card to remove all workaround in future https://issues.redhat.com/browse/TRIPLEOCI-70506:46
chandankumarplease do add there06:46
chandankumarif you find one06:46
frenzy_fridayack06:46
marioschandankumar: k06:47
ysandeepchandankumar: ok, thanks!06:50
*** jpena|off is now known as jpena06:54
*** amoralej|off is now known as amoralej07:06
* frenzy_friday lunch07:37
ysandeepmarios: hello o/ I see you have already added periodic image build jobs definitions, thanks for that. Can I wire them up so that they can run in integration line, chandankumar and me are trying to wire things up before first current-tripleo promotion.07:38
mariosysandeep: sure go ahead 07:39
ysandeepmarios++ thanks! 07:39
chandankumarpojadhav|ruck: https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/285577/3#message-c1392ecdf0ba6790024347fc3bd56c0998d79a3c please have a look when free, thansk@07:40
ysandeepmarios, chandankumar fyi.. https://review.rdoproject.org/r/c/rdo-jobs/+/3647907:43
ysandeepmarios: one thing i want to confirm, do we not need overcloud-hardened-full , I only see overcloud-hardened-uefi-full in job def patch... I recall some discussion in the past abour replacing overcloud-hardened-full with overcloud-hardened-uefi-full.. If that's the case I think we are good.07:44
mariosysandeep: yeah the uefi-full is the new 'hardened' we wont need a standalone hardened job any more07:44
ysandeepmarios: ack, thanks for confirming 07:45
pojadhav|ruckchandankumar, yup working on comments.. thanks for review..!!07:46
*** ysandeep is now known as ysandeep|lunch07:48
*** pojadhav is now known as pojadhav|ruck07:51
* pojadhav|ruck lunch07:51
* frenzy_friday back08:09
*** ykarel is now known as ykarel|lunch08:34
* pojadhav|ruck back08:34
*** ysandeep|lunch is now known as ysandeep08:45
ysandeepperiodic overcloud-full failed on running image sanity: https://logserver.rdoproject.org/54/32054/48/check/periodic-tripleo-centos-9-buildimage-overcloud-full-master/4bc12fb/job-output.txt 09:17
ysandeepI see the testproject have image_sanity: false https://review.rdoproject.org/r/c/testproject/+/36267/7/.zuul.yaml#35 , do we want to add image_sanity: false in periodic job def as well for the timebeing?09:18
mariosysandeep: yes we don't know if it is an issue with the image or something to do with virt-tools/image sanity for cs9 yet 09:19
mariosysandeep: this is why i'm chasing fs1/ovb to test if the image is ok 09:19
mariosysandeep: https://review.opendev.org/c/openstack/tripleo-ci/+/808177/16..18/playbooks/tripleo-buildimages/pre9.yaml#8 09:19
ysandeepmarios: ack09:22
ysandeepchandankumar, Update criteria file for c9: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3648209:26
*** ysandeep is now known as ysandeep|afk09:46
*** ykarel|lunch is now known as ykarel10:04
*** rlandy is now known as rlandy|ruck10:31
rlandy|ruckmarios: hey - want to talk about PSI request10:37
mariosrlandy|ruck: sure10:37
*** ysandeep|afk is now known as ysandeep10:37
rlandy|ruckhttps://meet.google.com/dxc-nihv-tzx?pli=1&authuser=010:37
rlandy|ruckmarios: ^^10:37
mariosrlandy|ruck: ack 10:37
chandankumarmarios: can you vote on this one https://review.opendev.org/c/openstack/releases/+/814827 as a tripleo liason (I think)?10:47
chandankumarThanks!10:47
chandankumarWhen free 10:47
marioschandankumar: has to be the ptl 10:47
*** dviroel|rover|afk is now known as dviroel|rover10:50
chandankumarpojadhav|ruck: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/815777/3#message-ba7b649de89961767bc1461345fbb4b6f1b74ac610:51
marioschandankumar: sec in call will check 10:52
pojadhav|ruckchandankumar, checking10:53
pojadhav|ruckchandankumar, will check with wallaby as well. thanks10:55
chandankumardviroel|rover: \o. please have a look at this review https://review.opendev.org/c/openstack/tripleo-ci/+/81553710:58
dviroel|roverchandankumar: hi10:59
dviroel|roverchandankumar: doesn't seems to be helping us10:59
chandankumarrlandy|ruck: dviroel|rover please have a look at this one https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/814641 when free, thansk!10:59
marioschandankumar: voted on there but it needs the ptl to vote for the ptl-approved label 11:00
chandankumarysandeep: please have a look at this https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/79745211:01
chandankumarmarios: aye, Thank you :-)11:02
ysandeepchandankumar, ack, will check in my next round of reviews11:03
chandankumarysandeep: aye, thanks :-)11:05
*** ykarel is now known as ykarel|afk11:15
rlandy|ruckarxcruz: hey ... https://review.opendev.org/c/openstack/tripleo-ci/+/81362911:19
rlandy|ruckis there a testproject patch with the update/upgrade jobs we can check before merging?11:19
*** jpena is now known as jpena|lunch11:23
rlandy|ruckjbadiapa: hi - we're looking at https://bugs.launchpad.net/tripleo/+bug/194907011:24
rlandy|ruckwe merged https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/806284 yesterday11:24
rlandy|ruckis that related to your issue?11:24
rlandy|ruckshould we revert that?11:24
ysandeeprlandy|ruck, i think jbadiapa reported that to track issue as suggested by chandankumar https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/797452 11:26
jbadiaparlandy|ruck: hi, yes, ysandeep is right... that bug is to match the VMs with the flavors11:26
rlandy|ruckysandeep: ack - I am just looking for the cause11:26
rlandy|ruckjbadiapa: ack - just looking for the patch that caused this11:26
rlandy|ruckif it was related to what we merged yesterday11:27
jbadiaparlandy|ruk, it's been at least for a long time....even several releases11:27
rlandy|ruckjbadiapa: ok - we're looking to merge this patch https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/809487/11:28
rlandy|ruckbut we won;t do it if there is already an issue with the patch below11:28
* ysandeep confused on how these two things are related11:29
jbadiapaysandeep, me too11:29
jbadiaparlandy|ruck: maybe we are talking about https://bugs.launchpad.net/tripleo/+bug/1948001  11:30
ysandeepyeah, but even that's atleast 1 - 2 weeks older11:31
ysandeepnot started yesterday11:32
rlandy|ruckjbadiapa: hi - we need to send that to hardware prov11:32
ysandeeprlandy|ruck, I am taking at look at that bug right now.. I will check with  hardware prov if needed11:32
jbadiapanothing regarding yesterday from my side. The bug I created today was due to the fact that chandankumar asked me on the patch submitted11:33
jbadiapaas ysandeep said before11:33
rlandy|ruckjbadiapa: k - just fyi - if you want a bug to be noticed, you can ping us with it - also triage with the current release - yoga-1 and mark it triaged in status and high/critical11:34
rlandy|ruckysandeep: do we need to raise that as a CIX?11:34
ysandeeprlandy|ruck: no its only impact manual deployment and we have a workaround whole_disk=false11:34
*** ysandeep is now known as ysandeep|mtg11:35
rlandy|ruckysandeep: ok - we need to doc that somewhere11:35
rlandy|ruckwe need to out stevebaker on those as a FYI11:35
jbadiaparandly|ruck, ysandeep: the point is with the whole_disk_images=false is using the old way instead the new hardened.qcow2 image 11:35
rlandy|ruckyeah11:38
rlandy|ruckso we need to raise these to stevebaker11:38
jbadiaparlandy|ruck: ok, I will ping you next time. thx11:38
jbadiapaI haven't seen him on the irc or dont know his nickname11:39
ysandeep|mtgjbadiapa, irc: stevebaker , but he is in newzealand   11:41
jbadiapaoh, I see, thx.11:42
rlandy|ruckjbadiapa: pining harold on #tripleo11:42
rlandy|ruckon where to raise these bugs11:42
* ysandeep|mtg trying to reproduce your issue in my local env, I will let you know if I find anything.11:42
jbadiaparlandy|ruck: btw, I would like to talk to you regarding creating a periodic job for testing backup and restore with ironic integration. is it possible? 11:43
jbadiapaysandeep|mtg, thx 11:43
rlandy|ruckjbadiapa: sure - I have some time open in my calendar tomorrow - feel free to book some time11:43
jbadiaparlandy|ruck: great thx, I'll do 11:44
mariossshnaidm: o/ around? do you have a few mins to help me debug some issues with ovb - trying to get the c9 fs1 job working there https://review.rdoproject.org/r/c/testproject/+/36267 - main problem/confusion now is that the bmc_console shows it booting c7 11:44
marioshttps://logserver.rdoproject.org/67/36267/7/check/tripleo-stream9-development-centos-9-ovb-3ctlr_1comp-featureset001-master/7d6afee/logs/bmc_7_59942-console.log (even though we merged that https://review.rdoproject.org/r/c/config/+/36457 )11:45
mariossshnaidm: doesn't have to be now we can schedule a time that works for you11:45
sshnaidmmarios, looking11:46
frenzy_fridayHey rlandy|ruck Can we merge this one https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/815823 ? This has a real bug with it which can be CIXed. So we can check the changes in the trello script as well11:46
rlandy|ruckfrenzy_friday: cool - looking11:47
frenzy_fridayrlandy|ruck, also, did I miss any tag in this bug https://bugs.launchpad.net/tripleo/+bug/1949033 ? It does not show up on cix trello board11:47
rlandy|ruckfrenzy_friday: let me check the server11:48
mariossshnaidm: stack params look OK https://paste.opendev.org/raw/810248/ (undercloud_image is set to the genericcloud-9 which we added with https://review.rdoproject.org/r/c/config/+/36457 - the job is failing right now cos it cannot attach instance to provision OVB network (No server with a name or ID  exists)11:48
frenzy_fridaythanks11:48
mariossshnaidm: thanks 11:48
* pojadhav|ruck stepping out for dr appointment11:48
rlandy|ruckfrenzy_friday: it's there11:49
rlandy|ruckin new/triaged11:49
rlandy|ruckmerging your change11:49
*** ysandeep|mtg is now known as ysandeep11:51
sshnaidmmarios, weird, seems like it either detects undercloud ID wrong, or trying to connect to a different cloud where this ID doesn't exist11:53
frenzy_fridayrlandy|ruck, oh ok, I see it now. So when  https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/815823 merges we should hopefully see a health link in the desc11:54
jbadiaparlandy|ruck: I've already sent the invitation. I aslo added jfrancoa (wants to know about it)11:54
jbadiapathx11:54
mariossshnaidm: yeah... one thing i noticed is that it fails to retrieve the undercloud ID from the file (there is a trace there grep "Find out UUID of instance with metadata file") and fetches from the metadata service11:54
mariossshnaidm: compared to a 'good' c8 job where it gets it from the file11:54
rlandy|ruckjbadiapa: pls add ysandeep as well11:55
sshnaidmyeah, it's possible from both usually, we switched to file to not abuse metadata server11:55
sshnaidmmarios, let's hold a job to see11:55
rlandy|ruckjbadiapa: and marios11:55
jbadiapasure11:55
mariossshnaidm: ack ok i'll try get a hold on it and will ping again thanks for checking for now anyway 11:55
ysandeepjbadiapa: my email: sandyada@redhat.com 11:56
jbadiapathx11:56
sshnaidmmarios, you can add following to keep ovb stack too: https://paste.opendev.org/show/810250/11:56
mariossshnaidm: k will do 11:57
jbadiapalet me know if the time does not work for you11:57
mariosamoralej: o/ hello are you the right person to ask about holding a node? or is there someone 'on duty' i can go ask instead ;) 12:00
amoraleji can do it12:00
amoralejmarios, which job and repo?12:01
mariosamoralej: thank you sir... please there https://review.rdoproject.org/r/c/testproject/+/36267 for job tripleo-stream9-development-centos-9-ovb-3ctlr_1comp-featureset001-master 12:01
mariosamoralej: i am about to update it so it will re-run in a bit12:01
amoralejok12:01
mariosamoralej: thank you very much 12:01
*** jpena|lunch is now known as jpena12:22
*** amoralej is now known as amoralej|lunch12:28
chandankumardpawlik: pojadhav|ruck is there a bug report for these failure https://logserver.rdoproject.org/82/815782/2/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/6ea5950/job-output.txt12:39
chandankumar /bin/tripleo-mount-image: line 210: [: missing `]'12:39
chandankumarsorry dpawlik it was for dviroel|rover 12:40
dviroel|roverchandankumar: don't think so, checking 12:45
dviroel|roverchandankumar: no, we don't have a LP, i can see three failures here https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset00112:51
dviroel|roverbut doesn't always happen12:51
dviroel|roverfails around 45m12:52
ysandeepmarios: Congratulation on new headphone :D13:01
chandankumaryes it's anew one13:01
rlandy|ruckdviroel|rover: scrum13:02
dviroel|roverack13:02
akahatlooks like new headphone do not have light. :)13:02
sshnaidmmarios, as it looks - this job is not running on vexxhost13:02
sshnaidmmarios, it runs on PSI.. can it be?13:03
marioshttps://logserver.rdoproject.org/67/36267/7/check/tripleo-stream9-development-centos-9-ovb-3ctlr_1comp-featureset001-master/7d6afee/zuul-info/inventory.yaml 13:13
marioshttps://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/ovb-manage/defaults/main.yml sshnaidm 13:16
*** ykarel|afk is now known as ykarel13:19
rlandy|ruckreview list:13:19
rlandy|ruckhttps://review.rdoproject.org/r/c/rdo-jobs/+/3648313:19
rlandy|ruckhttps://review.rdoproject.org/zuul/build/ef0801c8a7284270a7407328e8a9a041, https://review.rdoproject.org/zuul/build/687d8c1feebd427c8fdfcd556a5804a413:20
*** amoralej|lunch is now known as amoralej13:20
frenzy_fridayhttps://review.rdoproject.org/r/c/rdo-infra/ci-config/+/36484 - 002 003 in criteria13:21
sshnaidmmarios, well, seems like it IS on vexxhost..13:22
akahathttps://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3647713:25
ykarelsshnaidm, i think ^ happening as it's not in tripleo nodepool tenant13:29
ykarelProvider: vexxhost-nodepool-sf from job logs13:30
ykarelshould be tripleo one to get creds working13:30
sshnaidmykarel, so it's not our usual tenant?13:31
ykarelsshnaidm, yes for tripleo it's vexxhost-nodepool-tripleo13:31
ykarelmay be can check other jobs13:31
sshnaidmykarel, oh, right13:31
sshnaidmdpawlik, I think we found ^^13:32
rlandy|ruckhttps://review.rdoproject.org/r/c/rdo-infra/ci-config/+/36477/1/ci-scripts/dlrnapi_promoter/dlrnapi_promoter.py13:35
rlandy|ruckmarios: ^^13:35
mariosthanks13:35
arxcruzrlandy|ruck: https://review.opendev.org/c/openstack/tripleo-ci/+/81362913:45
ysandeepchandankumar, full-tempest-api is rerunning.. lets wait for current run to finish before adjusting the criteria..13:45
chandankumarysandeep: proposing a patch to modify the criteria13:45
chandankumarysandeep: ok13:46
ysandeeplast 2 run failed on different tempest test.. I think it may pass13:46
chandankumarsshnaidm: on ovb patch, updated with depends on13:56
chandankumarnodeset13:56
frenzy_fridaytripleo critical bugs script is adding health links if present on cix cards now \O/: https://trello.com/c/YeTRbuU5/2204-cixlp1949033tripleociproa-no-key-value-pairs-provided-at-least-one-is-required-for-this-action-to-succeed13:58
mariosthank you amoralej 13:58
mariosamoralej: also rlandy pointed me to https://sf.hosted.upshift.rdu2.redhat.com/etherpad/p/zuul_admin_HOWTO so hopefully next time i can do it without bothering you (famous last words)13:59
dviroel|roverrlandy|ruck: ysandeep pojadhav|ruck arxcruz https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3647114:00
dviroel|rover^ fixind rdo promotions panel14:01
ysandeepdviroel|rover, ack 14:01
dviroel|roversnapshot in the comments, thanks14:01
ysandeepthanks! checking.. I will vote soon14:01
dviroel|rovertks!14:02
ysandeepdviroel|rover, the grafana snapshot you shared is from production server or do you have a development environment ?14:06
arxcruzdviroel|rover: i was about to send similar patch 14:08
arxcruzdviroel|rover: i think for upstream we need the docker-compose host variable 14:08
arxcruzi know local it fails if we have that 14:08
akahatrlandy|ruck, o/ re: sc10 jobs.. we are good with the all branch results, except ussuri check jobs are failing.14:09
rlandy|ruckakahat: yeah - let's touch base on that14:09
rlandy|ruckgive me a few14:09
akahatokay14:10
rlandy|ruckdviroel|rover: thanks - will look in a bit14:11
rlandy|ruckjust fighting missing laptop for new hire14:12
rlandy|ruckmarios: ^^ fyi - will approve when done with this battle :)14:12
mariosrlandy|ruck: ack thanks14:14
dviroel|roverarxcruz: hi o/14:25
arxcruzdviroel|rover: oi sumido xD 14:25
dviroel|roverarxcruz: hum, but doesn't make sense to enable host network and expose a port14:25
dviroel|roverarxcruz: all other containers don't use host networking too14:26
arxcruzdviroel|rover: we can try, if it fails, we know who to blame :P 14:26
* dviroel|rover runs14:26
dviroel|roverysandeep: my dev environment14:27
arxcruzade_lee_: hi, what can i do for you regarding the collect_logs and your fips test14:28
rlandy|ruckade_lee_: ^^ this is your man on collect logs issues14:28
rlandy|ruckpls post the failure log we looked at yesterday14:28
rlandy|ruckdviroel|rover: pojadhav|ruck: fyi https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/view/phase-1-pipelines/14:42
rlandy|ruckphase 1 jobs have gone missing14:42
rlandy|ruckrdo guys are trying to restore them14:42
pojadhav|ruckrlandy|ruck, oops 14:42
rlandy|ruckyeah right14:42
dviroel|rover´・_・`14:42
ade_lee_rlandy|ruck, arxcruz sorry in another conversation14:46
arxcruznp 14:46
ade_lee_rlandy|ruck, incidentally what we tried yesterday failed - it still looks like the env file was not added14:47
rlandy|ruckhmmm ...14:51
*** ykarel is now known as ykarel|away14:51
rlandy|rucksshnaidm: hey ...to add a new file to env standalone deploy ... 14:52
rlandy|ruckhttps://review.opendev.org/c/openstack/tripleo-quickstart/+/815750/3/config/general_config/featureset052.yml14:52
rlandy|ruckstandalone_custom_env_files14:52
rlandy|ruckis the right var?14:52
rlandy|ruckis there another one we are using or overriding these days?14:52
rlandy|ruckade_lee_: ^^ checking14:53
ade_lee_rlandy|ruck, so maybe I need to override standalone_custom_env_files in my job -- maybe its not using featureset 52?14:58
ade_lee_sshnaidm, ^^14:58
rlandy|ruckit should be14:58
rlandy|ruckade_lee_: where is the testproject run14:58
* rlandy|ruck wants to check the variable14:58
rlandy|ruckakahat: let's chat after DF call14:59
ade_lee_I don't think we did one recently14:59
sshnaidmrlandy|ruck, ade_lee_ we are talking about standalone ipa job, right?15:00
rlandy|ruckade_lee_: it's in the deploy file on your job - afaict15:01
ade_lee_sshnaidm, for one .. but also scenario 2 ..15:01
rlandy|ruckhttp://pastebin.test.redhat.com/100464115:01
ade_lee_rlandy|ruck, really -- looking?15:01
rlandy|ruckhttps://6ce576c3d9483acba2ed-75a25eb118ff9373239bb3443dc0d448.ssl.cf1.rackcdn.com/815750/3/check/tripleo-ci-centos-8-standalone/1a9255a/logs/undercloud/home/zuul/index.html15:01
rlandy|ruckFileNotFoundError: [Errno 2] No such file or directory: '/home/zuul/tripleo-deploy/tripleo-heat-installer-templates/environments/fips.yaml'15:02
rlandy|ruckNone15:02
rlandy|ruck[Errno 2] No such file or directory: '/home/zuul/tripleo-deploy/tripleo-heat-installer-templates/environments/fips.yaml'15:02
rlandy|ruckade_lee_: it tried to include it15:02
rlandy|ruckbut didn't find the file15:02
sshnaidmade_lee_, rlandy|ruck maybe here? https://github.com/openstack/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L852-L85615:02
ysandeepchandankumar, full-tempest-api passed https://review.rdoproject.org/r/c/testproject/+/3636415:03
*** ysandeep is now known as ysandeep|mtg15:03
rlandy|rucksshnaidm: sorry - I think we are ok15:03
rlandy|ruckit did try include the added file15:03
chandankumarsshnaidm: ysandeep|mtg marios https://review.rdoproject.org/r/c/rdo-jobs/+/3648615:03
chandankumarand https://softwarefactory-project.io/r/c/config/+/2300715:03
ade_lee_rlandy|ruck, I think I'm confused - let me look again15:05
rlandy|ruckade_lee_: I checked the standalone run on that job15:05
rlandy|ruck-e /usr/share/openstack-tripleo-heat-templates/environments/low-memory-usage.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/fips.yaml15:06
chandankumarysandeep|mtg: ok, cool, hope this time promoter do cs9 promotion15:06
chandankumarysandeep|mtg: if nodeset change broke anything let me know tomorrow15:07
ade_lee_rlandy|ruck, I was looking at scenario4-standalone15:08
*** pojadhav|ruck is now known as pojadhav|dinner15:08
* rlandy|ruck looks15:08
chandankumarrlandy|ruck: fyi https://review.rdoproject.org/r/c/rdo-jobs/+/3648615:08
ade_lee_rlandy|ruck, yeah - so its not there as far as I can tell15:09
rlandy|ruckade_lee_: https://review.opendev.org/c/openstack/tripleo-quickstart/+/815750 - there is no scneraio 04 on this patch15:10
rlandy|ruckwhat am I missing???15:10
ade_lee_rlandy|ruck, https://review.opendev.org/c/openstack/tripleo-ci/+/80821515:10
chandankumarmarios: is it ok if I include fs02 job in this also https://review.rdoproject.org/r/c/testproject/+/36267 ?15:10
chandankumarwant to see how it behaves when the image gets built with in the job15:11
ade_lee_rlandy|ruck, it helps if we're looking at the right patches together :)15:11
ade_lee_rlandy|ruck, and yes - its in the standalone build here -- I think scenario4  is maybe using a different config file15:12
rlandy|ruckade_lee_: https://github.com/openstack/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L45415:13
rlandy|ruckgets overridden on scenario00415:13
marioschandankumar: sure go ahead 15:13
ade_lee_yeah 15:13
rlandy|ruckyou'll need to add your file there15:13
rlandy|ruckhttps://github.com/openstack/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L43215:13
rlandy|ruckscn003 is the same15:13
ade_lee_ack - ok let me check the rest too15:14
rlandy|ruckade_lee_: so vanilla change fs05215:14
rlandy|ruckall the scenario - add in the job defs15:14
arxcruzrlandy|ruck: ade_lee_ so, which file is not being collected ?15:14
ade_lee_arxcruz, so we're looking at this job .. https://review.opendev.org/c/openstack/tripleo-ci/+/808215 scenario 215:15
ade_lee_https://zuul.opendev.org/t/openstack/build/ea87e0b364ab43c6b31ddc753bc3227415:15
rlandy|ruckade_lee_: vanilla standalone deploy on https://review.opendev.org/c/openstack/tripleo-ci/+/808215 has your change15:15
rlandy|ruckso yeah - multiple changes15:15
ade_lee_arxcruz, consistently, for this job, log collection fails15:15
ade_lee_rlandy|ruck, ack - its never easy :/15:16
* dviroel|rover lunch15:17
arxcruzi see 15:18
ade_lee_arxcruz, which is weird because it isn't failing for any other job15:19
arxcruzfailed: [undercloud] (item=cpuinfo) => {15:19
ade_lee_arxcruz, and when we tried to do this in rdo - log collection succeeds15:20
ade_lee_arxcruz, I think whatever you pasted got truncated15:20
arxcruzade_lee_: https://83d0aab0d56e8ab1cd96-cf2e6d1d128a778849f5c48f17b8a34a.ssl.cf2.rackcdn.com/808215/46/check/tripleo-ci-centos-8-scenario002-standalone/ea87e0b/logs/quickstart_collect_logs.log 15:20
arxcruzfailed: [undercloud] (item=cpuinfo)15:20
arxcruzade_lee_: rlandy|ruck there a bunch of <127.0.0.2> Failed to connect to the host via ssh: OpenSSH_8.0p1, OpenSSL 1.1.1k  FIPS 25 Mar 202115:22
ade_lee_arxcruz, that could make sense -- if I'd expect anything to fail under fips it would be doing an md5 or an ssh connection -- but why does it only fail on this job?15:24
ade_lee_and only on upstream and not rdo15:24
arxcruzade_lee_: maybe the node you're using ?15:24
marioschandankumar: NODE_FAILURE at https://review.rdoproject.org/r/c/testproject/+/36267 i am guessing the depends-on(s) needs to merge for the new label first ? 15:24
arxcruzi saw in the patch that you're using multinode-fips 15:25
chandankumarmarios: depends on should work15:25
chandankumarmarios: mhu is looking into that15:25
ade_lee_arxcruz, right fips is enabled15:25
marioschandankumar: thanks switchign chans15:25
ade_lee_arxcruz, but thats true for all the jobs in that patch (except the content provider ones)15:26
arxcruzade_lee_: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_59b/808215/46/check/tripleo-ci-centos-8-scenario001-standalone/59b66e3/logs/index.html is also not collectiong the logs 15:26
arxcruzbut it passes 15:26
arxcruzade_lee_: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_59b/808215/46/check/tripleo-ci-centos-8-scenario001-standalone/59b66e3/logs/quickstart_collect_logs.log15:27
arxcruzhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_59b/808215/46/check/tripleo-ci-centos-8-scenario001-standalone/59b66e3/logs/quickstart_collect_logs.log15:27
ade_lee_arxcruz, scenario 3 is collecting the logs as is scenario 415:28
mariosamoralej: thanks for help - i deleted the hold request please check make sure all good 15:29
ade_lee_arxcruz, where is the code that tells the log collection to do an ssh?15:31
ade_lee_arxcruz, maybe we're in a situation where its failing because it can only do ssh with rsa and sha1 signatures for some reason -- that would fail under fips.  we might be able to get it to use ecdsa keys instead as a test15:32
rlandy|ruckakahat: hey - sorry :) - still around?15:47
*** ysandeep|mtg is now known as ysandeep15:49
* ysandeep shutdown sequence ..15:49
*** amoralej is now known as amoralej|off15:52
akahatrlandy|ruck, yes.. i'm here15:53
*** ysandeep is now known as ysandeep|out15:53
mariosthanks for chasing it sshnaidm and chandankumar looks like they have another patch up (https://softwarefactory-project.io/r/c/config/+/23008) ... will continue tomorrow15:55
mariossshnaidm: at least feels like forward progress and not just me staring at logs trying to understand wtf is going on with the bmc console... 15:55
rlandy|ruckakahat: hey15:57
arxcruzade_lee_: that's really weird, i'm not seeing any difference between the missing logs one and the normal one, they are even running in the same node 15:57
rlandy|ruckakahat: https://meet.google.com/qzf-zogb-fhu?pli=1&authuser=015:57
rlandy|rucklet's talk scenario01015:57
ade_lee_arxcruz, yeah - definitely weird15:58
arxcruzrlandy|ruck: ade_lee_ i think i found the problem...15:59
rlandy|ruckfrenzy_friday: hey - what's the status of https://bugs.launchpad.net/tripleo/+bug/1944416?16:01
rlandy|ruckdo we still need it?16:01
arxcruzrlandy|ruck: ade_lee_ i think it's timeout, the two jobs that are missing logs, run the collect logs in 14:55 and 15:09 16:01
arxcruzwhile the others in less than that 16:02
rlandy|ruckmarios: can we close https://bugs.launchpad.net/tripleo/+bug/1943968 out?16:02
arxcruzit might be the time that collect logs have to publish it 16:02
ade_lee_arxcruz, huh, I wonder why its taking so long ..16:02
ade_lee_arxcruz, can we increase the timeout?16:02
arxcruzwell, im not sure because one passing is 14:2716:02
sshnaidmmarios, sure, it's infra problem, would impact all c9 jobs anyway16:02
rlandy|ruckakahat: pls ping when you are back or we can talk tomorrow16:03
arxcruznot sure if these 30 seconds is the key 16:03
chandankumarrlandy|ruck: dviroel|rover if https://review.rdoproject.org/r/c/testproject/+/36480 passes then please get the depends on merged16:05
chandankumarto patch sc416:05
* rlandy|ruck looks16:05
*** jpena is now known as jpena|off16:05
rlandy|ruckhttps://review.rdoproject.org/r/c/rdo-jobs/+/36464 in merge conflict16:06
chandankumarrlandy|ruck: dviroel|rover and also keep an eye on this one https://review.rdoproject.org/r/c/testproject/+/3626716:06
rlandy|ruckhttps://review.rdoproject.org/r/c/rdo-jobs/+/36464 has a -116:06
rlandy|ruckchandankumar: ^^16:06
rlandy|ruckthere are a bunch16:06
rlandy|rucknot in status to merge16:06
mariosrlandy|ruck: yes done 16:07
rlandy|ruckmaybe https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81578216:07
rlandy|ruckmarios: thanks16:07
rlandy|ruckwatching the image build jobs16:08
dviroel|roverchandankumar: ok, i'll watch those16:09
ade_lee_arxcruz, are you thinking this is a timeout for the whole job, or for that specific task?16:09
akahatrlandy|ruck, sorry.. i'm back16:09
ade_lee_arxcruz, coz the job itself didn't time out16:10
rlandy|ruckakahat:  https://meet.google.com/qzf-zogb-fhu?pli=1&authuser=016:10
chandankumardviroel|rover: https://review.rdoproject.org/zuul/status#36480 and https://review.rdoproject.org/r/c/testproject/+/36267 this also16:11
chandankumarwill catch up tomorrow morning16:11
chandankumarsee ya!16:13
dviroel|rovero/16:13
rlandy|ruckakahat: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-ussuri&job_name=periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-victoria&job_name=periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-master&job_name=periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-wallaby&job_name=periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-train16:13
*** marios is now known as marios|out16:14
rlandy|ruckakahat: scenario010 branch results16:15
rlandy|ruckall scnario010 jobs are passing in periodic16:16
rlandy|ruckakahat: https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-scenario010-standalone16:17
rlandy|ruckakahat: https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-scenario010-standalone&job_name=https%3A%2F%2Fzuul.opendev.org%2Ft%2Fopenstack%2Fbuilds%3Fjob_name%3Dtripleo-ci-centos-8-scenario010-standalone-wallaby&job_name=https%3A%2F%2Fzuul.opendev.org%2Ft%2Fopenstack%2Fbuilds%3Fjob_name%3Dtripleo-ci-centos-8-scenario010-standalone-victoria&job_name=https%3A%2F%2Fzuul.opendev.org%2Ft%2Fopenstack%2Fbuilds%316:17
rlandy|ruckFjob_name%3Dtripleo-ci-centos-8-scenario010-ussuri&job_name=https%3A%2F%2Fzuul.opendev.org%2Ft%2Fopenstack%2Fbuilds%3Fjob_name%3Dtripleo-ci-centos-8-scenario010-standalone-train16:17
rlandy|ruckakahat: https://trello.com/c/tx4SwUQp/2109-cixlp1895248tripleociproa-master-loadbalancerscenariotesttestloadbalanceripv4crud-showloadbalancer-provisioningstatus-updated-to16:18
rlandy|ruckakahat: https://bugs.launchpad.net/tripleo/+bug/194497816:19
rlandy|ruckakahat: psi - only good until dec- working with infra - for another solution16:20
rlandy|ruckakahat: next step on check 16:20
*** pojadhav|dinner is now known as pojadhav|out16:43
dviroel|roverrlandy|ruck: anything needing attention?16:59
rlandy|ruckdviroel|rover: not at the moment ... unless you want to look into the scenario010 CIX17:00
rlandy|ruckakahat cleared the periodics on that17:00
rlandy|ruckhave a 15 min meeting17:00
rlandy|ruckwill link afterwards17:00
rlandy|ruckussuri should promote17:00
rlandy|ruckdownstream is dead17:01
rlandy|ruckgate is ok17:01
dviroel|roverrip downstream17:01
rlandy|ruckdviroel|rover: you can go back to some yum config work17:01
rlandy|ruckwe will pic up some upgrade stuff tomorro17:01
rlandy|rucktomorrow17:01
dviroel|roverrlandy|ruck: yeah, thinking about that too17:02
dviroel|roveralready chasing some promotions too17:02
*** derekh is now known as derekh_afk17:04
akahathttps://review.rdoproject.org/r/q/topic:%22scenario010-branchful%22+(status:open%20OR%20status:merged)17:22
akahatrlandy|ruck, dviroel|rover ^^17:22
rlandy|ruckdviroel|rover: k - yeah - so you are welcome to go back to yum config17:30
rlandy|ruckwhatever works for you17:30
rlandy|ruckakahat: https://review.rdoproject.org/r/c/rdo-jobs/+/36490 - I see what you did there :)17:31
rlandy|ruckand I am totally fine with using tags17:32
rlandy|ruckjust don't want to conflate the two17:32
rlandy|ruckcan you put in one patch to add kvm17:32
dviroel|roveryeah, splitting in two will be better17:32
rlandy|ruckand then you are welcome to put in a second patch with tags17:32
rlandy|ruckand we'll put it up for vote17:32
akahatrlandy|ruck, dviroel|rover okay.17:33
rlandy|ruckakahat: thanks  - just want to separate the scenario010 specific stuff17:33
rlandy|ruckbecause we are sharing it with nate's team17:33
rlandy|ruckdon't want to confuse the issue17:33
rlandy|ruckthank you17:33
akahatrlandy|ruck, dviroel|rover https://review.rdoproject.org/r/c/rdo-jobs/+/36492 :)17:39
akahatI'll update the old one. 17:39
dviroel|rovertks17:41
rlandy|ruckakahat: perfect  - thanks17:45
rlandy|ruckmerging17:46
dviroel|roverrlandy|ruck: gah, seems that everything is failing due to 'tripleo-mount-image'17:47
dviroel|rovereverything == ovb*17:48
rlandy|ruckdviroel|rover: ah - looking17:48
rlandy|ruckdviroel|rover: k - let's revert that17:49
dviroel|roverrlandy|ruck: need a bug for it?17:50
*** sshnaidm is now known as sshnaidm|afk17:50
rlandy|ruckdviroel|rover: ack17:50
rlandy|ruckdviroel|rover: this last one I assume : https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80948717:51
dviroel|roveryes17:52
rlandy|ruckk - revert with bug 17:52
rlandy|ruckbug does not need a ton of details - just the failures pls17:52
rlandy|ruckthank you17:52
rlandy|ruckweird sandeep tested that - but ok17:53
dviroel|roverok17:54
rlandy|ruckping me with review and I'll w+ it17:56
rlandy|ruckcan get the fix later17:56
rlandy|rucklet's just get the failure out the queue17:56
rlandy|ruckakahat: will merge https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/36491 when wallaby has run once with that job17:59
rlandy|ruckthanks17:59
akahatrlandy|ruck, okay.. adding it to the testproject.18:01
rlandy|ruckgreat18:01
rlandy|ruckdviroel|rover: I assume he may be missing a release switch on that18:04
rlandy|ruckdviroel|rover: do you have a testproject on the revert?18:04
rlandy|ruckif not I will add one18:04
dviroel|roverrlandy|ruck: no, i don't have18:05
dviroel|roverrlandy|ruck: yes, seems to pass only on master18:05
rlandy|ruckdviroel|rover: probably on wallaby as well18:05
dviroel|roverack18:05
rlandy|ruckdviroel|rover: adding testproject18:05
rlandy|ruckwill send it back to stevebaker18:05
dviroel|roverrlandy|ruck: also failing here: https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001 but with a different error18:09
dviroel|roverrlandy|ruck: chandan pointed this error earlier "/bin/tripleo-mount-image: line 210: [: missing `]'"18:10
rlandy|ruckdviroel|rover - there were two patches18:10
rlandy|rucklet's see how many we need to get rid of 18:11
rlandy|ruckhttps://meet.google.com/uzn-wzcf-bsm?pli=1&authuser=018:11
rlandy|ruckdviroel|rover: ^^18:11
dviroel|roverrlandy|ruck: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80628418:12
-opendevstatus- NOTICE: mirror.bhs1.ovh.opendev.org filled its disk around 17:25 UTC. We have corrected this issue around 18:25 UTC and jobs that failed due to this mirror can be rechecked.18:43
rlandy|ruckakahat++ nice email18:47
rlandy|ruckdviroel|rover: I think one revert is ok19:03
* dviroel|rover looks19:05
dviroel|roverrlandy|ruck: unexpected for me, cause of the error that we have "/bin/sh: line 1: type: tripleo-mount-image: not found"19:09
dviroel|roverrlandy|ruck: that was added in the first patch19:09
dviroel|roverrlandy|ruck: ah, search for "tripleo-mount-image\n/bin/sh"19:12
dviroel|roverin the running job19:12
dviroel|roverthe error is there, didn't fail yet19:13
rlandy|rucklet's see19:14
rlandy|ruckwill ping steve when he is in19:15
rlandy|ruckhmmm - overcloud image broke19:59
dviroel|rover(╯°□°)╯︵ ┻━┻20:00
dviroel|rovertrain?20:02
rlandy|ruckrerunning to check20:02
rlandy|ruck404 for http://mirror.centos.org/centos/8-stream/HighAvailability/x86_64/os/Packages/resource-agents-4.9.0-5.el8.x86_64.rpm (IP: 67.222.128.245)20:02
rlandy|ruck2021-10-28 18:35:55.823 | [FAILED] resource-agents-4.9.0-5.el8.x86_64.rpm: No more mirrors to try - All mirrors were already tried without success20:03
rlandy|ruck2021-10-28 18:35:55.837 | Error: Error downloading packages:20:03
rlandy|ruck2021-10-28 18:35:55.837 |   Cannot download Packages/resource-agents-4.9.0-5.el8.x86_64.rpm: All mirrors were tried20:03
rlandy|ruckcould be random or repeatable trying20:03
dviroel|roveryep20:04
rlandy|ruckdviroel|rover: ha ... https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset00120:44
rlandy|ruckfs001 working on multiple patches now20:45
dviroel|roverrlandy|ruck: it is intermittent 20:47
rlandy|ruckok20:47
dviroel|roverrlandy|ruck: search for '815782,2' 20:47
rlandy|rucklet's merge the revert20:47
rlandy|ruckand we can revert revert again20:47
dviroel|roveryep20:48
dviroel|rovermight have another variable that triggers the issue20:48
rlandy|ruckhttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81588120:49
rlandy|ruckdviroel|rover: ^^ pls vote anyways20:49
rlandy|ruckI don;t think we need the second revert20:49
dviroel|rovervoted in both20:50
dviroel|roveri think that we'll need, lets wait for more results20:50
dviroel|roverwith 1 revert, the error is still there, but the job didn't fail :P20:51
rlandy|ruckthe first one for sure we need 20:51
rlandy|ruckso let's start there20:51
dviroel|roveryep20:51
rlandy|ruckhttps://review.rdoproject.org/zuul/stream/cccd695750654705857ea900e5463a7d?logfile=console.log20:51
rlandy|ruckthink train build image is doing better now20:51
rlandy|ruckhmmm 21:00
rlandy|ruckidk 21:00
rlandy|rucknot sure abut either atm21:00
rlandy|ruckussuri is fine21:00
dviroel|roverupdated the bug title with the real issue: https://bugs.launchpad.net/tripleo/+bug/194910721:15
dviroel|roverin the code, he is testing if 'tripleo-mount-image' exists, so he is ok not testing agains different branches21:17
dviroel|roverbut it is failing in the 'mount'21:17
dviroel|roverhttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/806284/18/roles/modify-image/tasks/manual.yml#5321:17
dviroel|rovergoing afk21:33
*** dviroel|rover is now known as dviroel|rover|afk21:33
rlandy|ruckok21:38
rlandy|ruckthanks21:38
rlandy|ruckwaiting for victoria tests to complete21:40
*** rlandy|ruck is now known as rlandy|ruck|afk22:21

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!