Wednesday, 2019-04-24

vinayknsweshay|rover: ping.00:28
vinayknsI have a question in general, how could we have a downstream version of for say osp13 deployment..?00:29
*** rfolco has joined #oooq01:15
*** vinaykns has quit IRC01:17
*** apetrich has quit IRC01:56
*** ykarel|away has joined #oooq02:07
*** ykarel|away has quit IRC03:40
*** udesale has joined #oooq03:58
*** ykarel|away has joined #oooq04:24
*** ykarel_ has joined #oooq04:30
*** ykarel|away has quit IRC04:32
*** ratailor has joined #oooq05:17
*** quiquell|off is now known as quiquell|rover05:17
*** marios has joined #oooq05:18
*** ykarel_ is now known as ykarel05:53
*** kopecmartin|off is now known as kopecmartin06:08
*** jfrancoa has joined #oooq06:08
*** dsneddon has quit IRC06:25
*** dsneddon has joined #oooq06:50
*** quiquell|rover is now known as quique|rover|brb06:54
*** dsneddon has quit IRC06:55
*** saneax has joined #oooq07:09
*** apetrich has joined #oooq07:13
*** quique|rover|brb is now known as quiquell|rover07:14
*** amoralej has joined #oooq07:25
*** tosky has joined #oooq07:26
*** dsneddon has joined #oooq07:31
amoralejhi07:39
amoralejexecution in openstack-periodic-latest-released is taking 16hr 30min07:39
amoralejany known issue?07:40
amoralejquiquell|rover, ^07:40
*** dtantsur|afk is now known as dtantsur07:40
quiquell|roveramoralej: haven't arrive there yet07:41
quiquell|roveramoralej: do you know how to update diskimage-builder version from RDO nodepool ?07:41
chandankumarquiquell|rover: marios \o/07:42
chandankumarquiquell|rover: marios needs +w on this07:42
chandankumarhttps://review.opendev.org/#/c/652983/07:42
amoralejyou mean to update it in nodepool server in software factory?07:42
amoralejjpena|off, ^07:42
*** dsneddon has quit IRC07:42
quiquell|roveramoralej: we are talking about it at #sf-ops07:42
amoralejok, that's the right place, i guess07:42
quiquell|rovercan you join ?07:43
quiquell|roverso maybe you can help07:43
amoralejsure07:44
amoralejbut they know much more that me about that :)07:44
quiquell|roverok let's look at periodics now07:46
quiquell|roveramoralej: I see two of the jobs queued07:47
amoralejyeap07:47
amoralejthat must be the issue07:47
quiquell|roveramoralej: maybe there are issues with nodes ?07:47
quiquell|roveramoralej: there is not timeout for queued time ?07:47
amoralejdunno, i don't have access07:47
amoralejbut07:48
amoraleji guess node types for those jobs are the same as for openstack-periodic-24hr which are running07:48
*** jpena|off is now known as jpena07:48
quiquell|roveryep nothing special there07:48
amoralejquiquell|rover, i'd say there is no limit for jobs in queue07:48
amoralejor it's very long07:48
marioschandankumar: ack but question there about fs39 please07:49
amoralejlet's check if the job themselfes are defined07:49
ykarelamoralej, hmm that pipeline is high priority, so there must be some issue as they are still in queue07:49
quiquell|roveramoralej: we haven't change anything there07:49
amoralejjobs are defined07:49
quiquell|roveramoralej: have to be issues with tenant07:49
quiquell|roveramoralej: openstack tenant I mean07:49
quiquell|roverqueued ones ar centos-707:50
amoralejwe need someone from sf to check, i guess07:51
*** ykarel is now known as ykarel|lunch07:53
*** dsneddon has joined #oooq07:57
*** dsneddon has quit IRC08:03
marioschandankumar: o/ hey i am trying to work out if i can use your new ansible logs role in https://code.engineering.redhat.com/gerrit/#/c/167540/18/zuul.d/standalone-jobs.yaml ... so we can get some logs about repos/packages there as the job is failing really early. do i need to depend on https://review.opendev.org/#/c/652920/ as well ... or can i just try and add task to role: collect-logs (I think i need the08:05
mariosdepends-on cos we don't have it in required projects yet, or i need to add it in required project for my job directly08:05
chandankumarmarios: I think you need this patch https://review.opendev.org/#/c/654934/08:06
* chandankumar connects to vpn08:07
marioschandankumar: ack ... so that will enable it for all the jobs right? I was hoping there was some simpler way for me to add it to just my job for quick debug but sounds like not yet08:08
chandankumarmarios: we need to add it in the required projects then make sure tq installs the collect-logs then fire a simple playbook something liket hat https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/collect-logs.yml#L708:10
chandankumarit will work08:10
marioschandankumar: ack yes i was thinking along those lines ^ ok will try something08:10
chandankumarmarios: we have added new role in the rdo config repo https://review.rdoproject.org/r/#/c/20350/08:12
chandankumaras a project list, I think it will be there if same config is used08:13
*** derekh has joined #oooq08:13
marioschandankumar: thanks (the job i am trying to add is in internal sf)08:19
*** ykarel|lunch is now known as ykarel08:30
*** dsneddon has joined #oooq08:34
chandankumarmarios: thanks for the comment on doc patches, fixed it :-)08:38
marioschandankumar: ack revoted thx08:39
chandankumarmarios: in downsteam, what is the trusted repo name which is equivalent to rdo config project?08:41
*** dsneddon has quit IRC08:41
marioschandankumar: tripleo-ci-internal-config there is also sf-config so theres two i guess08:42
chandankumarmarios: thanks!08:43
marioschandankumar: see here for info/pointers fyi https://tree.taiga.io/project/tripleo-ci-board/us/951?milestone=226267 (under design) esp this http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/doc/oooq-upstream-baremetal.rst08:43
amoralejykarel, FS021 is voting for promotion?08:56
ykarelamoralej, no08:56
amoralejnice08:57
amoralejif we get current jobs passing for stein promotion we'll get the glance-store patch promoted08:58
ykarelyeah good08:58
amoraleji assume f28 is also non-voting08:58
ykarelamoralej, yes it's not in criteria08:58
amoralejwe are good then08:58
ykarelyes08:58
ykarelamoralej, glance_store in master already promoted?08:59
amoralejyes08:59
ykarelokk good08:59
ykareltiming08:59
amoralejthat's why scenario004 in p-o-i is passing08:59
ykarelas now we have new bug08:59
amoralejwith nautilus08:59
amoralejykarel, which bug?08:59
marioschandankumar: so i'd have to add that role to the sf-config source-repositories in order to use it09:00
marioschandankumar: i mean collect logs09:00
ykarelamoralej, https://bugs.launchpad.net/tripleo/+bug/182597609:00
openstackLaunchpad bug 1825976 in tripleo "THT: wrong indentation (?) in placement-api-container-puppet.yaml leads to wrong hieradata (and failed deployment)" [Critical,In progress] - Assigned to Luca Miccini (lmiccini2)09:00
marioschandankumar: i guess thats why you were asking before right?09:00
ykarelamoralej, u said poi scenario004 passing, but there we use puppet-passed-ci09:00
ykareland here we discussion tripleo promotion, /me confused09:01
marioschandankumar: in here i mean http://git.app.eng.bos.redhat.com/git/openstack/sf-config.git/tree/resources/tripleo-ci-internal.yaml09:01
amoralejyeah,  but in stein puppet-passed-ci is pointing to current-tripleo-rdo09:02
amoralejthere is no puppet promotion pipeline09:02
amoralejand for master, we'd need it in both09:02
ykarelamoralej, hmm for stein yes promotion needed09:03
ykarelamoralej, yes just checked fix is there in current-tripleo master too09:03
amoralejto make sure we don't break any job09:03
ykarelso we are good09:03
ykarelyes09:03
amoralejonce we have everything merged in puppet-ceph and p-o-i, we need to create a new puppet-ceph release09:04
amoralejand cherry-pick change to p-o-i in stable/stein09:04
ykarelamoralej, ack09:04
ykarellet's try to merge them soon :)09:04
ykarelshould be quicker than tripleo patches09:05
amoralejwell... it's taking ages to get everything done09:05
amoralejykarel, from oooq jobs pov we have the ceph-ansible patch so, we should be ok, right?09:06
amoralejthat's what i understood09:06
ykarelamoralej, yes waiting for ceph-ansible patch to exist in mirror.centos09:07
ykareland then fmount will adjust tht patch as per new ceph-ansible, and then all patches get merged in topic:ceph-nautilus09:07
amoralejwe can propose a review in rdoinfo to include in -testing to at least start testing it09:07
ykarelamoralej, need tht change atleast for that09:08
ykarelas per new ceph_ansible to disable mon_host_v109:08
amoralejykarel, you mean https://review.opendev.org/#/c/651239 ?09:09
ykarelamoralej, yes09:09
amoralejthere is something i don't understand well09:09
amoraleji thought this would be fixed in ceph-ansible09:10
ykarelamoralej, so see https://review.opendev.org/#/c/651239/13/ci/environments/scenario001-standalone.yaml09:10
ykarelhere ip is hardcoded09:10
amoralejdo we still need to patch tht?09:10
amoralejthen, what's the fix in ceph-ansible?09:10
ykarelamoralej, https://github.com/ceph/ceph-ansible/commit/a4bc7bda5148a94e917d228037447a138bd08cab09:11
ykarelamoralej, with ^^ patch it's now possible to disable mon_host_v109:11
ykarelsomething like: mon_host_v1: { 'enabled': False, suffix: ':6789' }09:11
chandankumarmarios: yes09:11
ykarelamoralej, ^^ change will be done in tht09:12
amoralejok, that's what i expected, not passing mon_host09:13
amoralejthat makes sense09:13
amoraleji have doubts about what should be the default value, but ok09:13
ykarelack09:13
amoralejykarel, just for testing, would it work if we set CephConfigOverrides in the release config file we create in rdoinfo jobs?09:16
*** sshnaidm|afk is now known as sshnaidm|09:16
*** sshnaidm| is now known as sshnaidm09:16
ykarelamoralej, to test ceph-ansible patch i just linked?09:18
amoraleji mean09:18
amoralejhttps://review.rdoproject.org/r/#/c/20157/09:18
amoralejthen09:18
amoralejcreate a review in rdoinfo to add https://cbs.centos.org/koji/buildinfo?buildID=25895 to train-testing or stein-testing09:18
amoralejwith depends-on to the rdo-jobs review09:18
amoralejbut adding that overrides for ceph09:18
*** dtantsur is now known as dtantsur|brb09:19
ykarelamoralej, so we can't use CephConfigOverrides09:20
ykarelamoralej, trying to find cephansible override09:20
amoralejthere is no way to override it in release file?09:21
amoralejdamn09:21
ykarelamoralej, i can recheck, afair release file has low priority than featureset file09:21
ykarelrelooking09:21
amoralejykarel, other option would be to create other review on tht with your proposed change09:21
amoraleji think i have one somewhere09:22
chandankumararxcruz: Hello09:23
arxcruzchandankumar: hey09:23
chandankumararxcruz: I think this user story https://tree.taiga.io/project/tripleo-ci-board/us/237 is already done na?09:23
amoralejykarel, as https://review.opendev.org/#/c/644618/09:23
arxcruzchandankumar: i think yes09:24
chandankumararxcruz: deleting it then, as it is taken care in another us09:25
arxcruzok09:25
ykarelamoralej, ack09:25
mariosquiquell|rover: do we have list of known issue/etherpad etc so don't have to keep asking you? (have you seen anything about problems with placement container like here http://logs.openstack.org/63/653363/2/check/tripleo-ci-centos-7-standalone-upgrade/054554f/logs/undercloud/home/zuul/standalone_upgrade.log.txt.gz#_2019-04-24_08_14_5909:48
quiquell|rovermarios: in the cockpit you have the alert bugs and promotion-blockers tables09:49
quiquell|rovermarios: also the etherpad for ruckrover https://etherpad.openstack.org/p/ruckroversprint809:49
mariosquiquell|rover: thanks09:49
quiquell|rovermarios: is cockpit working for you ?10:00
mariosquiquell|rover: refreshing10:00
mariosquiquell|rover: yeah looks like10:01
mariosquiquell|rover: want me to check something specifically10:01
quiquell|roverok10:01
*** ykarel_ has joined #oooq10:01
quiquell|roverI have errors here10:01
quiquell|roverok working now10:02
*** ykarel has quit IRC10:04
mariosquiquell|rover: fyi new one :/ https://bugs.launchpad.net/tripleo/+bug/182617910:09
openstackLaunchpad bug 1826179 in tripleo "standalone-upgrade fails during deploy steps (generate config) step1 for "Evaluation Error:... Could not find class ::tripleo::profile::base::placement::api" " [High,Triaged] - Assigned to Marios Andreou (marios-b)10:09
marioswe need to make that job voting otherwise this will never end10:09
*** ykarel_ is now known as ykarel10:14
quiquell|rovermarios, sshnaidm: To upgrade reproducer containers https://review.rdoproject.org/r/#/c/20381/10:15
quiquell|rovermarios: Humm I recall there is one fix for placement10:16
quiquell|roverlet me look10:16
*** ykarel_ has joined #oooq10:19
quiquell|rovermarios: this is not related to this ? https://bugs.launchpad.net/tripleo/+bug/182597610:19
openstackLaunchpad bug 1825976 in tripleo "THT: wrong indentation (?) in placement-api-container-puppet.yaml leads to wrong hieradata (and failed deployment)" [Critical,In progress] - Assigned to Luca Miccini (lmiccini2)10:19
mariosquiquell|rover: looking10:20
quiquell|rovermarios: this is the fix to that https://review.opendev.org/#/c/655120/10:20
mariosquiquell|rover: hard to tell might be different10:21
mariosquiquell|rover: cos there is no logs on the bug (link to logs) but also the failure I see is about missing puppet like Error while evaluating a Function Call, Could not find class ::tripleo::profile::base10:21
quiquell|roverpuff I always get lost with puppet10:22
*** ykarel has quit IRC10:22
mariosquiquell|rover: no i mean i still see the error in that fix review http://logs.openstack.org/20/655120/1/check/tripleo-ci-centos-7-standalone-upgrade/338c482/logs/undercloud/home/zuul/standalone_upgrade.log.txt.gz#_2019-04-24_08_27_4510:23
*** ykarel_ is now known as ykarel10:23
mariosquiquell|rover: thanks for checking ... looks like >1 bug for placement10:24
quiquell|roverlet's merge the fix and see10:24
mariosquiquell|rover: the fix in /#/c/655120/ you mean? it still has the issue 13:23 < marios> quiquell|rover: no i mean i still see the error in that fix review10:25
marioshttp://logs.openstack.org/20/655120/1/check/tripleo-ci-centos-7-standalone-upgrade/338c482/logs/undercloud/home/zuul/standalone_upgrade.log.txt.gz#_2019-04-24_08_27_4510:25
quiquell|roverargg10:25
quiquell|roverwait ok10:25
quiquell|rovermarios: looks like Removing container: container-puppet-nova_metadata didn't work out10:27
*** ykarel is now known as ykarelaway10:33
*** dtantsur|brb is now known as dtantsur10:35
quiquell|rovermarios, sshnaidm: lost the votes updating comment here https://review.opendev.org/#/c/65518310:35
quiquell|roverit will unblock scenario00910:35
*** dsneddon has joined #oooq10:37
quiquell|rovermarios: this could be the fix too https://review.opendev.org/#/c/655389/1/deployment/nova/nova-metadata-container-puppet.yaml10:40
quiquell|roverlet's check the standalone upgrdades job there10:41
mariosquiquell|rover: ack thanks lets see didn't report yet10:41
quiquell|rovermarios: btw did the new rhel dib work ?10:42
mariosquiquell|rover: no10:42
quiquell|rover:-(10:42
mariosquiquell|rover: yeah10:42
quiquell|roveryes or no =10:42
quiquell|rover?10:42
mariosquiquell|rover: i think we will abandon it for now... until we get a workign dib element ... i think next sprint will be about trying it manually10:42
mariosquiquell|rover: the yeah was for the ":-("10:43
quiquell|roverack10:43
mariosquiquell|rover: cos even the fix we merged yesterday (python3-selinux) is for the 'fake' rhel8 element10:43
mariosquiquell|rover: so not sure how much (more) effort we want to put there10:44
*** dsneddon has quit IRC10:45
quiquell|roverjaosorior: this too https://review.opendev.org/#/c/655183/10:45
quiquell|rovermarios: can you add a vote here https://review.opendev.org/#/c/655183/ ?10:45
quiquell|roverI wrongly commented the commit message and lose them10:46
mariosquiquell|rover: ack10:46
quiquell|roverhuimm10:50
*** dsneddon has joined #oooq11:01
chandankumarpanda: hello11:02
pandachandankumar: hi, did you firdrill ? I'm in your room11:02
chandankumarpanda: joining there11:03
quiquell|roverykarelaway: did you found issues with OVB ?11:05
chandankumarpanda: https://docs.google.com/document/d/14xyjhFkGcDqDjFEdfbPLoNCEtIzmayMAFxH_5i55-V8/edit#11:05
*** ykarelaway is now known as ykarel11:05
ykarelquiquell|rover, you asking about master ovb? if yes martin found, he proposed a patch also11:06
*** dsneddon has quit IRC11:06
quiquell|roverykarel: http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/15eeff8/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz11:06
quiquell|roverthis ^ ¿11:06
quiquell|rover?11:06
quiquell|roverdo you have martin's bug ?11:07
ykarelquiquell|rover, yes this is the orginal bug where firewall rules for placement were not applied11:07
quiquell|roverack11:07
quiquell|roverhttps://bugs.launchpad.net/tripleo/+bug/182597611:08
openstackLaunchpad bug 1825976 in tripleo "THT: wrong indentation (?) in placement-api-container-puppet.yaml leads to wrong hieradata (and failed deployment)" [Critical,In progress] - Assigned to Luca Miccini (lmiccini2)11:08
quiquell|roverthis11:08
ykarelquiquell|rover, yes this is first issue11:08
ykarelquiquell|rover, see last comment for new bug which martin files11:08
quiquell|roverok then we have https://bugs.launchpad.net/tripleo/+bug/182617811:08
openstackLaunchpad bug 1826178 in tripleo "nova_metadata iptables rules missing" [Undecided,In progress] - Assigned to Martin Schuppert (mschuppert)11:08
quiquell|roverso this is a promotion blocker too11:09
ykarelquiquell|rover, yes it's blocker, let' see how the job goes here11:09
quiquell|roverok taging it11:09
quiquell|roverI was missing something11:09
ykarelbut cause is same, so can keep only one alert11:09
ykareltransition to placement11:09
quiquell|roverack11:09
quiquell|roverok let's see reviews results it should fix standalone-upgrade too ?11:10
ykarelquiquell|rover, /me don't know about upgrade11:10
*** udesale has quit IRC11:16
*** jpena is now known as jpena|lunch11:18
*** jbadiapa has quit IRC11:33
*** vinaykns has joined #oooq11:36
vinayknssshnaidm: ping.11:38
sshnaidmvinaykns, hi11:41
*** dsneddon has joined #oooq11:42
vinayknssshnaidm: in the latest osp13z6 puddle downstream we have updated container image of qdrouter, if I deploy with oooq with -R queens will I be able to get those changes..?11:44
*** ccamacho has joined #oooq11:44
vinayknssshnaidm: if we can do so, I tried deploying osp13 with having 3ctrl_1cmp_1supp as config file I couldn't get a sucessful deployment11:46
*** jbadiapa has joined #oooq11:46
vinayknsit is getting failed during freeipa installation step..11:47
chandankumarpanda: https://tree.taiga.io/project/tripleo-ci-board/epic/55811:49
chandankumarpanda: https://tree.taiga.io/project/tripleo-ci-board/us/103111:49
*** dsneddon has quit IRC11:51
sshnaidmvinaykns, sorry, I have no idea about puddles downstream, maybe I can help with logs of freeipa installation step if you paste it11:56
sshnaidmvinaykns, afaik there was problem with our tls job in queens and not sure if it's solved finally, need to check..11:57
vinayknssshnaidm: aah..lemme see if I could get the logs11:58
vinayknssshnaidm: this is what I could see in the logs http://pastebin.test.redhat.com/75794911:59
*** quiquell|rover is now known as quique|rover|eat12:00
sshnaidmvinaykns, I don't see an error12:00
*** rlandy has joined #oooq12:01
vinayknssshnaidm: as far I see ipa-server command isn't executed so after the deployment failed I manually ran the command to observe http://pastebin.test.redhat.com/75795012:02
*** rlandy is now known as rlandy|ruck12:02
sshnaidmvinaykns, seems like passed wrong dns: DNS server 192.168.23.10: query '. SOA': The DNS operation timed out12:04
sshnaidmvinaykns, need to ensure forwarders are correct12:04
*** dsneddon has joined #oooq12:05
vinayknssshnaidm: but that's the ip of supplemental node..?12:05
*** amoralej is now known as amoralej|lunch12:06
sshnaidmvinaykns, maybe, I don't see your setup :)12:06
vinayknssshnaidm: you wanna do a tmate..?12:07
sshnaidmvinaykns, we have a retro today, maybe after it12:07
vinayknssshnaidm: okay, but anyways could you check the status of tls job in queens..?12:08
sshnaidmvinaykns, seems failing: https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039&branch=stable%2Fqueens12:11
*** dsneddon has quit IRC12:11
rlandy|ruckquique|rover|eat: ykarel:  wrt https://review.opendev.org/#/c/655389/- this is still failing deploy - do we need that change with https://review.opendev.org/655120 to see a clear pass?12:13
ykarelrlandy|ruck, ohh that's not rebase on other?12:14
ykarelboth needed together12:14
rlandy|ruckykarel: ok - I'll set up a tetsproject with both12:14
rlandy|rucklet's not stop these now with a rebase12:15
ykarelrlandy|ruck, okk12:15
quique|rover|eatrlandy|ruck: tristanC is rebuilding fedora-28 rdo images they were build with old dib tool12:16
quique|rover|eatrlandy|ruck: that was the issue with fedora-28 job12:16
quique|rover|eatrlandy|ruck: no need to revert reinstall12:17
rlandy|ruckquique|rover|eat: I think we w+'ed that though12:18
weshay|roverquique|rover|eat that is the oddest bit of code12:18
quique|rover|eatI -2 the revert12:18
quique|rover|eatthe issue was found12:19
rlandy|ruckseems weird we need a reinstall before an install12:19
quique|rover|eatwe can keep it12:19
rlandy|ruckwhy?12:19
quique|rover|eatrlandy|ruck: is what the element is doing at new dib version12:19
quique|rover|eatid all in the bug12:19
rlandy|ruckquique|rover|eat: unrelated question ...12:22
rlandy|ruckquique|rover|eat: I wanted to add multiple tests to trigger from the dlrn downstream trigger12:22
rlandy|ruckquique|rover|eat: it looks like https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_trigger/dlrnapi_trigger.py#L38 expects one job to launch12:23
rlandy|ruckquique|rover|eat: so we have a few options ...12:24
rlandy|ruckadd a list of tests12:24
rlandy|ruckadd an with_items12:24
quique|rover|eatrlandy|ruck: commented in the review12:24
rlandy|ruckadd multiple job defintions12:24
quique|rover|eatwhy we may don't want to look for multiple jobs12:25
quique|rover|eatsince we want to run as less baremetal as possible12:25
quique|rover|eatbut don't know how important is that12:25
rlandy|ruckquique|rover|eat: that is true but we will have a lot of duplication12:27
rlandy|ruckquique|rover|eat: this is ok for now but maybe we should rethink this?12:28
rlandy|ruckwill pick it up next sprint12:28
quique|rover|eatwe can implement multiple and use only one12:28
rlandy|ruckquique|rover|eat: because we need to on board the scale team12:28
quique|rover|eatif we want12:28
rlandy|ruckquique|rover|eat: k - let's discuss tomorrow12:28
quique|rover|eatok now food for me12:28
*** udesale has joined #oooq12:29
ykarelrlandy|ruck, i commented on your ci-config merged patch about opendev url, please check once free12:31
ykarelbefore i forget about it :)12:31
rlandy|ruckykarel: supposedly using that file altogether is a sketchy proposition12:35
rlandy|ruckykarel: Will add as a task to review this work - relying on a commit is not great either12:35
weshay|roverquique|rover|eat rlandy|ruck when you have 5min can you guys jump on my blue12:36
ykarelrlandy|ruck, with commit we can ensure we using same container images used with building container12:36
rlandy|ruckweshay|rover: joining12:36
weshay|roverquique|rover|eat you have a min?12:38
quique|rover|eatsure12:40
*** quique|rover|eat is now known as quiquell|rover12:41
quiquell|roverjoining12:41
*** dsneddon has joined #oooq12:46
*** dsneddon has quit IRC12:50
*** irclogbot_0 has quit IRC12:55
*** irclogbot_3 has joined #oooq12:55
*** altlogbot_0 has quit IRC12:57
*** altlogbot_3 has joined #oooq12:57
mariosrfolco: should it be weshay bluejeans?13:01
sshnaidmrfolco, do we have a mtg?13:01
mariosrfolco:  chandankumar we have a call now?13:02
sshnaidmrfolco, Mr TC?13:02
chandankumarmarios: joined thanks!13:03
*** ratailor has quit IRC13:10
*** rlandy|ruck is now known as rlandy|ruck|mtg13:11
*** aakarsh has quit IRC13:16
*** amoralej|lunch is now known as amoralej13:17
chandankumar20 weeks13:17
rfolcosorry guys not feeling well today13:18
*** rfolco is now known as rfolco_sick13:18
*** ykarel is now known as ykarel|away13:23
*** Goneri has joined #oooq13:23
*** dsneddon has joined #oooq13:30
*** dsneddon has quit IRC13:36
*** jpena|lunch is now known as jpena13:40
*** aakarsh has joined #oooq13:40
*** mjturek has joined #oooq13:44
*** ykarel|away has quit IRC13:46
*** rfolco_sick is now known as rfolco13:52
*** dsneddon has joined #oooq14:02
*** udesale has quit IRC14:06
*** udesale has joined #oooq14:07
*** udesale has quit IRC14:08
*** udesale has joined #oooq14:08
*** dsneddon has quit IRC14:09
*** ykarel has joined #oooq14:18
vinayknssshnaidm: ping.14:23
sshnaidmvinaykns, sorry, still on mtg14:23
vinayknsoops..didn't know that14:25
*** dsneddon has joined #oooq14:37
*** dsneddon has quit IRC14:43
*** quiquell|rover is now known as quiquell|off14:49
*** fultonj has joined #oooq14:51
fultonjFYI: we're making 001/004 standalone non-voting to help the transition from ceph lumionus to nautilus relevant reviews on the agenda of the rdo meeting in 8 minutes https://etherpad.openstack.org/p/RDO-Meeting14:53
fultonjpromotions will be affected until 001/004 are working again14:54
mariosfultonj: we are in a call right now. do you have plan /patches already in place for making it voting again (like last time we did this)14:55
mariosfultonj: its always a risk14:55
fultonjhttps://review.opendev.org/#/c/65522014:56
fultonjwe could revert ^14:56
mariosfultonj: like, if it breaks in the meantime and then you have potential for multiple breaking things ontop of each other (like we currently have for standalone-upgrade job /me rant)14:56
mariosfultonj: ack ... also ping ruck|rover for attention (as i said we are on a call right now, so folks might not respond for a little while longer)14:57
mariosweshay|rover: rlandy|ruck|mtg fyi scenario 1/4 standlone proposed to go non voting ^^14:57
fultonjmarios: yes (fwiw i did ping them in #rdo too)14:57
fultonjthanks marios14:57
*** ratailor has joined #oooq14:57
mariosfultonj: ack thanks14:57
*** dsneddon has joined #oooq14:57
*** Vorrtex has joined #oooq14:59
*** dsneddon has quit IRC15:03
rlandy|ruck|mtgfultonj: thanks - will ping you after meeting to discuss15:03
fultonjack15:03
fultonjfmount: ^ fyi15:03
rlandy|ruck|mtgrfolco: ^^ fyi15:06
rlandy|ruck|mtgrfolco: https://etherpad.openstack.org/p/ruckroversprint815:08
*** ccamacho has quit IRC15:15
*** rlandy|ruck|mtg is now known as rlandy15:16
*** rfolco is now known as rfolco|ruck15:19
rfolco|ruckfultonj, reading for context15:19
fultonjrfolco|ruck: ok, active discussion on this in #rdo right now if you find it helpful15:20
ykarelrlandy, you tested those patches together?15:21
ykarelrlandy, ovb fixes one15:21
ykarelone already merged15:21
ykarelsecond has 2 +2s15:21
*** sshnaidm is now known as sshnaidm|off15:23
rlandyykarel: there are three patches now ... https://review.opendev.org/65545015:23
ykarelrlandy, mmm, would have been good to fix those in one go,15:25
ykarelsince issue created by single patch15:25
rlandyykarel: testproject review with all three coming up15:25
ykarelrlandy, 1 already merged15:25
rlandyI don;t want to stop the earlier patches by rebasing15:25
ykarelgood to rebase the other on top of others15:25
rlandythe third can be rebased on the second15:26
rlandythat will test them all15:26
ykarelrlandy, but second one was rebased on 1st one15:26
ykarelso 1st one will be missed i think15:26
rlandylet's see how far out the second one is15:27
rlandyhttps://review.opendev.org/#/c/655389/ need w+15:28
rlandyykarel: ^^15:28
ykarelrlandy, yes,15:28
ykarelwho has +w there15:29
rlandyykarel: I asked jfrancoa15:30
ykarelrlandy, ack15:30
rlandyugh gate is long15:32
ykarelhmm15:32
jfrancoarlandy: done15:33
rlandyjfrancoa: thanks15:33
jfrancoarlandy: np15:33
rlandyykarel: suggestion ...15:33
rlandylet's rebase https://review.opendev.org/#/c/65545015:33
rlandyand put in a second dnm patch that manually puts in the change in the gate15:33
*** dsneddon has joined #oooq15:33
*** marios has quit IRC15:34
ykarelrlandy, so keep them running as it is, fire a new dnm patch with all changes together, no upstream job by disabling zuul.d/layout15:36
rlandyykarel: just getting the ack to rebase 65545015:37
ykarelrlandy, rebase on what?15:38
*** dsneddon has quit IRC15:41
rlandyykarel: https://review.opendev.org/#/c/655478/15:48
ykarelrlandy, ack15:48
rlandyweshay|rover: have a minute to run through an idea?15:52
weshay|roverrlandy I don't trying to unscrew us in #rdo15:53
*** tosky has quit IRC16:00
weshay|roverrfolco|ruck ok.. fucking disaster avoided16:00
*** ratailor has quit IRC16:02
rfolco|ruckweshay|rover, ok so need to watch now for a safe migration of ceph ? should be an atomic operation ?16:02
weshay|roverrfolco|ruck we need a branchful stein ovb job16:02
weshay|roverstat16:02
weshay|roverrfolco|ruck details are here https://etherpad.openstack.org/p/tripleo-integration-squad-status16:02
dtrainoranyone have a functional ssh.config.ansible I can look at for a moment?16:03
rfolco|ruckweshay|rover, ovb ? I thought it was scen1-4 ?16:04
weshay|roverit's both16:05
weshay|roverrfolco|ruck get a branchful stein fs001 up and let's review it16:05
chandankumarpanda: rlandy https://review.opendev.org/#/c/652918/ https://review.opendev.org/#/c/652983/ https://review.opendev.org/#/c/654406/ please have a look when free, needs +w16:05
rfolco|ruckweshay|rover, this? https://review.rdoproject.org/r/#/c/20398/16:06
weshay|roverrlandy https://review.rdoproject.org/r/#/c/20398/16:07
weshay|roverrfolco|ruck yup :)16:07
weshay|roverthanks16:07
rfolco|ruckweshay|rover, thats the one I mentioned in the retro mtg btw16:07
weshay|roveraye16:07
rlandyweshay|rover: w+16:08
rfolco|ruckjob was defined already but not included to template16:08
weshay|roverrlandy it is nice to see ci.centos check jobs gone :)16:09
weshay|roverrlandy++16:09
weshay|roverwhat was ur idea now16:09
rlandyweshay|rover: one sec - w+ chandankumar jobs16:09
*** altlogbot_3 has quit IRC16:09
rlandychandankumar: done16:11
*** ykarel is now known as ykarel|away16:11
*** altlogbot_2 has joined #oooq16:11
rlandyweshay|rover: wanted to chat about running less jobs but more stability in rdocloud16:11
rlandynothing urgent16:11
chandankumarrlandy: thanks!16:11
*** dsneddon has joined #oooq16:13
rlandyrfolco|ruck: weshay|rover: fyi .. test job to run all fixes for tht placementAPI changes ... https://review.opendev.org/#/c/655478/16:13
rfolco|ruckrlandy, ack thx16:13
chandankumarweshay|rover: kopecmartin is it ok to skip the next os_tempest updates due to ptg for next week?16:13
*** smalleni_ has joined #oooq16:14
kopecmartinchandankumar, sure, i'm fine with that16:14
weshay|roverchandankumar totally16:14
chandankumarack, cool!16:14
*** dsneddon has quit IRC16:21
weshay|roversshnaidm++16:21
weshay|roverthis is nice! http://logs.rdoproject.org/17/19917/23/check/tripleo-ci-reproducer-centos-7-libvirt-standalone-vexxhost/8414d6a/tripleo-ci-reproducer/logs/01/1001/1/check/tripleo-ci-centos-7-standalone-dlrn-hash-tag/16:21
*** dsneddon has joined #oooq16:22
*** sanjayu_ has joined #oooq16:24
*** ccamacho has joined #oooq16:25
*** dtantsur is now known as dtantsur|afk16:29
weshay|roverrfolco|ruck rlandy I'm going to create a new ruck/rover etherpad and update the cockpit16:32
weshay|roverrfolco|ruck do you want me to show you how?16:32
rfolco|ruckweshay|rover, I created the new etherpad16:32
weshay|roverah I see you did16:33
rfolco|ruckhttps://etherpad.openstack.org/p/ruckroversprint916:33
weshay|roverrfolco|ruck k.. want me to show you how to update the cockpit?16:33
rfolco|ruckweshay|rover, yes please16:33
weshay|roverhttps://bluejeans.com/u/whayutin/16:33
*** derekh has quit IRC16:35
*** ccamacho has quit IRC16:38
*** altlogbot_2 has quit IRC16:43
*** altlogbot_3 has joined #oooq16:43
*** altlogbot_3 has quit IRC16:53
*** altlogbot_3 has joined #oooq16:53
*** matbu has quit IRC17:02
*** matbu has joined #oooq17:05
*** jpena is now known as jpena|off17:06
*** kopecmartin is now known as kopecmartin|off17:16
*** amoralej is now known as amoralej|off17:18
rlandyweshay|rover: rfolco|ruck: https://code.engineering.redhat.com/gerrit/#/c/168584/ w+ - that will close out the last task from sprint 8 on pidone17:37
*** udesale has quit IRC17:49
rfolco|ruckrlandy, ack18:00
rfolco|ruckweshay|rover, @dentist brb18:00
rlandypanda: I am also getting node_failures on internal sf now18:01
*** Goneri has quit IRC18:05
*** ykarel|away has quit IRC18:22
pandarlandy: nhicher says it should be solved18:49
rlandypanda: I'm talking with him now, there is an issue with the patch sshnaidm|off merged today18:49
*** Goneri has joined #oooq18:59
pandarlandy: yep, still getting node failuer here ...19:00
rlandyweshay|rover: fyi ... osp-14 failure was legit ... https://bugzilla.redhat.com/show_bug.cgi?id=169330719:09
openstackbugzilla.redhat.com bug 1693307 in openstack-tripleo-heat-templates "[osp14] TripleO support for configuring Glance's cinder_store settings"" [High,On_qa] - Assigned to pdeore19:09
rlandyfixed in upcoming puddle19:09
weshay|roverrlandy really.. crazy19:10
weshay|roverand it passed phase219:10
weshay|roverheh19:10
rlandyI know, right19:11
rlandyanyways trying the job with the new puddle19:11
weshay|roverrock19:12
fultonjhttp://lists.openstack.org/pipermail/openstack-discuss/2019-April/005599.html19:12
fultonjweshay|rover rfolco|ruck ^19:12
fultonjfyi19:12
weshay|roverfultonj rock on! thanks19:16
fultonj:)19:16
*** sanjayu_ has quit IRC19:20
rlandypanda: node fix in progress19:23
*** rlandy is now known as rlandy|biab19:33
weshay|roverrfolco|ruck you have a change up yet?19:57
weshay|roverto update the cockpit19:57
*** Goneri has quit IRC20:34
*** Vorrtex has quit IRC20:39
*** rlandy|biab is now known as rlandy20:40
rlandyweshay|rover: by when do you need the bm  results for your ptg presentation?20:43
rlandyretesting now20:43
weshay|roverrlandy you have a number of days20:44
rlandycan also send you rocky vs rhos-14 f you want20:44
weshay|roverptg starts a week from tomorrow20:44
rlandyweshay|rover: ^^ run nightly20:44
weshay|roverosp-14 is for prod-chain folks only I think20:44
weshay|roverdid the bits get delivered properly20:44
rlandyok fine20:45
weshay|roverin osp-15 it should be more of a 1-1 because 15 has dlrn20:45
rlandyweshay|rover: rfolco|ruck: well, this was mixed bag of results ... https://review.opendev.org/#/c/65547820:46
rlandyall the placement changes20:46
rlandyfs001 passed20:46
* rlandy checks failures20:46
weshay|rovernice20:46
*** Goneri has joined #oooq20:47
rlandy035 and 039 no so much20:48
*** mjturek has quit IRC20:49
rlandypanda: node failures should be gone now20:55
rlandy2019-04-24 17:31:01 | Unexpected error while running command.21:01
rlandy2019-04-24 17:31:01 | Command: /sbin/ip route add default via 2001:db8:fd00:1000::1 dev br-ex21:01
rlandy2019-04-24 17:31:01 | Exit code: 121:01
rlandyrfolco|ruck: ^^ you may still need some placementAPI fixes21:02
*** jfrancoa has quit IRC21:05
*** aakarsh has quit IRC21:27
*** smalleni_ has quit IRC21:30
*** rlandy is now known as rlandy|bbl22:00
*** aakarsh has joined #oooq22:30
*** Goneri has quit IRC22:45
*** dsneddon has quit IRC23:23
*** dsneddon has joined #oooq23:48
*** Goneri has joined #oooq23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!