Friday, 2019-09-13

*** d0ugal has quit IRC00:12
*** d0ugal has joined #oooq00:19
*** saneax has quit IRC00:31
*** matbu has quit IRC02:08
*** apetrich has quit IRC02:10
*** matbu has joined #oooq02:14
*** matbu has quit IRC02:38
*** matbu has joined #oooq02:44
*** rf0lc0 has quit IRC03:05
*** ksambor has joined #oooq03:48
*** ksambor has quit IRC03:48
*** ksambor has joined #oooq03:49
*** skramaja has joined #oooq03:57
*** ykarel|away has joined #oooq04:06
*** surpatil has joined #oooq04:31
*** ykarel|away has quit IRC04:43
*** saneax has joined #oooq04:57
*** surpatil has quit IRC05:01
*** saneax has quit IRC05:06
*** marios has joined #oooq05:07
*** udesale has joined #oooq05:08
*** ratailor has joined #oooq05:08
*** surpatil has joined #oooq05:10
*** ykarel|away has joined #oooq05:13
*** pierreprinetti has quit IRC05:14
*** pierreprinetti has joined #oooq05:15
*** jtomasek has joined #oooq05:17
*** soniya29 has joined #oooq05:32
*** saneax has joined #oooq05:46
*** akahat has joined #oooq05:47
*** jfrancoa has joined #oooq05:51
*** ykarel|away is now known as ykarel06:03
*** jfrancoa has quit IRC06:06
*** jfrancoa has joined #oooq06:23
*** saneax has quit IRC06:23
*** holser has joined #oooq06:26
*** udesale has quit IRC07:04
*** jbadiapa has joined #oooq07:06
*** tosky has joined #oooq07:12
*** tesseract has joined #oooq07:15
*** tosky_ has joined #oooq07:18
*** tosky has quit IRC07:21
*** jaosorior has joined #oooq07:35
*** d0ugal has quit IRC07:38
*** tosky_ is now known as tosky07:38
*** jpena|off is now known as jpena07:40
*** apetrich has joined #oooq07:52
*** bogdando has joined #oooq07:52
*** d0ugal has joined #oooq07:54
*** ykarel is now known as ykarel|lunch07:56
*** Tengu has quit IRC07:59
*** Tengu has joined #oooq08:03
*** ccamacho has joined #oooq08:14
*** ccamacho has quit IRC08:14
*** ccamacho has joined #oooq08:18
*** chem has joined #oooq08:25
arxcruzhey guys, i have a family emergency here, i'll be back in a few08:29
*** derekh has joined #oooq08:45
*** jaosorior has quit IRC09:00
*** ykarel|lunch is now known as ykarel09:08
zbrweshay|ruck: you did not see any updates because last run failed to post due to infra issue. 1/2 passed for the 1st time only at 10PM my hour. see https://review.rdoproject.org/r/#/c/21860/09:12
*** udesale has joined #oooq09:15
*** soniya29 has quit IRC09:18
*** matbu has quit IRC09:36
*** matbu has joined #oooq09:43
*** udesale has quit IRC09:56
*** udesale has joined #oooq09:57
chandankumarzbr: marios: sshnaidm|rover can we get this merged https://review.rdoproject.org/r/#/c/22262/? I need to test container logging rdo jobs please verify the vars part10:14
marioschandankumar: ack checking in few mins10:15
*** saneax has joined #oooq10:19
zbrchandankumar: some other code that is added without testing it?10:21
chandankumarzbr: there is no way I can test it10:22
chandankumarzbr: so adding it in a seperate playbook and creating a fake job as base will test it there and iterate it10:22
zbr... thinking10:23
zbri don't like that aspect, it has braching based on version and enough tasks in order not to trust to review it without seeing jobs running first. is not about the code itself, is lack of tests around. it.10:27
zbrare we going to a model where we review stuff with "in 123 change I trust!..." ... and pray that it will work when we merge and also after.10:28
chandankumarzbr: it is a config project chnage10:30
chandankumar*change10:30
zbri know that we can run run molecule on config repo, my only concern is that I do not know if that job has access to rdo token. if it does, we should be able to test it here. i need to check10:30
chandankumarzbr: ok10:31
chandankumarzbr: one question, how https://review.rdoproject.org/r/#/c/22264/ is going to get secrets for registry?10:49
zbrwe will findout soon10:59
chandankumarack11:00
arxcruzand i'm back11:02
*** surpatil has quit IRC11:02
zbrchandankumar: marios arxcruz: please kick https://review.rdoproject.org/r/#/c/22265/ -- very simple!11:06
arxcruzzbr: voting is default to true right? so just need to remove the whole line11:06
zbrmaybe I want to make a statement? ;)11:07
*** surpatil has joined #oooq11:08
*** jbadiapa has quit IRC11:08
zbrmarios: moving from experimental to what? there are so many pipelines in that file11:23
zbrwhat is making that decision? i agree with you that with them in experimental their benefit is merely marginal11:25
zbri would move them to check11:25
chandankumarzbr: commented11:26
marioszbr: i think openstack-regular11:26
marioszbr: that seems to be where the other jobs running on tripleo-ci changes live11:26
marioszbr: since its third party the usual 'check' and 'gate' queue doesn't apply so not sure it makes a huge difference where it lives, as long as it runs where we want. but it is strange for it to be moved voting but still lives somehwere called 'experimental11:27
zbrlook at opendev.org/openstack/tripleo-ci -- openstack-check already has tripleo-ci-rhel-8-standalone-rdo11:28
zbrso is openstack-check vs openstack-regular11:28
chandankumarweshay|ruck: arxcruz: we have another meeting for tripleo bootcamp during tempest meeting?11:31
chandankumarDo we want to cancel tempest meeting?11:32
zbri can't wait to scrap taiga, i will throw a party when we do that11:33
chandankumarzbr: in rdo-jobs reviews, we need to keep the job non voting11:33
chandankumarand there are nit picks needed in commit message11:34
*** sshnaidm|rover is now known as sshnaidm|off11:40
zbrchandankumar: fixed msg.11:40
*** udesale has quit IRC11:40
zbrchandankumar: marios arxcruz: https://review.rdoproject.org/r/c/22268/ -- move sce1/2 out of experimental11:40
*** udesale has joined #oooq11:41
zbrhttps://review.rdoproject.org/r/c/22267/ to make molecule job voting11:42
*** jpena is now known as jpena|lunch11:48
zbrhttps://review.rdoproject.org/r/q/topic:%2522fix%252Fmo-vo%2522+(status:open%20OR%20status:merged)12:02
chandankumarzbr: on this review https://review.rdoproject.org/r/#/c/22264/ the playbook is not getting tested there12:07
*** apetrich has quit IRC12:08
*** apetrich has joined #oooq12:16
*** ratailor has quit IRC12:20
*** jaosorior has joined #oooq12:27
weshay|ruckchandankumar ya.. can we push the tempest mtg 1/2 hour?12:29
*** Goneri has joined #oooq12:32
*** rlandy has joined #oooq12:35
rlandychandankumar: hi - can I w+ https://review.opendev.org/#/c/681421/?12:37
chandankumarrlandy: yes12:37
rlandydone12:37
rlandymarios: are we sync'ing today?12:38
rlandytwo reviews that can possibly merge https://review.rdoproject.org/r/#/c/22256/ https://review.rdoproject.org/r/#/c/22255/12:38
rlandywith container push12:38
rlandyzbr: ^^ if you join sync?12:39
mariosrlandy: didn't set up a call but we can do if you want. /me been fighting docker/moleculethe whole day still trying to get the manifest include to work12:39
mariosrlandy: do you want to sync in 20 mins then ?12:39
marios(scrum time)12:39
rlandymarios: ack12:39
*** ksambor has quit IRC12:41
rlandyzbr: what happened with registry login. I reverted your patch at panda's request12:43
rlandywas it re-added?12:43
*** rf0lc0 has joined #oooq12:44
*** jbadiapa has joined #oooq12:44
chandankumarmarios: sorry meeting clashes12:45
chandankumarrlandy: https://review.rdoproject.org/r/2226212:45
chandankumarrlandy: zbr is doing some testing with molecule if possibel12:45
marioschandankumar: ack12:50
chandankumarsurpatil: arxcruz kopecmartin added agenda https://etherpad.openstack.org/p/tripleo-tempest-squad-meeting please update it12:51
*** jpena|lunch is now known as jpena12:59
*** Tengu has quit IRC13:11
*** Tengu has joined #oooq13:11
*** aakarsh|2 has quit IRC13:15
*** dsneddon has quit IRC13:18
*** akahat has quit IRC13:23
*** jaosorior has quit IRC13:26
*** Vorrtex has joined #oooq13:26
kopecmartinchandankumar: arxcruz joining?13:32
arxcruzkopecmartin: sec, still in another meeting13:32
arxcruzweshay|ruck: ^13:32
chandankumararxcruz: we are waiting for you13:33
arxcruzchandankumar: joining13:34
*** chem` has joined #oooq13:36
*** chem has quit IRC13:37
weshay|ruckhttps://meet.google.com/gzk-eyqs-qoj13:39
*** Vorrtex has quit IRC13:42
*** aakarsh|2 has joined #oooq13:46
*** dsneddon has joined #oooq13:49
*** dsneddon has quit IRC13:53
*** ksambor has joined #oooq13:57
*** ksambor has quit IRC13:57
*** ratailor has joined #oooq14:00
*** ykarel is now known as ykarel|afk14:01
*** dsneddon has joined #oooq14:04
jfrancoahey folks, I'm trying to run manually an upgrade from Rocky to Stein using a 3 controllers + 1 compute ovb_ha and I'm wonder why do we still have docker in the ovb_ha.yaml (https://github.com/openstack/tripleo-heat-templates/blob/stable/stein/ci/environments/ovb-ha.yaml) file... (also saw that we deploy Stein ovb ha jobs with docker instead of podman)14:08
*** ykarel|afk has quit IRC14:10
zbris anyone aware of a deployment failure with nova-scheduler isn't working (healthcheck failed) ? https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_0ac/679409/4/check/tripleo-ci-centos-7-undercloud-containers/0ac8c85/logs/undercloud/home/zuul/undercloud_install.log.txt.gz14:11
*** dsneddon has quit IRC14:11
*** surpatil has quit IRC14:11
rlandyjfrancoa: we shouldn't https://review.opendev.org/#/c/679308/14:15
rlandyI had some reviews on this work a while back14:16
*** dsneddon has joined #oooq14:17
jfrancoarlandy: I'll give a try leaving some of the env files and appending /environments/podman.yaml at the very end...let's see if this way it work...but for the time being it's upgrading one of the controllers and bringing up docker containers instead of podman14:18
*** ratailor has quit IRC14:24
*** dsneddon has quit IRC14:24
rlandyjfrancoa: can you try with this rebased patch: https://review.opendev.org/#/c/679308/14:24
rlandythe setting should only be in https://review.opendev.org/#/c/678881/1/roles/extras-common/defaults/main.yml14:25
jfrancoarlandy: it's hard to try as I'm not using quickstart for the upgrade but running the steps manually, so converting the "overcloud-deploy.sh" into "overcloud-upgrade-prepare.sh" by hand.. (it's being a try an error)14:26
rlandymarios: can you paste the link to checking whether docker containers are pushed?14:26
rlandyjfrancoa: ok - let's see what tests kick with https://review.opendev.org/#/c/679308/ - we can also set up a test job to kick the upgrade test if it does not run with the patch14:27
*** panda|ruck has quit IRC14:28
*** panda has joined #oooq14:29
mariosrlandy: e.g. here https://github.com/rdo-infra/ci-config/blob/ee6578c8987f8a2c99111d98ef9209015f52a43f/ci-scripts/container-push/container-push.yml#L15614:29
mariosrlandy: and here for url for rdo https://review.rdoproject.org/r/#/c/22002/13/ci-scripts/container-push/manifest-push.yml@1114:30
marioszbr: how can i pass options to the docker container created by molecule.. like i want to try host networking14:30
jfrancoarlandy: ack, I'll try to base my overcloud upgrade prepare in what this patch's CI jobs configure. Thanks for the fix14:31
zbrmarios: https://molecule.readthedocs.io/en/stable/configuration.html#docker -- network_mode: host14:31
marioszbr: thank you it goes here right? https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/promoter/molecule/default/molecule.yml14:32
marioszbr: yes looks like, thanks trying14:32
zbrmarios: yes, under platform block.14:32
marioszbr: thanks14:32
zbrmarios: me glad to help, when i can.14:33
*** marios has quit IRC14:34
zbrweshay|ruck: maybe you can help me identify why containers failed on https://zuul.opendev.org/t/openstack/build/0ac8c851540f4474b6c98be1c278967e -- really doubt is related to my chance14:34
*** dsneddon has joined #oooq14:34
weshay|ruckzbr sure /me looks14:35
weshay|ruckzbr there is a cix on this issue14:36
weshay|ruck9 |    "msg": "nova-scheduler isn't working (healthcheck failed)",14:36
weshay|ruck2019-09-11 21:06:39 |    "changed": false,14:36
weshay|ruck2019-09-11 21:06:39 |    "_ansible_no_log": false14:36
weshay|ruckhttps://review.opendev.org/#/c/681869/  https://review.opendev.org/#/c/681442/14:37
*** marios has joined #oooq14:37
*** marios has quit IRC14:38
zbrok 1st merged, but on 2nd you added a -114:38
weshay|ruckzbr ya.. it's rerunning now14:38
*** marios has joined #oooq14:38
weshay|ruckzbr note.. by -1 was on the same failure you saw14:39
weshay|ruckoops14:39
weshay|rucknot quite14:39
marioszbr: ok so that definitely did not help (this kills the wayland session fyi...14:39
weshay|ruckur's is nova-scheduler14:39
weshay|ruckthe one in the job failure is nova-conductor14:39
weshay|ruckzbr so, ya.. not your code14:39
weshay|ruckglobal issue atm14:39
*** dsneddon has quit IRC14:41
zbrshould I put a repends on 681442  on mine and do recheck, or just wait?14:41
*** dsneddon has joined #oooq14:43
*** dsneddon has quit IRC14:50
*** recheck has quit IRC15:04
weshay|ruckrlandy rf0lc0 https://review.rdoproject.org/r/#/c/22259/15:05
weshay|ruckadds fs039 to tripleo-ansible15:05
*** recheck has joined #oooq15:05
rlandy Cannot Merge15:06
rlandyweshay|ruck: ^^15:06
weshay|ruckrebased.. good to go15:07
rlandyweshay|ruck: that test fails a lot https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset03915:08
weshay|ruckrlandy we're fixing it :)15:08
rlandyadding it to more places?15:08
rlandylet's hope so15:09
weshay|ruckrlandy https://review.rdoproject.org/r/#/c/21672/15:09
rlandyweshay|ruck: I +2'ed15:09
weshay|ruckhrm.. getting timeouts on fs00115:10
weshay|ruck2019-09-13 13:11:32 | Ansible timed out at 3195 seconds.15:10
rlandyhmmm15:10
rlandyyep15:10
weshay|ruckare we overriding the deployment timeout? /me looks15:11
weshay|ruck  --libvirt-type qemu  --timeout 9015:11
weshay|ruckthat timed out in 3195 seconds which is 53min15:12
*** recheck has quit IRC15:15
*** recheck has joined #oooq15:15
*** ykarel|afk has joined #oooq15:16
weshay|ruckhrm.. I think ansible is just wrong about the # of seconds15:17
weshay|ruckzuul has it closer to 90 min15:17
weshay|ruckperf regressions I assume15:18
weshay|ruckrf0lc0 I'm on for 1-1 in 10min15:21
rlandyidk15:21
rf0lc0weshay|ruck, thx15:21
rlandywe were riding on the edge of execution times for a while15:21
rlandythat is why we cut the concurrent job numbers15:21
rf0lc0weshay|ruck, will brush teeth for a clean and bright smile15:22
*** dsneddon has joined #oooq15:22
weshay|ruckso fresh and so clean clean15:22
arxcruzmarios: come on man, it's Friday 13 and you schedule a meeting a few minutes before the time? xD15:22
*** tesseract has quit IRC15:25
mariosarxcruz: :D was only planned last minute sorry15:27
*** jtomasek has quit IRC15:28
rf0lc0arxcruz, happy friday 1315:29
*** udesale has quit IRC15:30
rf0lc0weshay|ruck, I'm in15:30
*** udesale has joined #oooq15:31
*** weshay|ruck has quit IRC15:31
*** dsneddon has quit IRC15:36
*** jfrancoa has quit IRC15:38
*** ykarel|afk is now known as ykarel|away15:39
*** rlandy is now known as rlandy|brb16:02
*** dsneddon has joined #oooq16:07
*** dsneddon has quit IRC16:12
*** weshay has joined #oooq16:13
*** marios has quit IRC16:13
weshayhey16:13
weshayrf0lc0, am I here?16:13
rf0lc0weshay, yes16:14
weshayk16:14
weshaythanks16:14
rf0lc0not dreaming, its real16:14
*** recheck has quit IRC16:14
*** recheck has joined #oooq16:14
*** weshay is now known as weshay|ruck16:15
*** dsneddon has joined #oooq16:35
rf0lc0arxcruz, do you <<manja>> uwsgi ?16:36
*** bogdando has quit IRC16:37
*** kopecmartin is now known as kopecmartin|off16:38
*** derekh has quit IRC16:40
*** rlandy|brb is now known as rlandy16:42
*** jpena is now known as jpena|off16:49
*** holser has quit IRC17:15
*** chem` has quit IRC17:22
*** udesale has quit IRC17:36
*** panda has quit IRC18:02
*** panda has joined #oooq18:03
*** saneax has quit IRC18:44
*** holser has joined #oooq18:46
rf0lc0rlandy, ping19:07
rlandyrf0lc0: hello19:07
rf0lc0rlandy, was starting to look at the promoter task to consume the staging containers list in the tripleo-common format as we discussed this morning19:08
rf0lc0rlandy, did anything change since?19:08
rlandyno19:09
rf0lc0ok19:09
rlandybeen working on querying local reg19:09
rlandygit some stuff working19:09
rlandygetting tags etc19:09
rf0lc0np, just syncing19:09
rlandygoing to put up ptach to add container with namespace19:09
rf0lc0cool19:10
rlandyso it matches what you need19:10
rlandylot of trial and error19:10
rlandyand error19:10
rlandyand error19:10
rf0lc0more error than trial19:10
rf0lc0lol19:10
rlandycurl -X GET http://localhost:5000/v2/_catalog works19:14
rlandyand19:14
rlandy curl -X GET http://localhost:5000/v2/<name>/tags/list19:14
*** holser__ has joined #oooq19:34
*** holser has quit IRC19:34
*** panda has quit IRC20:05
*** panda has joined #oooq20:08
*** aakarsh|2 has quit IRC20:11
*** ykarel|away has quit IRC20:18
*** weshay|ruck has quit IRC20:19
*** ksambor has joined #oooq20:23
*** ksambor has quit IRC20:23
rlandyrf0lc0: you want the container format to look like: tripleomaster/promoter-staging-centos7-base-neutron-12345:17234e9ab9dfab4cf5600f67f1d24db5064f1025_024e24f0?20:56
rf0lc0rlandy, the problem is the file that contains the list of containers20:57
rf0lc0not the container itself20:57
rlandyhttps://review.rdoproject.org/r/#/c/21895/43/ci-scripts/dlrnapi_promoter/tests/staging-setup/samples/docker_images.txt20:58
rlandy^^ that file20:58
rlandythen we need to make a file with the right format20:59
rlandymaybe it's a separate file20:59
rlandyfor your work20:59
rlandyif the list is no good20:59
rlandyI can remove the local reg20:59
rlandyand replace it with the namespace20:59
rlandybut now that is still not good?20:59
rf0lc0hold on let me get the curl command21:00
rlandyif so, we need a separate file21:00
rf0lc0https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/container-push/container-push.yml#L6521:01
rf0lc0rlandy, the promoter runs this curl command which expects the list to be in this format : https://github.com/openstack/tripleo-common/blob/master/container-images/overcloud_containers.yaml.j221:01
rf0lc0I finally finished patch https://review.rdoproject.org/r/#/c/21872/21:01
rf0lc0ready for review21:02
rf0lc0dlrn server is running fine !!!21:02
*** holser__ has quit IRC21:02
rf0lc0rlandy, will work on the new format on monday, gotta go21:02
rlandyok21:02
*** holser has joined #oooq21:04
rf0lc0rlandy, if still have time today please see https://review.rdoproject.org/r/#/c/21872/21:06
rf0lc0thx21:06
rf0lc0shutdown init21:07
rlandyk21:07
*** rf0lc0 has quit IRC21:12
*** holser has quit IRC21:36
*** jbadiapa has quit IRC21:37
*** holser has joined #oooq22:33
*** rlandy has quit IRC22:38
*** Goneri has quit IRC22:41
*** holser has quit IRC22:48
*** tosky has quit IRC23:23

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!