Monday, 2018-07-09

*** bandini has quit IRC00:41
*** bandini has joined #oooq00:42
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/56722401:00
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/56722403:00
*** saneax has joined #oooq03:09
*** atoth has quit IRC03:35
*** skramaja has joined #oooq03:36
*** jaganathan has joined #oooq03:53
*** ykarel|away has joined #oooq04:35
*** ykarel|away is now known as ykarel04:39
*** tcw has joined #oooq04:45
*** tcw has quit IRC04:55
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/56044505:00
*** links has joined #oooq05:00
*** chandankumar has joined #oooq05:08
*** chandankumar is now known as chkumar|ruck05:08
chkumar|ruck%gatestatus05:08
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/56044505:08
*** tcw has joined #oooq05:12
*** holser_ has joined #oooq05:40
*** yolanda has joined #oooq05:46
*** kopecmartin has joined #oooq05:50
quiquell|offchkumar|ruck: Is the grafana tool helping ?05:52
*** quiquell|off is now known as quiquell05:53
chkumar|ruckquiquell, yup05:56
quiquellLet me with any issue05:57
quiquellLet me know, I mean05:58
chkumar|ruckquiquell, It is possible to track periodic jobs in a seperate tab or section?05:58
quiquellYou can explore then in the explore dashboard05:59
quiquellusing05:59
quiquelljob_name ~= periodic05:59
quiquellchkumar|ruck: http://38.145.34.131:3000/d/2kHMNHvik/exploration?orgId=1&var-influxdb_filter=job_name%7C%3D~%7C%2Fperiodic%2F05:59
*** jfrancoa has joined #oooq06:04
*** matbu has joined #oooq06:11
*** holser_ has quit IRC06:19
*** quiquell is now known as quiquell|bbl06:19
*** ccamacho has joined #oooq06:39
*** jtomasek has joined #oooq06:53
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/56044507:00
*** florianf has joined #oooq07:06
*** tesseract has joined #oooq07:06
chkumar|rucksshnaidm|off, tracker bug for all zuulv3 issue [master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration - https://bugs.launchpad.net/tripleo/+bug/178072607:16
openstackLaunchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged]07:16
*** amoralej|off is now known as amoralej07:21
*** tesseract has quit IRC07:25
*** tesseract has joined #oooq07:27
*** d0ugal_ has quit IRC07:33
*** d0ugal has joined #oooq07:33
*** d0ugal has quit IRC07:33
*** d0ugal has joined #oooq07:33
*** tosky has joined #oooq07:35
*** quiquell|bbl is now known as quiquell07:43
*** bogdando has joined #oooq07:50
*** ykarel is now known as ykarel|lunch08:08
*** panda|off is now known as panda08:26
*** holser_ has joined #oooq08:43
*** gvrangan has joined #oooq08:44
*** ykarel|lunch is now known as ykarel08:49
ssbarneahi guys! I am here, please let me know with what to start.08:59
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/56722409:00
*** sshnaidm|off is now known as sshnaidm|rover09:02
sshnaidm|roverchkumar|ruck, looking09:03
chkumar|rucksshnaidm|rover, Good morning :-)09:04
pandassbarnea: hi, we were told you would not join for another 2 weeks09:04
chkumar|rucksshnaidm|rover, ocata third party job is failing http://logs.rdoproject.org/91/564291/16/openstack-check/legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata/047915d/logs/undercloud/home/zuul/overcloud_validate.log.txt.gz09:04
sshnaidm|roverssbarnea, hello!09:04
chkumar|ruckon noop check jobs09:04
sshnaidm|roverchkumar|ruck, how many times?09:05
ssbarneamaybe you know something I do not. now i am reading the onboarding document 2nd time and trying to get used ot the new environment. Any help/hints would be appreciated. In fact even giving me task to investigate something could help, anythign.09:06
quiquellssbarnea: New to tripleo-ci ?09:07
pandassbarnea: we have a scrum standup this afternoon. 14 UTC09:08
*** Goneri has joined #oooq09:08
ssbarneayeah, kinda yes I think. Please forward invites, my calendar has only the CI escalation added for today.09:09
pandassbarnea: and you don't need to attend that usually09:13
quiquellssbarnea: Welcome !09:15
pandassbarnea: sent invitation09:15
*** d0ugal has quit IRC09:17
*** ssbarnea_ has joined #oooq09:19
pandassbarnea: did you receive the invite ?09:23
ssbarneayep! and accepted.09:23
*** d0ugal has joined #oooq09:23
pandassbarnea: ping me if you need pointers09:26
quiquellpanda, marios: Have put in place some non-working reviews for todays meeting09:26
quiquellpanda, marios https://review.openstack.org/#/c/580971/, https://review.openstack.org/#/c/580974/09:27
pandaquiquell: me too09:27
quiquellpanda: So letÂÂÂ's comment on them in tmeeting09:27
pandayeah letTTTTAAAA comment them09:27
ssbarneai gues this document is stil valid, right https://docs.google.com/document/d/1IHVjfi8WJiQwAXp-dIMN9I_bR_brVclChpkevG59nmI/edit#09:29
mariosack quiquell thanks09:29
quiquellmarios: They are non working PoCs, be prepare09:31
quiquellsshnaidm|rover: Do you have a minute09:32
*** gvrangan has quit IRC09:42
ykarelchkumar|ruck, sshnaidm|rover https://review.rdoproject.org/r/#/c/14705/09:46
ykarelwe need to reschedule after ^^09:47
pandamarios: do you have a working test for https://review.openstack.org/578081 ?09:47
mariospanda: well i manually applied and ran it if that is what you mean09:48
quiquellmarios, panda: we need a reproducer job at zuul, zuul encrypt can helps us to have it09:49
pandamarios: yes, that's what I would have to do before +2, but if you have something to show, we can save time :)09:49
sshnaidm|roverquiquell, sorry, litl bit later09:49
quiquellalso a dry-run version can run can be done09:49
pandaquiquell: zuul is the answer09:49
quiquellsshnaidm|rover: np, just le me know if you have some time if not there is no problem09:49
mariosquiquell: btw i had a quick firstpass on your patches but didn't vote yet i will give them proper look either later today or tomorrow morning09:49
sshnaidm|roverykarel, great, merged09:50
sshnaidm|roverykarel, let's reschedule09:50
mariosquiquell: but thanks for putting them out i think it will help the discussion this afternnoon09:50
quiquellpanda, marios: dryrun job type can be test at a zuul job09:50
ykarelsshnaidm|rover, ok proposing09:50
mariospanda: well not sure what you mean by show? i applied it and ran it. its a pretty simple one, you could just past that into a terminal and run it see what happens09:50
quiquellmarios: Yep, at least to point to something to do09:51
*** brault has joined #oooq09:52
*** gvrangan has joined #oooq09:52
*** gvrangan has quit IRC09:53
mariospanda: i don't have the env (I only have one virt box there have been _many_ runs of reproder.sh and toci_gate_test since then on it09:53
mariospanda: if that is what you meant09:54
pandamarios: hold on, found a possible issue09:54
mariospanda:cool, commnt please.09:54
panday09:54
*** gvrangan has joined #oooq09:54
mariospanda: and if you like i can give you access to my current virthost where I can apply it for you to run?09:55
*** gvrangan has quit IRC09:55
pandamarios: commented09:56
*** gvrangan has joined #oooq09:56
mariospanda: thank you hm yeah ... i could make it something like python-[2,3].*-pip10:00
pandamarios: or you can just ignore [python3 for now, make this work with what we currently use. I see python3 from far far away right now ..10:01
mariospanda: or as you said make it .. yeah10:01
mariospanda: so i could add a note to it about python2 for now10:02
mariospanda: but then, if you do happen to be on python3 it will fail as if you _have_ to be on python2 which is kinda not nice10:02
marios:/10:02
mariospanda: i could just add a pytho --version but we want to keep this simple10:03
mariosand sane10:03
marios:)10:03
pandaquiquell:  after we merge https://review.openstack.org/580090 , what creates the ara reports ?10:04
quiquellpanda: ara-report role, of zuul-jobs10:05
quiquellpanda: It's always running,10:05
pandaquiquell: where is this included ?10:06
quiquellpanda: The info is in the commit message10:06
quiquellpanda: Check this http://lists.openstack.org/pipermail/openstack-dev/2018-March/128902.html10:06
quiquellpanda: containerized undercloud http://logs.openstack.org/90/580090/13/check/tripleo-ci-centos-7-undercloud-containers/7653825/10:07
quiquellpanda: the report is at logs/undercloud/root/ara-report10:07
pandammhh, stil can't find what runs it10:07
quiquellpanda: ara-report role: http://logs.openstack.org/90/580090/13/check/tripleo-ci-centos-7-undercloud-containers/7653825/job-output.txt.gz#_2018-07-06_14_38_22_78631910:07
quiquellpanda: wait, I am wrong, I think is the logs.openstack.org server that does it10:08
quiquellpanda: It's suppose to work out of the box, so we don't have to spend time rendering HTML10:08
quiquellpanda: The info is in the message at openstack-dev10:09
pandaquiquell: maybe I get it10:09
pandaquiquell: it's not a single command anymore, ara reports are created incrementally with callbacks after each task10:09
quiquellpanda: the sqlite, not the html report10:09
pandaso you really just need to ensure that the database is present10:10
quiquellpanda: Yep, that's this patch for10:10
quiquellpanda: You just need to have an ara-report dir with it10:10
pandaquiquell: and you're not compressing the directory anymore ?10:14
sshnaidm|roverquiquell, ok, can talk now10:17
sshnaidm|roverwhen periodics run *phew10:18
quiquellsshnaidm|rover: Have rework a little the ara+undercloud thing10:18
quiquellsshnaidm|rover: To remove the HTML generation and use the implicit logs.openstack.org mechanism10:19
quiquellsshnaidm|rover: Need you to check that I am not missing anything and that it aligns with ara+overcloud10:19
sshnaidm|roverquiquell, which one?10:19
quiquellsshnaidm|rover: https://review.openstack.org/#/c/580090/10:19
quiquellsshnaidm|rover: Has some Depends-On10:19
sshnaidm|roverquiquell, nice, need to check how it works with multiple files10:24
quiquellsshnaidm|rover: It has just ara with user zuul and ara with user root10:24
quiquellsshnaidm|rover: zuul user logs/undercloud/home/zuul/ara-report10:24
quiquellsshnaidm|rover: root user: logs/undercloud/root/ara-report10:25
quiquellsshnaidm|rover: In case of overcloud it would be mixed with undercloud10:25
quiquellsshnaidm|rover: As it's run with root10:25
sshnaidm|roverquiquell, and if we put the db files in one /logs/ara-report directory?10:25
quiquellsshnaidm|rover: wich one zuul or root user ?10:27
quiquellsshnaidm|rover: Don't know if we can mix the sqlite databases10:27
sshnaidm|roverquiquell, all of them10:28
sshnaidm|roverquiquell, well, I need to change undercloud way of ara collection anyway, it shouldn't be like that..10:29
sshnaidm|roverquiquell, so finally we'll just have 3 sqlite files10:29
*** verdurin has joined #oooq10:30
quiquellsshnaidm|rover: ara undercluod is already merge, maybe we can merge this to reduce post time10:30
quiquellsshnaidm|rover: And fix with the ara + OC patch10:30
sshnaidm|roverquiquell, well, it's merged, but it should work in different way :)10:33
sshnaidm|roverquiquell, let's merge the oc stuff and ara tasks generation first: https://review.openstack.org/#/c/580238/10:34
sshnaidm|roverquiquell, can you review it please btw ^^10:34
sshnaidm|roverquiquell, then we'll do grafana work for that, because we need this yesterday10:35
sshnaidm|roverquiquell, and then I will fix undercloud stuff and you will adopt upstream zuul tasks for that.. How is the plan?10:35
quiquellsshnaidm|rover: will, do, let's have this merged, so we have the info.10:35
quiquellsshnaidm|rover: Looks like a good plan, let's have oc and then fix the undercloud10:36
quiquellsshnaidm|rover: What do you mean with adopt upsgream zuul tasks ?10:37
sshnaidm|rovercool10:37
sshnaidm|roverquiquell, your patches with ara-report10:37
quiquellsshnaidm|rover: Ahh ok, good, going to run the oc ara thing now10:39
quiquellsshnaidm|rover: Let's get this merged10:39
*** sanjay__u has joined #oooq10:44
quiquellsshnaidm|rover: We the change at ansible.py we don't need to change ansible.cfg ?10:44
sshnaidm|roverquiquell, we change ansible.cfg in ansible.py10:47
quiquellsshnaidm|rover: But this affects undercloud too ?10:47
sshnaidm|roverquiquell, nope10:48
quiquellsshnaidm|rover: Then why we remove - containerized_undercloud|bool from undercloud-setup role ?10:48
sshnaidm|roverquiquell, so we could collect ara even in non- containerized_undercloud jobs10:49
quiquellsshnaidm|rover: Ohh that's right ok10:49
ssbarneais there a need to be subscribed to rhos-prio list?10:58
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/56722411:00
pandassbarnea: focus mainly on rhos-dev and openstack-dev11:00
ssbarnea... a lot of mail to soft(ignore) :D11:01
*** bogdando has quit IRC11:19
*** bogdando has joined #oooq11:35
*** atoth has joined #oooq11:39
*** saneax has quit IRC11:48
*** saneax has joined #oooq11:57
*** amoralej is now known as amoralej|lunch12:03
weshayssbarnea, welcome12:04
sshnaidm|roverweshay, can you please cover chkumar|ruck in ci escalation today? I need to go for 30-40 min12:05
sshnaidm|roverweshay, currently periodic jobs fail because failed login to registry, I'm on that12:05
weshaysshnaidm|rover, sure12:05
weshaysshnaidm|rover, they are running?12:05
weshaythe periodic jobs12:05
sshnaidm|roverweshay, yes, containers build job fails12:06
sshnaidm|rover^^12:06
chkumar|ruckweshay, https://bugs.launchpad.net/tripleo/+bug/178072612:06
openstackLaunchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged]12:06
chkumar|ruckit is on alerts12:06
*** d0ugal has quit IRC12:06
*** sshnaidm|rover is now known as sshnaidm|afk12:08
*** d0ugal has joined #oooq12:09
weshaysshnaidm|afk, hey qq... on the ruck/rover dashboard under zuul jobs12:15
weshaywhy are those now 90% red?12:15
weshaysshnaidm|afk, chkumar|ruck no time outs eh?12:17
weshayamazin12:17
weshayamazing12:17
chkumar|ruckweshay, https://trello.com/b/j4IcIomh/production-chain-escalation12:18
chkumar|ruckweshay, above bug https://bugs.launchpad.net/tripleo/+bug/1780726 is not added here12:18
openstackLaunchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged]12:18
quiquellweshay: How they get fixed ?12:19
chkumar|ruckweshay, I have added alert in bug12:19
weshaychkumar|ruck, it will land there, we wait 5hrs12:19
weshayquiquell, seems like minor adjustments to the mirror server settings12:19
chkumar|ruckquiquell, ack12:19
weshaychkumar|ruck, "promotion-blocker" is the tag that does the work12:20
weshaychkumar|ruck, "alert" makes it visible on #tripleo12:20
weshaychkumar|ruck, understood?12:20
chkumar|ruckweshay, yup12:20
weshayword up12:20
*** trown|outtypewww is now known as trown12:26
*** quiquell is now known as quiquell|off12:28
*** dougbtv has joined #oooq12:33
*** rlandy has joined #oooq12:34
ssbarneai made a small CR to reproducer at  https://review.openstack.org/#/c/581012/ but the gate failed with Resource CREATE failed: OverQuotaClient: resources.public_network: Quota exceeded for resources12:37
ssbarneai suspect this is not something normal12:38
rlandyssbarnea: yep - we need to clean up that tenant - not your patch's doing12:47
ssbarnearlandy: is something I can do myself?12:48
rlandyssbarnea: no - you'd need CI tenant creds for that12:48
*** ssbarnea_ has quit IRC12:48
rlandyruck/rover can take care of it12:49
rlandydon't worry about that faiing test though - it won't block your job12:49
weshayhrm.. tenant needs a cleanin?12:52
*** quiquell|off is now known as quiquell12:53
quiquellweshay: we have an alert for tenant issues12:53
*** matbu has quit IRC12:54
quiquellhttp://38.145.34.131:3000/d/pgdr_WVmk/cockpit?orgId=1&from=1530968087588&to=1531140887589&var-launchpad_tags=alert&var-promotion_names=current-tripleo&var-promotion_names=current-tripleo-rdo&var-promotion_names=current-tripleo-rdo-testing&var-releases=master&var-releases=queens&var-releases=pike&var-releases=ocata&panelId=181&fullscreen12:54
weshayquiquell, all I have w/ regards to changes to infra12:55
weshayhttps://review.openstack.org/#/c/580676/12:55
weshayhttps://review.openstack.org/57997012:55
*** matbu has joined #oooq12:56
weshayquiquell, ha.. ya.. I don't think that is what ssbarnea is hitting12:56
weshaybut I'll clean it up12:56
weshayhey ssbarnea you have a minute to chat?12:59
*** chem` has joined #oooq12:59
*** chem` is now known as chem13:00
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/56044513:00
* chkumar|ruck switches the irc server13:01
*** chkumar|ruck has left #oooq13:01
*** chkumar|ruck has quit IRC13:01
*** chandankumar has joined #oooq13:02
*** chandankumar is now known as chkumar|ruck13:02
*** ykarel is now known as ykarel|away13:02
bogdandoo/ PTAL https://review.openstack.org/#/c/577391/13:05
bogdandoeasy +213:05
*** amoralej|lunch is now known as amoralej13:11
weshaybogdando, thanks13:15
*** ykarel|away has quit IRC13:29
*** gvrangan has quit IRC13:29
ssbarneaweshay: sure! now I can talk, i was in a conf call.13:31
weshayssbarnea, morning.. ya let's chat for a few13:32
weshayhttps://bluejeans.com/u/whayutin/13:33
weshaypanda, you want to chat in a few13:39
pandaweshay: sure13:41
*** sshnaidm|afk is now known as sshnaidm|rover13:42
*** anande has joined #oooq13:45
*** skramaja has quit IRC13:46
weshaypanda, k.. ready in 2min13:49
weshaymarios, rfolco, quiquell please welcome your fellow newbie.. ssbarnea Sorin :)13:49
weshaythe incoming class of 201813:51
weshaypanda, ready13:51
marioso/ ssbarnea13:54
marioswelcome :)13:54
rfolcowelcome ssbarnea, are you joining the tripleo-ci team? where you from ?13:54
ssbarnearfolco: hi! I am UK based, Norwich. Originallly frum Bucharest, Romania (writing a description as we chat)13:55
rfolcocool :)13:56
*** anande has quit IRC13:59
pandassbarnea: meeting ?14:03
weshayssbarnea, https://bluejeans.com/7050859455/14:04
sshnaidm|roverssbarnea, Sorin, start please from changing beginning of your nick :D14:05
ssbarneasshnaidm|rover: i know this was going to be an issue as I use this nickname everywhere (github, registered nickname on irc,...). I myself use two-leter-autocomplete... so I understand the issue. I wonder if I could do something channel specific.14:09
sshnaidm|roverssbarnea, I'm kidding :) I think people will handle this with the time :D14:10
*** links has quit IRC14:18
rlandysshnaidm|rover: rfolco and I are dealing with the nick confusion ... you guys will work it out :)14:18
sshnaidm|roverrlandy, you have only 1 letter in common :)14:19
rlandysshnaidm|rover: there is a guy with the nick rlandry14:19
sshnaidm|roverrlandy, wow14:20
rlandyI get invited to his doc writer meeting on a regular basis14:20
sshnaidm|roverI wouldn't survive that14:20
*** ykarel|away has joined #oooq14:24
*** ykarel|away is now known as ykarel14:31
*** quiquell is now known as quiquell|off14:58
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/56044515:00
*** bogdando has quit IRC15:02
weshayhttps://github.com/openstack-infra/zuul-jobs/blob/master/roles/multi-node-bridge/tasks/common.yaml#L8-L1915:05
weshaypanda, ^15:05
weshayrlandy, https://trunk.rdoproject.org/centos7-master/delorean-deps.repo15:06
weshayhttps://trunk.rdoproject.org/centos7-queens/delorean-deps.repo15:06
weshayhttps://trunk.rdoproject.org/centos7-pike/delorean-deps.repo15:07
weshayhttps://trunk.rdoproject.org/centos7-ocata/delorean-deps.repo15:07
*** ykarel is now known as ykarel|away15:09
sshnaidm|roverweshay, do we have a bug triage?15:22
*** rfolco is now known as rfolcOUT15:23
weshaysshnaidm|rover, we used all our time on the scrum and the ovs issue15:27
weshaysshnaidm|rover, I reschedule it15:27
weshaysshnaidm|rover, chkumar|ruck https://semaphore.cloud.upshift.engineering.redhat.com/15:29
pandamarios: do you have PTO/holidays in this sprint ?15:52
*** anande has joined #oooq15:57
*** trown is now known as trown|lunch16:20
rlandyweshay: panda: marios: does this look basically right? https://review.openstack.org/#/c/581081/16:21
rlandybefore I ask for broader review16:22
chkumar|ruckweshay: sshnaidm|rover https://review.openstack.org/58102516:22
chkumar|ruckplease have a look, thanks :-)16:22
*** florianf has quit IRC16:24
chkumar|ruckweshay: sshnaidm|rover it is needed for tripleo-upgrade package build fix16:25
weshaychkumar|ruck, https://review.openstack.org/58108416:26
weshaychkumar|ruck, /me looks16:26
sshnaidm|roverchkumar|ruck, thanks.. weshay we don't need this in periodic jobs, right?16:26
sshnaidm|roverbecause we don't build in them afaiu16:27
chkumar|rucksshnaidm|rover: it is for check jobs against tht in non-voting if it is about container upgrade job?16:30
toskyweshay: tempestconf has a bunch of jobs that runs on changes on itself, even with different testers16:30
*** kopecmartin has quit IRC16:32
weshaytosky, k..16:32
weshaytosky, still I would like to see the refstack enabled job ONLY run aginst the python-tempestconf repo16:32
weshaytosky, does that make sense to you?16:33
toskyweshay: as I wrote in the comment, I totally agree with the need for a job with refstack, which would also cross-check if the API that tempestconf exposes is not broken16:33
toskyit should just end up in the correct file and with the proper commit message16:34
weshayk.. will have a look16:34
pandarlandy: paul just commented16:35
chkumar|ruckweshay: sshnaidm|rover only one timedout job http://logs.openstack.org/47/580747/1/gate/tripleo-ci-centos-7-containers-multinode/91fceed/job-output.txt.gz in whole day16:37
chkumar|ruckand not able to upload the logs also16:38
sshnaidm|roverchkumar|ruck, good16:38
*** florianf has joined #oooq16:40
pandarlandy: also, there's no {{ release }} variable available, I think you'll have to use zuul.branch or something similar16:41
rlandypanda; hey - I was uncertain about that ...16:41
rlandyeither way - looking at the pat paul pointed at16:42
rlandyobviously others see the problem - at least with ocata16:42
pandarlandy: if we are going to use that repo, the problem is that ther is not -master version16:43
pandarlandy: it stops at queens, so even fro zuul.branch == master, you'll have to specify queens16:43
rlandypanda:I know16:44
rlandycommenting on patch16:44
pandanow either we understand if that repo is good enough, or we push to use delorean deps.16:45
*** holser_ has quit IRC16:53
weshaychkumar|ruck, good stuff16:55
weshaysshnaidm|rover, nice fix.. containers-build is fixed16:56
*** holser_ has joined #oooq16:57
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/56722417:00
*** florianf has quit IRC17:05
*** Goneri has quit IRC17:14
*** tesseract has quit IRC17:15
*** anande has quit IRC17:20
*** trown|lunch is now known as trown17:23
weshayrlandy, ping17:27
*** holser_ has quit IRC17:33
*** holser_ has joined #oooq17:33
*** brault has quit IRC17:44
rlandyweshay: hello17:44
*** jfrancoa has quit IRC17:44
*** amoralej is now known as amoralej|off17:49
weshaymarios, ping18:10
weshayneed ur help18:10
weshayhttps://bluejeans.com/u/whayutin/18:11
*** anande has joined #oooq18:12
*** ykarel|away has quit IRC18:24
rlandypanda: is there already a review to reparent 007 and 008 out there?18:53
*** atoth has quit IRC18:53
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/56044519:00
rlandycreating reparenting job - don;t think there is one other there19:01
rlandyout there19:01
*** anande has quit IRC19:04
weshayrlandy, where does tripleo-ci get pulled into the reproducer?19:06
rlandyweshay: only on the undercloud in toci-gate-test19:07
rlandysec submitting reparenting job - then will link19:07
weshayrlandy, k.. context is .. I'm trying to get this change in play on a recreate https://review.openstack.org/#/c/580037/19:07
rlandyweshay: https://review.openstack.org/#/c/581116 ... Reparent scenario007 and 008 to tripleo-ci-base19:10
rlandyok - looking at your change above19:11
weshayrlandy, we don't clone it in the reproducer script19:13
rlandyweshay: that's tricky ... it's pretty much part of the (non-existent) card right now to update the reproducer ... this is how I would do it ...19:13
rlandyin the section that clones tq and tqe,19:13
rlandyclone tripleo-ci19:13
rlandyand two ansible playbook runs19:14
rlandythat call those playbooks19:14
weshayk.. but I'll have to parse the zuul_changes19:14
rlandyin the order they are listed in zuul jobs19:14
weshayand pull the change in question19:14
weshayright?19:14
rlandyuse git-review to do that19:14
rlandyor ...19:14
rlandychange the roles path19:14
rlandyand - I should say19:14
rlandychange the role path to read from your cloned repo19:15
rlandylike in the reproducer review I pointed to on friday19:15
rlandymake sense?19:15
weshayya19:15
*** brault has joined #oooq19:15
rlandybasically, these are all independent ansible-playbook calls19:16
weshayrlandy, because toci takes care of changes to tq and tqe I think19:16
rlandywith the same vars passed to them19:16
rlandyonly after it hits the ubdercloud19:16
rlandytoci takes care of that19:16
rlandyif you have a change that impacts running a playbook before the undercloud,19:16
rlandyyou always had to you git-review to include it19:17
*** jaganathan has quit IRC19:19
*** tosky has quit IRC19:23
*** jaganathan has joined #oooq19:30
rlandyweshay: hmm ... scenario007 abd 008 won;t run with that job19:33
rlandywill have to add another depends19:33
weshayanyone know awk?19:45
weshaybetter way to do  echo $zuul_changes | grep tripleo-ci | awk -F "tripleo-ci:" '{print $2 }' | cut -d ^ -f 1 | cut -d : -f 219:46
rlandyyou looking to pull just the changes for tripleo-ci?19:52
weshayrlandy, ya19:55
rlandyweshay: this was the origin include idea ... https://review.openstack.org/#/c/564589/19:55
rlandysuper old19:55
weshayk19:56
* weshay poking around19:56
rlandymaybe that's just confusing19:57
weshayanyone hitting20:29
weshay# If there is a change to openstack-infra/tripleo-ci include it immediately20:29
weshayecho $ZUUL_CHANGES20:29
weshayexport tripleo_ci_change=`echo $ZUUL_CHANGES | grep tripleo-ci | awk -F "tripleo-ci:" '{print $2 }' | cut -d ^ -f 1 | cut -d : -f 2`20:29
weshayif [ $tripleo_ci_change ]; then20:29
weshay  echo $tripleo_ci_change20:29
weshay  pushd tripleo-ci20:29
weshay  git fetch https://git.openstack.org/openstack-infra/tripleo-ci $tripleo_ci_change && git checkout FETCH_HEAD20:29
weshay  popd20:29
weshayfi20:29
weshayoops20:29
weshayTASK [libvirt/setup/overcloud : Resize undercloud image (call virt-resize)] *****************************************************************************************************************************************20:29
weshayfatal: [127.0.0.2]: FAILED! => {"changed": true, "cmd": ["virt-resize", "--expand", "/dev/sda1", "/var/tmp/ara/undercloud.qcow2", "/var/tmp/ara/undercloud-resized.qcow2"], "delta": "0:00:06.786351", "end": "2018-07-09 16:29:06.931990", "msg": "non-zero return code", "rc": 1, "start": "2018-07-09 16:29:00.145639", "stderr": "virt-resize: error: libguestfs error: /usr/bin/supermin5 exited with error \nstatus 1.\nTo see full error messages you20:29
weshaymay need to enable debugging.\nDo:\n  export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1\nand run the command again.  For further information, read:\n  http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs\nYou can also run 'libguestfs-test-tool' and post the *complete* output\ninto a bug report or message to the libguestfs mailing list.\n\nIf reporting bugs, run virt-resize with debugging enabled and include the \ncomplete output:\n\n20:29
weshayvirt-resize -v -x [...]", "stderr_lines": ["virt-resize: error: libguestfs error: /usr/bin/supermin5 exited with error ", "status 1.", "To see full error messages you may need to enable debugging.", "Do:", "  export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1", "and run the command again.  For further information, read:", "  http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs", "You can also run 'libguestfs-test-tool' and post the20:29
weshay*complete* output", "into a bug report or message to the libguestfs mailing list.", "", "If reporting bugs, run virt-resize with debugging enabled and include the ", "complete output:", "", "  virt-resize -v -x [...]"], "stdout": "[   0.0] Examining /var/tmp/ara/undercloud.qcow2", "stdout_lines": ["[   0.0] Examining /var/tmp/ara/undercloud.qcow2"]}20:30
weshayhrm..20:31
weshayworks manually20:31
weshaysudo virt-resize --expand /dev/sda1 /var/tmp/ara/undercloud.qcow2 /var/tmp/ara/undercloud-resized.qcow220:31
weshaybah.. now it's working20:36
weshaywth20:36
*** brault has quit IRC20:48
rlandynot really20:50
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/56044521:00
*** jtomasek has quit IRC21:37
*** holser_ has quit IRC21:58
*** jaganathan has quit IRC22:15
*** jaganathan has joined #oooq22:27
*** brault has joined #oooq22:48
*** brault has quit IRC22:53
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/56044523:00
*** yolanda_ has joined #oooq23:06
*** yolanda has quit IRC23:09
*** rook has quit IRC23:22
*** hubbot` has joined #oooq23:22
*** hubbot has quit IRC23:23
*** rook has joined #oooq23:25
*** rook is now known as Guest6789823:25
*** bandini has quit IRC23:27
*** bandini has joined #oooq23:28

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!