Monday, 2018-08-13

hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-containerized-undercloud-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci- (1 more message)00:44
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-containerized-undercloud-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci- (1 more message)02:44
*** chandankumar has quit IRC03:05
*** udesale has joined #oooq03:57
*** skramaja has joined #oooq04:17
*** jaosorior has joined #oooq04:28
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, (1 more message)04:44
*** jaganathan has joined #oooq05:04
*** chandankumar has joined #oooq05:41
*** saneax has joined #oooq05:47
*** kopecmartin has joined #oooq05:47
*** ykarel has joined #oooq05:54
*** jaosorior has quit IRC05:59
*** gvrangan has joined #oooq06:09
*** marios has quit IRC06:09
*** marios has joined #oooq06:10
*** ratailor has joined #oooq06:11
*** jfrancoa has joined #oooq06:11
*** ykarel_ has joined #oooq06:25
*** udesale has quit IRC06:25
*** ykarel has quit IRC06:27
*** ykarel__ has joined #oooq06:33
*** ykarel_ has quit IRC06:35
*** ykarel__ is now known as ykarel06:41
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, (1 more message)06:44
*** ssbarnea has joined #oooq06:55
*** udesale has joined #oooq07:02
*** apetrich has joined #oooq07:04
*** amoralej|off is now known as amoralej07:16
*** holser_ has joined #oooq07:37
*** ccamacho has joined #oooq07:40
*** bogdando has joined #oooq07:42
*** jaosorior has joined #oooq07:46
*** holser_ has quit IRC07:52
*** holser_ has joined #oooq07:54
*** ykarel is now known as ykarel|lunch07:59
*** jaosorior_ has joined #oooq08:36
*** jaosorior has quit IRC08:40
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, tripleo-ci-centos-7-containerized-undercloud-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000 (1 more message)08:44
*** dtantsur|afk is now known as dtantsur08:49
*** ykarel|lunch is now known as ykarel08:56
ykarelarxcruz, chandankumar is this issue known https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/1d10f1a/logs/undercloud/home/zuul/tempest.log.txt.gz,09:15
ykareltests from not deployed services are running09:16
*** ccamacho has quit IRC09:21
arxcruzchecking09:25
arxcruzwow, 583 failures09:28
arxcruzis this patrole a new plugin running?09:29
arxcruzchandankumar: ^09:29
chandankumararxcruz: nope09:31
arxcruzwas it running before?09:32
chandankumararxcruz: got the issue09:35
chandankumarfixing it09:35
arxcruzchandankumar: what was ?09:36
*** ccamacho has joined #oooq09:39
*** jaosorior_ is now known as jaosorior09:39
*** apetrich has quit IRC09:47
*** tosky has joined #oooq09:59
*** jaosorior has quit IRC10:09
*** jaosorior has joined #oooq10:11
*** panda is now known as panda|ruck10:15
amoralejany ETA for rocky promotion pipeline?10:18
*** tosky has quit IRC10:19
*** ccamacho has quit IRC10:31
*** ccamacho has joined #oooq10:32
*** ykarel is now known as ykarel|afk10:38
*** hubbot has quit IRC10:45
*** dmellado has quit IRC10:46
panda|ruckamoralej:  https://review.openstack.org/590779 https://review.rdoproject.org/r/15376 https://review.rdoproject.org/r/1537410:48
*** holser_ has quit IRC11:03
amoralejit seems there is outage in RDO Cloud11:03
amoralejpanda|ruck, ^11:03
amoralejyou may be seeing it too11:03
*** sshnaidm is now known as sshnaidm|off11:04
panda|ruckamoralej: yep, I can't access anything11:06
panda|ruckamoralej: are you opening a ticket ?11:09
amoralejwe have pinged ops in irc11:10
amoralejthey are checking11:10
amoralejpanda|ruck, i just opened a ticket too11:12
*** panda|ruck is now known as panda|ruck|lunch11:23
*** udesale has quit IRC11:27
*** amoralej is now known as amoralej|lunch11:32
*** tosky has joined #oooq11:41
*** holser_ has joined #oooq11:44
*** ykarel|afk is now known as ykarel11:45
*** saneax has quit IRC11:46
*** panda|ruck|lunch is now known as panda|ruck12:02
*** honza has joined #oooq12:06
honzaweshay: why are we deprecating quickstart.sh?12:06
honza(i'm trying to organize my thoughts on this whole reproducer thing)12:07
panda|ruckhonza: a few reasons. it's not aligned with what we do in tripleo-ci: running diffrent playbooks12:10
honzapanda|ruck: what are we replacing it with?12:11
panda|ruckhonza: in general we're trying to drop bash in favor of ansible as much as we can.12:11
honzapanda|ruck: that sounds like a great plan12:11
honzapanda|ruck: is this already in progress?  can i see some examples?12:11
*** saneax has joined #oooq12:12
honzaie what sort of thing would replace quickstart.sh?12:12
*** ChanServ sets mode: +o panda|ruck12:13
*** panda|ruck changes topic to "Docs: https://docs.openstack.org/tripleo-quickstart/latest/ || RDO cloud is DOWN (20180813)"12:13
*** panda|ruck sets mode: -o panda|ruck12:13
panda|ruckhonza: we  don't have a replacement yep. The only place is which we are running the multiple playbooks is in triple-ci repo12:14
honzapanda|ruck: does that mean that tripleo-quickstart is becoming a library consumed by tripleo-ci?12:15
panda|ruckhonza: yes, and I have some proposal to merge tq and tqe into tripleo-ci12:15
*** sanjayu_ has joined #oooq12:16
honzapanda|ruck: already published?12:16
panda|ruckhonza: only discussed, as soon as I end my ruck shift I will put and RFE12:17
honzapanda|ruck: ah, cool12:17
panda|ruckhonza: don't have much time for anything else while ruck12:17
*** jaosorior has quit IRC12:18
*** saneax has quit IRC12:18
*** jaosorior has joined #oooq12:19
*** ratailor has quit IRC12:20
weshayhonza, I think what we'll be doing is making sure the upstream workflow is called from quickstart.sh12:20
weshaythe goal is to make sure what ever is run locally is VERY well tested12:21
*** rfolco|rover has joined #oooq12:23
weshaypanda|ruck, 30 min sync after tripleo-ci- weekly12:24
*** amoralej|lunch is now known as amoralej12:25
weshaypanda|ruck, rfolco|rover is rdo-cloud down?12:26
weshay<ykarel> apevec, cshastri_ is checking12:27
weshay<apevec> ack, thanks cshastri_ !12:27
weshay<ykarel> it's still down, no api access, no vm access12:27
weshay<apevec> yeah, rdo website, review etc. is timing out12:27
weshay<cshastri_> apevec: seems we have that ovs issue again12:27
weshay<apevec> damn ovs12:27
panda|ruckweshay: yes it is12:31
*** apetrich has joined #oooq12:31
*** trown|outtypewww is now known as trown12:32
*** tosky has quit IRC12:35
honzaweshay: what upstream exactly? tripleo-ci?12:44
weshayya.. the workflow that is executed here http://zuul.openstack.org/12:45
honzaweshay: what exactly do you mean by 'locally'?12:49
*** dmellado has joined #oooq12:50
weshayrfolco|rover, panda|ruck this bug is turning master red12:53
weshayhttps://bugs.launchpad.net/tripleo/+bug/178653312:53
openstackLaunchpad bug 1786533 in tripleo "periodic fs050 upgrades: Unable to delete the specified workbook(s)" [Critical,Triaged]12:53
*** myoung|off is now known as myoung12:53
myoungo/12:53
*** dtrainor has joined #oooq13:01
weshayssbarnea, you online?13:08
honzaweshay: panda|ruck: i'm preparing a proposal/discussion thread for openstack-dev about oooq, and I wonder if you can help me with some references for what you've both told me above.  Are there any helpful threads that I can use?13:23
*** skramaja has quit IRC13:30
*** gvrangan has quit IRC13:33
weshayhonza, I suspect this is a ptg discussion13:46
*** jfrancoa has quit IRC13:50
*** jfrancoa has joined #oooq14:06
*** vinaykns has joined #oooq14:24
*** ykarel is now known as ykarel|away14:30
*** ykarel|away has quit IRC14:36
*** ccamacho has quit IRC14:50
*** ccamacho has joined #oooq14:56
honzaweshay: panda|ruck: interesting, ... it's just that the way you talk about it sounds a lot more definite14:57
weshayhonza, it's hard to provide community level support for workflows that do not have check job / gate jobs14:58
weshaywe had check /gate jobs for quickstart.sh workflows previously.. however the hardware is now insufficient14:58
weshayfor tripleo overcloud deployments14:59
weshayso.. we're working that issue on multiple fronts14:59
*** kopecmartin has quit IRC15:00
*** kopecmartin has joined #oooq15:15
weshaypanda|ruck, getting on w/ alex15:19
weshayre: stien15:19
*** holser_ has quit IRC15:24
panda|ruckweshay: where ?15:32
panda|ruckweshay: do I need to attend ?15:32
weshayhttps://redhat.bluejeans.com/u/whayutin/15:32
weshaypanda|ruck, no15:32
weshaybut just fyi15:32
panda|ruckweshay: ok15:32
myoungo/ tempest squad scrum starting15:33
myoungweshay:  ^^15:34
*** vinaykns has quit IRC15:34
*** sanjayu_ has quit IRC15:35
*** bogdando has quit IRC15:51
*** jfrancoa has quit IRC15:56
chandankumararxcruz: kopecmartin https://etherpad.openstack.org/p/tempest-sprint-1816:01
myoungpanda|ruck, weshay: chandankumar and I are in BJ16:02
chandankumaramoralej: kopecmartin dump other stuffs we need to cover for sprint 1816:02
myoungkopecmartin, amoralej, please use --> https://review.rdoproject.org/etherpad/p/tripleo-ci-sprint18 instead :)16:05
amoralejsorry, is that for me or for arxcruz ?16:06
myoungarxcruz: ^^16:06
arxcruzi guess is for me :)16:06
myoungamoralej: I didn't think so but didn't want to second guess chandankumar16:06
amoralejok :)16:07
amoraleji just wanted to make sure i'm missing something16:08
*** dtrainor_ has joined #oooq16:08
*** dtrainor has quit IRC16:09
chandankumaramoralej: is next week ok for rocky branch creation for tempest plugins ?16:09
amoralejthere are RC1 branches for many projects already16:10
amoralejso if it could be end of this week16:10
amoralejit'd be fantastic16:10
amoraleji'd like to get rc1 passing ci on next week16:10
chandankumaramoralej: yes, we will kick the tires this week16:10
panda|ruckamoralej: did you see my changes for the rocky pipeline in the end ?16:11
weshayamoralej, merge this https://review.rdoproject.org/r/#/c/15376/216:16
amoraleji was checking right before the outage16:16
weshaypanda|ruck, -1 on zuul here https://review.rdoproject.org/r/#/c/15374/16:17
weshayamoralej, thanks16:17
*** kopecmartin has quit IRC16:20
panda|ruckdammit gertty16:20
weshayrfolco|rover, http://38.145.34.55/master.log16:22
weshayrfolco|rover, look into that please.. host is unreachable16:22
rfolco|roverweshay, looking16:23
myoungweshay, chandankumar, panda|ruck: link from sprint pre-planning just now: https://review.rdoproject.org/etherpad/p/tripleo-ci-sprint1816:23
weshaymyoung, we doing that now? or did I miss it?16:23
myoungweshay: we just finished, but panda and I are still here if you want to chat16:24
myoungsame bat channel16:24
weshaymeh..16:24
* weshay reading16:24
weshaythanks all16:25
*** ccamacho has quit IRC16:31
rfolco|roverweshay, I could not find any info on how to fix unreachable host 38.145.34.55, if we open a ticket, send an email, if there is something I could do on my side...16:33
weshayrfolco|rover, what steps did you take?16:34
weshayrfolco|rover, feel free to reboot the instance etc..16:34
weshayrfolco|rover, can you get onto the console?16:34
rfolco|roverweshay, ah, this helps... instance at rdo-cloud, ok16:34
weshayrfolco|rover, ya.. it's in the tripleo-infra tenant16:35
rfolco|roverweshay, you mean rhos-dev-ci?16:36
weshayrfolco|rover,16:39
weshayno16:39
weshayrfolco|rover, log into your rdo cloud tenant16:39
weshayrfolco|rover, and in the ui switch tenants to tripleo-infra16:40
rfolco|roverweshay, thank you. It works.16:41
weshayrfolco|rover, glad you have access16:42
rfolco|roverweshay, pvt... access info to promoter box16:43
*** dtantsur is now known as dtantsur|afk16:59
*** myoung is now known as myoung|lunch17:03
*** trown is now known as trown|lunch17:07
*** rlandy has joined #oooq18:05
*** amoralej is now known as amoralej|lunch18:14
*** amoralej|lunch is now known as amoralej|off18:14
*** rfolco|rover is now known as rfolco|rover|brb18:15
rlandymyoung|lunch: hi - how's it going?18:16
*** myoung|lunch is now known as myoung18:20
* myoung hasn't been eating this long18:20
myoungrlandy: welcome back18:20
*** trown|lunch is now known as trown18:22
rlandymyoung: what did I miss?18:26
* rlandy tries to avoid reading tons of mail 18:27
* rlandy waves at weshay18:31
myoungrlandy: chat in 10?  just finishing putting something togethjer18:31
rlandymyoung: sure18:31
weshayrlandy, you are back?18:31
rlandyweshay: I am18:31
weshayhow was the trip?18:32
rlandyawesome18:32
weshayvery cool18:32
rlandygoing to meet with myoung to see what I can help with in what's left of sprint18:33
weshayrlandy, k.. ya. still landing some browbeat / zuulv3 patches for rdo18:34
rlandyweshay: still browbeat?18:34
rlandyoh - the rdo v3 part18:34
rlandyyeah - I guess those could take a while18:35
myoungwe're close18:42
myoungfor the browbeat stuff18:42
myounghttps://softwarefactory-project.io/r/#/c/13256 is next18:42
rlandywhat happened to https://review.rdoproject.org/zuul/status.html?18:43
myoungrlandy: o/  chat now?18:53
rlandysure18:53
myoungrlandy: https://bluejeans.com/705085945518:53
*** rfolco|rover|brb is now known as rfolco|rover19:05
*** sanjayu_ has joined #oooq19:07
rlandyweshay: re: https://review.rdoproject.org/r/#/c/15125/2/zuul.d/zuul-v3-jobs.yaml - is the playbooks var not able to be redefined per job?19:07
*** sanjayu_ has quit IRC19:07
rlandyquerying quique's comment19:08
rlandyI would not want to have that included for every OVB job if we don;t have to ( we did have to in the old workflow)19:08
rlandymyoung: ^^19:08
rlandyweshay: I would object to https://review.openstack.org/#/c/590090/19:09
rlandyif it is possible to overwrite19:09
weshayrlandy, you want me to -1?19:12
weshayworkflow?19:12
rlandyweshay: I want your opinion :)19:12
weshayrlandy, I'm not seeing the problem w/ it yet19:13
weshaybut I'm not deep here19:13
rlandyweshay: can you join us on bj for a minute19:13
rlandyit will be quicker to explain19:13
weshayk19:13
weshayin my blue19:14
myoungwe're in mine...should cut over?19:14
weshaygoing to myoung19:15
weshaymyoung, give me the number19:16
weshaygetting a password change request from blue19:16
weshayatm19:16
rlandyhttps://bluejeans.com/7050859455/19:16
*** Tengu_ has joined #oooq19:20
*** Tengu has quit IRC19:25
weshayhttps://review.openstack.org/#/c/584508/32/playbooks/tripleo-ci/vars/environment_type/multinode.yaml19:27
weshayrlandy, myoung19:27
*** holser_ has joined #oooq19:31
*** holser_ has quit IRC19:35
*** apetrich has quit IRC19:41
weshayrfolco|rover, ping19:42
weshayrfolco|rover, https://bluejeans.com/7050859455/19:42
jristugh20:08
jristanother huge failure :(20:08
jristPlan creation failed Error retrieving environment for plan default-plan: Object GET failed: https://192.168.24.2:13808/v1/AUTH_c395bd1dc2e149e9a16669f5d1778668/default-plan/plan-environment.yaml 404 Not Found [first 60 chars of response] <html><h1>Not Found</h1><p>The resource could not be found.<20:09
jristcan't even upload a plan20:09
weshayrfolco|rover, https://review.openstack.org/#/c/590090/3/playbooks/tripleo-ci/vars/environment_type/ovb.yaml20:10
weshayrfolco|rover, https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-ci/run-v3.yaml#L3620:11
*** apetrich has joined #oooq20:34
*** dtrainor_ has quit IRC20:54
*** trown is now known as trown|outtypewww20:55
*** dtrainor has joined #oooq20:55
*** apetrich has quit IRC20:59
chandankumarweshay: myoung It's celebration time21:15
weshayoh ya21:15
chandankumarweshay: myoung https://review.openstack.org/54127321:16
chandankumarwe finally made it21:16
weshaynice21:16
weshaychandankumar++21:16
weshay1 man w/ so much powa21:16
chandankumarit is not possible wihtout you myoung arxcruz mkopec and tosky support21:17
arxcruzi did nothing21:17
arxcruz:)21:17
myoungchandankumar++21:22
myoungchandankumar: that's great news :)21:22
*** rlandy has quit IRC22:09

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!