Thursday, 2018-05-10

hubbotFAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-quickstart-extras-gate-newton-delorean-full-minimal @ https://review.openstack.org/56044500:06
hubbotFAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-quickstart-extras-gate-newton-delorean-full-minimal @ https://review.openstack.org/56044502:06
*** links has joined #oooq02:28
*** ykarel|away has joined #oooq03:07
*** ykarel|away is now known as ykarel03:08
*** links has quit IRC03:43
ykarelpromoter is not promoting hashes03:45
ykareli can check all jobs passed for master/queens03:48
ykarelqueens: https://trunk.rdoproject.org/api-centos-queens/api/civotes_detail.html?commit_hash=aab3800eaddb5415fe54b8911e5e9f355cb87361&distro_hash=0c8f7f95a9dace8504905c03862036fe270f154503:48
ykarelmaster: https://trunk.rdoproject.org/api-centos-master-uc/api/civotes_detail.html?commit_hash=74d9700e15b7c2e80b80709c6deccfdd16669805&distro_hash=d032039d7ff7c0dc5f11a2ce9b68e2fa179cba9a03:49
*** tcw has quit IRC04:01
*** tcw has joined #oooq04:03
hubbotFAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode, tripleo-quickstart-extras-gate-newton-delorean-full-minimal @ https://review.openstack.org/56044504:06
*** tcw has quit IRC04:16
*** tcw has joined #oooq04:18
*** udesale has joined #oooq04:27
*** hamzy has joined #oooq04:38
*** pgadiya has joined #oooq04:38
*** pgadiya has quit IRC04:38
*** saneax-_-|AFK is now known as saneax04:43
*** links has joined #oooq04:49
*** tcw has quit IRC04:55
*** marios has joined #oooq04:56
*** tcw has joined #oooq05:01
*** ratailor has joined #oooq05:03
*** jtomasek has joined #oooq05:15
*** tcw has quit IRC05:17
*** ccamacho has quit IRC05:17
*** marios has quit IRC05:18
*** marios has joined #oooq05:18
*** ratailor_ has joined #oooq05:21
*** ratailor has quit IRC05:25
*** quiquell|off is now known as quiquell05:41
quiquellykarel: http://38.145.34.131:7272/ has put a tool in cplace to check ci stuff05:42
*** saneax has quit IRC05:46
ykarelquiquell, nice05:48
ykarelquiquell, have you checked why promotion is skipped05:49
*** saneax has joined #oooq05:50
quiquellgive me a minute05:53
*** ykarel_ has joined #oooq05:55
*** ykarel_ has quit IRC05:56
*** ykarel_ has joined #oooq05:56
*** ratailor__ has joined #oooq05:57
*** ykarel has quit IRC05:57
*** ratailor_ has quit IRC06:00
quiquellykarel_: Check now http://38.145.34.131:7272/06:00
quiquellThe lock problem, going to deply the lockless promoter06:01
quiquellNow that we run it sequencial06:01
*** ykarel_ is now known as ykarel06:03
*** jfrancoa has joined #oooq06:04
ykarelquiquell, ok pike promotion is going on, let's see if master/queens starts once it's complete06:04
hubbotFAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode, tripleo-quickstart-extras-gate-newton-delorean-full-minimal @ https://review.openstack.org/56044506:06
quiquellOk, now it shows the ongoing06:12
quiquellhttp://38.145.34.131:7272/06:12
*** matbu has quit IRC06:13
*** quiquell is now known as quiquell|afk06:13
*** ccamacho has joined #oooq06:14
ykarelquiquell|afk, also would be good to add logs link06:43
*** bogdando has joined #oooq07:09
*** tesseract has joined #oooq07:24
*** ykarel has quit IRC07:25
*** zoli is now known as zoli|wfh07:29
*** zoli|wfh is now known as zoli07:29
*** holser__ has joined #oooq07:31
*** tosky has joined #oooq07:37
*** skramaja has joined #oooq07:39
*** quiquell|afk is now known as quiquell07:43
*** arxcruz is now known as arxcruz|off07:46
*** ykarel has joined #oooq07:51
*** lucas-afk is now known as lucasagomes07:55
quiquellykarel: Is in the backlog of the tool, didn't have time to add it07:57
ykarelquiquell, ack07:59
*** ykarel is now known as ykarel|lunch08:00
*** jaganathan has joined #oooq08:02
*** sshnaidm|off is now known as sshnaidm|rover08:03
hubbotFAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode, tripleo-quickstart-extras-gate-newton-delorean-full-minimal @ https://review.openstack.org/56044508:07
quiquellsshnaidm|rover: We have to talk about the promoter08:24
quiquelllook http://38.145.34.131:7272/08:24
quiquellIt's still looking sometimes, let's try the lockeless version08:24
*** ratailor__ has quit IRC08:25
jfrancoasshnaidm|rover:  hey, are you aware of any infra issue? jobs are timeouting https://review.openstack.org/#/c/567275/08:32
sshnaidm|roverjfrancoa, hi, looking into it08:34
sshnaidm|roverjfrancoa, we built a new centos image tonight to solve one of issues, so it may affect.. in investigation08:35
jfrancoasshnaidm|rover: thanks, I've seen it already in couple of patches. The patch gets a -2 because few of the jobs timeout08:35
*** holser__ has quit IRC08:39
*** holser__ has joined #oooq08:42
*** udesale has quit IRC08:47
*** udesale has joined #oooq08:47
*** moguimar has quit IRC08:54
*** moguimar has joined #oooq08:56
sshnaidm|roverquiquell, sure, but let's look at it later, there are blocking gate issues now..09:02
quiquellsshnaidm|rover: ack ^09:02
*** panda|off is now known as panda09:05
*** moguimar has quit IRC09:07
*** ykarel|lunch is now known as ykarel09:09
*** gkadam has joined #oooq09:14
*** kopecmartin has joined #oooq09:14
sshnaidm|roverquiquell, have you logged in into https://review.rdoproject.org/dashboard/ ever?09:19
quiquellsshnaidm|rover: Nop09:19
sshnaidm|roverquiquell, can you please log in? need your user there to appear09:20
quiquellsshnaidm|rover: I think I am logged in now09:20
sshnaidm|roverquiquell, are you logged as ellorent@redhat.com?09:21
quiquellsshnaidm|rover: That's me09:21
sshnaidm|roverquiquell, https://review.rdoproject.org/sf/user_settings.html09:21
sshnaidm|roverquiquell, oh, I see there quique.llorente@gmail.com09:22
sshnaidm|roverthat's why I couldn't find you..09:22
quiquellsshnaidm|rover: I didn't want to create a github account for redhat...09:23
sshnaidm|roverit's over github09:23
quiquellLooks like you can have more than one e-mail09:23
sshnaidm|roverquiquell, yeah, for me it's also non RH account09:23
*** matbu has joined #oooq09:24
sshnaidm|roverI can change in gerrit settings, but not in general settings09:26
quiquellsshnaidm|rover: There is a place were you can add an e-mail and set it as the main09:29
quiquellsshnaidm|rover: I did it just in gerrit, you have an extra settins for the gerrit part09:30
*** udesale has quit IRC09:31
sshnaidm|roverquiquell, yep09:32
quiquellDamn I have to read, you have already say  it :-)09:32
*** moguimar has joined #oooq09:33
quiquellSo what are you doing with may precious user ?09:33
sshnaidm|roverquiquell, dmsimard created for us a separate grafana dashboard: https://review.rdoproject.org/grafana/dashboard/db/tripleo-ci-monitoring?orgId=109:36
sshnaidm|roverquiquell, I'd like we'll use it for ruck-rover dashboard09:37
quiquellsshnaidm|rover: Agree I was going to do some work now09:37
sshnaidm|roverquiquell, rdo-infra also uses telegraf, so we can join to them and add our plugins there09:37
sshnaidm|roverquiquell, just need to add you as admin there, that's why needed your login09:38
sshnaidm|roverquiquell, btw, #rdo is recommended to join there, we talk about a lot of issues in this channel09:40
*** moguimar has quit IRC09:42
*** moguimar has joined #oooq09:42
quiquellsshnaidm|rover: Do you have some info about influxdb + grafana integration we have ?09:44
*** d0ugal_ has quit IRC09:45
*** d0ugal has joined #oooq09:45
*** d0ugal has quit IRC09:45
*** d0ugal has joined #oooq09:45
quiquellsshnaidm|rover: Looks like I don't have admin, super power cannot add data sources and similar09:45
sshnaidm|roverquiquell, we have our db "tripleo_ci" in InfluxDB which is registered in grafana09:47
sshnaidm|roverquiquell, yeah, you can't do there anything09:47
sshnaidm|roverquiquell, even my powers are about dashboard only, but we have already everything in place09:48
sshnaidm|roverquiquell, we need to send data to influxdb database "tripleo_ci" and then it will be available in grafana09:48
sshnaidm|roverquiquell, for sending it from our custom scripts I would use "telegraf", which is used in rdo too09:49
sshnaidm|roverquiquell, but anyway we need to test it locally before configuring something there09:49
quiquellsshnaidm|rover: Do you have some examples we do here ?09:49
sshnaidm|roverquiquell, examples of what?09:50
quiquellsshnaidm|rover: Na don't worry going to install a grafana and play around09:50
sshnaidm|roverquiquell, for installing grafana and influx you can use: https://gist.github.com/sshnaidm/acc5ec86b2ea7e98c880ec9fa929941b09:51
sshnaidm|roverquiquell, I did it when we started to work with it09:51
quiquellCool thanks09:51
quiquellWill ask more stuff09:51
sshnaidm|roverquiquell, sure09:52
sshnaidm|roverjust need to add there telegraf container too09:52
quiquellsshnaidm|rover: Will test it too09:53
*** moguimar has quit IRC09:54
hubbotFAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch, tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata- (1 more message)10:07
sshnaidm|roverhubbot, don't put salt on my wounds please10:08
hubbotsshnaidm|rover: Error: "don't" is not a valid command.10:08
quiquellsshnaidm|rover: Poor little hubbot he is an attaboy10:12
quiquellsshnaidm|rover: To access influxdb mydb from grafana what's the user:password ?10:25
quiquellIt throws a Bad Gateway to grafana10:25
*** moguimar has joined #oooq10:26
*** udesale has joined #oooq10:27
*** udesale has quit IRC10:28
*** udesale has joined #oooq10:28
sshnaidm|roverquiquell, local grafana?10:32
sshnaidm|roverquiquell, you don't need user/pass10:32
quiquellNa, just going to use this10:33
quiquellhttps://github.com/nicolargo/docker-influxdb-grafana/blob/master/docker-compose.yml10:33
*** pliu_ has joined #oooq10:40
quiquell sshnaidm|rover: Powerful tool grafana + influxdb10:48
sshnaidm|roverquiquell, yeah, exactly what we need10:48
quiquellsshnaidm|rover: What is telegraf giving us ?10:50
sshnaidm|roverquiquell, it will run our custom scripts periodically and will send output to influxdb10:51
quiquellOk10:52
sshnaidm|roverquiquell, something like that: https://docs.influxdata.com/telegraf/v1.6/concepts/data_formats_input/10:52
quiquellSimilar to elasticsearch beams10:52
*** zoli is now known as zoli|lunch10:59
*** moguimar has quit IRC11:01
*** holser__ has quit IRC11:02
*** moguimar has joined #oooq11:03
*** moguimar has quit IRC11:03
*** moguimar has joined #oooq11:06
*** florianf has joined #oooq11:08
*** lucasagomes is now known as lucas-hungry11:09
*** panda is now known as panda|lunch11:09
*** udesale_ has joined #oooq11:18
*** udesale_ has quit IRC11:18
*** udesale_ has joined #oooq11:18
*** udesale_ has quit IRC11:18
*** udesale_ has joined #oooq11:19
*** udesale has quit IRC11:21
*** jfrancoa has quit IRC11:24
*** jfrancoa has joined #oooq11:29
*** skramaja_ has joined #oooq11:33
*** skramaja has quit IRC11:35
*** skramaja has joined #oooq11:40
*** skramaja_ has quit IRC11:41
*** florianf is now known as florianf|afk11:45
*** florianf|afk has quit IRC11:45
*** dougbtv has quit IRC11:52
*** tcw has joined #oooq11:52
*** dsneddon has quit IRC11:53
*** lucas-hungry is now known as lucasagomes11:56
*** dsneddon has joined #oooq11:56
*** zoli|lunch is now known as zoli|wfh11:58
*** zoli|wfh is now known as zoli11:59
*** panda|lunch is now known as panda12:02
*** dtrainor has quit IRC12:05
*** dtrainor has joined #oooq12:05
*** quiquell is now known as quiquell|lunch12:07
hubbotFAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp- (3 more messages)12:07
*** amoralej is now known as amoralej|lunch12:10
*** trown|outtypewww is now known as trown12:15
weshaysshnaidm|rover, you there? https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/221/12:15
*** atoth has joined #oooq12:19
sshnaidm|roverweshay, yeah, here12:21
*** holser__ has joined #oooq12:22
weshaysshnaidm|rover, hey.. want to get on blue and see what we can do here?12:22
* weshay looking at the last master run12:23
sshnaidm|roverweshay, one sec12:23
weshaytrying to determine if it was cent7512:23
sshnaidm|roverweshay, we have problem with hashes: https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing/852/console12:23
weshaysshnaidm|rover, https://bluejeans.com/u/whayutin/ /me looks12:25
*** matbu has quit IRC12:30
*** rlandy has joined #oooq12:33
rlandysshnaidm|rover: myoung|ruck: have you seen the updates on the hardware tickets we have with ops12:38
rlandyjpainter has left some info there12:38
*** matbu has joined #oooq12:38
*** holser__ has quit IRC12:49
*** holser__ has joined #oooq12:50
weshaymyoung|ruck, you online?12:55
*** Goneri has joined #oooq13:06
myoung|ruckweshay: yes, prepping for scrum meeting in 6 min13:24
myoung|ruckin my channel13:24
rlandypanda: hi - thank for your comment re: the unittesting13:24
*** atoth has quit IRC13:24
rlandythere was little design around that13:24
myoung|ruckweshay: (just got online)  morning, saw emails from last night13:24
rlandyso I threw up a patch to start the discussion13:24
rlandypanda: my other thought is to just use tox13:25
rlandywill discuss at meeting13:25
pandarlandy: excellent, let's discuss13:25
*** atoth has joined #oooq13:26
pandaeverything I say lately comes out differntly than what I thought when re reading it.13:27
rlandypanda: that is fine13:28
rlandyI wanted the comments13:28
rlandythe rest of that patch is somewhat decent but the tests were very undefined13:28
pandarlandy: I have some comments on the other parts too, but one step at a time.13:29
sshnaidm|rovermyoung|ruck, should be rover in scrum?13:29
weshaysshnaidm|rover, rover should, ruck should not13:31
myoung|ruckscrum for CI squad is now :)13:31
*** florianf has joined #oooq13:33
pandarlandy: scrum ?13:34
rlandyjoining13:34
*** zoli is now known as zoli|afk13:41
*** links has quit IRC13:46
*** dmellado has joined #oooq13:47
*** saneax is now known as saneax|AFK14:01
weshaymyoung|ruck, had to drop for another mtg14:04
myoung|ruckack np14:04
hubbotFAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch, tripleo-ci-centos-7-scenario003-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master,  (3 more messages)14:07
jfrancoahey panda, just wanted to ask you if you're planning to show some sketch/draft for the releases change in the CI jobs during tomorrow upstream upgrades meeting14:11
jfrancoapanda: it's just to add it into the etherpad for the meeting (if there are no entries, the meeting doesn't take place)14:12
*** quiquell|lunch is now known as quiquell|off14:18
pandajfrancoa: we still have to prepare something to show14:20
pandajfrancoa: we have a meeting to do that in 3 hours14:20
jfrancoapanda: ok, no worries, whenever you feel it's ready14:20
pandajfrancoa: I think it's ok to put a note in the agenda, it shoulnd't take more than 5-10 minutes14:20
pandajfrancoa: I think we agreed on show something, we just have to understand what14:21
jfrancoapanda: ok, thanks. I'll add it then, anyway if you feel it's not ready or you need some more time to discuss it, let us know and we can arrange a meeting any time next week14:22
*** skramaja has quit IRC14:32
*** agopi|brb has quit IRC14:33
*** ccamacho1 has joined #oooq14:35
*** ccamacho has quit IRC14:35
*** pliu_ has quit IRC14:43
*** zoli|afk is now known as zoli|wfh14:45
*** ccamacho1 has quit IRC14:50
myoung|ruckweshay, kopecmartin, arxcruz|off - chandankumar is on PTO, and not sure about arxcruz|off.  do you want to have tempest scrum (in 7 min) as scheduled?  I'm a little concerned that we have more than double the number of in progress cards for the number of humans working in sprint :)14:53
kopecmartinmyoung|ruck, today is public holiday in germany, so arxcruz|off will not attend too14:55
kopecmartinmyoung|ruck, if you want, we can have a quick chat .. half of our group will not attend, so it will be really quick14:56
myoung|ruckkopecmartin, weshay, as you wish.  cya in 414:56
sshnaidm|roverweshay, your patch also fails on overcloud deploy  http://logs.openstack.org/80/567580/1/check/tripleo-ci-centos-7-containers-multinode/025774f/job-output.txt.gz#_2018-05-10_14_48_09_10841315:00
weshaysshnaidm|rover, shit15:03
sshnaidm|roverweshay, and master tripleo-ci-promotion job failed because sync problems in rdo cloud yesterday...15:04
*** saneax|AFK is now known as saneax-_-|AFK15:04
sshnaidm|roverweshay, everything together15:04
*** ykarel is now known as ykarel|away15:05
ykarel|awaysshnaidm|rover, also promoter is not promoting somehow, please check once critical things are finished15:06
sshnaidm|roverykarel|away, not surprised :D15:07
weshaysshnaidm|rover, is this the issue? http://logs.openstack.org/80/567580/1/check/tripleo-ci-centos-7-containers-multinode/025774f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-05-10_14_47_5415:08
*** agopi|brb has joined #oooq15:08
weshay"Error: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20180510-8-py3qcy create failed: Error: unable to get cib",15:09
weshay2018-05-10 14:47:54 |         "Error: /Stage[main]/Pacemaker::Stonith/Pacemaker::Property[Disable STONITH]/Pcmk_property[property--stonith-enabled]/ensure: change from absent to present failed: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20180510-8-py3qcy create failed: Error: unable to get cib",15:09
weshay2018-05-10 14:47:54 |         "cibadmin: Connection to local file '/var/lib/pacemaker/cib/puppet-cib-backup20180510-8-1wk525r' failed: Update does not conform to the configured schema",15:09
weshay2018-05-10 14:47:54 |         "Error: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20180510-8-1yd4x8w create failed: Error: unable to set attribute rabbitmq-role",15:09
weshaywhat is crm_config?15:09
sshnaidm|roverweshay, it's better to discuss on #tripleo15:09
*** florianf has quit IRC15:12
*** ykarel|away has quit IRC15:17
*** amoralej|lunch is now known as amoralej15:18
rlandytrown: which is the best  unittest review to base the tox changes off? https://review.openstack.org/#/c/567521/?15:26
*** kopecmartin has quit IRC15:30
*** jaganathan has quit IRC15:30
weshaypanda, do you have 5 min to chat15:31
pandaweshay: yes15:31
weshayhttps://bluejeans.com/u/whayutin/15:31
*** agopi|brb is now known as agopi15:33
*** ykarel|away has joined #oooq15:37
*** holser__ has quit IRC15:47
*** holser__ has joined #oooq15:47
*** bogdando has quit IRC15:49
trownrlandy: use change-id from https://review.openstack.org/567320 I will move that to be on top of https://review.openstack.org/#/c/567521/15:50
*** jfrancoa has quit IRC15:58
*** jfrancoa has joined #oooq16:00
*** jfrancoa has quit IRC16:06
hubbotFAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch, tripleo-ci-centos-7-scenario003-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master,  (3 more messages)16:07
*** marios has quit IRC16:17
*** panda is now known as panda|bbl16:27
*** trown is now known as trown|lunch16:39
*** dsneddon_ has joined #oooq16:51
*** sshnaidm|rover is now known as sshnaidm|off16:52
*** dsneddon_ has quit IRC16:53
*** dsneddon_ has joined #oooq16:58
*** dsneddon_ has quit IRC16:59
*** dsneddon_ has joined #oooq16:59
*** lucasagomes is now known as lucas-afk17:00
*** gkadam has quit IRC17:00
*** holser__ has quit IRC17:04
*** jtomasek has quit IRC17:10
*** udesale_ has quit IRC17:12
*** panda|bbl is now known as panda17:25
*** jaganathan has joined #oooq17:31
*** trown|lunch is now known as trown17:37
*** zoli|wfh is now known as zoli|gone17:42
*** zoli|gone is now known as zoli17:43
*** dsneddon has quit IRC17:52
trownrlandy: ok fixed my patch up to put things in the new filesystem quiquell made, and rebased your patch on top ... looking at your patch now17:53
rlandytrown: thanks - my patch a very basic start17:54
weshayoh man.. we're corporate now17:54
rlandywill refine it after your comments17:54
weshayredhat is blocking sites now while on the vpn17:54
rlandyweshay: ?17:54
*** ykarel|away has quit IRC17:54
rlandyoh17:54
weshayin this case.. coinbase17:54
weshayhttp://10.5.30.79/17:55
trownweshay: lol18:00
weshayya18:01
trownthat is quite odd really18:01
trowni somehow doubt that is even intentional18:01
trowninternal network sure... vpn though?18:02
trownconfirmed though18:02
trownI only keep my dev machine on the vpn and not my laptop18:03
hubbotFAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch, tripleo-ci-centos-7-scenario003-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode, gate- (3 more messages)18:07
*** tesseract-RH has joined #oooq18:08
*** tesseract has quit IRC18:09
*** tesseract-RH has quit IRC18:11
*** tesseract has joined #oooq18:11
*** tbarron has quit IRC18:17
*** tbarron has joined #oooq18:18
*** bandini has quit IRC18:20
rlandytrown: should pytest run all tests in the scripts/emit_releases_file/ dir?18:21
rlandycan change the tox command to do that18:21
trownrlandy: ya I have that comment in draft... trying to get that test harness to run locally and hitting issues installing deps18:21
*** bandini has joined #oooq18:22
rlandytrown: updating the review for that18:22
trownrlandy: while you are there I think you want to put the deps in test-requirements rather than in the tox.ini18:23
rlandyI thought about that18:23
rlandywill fix18:23
*** amoralej is now known as amoralej|lunch18:26
*** amoralej|lunch is now known as amoralej|off18:26
trownrlandy: ya the pyflakes example is bad there... but we can change that too (in another patch) if we want to run pyflakes18:27
trownit does not currently pass18:27
rlandyI see that18:27
rlandyreading your comments to update18:27
weshaymyoung|ruck, mr. ruck.. I need two lp's promotion blockers18:30
weshaymyoung|ruck, http://logs.openstack.org/80/567580/1/check/tripleo-ci-centos-7-containers-multinode/025774f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-05-10_14_47_5418:30
weshaymyoung|ruck, and another bug describing the need for https://review.rdoproject.org/r/#/c/13724/1/ci-scripts/tripleo-upstream/build-containers-images.sh18:31
myoung|ruckweshay: ack, i've been salad'd and good to go18:33
rlandytrown: I ma just trying pyflakes out of the default list for now18:33
rlandynot working anyways18:33
trownrlandy: sure18:35
trownflake8 is also being mean and refusing to install in my tox venv...18:35
myoung|ruckweshay: so for the first one we want an additional promotion-blocker bug apart from https://bugs.launchpad.net/tripleo/+bug/1770355 ?18:37
openstackLaunchpad bug 1770355 in tripleo "Containers in CI updates all packages which takes time and leads to timeouts" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)18:37
weshaymyoung|ruck, diff issues right?18:37
myoung|ruckyes...i guess the one is timeouts the $newBug is about dependency failures.18:38
myoung|ruckparsing amoralej|off comments (https://bugs.launchpad.net/tripleo/+bug/1770355/comments/5)18:39
openstackLaunchpad bug 1770355 in tripleo "Containers in CI updates all packages which takes time and leads to timeouts" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)18:39
myoung|ruckregarding sshnaidm|off patch, I had thought that was a WIP contingincy in the event that we were going to go days prior to centos 7.5 container update from upstream centos.  I'll log a promotion blocker bug in any event...drafting it now18:42
myoung|ruckweshay ^18:42
weshaymyoung|ruck, I'm working from the assumption our current conclusions *may* be correct, but it's possible they  are not18:43
* myoung|ruck nods, given the the world is red that makes sense :(18:44
weshaymyoung|ruck, if our assumptions about the rpm versions being out of sync are wrong18:44
weshayhttp://logs.openstack.org/80/567580/1/check/tripleo-ci-centos-7-containers-multinode/025774f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-05-10_14_47_5418:44
weshayis blocking18:44
weshayand we'll have to find out why18:44
*** sshnaidm|off has quit IRC18:47
*** tesseract has quit IRC18:49
*** tosky has quit IRC19:07
*** tosky has joined #oooq19:11
myoung|ruckweshay: https://bugs.launchpad.net/tripleo/+bug/1770477, working on the other one19:12
openstackLaunchpad bug 1770477 in tripleo "CI jobs failing because base kolla container used by CI are not up to date" [Critical,Triaged]19:12
weshaymyoung|ruck, hrm.. let's try this again19:12
weshayjump on my bluejeans19:13
myoung|ruckweshay: k incoming19:13
weshaymyoung|ruck, http://logs.openstack.org/80/567580/1/check/tripleo-ci-centos-7-containers-multinode/025774f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-05-10_14_47_5419:14
weshay"Error: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20180510-8-py3qcy create failed: Error: unable to get cib",19:15
weshay2018-05-10 14:47:54 |         "Error: /Stage[main]/Pacemaker::Stonith/Pacemaker::Property[Disable STONITH]/Pcmk_property[property--stonith-enabled]/ensure: change from absent to present failed: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20180510-8-py3qcy create failed: Error: unable to get cib",19:15
weshay2018-05-10 14:47:54 |         "cibadmin: Connection to local file '/var/lib/pacemaker/cib/puppet-cib-backup20180510-8-1wk525r' failed: Update does not conform to the configured schema",19:15
weshay2018-05-10 14:47:54 |         "Error: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20180510-8-1yd4x8w create failed: Error: unable to set attribute rabbitmq-role",19:15
weshay2018-05-10 14:47:54 |         "Error: /Stage[main]/Tripleo::Profile::Pacemaker::Rabbitmq_bundle/Pacemaker::Property[rabbitmq-role-centos-7-ovh-bhs1-0003961901]/Pcmk_property[property-centos-7-ovh-bhs1-0003961901-rabbitmq-role]/ensure: change from absent to present failed: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20180510-8-1yd4x8w create failed: Error: unable to set attribute rabbitmq-role",19:15
*** jaganathan has quit IRC19:39
*** agopi has quit IRC19:40
*** sshnaidm|off has joined #oooq19:49
myoung|ruck%gatestatus20:02
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens @ https://review.openstack.org/567224, stable/ocata:  (2 more messages)20:02
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens @ https://review.openstack.org/567224, stable/ocata:  (2 more messages)20:07
*** jaganathan has joined #oooq20:37
*** agopi has joined #oooq20:39
*** agopi has quit IRC20:47
*** atoth has quit IRC20:49
*** trown is now known as trown|outtypewww20:58
rlandyweshay: we got unittests ... http://logs.openstack.org/49/567649/10/check/openstack-tox-functional/91d035c/job-output.txt.gz21:00
rlandynow to limit when they kick21:01
*** Goneri has quit IRC21:01
weshayah nice21:04
weshayemit release21:04
weshayhttp://logs.openstack.org/49/567649/10/check/openstack-tox-functional/91d035c/job-output.txt.gz#_2018-05-10_20_56_23_67076821:04
weshaynice https://review.openstack.org/#/c/567649/10/tox.ini21:06
weshayok.. that looks good to me!21:06
weshayrlandy, do you have access to the promotion server?21:28
rlandyI'll check21:29
rlandyI didn't last time21:29
rlandyweshay: no - can't get further than jumpserver21:31
*** atoth has joined #oooq21:42
weshayrlandy, can you join my channel in blue21:47
weshaysshnaidm|off, you there?21:50
weshaypanda, you there?21:50
weshayneed access to the promoter server21:50
rlandyweshay: joining22:00
sshnaidm|offweshay, you should have access22:04
weshaysshnaidm|off, join my blue please22:04
weshayreally need someone w/ access22:04
hubbotFAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, gate-tripleo-ci- (2 more messages)22:07
weshayrlandy, https://review.rdoproject.org/r/1373022:09
sshnaidm|offweshay, r u there?22:30
weshayhey22:30
weshaysshnaidm|off, sorry..22:30
weshayI should not be bothering you22:30
sshnaidm|offweshay, np, but you should have access to it too, your keys are there22:31
weshaysshnaidm|off, meh.. what I was going to attempt was a bit of a hack22:31
weshaybut I'll bother panda tomorrow22:31
sshnaidm|offok22:31
weshaysshnaidm|off, have a good weekend22:33
*** rasca has quit IRC22:43
*** rasca has joined #oooq22:44
rlandydidn't kick?22:48
rlandybrb22:48
*** atoth_ has joined #oooq22:49
*** atoth has quit IRC22:50
*** bandini has quit IRC22:54
*** bandini has joined #oooq22:57
*** jaganathan has quit IRC23:04
*** rlandy has quit IRC23:45

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!