Monday, 2015-12-07

« Sunday, 2015-12-06 Index Tuesday, 2015-12-08 »
*** chlong has quit IRC00:13
*** chlong has joined #openstack-sahara00:26
*** chlong has quit IRC01:01
*** chlong has joined #openstack-sahara02:36
*** links has joined #openstack-sahara02:45
*** Poornima has joined #openstack-sahara03:27
*** jinxing has joined #openstack-sahara03:58
*** jinxing has quit IRC04:10
openstackgerritlu huichun proposed openstack/sahara: Replacing all hard coded cluster status using cluster_utils  https://review.openstack.org/25168004:20
openstackgerritlu huichun proposed openstack/sahara: Add log when directly return from cancel_job in job_manager If directly return from cancel_job in job_manager, we should log why sahara directly return other than keep running this method.  https://review.openstack.org/25400804:48
*** chlong has quit IRC05:05
*** jinxing has joined #openstack-sahara05:14
*** chlong has joined #openstack-sahara05:22
*** openstackgerrit_ has joined #openstack-sahara06:52
*** nkrinner has joined #openstack-sahara07:13
*** chlong has quit IRC07:29
*** shakamunyi has quit IRC08:14
*** sgotliv_ has quit IRC08:37
*** witlessb has joined #openstack-sahara08:51
*** pino|work_ is now known as pino|work09:00
openstackgerritEvgeny Sikachev proposed openstack/sahara: [TEST COMMIT] CDH HA  https://review.openstack.org/25408309:02
*** esikachev has joined #openstack-sahara09:02
*** datainadequate has joined #openstack-sahara09:18
openstackgerritEvgeny Sikachev proposed openstack/sahara: [TEST COMMIT] CDH HA  https://review.openstack.org/25408309:24
openstackgerritEvgeny Sikachev proposed openstack/sahara: [TEST COMMIT] CDH HA  https://review.openstack.org/25408309:32
*** AndreyPavlov has joined #openstack-sahara09:33
*** sgotliv_ has joined #openstack-sahara09:54
*** _degorenko|afk is now known as degorenko09:58
*** vgridnev has joined #openstack-sahara10:05
*** witlessb has quit IRC10:21
*** witlessb has joined #openstack-sahara10:21
*** openstackgerrit_ has quit IRC10:23
openstackgerritEvgeny Sikachev proposed openstack/sahara: [TEST COMMIT] CDH HA  https://review.openstack.org/25408310:26
*** tellesnobrega_af is now known as tellesnobrega10:43
openstackgerritVitaly Gridnev proposed openstack/sahara: Trust usage improvements in sahara  https://review.openstack.org/25181310:46
openstackgerritVitaly Gridnev proposed openstack/sahara: Add ability to get auth token from auth plugin  https://review.openstack.org/25183510:46
openstackgerritVitaly Gridnev proposed openstack/sahara: rewrite heat client calls  https://review.openstack.org/25148810:46
*** tosky has joined #openstack-sahara10:49
*** esikachev has quit IRC10:57
*** esikachev has joined #openstack-sahara11:09
openstackgerritVitaly Gridnev proposed openstack/sahara: rewrite heat client calls  https://review.openstack.org/25148811:15
openstackgerritAndrey Pavlov proposed openstack/python-saharaclient: Fixing cluster scaling via CLI  https://review.openstack.org/25413611:27
*** Poornima has quit IRC11:34
openstackgerritVitaly Gridnev proposed openstack/sahara: Enable passwordless ssh beetween vanilla nodes  https://review.openstack.org/25083011:43
openstackgerritVitaly Gridnev proposed openstack/sahara: Enable passwordless ssh beetween vanilla nodes  https://review.openstack.org/25083011:45
openstackgerritEvgeny Sikachev proposed openstack/sahara: [TEST COMMIT] CDH HA  https://review.openstack.org/25408311:46
*** _mattf is now known as mattf11:46
*** noqa_v_q1ovnie is now known as noqa_v_qoovnie11:48
*** Poornima has joined #openstack-sahara11:52
*** Poornima has quit IRC12:13
*** raildo-afk is now known as raildo12:14
*** links has quit IRC12:15
openstackgerritEvgeny Sikachev proposed openstack/sahara: [TEST COMMIT] CDH HA   https://review.openstack.org/25408312:20
*** tellesnobrega is now known as tellesnobrega_af12:24
*** mattf is now known as _mattf12:25
*** tellesnobrega_af is now known as tellesnobrega12:27
*** chlong has joined #openstack-sahara12:30
*** esikachev has quit IRC12:36
*** esikachev has joined #openstack-sahara12:39
*** esikachev has quit IRC12:52
*** akuznetsov has joined #openstack-sahara13:00
*** akuznetsov has quit IRC13:05
*** akuznetsov has joined #openstack-sahara13:17
*** AndreyPavlov has quit IRC13:21
*** datainadequate has quit IRC13:22
*** datainadequate has joined #openstack-sahara13:38
*** _mattf is now known as mattf13:40
*** datainadequate has quit IRC13:41
*** Akanksha08 has joined #openstack-sahara13:46
openstackgerritTimur Sufiev proposed openstack/sahara-dashboard: Support pluggable nav structure in Horizon integration tests  https://review.openstack.org/25365413:48
openstackgerritTimur Sufiev proposed openstack/sahara-dashboard: Backport integration tests fixes from Horizon repo  https://review.openstack.org/25365313:48
*** datainadequate has joined #openstack-sahara13:50
*** datainadequate has quit IRC13:52
*** AndreyPavlov has joined #openstack-sahara14:03
*** esikachev has joined #openstack-sahara14:03
*** datainadequate has joined #openstack-sahara14:10
*** akuznetsov has quit IRC14:10
*** hogepodge has quit IRC14:17
*** Akanksha08 has quit IRC14:18
*** tmckay has joined #openstack-sahara14:26
vgridnevelmiko, are you around?14:29
elmikovgridnev: yup14:30
vgridnevgreat, could you please take a look on https://review.openstack.org/#/c/251813/ and https://review.openstack.org/#/c/251488/ ?14:31
elmikovgridnev: they're on my list =)14:31
*** Akanksha08 has joined #openstack-sahara14:35
*** egafford has joined #openstack-sahara14:47
*** jinxing has quit IRC14:49
*** jinxing has joined #openstack-sahara15:04
*** hogepodge has joined #openstack-sahara15:14
*** esikachev has quit IRC15:24
*** datainadequate has quit IRC15:27
*** nkrinner has quit IRC15:37
*** vgridnev has quit IRC15:44
*** pino|work has quit IRC15:46
*** datainadequate has joined #openstack-sahara15:51
*** pino|work has joined #openstack-sahara16:16
*** AndreyPavlov has quit IRC16:29
openstackgerritAkanksha proposed openstack/sahara: Added "# nosec" comment to the os.system call  https://review.openstack.org/25427716:29
*** sgotliv_ has quit IRC16:30
openstackgerritlu huichun proposed openstack/sahara: Add log when directly return from cancel_job  https://review.openstack.org/25400816:30
*** vgridnev has joined #openstack-sahara16:36
*** jinxing has quit IRC16:39
*** david-lyle has joined #openstack-sahara16:49
*** links has joined #openstack-sahara16:53
*** links has quit IRC17:14
elmikoAkanksha08: hi17:28
Akanksha08Hello everyone! I am an Outreachy Intern for OpenStack and would be working on Sahara Project in the course of my internship17:28
*** witlessb has quit IRC17:28
Akanksha08Hi elmiko17:28
Akanksha08elmiko would me mentoring me17:28
Akanksha08The project idea is described here - https://wiki.openstack.org/wiki/Internship_ideas17:29
Akanksha08Sahara - Improve anti-affinity behavior for cluster creation17:29
elmikoSergeyLukjanov and i talked about this briefly17:30
elmikobut the idea is that currently we achieve anti-affinity by creating a server group with that behavior set in nova17:31
Akanksha08SergeyLukjanov  is away I think17:31
elmikoprobably17:31
elmikojust pinging his name in case he sees it later17:31
Akanksha08yes and I would like to set up the IRC bouncer17:31
crobertsrhAkanksha08:  Welcome!17:32
elmikocool, maybe it would be best to get some of your infra setup. then we can get deeper into the project details17:32
Akanksha08crobertsrh, Thanks!17:33
Akanksha08elmiko, yes17:33
egaffordcrobertsrh: In https://review.openstack.org/#/c/253203/1/sahara_dashboard/content/data_processing/nodegroup_templates/workflows/create.py: I get that this is UI, so the answer is probably no, but is there anything less obscure to do than the weird mod 3 loop?17:33
elmikoAkanksha08: when you are setup a little more, i can give some links of code to look at. we will need to talk with the team to determine if a spec is needed for this change.17:34
egaffordAgain, answer is probably no; just asking.17:34
crobertsrhegafford:  Perhaps, but I was unable to figure it out.  It looks like the built-in multiwidget stuff isn't quite as awesome as I was hoping.17:34
crobertsrhI felt dirty writing that loop.17:35
egaffordYeah, that's a crazy loop.17:35
egaffordSo it's just a list? What are the filler values?17:35
crobertsrhSo each "row" is essentially one "share info", which has a share name, path, and permissions.17:36
Akanksha08elmiko, yes I will let you know once the setup is done. You can give me the links though17:36
crobertsrhThe filler values are added so that things work correctly if only the nth share (where n > 1st) on a page is enabled.17:37
crobertsrhEssentially going through each share, if we have values for it, load them, otherwise, add "blank" values17:38
egaffordcrobertsrh: Okay, understood; so this sounds like it is a stark limitation of the widget. :/17:38
crobertsrh^^^ is only really important when we are revisiting the form after we have some shares already chosen17:38
egaffordOr at least, WAI and in some contexts desirable, just very dynamic.17:39
elmikoAkanksha08: k, 1sec17:39
crobertsrhYeah.  If we find ourselves wanting to use multiwidget a lot, it might be a "fun" exercise to make something more abstract that would work in a general way.17:40
*** AndreyPavlov has joined #openstack-sahara17:41
elmikoAkanksha08: so, you will want to start looking at how sahara provisions clusters. to start with checkout out the sahara.service.engine package, specifically17:41
elmikoAkanksha08: https://github.com/openstack/sahara/blob/5240195f4be8544ec61f595ba8c235ff4a86201b/sahara/service/engine.py17:41
elmikoAkanksha08: also, look at the heat service files https://github.com/openstack/sahara/tree/cc0e7e9c70a35b3c7faf07cd7d8c422ffdc22c68/sahara/service/heat17:41
elmikojust become familiar with them for now17:42
elmikoAkanksha08: here are some better links17:42
elmikohttps://github.com/openstack/sahara/blob/master/sahara/service/engine.py17:42
elmikohttps://github.com/openstack/sahara/tree/master/sahara/service/heat17:42
Akanksha08elmiko, alright! I will take a look at those17:49
*** sgotliv_ has joined #openstack-sahara18:00
crobertsrhHmm, and somehow we've managed to break sahara-dashboard already :(18:12
elmikodoh!18:13
crobertsrhI'm guessing something horizon itself changed and is hosing us down.....this may be an ongoing battle.18:14
* elmiko hands crobertsrh his broom and whisky glass18:15
* elmiko salutes crobertsrh 18:15
crobertsrhWhat should I do with 2 whiskey glasses?18:15
elmikopour 2 drinks?18:15
crobertsrhWorth a "shot"18:15
elmikoharharhar18:16
david-lylewell that's not good18:16
crobertsrhdavid-lyle:  I'm still peeking.  unit tests started failing.18:21
david-lylelooking too, when was the first failure?18:23
crobertsrhFirst one I noticed was when I went to +1 workflow for https://review.openstack.org/#/c/253154/18:23
crobertsrhI'm guessing it's related to the merge of the Sahara exorcism patch18:24
david-lylecould be18:24
crobertsrhTest data appears to be awol18:24
david-lylehmm18:25
david-lyleI was running the removal and sahara-dashboard patches together18:25
david-lyleok, digging18:25
crobertsrhthanks.  I'm also continuing the dig18:25
*** degorenko is now known as _degorenko|afk18:30
crobertsrhdavid-lyle:  Looks like our panels are still grabbing openstack_dashboard.test.18:31
crobertsrhI'm guessing that might need to change to sahara_dashboard18:31
*** AndreyPavlov has quit IRC18:32
crobertsrhHmm, yep.  Looks like that might be it.18:32
david-lyleyeah18:32
crobertsrhI'll make it so.  Thanks.18:32
david-lylewrong helpers file18:32
david-lyleoops18:33
*** ViswaV has quit IRC18:33
openstackgerritAkanksha proposed openstack/sahara: Added "# nosec" comment to os.system call in NetcatSocket._terminate  https://review.openstack.org/25427718:34
*** Akanksha08 has quit IRC18:38
*** Akanksha08 has joined #openstack-sahara18:40
*** ViswaV has joined #openstack-sahara18:41
*** Akanksha08 has quit IRC18:41
openstackgerritDavid Lyle proposed openstack/sahara-dashboard: Adding integration test support  https://review.openstack.org/25361418:41
openstackgerritChad Roberts proposed openstack/sahara-dashboard: Fixing unit tests after removal from Horizon  https://review.openstack.org/25434918:43
crobertsrhegafford, vgridnev, elmiko:  Ideally, a couple of you can get +2's on https://review.openstack.org/254349  We will be blocked until it merges.18:44
openstackgerritTimur Sufiev proposed openstack/sahara-dashboard: Adding integration test support  https://review.openstack.org/25361418:45
openstackgerritTimur Sufiev proposed openstack/sahara-dashboard: Backport integration tests fixes from Horizon repo  https://review.openstack.org/25365318:45
*** tosky has quit IRC18:52
*** itisha has joined #openstack-sahara19:05
*** agireud has joined #openstack-sahara19:14
elmikocrobertsrh: ack, will take a look19:17
crobertsrhthanks:  still verifying, but should be lovely when it does19:17
vgridnevcrobertsrh, approved19:18
crobertsrhvgridnef:  Thanks19:18
elmikook, no need for a look ;)19:19
*** hdd has joined #openstack-sahara19:22
egaffordelmiko: Is this awesome? https://review.openstack.org/#/c/254277/19:29
elmikoegafford: almost there, it just needs an adjustment of the commit message19:30
elmikootherwise, yes, i agree about putting nosec there19:31
egaffordIt looks reasonable, and the bug is well-described. Cool.19:31
elmikoAkanksha is an intern who will be working on sahara for the next outreachy program (running Dec7-March7)19:32
*** witlessb has joined #openstack-sahara19:33
vgridnevcrobertsrh, bumps! It failed https://review.openstack.org/#/c/254349/ ?19:39
crobertsrhYeah...saw that.  Back to being unsure.  Tests passed locally for me.19:39
crobertsrhA different set of errors this time19:39
elmikoholy import errors batman!19:40
crobertsrhHmm, tests succeeded locally...again.19:42
elmikodid you try rebuilding the tox environment?19:44
crobertsrhHeh...yep....fresh env it fails appropriately19:46
elmikonice19:46
crobertsrhMight just be a requirements issue19:46
elmikoyea, looked like it19:46
crobertsrhAll of the bits that horizon used to get us don't seem to be around  ( the exorcism patch merged over the weekend)19:46
*** flwang has joined #openstack-sahara19:49
crobertsrhHmm, adding netifaces seems to make things go19:54
elmiko\o/19:56
openstackgerritChad Roberts proposed openstack/sahara-dashboard: Fixing unit tests after removal from Horizon  https://review.openstack.org/25434920:00
flwangelmiko: ping,   egafford mentioned that you're thinking to use zaqar for log aggregation for heat20:02
flwangelmiko: may i get more details?20:02
flwangelmiko: btw, this is feilong from zaqar team20:02
elmikoflwang: well, i have a dream... ;)20:02
elmikoi wasn't specifically targetting heat, more thinking about using zaqarclient from our cluster nodes to publish their log data20:03
flwangi'm listening for the dream...20:03
elmikothe sahara team has long discussed improving the logging of our processing cluster nodes20:03
flwangelmiko: yep, i think it's a common user case20:03
flwangeven for all openstack components20:03
elmikoi participated in a presentation at the last summit showing how we could consume some service controller log data through zaqar20:04
*** tmckay has quit IRC20:04
flwangelmiko: there was a session about that? i even don't know :(20:04
flwangin tokyo?20:04
elmikothe thought was that we might be able to expand on this by having our cluster nodes publish log data to a queue that could be harvested by an application20:04
elmikoflwang: yea, tokyo20:04
elmiko1sec, grabbing link20:05
flwangunfortunately, zaqar is not involved20:05
flwangelmiko: thanks20:05
elmikoflwang: this was a presentation not a design session20:05
elmikoflwang: https://www.openstack.org/summit/tokyo-2015/videos/presentation/this-is-sparkhara-openstack-log-processing-in-real-time-using-spark-on-sahara20:06
elmikoflwang: anyways, we hadn't really gotten much further than just discussing the possibility of using zaqarclient from our cluster nodes. did you have any specific questions?20:07
flwangelmiko: not really, i just want to check how can zaqar team help to make it happen?20:08
elmikoflwang: not sure there is much to do yet, we still need to plan out what we are going to implement.20:08
elmikois zaqar api v2 generally available yet?20:09
flwangelmiko: yes, we do20:09
elmikogreat!20:09
vgridnevcrobertsrh, for which purpose netifaces was added to requirements? Should it be added to both requirements or only for test-requirements?20:09
flwangthe api was released in Liberty, and we almost completed the client work in M-120:09
flwangelmiko: now we can support notification and websocket20:10
crobertsrhvgridnev:  Tests were failing on importing netifaces.  I will double check to see if it's actually needed at runtime as well.20:10
elmikoflwang: ah ok, it was just the client i was missing out on then. i read up on v2 but only tested out the subscription methods, i needed the client too.20:10
flwangelmiko: so if there is further plan, pls involve me20:10
elmikoflwang: will do!20:10
flwangelmiko: cool, actually, i'm the original author of the subscriptions, and i'm happy to give a hand if there is any question20:11
elmikocrobertsrh: i guess maybe it's only needed for the test-reqs. since the dashboard will be installed alongside horizon?20:11
flwangelmiko: just jump in #openstack-zaqar, and ask :)20:12
crobertsrhWell, even for the tests, horizon gets installed as well.20:12
elmikoflwang: awesome, i like the way subscriptions were working but i needed to get client access.20:12
elmikocrobertsrh: weird... and it didn't pull in that package wtf.20:12
flwangelmiko: yes, i'm working on the client part, https://review.openstack.org/249395 it should be merged in this week or next week20:12
elmikoflwang: and yea, if we get to a spec or blueprint i will ping you20:13
elmikoflwang: great to hear =)20:13
flwangelmiko: awesome20:13
flwangkeep in touch, man20:13
elmikowill do20:13
crobertsrhIt does look like I should be able to just include netifaces in test-requirements20:14
elmikocool20:14
openstackgerritChad Roberts proposed openstack/sahara-dashboard: Fixing unit tests after removal from Horizon  https://review.openstack.org/25434920:14
*** datainadequate has quit IRC20:36
*** stanchan has joined #openstack-sahara21:08
openstackgerritMerged openstack/sahara-dashboard: Fixing unit tests after removal from Horizon  https://review.openstack.org/25434921:12
vgridnevhm, we have same issue with netifaces in sahara gate too21:18
vgridnevhttps://review.openstack.org/#/c/250699/21:19
elmikoweird21:19
vgridnevuh, new oslo.utils was released two hours ago21:21
elmikointeresting, did they add something?21:22
vgridnevyep21:22
vgridnevhttps://github.com/openstack/oslo.utils/commit/2abbe1c3b19490f570c29502cd56ec92daf4ca4521:22
elmikoah, good find21:22
*** tmckay has joined #openstack-sahara21:26
crobertsrhInteresting21:28
crobertsrhSo they likely broke a lot of people :)21:28
elmikoi would imagine21:28
elmikothe real question is should have put netifaces into the test-requirements?21:28
elmiko*should we*21:29
crobertsrhIt did manage to unblock us, at least in the short term, until the "right" fix is found.21:29
elmikotrue21:29
vgridnevI think that we should ask for the correct solution in the openstack-dev21:31
elmiko+121:31
crobertsrh+121:31
vgridnevwho will prepare an email?21:34
elmikovgridnev: i vote you or crobertsrh =)21:36
openstackgerritMerged openstack/puppet-sahara: Remove deprecated parameters since Liberty release  https://review.openstack.org/25309921:39
crobertsrhI can.  I want to poke around a bit first to be sure I'm not asking a redundant question.21:47
*** vgridnev has quit IRC21:49
openstackgerritMerged openstack/sahara-dashboard: Adding option for name and uuid substitution  https://review.openstack.org/25315422:00
*** crobertsrh is now known as _crobertsrh22:04
*** mattf is now known as _mattf22:21
*** tmckay has quit IRC22:39
*** jamielennox is now known as jamielennox|away23:18
« Sunday, 2015-12-06 Index Tuesday, 2015-12-08 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!