| *** egafford has quit IRC | 00:01 | |
| *** stanchan has quit IRC | 00:01 | |
| *** openstackgerrit has quit IRC | 00:46 | |
| *** openstackgerrit has joined #openstack-sahara | 00:47 | |
| *** Poornima has joined #openstack-sahara | 00:48 | |
| *** saneax has quit IRC | 00:54 | |
| *** coolsvap|away is now known as coolsvap | 03:32 | |
| *** htruta_ has quit IRC | 03:50 | |
| *** saneax has joined #openstack-sahara | 04:06 | |
| *** saneax has quit IRC | 04:11 | |
| *** saneax has joined #openstack-sahara | 04:14 | |
| *** saneax has quit IRC | 04:23 | |
| *** saneax has joined #openstack-sahara | 04:25 | |
| *** saneax has quit IRC | 04:37 | |
| *** sgotliv has joined #openstack-sahara | 04:38 | |
| *** saneax has joined #openstack-sahara | 04:41 | |
| *** saneax has quit IRC | 04:43 | |
| *** saneax has joined #openstack-sahara | 04:47 | |
| *** sgotliv has quit IRC | 04:50 | |
| *** Nikolay_St has joined #openstack-sahara | 05:03 | |
| *** saneax has quit IRC | 05:21 | |
| *** saneax has joined #openstack-sahara | 05:23 | |
| *** jamielennox is now known as jamielennox|away | 05:52 | |
| *** saneax has quit IRC | 05:54 | |
| *** jamielennox|away is now known as jamielennox | 05:56 | |
| *** saneax has joined #openstack-sahara | 05:58 | |
| *** vgridnev has joined #openstack-sahara | 06:04 | |
| *** chlong has quit IRC | 06:17 | |
| *** Nikolay_St has quit IRC | 06:25 | |
| *** nkrinner has joined #openstack-sahara | 06:42 | |
| -openstackstatus- NOTICE: zuul is stuck and about to undergo an emergency restart, please be patient as job results may take a long time | 06:47 | |
| *** ChanServ changes topic to "zuul is stuck and about to undergo an emergency restart, please be patient as job results may take a long time" | 06:47 | |
| *** esikachev has joined #openstack-sahara | 07:05 | |
| *** Nikolay_St has joined #openstack-sahara | 07:14 | |
| *** sgotliv has joined #openstack-sahara | 07:23 | |
| *** pino|work has joined #openstack-sahara | 07:32 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-image-elements: Fix version of Centos in Mapr plugin https://review.openstack.org/206344 | 07:55 |
|---|---|---|
| *** Poornima_K has joined #openstack-sahara | 07:55 | |
| *** coolsvap is now known as coolsvap|away | 07:57 | |
| *** sgotliv has quit IRC | 07:58 | |
| *** Poornima_K has quit IRC | 08:01 | |
| *** ChanServ changes topic to "OpenStack Sahara // IRC Meetings - http://eavesdrop.openstack.org/#OpenStack_Data_Processing_(Sahara)_Team_Meeting" | 08:03 | |
| -openstackstatus- NOTICE: zuul has been restarted and queues restored. It may take some time to work through the backlog. | 08:03 | |
| *** esikachev has quit IRC | 08:14 | |
| *** esikachev has joined #openstack-sahara | 08:16 | |
| *** sgotliv has joined #openstack-sahara | 08:20 | |
| *** vgridnev has quit IRC | 08:20 | |
| *** coolsvap|away is now known as coolsvap | 08:56 | |
| *** sgotliv has quit IRC | 08:59 | |
| openstackgerrit | Merged openstack/sahara-dashboard: Updated from global requirements https://review.openstack.org/200914 | 09:01 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Add cluster verification https://review.openstack.org/196713 | 09:18 |
| openstackgerrit | Merged openstack/sahara-specs: Add new HDP plugin to Sahara https://review.openstack.org/204569 | 09:33 |
| openstackgerrit | Merged openstack/sahara-image-elements: Disable firewall on rhel-based distros only https://review.openstack.org/198652 | 09:37 |
| *** vgridnev has joined #openstack-sahara | 09:37 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Add API methods for call verifications, DB table https://review.openstack.org/196713 | 09:39 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Add API methods for call verifications, DB table https://review.openstack.org/196713 | 09:40 |
| openstackgerrit | Merged openstack/sahara-specs: Run Spark jobs on vanilla Hadoop 2.x https://review.openstack.org/201411 | 09:48 |
| openstackgerrit | Merged openstack/sahara-specs: [EDP]upgrade oozie web service api version in sahara oozie engine https://review.openstack.org/200993 | 09:48 |
| openstackgerrit | Merged openstack/python-saharaclient: Updated from global requirements https://review.openstack.org/204424 | 09:52 |
| openstackgerrit | Merged openstack/python-saharaclient: Updated from global requirements https://review.openstack.org/201208 | 09:52 |
| openstackgerrit | Merged openstack/sahara-specs: Add HDFS HA support in Cloudera plugin https://review.openstack.org/196929 | 09:52 |
| openstackgerrit | Merged openstack/sahara-specs: [EDP] Add suspend and resume abilities for edp jobs https://review.openstack.org/198264 | 09:52 |
| *** Poornima has quit IRC | 09:56 | |
| *** vgridnev has quit IRC | 10:11 | |
| *** vgridnev has joined #openstack-sahara | 10:14 | |
| openstackgerrit | Merged openstack/sahara: Updated from global requirements https://review.openstack.org/205663 | 10:27 |
| openstackgerrit | Merged openstack/sahara-image-elements: Deprecate Spark 0.x and 1.0.x images https://review.openstack.org/202924 | 10:28 |
| *** saneax has quit IRC | 10:45 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-specs: Add ability create flavor from yaml-file https://review.openstack.org/206482 | 11:06 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Implement ability of creating flavor for scenario tests https://review.openstack.org/203567 | 11:09 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Implement ability of creating flavor for scenario tests https://review.openstack.org/203567 | 11:09 |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Formatting and mounting methods changed for ironic https://review.openstack.org/200483 | 11:12 |
| openstackgerrit | Merged openstack/python-saharaclient: Sorting 'job-list' output by start_time https://review.openstack.org/197606 | 11:21 |
| *** sgotliv has joined #openstack-sahara | 11:22 | |
| openstackgerrit | Oleg Borisenko proposed openstack/sahara: EDP Spark jobs work with Swift https://review.openstack.org/206498 | 11:30 |
| *** coolsvap is now known as coolsvap|away | 11:37 | |
| *** saneax has joined #openstack-sahara | 11:44 | |
| openstackgerrit | Merged openstack/sahara: Ignore .eggs directory in git https://review.openstack.org/204095 | 11:48 |
| openstackgerrit | Merged openstack/sahara: Cleanup .gitignore https://review.openstack.org/204101 | 11:48 |
| openstackgerrit | Merged openstack/sahara: Add configs unit test case https://review.openstack.org/204887 | 11:48 |
| openstackgerrit | Andrey Pavlov proposed openstack/python-saharaclient: Add initial commit for integration with Openstackclient https://review.openstack.org/204540 | 11:56 |
| openstackgerrit | Merged openstack/sahara: Changing log level inside execute_with_retries method https://review.openstack.org/187978 | 12:06 |
| openstackgerrit | Merged openstack/sahara: Changed all stacks retrieval with filtered search https://review.openstack.org/203267 | 12:06 |
| openstackgerrit | Merged openstack/sahara: Storm job type not found https://review.openstack.org/204071 | 12:06 |
| openstackgerrit | Merged openstack/sahara: updating documentation on devstack usage https://review.openstack.org/203738 | 12:06 |
| *** raildo has joined #openstack-sahara | 12:13 | |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara: Increase internal_ip and management_ip column size https://review.openstack.org/203067 | 12:24 |
| openstackgerrit | Atsushi SAKAI proposed openstack/sahara: Fix six typos on sahara documentation https://review.openstack.org/206518 | 12:25 |
| *** egafford has joined #openstack-sahara | 12:34 | |
| *** esikachev has quit IRC | 12:39 | |
| *** coolsvap|away is now known as coolsvap | 12:45 | |
| *** egafford has quit IRC | 12:57 | |
| *** egafford has joined #openstack-sahara | 13:04 | |
| openstackgerrit | Chad Roberts proposed openstack/sahara: Support manila shares as binary store https://review.openstack.org/204690 | 13:08 |
| openstackgerrit | Chad Roberts proposed openstack/sahara: Support manila shares as binary store https://review.openstack.org/204690 | 13:17 |
| *** tmckay has joined #openstack-sahara | 13:21 | |
| *** tosky has joined #openstack-sahara | 13:27 | |
| openstackgerrit | Denis Egorenko proposed openstack/puppet-sahara: Add distribute mode for Sahara https://review.openstack.org/192721 | 13:30 |
| openstackgerrit | Denis Egorenko proposed openstack/puppet-sahara: Update parameters for Sahara https://review.openstack.org/205987 | 13:30 |
| openstackgerrit | Denis Egorenko proposed openstack/puppet-sahara: Configure rpc options separately from ceilometer notifications https://review.openstack.org/198744 | 13:30 |
| *** sgotliv_ has joined #openstack-sahara | 13:40 | |
| *** sgotliv has quit IRC | 13:41 | |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara-specs: Adding spec for integration of Sahara CLI with OpenstackClient https://review.openstack.org/206096 | 13:56 |
| egafford | tmckay: I'm given to leave the Debian command as default in the shares patch; I think that as the Red Hat distros are well covered in the dict, Debian makes sense as default, and if that command works, we should let it. I want to clear this before pushing a correction patch for your comments, though. Thoughts? | 14:50 |
| tmckay | egafford, I don't feel strongly about it. I suppose since DIB supports a specific set of OSs it's unlikely to be something else, and the exception should be clear | 14:55 |
| egafford | Yeah, I can see that argument. | 14:55 |
| *** Nikolay_St has quit IRC | 14:55 | |
| tmckay | my reaction is based on a mild dislike for "I don't know what this is, let's guess!" :) | 14:56 |
| tmckay | but the set should be bounded, so, okay | 14:56 |
| openstackgerrit | Oleg Borisenko proposed openstack/sahara: EDP Spark jobs work with Swift https://review.openstack.org/206498 | 14:57 |
| egafford | tmckay: Sure; I can see that completely. My reaction is based on "if we can guess, and it can't hurt, might as well try?" I can wrap the call in a try and raise a sensible exception in the failure case. | 14:57 |
| openstackgerrit | Oleg Borisenko proposed openstack/sahara: EDP Spark jobs work with Swift https://review.openstack.org/206498 | 14:57 |
| egafford | tmckay: Then we both kind of get what we're after. | 14:58 |
| tmckay | egafford, yeah, it might be better to have a more tailored exception to help the user in the odd chance that the command fails | 14:59 |
| * tosky votes for clear exceptions | 15:02 | |
| tosky | I was burned a bit too much by too generic errors in various openstack components | 15:03 |
| elmiko | "error: please try again later" ? | 15:05 |
| *** nkrinner has quit IRC | 15:10 | |
| *** vgridnev has quit IRC | 15:12 | |
| egafford | tmckay: The other, maybe better, approach to this is simply to take no action if the distro isn't found. "Hey, you want to mount a share on a distro and image that we don't support? Cool! We assume that you've installed nfs mounting utilities already." I can log a warning instead of an exception, in that case. | 15:31 |
| egafford | tmckay: Thoughts? | 15:31 |
| egafford | tmckay: I just don't want to needlessly hose anyone who ought to be functional. | 15:32 |
| tmckay | egafford, would the mount still happen in that case? | 15:33 |
| egafford | Yes, the mount would happen; we just wouldn't try to ensure any (distro-specific) mounting packages. | 15:33 |
| tmckay | ooo, nice | 15:33 |
| tmckay | yes, I love that. Warning and carry on. If it fails, it will fail at the mount command | 15:34 |
| tmckay | I think that's perfect | 15:34 |
| egafford | tmckay: I agree! | 15:34 |
| aignatov | @egafford Hi, I have question for some lines in https://review.openstack.org/#/c/204244/13/sahara/service/shares.py | 15:46 |
| aignatov | lines 169,170 | 15:46 |
| aignatov | this change does install distro dependent libraries | 15:47 |
| aignatov | may be it would be better to move to sahara images? | 15:47 |
| elmiko | we need to get those in image-elements at some point | 15:49 |
| aignatov | ok, reading your conversation regarding this with tmckay above :) | 15:49 |
| aignatov | basically I agree with current change | 15:50 |
| aignatov | may be some TODO and bug filed would be good :) | 15:50 |
| egafford | aignatov: I think that it does make sense to put them in SIE as well; totally agreed. That's why I wrote them the way I did (check or install.) | 15:54 |
| *** logan2 has quit IRC | 15:55 | |
| egafford | aignatov: That way when we do put them in SIE it'll be a no-op, and will work even if nodes are not internet-enabled. | 15:55 |
| aignatov | what is SIE? :) | 15:56 |
| aignatov | ah, I see | 15:56 |
| egafford | aignatov: Right. :) | 15:56 |
| pino|work | sahara-image-elements | 15:56 |
| aignatov | Sahara Image Elements | 15:56 |
| pino|work | but if you install things directly when creating the image, why even try to install things later? | 15:57 |
| *** Nikolay_St has joined #openstack-sahara | 15:57 | |
| egafford | pino|work: a) This is an optional feature. b) There are many flows in which we assess install state and install if needed (like all clean image flows.) | 15:57 |
| egafford | pino|work: This is like a clean image flow for a single, optional feautre. | 15:58 |
| egafford | I don't want to force people to build a new, special image just to mount an NFS share. | 15:58 |
| pino|work | the runtime weight for nfs stuff is not that much though, isn't it? | 15:58 |
| egafford | No, it's not, but this makes it work regardless of previous image state. | 15:59 |
| egafford | (Honestly, I kind of think we should move more this way in general: assess what's on the image, get it up to speed in an idempotent manner, regardless of previous state.) | 16:00 |
| elmiko | not to mention we have precedence for installing things during configuration in other plugins | 16:00 |
| egafford | pino|work: (So while I see your argument that we don't do this all the time, I actually think we should do it more.) elmiko: Yup, absolutely. | 16:00 |
| pino|work | still feels like "eeek" to me though | 16:01 |
| elmiko | i dunno, i can definitely see a future case using containers that might install things during configuration from a local registry or something | 16:02 |
| * pino|work hears "containers" and gets another "eeek" moment | 16:02 | |
| elmiko | haha | 16:02 |
| elmiko | pino|work: why though? | 16:03 |
| pino|work | dunno, i've been generally hype-repulsive | 16:03 |
| elmiko | fair | 16:03 |
| egafford | pino|work: This is how most modern devops toolchains work (heavy emphasis on idempotence.) The whole run-once special snowflakeness of DIB is actually kind of a huge weakness. | 16:03 |
| pino|work | egafford: the second part i can agree | 16:04 |
| pino|work | <adv>that's also why tosky and me are proposing a talk related to that: https://www.openstack.org/summit/tokyo-2015/vote-for-speakers/presentation/5066 -- some votes please? ;) </adv> | 16:04 |
| *** coolsvap is now known as coolsvap|dinner | 16:06 | |
| tosky | yes, we will many interesting things about image generation and how to make life easier in that regard | 16:06 |
| openstackgerrit | Ethan Gafford proposed openstack/sahara: Mount share API https://review.openstack.org/204244 | 16:07 |
| openstackgerrit | Chad Roberts proposed openstack/sahara: Support manila shares as binary store https://review.openstack.org/204690 | 16:11 |
| *** logan2 has joined #openstack-sahara | 16:24 | |
| *** vgridnev has joined #openstack-sahara | 16:29 | |
| openstackgerrit | Ethan Gafford proposed openstack/sahara-image-elements: NFS share utility installation https://review.openstack.org/206619 | 16:44 |
| *** tosky has quit IRC | 16:47 | |
| *** tosky has joined #openstack-sahara | 16:47 | |
| pino|work | egafford: you can just use package-installs btw | 16:47 |
| _crobertsrh | Anyone looking into the gate-sahara-nova-heat-hdp_2.0.6-c6.6 job? It seems to bomb-out fairly consistently lately. | 16:51 |
| *** tosky has quit IRC | 16:55 | |
| *** coolsvap|dinner is now known as coolsvap|mt | 17:01 | |
| *** coolsvap|mt is now known as coolsvap|mtg | 17:01 | |
| egafford | pino|work: Even with the remap? | 17:04 |
| pino|work | egafford: yes, package-installs uses pkg-map | 17:04 |
| egafford | Ah, okay. | 17:04 |
| pino|work | see the mysql element for example | 17:04 |
| pino|work | the only script there just creates a directory, otherwise there would be none | 17:04 |
| openstackgerrit | Ethan Gafford proposed openstack/sahara-image-elements: NFS share utility installation https://review.openstack.org/206619 | 17:07 |
| egafford | pino|work: Done; thanks. | 17:13 |
| pino|work | egafford: thank you! (see how's more elegant | 17:13 |
| pino|work | ? not even a bash script to maintain) | 17:14 |
| egafford | pino|work: Yup; it is indeed better. | 17:16 |
| *** pino|work has quit IRC | 17:42 | |
| *** stanchan has joined #openstack-sahara | 17:51 | |
| openstackgerrit | Chad Roberts proposed openstack/sahara: Support manila shares as binary store https://review.openstack.org/204690 | 17:56 |
| *** tmckay1 has joined #openstack-sahara | 17:59 | |
| *** tmckay has quit IRC | 17:59 | |
| *** tosky has joined #openstack-sahara | 18:00 | |
| *** chen has joined #openstack-sahara | 18:03 | |
| *** chen is now known as Guest64977 | 18:04 | |
| *** chen12 has quit IRC | 18:04 | |
| *** sgotliv_ has quit IRC | 18:06 | |
| *** tellesnobrega has quit IRC | 18:11 | |
| *** tellesnobrega has joined #openstack-sahara | 18:15 | |
| openstackgerrit | Chad Roberts proposed openstack/sahara: Support manila shares as binary store https://review.openstack.org/204690 | 18:19 |
| *** tmckay1 has quit IRC | 18:54 | |
| *** melaks has joined #openstack-sahara | 19:05 | |
| *** tmckay has joined #openstack-sahara | 19:08 | |
| *** saneax has quit IRC | 19:16 | |
| *** saneax has joined #openstack-sahara | 19:26 | |
| elmiko | was there a preference for using {} over dict() ? | 19:29 |
| openstackgerrit | Alan Pevec proposed openstack/sahara: Bump stable/kilo next version to 2015.1.2 https://review.openstack.org/206677 | 19:42 |
| *** melaks has quit IRC | 20:11 | |
| openstackgerrit | Chad Roberts proposed openstack/sahara: Support manila shares as binary store https://review.openstack.org/204690 | 20:20 |
| *** sgotliv_ has joined #openstack-sahara | 20:25 | |
| egafford | SergeyLukjanov, alazarev: Might I ask for a review on https://review.openstack.org/#/c/200633/? The code change for which this is the spec is near complete, and I had some + votes from you all on the last patch set. Just want to make sure the spec lands in time. Thanks. | 20:31 |
| *** stanchan has quit IRC | 20:32 | |
| *** logan2 has quit IRC | 20:42 | |
| *** logan2 has joined #openstack-sahara | 20:45 | |
| SergeyLukjanov | egafford, hey | 20:57 |
| SergeyLukjanov | egafford, I'm ok with this spec, but I think that we should install software using diskimage-builder instead of doing it using Sahara | 20:58 |
| SergeyLukjanov | egafford, we have a lot of issues with then using this features in private DMZ labs w/o internet access | 20:58 |
| SergeyLukjanov | and anyway it'll slow down the deployment speed | 20:59 |
| SergeyLukjanov | egafford, what do you think? | 20:59 |
| *** melaks has joined #openstack-sahara | 20:59 | |
| *** raildo has quit IRC | 21:01 | |
| elmiko | SergeyLukjanov: there is a patch up to add this to sie as well | 21:03 |
| elmiko | SergeyLukjanov: in general though, i agree. private net labs is a real issue. | 21:03 |
| SergeyLukjanov | elmiko, I think we could continue discussing on actual CRs, the spec is ok IMO | 21:05 |
| SergeyLukjanov | elmiko, this part is just a tech q. | 21:05 |
| elmiko | SergeyLukjanov: agreed, the spec is fine | 21:06 |
| SergeyLukjanov | elmiko, I think I'm ready to +A it if continue talking on CRs to probably move from sahara to sie | 21:06 |
| SergeyLukjanov | going to re-read and approve | 21:06 |
| elmiko | SergeyLukjanov: sounds good, also see https://review.openstack.org/#/c/206619/ | 21:06 |
| elmiko | that's the sie patch | 21:07 |
| SergeyLukjanov | elmiko, thx, already +2'd | 21:07 |
| elmiko | hehe, awesome =) | 21:07 |
| *** stanchan has joined #openstack-sahara | 21:07 | |
| SergeyLukjanov | the spec approved as well | 21:10 |
| egafford | Thanks SergeyLukjanov. I agree with you about SIE; I added the patch to add the nfs-{utils,common} package. The code patch queries to see if the package is installed before attempting to install it, so we should be covered in no-internet-access cases. | 21:11 |
| openstackgerrit | Merged openstack/sahara: Bump stable/kilo next version to 2015.1.2 https://review.openstack.org/206677 | 21:15 |
| *** tmckay has quit IRC | 21:23 | |
| *** egafford has quit IRC | 21:28 | |
| openstackgerrit | Merged openstack/sahara-specs: API to mount manila shares to clusters https://review.openstack.org/200633 | 21:31 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/206723 | 21:33 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara-extra: Updated from global requirements https://review.openstack.org/206724 | 21:33 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara-image-elements: Updated from global requirements https://review.openstack.org/206725 | 21:33 |
| *** saneax has quit IRC | 21:44 | |
| *** egafford has joined #openstack-sahara | 21:47 | |
| *** egafford has quit IRC | 21:47 | |
| *** witlessb has quit IRC | 21:52 | |
| *** coolsvap|mtg is now known as coolsvap|away | 22:00 | |
| *** melaks has quit IRC | 22:35 | |
| *** melaks has joined #openstack-sahara | 22:36 | |
| *** vgridnev has quit IRC | 22:42 | |
| *** egafford has joined #openstack-sahara | 22:47 | |
| *** egafford has quit IRC | 22:48 | |
| *** melaks has quit IRC | 22:55 | |
| *** melaks has joined #openstack-sahara | 22:59 | |
| *** melaks has quit IRC | 22:59 | |
| *** stanchan has quit IRC | 23:24 | |
| *** tosky has quit IRC | 23:27 | |
| openstackgerrit | Merged openstack/sahara: Configure NTP service on cluster instances https://review.openstack.org/200136 | 23:39 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!