| *** witlessb has quit IRC | 00:04 | |
| *** agireud has quit IRC | 01:26 | |
| *** jinxing has joined #openstack-sahara | 01:28 | |
| *** agireud has joined #openstack-sahara | 01:30 | |
| *** agireud has quit IRC | 01:39 | |
| *** agireud has joined #openstack-sahara | 01:41 | |
| *** jinxing has quit IRC | 01:44 | |
| *** jinxing has joined #openstack-sahara | 01:45 | |
| *** jinxing has quit IRC | 01:49 | |
| *** jinxing has joined #openstack-sahara | 02:32 | |
| *** houming has joined #openstack-sahara | 02:38 | |
| *** jinxing has quit IRC | 02:44 | |
| *** jinxing has joined #openstack-sahara | 02:47 | |
| *** links has joined #openstack-sahara | 03:51 | |
| *** sgotliv_ has joined #openstack-sahara | 04:05 | |
| *** esikachev has joined #openstack-sahara | 04:27 | |
| *** esikachev has quit IRC | 04:32 | |
| *** dave-mccowan has quit IRC | 04:41 | |
| *** houming has quit IRC | 05:19 | |
| *** jinxing has quit IRC | 05:34 | |
| *** jinxing has joined #openstack-sahara | 05:37 | |
| *** Poornima has joined #openstack-sahara | 05:38 | |
| *** pgadiya has joined #openstack-sahara | 06:08 | |
| *** rcernin has joined #openstack-sahara | 06:15 | |
| *** nkrinner_afk is now known as nkrinner | 06:17 | |
| *** houming has joined #openstack-sahara | 06:32 | |
| *** sverma has joined #openstack-sahara | 06:41 | |
| *** esikachev has joined #openstack-sahara | 06:43 | |
| *** esikachev has quit IRC | 06:47 | |
| *** jamielennox is now known as jamielennox|away | 06:48 | |
| *** tangchen has quit IRC | 06:58 | |
| *** esikachev has joined #openstack-sahara | 06:59 | |
| *** rcernin has quit IRC | 07:02 | |
| *** abalutoiu has quit IRC | 07:09 | |
| *** tesseract- has joined #openstack-sahara | 07:13 | |
| *** esikachev has quit IRC | 07:13 | |
| *** tesseract- has quit IRC | 07:14 | |
| *** tesseract- has joined #openstack-sahara | 07:14 | |
| *** rcernin has joined #openstack-sahara | 07:17 | |
| *** witlessb has joined #openstack-sahara | 07:23 | |
| *** anshul has joined #openstack-sahara | 07:30 | |
| *** anshul is now known as Guest90309 | 07:30 | |
| *** akuznetsov has joined #openstack-sahara | 07:31 | |
| *** akuznetsov has quit IRC | 07:57 | |
| *** jinxing has quit IRC | 08:03 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara-dashboard: Imported Translations from Zanata https://review.openstack.org/333170 | 08:23 |
|---|---|---|
| openstackgerrit | Tang Chen proposed openstack/python-saharaclient: Use osc-lib instead of openstackclient.common https://review.openstack.org/333180 | 08:42 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/333183 | 08:46 |
| *** rcernin has quit IRC | 08:50 | |
| *** rcernin has joined #openstack-sahara | 09:02 | |
| *** tangchen_ has joined #openstack-sahara | 09:08 | |
| *** dmk0202 has joined #openstack-sahara | 09:09 | |
| *** Guest90309 has quit IRC | 09:14 | |
| *** anshul has joined #openstack-sahara | 09:14 | |
| *** anshul is now known as Guest36085 | 09:15 | |
| tangchen_ | vgridnev: Hi Vitaly, I'm new in sahara. I just noticed that saharaclient has no i18n support, and all command help messages are not translated. So, do we need to wrap the help messages and logs with the i18n _(), or you guys just don't want to support it intentionally ? | 09:17 |
| *** jamielennox|away is now known as jamielennox | 09:43 | |
| *** esikachev has joined #openstack-sahara | 09:44 | |
| *** pcaruana has joined #openstack-sahara | 09:51 | |
| *** tosky has joined #openstack-sahara | 09:55 | |
| *** sgotliv__ has joined #openstack-sahara | 09:56 | |
| *** sgotliv_ has quit IRC | 09:57 | |
| *** _degorenko|afk is now known as degorenko | 10:20 | |
| openstackgerrit | Merged openstack/sahara-dashboard: Imported Translations from Zanata https://review.openstack.org/333170 | 10:29 |
| *** dmk0202 has quit IRC | 10:29 | |
| *** houming has quit IRC | 10:31 | |
| openstackgerrit | Michael Ionkin proposed openstack/sahara: novaclient.v2.images to glanceclient migration https://review.openstack.org/322894 | 10:34 |
| *** Poornima has quit IRC | 10:35 | |
| openstackgerrit | Merged openstack/sahara: Updated from global requirements https://review.openstack.org/333183 | 10:44 |
| openstackgerrit | Tang Chen proposed openstack/python-saharaclient: Use osc-lib instead of openstackclient.common https://review.openstack.org/333180 | 10:56 |
| tosky | esikachev: the new job for CLI tests has another issue with the image registration, how was it done before? A pre-hook? | 11:00 |
| vgridnev | tosky, I guess that image registrations for added for future tests, seems like it was wrong because there is no such image available | 11:06 |
| tosky | vgridnev: but then we need also the pre hook which register it, like in the "scenario" configuration | 11:07 |
| vgridnev | probably we will need some kind of pre test hook to put new image into IMAGE_URLS (probably not right name) to be able to upload that to glance by during devstack deployment. OR just upload new image | 11:08 |
| tosky | (see tools/gate/scenario/{pre,post}_test_hook.sh) | 11:08 |
| vgridnev | hm, seems yes | 11:08 |
| vgridnev | tosky, could be please put new change to project config? I hope that infra folks will not kill us :) | 11:09 |
| esikachev | and remove image registration | 11:10 |
| tosky | vgridnev: don't we need a change to sahara-tests first for the hook? | 11:10 |
| tosky | if I remove the image registration from the cli_tests hook, maybe we don't need to change the jobs | 11:11 |
| vgridnev | maybe we can following workflow: "Fix tests by commenting image registration" -> "Adding pre-test-hook" -> "Enable Pre test hook in project-config" | 11:12 |
| esikachev | vgridnev: maybe firstly make a patch in project-config? | 11:14 |
| esikachev | for merging need more time | 11:14 |
| esikachev | and in sahara-tests we can debug jobs with different patches | 11:15 |
| vgridnev | my workflow is minimizing failures rates | 11:15 |
| vgridnev | after commenting image registration tests are supposed to be green always. | 11:17 |
| vgridnev | tosky, what do you think about my workflow? | 11:18 |
| tosky | it minimizes the failure rate; on the other side, that job is non-voting for now, so we could directly add the hook with image registration and change project-config | 11:19 |
| tosky | apart from that, I think it's better to minimize the changes to project-config and your workflow only involves one change there | 11:20 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara-tests: fix test and adding empty pre_test_hook https://review.openstack.org/333266 | 11:24 |
| vgridnev | esikachev, tosky ^^ | 11:25 |
| tosky | ah, right | 11:25 |
| esikachev | good change) | 11:25 |
| vgridnev | are tests are supposed to running if there are only changes in tools? | 11:26 |
| *** ekarlso has quit IRC | 11:26 | |
| vgridnev | no! | 11:26 |
| tosky | vgridnev: I think that sahara_register_flavor could stay, all its parameters (unless I'm missing something) are available | 11:27 |
| vgridnev | job sahara-cli-nv is not scheduled | 11:27 |
| vgridnev | tosky, it can stay, but seems we need some follow-up to verify | 11:30 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara-tests: [testcommit] https://review.openstack.org/333270 | 11:30 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara-tests: [testcommit] https://review.openstack.org/333270 | 11:31 |
| *** dmk0202 has joined #openstack-sahara | 11:33 | |
| openstackgerrit | Mikhail Lelyakin proposed openstack/sahara-dashboard: Resolve bug with long time for loading node group template page In this patch I implement work with ajax for loading node group template and simplify it process. https://review.openstack.org/333273 | 11:33 |
| tosky | the commit message ^^ | 11:35 |
| tosky | :) | 11:35 |
| vgridnev | quite short | 11:38 |
| *** ekarlso has joined #openstack-sahara | 11:51 | |
| *** zioproto has joined #openstack-sahara | 12:06 | |
| zioproto | hello everytone | 12:07 |
| zioproto | everyone :) | 12:07 |
| zioproto | vgridnev: I will be in vacation next week :) If there is any additional work to be done on the swiftfs patch let me know ... or it will be all delay until July :) | 12:08 |
| vgridnev | zioproto, sure | 12:08 |
| zioproto | btw, I am preparing my trip to NYC for the Operatos Mid-Cycle. Is anyone from the sahara project going there ? | 12:08 |
| vgridnev | zioproto, not sure, but I'm not going there | 12:09 |
| vgridnev | tosky, is anyone from redhatters are going to this event? | 12:09 |
| esikachev | vgridnev: tosky i think, we need add trigger for sahara-cli job on this files https://review.openstack.org/#/c/333266/ | 12:11 |
| vgridnev | esikachev, I triggered on in test commit, btw, in next patch we should add that | 12:11 |
| vgridnev | http://logs.openstack.org/70/333270/2/check/gate-sahara-cli-nv/c522086/logs/devstack-gate-post_test_hook.txt.gz | 12:11 |
| vgridnev | so it passed! | 12:12 |
| esikachev | cool | 12:12 |
| zioproto | is sahara packaged only for redhat ? http://docs.openstack.org/developer/sahara/userdoc/installation.guide.html ? Does the project follow the release cycle or has a different versioning scheme ? | 12:14 |
| esikachev | vgridnev: tosky who can prepare patch? if no objections, I can | 12:14 |
| vgridnev | esikachev, sure | 12:16 |
| vgridnev | zioproto, sahara also can be installed via fuel (which is the part of mirantis openstack), which is mostly created by mirantis folks. | 12:17 |
| tosky | (sorry, late lunch break) | 12:18 |
| tosky | vgridnev: I have no idea about the operators mid-cycle | 12:18 |
| tosky | zioproto: I think almost all main OpenStack distributors packaged Sahara | 12:19 |
| tosky | esikachev: if you already started with the patch for project-config, please go ahead; otherwise of course I can help :) | 12:20 |
| openstackgerrit | Tang Chen proposed openstack/python-saharaclient: Use osc-lib instead of openstackclient https://review.openstack.org/333180 | 12:22 |
| esikachev | tosky: ok | 12:22 |
| zioproto | OK I see the packages in Ubuntu, and I see also there exists a puppet-sahara. I am trying to calculate how much effort is not add sahara to our existing Openstack public cloud. I will probably need just a mysql database and pet server to run the sahara-api. Heat is already active in our openstack. | 12:22 |
| vgridnev | DB + messaging | 12:24 |
| zioproto | vgridnev: in sahara.conf in the [swift] section I see only the endpoint_type. The container names are specified at a later time ? | 12:25 |
| zioproto | I have a question about this bug: https://bugs.launchpad.net/sahara/+bug/1593663 I see imporance is marked to 'High'. It means some core dev will pick this up any soon ? I am working with Hadoop and Swiftfs here at SWITCH. I am not sure my Java skills are good enough to propose this patch. Is the multipart handling completely missing or it is just buggy? | 12:28 |
| openstack | Launchpad bug 1593663 in Sahara "[hadoop-swift] Cannot access Swift Static Large Objects" [High,Confirmed] | 12:28 |
| esikachev | tosky: vgridnev https://review.openstack.org/333315 | 12:30 |
| tosky | esikachev: do you need a depends-on on vgridnev's patch? | 12:33 |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Tests for Sahara CLI client. https://review.openstack.org/332122 | 12:34 |
| tangchen_ | <vgridnev>: Hi Vitaly, does saharaclient need i18n support ? It can use osc-lib.i18n | 12:34 |
| vgridnev | zioproto, you will pass url to your datasource later (with credentials) later | 12:38 |
| *** abalutoiu has joined #openstack-sahara | 12:39 | |
| vgridnev | it's High, it means that it should considered with high priority. It doesn't mean that someone will pick up that soon. | 12:40 |
| *** _crobertsrh is now known as crobertsrh | 12:41 | |
| vgridnev | tangchen_, as you wish. btw I'm not sure about translators priorities. So, I guess that we can setup translations, but there is no guarantee that it will be really translated | 12:42 |
| tosky | well, it's up to the translation team, so it's not a cost on our side :) | 12:43 |
| vgridnev | tangchen_, you also make correct setup of sahara's translations jobs | 12:43 |
| vgridnev | I'm not quite sure it works properly | 12:43 |
| vgridnev | tangchen_, so now we have only sahara-dashboard translated | 12:44 |
| vgridnev | tosky, test commit voted with +1 https://review.openstack.org/#/c/333270/ | 12:44 |
| vgridnev | esikachev, | 12:44 |
| vgridnev | I guess that we can push https://review.openstack.org/#/c/333266/ | 12:45 |
| esikachev | ok | 12:45 |
| esikachev | tosky: ^^ | 12:46 |
| tosky | done | 12:46 |
| tosky | :) | 12:46 |
| *** pgadiya has quit IRC | 13:26 | |
| *** catintheroof has joined #openstack-sahara | 13:32 | |
| *** esikachev has quit IRC | 13:34 | |
| openstackgerrit | Merged openstack/sahara-tests: fix test and adding empty pre_test_hook https://review.openstack.org/333266 | 13:43 |
| *** tmckay has joined #openstack-sahara | 13:47 | |
| *** egafford has joined #openstack-sahara | 13:48 | |
| *** Guest36085 has quit IRC | 13:51 | |
| *** sverma has quit IRC | 13:53 | |
| *** dave-mccowan has joined #openstack-sahara | 13:55 | |
| *** itisha has joined #openstack-sahara | 13:55 | |
| *** esikachev has joined #openstack-sahara | 13:56 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Tests for Sahara CLI client. https://review.openstack.org/332122 | 13:56 |
| esikachev | vgridnev: tosky maybe merge https://review.openstack.org/#/c/332785/? | 13:59 |
| tosky | esikachev: ah, right, can I simply run a recheck? | 14:00 |
| esikachev | sure | 14:00 |
| *** nkrinner is now known as nkrinner_afk | 14:11 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: plugins api impl https://review.openstack.org/333374 | 14:21 |
| *** links has quit IRC | 14:41 | |
| *** pcaruana has quit IRC | 14:41 | |
| *** esikachev has quit IRC | 14:45 | |
| *** esikachev has joined #openstack-sahara | 15:01 | |
| *** dave-mccowan has quit IRC | 15:02 | |
| *** _elmiko is now known as elmiko | 15:04 | |
| *** dave-mccowan has joined #openstack-sahara | 15:19 | |
| openstackgerrit | Merged openstack/puppet-sahara: Switch to use oslo::zmq messaging https://review.openstack.org/332900 | 15:27 |
| *** dmk0202 has quit IRC | 15:46 | |
| *** zioproto has quit IRC | 15:49 | |
| *** tesseract- has quit IRC | 16:17 | |
| openstackgerrit | Merged openstack/sahara-tests: Removed unused dir https://review.openstack.org/332785 | 16:25 |
| openstackgerrit | Mikhail Lelyakin proposed openstack/sahara-dashboard: Resolve bug with long time for loading node group template page https://review.openstack.org/333273 | 16:55 |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Tests for Sahara CLI client. https://review.openstack.org/332122 | 16:55 |
| vgridnev | egafford, seems like your questions was addressed at https://review.openstack.org/#/c/324284/1 | 17:13 |
| egafford | vgridnev: True! | 17:14 |
| egafford | vgridnev: In terms of the CLI stuff, btw, I have a patch that's working, but I'm waiting on some licensing issues on the libguestfs python API to resolve (historically the libguestfs team hasn't pushed to pypi to avoid an overly broad relicensing clause in the Python Foundation's legal agreement.) I hope those will resolve shortly in one direction or the other. | 17:16 |
| egafford | vgridnev: BTW, do you want to be the single point of WF+1 normally (just to merge things in a sane queue) or is it helpful to you if I WF+1 things when they've sat for a while with enough +2s? | 17:18 |
| *** abalutoiu has quit IRC | 17:32 | |
| *** tosky has quit IRC | 17:34 | |
| *** rcernin has quit IRC | 17:38 | |
| vgridnev | egafford, I'm ok if you will WF+1 changes. It will be helpful | 17:46 |
| egafford | vgridnev: Cool; I'll do that then when I see that it's appropriate. :) | 17:47 |
| vgridnev | there are few changes with at least one +2 https://review.openstack.org/#/q/label:Code-Review%253E%253D2+status:open+projects:openstack/sahara | 17:49 |
| vgridnev | egafford, ^^ | 17:52 |
| vgridnev | egafford, are you using some special review boards? | 17:53 |
| egafford | vgridnev: Yup; I've been charging through those in the last :30 or so. I'm mostly just looking at all changes for all sahara-related repositories all the time. I've considered getting fancier with gerrit queries. | 17:53 |
| *** tosky has joined #openstack-sahara | 17:54 | |
| egafford | Ah, Java reviews. | 17:54 |
| * egafford misses strong types sometimes. | 17:54 | |
| egafford | So much code to do so little, though. | 17:55 |
| *** dave-mccowan has quit IRC | 17:58 | |
| vgridnev | egafford, meeting? | 18:01 |
| vgridnev | elmiko, crobertsrh tmckay ? | 18:01 |
| elmiko | ack, brt. sorry i've got some other conflicts | 18:05 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Added publisher script and job https://review.openstack.org/328180 | 18:07 |
| crobertsrh | coming | 18:07 |
| *** degorenko is now known as _degorenko|afk | 18:16 | |
| *** dave-mccowan has joined #openstack-sahara | 18:19 | |
| *** witlessb has quit IRC | 18:29 | |
| *** witlessb has joined #openstack-sahara | 18:29 | |
| *** rodrigods has quit IRC | 18:40 | |
| *** rodrigods has joined #openstack-sahara | 18:40 | |
| openstackgerrit | Merged openstack/sahara-specs: initial kerberos integration https://review.openstack.org/327616 | 18:48 |
| openstackgerrit | Merged openstack/python-saharaclient: Updated from global requirements https://review.openstack.org/333454 | 18:52 |
| tellesnobrega | quick question, does sahara hadoop job work properly running with data in swift being a folder with the to be processed files in it? or swift url has to point to the file itself? | 18:58 |
| elmiko | tellesnobrega: i think the expectation is that you will provide a full path to the object | 19:01 |
| elmiko | not just a container | 19:01 |
| elmiko | but, i imagine if the hadoop job knows how to add the object to the container, then it might work. but probably not if you are just using the sahara interface | 19:01 |
| *** esikachev has quit IRC | 19:04 | |
| tellesnobrega | elmiko, i see. Basically the problem we are facing is we want to have a bigger file >5GB but we are using ceph on the background with radosgw which only allows max of 5GB file. One solution is to partition the file while uploading which lead to many socket timeouts and what not. Second option was to split the file and upload it and pass a folder to hadoop (since it does understands that on hdfs) | 19:04 |
| elmiko | huh... that sounds like a tough one | 19:06 |
| elmiko | i'm not sure how we would handle that, but it's possible we could create some feature that allowed passing swift containers, which could then be used | 19:07 |
| tellesnobrega | elmiko, yeah. I will try to look into that later on | 19:12 |
| *** sgotliv__ has quit IRC | 19:14 | |
| *** htruta_ has joined #openstack-sahara | 19:15 | |
| htruta_ | elmiko: hi! was talking to tellesnobrega now... have you ran sahara jobs with swift segmented files? | 19:17 |
| htruta_ | we've tried with some files in the same directory, but it does not work... and with the segmented files, I'm able to downlaod the whole file by using only swift, but seems like sahara is not able to handle with it | 19:18 |
| *** htruta is now known as henrique | 19:22 | |
| *** henrique is now known as Guest78419 | 19:23 | |
| *** Guest78419 is now known as htruta | 19:23 | |
| *** htruta_ has quit IRC | 19:24 | |
| *** esikachev has joined #openstack-sahara | 19:48 | |
| openstackgerrit | Merged openstack/python-saharaclient: avoid additional requirement for building docs https://review.openstack.org/326582 | 19:59 |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara-specs: Allow creation of python topologies for Storm https://review.openstack.org/333003 | 20:01 |
| *** esikachev has quit IRC | 20:04 | |
| *** itisha has quit IRC | 20:27 | |
| *** crobertsrh has quit IRC | 20:27 | |
| *** aignatov has quit IRC | 20:27 | |
| *** zigo has quit IRC | 20:27 | |
| *** DuncanT has quit IRC | 20:27 | |
| *** jamielennox has quit IRC | 20:27 | |
| *** aignatov has joined #openstack-sahara | 20:27 | |
| *** crobertsrh has joined #openstack-sahara | 20:28 | |
| *** zigo has joined #openstack-sahara | 20:29 | |
| *** DuncanT has joined #openstack-sahara | 20:31 | |
| *** itisha has joined #openstack-sahara | 20:31 | |
| *** jamielennox has joined #openstack-sahara | 20:38 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Update documentation for hadoop-swift https://review.openstack.org/324321 | 21:00 |
| openstackgerrit | Merged openstack/sahara-extra: hadoop-swiftfs: SimpleDateFormat is locale specific https://review.openstack.org/324284 | 21:01 |
| openstackgerrit | Merged openstack/sahara-extra: hadoop-swiftfs: Allow configuring domain.id https://review.openstack.org/324285 | 21:02 |
| openstackgerrit | Merged openstack/sahara-extra: hadoop-swiftfs: Allow configuring container.tenant https://review.openstack.org/331589 | 21:02 |
| *** catintheroof has quit IRC | 21:21 | |
| *** crobertsrh is now known as _crobertsrh | 21:23 | |
| *** tosky has quit IRC | 22:28 | |
| openstackgerrit | Merged openstack/sahara: Update documentation for hadoop-swift https://review.openstack.org/324321 | 23:03 |
| *** rcernin has joined #openstack-sahara | 23:16 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!