Thursday, 2017-07-27

*** esikachev has joined #openstack-sahara00:04
*** esikachev has quit IRC00:09
*** ssmith has joined #openstack-sahara00:10
*** esikachev has joined #openstack-sahara01:05
*** jamielennox has quit IRC01:08
*** esikachev has quit IRC01:09
*** jamielennox has joined #openstack-sahara01:15
*** shuyingya has joined #openstack-sahara01:20
*** shuyingya has quit IRC01:28
*** shuyingy_ has joined #openstack-sahara01:28
*** ssmith has quit IRC01:37
*** esikachev has joined #openstack-sahara02:05
*** esikachev has quit IRC02:10
*** jamielennox has quit IRC02:17
*** jamielennox has joined #openstack-sahara02:24
*** ukaynar has quit IRC02:52
*** ukaynar has joined #openstack-sahara02:53
*** esikachev has joined #openstack-sahara03:06
*** esikachev has quit IRC03:11
*** tuanluong has joined #openstack-sahara03:51
*** esikachev has joined #openstack-sahara04:07
*** esikachev has quit IRC04:12
*** hoonetorg has joined #openstack-sahara04:26
*** links has joined #openstack-sahara04:33
*** esikachev has joined #openstack-sahara05:08
*** esikachev has quit IRC05:39
*** ukaynar has quit IRC05:49
*** ukaynar has joined #openstack-sahara05:50
*** ukaynar has quit IRC05:54
*** esikachev has joined #openstack-sahara06:03
*** esikachev has quit IRC06:14
*** anshul has joined #openstack-sahara06:14
*** anshul has quit IRC06:19
*** esikachev has joined #openstack-sahara07:02
*** rcernin has joined #openstack-sahara07:13
*** zemuvier has joined #openstack-sahara07:33
*** esikachev has quit IRC09:02
*** esikachev has joined #openstack-sahara09:06
*** esikachev has quit IRC09:27
*** masber has quit IRC09:55
*** ukaynar has joined #openstack-sahara11:17
*** ukaynar has quit IRC11:28
*** tuanluong has quit IRC11:47
openstackgerritMerged openstack/sahara-image-elements master: Configurable Spark version for Vanilla image  https://review.openstack.org/48446312:06
*** esikachev has joined #openstack-sahara12:13
*** shuyingy_ has quit IRC12:44
*** shuyingya has joined #openstack-sahara12:44
*** shuyingya has quit IRC12:44
*** shuyingya has joined #openstack-sahara12:45
*** shuyingya has quit IRC12:49
*** links has quit IRC12:52
*** jeremyfreudberg has joined #openstack-sahara13:01
*** lucasxu has joined #openstack-sahara13:03
*** shuyingya has joined #openstack-sahara13:08
*** shuyingya has quit IRC13:12
*** shuyingya has joined #openstack-sahara13:22
jeremyfreudberghey tellesnobrega13:23
jeremyfreudbergregarding cdh 5.1113:23
*** shuyingy_ has joined #openstack-sahara13:23
tellesnobregajeremyfreudberg, whats up?13:24
jeremyfreudbergyeah, so i'm working on getting those json default configs for cdh5.11, I think you saw yingya's instruction about how to find them13:24
jeremyfreudbergbut13:24
tellesnobregayes13:25
jeremyfreudbergit isn't quite working right still, so i was thinking we could use the cdh 5.10 configs, and open a bug saying "figure out the 5.11 stuff soon"13:25
jeremyfreudbergas to get around the feature freeze13:25
tellesnobregacan you make sure it properly works?13:26
jeremyfreudbergyeah, i'll see if the new version works well enough with the old configs13:26
*** shuyingya has quit IRC13:26
tellesnobregacool, let me know13:32
jeremyfreudbergyep13:32
jeremyfreudbergtellesnobrega: also, if there is a meeting today, I can't stay the whole time13:33
tellesnobregajeremyfreudberg, evgeny won't be able to be at the meeting today and tosky. Do you have important topics to be discussed at the meeting?13:33
jeremyfreudbergtellesnobrega: see above, let's skip the meeting13:33
tellesnobregaok, I will cancel the meeting, doesn't make sense to be there by myself :)13:33
jeremyfreudbergyep13:33
*** zemuvier has quit IRC13:38
*** ssmith has joined #openstack-sahara13:50
*** cpusmith has joined #openstack-sahara13:51
*** ssmith has quit IRC13:55
*** shuyingya has joined #openstack-sahara14:00
*** shuyingy_ has quit IRC14:00
*** shuyingy_ has joined #openstack-sahara14:02
*** shuyingya has quit IRC14:04
*** esikachev has quit IRC14:27
*** lucasxu has quit IRC14:30
*** lucasxu has joined #openstack-sahara14:32
*** brad[] has quit IRC14:33
*** jeremyfreudberg has quit IRC14:33
*** brad[] has joined #openstack-sahara14:34
*** lucasxu has quit IRC14:59
*** lucasxu has joined #openstack-sahara15:02
*** rcernin has quit IRC15:03
*** links has joined #openstack-sahara15:04
*** links has quit IRC15:07
*** jeremyfreudberg has joined #openstack-sahara16:02
*** lucasxu has quit IRC16:06
*** jeremyfreudberg has quit IRC16:08
*** shuyingy_ has quit IRC16:15
*** jeremyfreudberg has joined #openstack-sahara16:49
*** rcernin has joined #openstack-sahara17:16
*** tellesnobrega has quit IRC17:22
*** esikachev has joined #openstack-sahara17:23
*** esikachev has quit IRC17:27
tomtomtomhello, anyone got any ideas about the following situation.  I have a flavor for ephemeral storage, boot an instance with that flavor and ephemeral disk only.  When the instance comes up it says "not a bootable disk", then I dumpxml from virsh on the compute node and see two disks attached (there is only supposed to be one).17:46
tomtomtomone disk is vda @ 2.7GB which isn't supposed to be there and second is my ephermal disk @ 10GB.17:47
tomtomtomWhy would nova or libvirt attach the 2.7GB disk? In ceph rbd both disks are there however this error message is supplied by nova-compute.log: 2017-07-27 16:38:36.643 21452 WARNING nova.virt.libvirt.driver [req-63366dcb-743e-47ff-b55a-997a6bba48ca b1391381280b4279a80cd5af3165e7ec 765e45ff3feb4a21b561ac6e3e06fda8 - - -] [instance: ade5d677-9ecc-43ff-89de-e6f46eb61112] Ignoring supplied device name: /dev/vdb. Libvirt can't ho17:48
jeremyfreudberghi tomtomtom, is the disk of your flavor defined as root disk or ephemeral disk?17:48
tomtomtomCould that be why it's not a bootable disk?17:48
tomtomtomit's defined as ephemeral17:48
jeremyfreudbergi'm not quite sure, but i know that in my deployment, sahara's idea of "ephemeral storage" corresponds to root disk on the actual flavor17:49
tomtomtomhttp://imgur.com/a/FBydD that's the output I get.17:50
jeremyfreudbergtomtomtom, looking now17:51
tomtomtomno matter how I create the flavor I get "disk 0" which I think is ok as far as I know.17:52
jeremyfreudbergtomtomtom, this is a flavor from my sahara: http://paste.openstack.org/raw/616767/17:53
jeremyfreudbergi think the disk 0 is your problem17:53
jeremyfreudbergbut i could be wrong, things could be different depending on how storage backend is deployed17:53
jeremyfreudbergreally not my forte, unfortunately17:53
tomtomtomok, I thought I had to use ephemeral for sahara and that disk X would mean a non-ephemeral disk? no?17:54
jeremyfreudbergso that's what i am confused about too17:54
jeremyfreudbergin my experience, what sahara calls ephemeral really just means "not a volume", i.e. root disk of flavor17:54
jeremyfreudbergby the way, is this the same cloud ssmith was talking about and asking similar questions with yesterday?17:55
*** esikachev has joined #openstack-sahara17:55
tomtomtomyes17:59
jeremyfreudbergcool, so it is ceph then17:59
*** esikachev has quit IRC18:00
jeremyfreudbergtomtomtom, so I guess try with root disk instead, if you haven't already18:01
tomtomtomyeah and ceph appears to be working ok, "ephemeral" volumes get created in rbd, but nova can't boot them, I remember (as posted above) the issue with vdb assignment being an issue, but I can't see why this is happening, nova is booting the instance with the rbd driver correctly, and the only issue I could see is that the vm doesn't like to boot from /dev/vdb18:01
*** tellesnobrega has joined #openstack-sahara18:10
tellesnobregajeremyfreudberg, ping18:10
jeremyfreudberghey tellesnobrega, was about to ping you too18:11
tellesnobregamine is faster :)18:11
jeremyfreudberglol18:11
jeremyfreudberggive your news first18:11
tellesnobregajust approved my patch on the default templates18:11
jeremyfreudbergyes18:11
tellesnobregawaited for some people to look at it18:11
tellesnobreganobody did, I got your +118:11
tellesnobregaso I approved it18:11
tellesnobregathat is it18:11
jeremyfreudbergyep18:12
tellesnobregajust making sure someone else agreed there18:12
tellesnobregayour turn now18:12
jeremyfreudbergyes, i will give my news18:12
jeremyfreudbergso, 3 things18:12
jeremyfreudbergall mostly related18:12
*** esikachev has joined #openstack-sahara18:13
jeremyfreudbergone is cdh 5.1118:13
tellesnobregagood news?18:13
jeremyfreudbergmeh, i'm closer than before to getting those json files for 5.1118:13
jeremyfreudbergbut still stuck18:13
jeremyfreudbergso i am going to fall back on the 5.9 jsons for now18:14
jeremyfreudbergthey should work afaik, and i will be doing some testing soon18:14
jeremyfreudbergthe other thing is that i still have another patch coming for s3 on SIE18:15
*** shuyingya has joined #openstack-sahara18:15
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara-dashboard master: Test commit do not merge  https://review.openstack.org/48796818:15
jeremyfreudbergoh, funny, i thought django version could have been the issue too18:16
jeremyfreudbergregarding your patch18:16
tellesnobregayeah, seems like the most probably cause18:16
tellesnobregaabout the S3 patch, how big is it?18:17
jeremyfreudbergnot that big,18:17
jeremyfreudbergit's just SIE18:17
jeremyfreudbergthat's all i can fit into pike, sadly18:17
tellesnobregano worries18:17
jeremyfreudbergyeah, anyway, my point is, what time are you tagging pike-318:18
tellesnobregais this a topic worth discussing at the PTG? or you have most of it down?18:18
jeremyfreudbergwe can spend a little time at ptg18:18
jeremyfreudbergbut for the most part i know what i need to do18:18
tellesnobregapike-3 should be at most tomorrow by EOD18:18
jeremyfreudbergcool18:19
tellesnobregaif you feel like we could benefit from talking about it add to the etherpad18:19
*** esikachev has quit IRC18:19
jeremyfreudbergthere is a tiny mention of it already18:19
tellesnobregaawesome18:19
tellesnobregathat should be fine18:19
*** shuyingya has quit IRC18:20
tellesnobregaI will wait for you patch, so we can try to merge it before EOD tomorrow18:20
jeremyfreudbergi'm trying to get everything out today18:20
jeremyfreudbergwe will see18:20
tellesnobregaand include it in pike-318:20
tellesnobregaawesome18:20
jeremyfreudbergand your plan for python-saharaclient release? I think that one is force release tomorrow whether we want to or not18:20
jeremyfreudbergif i understand the mailing list email18:20
jeremyfreudbergsorry, let me rephrase that18:24
jeremyfreudbergabout the open patches that we do have on python-saharaclient18:25
jeremyfreudbergwill any of them be merged for release, or no18:25
tellesnobregayou mean iwonka's patches?18:27
jeremyfreudbergbasically, yes18:27
*** esikachev has joined #openstack-sahara18:28
tellesnobregaI would like to18:29
tellesnobregacan you review them?18:29
tellesnobregaso I don't approve it alone18:29
jeremyfreudbergi can review them18:29
jeremyfreudbergi just don't want to have mismatched release18:29
jeremyfreudbergsince final release of saharaclient for pike is tomorrow18:30
jeremyfreudbergbut there is one more month for sahara itself18:30
*** esikachev has quit IRC18:36
tellesnobregaoh, I see what you mean18:36
tellesnobregathat makes sense, we can wait to have them merged after the cut18:37
tellesnobregaso it releases next cycle18:37
jeremyfreudbergwell we could merge some things before the cut18:37
jeremyfreudbergwe just have to be consistent18:38
jeremyfreudbergnow that i'm thinking about it, it's not as big of a deal as i made it sound18:39
tellesnobregait doesn't make sense to provide a functionality on the client that don't have an answer from the server18:39
jeremyfreudbergthat's basically what i mean18:40
tellesnobregawe could merge but we would have to hide it18:40
jeremyfreudbergi was also thinking the other way, on api side we shouldn't merge export cluster template unless the cli had import cluster template18:40
*** tellesnobrega has quit IRC18:44
*** tellesnobrega has joined #openstack-sahara18:57
*** cpusmith_ has joined #openstack-sahara19:02
openstackgerritMerged openstack/sahara master: Updating default templates  https://review.openstack.org/48402819:05
*** cpusmith has quit IRC19:06
*** cpusmith_ has quit IRC19:19
*** cpusmith_ has joined #openstack-sahara19:19
*** cpusmith has joined #openstack-sahara19:20
jeremyfreudbergtellesnobrega: i think i did actually manage to get the cdh 5.11 json after all19:20
tellesnobregajeremyfreudberg, awesome19:21
jeremyfreudbergwe really need to change and document the way it's done19:21
jeremyfreudbergit's really a pain19:21
jeremyfreudberg"add it to etherpad"19:21
*** cpusmith_ has quit IRC19:24
tellesnobregasounds good :)19:31
tellesnobregajeremyfreudberg, trying to get to the bottom of this error19:35
tellesnobregalooks like using django <1.10 helps but it doesn't entirely fix the issue19:35
tellesnobregathere is something else going on19:36
jeremyfreudbergconsidering requirements.txt of sahara-dashboard was updated 3 weeks ago19:37
jeremyfreudbergi would look in upper-constraints actually19:37
jeremyfreudbergso i guess django-compressor19:37
jeremyfreudbergsince it is not capped in our requirements.txt19:37
jeremyfreudbergmaybe19:38
jeremyfreudbergnot django compressor19:38
jeremyfreudbergthe only thing that we are not capping in our own requirements.txt19:39
jeremyfreudbergthat got bumped up19:39
jeremyfreudbergis django-openstack-auth19:39
jeremyfreudbergnot sure19:40
tellesnobregaupper-constraints from horizon?19:41
jeremyfreudberghttps://github.com/openstack/requirements/blob/master/upper-constraints.txt19:41
tellesnobregaoh, ok19:42
jeremyfreudbergin our tox.ini we reference that upper constraints file as well as our own requirements.txt19:42
jeremyfreudbergrequirements.txt has been relatively stable for us, and all of our patches are failing, not just requirements one19:42
jeremyfreudbergso i was thinking it's upper constraints messing us up19:42
jeremyfreudbergbut i'm really not sure19:42
tellesnobregacould be19:47
tellesnobregalooking it it19:47
tellesnobregathis error showed up like what? 2 days or 3 days agow19:47
tellesnobrega?19:47
jeremyfreudbergsome time around july 24 i think, yeah19:48
jeremyfreudbergi don't remember exactly19:48
jeremyfreudbergnot that long ago at all19:48
jeremyfreudberglet me try a patch which has django-openstack-auth set to old version19:50
jeremyfreudbergjust for sanity19:50
tellesnobregathanks19:50
openstackgerritJeremy Freudberg proposed openstack/sahara-dashboard master: Test commit do not merge  https://review.openstack.org/48796819:50
jeremyfreudbergjust stealing your commit19:50
tellesnobregano worries19:51
tellesnobregayou can actually see that locally19:51
jeremyfreudbergoh right19:51
tellesnobregai'm running the tests here and seeing the same issu19:51
tellesnobregaissue19:51
tellesnobregait is just faster :)19:51
jeremyfreudbergi'll keep an eye on it on zuul19:52
jeremyfreudbergbut yeah19:52
jeremyfreudbergwe don't actually need to push it to gerrit to find out19:52
openstackgerritOpenStack Proposal Bot proposed openstack/python-saharaclient master: Updated from global requirements  https://review.openstack.org/48812719:57
openstackgerritOpenStack Proposal Bot proposed openstack/sahara master: Updated from global requirements  https://review.openstack.org/48813619:58
tellesnobregajeremyfreudberg, how do I run tests to get pdb working? ostestr right?20:06
jeremyfreudbergpython -m testtools.run <modulename>20:06
jeremyfreudbergdepending on how it's installed (and what directory your run from) usually modulename is sahara.tests.unit.blah or tests.unit.blah20:07
tellesnobregai see, it doesn't run on the tox env, so I have to have all dependencies locally installed for that20:08
tellesnobregaright?20:09
jeremyfreudbergthat's correct20:09
jeremyfreudbergbut20:09
jeremyfreudbergyou could also edit your tox.ini, maybe?20:09
tellesnobregatrue20:09
tellesnobregaI will try that later20:09
jeremyfreudbergbasically changing this line: https://github.com/openstack/sahara/blob/master/tox.ini#L1520:09
jeremyfreudbergto use testtools.run20:10
tellesnobregamakes total sense20:10
tellesnobregaI will try that later20:10
jeremyfreudbergcool20:10
tellesnobregalooks like it is solving part of the problem again20:10
jeremyfreudbergi am pushing cdh patch very soon, btw20:10
tellesnobregasetting the django-auth20:10
tellesnobregagreat, thanks20:10
tellesnobregabut there is one test fail20:11
jeremyfreudbergoh, hmm20:11
tellesnobregasahara_dashboard/content/data_processing/clusters/clusters/tests.py20:12
tellesnobregasahara_dashboard.content.data_processing.clusters.clusters.tests.DataProcessingClusterTests  test_launch_cluster_get_nodata20:13
openstackgerritOpenStack Proposal Bot proposed openstack/python-saharaclient master: Updated from global requirements  https://review.openstack.org/48812720:15
openstackgerritOpenStack Proposal Bot proposed openstack/sahara master: Updated from global requirements  https://review.openstack.org/48813620:16
jeremyfreudbergtellesnobrega: the bot did not announce my patch, but here it is https://review.openstack.org/#/c/48818120:17
jeremyfreudbergi'm looking at your test now20:17
tellesnobregait saw it :)20:17
* tellesnobrega looks20:17
jeremyfreudbergit's pretty substantial20:18
jeremyfreudbergas usual most of it is just fluff, you can ignore all the jsons and xmls and trust that they are right20:18
jeremyfreudbergremind me to deprecate 5.7 once we know that 5.11 is working20:20
openstackgerritEvgeny Sikachev proposed openstack/sahara-ci-config master: Added basic playbook  https://review.openstack.org/48818920:21
tellesnobregasure20:22
tellesnobregajeremyfreudberg, just two nits inline from what I see20:23
tellesnobregaotherwise looks good20:23
jeremyfreudbergcool20:23
tellesnobregaI have to leave now, but I will look at the new patch later20:23
jeremyfreudbergok cool20:23
jeremyfreudbergthanks20:23
jeremyfreudbergi don't know how i missed some of those v59s20:23
tellesnobregacommon on big patches20:23
tellesnobregadon't sweat20:23
jeremyfreudberg:)20:23
*** tellesnobrega has quit IRC20:29
openstackgerritOpenStack Proposal Bot proposed openstack/python-saharaclient master: Updated from global requirements  https://review.openstack.org/48812720:33
openstackgerritJeremy Freudberg proposed openstack/sahara master: Support of CDH 5.11.0  https://review.openstack.org/48818120:33
openstackgerritOpenStack Proposal Bot proposed openstack/sahara master: Updated from global requirements  https://review.openstack.org/48813620:34
openstackgerritJeremy Freudberg proposed openstack/sahara master: Support of CDH 5.11.0  https://review.openstack.org/48818120:35
*** jeremyfreudberg has quit IRC20:41
*** esikachev has joined #openstack-sahara20:43
*** esikachev has quit IRC20:47
*** tmckay has quit IRC21:16
*** tmckay has joined #openstack-sahara21:31
*** iwonka has quit IRC21:44
*** tmckay has quit IRC21:56
*** tmckay has joined #openstack-sahara22:07
*** cpusmith has quit IRC22:18
*** esikachev has joined #openstack-sahara22:24
*** rcernin has quit IRC22:26
*** esikachev has quit IRC22:29
*** esikachev has joined #openstack-sahara22:36
*** openstack has joined #openstack-sahara22:45
*** elmiko has joined #openstack-sahara22:47
*** tmckay has quit IRC22:48
*** ukaynar has joined #openstack-sahara22:50
*** tmckay has joined #openstack-sahara23:34
*** esikachev has joined #openstack-sahara23:44
*** esikachev has quit IRC23:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!