Eva-i | To test zaqar-server's response I also had to install "uuid-runtime" linux package to be able to execute "uuidgen" command. | 00:05 |
---|---|---|
Eva-i | I'm on debian jessie distro. | 00:05 |
vkmc | cool | 00:08 |
Eva-i | What bothers me is that the server is running under python 3: http://pastebin.com/uvp9Swpi | 00:08 |
Eva-i | Is that okay? | 00:08 |
vkmc | yeah its ok | 00:15 |
vkmc | zaqar is py3 compatible | 00:15 |
vkmc | :) | 00:15 |
vkmc | its not true for other OpenStack services | 00:15 |
vkmc | but in this case its ok | 00:15 |
vkmc | you succeeded creating a queue, awesome | 00:15 |
Eva-i | "py3 compatible" now that's cool | 00:17 |
*** achanda has joined #openstack-zaqar | 00:21 | |
mdnadeem | Eva-i:vkmc: for [driver] section already a fixed is proposed, Please have a look at https://review.openstack.org/#/c/229228/ | 00:26 |
vkmc | mdnadeem, thanks | 00:26 |
Eva-i | But I'm not able to run tests. "tox -e py27" whines about insufficient disk space. Mongodb with zaqar databases used all remaining space(about 8,6 GB). =) | 00:26 |
mdnadeem | vkmc: I face a problem, please look if you can help me out | 00:26 |
vkmc | :o | 00:27 |
vkmc | Eva-i, how is your env? | 00:27 |
vkmc | mdnadeem, which problem? | 00:27 |
Eva-i | vkmc: what do you mean by how is my env? | 00:27 |
*** mdnadeem_ has joined #openstack-zaqar | 00:28 | |
vkmc | Eva-i, sorry, I meant what are the specs of your computer/if you are running things in a virtual machine | 00:28 |
mdnadeem | vkmc: i created a queue sucessfully, however when i run queue list command it show me an empty list | 00:28 |
vkmc | mdnadeem, are you curling to zaqar? | 00:29 |
mdnadeem | I try to debug the code , however i stuck at a point | 00:29 |
mdnadeem | yes | 00:29 |
vkmc | hm | 00:29 |
Eva-i | vkmc: 25 GB for root partition, 82 GB for home partition | 00:30 |
mdnadeem | vkmc: So while debugging code, i come to the file https://github.com/openstack/zaqar/blob/master/zaqar/storage/mongodb/pools.py at line #71 | 00:30 |
mdnadeem | it query for Collection(Database(MongoClient('localhost', 27017), u'zaqar_mgmt'), u'pools') | 00:31 |
Eva-i | mongodb databases reside here: /var/lib/mongodb | 00:31 |
Eva-i | so root partition was filled | 00:31 |
Eva-i | What are recommended space specs for testing zaqar? | 00:32 |
mdnadeem | vkmc: i have manually checked mongodb database , zaqar_mgmt.pools is empty | 00:32 |
mdnadeem | Eva-i: I took 80GB for root partition, it works fine for me | 00:33 |
mdnadeem | Eva-i: I think you should increase the root partition, as mongodb database created at /var/lib/mongodb | 00:33 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/zaqar: Updated from global requirements https://review.openstack.org/231267 | 00:34 |
mdnadeem_ | vkmc: around ? | 00:38 |
vkmc | Eva-i, you shouldn't need much space | 00:39 |
vkmc | Eva-i, maybe you can start mongo with smallfiles = true | 00:39 |
vkmc | mdnadeem_, so I suppose you have pools enabled | 00:40 |
Eva-i | mdnadeem: nope, I will just create VM on different disk. I was trying out zaqar server directly on my home laptop. I think that was bad idea. | 00:41 |
mdnadeem_ | vkmc: i have used defaullt devstack created zaqar.conf, how to check if pool enable? | 00:41 |
vkmc | mdnadeem, pooling = true under /etc/zaqar/zaqar.conf | 00:42 |
*** davideagnello has quit IRC | 00:42 | |
vkmc | I'll test that scenario though, its an odd behaviour | 00:42 |
Eva-i | vkmc: okay, next time I will. | 00:42 |
mdnadeem_ | vkmc: in zaqar.conf , pooling = True | 00:42 |
vkmc | yeah | 00:42 |
mdnadeem_ | [pooling:catalog] | 00:43 |
mdnadeem_ | enable_virtual_pool = True | 00:43 |
mdnadeem_ | that means pools enable rt? | 00:43 |
*** davideagnello has joined #openstack-zaqar | 00:44 | |
*** davideagnello has quit IRC | 00:46 | |
*** davideagnello has joined #openstack-zaqar | 00:47 | |
mdnadeem_ | vkmc: i will check behavior by disabling the pool and update you the same today. | 00:50 |
vkmc | mdnadeem, sure, thanks for that | 00:50 |
vkmc | I'll test that myself too | 00:50 |
mdnadeem_ | vkmc: Thank you very much. You guys are really very help full :) | 00:51 |
Eva-i | vkmc: yeah, thanks for answering my newbie questions | 00:57 |
vkmc | mdnadeem, Eva-i, anytime! | 00:57 |
mdnadeem_ | vkmc: queue list command work as expected by disabling pool. | 00:58 |
mdnadeem_ | vkmc: can you refer any doc or link to understand pool concept and how it work, such that i can debug first scenario more deeply | 01:00 |
*** itisha has quit IRC | 01:03 | |
*** mdnadeem__ has joined #openstack-zaqar | 01:36 | |
*** mdnadeem_ has quit IRC | 01:37 | |
*** stanchan has joined #openstack-zaqar | 02:13 | |
*** csoukup has joined #openstack-zaqar | 02:18 | |
*** csoukup has quit IRC | 02:22 | |
*** Qiming_ has joined #openstack-zaqar | 02:23 | |
*** Qiming has quit IRC | 02:26 | |
*** achanda has quit IRC | 02:50 | |
*** Eva-i has quit IRC | 02:51 | |
*** JAHoagie has joined #openstack-zaqar | 03:44 | |
*** JAHoagie has quit IRC | 03:53 | |
*** mdnadeem__ has quit IRC | 04:24 | |
*** mdnadeem_ has joined #openstack-zaqar | 04:24 | |
mdnadeem | i am running a curl command, it say client ID is missing in header, Any idea how to get client ID | 04:27 |
mdnadeem_ | stack@vm2:~/devstack$ curl -i -X POST -H "X-AUTH_TOKEN:3c5c2d436f824d10b914a3ebb0e983e5" http://10.0.2.15:8888/v2/queues/firstq1/messages -d '[{"ttl":300, "body":{"event":"One"}}]' | 04:28 |
mdnadeem_ | HTTP/1.1 400 Bad Request | 04:28 |
mdnadeem_ | content-length: 93 | 04:28 |
mdnadeem_ | content-type: application/json; charset=utf-8 | 04:28 |
mdnadeem_ | { | 04:28 |
mdnadeem_ | "title": "Missing header", | 04:28 |
mdnadeem_ | "description": "The \"Client-ID\" header is required." | 04:28 |
mdnadeem_ | ryansb:Qiming:zigo:^^ | 04:29 |
*** achanda has joined #openstack-zaqar | 04:42 | |
*** mdnadeem_ has quit IRC | 04:46 | |
mdnadeem | Got it, can create client ID by executing command >> ZQ_CLIENTID=`python -c "import uuid; print(uuid.uuid4())"` | 05:28 |
*** davideagnello has quit IRC | 05:30 | |
*** davideagnello has joined #openstack-zaqar | 05:30 | |
*** diga has joined #openstack-zaqar | 05:31 | |
*** khushbu has joined #openstack-zaqar | 05:44 | |
*** flwang1 has joined #openstack-zaqar | 06:13 | |
*** khushbu has quit IRC | 07:05 | |
*** achanda has quit IRC | 07:18 | |
*** achanda has joined #openstack-zaqar | 07:22 | |
*** flwang1 has quit IRC | 07:40 | |
*** achanda has quit IRC | 07:57 | |
*** achanda has joined #openstack-zaqar | 08:05 | |
*** achanda has quit IRC | 08:16 | |
*** achanda has joined #openstack-zaqar | 08:39 | |
*** achanda has quit IRC | 08:50 | |
*** exploreshaifali has joined #openstack-zaqar | 09:52 | |
ryansb | mdnadeem: (I'm very late to answering your question) but on linux you can also use the "uuidgen" command | 10:24 |
mdnadeem | ryansb: Thanks for reply , i have a query , Please have a look if you can help me out. | 10:53 |
mdnadeem | ryansb: I need to know at which point in the code, queue is mapped with pool? | 10:54 |
mdnadeem | ryansb: as while creating a queue , i dnt give any pool information , so how it mapped to a pool, Note: pool option is True in zaqar.conf | 10:56 |
exploreshaifali | I am building mockups for Zaqar UI here is first link https://app.moqups.com/shaifali.agrawal09@gmail.com/Wn5sDwMw9I/view | 11:00 |
exploreshaifali | how should I put pools and flavors? | 11:00 |
exploreshaifali | because I think we will provide option to users for creating and destroying and updating pools and flavors both | 11:01 |
exploreshaifali | also what else should be added? | 11:01 |
exploreshaifali | ryansb, ^ | 11:01 |
mdnadeem | exploreshaifali: Look good :} | 11:03 |
exploreshaifali | mdnadeem, Thanks! | 11:03 |
exploreshaifali | but it need lot more things :) | 11:03 |
mdnadeem | exploreshaifali: is messaging and notification is common for all project? | 11:04 |
exploreshaifali | hmm... they are not | 11:04 |
exploreshaifali | so I should put them under project | 11:05 |
mdnadeem | so it would be better if you create them under project sub heading | 11:05 |
exploreshaifali | yup, Thanks mdnadeem :D | 11:05 |
mdnadeem | :) | 11:05 |
mdnadeem | exploreshaifali: do you know how pool and queue mapped together? | 11:07 |
exploreshaifali | mdnadeem, pool is collection of queues | 11:07 |
exploreshaifali | a queue must be mapped with a pool and a pool can contain n number of queues | 11:07 |
mdnadeem | yes, but i am little confused as while creating a queue we dnt mention any pool name, as per my undestanding queue should be mapped to a pool rt? | 11:08 |
exploreshaifali | mdnadeem, http://blog.flaper87.org/post/zaqar-pools-explained/ | 11:09 |
ryansb | I agree with mdnadeem about keeping projects as a top-level heading | 11:09 |
exploreshaifali | yup yup, Thanks ryansb :) | 11:09 |
ryansb | do you plan on having basic queue interactions as well (such as adding a message, or viewing the most recent messages) | 11:10 |
ryansb | in AWS you can add/read messages from SQS queues from the web UI | 11:10 |
ryansb | it's clunky, but it can be handy | 11:10 |
exploreshaifali | ryansb, so we will start with less features and can add more as we move forward | 11:11 |
exploreshaifali | later on definatly we will provide UI for add/read messages | 11:11 |
exploreshaifali | but for now I think pools and flavor or okay | 11:11 |
exploreshaifali | what you people say? | 11:11 |
exploreshaifali | s/or/are | 11:12 |
ryansb | yeah, I think pools/flavors are a good start | 11:12 |
ryansb | since those are the things users are most likely to want to configure by hand | 11:12 |
exploreshaifali | yes :D | 11:13 |
mdnadeem | exploreshaifali: for a start it is good, however creating message is the main task that must be added in future. :) | 11:13 |
exploreshaifali | okay, mdnadeem | 11:13 |
mdnadeem | exploreshaifali:ryansb: here is my queue create command: curl -i -X PUT -H "X-AUTH_TOKEN:bc314ef63c0e48adb8215c2127d3c297" http://10.0.2.15:8888/v2/queues/firstq2 | 11:14 |
ryansb | do you need a client ID as well? | 11:14 |
ryansb | or is that only message | 11:15 |
mdnadeem | no, | 11:15 |
mdnadeem | yes client id is only for message creation | 11:15 |
mdnadeem | i have doubt this created queue is not mapped with any pool | 11:15 |
mdnadeem | so i need to know how can i attached my queue to a pool? | 11:16 |
mdnadeem | ryansb:exploreshaifali: ^^ | 11:18 |
ryansb | it will be the default pool | 11:18 |
ryansb | so if you GET /v2/pools you should see the existing pools | 11:19 |
ryansb | (likely only one) | 11:19 |
exploreshaifali | for pool operations you can look at https://wiki.openstack.org/wiki/Zaqar/specs/api/v1.1#Message_Store_Pools | 11:19 |
mdnadeem | ryansb: I have check mongodb data base, no entry is present in pool collection , and not also in catalog collection | 11:20 |
*** Eva-i has joined #openstack-zaqar | 11:20 | |
mdnadeem | only created queue entry is present in db zaqar_mgmt_queues.queue collection | 11:21 |
exploreshaifali | this is flaper87 's call | 11:22 |
mdnadeem | flaper87: ^^ping | 11:23 |
ryansb | so the pool is linked to a queue by a flavor | 11:23 |
ryansb | and if you didn't specify a flavor, then it won't get a pool | 11:24 |
ryansb | in the mongo backend, all a project name does is scope the query to its own collection | 11:24 |
ryansb | otherwise the queue collection will just be named with the queue name, I think | 11:24 |
ryansb | so you should be able to see the queue collection and its messages | 11:24 |
mdnadeem | ryansb: i can see the queue entry in data base manually, however queue list command return me an empty list | 11:25 |
mdnadeem | ryansb: If i disable the pool, then every thing work fine for me | 11:26 |
mdnadeem | GET /v2/pools commands return HTTP/1.1 404 Not Found | 11:27 |
mdnadeem | content-length: 0 | 11:27 |
mdnadeem | ryansb: So there no default pool present | 11:27 |
mdnadeem | ryansb:flaper87: queue create help did not show me any option to add flavor or pool, neither i got any pointer in code where they are mapped. Please have a look at cli help option | 11:30 |
mdnadeem | usage: openstack queue create [-h] [-f {html,json,shell,table,value,yaml}] | 11:30 |
mdnadeem | [-c COLUMN] [--max-width <integer>] | 11:30 |
mdnadeem | [--prefix PREFIX] | 11:30 |
mdnadeem | <queue_name> | 11:30 |
exploreshaifali | mdnadeem, cli for pools and flavor are not ready yet | 11:31 |
exploreshaifali | as I mentioned earlier, conflict of flavor with nove | 11:32 |
exploreshaifali | nova* | 11:32 |
exploreshaifali | once we reach to a common conclusion, will start implementing cli | 11:32 |
ryansb | flat namespace :( | 11:33 |
mdnadeem | exploreshaifali: ohk, Thanks for info | 11:35 |
exploreshaifali | np : | 11:36 |
exploreshaifali | :) | 11:36 |
mdnadeem | :) | 11:36 |
mdnadeem | if using curl command for creating a queue, i am not getting how to specify pool for attaching my queue to it, | 11:38 |
mdnadeem | if you guys can give me any reference or link, i dnt find any using googly :) | 11:39 |
therve | mdnadeem, You don't pass the pool directly, you pass a flavor | 11:53 |
therve | I think you can do that by passing the _flavor key in the queue metadata | 11:53 |
mdnadeem | therve: Thanks for reply, How to do that , Please give an example of the command | 11:54 |
therve | mdnadeem, Something like curl ... -d '{"metadata": {"_flavor": "myflavor"}}' | 11:55 |
mdnadeem | ok, i execute this command separately for creating a flavor or i attached it with queue create command? | 11:57 |
therve | The queue create one | 11:58 |
mdnadeem | thanks, i just execute it and update you the same | 11:59 |
*** samjaro has joined #openstack-zaqar | 12:00 | |
mdnadeem | therve: Same situation, queue created successfully, however list command for queue or flavor or pool is return an empty list | 12:06 |
therve | Ah, that's probably something else then, like you're using pooling and the default pool is not detected properly or something | 12:08 |
therve | Are you using zaqar master? Maybe try to clean everything up in mongo and try again. | 12:08 |
therve | You don't need to specify a pool even if pooling is enabled in your configuration | 12:08 |
mdnadeem | ohk, flavor will attached the corresponding queue to a pool rt? | 12:09 |
mdnadeem | yes i am using zaqar master code | 12:10 |
therve | If you want to use flavor then I don't know | 12:10 |
therve | Possibly there is a bug | 12:10 |
mdnadeem | hmm, i feel so | 12:10 |
mdnadeem | by the way i ll try once more as you say after cleaning my mongo db | 12:11 |
mdnadeem | cleaning you means, unstalled and then re install it freshly rt? | 12:11 |
therve | I don't know what rt means | 12:12 |
therve | But know not uninstalling, just removing the data files | 12:12 |
mdnadeem | ohh rt meand right? :) | 12:12 |
mdnadeem | ohk, i will do it . Thanks therve :) | 12:13 |
mdnadeem | good night | 12:14 |
*** exploreshaifali has quit IRC | 12:17 | |
*** Qiming_ has quit IRC | 12:51 | |
*** Qiming_ has joined #openstack-zaqar | 12:51 | |
*** Qiming_ is now known as Qiming | 13:01 | |
*** nate_gone is now known as njohnston | 13:01 | |
*** sriram has joined #openstack-zaqar | 13:11 | |
*** mpanetta has joined #openstack-zaqar | 13:14 | |
*** mdnadeem_ has joined #openstack-zaqar | 13:21 | |
*** njohnston is now known as nate_gone | 13:23 | |
*** samjaro has quit IRC | 13:26 | |
*** nate_gone is now known as njohnston | 13:28 | |
*** malini has joined #openstack-zaqar | 13:53 | |
*** kgriffs|afk is now known as kgriffs | 14:12 | |
*** davideagnello has quit IRC | 14:14 | |
*** davideagnello has joined #openstack-zaqar | 14:15 | |
*** Qiming_ has joined #openstack-zaqar | 14:15 | |
*** Qiming has quit IRC | 14:15 | |
*** stanchan has quit IRC | 14:15 | |
*** dynarro has joined #openstack-zaqar | 14:17 | |
*** mdnadeem_ has quit IRC | 14:23 | |
openstackgerrit | Merged openstack/zaqar: Updated from global requirements https://review.openstack.org/231267 | 14:23 |
*** achanda has joined #openstack-zaqar | 14:29 | |
*** achanda has quit IRC | 14:37 | |
*** diga has quit IRC | 14:47 | |
*** dynarro has quit IRC | 14:48 | |
*** itisha has joined #openstack-zaqar | 14:55 | |
*** achanda has joined #openstack-zaqar | 14:57 | |
*** achanda has quit IRC | 15:01 | |
*** csoukup has joined #openstack-zaqar | 15:03 | |
*** davideagnello has quit IRC | 15:05 | |
*** david-ly_ is now known as david-lyle | 15:06 | |
*** davideagnello has joined #openstack-zaqar | 15:10 | |
*** kgriffs is now known as kgriffs|afk | 15:12 | |
*** davideagnello has quit IRC | 15:12 | |
*** davideagnello has joined #openstack-zaqar | 15:13 | |
*** kgriffs|afk is now known as kgriffs | 15:14 | |
*** khushbu has joined #openstack-zaqar | 15:28 | |
*** khushbu has quit IRC | 15:42 | |
*** khushbu has joined #openstack-zaqar | 15:45 | |
*** khushbu has quit IRC | 15:49 | |
*** khushbu has joined #openstack-zaqar | 15:51 | |
*** AAzza has quit IRC | 16:18 | |
*** malini has quit IRC | 16:25 | |
*** khushbu has quit IRC | 16:27 | |
*** Qiming_ has quit IRC | 16:33 | |
*** AAzza has joined #openstack-zaqar | 16:41 | |
*** AAzza has quit IRC | 16:51 | |
*** malini has joined #openstack-zaqar | 16:53 | |
*** AAzza has joined #openstack-zaqar | 17:19 | |
*** david-ly_ has joined #openstack-zaqar | 17:21 | |
*** david-lyle has quit IRC | 17:21 | |
*** david-ly_ is now known as david-lyle | 17:22 | |
*** achanda has joined #openstack-zaqar | 17:24 | |
*** stanchan has joined #openstack-zaqar | 17:29 | |
*** exploreshaifali has joined #openstack-zaqar | 17:50 | |
*** sriram has quit IRC | 18:04 | |
*** sriram has joined #openstack-zaqar | 18:04 | |
*** malini has quit IRC | 18:24 | |
*** kgriffs is now known as kgriffs|afk | 18:30 | |
*** malini has joined #openstack-zaqar | 18:33 | |
*** kgriffs|afk is now known as kgriffs | 18:36 | |
*** njohnston is now known as nate_gone | 18:52 | |
*** nate_gone is now known as njohnston | 19:16 | |
*** kgriffs is now known as kgriffs|afk | 19:32 | |
*** malini has left #openstack-zaqar | 19:39 | |
*** exploreshaifali has quit IRC | 19:40 | |
*** njohnston is now known as nate_gone | 20:09 | |
*** akanksha_ has joined #openstack-zaqar | 20:14 | |
*** kgriffs|afk is now known as kgriffs | 20:20 | |
*** nate_gone is now known as njohnston | 20:25 | |
*** sriram has quit IRC | 20:43 | |
*** flwang has quit IRC | 20:43 | |
*** zigo has quit IRC | 20:43 | |
*** kgriffs has quit IRC | 20:43 | |
*** VeggieMeat has quit IRC | 20:43 | |
*** sriram has joined #openstack-zaqar | 20:46 | |
*** flwang has joined #openstack-zaqar | 20:46 | |
*** zigo has joined #openstack-zaqar | 20:46 | |
*** kgriffs has joined #openstack-zaqar | 20:46 | |
*** VeggieMeat has joined #openstack-zaqar | 20:46 | |
*** VeggieMeat has quit IRC | 20:46 | |
*** VeggieMeat has joined #openstack-zaqar | 20:47 | |
*** mpanetta has quit IRC | 21:08 | |
*** sriram has quit IRC | 21:09 | |
*** samjaro has joined #openstack-zaqar | 21:32 | |
*** stanchan has quit IRC | 22:03 | |
*** itisha has quit IRC | 22:09 | |
*** sebasmagri has quit IRC | 22:09 | |
*** boris-42 has quit IRC | 22:09 | |
*** davideagnello has quit IRC | 22:10 | |
*** Roachs_ has joined #openstack-zaqar | 22:16 | |
*** samjaro has quit IRC | 22:19 | |
*** csoukup has quit IRC | 22:26 | |
*** sebasmagri has joined #openstack-zaqar | 22:37 | |
*** itisha has joined #openstack-zaqar | 22:44 | |
*** kgriffs is now known as kgriffs|afk | 22:52 | |
*** Roachs_ has quit IRC | 22:53 | |
*** boris-42 has joined #openstack-zaqar | 22:53 | |
*** davideagnello has joined #openstack-zaqar | 22:56 | |
*** Roachs_ has joined #openstack-zaqar | 23:03 | |
*** achanda_ has joined #openstack-zaqar | 23:36 | |
*** achanda has quit IRC | 23:40 | |
*** achanda_ has quit IRC | 23:41 | |
akanksha_ | Hey vkmc, did you find a solution for the missing X-Project-Id header? | 23:47 |
vkmc | no, I have been busy with some other stuff | 23:47 |
vkmc | sorry about that | 23:47 |
akanksha_ | vkmc, it seems like other people also encountered the same problem. https://bugs.launchpad.net/python-zaqarclient/+bug/1494154 | 23:48 |
openstack | Launchpad bug 1494154 in Python client library for Zaqar "zaqarclient failing with error header X-PROJECT-ID was missing" [Undecided,Confirmed] | 23:48 |
vkmc | yeah, you mentioned this before | 23:48 |
akanksha_ | If you could point me in the right direction I might be able to find a solution? | 23:48 |
vkmc | so basically we need to try this with a devstack deployment and try to understand why the credentials are not being post properly | 23:49 |
vkmc | the only way to do it is to follow in the code how a call is made and how a request is build | 23:50 |
vkmc | that requires you to inspect the code closely | 23:50 |
akanksha_ | Alright, I will get started on it. | 23:50 |
vkmc | thanks akanksha_ | 23:50 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!