| *** nati_uen_ has quit IRC | 00:00 | |
| *** nati_uen_ has joined #openstack-metering | 00:00 | |
| *** nati_uen_ has quit IRC | 00:01 | |
| *** nati_uen_ has joined #openstack-metering | 00:02 | |
| openstackgerrit | Victor Stinner proposed a change to openstack/ceilometer: Replace mox with mocks in tests.compute.pollsters https://review.openstack.org/54845 | 00:03 |
|---|---|---|
| *** nati_ueno has quit IRC | 00:03 | |
| *** sandywalsh has quit IRC | 00:11 | |
| *** matsuhashi has joined #openstack-metering | 00:25 | |
| *** nosnos has joined #openstack-metering | 01:09 | |
| *** bingbu has joined #openstack-metering | 01:23 | |
| *** nati_uen_ has quit IRC | 01:24 | |
| *** nati_ueno has joined #openstack-metering | 01:24 | |
| *** nati_ueno has quit IRC | 01:30 | |
| sphoorti_ | sileht, are you around? | 01:43 |
| *** nati_ueno has joined #openstack-metering | 01:53 | |
| *** SergeyLukjanov is now known as _SergeyLukjanov | 02:01 | |
| *** _SergeyLukjanov has quit IRC | 02:02 | |
| *** suo has joined #openstack-metering | 02:09 | |
| *** krtaylor has joined #openstack-metering | 02:10 | |
| *** llu has quit IRC | 02:17 | |
| *** sdake has joined #openstack-metering | 02:27 | |
| *** sdake has joined #openstack-metering | 02:27 | |
| *** SergeyLukjanov has joined #openstack-metering | 02:39 | |
| *** matsuhashi has quit IRC | 02:43 | |
| *** matsuhashi has joined #openstack-metering | 02:43 | |
| *** matsuhas_ has joined #openstack-metering | 02:44 | |
| *** matsuhashi has quit IRC | 02:44 | |
| *** nati_ueno has quit IRC | 03:02 | |
| *** nati_ueno has joined #openstack-metering | 03:03 | |
| *** nati_ueno has quit IRC | 03:11 | |
| *** SergeyLukjanov has quit IRC | 03:11 | |
| *** SergeyLukjanov has joined #openstack-metering | 03:12 | |
| *** nati_ueno has joined #openstack-metering | 03:15 | |
| *** matsuhas_ has quit IRC | 03:20 | |
| *** matsuhashi has joined #openstack-metering | 03:21 | |
| *** sdake has quit IRC | 03:21 | |
| *** matsuhashi has quit IRC | 03:26 | |
| *** sdake has joined #openstack-metering | 03:29 | |
| *** suo has quit IRC | 03:49 | |
| *** suo has joined #openstack-metering | 03:49 | |
| *** SergeyLukjanov has quit IRC | 03:49 | |
| *** sphoorti_ has quit IRC | 03:52 | |
| *** SergeyLukjanov has joined #openstack-metering | 04:01 | |
| openstackgerrit | ChenZheng proposed a change to openstack/ceilometer: Add i18n warpping for all LOG messages https://review.openstack.org/54683 | 04:12 |
| *** SergeyLukjanov has quit IRC | 04:25 | |
| *** matsuhashi has joined #openstack-metering | 04:28 | |
| *** sphoorti has joined #openstack-metering | 04:48 | |
| *** sdake has quit IRC | 04:49 | |
| *** bingbu has quit IRC | 04:55 | |
| *** shakayumi has joined #openstack-metering | 05:09 | |
| openstackgerrit | ChenZheng proposed a change to openstack/ceilometer: Add i18n warpping for all LOG messages https://review.openstack.org/54683 | 05:47 |
| openstackgerrit | Jenkins proposed a change to openstack/ceilometer: Imported Translations from Transifex https://review.openstack.org/54482 | 06:03 |
| *** SergeyLukjanov has joined #openstack-metering | 06:05 | |
| *** sphoorti has quit IRC | 06:26 | |
| *** nati_ueno has quit IRC | 06:27 | |
| *** nati_ueno has joined #openstack-metering | 06:27 | |
| *** sphoorti has joined #openstack-metering | 06:28 | |
| *** nati_ueno has quit IRC | 06:32 | |
| *** nati_ueno has joined #openstack-metering | 06:33 | |
| *** evanjfraser has joined #openstack-metering | 06:41 | |
| *** evanjfraser has quit IRC | 06:49 | |
| *** sayali has joined #openstack-metering | 07:07 | |
| *** eglynn has joined #openstack-metering | 07:25 | |
| *** nati_ueno has quit IRC | 07:26 | |
| *** nati_ueno has joined #openstack-metering | 07:27 | |
| sphoorti | eglynn, hello :) | 07:29 |
| *** nati_ueno has quit IRC | 07:31 | |
| *** lsmola has joined #openstack-metering | 07:44 | |
| *** sayali has quit IRC | 07:44 | |
| *** eglynn has quit IRC | 07:45 | |
| *** matsuhashi has quit IRC | 08:08 | |
| *** matsuhashi has joined #openstack-metering | 08:08 | |
| *** matsuhashi has quit IRC | 08:12 | |
| *** sayali has joined #openstack-metering | 08:13 | |
| *** SergeyLukjanov has quit IRC | 08:14 | |
| *** matsuhashi has joined #openstack-metering | 08:16 | |
| *** matsuhashi has quit IRC | 08:34 | |
| *** eglynn has joined #openstack-metering | 08:45 | |
| sphoorti | eglynn, hi :) | 08:53 |
| *** tasdomas` has joined #openstack-metering | 08:57 | |
| *** tasdomas has quit IRC | 08:58 | |
| *** matsuhashi has joined #openstack-metering | 09:02 | |
| *** sayali has quit IRC | 09:02 | |
| *** sphoorti has quit IRC | 09:02 | |
| *** sayali has joined #openstack-metering | 09:02 | |
| *** sphoorti has joined #openstack-metering | 09:03 | |
| *** Ruetobas has quit IRC | 09:04 | |
| *** Ruetobas has joined #openstack-metering | 09:06 | |
| *** giroro_ has joined #openstack-metering | 09:09 | |
| *** matsuhashi has quit IRC | 09:10 | |
| *** Ruetobas has quit IRC | 09:11 | |
| *** matsuhashi has joined #openstack-metering | 09:11 | |
| *** matsuhashi has quit IRC | 09:15 | |
| eglynn | sphoorti: hi | 09:16 |
| sphoorti | hey eglynn , i am working on this bug https://bugs.launchpad.net/ceilometer/+bug/1243292 | 09:17 |
| sphoorti | i am failing to understand the exact bug. As to what exactly i should be doing | 09:18 |
| sphoorti | my mentors told me to look into ceilometer/networks/notifications.py file | 09:19 |
| sphoorti | how should i approach this problem? | 09:19 |
| sphoorti | eglynn, ? | 09:19 |
| *** matsuhashi has joined #openstack-metering | 09:20 | |
| *** nprivalova has joined #openstack-metering | 09:21 | |
| eglynn | sphoorti: /me looking ... | 09:21 |
| sphoorti | thank you eglynn :) | 09:21 |
| eglynn | sphoorti: OK so the basic problem is a mismatch between the structure of actual notification payload emitted by neutron | 09:26 |
| eglynn | sphoorti: ... and the expectations that ceilometer has around that content | 09:26 |
| eglynn | sphoorti: in particular, ceilo expects the notification message to look like this: | 09:26 |
| eglynn | {'payload': {'tenant_id': PROJECT_ID, 'label_id': LABEL_ID, ...}} | 09:26 |
| eglynn | whereas traceback in the bug report is telling you that it doesn't look like that | 09:27 |
| eglynn | in fact it's missing a mapping for the 'tenant_id' key in the payload dict | 09:27 |
| sphoorti | traceback says its in this format project_id=message['payload']['tenant_id'] right eglynn ? | 09:27 |
| sphoorti | so is it a syntactical error which i need to resolve? | 09:28 |
| eglynn | sphoorti: no, the traceback says that's what ceilometer expects | 09:28 |
| eglynn | sphoorti: whereas the structure looks somehow different | 09:28 |
| eglynn | sphoorti: this is not a syntax error in the ceilo code | 09:28 |
| eglynn | sphoorti: it's a mismatch between the expected and actual notification structure | 09:29 |
| eglynn | sphoorti: so how are you going to debug this? | 09:29 |
| sphoorti | but eglynn the notifcations.py file has the same line as that in traceback | 09:29 |
| eglynn | sphoorti ... eh, yeah, all python tracebacks look like that | 09:30 |
| sphoorti | okay eglynn , so in communication between neutron and ceilometer, the format in which neutron is sending is not matching with ceilometer's? | 09:30 |
| eglynn | sphoorti: ... i.e. include the problematic line from the code that cuased the exception to be raised | 09:30 |
| sphoorti | so the eglynn should i be opening some other file for this error? | 09:31 |
| eglynn | sphoorti: ... think about it for a second, before I hand you the answer | 09:31 |
| sphoorti | sure eglynn | 09:31 |
| eglynn | sphoorti: ... where does the problematic notification originate from? | 09:31 |
| eglynn | sphoorti: ... how could you get visibility onto the actual notification structure? | 09:32 |
| eglynn | sphoorti: ... have you looked at the ceilometer logs? | 09:32 |
| eglynn | sphoorti: ... with debug=True | 09:32 |
| eglynn | sphoorti: ... have you looked at the neutron code that produces this notification? | 09:33 |
| sphoorti | eglynn, i ll first check the ceilometer logs | 09:33 |
| eglynn | sphoorti: ... facts you need to establish | 09:33 |
| eglynn | 1. what the notification actually looks like in reality | 09:33 |
| eglynn | 2. whether the structure of the notification is variable according to the scenario at hand, or fixed | 09:34 |
| eglynn | 3. whether it's an error in the neutron notification logic in certain cases, or just a mismatch between the actual notification structure and ceilometer's expectation of same | 09:35 |
| eglynn | sphoorti: the answer to question #3 will tell you where the fix needs to be applied | 09:35 |
| eglynn | sphoorti: back to the traceback, do you understand what the traceback is telling you? | 09:36 |
| eglynn | sphoorti: ... it's not saying that the notification is in the format project_id=message['payload']['tenant_id'] | 09:36 |
| eglynn | sphoorti: ... rather its saying the code handling the notification is blowing up when it tries to access message['payload']['tenant_id'] | 09:38 |
| sphoorti | eglynn, is the flow from extension.py to services.py and then from the to_sample to notifications.py? | 09:38 |
| eglynn | sphoorti: the notification handlers are loaded as stevedove extensions and then sit there within the service process passively waiting for notifications to consume | 09:41 |
| sphoorti | eglynn, i just opened the extensions.py | 09:44 |
| eglynn | sphoorti: why? | 09:44 |
| eglynn | sphoorti: seriuusly, close it right up again ... that module will tell nothing about this bug | 09:45 |
| sphoorti | closed eglynn . sorry :( | 09:46 |
| eglynn | sphoorti: stevedore is just a library we use to dynamically load extensions | 09:46 |
| eglynn | sphoorti: it's completely generic, there's nothing to see there WRT this particular bug | 09:46 |
| eglynn | sphoorti: you need to look at ...(a) | 09:47 |
| eglynn | (a) the ceilometer logs showing the actual notification structure | 09:47 |
| eglynn | (b) the neutron code that emits that notification | 09:47 |
| eglynn | sphoorti: first things first ... figure out what the AMQP notification actually looks like | 09:48 |
| sphoorti | okay eglynn | 09:48 |
| eglynn | sphoorti: do you have a devstack running with both ceilometer & neutron? | 09:50 |
| eglynn | sphoorti: do you know which ceilometer service loads the problematic notification handler? | 09:51 |
| sphoorti | eglynn, i have ceilometer | 09:51 |
| eglynn | sphoorti: ^^^ the answer to that question will tell which ceilometer log file to look in | 09:51 |
| eglynn | sphoorti: "i have ceilometer" == "i have ceilometer but not neutron"? | 09:52 |
| sphoorti | yes eglynn . sorry :( | 09:52 |
| eglynn | sphoorti: no problem! | 09:52 |
| eglynn | sphoorti: ... BTW I'm just trying to prompt your own independent thought process | 09:53 |
| eglynn | sphoorti: ... (hope I don't appear difficult or narky :) ) | 09:53 |
| eglynn | sphoorti: so why is neutron important in this case? | 09:54 |
| eglynn | sphoorti: (for background, there are two separate network services in openstack, the original nova-network and the newer neutron service) | 09:54 |
| eglynn | sphoorti: devstack by default still uses nova-network | 09:55 |
| eglynn | sphoorti: no in this bug, it doesn't explicitly state that the issue arises with neutron | 09:55 |
| sphoorti | no eglynn . That will help me actually :). | 09:55 |
| eglynn | sphoorti: s/no in this bug/now in this bug/ | 09:56 |
| eglynn | sphoorti: but we can see that it's neutron from the log file URL that identifies the CI gate as: gate-tempest-devstack-vm-neutron-large-ops | 09:56 |
| eglynn | sphoorti: so in order to reproduce the issue, you'll need a neutron based devstack | 09:57 |
| sphoorti | eglynn, should i parallely start following these instructions? https://wiki.openstack.org/wiki/NeutronDevstack | 09:59 |
| eglynn | sphoorti: yes, spin up a fresh devstack with localrc based on that wiki page PLUS the ceilometer related setting you already have | 10:00 |
| sphoorti | eglynn, i ll simulateneously do that now. | 10:02 |
| openstackgerrit | ChenZheng proposed a change to openstack/ceilometer: Add i18n warpping for all LOG messages https://review.openstack.org/54683 | 10:02 |
| eglynn | sphoorti: cool :) | 10:02 |
| sphoorti | eglynn, i am working on neutron installtion. will ping you in a bit | 10:11 |
| *** nijaba_ has quit IRC | 10:19 | |
| *** nprivalova has quit IRC | 10:21 | |
| *** matsuhashi has quit IRC | 10:25 | |
| sphoorti | eglynn, sorry for pinging late, was fixing network connectivity issue on virtual box. Restarted the virtual box. | 10:29 |
| sphoorti | the stack.sh script is running now eglynn :) | 10:29 |
| *** nosnos has quit IRC | 10:32 | |
| sphoorti | eglynn, the collectorservice in ceilometer handles the notifications right? | 10:34 |
| eglynn | sphoorti: yep, exactly | 10:47 |
| *** nprivalova has joined #openstack-metering | 10:47 | |
| eglynn | sphoorti: (ensure debug=True in /etc/ceilometer/ceilometer.conf to dial logging up to the max) | 10:48 |
| *** suo has quit IRC | 10:48 | |
| sphoorti | eglynn, neutron installed :) i can see it in my system resources :) | 10:50 |
| sphoorti | eglynn, now checking /etc/ceilometer/ceilometer.conf | 10:52 |
| sphoorti | eglynn, debug=True added in ceilometer.conf | 10:54 |
| *** mwagner has joined #openstack-metering | 11:28 | |
| *** sphoorti has quit IRC | 11:28 | |
| *** sayali has quit IRC | 11:29 | |
| *** sphoorti has joined #openstack-metering | 11:29 | |
| *** sayali has joined #openstack-metering | 11:29 | |
| *** ruhe has joined #openstack-metering | 11:35 | |
| *** nprivalova has quit IRC | 11:47 | |
| *** ruhe has quit IRC | 12:14 | |
| sphoorti | eglynn, are you around? | 12:30 |
| *** sphoorti has quit IRC | 12:39 | |
| *** nprivalova has joined #openstack-metering | 12:43 | |
| *** thomasem has joined #openstack-metering | 12:47 | |
| *** sphoorti has joined #openstack-metering | 12:48 | |
| *** julim has joined #openstack-metering | 13:05 | |
| thomasem | Hey all | 13:09 |
| sphoorti | hi thomasem :) | 13:10 |
| thomasem | Hey, sphoorti! How's the day treating you? | 13:11 |
| sphoorti | thomasem, eglynn was helping me understand me the bug. | 13:11 |
| thomasem | Oh, awesome. | 13:11 |
| sphoorti | thomasem, i installed neutron on devstack | 13:11 |
| sphoorti | and i was looking into the service.py file | 13:12 |
| sphoorti | thomasem, how i should approach this bug? | 13:12 |
| thomasem | Can you link the bug? | 13:13 |
| sphoorti | sure :) | 13:13 |
| sphoorti | https://bugs.launchpad.net/ceilometer/+bug/1243292 | 13:13 |
| eglynn | sphoorti: the key code to look at is not the service.py (again that's just the foundation) | 13:19 |
| eglynn | sphoorti: instead look at the ceilometer/network/notifications.py | 13:19 |
| eglynn | sphoorti: and the collector logs, so the incoming AMQP notifications from neutron | 13:20 |
| sphoorti | eglynn, i am searching for the collector logs | 13:23 |
| eglynn | sphoorti: did you set LOGFILE in your localrc? | 13:24 |
| eglynn | sphoorti: see http://devstack.org/localrc.html for details of configuring logging | 13:25 |
| eglynn | sphoorti:otherwise just run: | 13:26 |
| eglynn | sceen -r | 13:26 |
| eglynn | *screen -r | 13:27 |
| eglynn | then: | 13:27 |
| eglynn | ctrl+" | 13:27 |
| eglynn | choose the ceilo collector screen | 13:27 |
| eglynn | then: | 13:27 |
| eglynn | ctrl+[ | 13:27 |
| sphoorti | okay eglynn will do that | 13:28 |
| eglynn | and you can search back thru' the collector logs | 13:28 |
| sphoorti | eglynn, i had copied the sample localrc file. terriyu had suggested me | 13:28 |
| eglynn | sphoorti: OK, forget about changing the LOGFILE setting now | 13:28 |
| sphoorti | eglynn, i have LOGFILE in my localrc file | 13:28 |
| eglynn | sphoorti: just look at the screen -r | 13:28 |
| *** ruhe has joined #openstack-metering | 13:28 | |
| sphoorti | it has aegthe destination is set to logs/stack.sh.logs | 13:29 |
| lsmola | eglynn, hello | 13:31 |
| eglynn | lsmola: yo | 13:31 |
| *** ruhe has quit IRC | 13:32 | |
| lsmola | eglynn, we are talking on #openstack-horizon about sayali 's patch | 13:33 |
| *** sayali has quit IRC | 13:33 | |
| lsmola | eglynn, that we will probably accept the 10, then the UX guys have to figure out the best approach to show more entities in one chart | 13:33 |
| *** sphoorti has quit IRC | 13:34 | |
| eglynn | lsmola: meh, no channel logging? | 13:34 |
| *** sayali has joined #openstack-metering | 13:35 | |
| eglynn | lsmola: who are the UX guys? the horizon core team? | 13:35 |
| lsmola | eglynn, the jcoufal is the UX guy :-) and yeah the Horizon team too :-) | 13:35 |
| *** sphoorti has joined #openstack-metering | 13:36 | |
| lsmola | eglynn, the rest of the conversation is on #openstack-opw | 13:36 |
| lsmola | eglynn, seems you are not there :-) | 13:36 |
| *** ruhe has joined #openstack-metering | 13:38 | |
| *** ruhe has quit IRC | 13:57 | |
| eglynn | jd__: you around? | 14:06 |
| eglynn | jd__: you happy enough for me to go ahead and stick those slides up on http://www.openstack.org/summit-upload? | 14:07 |
| *** eglynn is now known as eglynn-lunch | 14:09 | |
| *** giroro_ has quit IRC | 14:10 | |
| sayali | i will be back later too :) | 14:11 |
| *** ruhe has joined #openstack-metering | 14:11 | |
| *** Ruetobas has joined #openstack-metering | 14:11 | |
| *** sayali has quit IRC | 14:11 | |
| *** sphoorti has quit IRC | 14:12 | |
| *** Ruetobas has quit IRC | 14:16 | |
| *** Ruetobas has joined #openstack-metering | 14:28 | |
| *** nprivalova has quit IRC | 14:29 | |
| *** Ruetobas has quit IRC | 14:32 | |
| *** ruhe has quit IRC | 14:34 | |
| *** Ruetobas has joined #openstack-metering | 14:36 | |
| *** eglynn-lunch is now known as eglynn | 14:49 | |
| *** sphoorti has joined #openstack-metering | 14:52 | |
| *** lsmola has quit IRC | 15:12 | |
| *** nealph has left #openstack-metering | 15:17 | |
| *** ArcTanSusan has joined #openstack-metering | 15:46 | |
| *** lsmola has joined #openstack-metering | 15:55 | |
| *** Ruetobas has quit IRC | 16:01 | |
| *** sdake has joined #openstack-metering | 16:01 | |
| *** jsergent has joined #openstack-metering | 16:02 | |
| *** Ruetobas has joined #openstack-metering | 16:03 | |
| *** giroro_ has joined #openstack-metering | 16:06 | |
| *** Ruetobas has quit IRC | 16:07 | |
| *** ArcTanSusan has quit IRC | 16:20 | |
| *** nati_ueno has joined #openstack-metering | 16:30 | |
| *** jsergent has quit IRC | 17:02 | |
| *** julim has quit IRC | 17:03 | |
| *** SergeyLukjanov has joined #openstack-metering | 17:08 | |
| *** jsergent has joined #openstack-metering | 17:17 | |
| *** jsergent has quit IRC | 17:28 | |
| *** jsergent has joined #openstack-metering | 17:28 | |
| *** krtaylor has quit IRC | 17:39 | |
| *** sayali has joined #openstack-metering | 17:46 | |
| *** shakayumi has quit IRC | 17:50 | |
| *** julim has joined #openstack-metering | 17:51 | |
| *** eglynn has quit IRC | 18:05 | |
| *** lsmola has quit IRC | 18:07 | |
| *** shakayumi has joined #openstack-metering | 18:10 | |
| *** jsergent has quit IRC | 18:11 | |
| *** krtaylor has joined #openstack-metering | 18:20 | |
| *** nati_ueno has quit IRC | 18:21 | |
| *** nati_ueno has joined #openstack-metering | 18:21 | |
| *** jsergent has joined #openstack-metering | 18:23 | |
| *** SergeyLukjanov has quit IRC | 18:34 | |
| *** eglynn has joined #openstack-metering | 18:51 | |
| sphoorti | eglynn, hello :) | 19:00 |
| *** sayali_ has joined #openstack-metering | 19:20 | |
| *** sayali has quit IRC | 19:24 | |
| eglynn | sphoorti: hi | 19:45 |
| sphoorti | hi eglynn | 19:45 |
| sphoorti | made some progress | 19:46 |
| eglynn | sphoorti: cool have you figured out the notification message structure? | 19:46 |
| sphoorti | with thomasem and jpich help we mailed the openstack-dev group regarding a proposed solution and asking if there is restriction in the structure | 19:47 |
| sphoorti | i also made that particular change in my notifications.py file | 19:47 |
| eglynn | sphoorti: great! | 19:48 |
| sphoorti | eglynn, after changing the code i ran stack.sh too | 19:49 |
| sphoorti | and then i created one instance | 19:49 |
| sphoorti | but i am stuck now. I am not understanding how i should be checking what my changes have done. | 19:49 |
| sphoorti | have they solved the bug or not | 19:49 |
| sphoorti | :( | 19:50 |
| sphoorti | besides eglynn i think i have failed in creating an instance in the first place | 19:50 |
| eglynn | sphoorti: I don't creating an instance is the best way to cause neutron to emit a notification | 19:52 |
| eglynn | sphoorti: better to create a resource under neutron's control | 19:52 |
| eglynn | sphoorti: such as a router | 19:52 |
| sphoorti | then eglynn how otherwise should i check if my code is working? | 19:52 |
| eglynn | sphoorti: as I said above, create a resource that neutron is concerned with, such as a router | 19:53 |
| eglynn | sphoorti: start with 'neutron help' | 19:54 |
| eglynn | sphoorti: that'll tell you the commands available via the neutron CLI | 19:54 |
| sphoorti | okay eglynn i ll do that. | 19:54 |
| sphoorti | i deleted the instance i created | 19:54 |
| eglynn | sphoorti: so what does the message payload from neutron actually look like? | 19:55 |
| eglynn | sphoorti: ... i.e. is the tenant_id completely missing from the notification? | 19:55 |
| eglynn | sphoorti: ... (or just available via a key that ceilo doesn't expect?) | 19:56 |
| *** vkmc has joined #openstack-metering | 19:56 | |
| eglynn | sphoorti: ... is your change to notifications.py along the lines of s/['tenant_id']/.get('tenant_id)/ ? | 19:57 |
| sphoorti | eglynn, yes | 19:57 |
| sphoorti | i did .get(tenant_id,None) | 19:57 |
| eglynn | sphoorti: the None default is redundant there I think | 19:57 |
| sphoorti | eglynn, thomasem suggested we could use it | 19:58 |
| sphoorti | so that KeyError wont be thrown | 19:58 |
| sphoorti | if no match found | 19:58 |
| thomasem | sphoorti, eglynn is correct | 19:58 |
| thomasem | you can just do .get(?) and it'll return None automatically. | 19:58 |
| eglynn | sphoorti: but in any case, that's more like making the ceilometer code tolerant of the tenant_id not being present in the notification payload | 19:58 |
| eglynn | thomasem: exactly | 19:59 |
| eglynn | sphoorti: we still have to figure out why the tenant_id is missing | 19:59 |
| sphoorti | okay | 19:59 |
| thomasem | That's what the email to the Neutron team is about. I was wondering if some change had gone in recently that could effect those attributes. | 20:00 |
| eglynn | sphoorti: ... because ceilometer needs the tenant ID to be set in order to bill by project / group statistics by project etc. | 20:00 |
| thomasem | ^^ :) | 20:00 |
| eglynn | sphoorti: do you have an example of the actual notification message payload? | 20:00 |
| eglynn | sphoorti: (from the collector logs?) | 20:01 |
| eglynn | sphoorti: the tenant ID may be missing completely, or the structure of the notification may be such that the tenant ID is just not where ceilometer expects | 20:01 |
| eglynn | sphoorti: so next task is to get an example of such a notification payload | 20:02 |
| sphoorti | eglynn, i ran screen -r in /opt/stack/ceilometer/collector | 20:02 |
| eglynn | sphoorti: "in /opt/stack/ceilometer/collector"? | 20:03 |
| eglynn | sphoorti: it doesn't really matter what your current directory is when you run screen -r | 20:03 |
| eglynn | sphoorti: run 'screen -r' from anywhere | 20:04 |
| eglynn | sphoorti: *then* you need to switch to the collector screen | 20:04 |
| eglynn | sphoorti: earlier I gave you the screen command to list the available screens ... ctrl+" | 20:04 |
| eglynn | sphoorti: the collector should be one of these | 20:04 |
| eglynn | sphoorti: make sense? | 20:04 |
| sphoorti | eglynn, when i ran the screen -r command it says no screen to be resumed | 20:05 |
| eglynn | sphoorti: hmmm, on the host you're running devstack on? | 20:06 |
| sphoorti | yes | 20:06 |
| eglynn | sphoorti: check if the openstack services actually running | 20:07 |
| eglynn | sphoorti: ps -fe | grep ceilometer | 20:07 |
| *** krtaylor has quit IRC | 20:07 | |
| eglynn | sphoorti: (for example...) | 20:07 |
| eglynn | sphoorti: are those services actually running on that host? | 20:08 |
| sphoorti | eglynn, screen -r also says there is screen on 24811.stack | 20:08 |
| eglynn | sphoorti: oh, I thought you said there was no screen to be resumed? | 20:09 |
| eglynn | sphoorti: try: screen -r 24811.stack | 20:09 |
| sphoorti | and the grep instruction does give me ceilometer | 20:09 |
| eglynn | sphoorti: did you run stack.sh twice in succession? | 20:09 |
| eglynn | sphoorti: (without doing an unstack.sh in between?) | 20:10 |
| eglynn | sphoorti: anyway what does 'screen -r 24811.stack' give you? | 20:10 |
| sphoorti | There is a screen on 24811.stack | 20:10 |
| sphoorti | and at end there is no screen to be resumed matching 24811.stack | 20:11 |
| eglynn | sphoorti: are you running all of this on a fresh VM, or on a baremetal host? | 20:12 |
| sphoorti | vm | 20:12 |
| eglynn | sphoorti: is it possible that a previous running of devstack is interfering here? | 20:13 |
| sphoorti | eglynn, should i restart my vm and see? | 20:13 |
| eglynn | sphoorti: first try running ... | 20:13 |
| eglynn | unstack.sh ; stack.sh | 20:13 |
| sphoorti | okay eglynn | 20:13 |
| sphoorti | will do that | 20:14 |
| eglynn | sphoorti: if that doesn't work, my advice would be to simply spin up a completely fresh VM | 20:14 |
| eglynn | sphoorti: (as opposed to rebooting your existing one) | 20:14 |
| sphoorti | eglynn, :) | 20:26 |
| sphoorti | i think i wont have to install again | 20:27 |
| sphoorti | i did stack.sh | 20:27 |
| sphoorti | and then screen -r | 20:27 |
| sphoorti | and now i dont get the same result like before | 20:27 |
| sphoorti | instead i now see a whole list of staements and at the end ceilometer.alarm.service | 20:28 |
| sphoorti | eglynn, | 20:28 |
| eglynn | sphoorti: those statements look healthy? | 20:29 |
| eglynn | sphoorti: i.e. not error messages, just informational? | 20:30 |
| sphoorti | HTTP/1.0 200 ok | 20:30 |
| eglynn | sphoorti: sweet | 20:30 |
| sphoorti | hush :) | 20:30 |
| eglynn | sphoorti: so if you hit ... ctrl&" | 20:30 |
| eglynn | sphoorti: do you see a list of numbered screens? | 20:31 |
| eglynn | sphoorti: if so, navigate to the ceilometer collector screen | 20:31 |
| eglynn | sphoorti: that's the one you're interested in from a logging perspective | 20:31 |
| sphoorti | eglynn, sorry i am asking a really lame question | 20:32 |
| sphoorti | its ctrl& that i type right? | 20:32 |
| eglynn | sphoorti: no question is too lame :) | 20:32 |
| eglynn | sphoorti: sorry my fault ... hold down the Ctrl key then type " | 20:33 |
| sphoorti | i tried that fisrt like ctrl key and shift-7 | 20:33 |
| *** sayali_ has quit IRC | 20:33 | |
| eglynn | sphoorti: (i.e. Ctrl and double-quote together) | 20:33 |
| eglynn | sphoorti: by & I meant 'as well as' | 20:34 |
| sphoorti | oops.. sorry :( | 20:34 |
| eglynn | sphoorti: np! | 20:34 |
| sphoorti | okay i ll do that right away | 20:34 |
| eglynn | sphoorti: here's another of navigating | 20:34 |
| eglynn | sphoorti: hold down Ctrl then type p | 20:35 |
| eglynn | sphoorti: that moves to the previous screen | 20:35 |
| eglynn | sphoorti: do that a couple of times of you'll get to the collector screen | 20:35 |
| sphoorti | btw eglynn at the bottom of my terminal i see 25 $ ceilometer-api 26$ and so on | 20:36 |
| eglynn | sphoorti: k, repeat until you get to collector | 20:36 |
| eglynn | sphoorti: there yet? | 20:36 |
| sphoorti | i need to press enter every time i do ctrl p right? | 20:38 |
| eglynn | no need for enter, ctrl p should get to the previous screen each time | 20:38 |
| sphoorti | i dont think that is workig | 20:38 |
| sphoorti | :( | 20:39 |
| eglynn | sphoorti: sorry, my finger memory and my typing are not in sync | 20:39 |
| eglynn | sphoorti: k, rewind | 20:39 |
| sphoorti | i tried pressing ctrl key and p | 20:40 |
| eglynn | sphoorti: yep, my fault! | 20:40 |
| sphoorti | but the screen remains the same | 20:40 |
| eglynn | sphoorti: I meant 'ctrl and a together then hit p' | 20:40 |
| * eglynn is struggling with explaining commands that his fingers type automatically ;) | 20:41 | |
| sphoorti | :) | 20:41 |
| sphoorti | sorry eglynn :( | 20:41 |
| eglynn | sphoorti: no, my fault | 20:41 |
| eglynn | sphoorti: so ... hold down the ctrl key and the a character, then hit p | 20:42 |
| sphoorti | eglynn, long press ctrl key and p simultaneously gives me ^p | 20:42 |
| sphoorti | okay | 20:42 |
| sphoorti | ctrl key press a then hit p | 20:42 |
| eglynn | sphoorti: just do ctrl *with* a, then release, then hit p | 20:42 |
| *** shakayumi has quit IRC | 20:43 | |
| eglynn | sphoorti: similarly, to get the window list ... ctrl *with* a, then release, then hit " | 20:43 |
| eglynn | sphoorti: working? | 20:44 |
| sphoorti | eglynn, perfectly working | 20:44 |
| eglynn | \o/ | 20:44 |
| sphoorti | i worked out with " | 20:44 |
| sphoorti | yayyy | 20:44 |
| sphoorti | and now i am on collecter screen | 20:45 |
| sphoorti | screen 24 :) | 20:45 |
| eglynn | k, now you're on the correct screen, so detach by ... ctrl *with* a, then release, then hit d | 20:45 |
| eglynn | so back to your original shell | 20:45 |
| eglynn | then run a neutron command | 20:45 |
| *** shakayumi has joined #openstack-metering | 20:45 | |
| sphoorti | yes eglynn back to original shell. | 20:46 |
| *** thomasem has quit IRC | 20:46 | |
| eglynn | sphoorti: neutron router-create router1 | 20:47 |
| eglynn | sphoorti: or, neutron net-create net1 | 20:47 |
| eglynn | sphoorti: ... something of that ilk | 20:48 |
| eglynn | sphoorti: then back to the collector screen | 20:48 |
| eglynn | sphoorti: via ... screen -r | 20:48 |
| sphoorti | eglynn, i also struggle with this thing... whenever i am going to use these commands like neutron it asks me for os-username | 20:48 |
| sphoorti | under such circumstance --os-username = admin is the correct syntax? | 20:49 |
| eglynn | sphoorti: you need to set the OS_* env variables with the username etc that you provided when running devstack | 20:49 |
| sphoorti | how does one do that eglynn ? | 20:49 |
| eglynn | sphoorti: ... | 20:50 |
| eglynn | export OS_USERNAME=username | 20:50 |
| eglynn | export OS_PASSWORD=password | 20:50 |
| eglynn | export OS_TENANT_NAME=admin | 20:50 |
| eglynn | export OS_AUTH_URL=http://localhost:5000/v2.0 | 20:50 |
| eglynn | sphoorti: replace username with the actual username you specified, similarly for password | 20:51 |
| sphoorti | on commanline eglynn ? | 20:51 |
| eglynn | sphoorti: yep | 20:51 |
| sphoorti | okay doing that | 20:51 |
| *** chuck_ has joined #openstack-metering | 20:51 | |
| eglynn | sphoorti: look in your localrc if you forget the username, password etc. | 20:51 |
| sphoorti | eglynn, username can be admin as well as demo right? | 20:53 |
| eglynn | sphoorti: sure, export OS_USERNAME=admin | 20:53 |
| *** zul has quit IRC | 20:53 | |
| eglynn | export OS_USERNAME=sphoorti's_favourite_password | 20:54 |
| eglynn | export OS_TENANT_NAME=admin | 20:54 |
| eglynn | export OS_AUTH_URL=http://localhost:5000/v2.0 | 20:54 |
| eglynn | then: | 20:54 |
| eglynn | neutron router-create router1 | 20:54 |
| eglynn | then: | 20:54 |
| eglynn | screen -r | 20:54 |
| sphoorti | router has been created and i see a tabular display | 20:55 |
| eglynn | \o/ | 20:55 |
| eglynn | sphoorti: screen -r | 20:55 |
| eglynn | sphoorti: (to go back to the collector screen) | 20:56 |
| eglynn | sphoorti: then go into copy mode so you can srach back | 20:56 |
| eglynn | sphoorti: ctrl *with* a, then release, then hit [ | 20:56 |
| eglynn | sphoorti: then you can page up & down | 20:56 |
| eglynn | sphoorti: and text search backwards with '?' | 20:57 |
| *** nikhil___ is now known as |_nikhil_ | 20:57 | |
| eglynn | sphoorti: s/srach back/search backwards/ | 20:57 |
| sphoorti | eglynn, copy mode activated | 20:58 |
| eglynn | sphoorti: \o/ | 20:58 |
| sphoorti | now what do i have to search? | 20:58 |
| eglynn | sphoorti: so have a look back at notifications.py | 20:59 |
| eglynn | sphoorti: look for a method called event_types | 20:59 |
| eglynn | sphoorti: that binds the notification handler to particular notification events | 21:00 |
| sphoorti | eglynn, isnt there a simpler method than moving up the screen? | 21:00 |
| sphoorti | yes event_types is the first error line in my traceback | 21:00 |
| eglynn | sphoorti: page up | 21:00 |
| eglynn | sphoorti: so search for create.end | 21:01 |
| sphoorti | nothing as easy as the ctrl a and " | 21:01 |
| eglynn | sphoorti: it's getting late here (9pm), I need to drop off and put my kids to bed | 21:01 |
| eglynn | sphoorti: do you have enough to go on for now? | 21:01 |
| sphoorti | eglynn, could you just explain me the flow? i ll try working around it | 21:02 |
| *** chuck_ is now known as zul | 21:02 | |
| eglynn | sphoorti: which flow? | 21:02 |
| *** nati_ueno has quit IRC | 21:02 | |
| *** julim has quit IRC | 21:02 | |
| sphoorti | when i find the notifications.py file in my screen -r what do i do next? | 21:03 |
| *** nati_ueno has joined #openstack-metering | 21:03 | |
| eglynn | sphoorti: bbiab | 21:03 |
| sphoorti | okay eglynn | 21:03 |
| *** thomasem has joined #openstack-metering | 21:11 | |
| *** thomasem has quit IRC | 21:11 | |
| *** thomasem has joined #openstack-metering | 21:12 | |
| *** SergeyLukjanov has joined #openstack-metering | 21:12 | |
| thomasem | back | 21:13 |
| eglynn | sphoorti: search backward in the collector logging output for 'router1' | 21:17 |
| eglynn | sphoorti: if not already in copy mode: ctrl *with* a, then release, then hit [ | 21:17 |
| eglynn | sphoorti: then type ?router1 | 21:17 |
| eglynn | sphoorti: got it? | 21:18 |
| sphoorti | eglynn, notifications.py is not in collector folder it is seen networks | 21:18 |
| sphoorti | as far as i remember | 21:19 |
| eglynn | sphoorti: you're confusing screens and directories | 21:20 |
| sphoorti | but eglynn when i am in copy mode and i do ?notifications.py or ?router1 | 21:20 |
| eglynn | sphoorti: but either way, can you search thru' the collector log in the screen session? | 21:20 |
| sphoorti | no pattern found | 21:20 |
| eglynn | sphoorti: did you create a router called router1? | 21:21 |
| sphoorti | yes eglynn | 21:21 |
| sphoorti | and i saw the table too | 21:21 |
| sphoorti | and the router1 status was active in the table | 21:21 |
| eglynn | sphoorti: create another one, maybe the screen buffer has recycled | 21:21 |
| eglynn | sphoorti: detach from the screen session first | 21:21 |
| sphoorti | okay eglynn | 21:22 |
| eglynn | sphoorti: then create the 2nd router | 21:22 |
| eglynn | sphoorti: then resume the screen | 21:22 |
| sphoorti | eglynn, by mistake i wrote in the screen only screen -d.. how do you delete such lines? | 21:23 |
| eglynn | sphoorti: no need to delete | 21:24 |
| eglynn | sphoorti: ctrl *with* a, then release, then hit d | 21:24 |
| sphoorti | eglynn, two routers are there now | 21:25 |
| sphoorti | i got a tabular display for this one too | 21:25 |
| eglynn | sphoorti: screen -r again | 21:25 |
| sphoorti | and go to collector screen right? | 21:26 |
| eglynn | sphoorti: look for a notification related to the second router in the collector log | 21:26 |
| eglynn | sphoorti: yes | 21:26 |
| sphoorti | eglynn, so for that i have to do ?router2 right? | 21:27 |
| eglynn | sphoorti: copy mode first | 21:27 |
| eglynn | sphoorti: ctrl *with* a, then release, then hit [ | 21:27 |
| eglynn | sphoorti: then type ?router2 | 21:27 |
| sphoorti | yes eglynn did that :) sorry forgot to write that | 21:28 |
| sphoorti | eglynn, router2 found | 21:28 |
| sphoorti | :) | 21:28 |
| eglynn | \o/ | 21:29 |
| eglynn | sphoorti: what's the notification payload? | 21:29 |
| *** SergeyLukjanov is now known as _SergeyLukjanov | 21:29 | |
| *** _SergeyLukjanov has quit IRC | 21:29 | |
| eglynn | sphoorti: can you copy & paste? | 21:30 |
| sphoorti | eglynn, i ll try doing that | 21:30 |
| sphoorti | i am on virtualbox and it wont get copied on my nativemachine | 21:31 |
| sphoorti | any expert solution? | 21:33 |
| sphoorti | eglynn, ? | 21:33 |
| sphoorti | eglynn, | 21:36 |
| sphoorti | http://paste.openstack.org/show/8BA3AApgXbYh3aD7jMD7/ | 21:36 |
| eglynn | sphoorti: hmmm, can you include the previous line also? | 21:38 |
| eglynn | sphoorti: note ... u'tenant_id': u'987b29aa5e014b94a0cea884b69b7eee' | 21:39 |
| sphoorti | okay eglynn i ll include the previous line too | 21:39 |
| sphoorti | http://paste.openstack.org/show/023IXe3qPv4w1QnAhgm2/ | 21:41 |
| sphoorti | eglynn, | 21:41 |
| eglynn | sphoorti: ok, that's the messge with the sample as opposed to the raw notification | 21:43 |
| eglynn | sphoorti: seach back again for router2 | 21:43 |
| sphoorti | again ? | 21:44 |
| eglynn | yes again | 21:44 |
| eglynn | sphoorti: what TZ are you in? | 21:44 |
| eglynn | sphoorti: TZ=timezome | 21:44 |
| eglynn | timezone | 21:44 |
| sphoorti | GMT +5 | 21:44 |
| eglynn | sphoorti: k, I'm GMT+0 | 21:45 |
| eglynn | so getting very late here, I'm gonna have to drop off very shortly | 21:46 |
| sphoorti | its 3:15 am here :p | 21:46 |
| *** krtaylor has joined #openstack-metering | 21:46 | |
| sphoorti | eglynn, and i searched again fo router2 | 21:47 |
| sphoorti | what different thing was i supposed to find? eglynn ? | 21:49 |
| eglynn | sphoorti: the actual incoming AMQP notification is what you're looking for ... what did you find? | 21:50 |
| *** SergeyLukjanov has joined #openstack-metering | 21:50 | |
| sphoorti | its the same as previous one | 21:51 |
| eglynn | and, did you search again perchance? | 21:51 |
| sphoorti | yes eglynn | 21:52 |
| eglynn | .... and what did you find? | 21:52 |
| sphoorti | eglynn, previously you told me to note my tenant_id | 21:53 |
| sphoorti | its the same | 21:53 |
| eglynn | sphoorti: ok, so what you've proven there is? | 21:56 |
| eglynn | sphoorti: come on, think! | 21:56 |
| eglynn | sphoorti: the router.create.end notification includes what? | 21:56 |
| sphoorti | my tenant_id remains same | 21:56 |
| sphoorti | my tenant_id ? | 21:57 |
| eglynn | sphoorti: it includes a tenant ID, that's the important thing | 21:57 |
| eglynn | sphoorti: so where is the tenant ID contained? | 21:57 |
| eglynn | sphoorti: is it where ceilometer expects? | 21:58 |
| eglynn | sphoorti: where does ceilometer expect it to be? | 21:58 |
| eglynn | sphoorti: remember the notifications.py file you looked at earlier | 21:58 |
| sphoorti | eglynn , yes | 21:58 |
| eglynn | sphoorti: ... project_id=message['payload']['tenant_id'] | 21:58 |
| sphoorti | yes | 21:58 |
| eglynn | sphoorti: so is it in the payload? | 21:59 |
| eglynn | sphoorti: search for payload | 21:59 |
| eglynn | sphoorti: what do you see | 21:59 |
| sphoorti | payload gives me pattern not found | 21:59 |
| eglynn | sphoorti: if you see something like u'payload': { ... u'tenant_id': ... } | 21:59 |
| eglynn | sphoorti: you've probably run out of buffer again | 22:00 |
| *** nati_ueno has quit IRC | 22:00 | |
| eglynn | sphoorti: ok, here's what you need to do | 22:00 |
| sphoorti | i ll redo it | 22:00 |
| sphoorti | eglynn, i could ctrl f on the pastebin page too | 22:00 |
| eglynn | sphoorti: ... for each of the neutron notification types, ensure that the tenant ID is present as ceilo expects it | 22:00 |
| eglynn | sphoorti: ... do this either by: | 22:01 |
| eglynn | sphoorti: (a) causing those notifications to be emitted by nuetron and examining the collector logs | 22:01 |
| eglynn | sphoorti: or | 22:01 |
| eglynn | sphoorti: (b) by code inspection on the neutron side | 22:01 |
| sphoorti | eglynn, i ran a ctrl f but it didnt give me payload found | 22:02 |
| eglynn | sphoorti: you need to find the case where the tenant ID is missing, or not in the expected place in the payload | 22:02 |
| eglynn | sphoorti: ctrl f? | 22:02 |
| *** sdake has quit IRC | 22:04 | |
| sphoorti | eglynn, i created a router | 22:04 |
| sphoorti | but ?payload - not found | 22:04 |
| sphoorti | eglynn, ? | 22:07 |
| eglynn | sphoorti: one sec | 22:07 |
| thomasem | hey eglynn, is there a way for me to restore this change? John Herndon is on his way to Hong Kong, but I need this change restored so I can submit a fixed branch: https://review.openstack.org/#/c/40248/11 | 22:08 |
| thomasem | I wanted to keep the history and everything with that branch; it looks like only the owner can restore. It will be alright, I was just curious. Otherwise, I'll send John an email and see if he gets a chance to click the button. | 22:09 |
| eglynn | thomasem: I think only the owner or a gerrit admin | 22:13 |
| eglynn | sphoorti: OK, back | 22:13 |
| sphoorti | :) | 22:13 |
| eglynn | sphoorti: so, the logs don't include logging of the actual payload | 22:13 |
| eglynn | sphoorti: so, what do you suggest we do? | 22:13 |
| eglynn | sphoorti: if the logging we need isn't there? | 22:13 |
| thomasem | eglynn, Gotcha. Thanks anyway. I need to take off, got a concert tonight. Anyway - have an awesome weekend everyone, and good luck sphoorti! | 22:13 |
| sphoorti | thank you thomasem :) | 22:14 |
| eglynn | sphoorti: we add the logging, right? | 22:14 |
| sphoorti | yes eglynn | 22:14 |
| eglynn | sphoorti: so which source file needs to be changed? | 22:15 |
| sphoorti | notifications.py | 22:16 |
| eglynn | sphoorti: exactly! ceilometer/network/notifications.py | 22:16 |
| eglynn | sphoorti: so 3 lines need to be added | 22:16 |
| eglynn | sphoorti: sorry, actually just one line | 22:16 |
| eglynn | sphoorti: the imports are already there | 22:17 |
| sphoorti | eglynn, which line then? | 22:17 |
| eglynn | sphoorti: look for a line like: LOG.info('network notification %r', message) | 22:17 |
| eglynn | sphoorti: in process_notification() | 22:18 |
| eglynn | sphoorti: why isn't that line do what we expect? | 22:18 |
| *** zul has quit IRC | 22:19 | |
| *** thomasem has quit IRC | 22:19 | |
| sphoorti | eglynn, found the line | 22:19 |
| sphoorti | eglynn, is it because i wrote .get(tenant_id,None)>? | 22:21 |
| eglynn | sphoorti: the question is, why isn't that line appearing the collector log? | 22:21 |
| eglynn | sphoorti: (genuine question) | 22:21 |
| eglynn | sphoorti: let's check if it is | 22:22 |
| sphoorti | i am wondering that too :):P eglynn :P | 22:22 |
| eglynn | sphoorti: k, create yet another router | 22:22 |
| eglynn | sphoorti: then back to the collector log | 22:22 |
| eglynn | sphoorti: then copy mode | 22:22 |
| eglynn | sphoorti: then ?network notification | 22:23 |
| sphoorti | the same process again | 22:23 |
| sphoorti | gotcha | 22:23 |
| sphoorti | eglynn, i created a router3 | 22:25 |
| sphoorti | but when i am trying to find it pattern not found | 22:25 |
| sphoorti | and so for network notification | 22:26 |
| sphoorti | though i find router2 , the old one | 22:26 |
| sphoorti | eglynn, | 22:26 |
| sphoorti | eglynn, i found router3 this time but no network notification | 22:27 |
| *** thomasem has joined #openstack-metering | 22:29 | |
| sphoorti | no network notification found eglynn :( | 22:30 |
| eglynn | sphoorti: I really have to drop off now ... I'll spin up a fresh neutron-based devstack myself tmrw and figure out the logging the aspect ... I'll send you the details | 22:31 |
| eglynn | sphoorti: email? | 22:31 |
| sphoorti | eglynn, sure | 22:31 |
| sphoorti | my email id is sphoorti.joglekar@gmail.com | 22:31 |
| sphoorti | even i ll grab some sleep.. its 4 am here | 22:32 |
| sphoorti | thank you eglynn for all the help :) | 22:32 |
| sphoorti | eglynn, would you be on irc tomorrow? | 22:33 |
| *** thomasem has quit IRC | 22:34 | |
| eglynn | sphoorti: I'll be on & off IRC tmrw, mostly off TBH | 22:35 |
| eglynn | sphoorti: then travelling to HK Sunday | 22:36 |
| sphoorti | okay eglynn | 22:36 |
| sphoorti | how should i get going with this bug now eglynn ? | 22:37 |
| sphoorti | thomasem would be around? | 22:37 |
| sphoorti | on the weekend? | 22:37 |
| *** SergeyLukjanov has quit IRC | 23:20 | |
| *** SergeyLukjanov has joined #openstack-metering | 23:35 | |
| *** SergeyLukjanov is now known as _SergeyLukjanov | 23:37 | |
| *** _SergeyLukjanov has quit IRC | 23:37 | |
| *** SergeyLukjanov has joined #openstack-metering | 23:41 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!