*** eghobo has joined #openstack-containers | 00:04 | |
*** sdake_ has joined #openstack-containers | 00:06 | |
*** sdake has quit IRC | 00:10 | |
*** eghobo has quit IRC | 00:16 | |
*** rongze_ has quit IRC | 00:26 | |
*** jay-lau-513 has quit IRC | 00:26 | |
*** sdake has joined #openstack-containers | 00:32 | |
*** sdake_ has quit IRC | 00:35 | |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/magnum: Add netaddr to requirements https://review.openstack.org/189031 | 00:44 |
---|---|---|
*** kebray has joined #openstack-containers | 00:48 | |
*** kebray has quit IRC | 00:49 | |
*** jjlehr has quit IRC | 00:55 | |
*** sdake_ has joined #openstack-containers | 01:06 | |
*** dims__ has quit IRC | 01:06 | |
*** sdake__ has joined #openstack-containers | 01:08 | |
*** sdake has quit IRC | 01:09 | |
*** sdake__ is now known as sdake | 01:09 | |
*** sdake_ has quit IRC | 01:13 | |
*** erkules_ has joined #openstack-containers | 01:32 | |
*** eliqiao1 has quit IRC | 01:34 | |
*** erkules has quit IRC | 01:35 | |
madhuri | sdake, hi, did you see zaneb? | 01:37 |
madhuri | I want that patch to land soon | 01:37 |
*** eliqiao has joined #openstack-containers | 01:37 | |
sdake | link plz | 01:41 |
sdake | no didn't see | 01:41 |
openstackgerrit | Merged openstack/magnum: Add netaddr to requirements https://review.openstack.org/189031 | 01:43 |
*** sdake_ has joined #openstack-containers | 01:43 | |
*** sdake has quit IRC | 01:46 | |
*** sdake has joined #openstack-containers | 01:54 | |
*** sdake_ has quit IRC | 01:58 | |
*** dims_ has joined #openstack-containers | 01:58 | |
*** Kennan2 has joined #openstack-containers | 02:03 | |
*** dims_ has quit IRC | 02:03 | |
*** Kennan has quit IRC | 02:04 | |
*** sthillma has joined #openstack-containers | 02:10 | |
*** sthillma_ has joined #openstack-containers | 02:11 | |
*** sthillma has quit IRC | 02:15 | |
*** sthillma_ is now known as sthillma | 02:15 | |
*** kebray has joined #openstack-containers | 02:24 | |
*** sdake_ has joined #openstack-containers | 02:25 | |
openstackgerrit | Eli Qiao proposed openstack/magnum: WIP: Add periodict task support for to rpc service https://review.openstack.org/187090 | 02:27 |
openstackgerrit | Eli Qiao proposed openstack/magnum: WIP: Add periodic task to bay conductor https://review.openstack.org/187114 | 02:27 |
madhuri | sdake, This one https://review.openstack.org/#/c/188059/ | 02:28 |
*** hongbin_desktop has quit IRC | 02:29 | |
*** sdake has quit IRC | 02:29 | |
*** sthillma has quit IRC | 02:30 | |
*** sdake has joined #openstack-containers | 02:44 | |
*** sdake_ has quit IRC | 02:48 | |
*** julim has joined #openstack-containers | 02:50 | |
*** eghobo has joined #openstack-containers | 02:54 | |
*** dims_ has joined #openstack-containers | 03:03 | |
sdake | madhuri ping re zane'bs patch - got a link? | 03:04 |
*** eghobo has quit IRC | 03:07 | |
madhuri | I shared the link | 03:08 |
madhuri | https://review.openstack.org/#/c/188059/ | 03:08 |
*** dims_ has quit IRC | 03:09 | |
madhuri | sdake, around? | 03:13 |
sdake | sure what do you need from me madhuri | 03:14 |
*** kebray has quit IRC | 03:14 | |
sdake | i looked at bug, looks like waiting on action from zaneb | 03:14 |
openstackgerrit | yuntongjin proposed openstack/magnum: Add support for API microversions https://review.openstack.org/184975 | 03:14 |
sdake | bug/review | 03:14 |
madhuri | Yes | 03:14 |
sdake | you want me to ping zaneb then? | 03:14 |
*** kebray has joined #openstack-containers | 03:15 | |
madhuri | No no | 03:15 |
madhuri | Leave that review | 03:15 |
madhuri | I want to discuss about the tls support | 03:15 |
sdake | i need more punishment, shoot ;) | 03:16 |
*** vilobhmm has joined #openstack-containers | 03:16 | |
madhuri | I configures kubernetes-apiserver with certificate and keys | 03:16 |
madhuri | It started well | 03:16 |
madhuri | But it seems the apiserver listens on different ports for secure and insecure connection | 03:16 |
madhuri | I also remember I read it in their docs | 03:17 |
madhuri | The apiserver has 3 ports | 03:17 |
madhuri | One for secure connection, second for insecure connection and third for read-only insecure | 03:18 |
*** snrism has joined #openstack-containers | 03:19 | |
sdake | ok got that | 03:20 |
sdake | the problem is which? | 03:20 |
madhuri | If you wanna have a look http://paste.openstack.org/show/272770/ | 03:21 |
madhuri | sdake, I have my lunch time now | 03:21 |
madhuri | Sorry | 03:21 |
madhuri | But I will be back after an hr | 03:22 |
sdake | enjoy | 03:22 |
madhuri | Lunch timing is fixed | 03:22 |
sdake | too late to look at reviews atm | 03:22 |
sdake | 9pm time to eat soon :) | 03:22 |
*** brendenblanco has quit IRC | 03:27 | |
*** bradjones|away has quit IRC | 03:27 | |
*** brendenblanco has joined #openstack-containers | 03:28 | |
*** bradjones has joined #openstack-containers | 03:28 | |
*** bradjones has quit IRC | 03:28 | |
*** bradjones has joined #openstack-containers | 03:28 | |
*** julim has quit IRC | 03:31 | |
openstackgerrit | Hongbin Lu proposed openstack/magnum: Initial Heat template for Mesos https://review.openstack.org/189179 | 03:44 |
openstackgerrit | Hongbin Lu proposed openstack/magnum: WIP: Elements for building Mesos image https://review.openstack.org/189180 | 03:44 |
*** coolsvap|afk is now known as coolsvap | 03:44 | |
*** eghobo has joined #openstack-containers | 03:53 | |
*** eghobo has quit IRC | 03:56 | |
*** eghobo has joined #openstack-containers | 04:03 | |
madhuri | Hi sdake | 04:14 |
sdake | shoot | 04:14 |
madhuri | Ok | 04:15 |
madhuri | So after configuring apiserver with cert | 04:15 |
madhuri | I tried to run a command, but it failed | 04:15 |
madhuri | Did you see the paste? | 04:17 |
madhuri | Here is the error http://paste.openstack.org/show/272925/ | 04:18 |
madhuri | I also noticed that the URL still doesn't have https | 04:18 |
*** unicell1 has joined #openstack-containers | 04:31 | |
*** achanda has joined #openstack-containers | 04:33 | |
*** unicell has quit IRC | 04:33 | |
*** eghobo_ has joined #openstack-containers | 04:33 | |
*** eghobo has quit IRC | 04:37 | |
*** Drago has quit IRC | 04:40 | |
*** eghobo has joined #openstack-containers | 04:40 | |
*** eghobo_ has quit IRC | 04:41 | |
*** achanda has quit IRC | 04:55 | |
*** kebray has quit IRC | 04:56 | |
sdake | madhuri doesn't kubectl take an argument for target http port and host | 04:58 |
madhuri | Yes -s option | 04:58 |
madhuri | in the paste above I have specified the secure port using -s option | 04:59 |
madhuri | Do you have any idea how do we make kubectl to send https request rather than http? | 05:00 |
*** achanda has joined #openstack-containers | 05:13 | |
*** belmoreira has joined #openstack-containers | 05:20 | |
*** achanda_ has joined #openstack-containers | 05:22 | |
*** achanda has quit IRC | 05:23 | |
eliqiao | sdake: r u around? | 05:27 |
sdake | wound me | 05:28 |
*** achanda_ has quit IRC | 05:28 | |
sdake | madhuri no idea | 05:28 |
sdake | madhuri complain #google-containers in about 8 hours ;) | 05:28 |
eliqiao | sdake: I think the periodic task patches are ready for reviewing.. I wonder if you have time to do a reviewing? | 05:29 |
sdake | 10;30 at night | 05:29 |
sdake | headed to the rack | 05:29 |
sdake | we have a large core team though | 05:29 |
sdake | feel free to submit them, somebody will get to them | 05:30 |
sdake | i am out of the office next week on travel | 05:30 |
eliqiao | sdake: ah okay, I saw you are very active in my day-time , so I though your TZ are closed to me... seems I am very bad. | 05:30 |
*** snrism has quit IRC | 05:30 | |
eliqiao | s/bad/wrong... | 05:30 |
sdake | its ok I have a bad habit of living on irc | 05:31 |
eliqiao | sdake: yeah , cool, thanks . good team :) | 05:31 |
eliqiao | you working so hard .. | 05:31 |
sdake | more like playing | 05:31 |
eliqiao | sdake: have a good travel ;) | 05:32 |
*** vilobhmm has quit IRC | 05:32 | |
sdake | thanks | 05:32 |
*** apuimedo has joined #openstack-containers | 05:37 | |
*** eghobo_ has joined #openstack-containers | 05:38 | |
*** vilobhmm has joined #openstack-containers | 05:39 | |
*** eghobo has quit IRC | 05:41 | |
*** eghobo has joined #openstack-containers | 05:46 | |
*** eghobo_ has quit IRC | 05:47 | |
*** Kennan2 has quit IRC | 05:47 | |
*** rongze has joined #openstack-containers | 05:47 | |
*** Kennan has joined #openstack-containers | 05:48 | |
*** destiny has joined #openstack-containers | 06:02 | |
*** belmoreira has quit IRC | 06:06 | |
*** snrism has joined #openstack-containers | 06:18 | |
*** achanda has joined #openstack-containers | 06:19 | |
*** jay-lau-513 has joined #openstack-containers | 06:22 | |
*** snrism_ has joined #openstack-containers | 06:26 | |
*** snrism has quit IRC | 06:26 | |
*** BertrandN has joined #openstack-containers | 06:34 | |
openstackgerrit | Eli Qiao proposed openstack/magnum: Add periodict task support for to rpc service https://review.openstack.org/187090 | 06:35 |
*** nshaikh has joined #openstack-containers | 06:43 | |
*** tobe has joined #openstack-containers | 06:45 | |
openstackgerrit | Baohua Yang proposed openstack/magnum: Fix Bug #1462887 https://review.openstack.org/189203 | 06:59 |
openstack | bug 1462887 in Magnum "The PodFactory base class inherits from the ContainerBase Class directory" [Undecided,New] https://launchpad.net/bugs/1462887 - Assigned to Baohua Yang (yangbaohua) | 06:59 |
*** vilobhmm has quit IRC | 07:02 | |
*** achanda has quit IRC | 07:02 | |
*** suro-patz has joined #openstack-containers | 07:02 | |
*** snrism_ has quit IRC | 07:03 | |
*** achanda has joined #openstack-containers | 07:04 | |
*** suro-patz has quit IRC | 07:11 | |
*** suro-patz has joined #openstack-containers | 07:12 | |
*** snrism has joined #openstack-containers | 07:13 | |
*** eghobo has quit IRC | 07:16 | |
*** achanda has quit IRC | 07:17 | |
*** rongze has quit IRC | 07:39 | |
*** snrism has quit IRC | 07:39 | |
*** snrism has joined #openstack-containers | 07:40 | |
*** snrism has quit IRC | 07:46 | |
*** snrism has joined #openstack-containers | 07:46 | |
*** ahcorporto has joined #openstack-containers | 08:00 | |
*** belmoreira has joined #openstack-containers | 08:00 | |
*** suro-patz has quit IRC | 08:02 | |
*** yuanying has quit IRC | 08:13 | |
*** achanda has joined #openstack-containers | 08:14 | |
*** dims_ has joined #openstack-containers | 08:28 | |
*** achanda has quit IRC | 08:29 | |
*** achanda has joined #openstack-containers | 08:30 | |
*** rongze has joined #openstack-containers | 08:31 | |
*** dims_ has quit IRC | 08:33 | |
*** achanda has quit IRC | 08:35 | |
*** achanda has joined #openstack-containers | 08:49 | |
*** achanda has quit IRC | 08:56 | |
*** achanda has joined #openstack-containers | 08:57 | |
*** achanda has quit IRC | 09:03 | |
*** achanda has joined #openstack-containers | 09:31 | |
*** achanda has quit IRC | 09:33 | |
*** achanda has joined #openstack-containers | 09:34 | |
*** kbyrne has quit IRC | 09:45 | |
*** snrism has quit IRC | 09:48 | |
*** kbyrne has joined #openstack-containers | 09:48 | |
*** achanda_ has joined #openstack-containers | 09:51 | |
*** achanda has quit IRC | 09:53 | |
openstackgerrit | Tom Cammann proposed openstack/magnum: Fix ignored E121 to E125 pep 8 rules https://review.openstack.org/189242 | 09:57 |
*** sdake has quit IRC | 10:00 | |
*** openstackgerrit has quit IRC | 10:09 | |
*** dims_ has joined #openstack-containers | 10:09 | |
*** openstackgerrit has joined #openstack-containers | 10:09 | |
*** snrism has joined #openstack-containers | 10:17 | |
*** snrism has quit IRC | 10:23 | |
*** achanda_ has quit IRC | 10:28 | |
diga | hongbin: Hi | 10:29 |
*** achanda has joined #openstack-containers | 10:35 | |
*** achanda has quit IRC | 10:42 | |
*** achanda has joined #openstack-containers | 10:43 | |
*** achanda has quit IRC | 10:45 | |
*** achanda has joined #openstack-containers | 10:46 | |
*** coolsvap is now known as coolsvap|afk | 10:47 | |
*** snrism has joined #openstack-containers | 10:51 | |
*** achanda has quit IRC | 10:52 | |
openstackgerrit | Tom Cammann proposed openstack/magnum: Fix ignored E121 to E125 pep 8 rules https://review.openstack.org/189242 | 10:55 |
*** snrism has quit IRC | 10:56 | |
*** ubuntu has joined #openstack-containers | 10:59 | |
*** ubuntu is now known as tcammann | 11:00 | |
*** jay-lau-513 has quit IRC | 11:07 | |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/python-magnumclient: Sync from latest oslo-incubator https://review.openstack.org/189125 | 11:09 |
*** madhuri_ has joined #openstack-containers | 11:09 | |
openstackgerrit | Bradley Jones proposed openstack/magnum: Web Interface for Magnum in Horizon https://review.openstack.org/188958 | 11:23 |
*** tobe has quit IRC | 11:26 | |
*** alex_klimov has joined #openstack-containers | 11:46 | |
*** jjlehr has joined #openstack-containers | 12:37 | |
*** jjlehr has quit IRC | 12:43 | |
*** achanda has joined #openstack-containers | 12:52 | |
*** achanda has quit IRC | 13:20 | |
*** achanda has joined #openstack-containers | 13:21 | |
*** rlrevell has joined #openstack-containers | 13:21 | |
*** rlrevell has quit IRC | 13:23 | |
*** achanda has quit IRC | 13:26 | |
*** rpothier has joined #openstack-containers | 13:27 | |
*** ahcorporto has quit IRC | 13:33 | |
*** rlrevell has joined #openstack-containers | 13:35 | |
*** adrian_otto has joined #openstack-containers | 13:36 | |
*** dboik has quit IRC | 13:36 | |
*** julim has joined #openstack-containers | 13:36 | |
*** sdake has joined #openstack-containers | 13:48 | |
*** jjlehr has joined #openstack-containers | 13:50 | |
*** dboik has joined #openstack-containers | 13:57 | |
*** sdake_ has joined #openstack-containers | 14:00 | |
*** sdake has quit IRC | 14:04 | |
*** logan2 has quit IRC | 14:12 | |
*** achanda has joined #openstack-containers | 14:12 | |
*** logan2 has joined #openstack-containers | 14:13 | |
*** achanda has quit IRC | 14:18 | |
*** nshaikh has left #openstack-containers | 14:19 | |
*** hongbin has joined #openstack-containers | 14:21 | |
*** Drago has joined #openstack-containers | 14:27 | |
*** Drago has quit IRC | 14:28 | |
*** Drago has joined #openstack-containers | 14:28 | |
*** unicell has joined #openstack-containers | 14:31 | |
*** unicell1 has quit IRC | 14:31 | |
*** adrian_otto has quit IRC | 14:42 | |
*** madhuri_ has quit IRC | 14:44 | |
*** achanda has joined #openstack-containers | 14:56 | |
openstackgerrit | Zane Bitter proposed openstack/magnum: Eliminate eval from swagger.py in k8sclient https://review.openstack.org/188059 | 14:57 |
*** achanda has quit IRC | 15:02 | |
*** belmoreira has quit IRC | 15:06 | |
*** snrism has joined #openstack-containers | 15:10 | |
*** suro-patz has joined #openstack-containers | 15:10 | |
*** adrian_otto has joined #openstack-containers | 15:11 | |
*** suro-patz1 has joined #openstack-containers | 15:15 | |
*** snrism has quit IRC | 15:15 | |
*** suro-patz has quit IRC | 15:17 | |
*** kebray has joined #openstack-containers | 15:21 | |
*** adrian_otto has quit IRC | 15:30 | |
*** BertrandN has quit IRC | 15:31 | |
*** suro-patz1 has quit IRC | 15:37 | |
*** Drago has quit IRC | 15:38 | |
*** dane_leblanc has joined #openstack-containers | 15:38 | |
*** unicell has quit IRC | 15:41 | |
*** sdake_ has quit IRC | 15:42 | |
*** rpothier has quit IRC | 15:47 | |
*** sdake has joined #openstack-containers | 15:47 | |
*** snrism has joined #openstack-containers | 15:48 | |
*** sdake_ has joined #openstack-containers | 15:48 | |
*** sdake has quit IRC | 15:52 | |
*** sdake_ is now known as sdake | 15:56 | |
*** daneyon has joined #openstack-containers | 15:56 | |
*** eghobo has joined #openstack-containers | 15:58 | |
*** rongze has quit IRC | 15:58 | |
*** eghobo has quit IRC | 15:58 | |
*** rongze has joined #openstack-containers | 15:58 | |
*** eghobo has joined #openstack-containers | 16:03 | |
*** mfalatic has joined #openstack-containers | 16:04 | |
*** eghobo has quit IRC | 16:08 | |
*** jay-lau-513 has joined #openstack-containers | 16:10 | |
*** eghobo has joined #openstack-containers | 16:10 | |
*** daneyon_ has joined #openstack-containers | 16:12 | |
*** apuimedo has quit IRC | 16:12 | |
*** daneyon has quit IRC | 16:14 | |
*** achanda has joined #openstack-containers | 16:16 | |
*** unicell has joined #openstack-containers | 16:29 | |
*** rlrevell1 has joined #openstack-containers | 16:31 | |
*** rlrevell has quit IRC | 16:32 | |
*** Drago has joined #openstack-containers | 16:38 | |
*** dane_leblanc has quit IRC | 16:38 | |
*** Drago has quit IRC | 16:39 | |
*** Drago has joined #openstack-containers | 16:39 | |
*** achanda has quit IRC | 16:41 | |
*** kebray has quit IRC | 16:42 | |
*** belmoreira has joined #openstack-containers | 16:44 | |
*** achanda has joined #openstack-containers | 16:44 | |
*** dane_leblanc has joined #openstack-containers | 16:45 | |
*** Tango has joined #openstack-containers | 16:46 | |
*** alex_klimov has quit IRC | 16:55 | |
*** snrism has quit IRC | 17:00 | |
*** dane_leblanc has quit IRC | 17:02 | |
*** vilobhmm has joined #openstack-containers | 17:03 | |
*** jjlehr has quit IRC | 17:04 | |
*** daneyon has joined #openstack-containers | 17:05 | |
*** daneyon_ has quit IRC | 17:07 | |
*** dims has joined #openstack-containers | 17:07 | |
*** dims_ has quit IRC | 17:10 | |
*** bradjones has quit IRC | 17:10 | |
*** bradjones has joined #openstack-containers | 17:11 | |
*** bradjones has quit IRC | 17:11 | |
*** bradjones has joined #openstack-containers | 17:11 | |
*** harshs has joined #openstack-containers | 17:15 | |
*** harshs has quit IRC | 17:15 | |
*** erw has quit IRC | 17:18 | |
*** erw has joined #openstack-containers | 17:18 | |
*** ybathia has joined #openstack-containers | 17:21 | |
*** Marga_ has joined #openstack-containers | 17:23 | |
*** rongze has quit IRC | 17:25 | |
*** dane_leblanc has joined #openstack-containers | 17:25 | |
*** harshs has joined #openstack-containers | 17:26 | |
*** Marga_ has quit IRC | 17:27 | |
*** Marga_ has joined #openstack-containers | 17:27 | |
*** pradk has joined #openstack-containers | 17:30 | |
*** jjlehr has joined #openstack-containers | 17:35 | |
*** rlrevell1 has quit IRC | 17:44 | |
*** daneyon_ has joined #openstack-containers | 17:45 | |
*** vahidh has quit IRC | 17:45 | |
*** vahidh has joined #openstack-containers | 17:47 | |
*** daneyon has quit IRC | 17:48 | |
*** eliqiao has quit IRC | 17:51 | |
*** rlrevell has joined #openstack-containers | 17:51 | |
*** snrism has joined #openstack-containers | 17:52 | |
*** snrism has quit IRC | 17:52 | |
*** snrism_ has joined #openstack-containers | 17:52 | |
*** sthillma has joined #openstack-containers | 17:52 | |
*** rlrevell has quit IRC | 17:52 | |
*** rlrevell has joined #openstack-containers | 17:52 | |
*** eliqiao has joined #openstack-containers | 17:57 | |
*** achanda_ has joined #openstack-containers | 17:59 | |
*** dontalton has joined #openstack-containers | 18:00 | |
*** achanda has quit IRC | 18:02 | |
*** sdake_ has joined #openstack-containers | 18:02 | |
*** sdake has quit IRC | 18:02 | |
*** sdake has joined #openstack-containers | 18:02 | |
*** sdake_ has quit IRC | 18:06 | |
*** juggler has joined #openstack-containers | 18:06 | |
*** openstackgerrit has quit IRC | 18:09 | |
*** openstackgerrit has joined #openstack-containers | 18:09 | |
*** jruano has joined #openstack-containers | 18:15 | |
*** rpothier has joined #openstack-containers | 18:20 | |
*** daneyon_ has quit IRC | 18:26 | |
*** achanda_ has quit IRC | 18:32 | |
*** eliqiao has quit IRC | 18:37 | |
*** jjlehr has quit IRC | 18:37 | |
*** Marga_ has quit IRC | 18:40 | |
*** achanda has joined #openstack-containers | 18:41 | |
*** eliqiao has joined #openstack-containers | 18:41 | |
*** achanda has quit IRC | 18:46 | |
*** jjlehr has joined #openstack-containers | 18:46 | |
*** Marga_ has joined #openstack-containers | 18:47 | |
*** prad__ has joined #openstack-containers | 19:14 | |
*** prad__ has quit IRC | 19:23 | |
*** pradk has quit IRC | 19:28 | |
*** dane_leblanc has quit IRC | 19:28 | |
*** harshs has quit IRC | 19:37 | |
*** harshs has joined #openstack-containers | 19:40 | |
*** alex_klimov has joined #openstack-containers | 19:56 | |
*** Marga_ has quit IRC | 19:57 | |
*** kebray has joined #openstack-containers | 20:03 | |
*** snrism_ has quit IRC | 20:17 | |
*** eghobo has quit IRC | 20:22 | |
*** rpothier has quit IRC | 20:23 | |
*** snrism has joined #openstack-containers | 20:33 | |
*** apuimedo has joined #openstack-containers | 20:49 | |
*** achanda has joined #openstack-containers | 20:51 | |
*** dane_leblanc has joined #openstack-containers | 20:53 | |
*** Marga_ has joined #openstack-containers | 20:54 | |
*** belmoreira has quit IRC | 20:56 | |
*** achanda has quit IRC | 20:56 | |
*** pradk has joined #openstack-containers | 20:57 | |
*** Marga_ has quit IRC | 20:59 | |
*** Marga_ has joined #openstack-containers | 20:59 | |
*** rlrevell has quit IRC | 20:59 | |
dane_leblanc | Hello, I'm new to Magnum, and I'm trying to follow the quick-start guide (https://github.com/openstack/magnum/blob/master/doc/source/dev/dev-quickstart.rst) to set up a swarm bay, without much luck. When I try to create a bay, it seems forever stuck in CREATE_IN_PROGRESS state. Can anyone suggest some debugging steps? | 20:59 |
*** abe_music has quit IRC | 21:13 | |
sdake | dane_leblanc i am not intimately familiar with the swarm bay type, but I can walk you thorugh debug | 21:16 |
sdake | run heat stack-list | 21:16 |
sdake | this will givey ou a list of stacks running | 21:16 |
sdake | one of them mpas to the gap | 21:16 |
sdake | gap/bay | 21:16 |
*** julim has quit IRC | 21:16 | |
sdake | brain crossed wires there | 21:16 |
sdake | you can use heat event-list bay-id | 21:16 |
sdake | this will tell you where heat is stuck | 21:16 |
sdake | if you could paste that output in a pastebin tool I can help debug further | 21:17 |
sdake | my speculation is your heat-api-cfn process is not running or cannot be contacted from the vm because of communication problems with neutron config | 21:18 |
sdake | i expect wwe will see heat is jammed up at the wait condition | 21:18 |
*** sdake_ has joined #openstack-containers | 21:19 | |
dane_leblanc | sdake: http://paste.openstack.org/show/275390/ | 21:20 |
dane_leblanc | sdake: Here is the heat event-list output: http://paste.openstack.org/show/275391/ | 21:22 |
*** sdake has quit IRC | 21:23 | |
*** kebray has quit IRC | 21:24 | |
sdake_ | | agent_wait_handle | 88e62362-07bc-4ad1-be12-6642c77e0e13 | Signal: status:SUCCESS reason:Setup complete | SIGNAL_COMPLETE | 2015-06-08T20:32:42Z | | 21:26 |
sdake_ | that violates my speculation | 21:26 |
sdake_ | anything in the magnum conductor logs? | 21:27 |
sdake_ | or in the heat engine logs | 21:27 |
sdake_ | apmelton ping ^ | 21:27 |
mfalatic | If I may add, what are the basic characteristics of the server you're attempting this on? Memory, disk, etc. | 21:27 |
sdake_ | oh ya good point mfalatic are you running in a vm | 21:28 |
sdake_ | dane_leblanc run heat resource-list stack-id | 21:29 |
dane_leblanc | This is on a UCS server, 256G disk | 21:30 |
mfalatic | memory? | 21:30 |
dane_leblanc | Looks like 32G memory | 21:32 |
sdake_ | need to see a past eof resource-list to further diagnose | 21:32 |
sdake_ | running on bare metal then? | 21:32 |
dane_leblanc | Yes | 21:33 |
mfalatic | Sounds like no shortage of space and memory then. | 21:33 |
dane_leblanc | This is behind a corporate firewall, don't know if external access could be an issue? | 21:34 |
sdake_ | which base os are you using? oreos or fedora? | 21:34 |
sdake_ | the vms need external access | 21:35 |
sdake_ | but i've never debugged swarm, would like to continue ;) | 21:35 |
dane_leblanc | Resource-list is here: http://paste.openstack.org/show/275432/ | 21:35 |
dane_leblanc | Base OS is ubuntu | 21:36 |
mfalatic | 14.04? | 21:37 |
dane_leblanc | YEs | 21:37 |
*** Marga_ has quit IRC | 21:37 | |
mfalatic | Devstack branch is master or something else? | 21:37 |
dane_leblanc | Yes, devstack is master | 21:37 |
*** jruano has quit IRC | 21:38 | |
sdake_ | ca nyou create a kubernetes bay? | 21:40 |
sdake_ | dane_leblanc run heat resource-show master_wait_condition | 21:43 |
dane_leblanc | Yes, I was able to create a Kubernetes bay, but I was getting a 500 error when I tried creating a pod | 21:43 |
sdake_ | ok so problem with template and not your enviornment | 21:43 |
sdake_ | which base os are you using, fedora or coreos? | 21:43 |
dane_leblanc | Ubuntu 14.04 desktop | 21:43 |
sdake_ | nah i mean for the vms | 21:43 |
dane_leblanc | Fedora | 21:44 |
sdake_ | is your kubernetes bay still running? | 21:44 |
dane_leblanc | Fedora atomic | 21:44 |
dane_leblanc | No, I shut down the kubernetes, just trying to isolate one bay type at a time | 21:44 |
sdake_ | well apparently both ar ebroke nfor you :) | 21:45 |
sdake_ | my devstack is bust atm | 21:45 |
sdake_ | so I can't see the kube output | 21:45 |
sdake_ | can you start a new bay of kubernetes while keeping your existing bay at bay :) | 21:45 |
dane_leblanc | For "vms need external access", what needs to be opened? | 21:45 |
sdake_ | the docker cdn | 21:45 |
sdake_ | i don't recall which port docker runs on | 21:46 |
dane_leblanc | Have to step out for a couple of minutes to exchange car keys with my wife, be right back | 21:46 |
sdake_ | yar | 21:46 |
*** dboik has quit IRC | 21:46 | |
sdake_ | so steps to take - run heat resource-show master_wait_condition | 21:47 |
sdake_ | (you will need to file a bug for this, its outside my expertise to fix this problem) | 21:47 |
sdake_ | but lets get the info needed for hte bug report | 21:47 |
sdake_ | and apmelton can tackle it | 21:48 |
*** snrism has quit IRC | 21:48 | |
*** snrism has joined #openstack-containers | 21:50 | |
*** snrism has quit IRC | 21:50 | |
*** achanda has joined #openstack-containers | 21:51 | |
dane_leblanc | Okay, I'm back (sorry, my wife needed to take our "dog bus") | 21:56 |
sdake_ | dane_leblanc I wont even ask :) | 21:56 |
dane_leblanc | It's the car we let the dogs ride in. | 21:56 |
sdake_ | so I am pretty sure the problem is your ports 2375 and 2376 (docker cdn) are not open for reading from the internets | 21:56 |
*** achanda has quit IRC | 21:57 | |
sdake_ | https://github.com/openstack/magnum/blob/master/magnum/templates/docker-swarm/fragments/write-swarm-agent-service.yaml#L17 | 21:57 |
dane_leblanc | So it's a problem with those ports on my setup, and not a bug? | 21:58 |
sdake_ | possibly | 21:58 |
sdake_ | lets debug kubernetes | 21:58 |
sdake_ | I know much mor eabout that ;) | 21:58 |
dane_leblanc | okay, awesome | 21:59 |
sdake_ | docker pulls the swarm agent and master via the docker registry | 21:59 |
*** achanda has joined #openstack-containers | 21:59 | |
sdake_ | if docker can't pull it won't signal the wait condition of success | 21:59 |
dane_leblanc | Ahhh. | 21:59 |
sdake_ | I'm not sure what precisely teh deal was with teh signalling but not all signals were received | 21:59 |
sdake_ | that is why in resource-show you saw some uncompleted resources | 21:59 |
sdake_ | it times out after 6000 seconds | 21:59 |
sdake_ | and then will say "create_failed" :) | 22:00 |
sdake_ | but i know kubernetes inside and out lets atleast get that working | 22:00 |
sdake_ | note for kubernetes to work it also uses docker pull on same ports i believe | 22:00 |
sdake_ | the folks from china that work on magnum suffer this problem all the time as a result of the GFW | 22:02 |
sdake_ | this may be way you got a 500 error in pod creation | 22:03 |
sdake_ | why | 22:03 |
sdake_ | i'd like to knwo for sure - because if that is not the cause it means a regression in teh code base | 22:03 |
dane_leblanc | Kubernetes bay create in progress... | 22:06 |
sdake_ | when it finishes, scp the pod files you intended to launch into the master node | 22:07 |
sdake_ | scp file.yml minion@floating-ip | 22:07 |
*** achanda has quit IRC | 22:08 | |
*** pradk has quit IRC | 22:08 | |
sdake_ | you can get the floating ip i think bybay-show or nova list | 22:08 |
dane_leblanc | The pod yaml files would be the --manifest file, redis-master.yml in this example? | 22:08 |
sdake_ | yup | 22:09 |
sdake_ | ocne you have scp'ed the files to /tmp or somewhere approrpaite | 22:10 |
sdake_ | ssh into the master | 22:10 |
sdake_ | and run kubectl get minions and paste output | 22:10 |
*** jjlehr has quit IRC | 22:11 | |
*** muralia has quit IRC | 22:16 | |
sdake_ | dane_leblanc bay created yet? | 22:21 |
dane_leblanc | Yes, just collecting the get minions | 22:21 |
sdake_ | cool | 22:21 |
dane_leblanc | 2 minions are ready: http://paste.openstack.org/show/275507/ | 22:21 |
sdake_ | fantastic | 22:22 |
sdake_ | that tells you your devstack is working correctly ;) | 22:22 |
sdake_ | and magnum did the right thing | 22:22 |
sdake_ | and kubernetes cooperated | 22:22 |
dane_leblanc | Nice | 22:22 |
sdake_ | kubernetes is a highly complex beast | 22:22 |
sdake_ | if get minions says "Ready" it means all went right ;) | 22:22 |
sdake_ | if it says "NotReady" it means there is a regression in the code base in magnum | 22:22 |
dane_leblanc | So should I try to create a pod? | 22:23 |
sdake_ | from within the vm yes | 22:23 |
sdake_ | kubectl create file.yaml | 22:23 |
sdake_ | does this display any output? | 22:24 |
dane_leblanc | Think I need a -f option | 22:25 |
sdake_ | ok | 22:25 |
sdake_ | add er in | 22:25 |
dane_leblanc | No output from that command | 22:25 |
sdake_ | kubectl get pods | 22:25 |
sdake_ | paste output | 22:26 |
dane_leblanc | Looks like a healthy output | 22:26 |
sdake_ | login to the node where the pod was started | 22:26 |
sdake_ | via ssh | 22:26 |
sdake_ | you wil have to do from outside the vm | 22:26 |
sdake_ | you will have to coorelate the internal ip with the external floating ip | 22:26 |
dane_leblanc | http://paste.openstack.org/show/275510/ | 22:26 |
sdake_ | in nova list, you will see a node 10.0.0.5 which has a floating ip | 22:27 |
dane_leblanc | right | 22:27 |
sdake_ | ssh minion@floating-ip-of-10.0.0.5 | 22:27 |
sdake_ | the internal vms don't set up cross-keys | 22:27 |
sdake_ | they probably should but they dont | 22:27 |
sdake_ | if you were in the summit fishbowl sessions, this is the native api support we were talkingabout (usingkubectl vs magnum pod-create) | 22:29 |
dane_leblanc | Okay, I'm in that minion | 22:29 |
sdake_ | docker images into paste | 22:29 |
dane_leblanc | I'm not seeing any images... will paste output. | 22:30 |
dane_leblanc | http://paste.openstack.org/show/275529/ | 22:30 |
sdake_ | docker pull centos | 22:31 |
dane_leblanc | Are the images downloaded from the repo? | 22:31 |
sdake_ | they are downloaded from the dockerhub cdn | 22:31 |
sdake_ | i need to understand what errors you get when this happens - it helps us make magnum more resilient | 22:31 |
sdake_ | sorry for experimenting on your machine :) | 22:32 |
dane_leblanc | No worries at all! At least I feel like I'm making progress! | 22:32 |
sdake_ | you got devstack running properly count that as serious progress ;-) | 22:33 |
sdake_ | did that docker pull do anything | 22:33 |
dane_leblanc | It's still working on it. How long does it normally take? | 22:34 |
sdake_ | it should be printing things out by now | 22:34 |
dane_leblanc | FATAL, connection timed out | 22:34 |
sdake_ | go back to the master node | 22:35 |
dane_leblanc | Looks like more firewall woes | 22:35 |
dane_leblanc | Okay, I'm on the master | 22:35 |
sdake_ | kubectl get pods | 22:35 |
sdake_ | paste output | 22:36 |
dane_leblanc | http://paste.openstack.org/show/275530/ | 22:36 |
sdake_ | ok first action | 22:37 |
sdake_ | file bug with the kubernetes upstream indicating when a firewall blocks docker pull from executing, the pod status stays in "PENDING" rather then entering an error state | 22:37 |
sdake_ | maybe they will be kind enough to fix that problem | 22:37 |
dane_leblanc | Okay, will do | 22:38 |
sdake_ | now kubectl delete -f manifest.yaml | 22:38 |
sdake_ | a docker pull failureis fatal imo :0 | 22:38 |
dane_leblanc | Right | 22:38 |
sdake_ | i guess it could be retried | 22:39 |
sdake_ | but eventually k8s needs to give up and tell the user "your network is bust" vs leaving people guessing | 22:39 |
sdake_ | after that kubectl delete finishes the job make sure with kubectl get minions nothing is running | 22:39 |
dane_leblanc | After kubectl delete, 'kubectl get pods' shows empty list | 22:40 |
sdake_ | ok create the pod one mor etime | 22:40 |
sdake_ | and echo $? | 22:40 |
dane_leblanc | 'kubectl get minions' shows minions still alive | 22:40 |
sdake_ | sorry kubectl get pods above 4 lines | 22:41 |
sdake_ | too many abstractions in my brain ;) | 22:41 |
sdake_ | minions should still be alive | 22:41 |
sdake_ | i want to retry the kubectl create pod operatioin and print the exit code of kubectl | 22:41 |
*** apuimedo has quit IRC | 22:42 | |
dane_leblanc | 0 | 22:43 |
sdake_ | expected | 22:43 |
sdake_ | delete the pod | 22:43 |
dane_leblanc | Oh wait, hang on a sec | 22:43 |
dane_leblanc | Let me redo that, I had an extra kubectl in there | 22:44 |
dane_leblanc | Yep, 0 result code | 22:44 |
sdake_ | ok delete the pod check its gone | 22:44 |
dane_leblanc | Hmmm... my VNC connection is slow | 22:46 |
dane_leblanc | Okay, empty list for pods | 22:47 |
sdake_ | ok exit vm | 22:47 |
sdake_ | from your bare metal run magnum pod-ccreate -f manifest.yaml | 22:47 |
sdake_ | i think you need to specify a bay uuid as well ;) | 22:47 |
sdake_ | or by name should work | 22:47 |
sdake_ | i can't tell you how long its been since i've hada working devstack | 22:48 |
* sdake_ groans | 22:48 | |
sdake_ | clearly awhile since i don't remember the syntax :( | 22:48 |
*** hongbin has quit IRC | 22:48 | |
sdake_ | hey hongbin | 22:48 |
sdake_ | oh bye hongbin ;) | 22:49 |
dane_leblanc | Got this error for pod-create: "ERROR: invalid syntax (line 2) (HTTP 500)" | 22:49 |
sdake_ | paste pod file | 22:49 |
dane_leblanc | The manifest? | 22:50 |
sdake_ | right | 22:50 |
dane_leblanc | http://paste.openstack.org/show/275591/ | 22:51 |
sdake_ | give me a minute | 22:51 |
dane_leblanc | sure | 22:51 |
sdake_ | at line two add "id: groan" | 22:55 |
sdake_ | between lines 1 and 2 :) | 22:56 |
dane_leblanc | Was just about to ask! | 22:56 |
dane_leblanc | okay | 22:57 |
dane_leblanc | Retry? | 22:57 |
sdake_ | yar | 22:57 |
dane_leblanc | Same error | 22:58 |
dane_leblanc | with (line 2) | 22:58 |
*** harshs has quit IRC | 22:58 | |
dane_leblanc | "ERROR: invalid syntax (line 2) (HTTP 500)" | 22:58 |
sdake_ | punishment for past life events i'm sure | 22:58 |
sdake_ | which tarball of examples did you download | 22:59 |
dane_leblanc | Sounds about right. :) | 22:59 |
dane_leblanc | This was from a kubernetes git clone | 22:59 |
dane_leblanc | git clone https://github.com/GoogleCloudPlatform/kubernetes.git | 23:00 |
dane_leblanc | cd kubernetes/examples/redis/ | 23:00 |
sdake_ | second action - file bug for that problem in magnum | 23:01 |
dane_leblanc | If I were to try this from a VM, would 30G drive and 8G memory work? | 23:01 |
sdake_ | 30g drive might be a little tight | 23:02 |
sdake_ | not sure | 23:02 |
dane_leblanc | I can open up some more, maybe try 50G | 23:02 |
dane_leblanc | So for the magnum bug, this is a problem separate from my firewall issues? | 23:03 |
sdake_ | wget https://github.com/GoogleCloudPlatform/kubernetes/releases/download/v0.15.0/kubernetes.tar.gz | 23:03 |
sdake_ | yup this is a documentation bug | 23:03 |
sdake_ | or an implementation bug depending on your perspective ;) | 23:04 |
dane_leblanc | Bug against the wiki page? | 23:04 |
sdake_ | the developer quickstart guide | 23:04 |
dane_leblanc | Oh, the rst doc | 23:04 |
dane_leblanc | Right | 23:04 |
sdake_ | try that wget | 23:04 |
sdake_ | untar it and try the redis pod in it | 23:04 |
sdake_ | you downloaded 0.18+, fedora image has 0.15 | 23:05 |
sdake_ | world apart in .03 versions | 23:05 |
sdake_ | every time I update the fedora image it cuses major chaos so I try to keep it to a minimum during development ;) | 23:05 |
sdake_ | google shoudl be on version 4.0 of kubernetes or so by now | 23:07 |
sdake_ | but they refuse to pull the trigger on a 1.0 until its "perfect" | 23:07 |
dane_leblanc | Okay, that manifest shows an error, but a more meaningful error: | 23:09 |
dane_leblanc | "ERROR: Field metadata['name'] can't be empty in manifest. (HTTP 400)" | 23:09 |
sdake_ | diff the two manifests | 23:09 |
sdake_ | addthe name field where required | 23:09 |
*** daneyon has joined #openstack-containers | 23:10 | |
dane_leblanc | D'oh, I overwrote the original, let me re-clone that | 23:10 |
sdake_ | paste the diff if you wouldn't mind | 23:11 |
*** daneyon_ has joined #openstack-containers | 23:11 | |
sdake_ | wow talk about changing everything about the manifest | 23:14 |
*** daneyon has quit IRC | 23:15 | |
dane_leblanc | Yeah, no kidding | 23:15 |
sdake_ | ok in the redis directory | 23:15 |
sdake_ | there is a v1beta3 directory | 23:15 |
sdake_ | from the tarball | 23:15 |
sdake_ | run the pod from that directory | 23:15 |
sdake_ | we are running the v1beta3 api in magnum | 23:16 |
dane_leblanc | v1beta3 shows the original error that I was seeing from the git clone | 23:17 |
dane_leblanc | "ERROR: invalid syntax (line 2) (HTTP 500)" | 23:17 |
sdake_ | magnum pod-list | 23:17 |
sdake_ | any output? | 23:17 |
dane_leblanc | Yes! | 23:18 |
sdake_ | ok delete all those pods | 23:18 |
sdake_ | you will have to use uuid unfortunately | 23:18 |
dane_leblanc | Okay, 3 pods are deleted | 23:19 |
sdake_ | create a new pod | 23:19 |
sdake_ | then past eoutput of pod-show on that new pod | 23:19 |
dane_leblanc | http://paste.openstack.org/show/275642/ | 23:20 |
sdake_ | 5 minutes reading code | 23:21 |
sdake_ | ssh into master pls | 23:24 |
sdake_ | rpm -qa | grep kubernetes | 23:24 |
*** yuanying has joined #openstack-containers | 23:25 | |
dane_leblanc | kubernetes-0.15.0-5.fc21.x86_64 | 23:27 |
sdake_ | ins't debugging kubernetes fun - whee | 23:27 |
dane_leblanc | Yes indeed | 23:29 |
*** alex_klimov has quit IRC | 23:29 | |
sdake_ | ok action #2, create bug report with the pod create operation | 23:34 |
sdake_ | ignore previous action #2 | 23:34 |
sdake_ | in the magnum laucnhpad tracker | 23:34 |
sdake_ | and link me the bug when done so I can make it essential | 23:34 |
sdake_ | can you create other types of objects like services and replication controllers? | 23:34 |
* sdake_ swears at swagger some more | 23:35 | |
dane_leblanc | No, I wasn't able to create pods, so couldn't make services and replication controllers. | 23:35 |
sdake_ | did you try? | 23:35 |
sdake_ | one doesnot depend on the other | 23:36 |
dane_leblanc | Oh. Perhaps I should try. :) | 23:36 |
sdake_ | agree :) | 23:36 |
dane_leblanc | What details do I need for the bug, besides that I'm seeing the HTTP 500 error? | 23:37 |
sdake_ | if there is something more meaningful in the conductor log that owuld be helpful | 23:37 |
sdake_ | any sort of trace with teh actual data sent | 23:38 |
sdake_ | I see what the problem is with the code I suspect | 23:38 |
sdake_ | yuanying when does madhuri make it in | 23:38 |
sdake_ | morning btw ;) | 23:39 |
yuanying | what about? | 23:40 |
sdake_ | pod create is busted on master | 23:40 |
madhuri | morning sdake_ yuanying | 23:40 |
sdake_ | hey madhuri | 23:40 |
yuanying | morning | 23:40 |
sdake_ | is pod create busted on master for you? | 23:40 |
madhuri | I haven't checked | 23:41 |
madhuri | Let me check | 23:41 |
sdake_ | can you check plz | 23:41 |
madhuri | What is the error you are getting bdw? | 23:41 |
dane_leblanc | sdake: I'm seeing a similar error for service-create: | 23:41 |
sdake_ | dane_leblanc go ahead and file a bug plz | 23:41 |
dane_leblanc | sdake: Bug for the pod-create? | 23:41 |
yuanying | I will also check it | 23:42 |
sdake_ | yes | 23:42 |
sdake_ | def createPod(self, **kwargs): | 23:42 |
sdake_ | namespaces, str: object name and auth scope, such as for teams and projects (required) | 23:42 |
sdake_ | body, V1beta3_Pod: (required) | 23:42 |
sdake_ | manifest is not of type V1beta3_Pod | 23:42 |
madhuri | For manifest v1beta3, it is succesful | 23:43 |
madhuri | I have checked | 23:43 |
sdake_ | dane_leblanc can yo upaste your error | 23:44 |
sdake_ | dane_leblanc is using v1beta3 redis example | 23:44 |
dane_leblanc | ERROR: invalid syntax (line 2) (HTTP 500) | 23:44 |
madhuri | dane_leblanc, can you please paste the command and output? | 23:45 |
*** dontalton has quit IRC | 23:45 | |
madhuri | Here http://paste.openstack.org/ | 23:46 |
dane_leblanc | http://paste.openstack.org/show/275665/ | 23:46 |
sdake_ | dane try adding --name abc | 23:46 |
sdake_ | dane_leblanc that is ;) | 23:47 |
sdake_ | or did we take that out | 23:47 |
sdake_ | can't remember | 23:47 |
dane_leblanc | You mean add it at line 2 of the manifest file? | 23:48 |
sdake_ | no i mean add to cmd line | 23:48 |
sdake_ | madhuri try a git pull --rebase of master | 23:49 |
sdake_ | with a fresh bay | 23:49 |
yuanying | I have checked at master | 23:49 |
yuanying | succeeded | 23:49 |
sdake_ | same result as madhuri? | 23:49 |
yuanying | http://paste.openstack.org/show/275666/ | 23:49 |
madhuri | No | 23:49 |
sdake_ | your manifest is parsed yuanying dane_leblanc's is not | 23:50 |
sdake_ | how about we paste our pod files for comparison :) | 23:50 |
madhuri | succeeded | 23:50 |
madhuri | Sure | 23:50 |
sdake_ | madhuri using master python-magnumclient? | 23:51 |
madhuri | http://paste.openstack.org/show/275692/ | 23:51 |
madhuri | I guess no | 23:51 |
madhuri | Let me update it | 23:51 |
sdake_ | dane_leblanc diff madhuri's pod vs yours | 23:52 |
madhuri | With master magnumclient and magnum, succeeded | 23:52 |
*** vahidh has quit IRC | 23:52 | |
*** jjlehr has joined #openstack-containers | 23:53 | |
sdake_ | if the pods are the same must be a dependency issue | 23:53 |
madhuri | From looking at the error of dane_leblanc, it seems the yaml has invalid syntax | 23:54 |
sdake_ | it would be dandy to know where that error is origniating from - kubernetse, our rest api or what | 23:54 |
madhuri | dane_leblanc, Can you validate your yaml? | 23:54 |
dane_leblanc | The yaml I'm using matches Madhuri's | 23:54 |
madhuri | Really? | 23:54 |
madhuri | Can you please paste it? | 23:55 |
madhuri | I will try it out | 23:55 |
dane_leblanc | http://paste.openstack.org/show/275696/ | 23:55 |
madhuri | dane_leblanc, It succeded | 23:56 |
madhuri | Do you have the master branch? | 23:57 |
madhuri | If yes, can you please check magnum-api or magnum-conductor logs for error? | 23:57 |
dane_leblanc | Yes, this is master for magnum | 23:58 |
madhuri | Strange | 23:59 |
madhuri | Did you see any error in logs? | 23:59 |
sdake_ | madhuri pip show six plz | 23:59 |
sdake_ | dane_leblanc pip show six plz | 23:59 |
dane_leblanc | Yes, I see traceback in m-api.log | 23:59 |
sdake_ | paste traceback plz | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!