*** hongbin has quit IRC | 00:35 | |
*** tovin07 has joined #openstack-containers | 00:39 | |
*** EricGonc_ has quit IRC | 00:43 | |
*** jwcroppe has quit IRC | 00:57 | |
*** juggler has joined #openstack-containers | 01:00 | |
*** jberkus has quit IRC | 01:05 | |
*** kevinz has joined #openstack-containers | 01:08 | |
*** catintheroof has quit IRC | 01:13 | |
*** edisonxiang has quit IRC | 01:19 | |
*** edisonxiang has joined #openstack-containers | 01:19 | |
*** ricolin has joined #openstack-containers | 01:20 | |
*** salmankhan has quit IRC | 01:21 | |
*** mtanino has quit IRC | 01:22 | |
*** Syed__ has quit IRC | 01:25 | |
*** dave-mccowan has joined #openstack-containers | 01:27 | |
*** sdake_ has joined #openstack-containers | 01:27 | |
*** sdake has quit IRC | 01:30 | |
*** jberkus has joined #openstack-containers | 02:03 | |
*** tonanhngo has quit IRC | 02:06 | |
*** dfflanders has quit IRC | 02:09 | |
*** dfflanders has joined #openstack-containers | 02:10 | |
*** tonanhngo has joined #openstack-containers | 02:12 | |
*** tonanhngo has quit IRC | 02:17 | |
*** zz_dimtruck is now known as dimtruck | 02:19 | |
*** EricGonczer_ has joined #openstack-containers | 02:32 | |
*** ianychoi has quit IRC | 02:34 | |
*** juggler has quit IRC | 02:35 | |
*** ianychoi has joined #openstack-containers | 02:38 | |
*** EricGonc_ has joined #openstack-containers | 02:39 | |
*** EricGonczer_ has quit IRC | 02:40 | |
*** vijaykc4 has joined #openstack-containers | 02:44 | |
*** wangbo has joined #openstack-containers | 02:58 | |
*** EricGonc_ has quit IRC | 03:03 | |
*** vijaykc4 has quit IRC | 03:12 | |
*** vijaykc4 has joined #openstack-containers | 03:15 | |
*** vijaykc4 has quit IRC | 03:23 | |
*** wangbo has quit IRC | 03:25 | |
*** sdake_ has quit IRC | 03:36 | |
*** sdake has joined #openstack-containers | 03:39 | |
*** hongbin has joined #openstack-containers | 03:43 | |
*** deepbook5broo has joined #openstack-containers | 03:43 | |
*** deepbook5broo has left #openstack-containers | 03:44 | |
*** dave-mccowan has quit IRC | 03:47 | |
*** zhugaoxiao has quit IRC | 03:49 | |
*** david-lyle has quit IRC | 03:49 | |
*** zhugaoxiao has joined #openstack-containers | 03:50 | |
*** david-lyle has joined #openstack-containers | 03:50 | |
*** jberkus has quit IRC | 03:53 | |
*** sdake_ has joined #openstack-containers | 03:53 | |
*** sdake has quit IRC | 03:55 | |
openstackgerrit | Anh Tran proposed openstack/magnum master: Remove unused logging import https://review.openstack.org/435219 | 03:57 |
---|---|---|
*** adrian_otto has joined #openstack-containers | 03:58 | |
*** janki has joined #openstack-containers | 04:09 | |
*** adrian_otto has quit IRC | 04:14 | |
*** hongbin has quit IRC | 04:22 | |
*** dimtruck is now known as zz_dimtruck | 04:24 | |
*** adrian_otto has joined #openstack-containers | 04:34 | |
*** adisky_ has joined #openstack-containers | 04:38 | |
*** v1k0d3n has quit IRC | 04:40 | |
*** mdnadeem has joined #openstack-containers | 04:40 | |
*** daidv has joined #openstack-containers | 04:46 | |
*** v1k0d3n has joined #openstack-containers | 04:52 | |
*** adrian_otto has quit IRC | 04:54 | |
*** sdake_ has quit IRC | 04:54 | |
*** ricolin has quit IRC | 04:59 | |
*** v1k0d3n has quit IRC | 05:05 | |
*** rcernin has joined #openstack-containers | 05:08 | |
*** feke has quit IRC | 05:14 | |
*** maestropandy has joined #openstack-containers | 05:17 | |
*** v1k0d3n has joined #openstack-containers | 05:18 | |
*** faizy has joined #openstack-containers | 05:32 | |
*** vijaykc4 has joined #openstack-containers | 05:43 | |
*** daidv has quit IRC | 05:54 | |
*** vijaykc4 has quit IRC | 05:56 | |
*** daidv has joined #openstack-containers | 06:00 | |
*** vijaykc4 has joined #openstack-containers | 06:02 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/magnum-ui master: Imported Translations from Zanata https://review.openstack.org/435259 | 06:05 |
*** vijaykc4 has quit IRC | 06:07 | |
openstackgerrit | fengbeihong proposed openstack/magnum master: Support dcos installation on centos vm cluster https://review.openstack.org/386435 | 06:08 |
*** yamamoto has quit IRC | 06:08 | |
openstackgerrit | fengbeihong proposed openstack/magnum master: Support dcos installation on centos vm cluster https://review.openstack.org/386435 | 06:11 |
*** jberkus has joined #openstack-containers | 06:11 | |
*** sidx64 has joined #openstack-containers | 06:13 | |
*** jberkus has quit IRC | 06:15 | |
*** rcernin has quit IRC | 06:21 | |
*** vijaykc4 has joined #openstack-containers | 06:27 | |
openstackgerrit | Michael Liu proposed openstack/magnum master: magnum support cni network driver https://review.openstack.org/435270 | 06:36 |
*** yuanying has quit IRC | 06:37 | |
*** jerrygb has joined #openstack-containers | 06:41 | |
*** jerrygb has quit IRC | 06:46 | |
*** yamamoto has joined #openstack-containers | 06:47 | |
*** sidx64_ has joined #openstack-containers | 06:47 | |
*** sidx64 has quit IRC | 06:50 | |
*** sidx64_ is now known as sidx64 | 06:50 | |
*** jerrygb has joined #openstack-containers | 07:00 | |
*** rcernin has joined #openstack-containers | 07:01 | |
*** askb has quit IRC | 07:04 | |
*** vijaykc4 has quit IRC | 07:05 | |
*** jerrygb has quit IRC | 07:05 | |
*** Oku_OS-away is now known as Oku_OS | 07:07 | |
*** askb has joined #openstack-containers | 07:15 | |
*** fragatina has quit IRC | 07:19 | |
*** dsariel has quit IRC | 07:26 | |
*** fragatina has joined #openstack-containers | 07:35 | |
*** fragatina has quit IRC | 07:37 | |
*** fragatina has joined #openstack-containers | 07:38 | |
*** code34_ has joined #openstack-containers | 07:38 | |
*** code34_ has quit IRC | 07:38 | |
*** fragatina has quit IRC | 07:38 | |
*** dsariel has joined #openstack-containers | 07:39 | |
*** fragatina has joined #openstack-containers | 07:39 | |
openstackgerrit | yuhui proposed openstack/magnum master: Fix some typos https://review.openstack.org/435283 | 07:40 |
*** maestropandy has quit IRC | 07:45 | |
*** amoralej|off is now known as amoralej | 07:46 | |
*** yuanying has joined #openstack-containers | 07:57 | |
*** hishh has joined #openstack-containers | 08:04 | |
openstackgerrit | Kevin Lefevre proposed openstack/magnum master: Prepare Kubelet for multiple container runtime https://review.openstack.org/434921 | 08:10 |
*** hishh has quit IRC | 08:17 | |
*** yamamoto has quit IRC | 08:18 | |
*** pcaruana has joined #openstack-containers | 08:22 | |
*** pcastets has joined #openstack-containers | 08:29 | |
*** yamamoto has joined #openstack-containers | 08:31 | |
*** vijaykc4 has joined #openstack-containers | 08:41 | |
*** yamamoto has quit IRC | 08:44 | |
*** vimal has joined #openstack-containers | 08:45 | |
*** code34 has quit IRC | 08:45 | |
*** daidv has quit IRC | 08:46 | |
*** Serlex has joined #openstack-containers | 08:53 | |
*** ssbarnea has joined #openstack-containers | 08:56 | |
ArchiFleKs | hi, could someone take a look a this bug https://bugs.launchpad.net/magnum/+bug/1643197 I think it is a real issue that should be addressed as it can "break" cluster creation completly when instances cannot access the internalURL Api network (which is the case for almost every production deployment I think) | 09:00 |
openstack | Launchpad bug 1643197 in Magnum "os_magnum role uses internal VIP inside instances" [Undecided,New] | 09:00 |
openstackgerrit | yatin proposed openstack/python-magnumclient master: Compare test coverage with the master branch https://review.openstack.org/435316 | 09:01 |
*** tovin07 has quit IRC | 09:26 | |
*** maestropandy has joined #openstack-containers | 09:30 | |
*** maestropandy has left #openstack-containers | 09:30 | |
*** Jeffrey4l has quit IRC | 09:42 | |
*** yamamoto has joined #openstack-containers | 09:44 | |
*** vimal has quit IRC | 09:49 | |
*** yamamoto has quit IRC | 09:49 | |
*** vimal has joined #openstack-containers | 09:49 | |
*** Jeffrey4l has joined #openstack-containers | 09:55 | |
*** vijaykc4 has quit IRC | 09:55 | |
*** vijaykc4 has joined #openstack-containers | 09:55 | |
*** salmankhan has joined #openstack-containers | 09:56 | |
*** Jeffrey4l has quit IRC | 09:56 | |
*** Jeffrey4l has joined #openstack-containers | 09:57 | |
*** ssbarnea has quit IRC | 10:02 | |
*** ssbarnea has joined #openstack-containers | 10:03 | |
strigazi | ArchiFleKs I'll have a look again this afternoon | 10:08 |
*** faizy has quit IRC | 10:12 | |
*** faizy has joined #openstack-containers | 10:13 | |
*** kevinz has quit IRC | 10:14 | |
*** yamamoto has joined #openstack-containers | 10:17 | |
*** Jeffrey4l has quit IRC | 10:18 | |
*** vijaykc4 has quit IRC | 10:18 | |
*** Jeffrey4l has joined #openstack-containers | 10:19 | |
*** vijaykc4 has joined #openstack-containers | 10:19 | |
*** pcastets has quit IRC | 10:21 | |
*** yamamoto has quit IRC | 10:25 | |
*** sidx64 has quit IRC | 10:27 | |
*** vijaykc4 has quit IRC | 10:28 | |
*** sidx64 has joined #openstack-containers | 10:29 | |
*** pcastets has joined #openstack-containers | 10:35 | |
*** jerrygb has joined #openstack-containers | 10:46 | |
*** jerrygb has quit IRC | 10:50 | |
*** jerrygb has joined #openstack-containers | 10:51 | |
*** jerrygb_ has joined #openstack-containers | 10:54 | |
*** jerrygb has quit IRC | 10:55 | |
*** vijaykc4 has joined #openstack-containers | 11:04 | |
*** sidx64_ has joined #openstack-containers | 11:05 | |
*** sidx64 has quit IRC | 11:08 | |
*** sidx64_ is now known as sidx64 | 11:08 | |
*** sdake has joined #openstack-containers | 11:18 | |
*** itoperatorguy has joined #openstack-containers | 11:24 | |
itoperatorguy | hi all | 11:24 |
itoperatorguy | can I ask a fast magnum issue question here? | 11:25 |
itoperatorguy | I have installed magnum followed by official documentation. I created a swarm cluster using the fedora-atomic-latest image. I configured the env variables using the $(magnum cluster-config swarm-cluster --dir working_dir) command. But when I want to test with 'docker run busybox echo "HEllo From docker"' then I get docker: Error response from daemon: No healthy node available in the cluster. If I am ssh into the swarm master VM | 11:31 |
itoperatorguy | or the 'slave' node vm then the docker run command works without issue. What do I miss? (using tcpdump on the swarm master VM i see that packets arriving to the port 2376 when I am running docker run from controller1 node) | 11:31 |
*** salmankhan has quit IRC | 11:33 | |
*** salmankhan has joined #openstack-containers | 11:34 | |
*** vijaykc4 has quit IRC | 11:34 | |
*** vijaykc4 has joined #openstack-containers | 11:35 | |
*** yolanda has quit IRC | 11:36 | |
*** yamamoto has joined #openstack-containers | 11:37 | |
*** yamamoto has quit IRC | 11:37 | |
*** yolanda has joined #openstack-containers | 11:39 | |
*** sidx64 has quit IRC | 11:43 | |
*** sidx64 has joined #openstack-containers | 11:45 | |
*** sdake has quit IRC | 11:49 | |
*** sdake has joined #openstack-containers | 11:49 | |
*** askb has quit IRC | 12:00 | |
*** danil has joined #openstack-containers | 12:07 | |
*** adisky_ has quit IRC | 12:09 | |
*** jerrygb_ has quit IRC | 12:10 | |
*** danil has quit IRC | 12:11 | |
*** dave-mccowan has joined #openstack-containers | 12:13 | |
*** pcastets has quit IRC | 12:19 | |
strigazi | itoperatorguy which version of magnum? | 12:21 |
*** catintheroof has joined #openstack-containers | 12:23 | |
*** yamamoto has joined #openstack-containers | 12:28 | |
*** jerrygb has joined #openstack-containers | 12:29 | |
*** sdake has quit IRC | 12:39 | |
*** jerrygb_ has joined #openstack-containers | 12:45 | |
*** faizy has quit IRC | 12:45 | |
*** jerrygb has quit IRC | 12:46 | |
*** sdake has joined #openstack-containers | 12:46 | |
itoperatorguy | Sorry I was out for lunch. root@controller1 (adminv3) $> magnum --version | 12:57 |
itoperatorguy | 2.3.1 | 12:57 |
*** yamamoto has quit IRC | 12:58 | |
*** mtanino has joined #openstack-containers | 12:59 | |
*** sdake_ has joined #openstack-containers | 12:59 | |
*** yamamoto has joined #openstack-containers | 13:01 | |
*** jerrygb_ has quit IRC | 13:02 | |
*** jerrygb has joined #openstack-containers | 13:02 | |
*** sdake has quit IRC | 13:02 | |
*** yamamoto has quit IRC | 13:06 | |
strigazi | that is the client, for server do pip freeze | grep magnum or dpkg -l | grep magnum or rpm -qa | grep magnum depending on your system | 13:07 |
*** pcastets has joined #openstack-containers | 13:09 | |
itoperatorguy | openstack-magnum-api-3.1.1-1.el7.noarch | 13:11 |
itoperatorguy | openstack-magnum-common-3.1.1-1.el7.noarch | 13:11 |
itoperatorguy | python2-magnumclient-2.3.1-1.el7.noarch | 13:11 |
itoperatorguy | openstack-magnum-conductor-3.1.1-1.el7.noarch | 13:11 |
itoperatorguy | python-magnum-3.1.1-1.el7.noarch | 13:11 |
strigazi | you must use fedora-atomic-newton | 13:11 |
itoperatorguy | thanks. I will run the test and get back to you | 13:14 |
*** sdake has joined #openstack-containers | 13:14 | |
*** mtanino has quit IRC | 13:15 | |
*** sdake_ has quit IRC | 13:15 | |
*** EricGonczer_ has joined #openstack-containers | 13:16 | |
*** yuanying has quit IRC | 13:18 | |
*** pcastets has quit IRC | 13:19 | |
*** pcastets has joined #openstack-containers | 13:22 | |
*** EricGonc_ has joined #openstack-containers | 13:24 | |
*** salmankhan has quit IRC | 13:24 | |
*** EricGonczer_ has quit IRC | 13:24 | |
*** sidx64 has quit IRC | 13:32 | |
*** faizy has joined #openstack-containers | 13:41 | |
*** EricGonc_ has quit IRC | 13:47 | |
*** salmankhan has joined #openstack-containers | 14:05 | |
*** yamamoto has joined #openstack-containers | 14:05 | |
*** mdnadeem has quit IRC | 14:09 | |
*** yamamoto has quit IRC | 14:11 | |
*** mtanino has joined #openstack-containers | 14:28 | |
*** randallburt has joined #openstack-containers | 14:30 | |
*** yatinkarel has quit IRC | 14:33 | |
*** amoralej is now known as amoralej|lunch | 14:41 | |
*** jwcroppe has joined #openstack-containers | 14:43 | |
*** zz_dimtruck is now known as dimtruck | 14:44 | |
*** yatinkarel has joined #openstack-containers | 14:45 | |
openstackgerrit | Spyros Trigazis proposed openstack/magnum stable/newton: IGNORE: tests stable/newton jobs https://review.openstack.org/435480 | 14:56 |
*** jerrygb has quit IRC | 14:59 | |
*** jerrygb has joined #openstack-containers | 15:00 | |
itoperatorguy | <strigazi> this time cluster is constantly in "CREATE_IN_PROGRESS" state. And when I run openstack server show I only see the swarm_master server and slave node does not come up | 15:00 |
itoperatorguy | magnum-conductor.log does not really help: 2017-02-17 14:59:04.533 13333 WARNING oslo.service.loopingcall [-] Function 'magnum.conductor.handlers.cluster_conductor.HeatPoller.poll_and_check' run outlasted interval by 2.30 sec | 15:01 |
*** janki has quit IRC | 15:01 | |
*** hongbin has joined #openstack-containers | 15:02 | |
*** jerrygb has quit IRC | 15:04 | |
*** yatinkarel has quit IRC | 15:15 | |
*** amoralej|lunch is now known as amoralej | 15:18 | |
*** faizy has quit IRC | 15:22 | |
*** yatinkarel has joined #openstack-containers | 15:27 | |
strigazi | dims We need to release the client today? | 15:28 |
ttx | you have a release request already$ | 15:30 |
*** EricGonczer_ has joined #openstack-containers | 15:31 | |
*** faizy has joined #openstack-containers | 15:32 | |
dims | strigazi : see review https://review.openstack.org/#/c/435241/ | 15:35 |
*** vijaykc4 has quit IRC | 15:40 | |
dims | strigazi : just edit that review and add stable/ocata in there | 15:41 |
*** jvgrant__ has joined #openstack-containers | 15:42 | |
strigazi | dims done | 15:43 |
dims | thanks strigazi | 15:44 |
*** jvgrant_ has quit IRC | 15:45 | |
*** yatinkarel has quit IRC | 15:49 | |
*** kbyrne has joined #openstack-containers | 15:52 | |
strigazi | itoperatorguy before was CREATE_COMLETE? | 15:52 |
*** Syed__ has joined #openstack-containers | 15:52 | |
itoperatorguy | yes with fedora-atomic-latest creation was complete | 15:53 |
itoperatorguy | strigazi yes with fedora-atomic-latest creation was complete | 15:53 |
itoperatorguy | this time it just stuck/hangs in the 'CREATE_IN_PROGRESS' state | 15:54 |
strigazi | can you go in the master and do docker ps | 15:55 |
strigazi | can you go in the master and do docker ps -s | 15:55 |
strigazi | can you go in the master and do docker ps -a | 15:55 |
strigazi | to see if the swarm manager is running | 15:55 |
strigazi | and can you try a k8s cluster too? | 15:55 |
itoperatorguy | I am not able to login to the swarm_master node this time (with image latest it worked) | 15:57 |
itoperatorguy | I am not able to even ping its floating ip | 15:58 |
itoperatorguy | it seems it is not properly booting up | 15:58 |
strigazi | try to boot only a vm with the image | 16:00 |
strigazi | sha256sum should be 53998ae262d47435b02394268585770d253b21b3507bf8c3ec7f3f10dc89c657 | 16:00 |
*** Drago1 has joined #openstack-containers | 16:01 | |
*** yatinkarel has joined #openstack-containers | 16:02 | |
*** kbyrne has quit IRC | 16:04 | |
*** sdake has quit IRC | 16:04 | |
itoperatorguy | sum is correct :( | 16:05 |
*** sdake has joined #openstack-containers | 16:06 | |
*** kbyrne has joined #openstack-containers | 16:07 | |
*** chris_hultin|AWA is now known as chris_hultin | 16:08 | |
*** randallburt has quit IRC | 16:11 | |
*** randallburt has joined #openstack-containers | 16:11 | |
*** swatson_ has joined #openstack-containers | 16:14 | |
itoperatorguy | strigaz Trying to launch the instance I am getting Failed to perform requested operation on instance "test-instance", the instance has an error status: Please try again later [Error: Build of instance 972ee124-f1d3-4ff4-86a9-b6ba57af5da8 aborted: Block Device Mapping is Invalid.]. | 16:15 |
strigazi | excellent :( | 16:16 |
yatinkarel | :) | 16:16 |
*** vijaykc4 has joined #openstack-containers | 16:19 | |
yatinkarel | itoperatorguy, nova boot command? | 16:20 |
*** pcaruana has quit IRC | 16:21 | |
itoperatorguy | I did it from dashboard. Now I am readding the image to glance. After that I will try with nova boot | 16:21 |
yatinkarel | itoperatorguy, Ok | 16:21 |
yatinkarel | when you created cluster, what was the state of swarm-master in openstack server list | 16:23 |
itoperatorguy | status was "ACTIVE" but I was unable to ssh or ping (when I used fedora-atomic-latest ping and ssh worked and both master and node vm started) | 16:25 |
*** vijaykc4 has quit IRC | 16:25 | |
yatinkarel | itoperatorguy, did you checked nova console-log <instance id> | 16:28 |
itoperatorguy | yes and it seemed to me that the boot procedure stucked somewhere | 16:29 |
itoperatorguy | there was no login prompt | 16:29 |
itoperatorguy | this time manual start: openstack server create --image fedora-atomic-newton --flavor magnum.test --security-group 5ab61dec-3f90-4436-b0bf-a808ba5ca885 --key-name mykey --nic net-id=1b6ae2d1-ecfe-4ec5-9933-ddc776135567 test-vm | 16:31 |
itoperatorguy | error message: No valid host was found. There are not enough hosts available. | 16:32 |
itoperatorguy | so error message is different and I have 2 compute node with enough free resources | 16:32 |
yatinkarel | nova service-list | 16:32 |
itoperatorguy | root@controller1 (adminv3) $> nova service-list | 16:33 |
itoperatorguy | +----+------------------+-----------------------------+----------+---------+-------+----------------------------+-----------------+ | 16:33 |
itoperatorguy | | Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason | | 16:33 |
itoperatorguy | +----+------------------+-----------------------------+----------+---------+-------+----------------------------+-----------------+ | 16:33 |
itoperatorguy | | 1 | nova-cert | controller1.openstack.local | internal | enabled | up | 2017-02-17T16:33:43.000000 | - | | 16:33 |
itoperatorguy | | 2 | nova-consoleauth | controller1.openstack.local | internal | enabled | up | 2017-02-17T16:33:43.000000 | - | | 16:33 |
itoperatorguy | | 5 | nova-scheduler | controller1.openstack.local | internal | enabled | up | 2017-02-17T16:33:42.000000 | - | | 16:33 |
itoperatorguy | | 6 | nova-conductor | controller1.openstack.local | internal | enabled | up | 2017-02-17T16:33:49.000000 | - | | 16:33 |
itoperatorguy | | 7 | nova-compute | compute1.openstack.local | nova | enabled | up | 2017-02-17T16:33:42.000000 | - | | 16:33 |
itoperatorguy | | 8 | nova-compute | compute2.openstack.local | nova | enabled | up | 2017-02-17T16:33:48.000000 | - | | 16:33 |
itoperatorguy | +----+------------------+-----------------------------+----------+---------+-------+----------------------------+-----------------+ | 16:33 |
yatinkarel | nova hypervisor-stats | 16:33 |
itoperatorguy | root@controller1 (adminv3) $> nova hypervisor-stats | 16:34 |
itoperatorguy | +----------------------+-------+ | 16:34 |
itoperatorguy | | Property | Value | | 16:34 |
itoperatorguy | +----------------------+-------+ | 16:34 |
itoperatorguy | | count | 2 | | 16:34 |
itoperatorguy | | current_workload | 0 | | 16:34 |
itoperatorguy | | disk_available_least | 60 | | 16:34 |
itoperatorguy | | free_disk_gb | 146 | | 16:34 |
itoperatorguy | | free_ram_mb | 10750 | | 16:34 |
itoperatorguy | | local_gb | 156 | | 16:34 |
itoperatorguy | | local_gb_used | 10 | | 16:34 |
itoperatorguy | | memory_mb | 12286 | | 16:34 |
itoperatorguy | | memory_mb_used | 1536 | | 16:34 |
itoperatorguy | | running_vms | 1 | | 16:34 |
itoperatorguy | | vcpus | 4 | | 16:34 |
itoperatorguy | | vcpus_used | 1 | | 16:34 |
itoperatorguy | +----------------------+-------+ | 16:34 |
itoperatorguy | root@controller1 (adminv3) $> openstack flavor show magnum.test | 16:35 |
itoperatorguy | +----------------------------+--------------------------------------+ | 16:35 |
itoperatorguy | | Field | Value | | 16:35 |
itoperatorguy | +----------------------------+--------------------------------------+ | 16:35 |
itoperatorguy | | OS-FLV-DISABLED:disabled | False | | 16:35 |
itoperatorguy | | OS-FLV-EXT-DATA:ephemeral | 0 | | 16:35 |
itoperatorguy | | access_project_ids | None | | 16:35 |
itoperatorguy | | disk | 10 | | 16:35 |
itoperatorguy | | id | 4c883f16-f2bd-4653-9729-40140a81f73c | | 16:35 |
itoperatorguy | | name | magnum.test | | 16:35 |
itoperatorguy | | os-flavor-access:is_public | True | | 16:35 |
itoperatorguy | | properties | | | 16:35 |
itoperatorguy | | ram | 512 | | 16:35 |
itoperatorguy | | rxtx_factor | 1.0 | | 16:35 |
itoperatorguy | | swap | | | 16:35 |
itoperatorguy | | vcpus | 1 | | 16:35 |
*** rcernin has quit IRC | 16:35 | |
yatinkarel | itoperatorguy, looks OK | 16:36 |
yatinkarel | itoperatorguy, when you tried with fedora-atomic-latest did you used the same flavor magnum.test | 16:37 |
itoperatorguy | I still can scroll back to the nova console-log output from the previously failed (stucked) cluster | 16:37 |
fishbone | strigazi: I am currently trying the fedora-atomic-newton image and the docker daemon maintains appropriately, however; I cannot establish any remote connections to the cluster | 16:38 |
itoperatorguy | http://pastebin.com/9Kz4ifej | 16:39 |
yatinkarel | itoperatorguy, share log over paste.openstack.org | 16:39 |
*** tonanhngo has joined #openstack-containers | 16:39 | |
fishbone | If i use the fedora-atomic-latest image I can establish a connection, but it produces the error that there are no healthy nodes, and on the nodes the docker daemon does not restart properly | 16:39 |
itoperatorguy | fishbone: I had the same experience with fedora-atomic-latest | 16:39 |
fishbone | itoperatorguy: Is there something I may be screwing up? | 16:40 |
itoperatorguy | I am here to find out that for myself as well :D | 16:40 |
fishbone | it says that the host is actively refusing the connection | 16:40 |
fishbone | oh perfect, at least I am not alone in this | 16:41 |
itoperatorguy | same was here. Now trying with fedora-atomic-newton instead of latest but this time cluster creation is just hanging in the CREATING_IN_PROGRESS state | 16:41 |
itoperatorguy | yatinkarel I copied to pastebin http://pastebin.com/9Kz4ifej | 16:42 |
itoperatorguy | should I share on paste.openstack.org as well? | 16:42 |
yatinkarel | itoperatorguy, its Ok on pastebin | 16:42 |
fishbone | itoperatorguy: hmm, are you sure the fedora-atomic-newton images created in the cluster can reach your magnum api controller by IP | 16:42 |
itoperatorguy | http://paste.openstack.org/show/599440/ | 16:43 |
yatinkarel | itoperatorguy, i think i have seen this error sometimes, retrying creating a cluster solved this | 16:43 |
fishbone | itoperatorguy: that was an issue I suffered from previously, I modified the host file in the image to be able to route to the controller | 16:43 |
itoperatorguy | fishbone: I don't think the newton image even booting properly until the point when it is trying to do that | 16:44 |
*** Oku_OS is now known as Oku_OS-away | 16:45 | |
itoperatorguy | latest image I think was able. At least when run tcpdump I saw that packages are coming back and forth | 16:45 |
yatinkarel | itoperatorguy, what's the status for test-vm | 16:45 |
itoperatorguy | root@controller1 (adminv3) $> openstack server list | 16:46 |
itoperatorguy | +--------------------------------------+-------------------------------------------------------+--------+---------------------------------------------------------------------------------+----------------------+ | 16:46 |
itoperatorguy | | ID | Name | Status | Networks | Image Name | | 16:46 |
itoperatorguy | +--------------------------------------+-------------------------------------------------------+--------+---------------------------------------------------------------------------------+----------------------+ | 16:46 |
*** vijaykc4 has joined #openstack-containers | 16:46 | |
itoperatorguy | | ff4bedba-075d-45bd-97fc-57762b01e929 | test-fedora | ERROR | | | | 16:46 |
itoperatorguy | | eec4bc1a-76a6-4618-9d7d-9d6612688896 | test-vm | ERROR | | fedora-atomic-newton | | 16:46 |
itoperatorguy | | 4434246e-1490-45c5-b731-5dfca5b9be6a | sw-24rpy4pic-0-6xpgfhkgdozi-swarm_master-zjcfshuqjfd5 | ACTIVE | swarm-cluster-5ne2unwbaxn3-fixed_network-rphluerivq4v=10.0.0.6, 192.168.100.118 | | | 16:46 |
itoperatorguy | +--------------------------------------+-------------------------------------------------------+--------+---------------------------------------------------------------------------------+----------------------+ | 16:46 |
itoperatorguy | test-fedore: created via dashboard error message: Failed to perform requested operation on instance "test-fedora", the instance has an error status: Please try again later [Error: Build of instance ff4bedba-075d-45bd-97fc-57762b01e929 aborted: Block Device Mapping is Invalid.]. | 16:46 |
yatinkarel | itoperatorguy, what flavor you used when you created cluster-template | 16:47 |
itoperatorguy | test-vm created visa 'openstack cli' error message: | 16:47 |
itoperatorguy | fault | {u'message': u'No valid host was found. There are not enough hosts available.', u'code': 500, u'details': u' File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 496, in | | 16:47 |
itoperatorguy | | | build_instances\n context, request_spec, filter_properties)\n File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 567, in _schedule_instances\n hosts = | | 16:47 |
itoperatorguy | | | self.scheduler_client.select_destinations(context, spec_obj)\n File "/usr/lib/python2.7/site-packages/nova/scheduler/utils.py", line 370, in wrapped\n return func(*args, **kwargs)\n File | | 16:47 |
itoperatorguy | | | "/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 51, in select_destinations\n return self.queryclient.select_destinations(context, spec_obj)\n File | | 16:47 |
yatinkarel | Are you able to login to 192.168.100.118? | 16:47 |
itoperatorguy | | | "/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 37, in __run_method\n return getattr(self.instance, __name)(*args, **kwargs)\n File "/usr/lib/python2.7/site- | | 16:47 |
itoperatorguy | | | packages/nova/scheduler/client/query.py", line 32, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj)\n File "/usr/lib/python2.7/site- | | 16:47 |
itoperatorguy | | | packages/nova/scheduler/rpcapi.py", line 126, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/usr/lib/python2.7/site- | | 16:48 |
itoperatorguy | | | packages/oslo_messaging/rpc/client.py", line 169, in call\n retry=self.retry)\n File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 97, in _send\n timeout=timeout, | | 16:48 |
itoperatorguy | | | retry=retry)\n File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 464, in send\n retry=retry)\n File "/usr/lib/python2.7/site- | | 16:48 |
itoperatorguy | | | packages/oslo_messaging/_drivers/amqpdriver.py", line 455, in _send\n raise result\n', u'created': u'2017-02-17T16:30:59Z'} | | 16:48 |
itoperatorguy | | flavor | magnum.test (4c883f16-f2bd-4653-9729-40140a81f73c) | 16:48 |
itoperatorguy | no I can't | 16:48 |
itoperatorguy | flavor is costum flavor callled magnum.test | 16:48 |
itoperatorguy | root@controller1 (adminv3) $> openstack flavor show magnum.test | 16:48 |
itoperatorguy | <itoperatorguy> +----------------------------+--------------------------------------+ | 16:48 |
itoperatorguy | <itoperatorguy> | Field | Value | | 16:48 |
itoperatorguy | <itoperatorguy> +----------------------------+--------------------------------------+ | 16:48 |
itoperatorguy | <itoperatorguy> | OS-FLV-DISABLED:disabled | False | | 16:48 |
itoperatorguy | <itoperatorguy> | OS-FLV-EXT-DATA:ephemeral | 0 | | 16:48 |
yatinkarel | itoperatorguy, please try with some larger flavor | 16:48 |
itoperatorguy | <itoperatorguy> | access_project_ids | None | | 16:49 |
itoperatorguy | <itoperatorguy> | disk | 10 | | 16:49 |
itoperatorguy | <itoperatorguy> | id | 4c883f16-f2bd-4653-9729-40140a81f73c | | 16:49 |
itoperatorguy | <itoperatorguy> | name | magnum.test | | 16:49 |
itoperatorguy | <itoperatorguy> | os-flavor-access:is_public | True | | 16:49 |
itoperatorguy | <itoperatorguy> | properties | | | 16:49 |
itoperatorguy | <itoperatorguy> | ram | 512 | | 16:49 |
itoperatorguy | <itoperatorguy> | rxtx_factor | 1.0 | | 16:49 |
itoperatorguy | <itoperatorguy> | swap | | | 16:49 |
itoperatorguy | <itoperatorguy> | vcpus | 1 | | 16:49 |
itoperatorguy | * rcernin has quit (Quit: WeeChat 1.6) | 16:49 |
yatinkarel | i use m1.small(2096MB ram, 20 GB, 1cpu) | 16:49 |
*** pcastets has quit IRC | 16:49 | |
yatinkarel | try with larger flavor | 16:49 |
itoperatorguy | ok I will try it | 16:50 |
itoperatorguy | I know 'it depends' but how long should a cluster creation take with only 1 node? | 16:53 |
*** faizy has quit IRC | 16:54 | |
*** fragatina has quit IRC | 16:54 | |
*** salmankhan has quit IRC | 16:57 | |
*** salmankhan has joined #openstack-containers | 16:58 | |
*** yatinkarel has quit IRC | 16:58 | |
fishbone | hello all, despite which flavor size I use for the cluster template in the fedora-atomic-newton image provisioning of the cluster I am unable to make a docker connection | 16:59 |
*** vijaykc4 has quit IRC | 16:59 | |
fishbone | I receive the error, The target machine actively refused it | 17:00 |
fishbone | I am able to ssh and ping all of the nodes in the cluster, and I can run docker commands from within all of the nodes | 17:00 |
fishbone | when using the fedora-atomic-latest image I can establish a connection but the docker daemon on the nodes consistently fails, and I receive the error "There are no healthy nodes available in the cluster" | 17:02 |
*** EricGonczer_ has quit IRC | 17:05 | |
*** jberkus has joined #openstack-containers | 17:05 | |
*** vijaykc4 has joined #openstack-containers | 17:06 | |
itoperatorguy | cluster is still CREATE_IN_PROGRESS state with fedora-atomic-newton | 17:06 |
itoperatorguy | I see that a new instance come up, but can not ping, ssh or anything with the machine + I can not interact with it in the dashboard web-console | 17:06 |
itoperatorguy | like is still booting... | 17:07 |
itoperatorguy | and this is only the swarm_master instance, there is now 'slave' instance at all | 17:08 |
*** EricGonczer_ has joined #openstack-containers | 17:08 | |
*** yatinkarel has joined #openstack-containers | 17:10 | |
*** ttx has left #openstack-containers | 17:10 | |
*** salmankhan has quit IRC | 17:12 | |
itoperatorguy | I had to go, but thanks everybody for your time | 17:12 |
*** itoperatorguy has quit IRC | 17:13 | |
*** jberkus has quit IRC | 17:13 | |
*** salmankhan has joined #openstack-containers | 17:16 | |
*** vijaykc4 has quit IRC | 17:19 | |
*** jberkus has joined #openstack-containers | 17:19 | |
*** Serlex has quit IRC | 17:25 | |
fishbone | this is the message I see in the docker daemon on the nodes, http://paste.openstack.org/show/599442/ | 17:27 |
fishbone | I'm wondering if it's an issue with the ssl cert creation? | 17:27 |
*** vijaykc4 has joined #openstack-containers | 17:29 | |
*** dimtruck is now known as zz_dimtruck | 17:33 | |
yatinkarel | fishbone, ls /etc/docker | 17:39 |
fishbone | yatinkarel, I will try that asap, I tried reconstructing the cluster as I received an error when running that command manually, http://paste.openstack.org/show/599445/ | 17:41 |
fishbone | yatinkarel: ....led me to believe the cluster settings were the issue | 17:41 |
fishbone | yatinkarel: http://paste.openstack.org/show/599445/, my bad | 17:42 |
*** vijaykc4 has quit IRC | 17:45 | |
yatinkarel | fishbone, when you create the cluster, swarm-master starts and swarm-agent doesn't? | 17:45 |
*** zz_dimtruck is now known as dimtruck | 17:46 | |
*** jerrygb_ has joined #openstack-containers | 17:46 | |
fishbone | yatinkarel, they both start fine initially it seems that may have been a hiccup, when I restart the docker daemon on both it restart fine, however; I was still not able to connect through a docker client | 17:46 |
*** vimal has quit IRC | 17:47 | |
fishbone | yatarinkel: scratch that, same error, although the service does restart fine | 17:48 |
fishbone | yatinkarel: contents of /etc/docker, ca.crt conf server.crt server.csr server.key | 17:48 |
yatinkarel | fishbone, certs are correct | 17:49 |
yatinkarel | fishbone, docker service not running? | 17:49 |
fishbone | yatinkarel: not initially, although I can restart it | 17:50 |
fishbone | yatinkarel: I received the same error from http://paste.openstack.org/show/599442/ | 17:50 |
*** jerrygb has joined #openstack-containers | 17:50 | |
fishbone | yatinkarel: and when manually entering the failed command, same thing, http://paste.openstack.org/show/599445/ | 17:51 |
*** jerrygb_ has quit IRC | 17:51 | |
fishbone | yatinkarel: actually something new, http://paste.openstack.org/show/599446/ | 17:52 |
yatinkarel | fishbone, just: sudo pkill docker | 17:53 |
fishbone | yatinkarel: and this time I can't restart the service.... | 17:53 |
yatinkarel | fishbone, sudo rm -rf /var/lib/docker | 17:54 |
yatinkarel | sudo systemctl start docker | 17:54 |
fishbone | rm: cannot remove ‘/var/lib/docker/devicemapper’: Device or resource busy | 17:54 |
yatinkarel | ps -eaf|grep docker | 17:55 |
fishbone | fedora 1766 1278 0 17:55 pts/0 00:00:00 grep --color=auto docker | 17:55 |
fishbone | yatinkarel: the process continues to respawn | 17:56 |
yatinkarel | cluster-template-create command? | 17:57 |
yatinkarel | cat /etc/redhat-release | 17:57 |
fishbone | Fedora release 23 (Twenty Three) | 17:58 |
fishbone | yatinkarel: this is on the swarm master instance | 17:58 |
yatinkarel | fishbone, ok | 17:58 |
yatinkarel | fishbone, can you share cluster-template-create command used by you | 17:59 |
fishbone | yatinkarel: I did it in the dashboard but I imagine it was simply, openstack cluster create --cluster-template test test | 18:00 |
fishbone | It auto set the 1 master 1 node amounts | 18:00 |
yatinkarel | not cluster-create, cluster-template-create | 18:00 |
yatinkarel | magnum cluster-template-list | 18:01 |
fishbone | yatinkarel: oh sorry, those settings are here, http://paste.openstack.org/show/599447/ | 18:01 |
yatinkarel | fishbone, cinder list | 18:02 |
*** pbandark has joined #openstack-containers | 18:02 | |
fishbone | yatinkarel, also the image-id is fedora-atomic-latest but it is actually the fedora-atomic-newton image, I had an issue where if I used a different name it would fail cluster creation | 18:03 |
yatinkarel | :( really | 18:03 |
fishbone | yatinkarel: here, http://paste.openstack.org/show/599448/, thanks for your help | 18:04 |
fishbone | yatarinkel: oh yes, although I think that issue has subsided but I would rather not edit the image since it currently works | 18:07 |
*** sdake_ has joined #openstack-containers | 18:10 | |
*** sdake_ has quit IRC | 18:10 | |
*** sdake_ has joined #openstack-containers | 18:10 | |
yatinkarel | fishbone, can you try with overlay storage driver | 18:11 |
yatinkarel | magnum cluster-template-create --name swarm-cluster-template-overlay \ | 18:11 |
yatinkarel | --image-id fedora-atomic-latest \ | 18:11 |
yatinkarel | --keypair-id INFRASTRUCTURE \ | 18:11 |
yatinkarel | --external-network-id Internet \ | 18:11 |
yatinkarel | --dns-nameserver 8.8.8.8 \ | 18:11 |
yatinkarel | --flavor m1.small \ | 18:11 |
yatinkarel | --coe swarm --docker-storage-driver overlay | 18:11 |
yatinkarel | magnum cluster-create --cluster-template swarm-cluster-template-overlay | 18:12 |
fishbone | yatinkarel: I will try that | 18:12 |
fishbone | yatinkarel: thank you | 18:12 |
*** randallburt has quit IRC | 18:13 | |
*** sdake has quit IRC | 18:14 | |
*** fragatina has joined #openstack-containers | 18:17 | |
fishbone | yatinkarel: OMGSSS I can't believe it was that, you are a life savor.... Any idea why the devicemapper driver is not working? | 18:23 |
*** dfflanders has quit IRC | 18:31 | |
*** EricGonc_ has joined #openstack-containers | 18:32 | |
Drago1 | fishbone: Woohoo! | 18:34 |
*** EricGonczer_ has quit IRC | 18:34 | |
yatinkarel | fishbone, No idea right now, but will try to reproduce this on monday | 18:43 |
*** jberkus has quit IRC | 18:52 | |
*** jberkus has joined #openstack-containers | 18:56 | |
fishbone | yatinkarel, thanks again | 18:58 |
-openstackstatus- NOTICE: Restarting gerrit due to performance problems | 19:02 | |
*** sdake_ has quit IRC | 19:10 | |
*** salmankhan has quit IRC | 19:20 | |
*** fragatina has quit IRC | 19:47 | |
*** ssbarnea has quit IRC | 19:50 | |
*** lakerzhou_ has joined #openstack-containers | 20:18 | |
*** xiangxinyong has joined #openstack-containers | 20:23 | |
*** edisonxiang has quit IRC | 20:25 | |
lakerzhou_ | Hi There. I am new to Magnum. Trying setup magnum with devstack by following Quick Start. But creation of k8s-cluster failed after about 30 minutes. Heat logs show kube_masters CREATE_FAILED. My Ubuntu 14.04 VM has 32G RAM and 6 vcpu. Any advice? | 20:26 |
*** salmankhan has joined #openstack-containers | 20:30 | |
openstackgerrit | OpenStack Release Bot proposed openstack/magnum master: Update reno for stable/ocata https://review.openstack.org/435593 | 20:32 |
*** salmankhan has quit IRC | 20:34 | |
*** amoralej is now known as amoralej|off | 20:37 | |
*** jerrygb has quit IRC | 20:44 | |
*** mtanino has quit IRC | 20:51 | |
*** fragatina has joined #openstack-containers | 20:55 | |
*** pbandark has quit IRC | 21:00 | |
swatson_ | lakerzhou_: I've had problems with Devstacks on VMs | 21:08 |
swatson_ | I forgot the root cause but it had to do with VM support for some feature that I can't remember now :( | 21:08 |
*** salmankhan has joined #openstack-containers | 21:17 | |
*** dimtruck is now known as zz_dimtruck | 21:22 | |
*** Jeffrey4l_ has joined #openstack-containers | 21:34 | |
*** Jeffrey4l has quit IRC | 21:34 | |
*** tonanhngo has quit IRC | 21:38 | |
*** fragatin_ has joined #openstack-containers | 21:38 | |
*** chris_hultin is now known as chris_hultin|AWA | 21:38 | |
lakerzhou_ | swatson_: thanks for the response. I will try passthrough cpumode, can try again | 21:40 |
*** fragatina has quit IRC | 21:40 | |
*** Drago1 has quit IRC | 21:52 | |
*** jerrygb has joined #openstack-containers | 21:57 | |
*** jerrygb has quit IRC | 22:03 | |
*** tonanhngo has joined #openstack-containers | 22:16 | |
*** fragatin_ has quit IRC | 22:16 | |
*** dave-mccowan has quit IRC | 22:17 | |
*** fragatina has joined #openstack-containers | 22:17 | |
*** lakerzhou_ has quit IRC | 22:17 | |
*** Serlex has joined #openstack-containers | 22:30 | |
*** sdake has joined #openstack-containers | 22:30 | |
*** code34 has joined #openstack-containers | 22:37 | |
*** jwcroppe has quit IRC | 22:40 | |
*** zz_dimtruck is now known as dimtruck | 22:49 | |
openstackgerrit | Vijendar Komalla proposed openstack/magnum master: (WIP)Validate project-id on quota create/update https://review.openstack.org/435623 | 22:57 |
*** jerrygb has joined #openstack-containers | 23:00 | |
*** Serlex has quit IRC | 23:00 | |
*** jwcroppe has joined #openstack-containers | 23:05 | |
*** jwcroppe has quit IRC | 23:09 | |
*** catintheroof has quit IRC | 23:21 | |
*** catintheroof has joined #openstack-containers | 23:22 | |
*** swatson_ has quit IRC | 23:24 | |
*** catintheroof has quit IRC | 23:26 | |
*** salmankhan has quit IRC | 23:30 | |
*** salmankhan has joined #openstack-containers | 23:37 | |
*** PagliaccisCloud has quit IRC | 23:46 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!