*** skyraven has joined #openstack | 00:04 | |
*** jistr has quit IRC | 00:07 | |
*** jistr has joined #openstack | 00:08 | |
*** Warped has joined #openstack | 00:09 | |
*** ivve has quit IRC | 00:16 | |
*** skyraven has quit IRC | 00:16 | |
*** coboluxx has joined #openstack | 00:38 | |
*** Adri2000 has joined #openstack | 00:46 | |
*** brokencycle has quit IRC | 00:55 | |
*** mikecmpbll has quit IRC | 00:55 | |
*** shibboleth has quit IRC | 01:18 | |
*** gyee has quit IRC | 01:48 | |
*** Goneri has quit IRC | 01:57 | |
*** awalende has joined #openstack | 02:00 | |
*** awalende has quit IRC | 02:04 | |
*** skyraven has joined #openstack | 02:12 | |
*** davee_ has quit IRC | 02:16 | |
*** davee_ has joined #openstack | 02:17 | |
*** skyraven has quit IRC | 02:28 | |
*** yaawang has quit IRC | 02:36 | |
*** yaawang has joined #openstack | 02:36 | |
*** macz has quit IRC | 02:37 | |
*** chenhaw has joined #openstack | 02:45 | |
*** maddtux has joined #openstack | 03:17 | |
*** macz has joined #openstack | 03:46 | |
*** macz has quit IRC | 03:51 | |
*** msalo has joined #openstack | 03:58 | |
*** jangutter has joined #openstack | 03:59 | |
*** yaawang has quit IRC | 04:01 | |
*** yaawang has joined #openstack | 04:02 | |
*** msalo has quit IRC | 04:02 | |
*** jangutter has quit IRC | 04:03 | |
*** cyberworm54 has quit IRC | 04:12 | |
*** negronjl has quit IRC | 04:17 | |
*** negronjl has joined #openstack | 04:19 | |
*** skyraven has joined #openstack | 04:24 | |
*** igordc has quit IRC | 04:34 | |
*** skyraven has quit IRC | 04:39 | |
*** aakarsh has quit IRC | 04:41 | |
*** jangutter has joined #openstack | 04:46 | |
*** jangutter has quit IRC | 04:51 | |
*** surpatil has joined #openstack | 04:58 | |
*** SurajPatil has joined #openstack | 05:13 | |
*** surpatil has quit IRC | 05:15 | |
*** surpatil has joined #openstack | 05:16 | |
*** SurajPatil has quit IRC | 05:18 | |
*** surpatil has quit IRC | 05:21 | |
*** surpatil has joined #openstack | 05:22 | |
*** msalo has joined #openstack | 05:35 | |
*** skyraven has joined #openstack | 05:39 | |
*** msalo has quit IRC | 05:40 | |
*** links has joined #openstack | 05:52 | |
*** skyraven has quit IRC | 05:58 | |
*** ircuser-1 has joined #openstack | 06:19 | |
*** ymasson has quit IRC | 06:25 | |
*** skyraven has joined #openstack | 06:31 | |
*** tonythomas has quit IRC | 06:37 | |
*** sauvin has joined #openstack | 06:39 | |
*** msalo has joined #openstack | 06:43 | |
*** skyraven has quit IRC | 06:44 | |
*** jtomasek has joined #openstack | 06:44 | |
*** jangutter has joined #openstack | 06:47 | |
*** yaawang has quit IRC | 06:47 | |
*** yaawang has joined #openstack | 06:48 | |
*** msalo has quit IRC | 06:51 | |
*** jangutter has quit IRC | 06:52 | |
*** jab416171 has joined #openstack | 06:56 | |
*** msalo has joined #openstack | 06:58 | |
*** msalo has quit IRC | 07:03 | |
*** brault has joined #openstack | 07:05 | |
dirtwash | im confused about networking in openstack, cant I just tell it to use a certain bridge? im not sure what is meant with provider network, is that a openstack terM? | 07:19 |
---|---|---|
*** jab416171 has quit IRC | 07:22 | |
*** jab416171 has joined #openstack | 07:28 | |
*** msalo has joined #openstack | 07:34 | |
jrosser | dirtwash: you can tell neutron to use an interface, not a bridge. (in the context of your external network) | 07:35 |
jrosser | a provider network is one managed and configured by the cloud operator (aka provider) rather than one created on demand by a user to use privately within their project | 07:37 |
*** msalo has quit IRC | 07:38 | |
dirtwash | well im trying this now https://docs.openstack.org/newton/install-guide-ubuntu/launch-instance-networks-provider.html | 07:39 |
dirtwash | but im already failing at executing any opentsack command, I got the RC file and sourced it but there are no openstack binaries on my controller node | 07:40 |
*** msalo has joined #openstack | 07:40 | |
*** msalo has quit IRC | 07:41 | |
dirtwash | jrosser: well if there is a simpler way, but the admin interface said I need a provider name if I want to create a network | 07:42 |
dirtwash | so I figured I have to create a provider network? | 07:42 |
dirtwash | all I want is to spin up a VM to use my LAN interface to test if that works | 07:43 |
dirtwash | with most managment platforms u just tell it to use interface X and the rest is done via bridge | 07:43 |
*** msalo has joined #openstack | 07:44 | |
*** slaweq has joined #openstack | 07:45 | |
jrosser | you need to have the neutron config define the network name “provider” and which interface it is bound to, you see that in your link in ml2_conf.ini | 07:45 |
*** surpatil is now known as surpatil|lunch | 07:46 | |
jrosser | it is unfortunate that in that example they choose to make the name of the physical network “provider” which is also the conceptual term for this kind of network | 07:46 |
*** yaawang has quit IRC | 07:46 | |
jrosser | anyway, you need to get the physical interface mapped to a logical network name in the neutron config files first, probably via whatever deployment tool you are using | 07:47 |
jrosser | then use that logical have to create a provider network with the openstack CLI with the setup you need | 07:47 |
jrosser | *logical name | 07:47 |
*** jab416171 has quit IRC | 07:48 | |
dirtwash | yea I understood that | 07:48 |
dirtwash | but im stuck with not being ble to execute the openstack command | 07:48 |
*** yaawang has joined #openstack | 07:48 | |
dirtwash | because its not an existing binary | 07:48 |
dirtwash | deployment was via Kolla btw | 07:48 |
jrosser | I use openstack-ansibke so I would go to my “utility container” - I don’t know what the same construct is for kolla | 07:49 |
dirtwash | openstack network create... <-- this just leads to "command not found" | 07:49 |
dirtwash | well docs say to execute on the controller node | 07:49 |
jrosser | or you can install hem anywhere with pip | 07:49 |
dirtwash | or did they mean the deployment instance | 07:50 |
*** calbers has quit IRC | 07:50 | |
dirtwash | I swear...IT and terms, everybody just makes up their own words | 07:50 |
*** jklare has quit IRC | 07:50 | |
*** CobHead has quit IRC | 07:50 | |
*** Roedy86 has quit IRC | 07:50 | |
*** jc__ has joined #openstack | 07:51 | |
*** trident has quit IRC | 07:51 | |
*** jc_ has quit IRC | 07:51 | |
*** calbers has joined #openstack | 07:51 | |
* dirtwash hates human languages | 07:51 | |
*** johanssone has quit IRC | 07:51 | |
*** whyz has quit IRC | 07:51 | |
*** Roedy has joined #openstack | 07:51 | |
*** trident has joined #openstack | 07:51 | |
*** jklare has joined #openstack | 07:52 | |
*** johanssone has joined #openstack | 07:52 | |
jrosser | pip install python-openstackclient | 07:53 |
jrosser | from here https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html | 07:53 |
dirtwash | jrosser: yea already found it thanks | 07:56 |
dirtwash | just trying to figure out where the config files are I need to edit | 07:56 |
dirtwash | the ml2 and linuxbridge_agent | 07:56 |
dirtwash | i figure i have to edit some kolla files to adjust those | 07:56 |
*** damien_r has joined #openstack | 08:00 | |
*** jangutter has joined #openstack | 08:04 | |
*** msalo has quit IRC | 08:04 | |
*** macz has joined #openstack | 08:12 | |
*** rainmanjam has joined #openstack | 08:13 | |
*** awalende has joined #openstack | 08:14 | |
*** tesseract has joined #openstack | 08:16 | |
*** macz has quit IRC | 08:16 | |
*** miloa has joined #openstack | 08:17 | |
*** tonythomas has joined #openstack | 08:17 | |
*** bengates has joined #openstack | 08:22 | |
*** alexmcleod has joined #openstack | 08:22 | |
*** fsimonce has joined #openstack | 08:26 | |
*** msalo has joined #openstack | 08:29 | |
*** avivgta has joined #openstack | 08:35 | |
*** msalo has quit IRC | 08:36 | |
*** skyraven has joined #openstack | 08:40 | |
*** rpittau|afk is now known as rpittau | 08:43 | |
*** ivve has joined #openstack | 08:51 | |
*** avivgt has joined #openstack | 08:54 | |
*** skyraven has quit IRC | 08:55 | |
*** msalo has joined #openstack | 09:03 | |
*** citadelcore has joined #openstack | 09:10 | |
citadelcore | Hello. I recently deployed Openstack with Cinder/Ceph as its storage backend and I am running into some issues deploying VMs | 09:11 |
citadelcore | Fails to allocate hosts because Placement thinks there is not enough storage to run them on | 09:11 |
citadelcore | Looking at the available hosts listed in Placement it only shows their local OS disks and not the Ceph volume created by Cinder which appears to be the cause of the problem | 09:12 |
*** brokencycle has joined #openstack | 09:17 | |
*** surpatil|lunch is now known as surpatil | 09:22 | |
*** gmoro has joined #openstack | 09:32 | |
*** random_yanek has quit IRC | 09:37 | |
*** admin0 has quit IRC | 09:41 | |
*** wpp has quit IRC | 09:41 | |
*** do1jlr has quit IRC | 09:42 | |
*** dasp has quit IRC | 09:42 | |
*** do1jlr has joined #openstack | 09:42 | |
*** dasp has joined #openstack | 09:43 | |
*** yaawang has quit IRC | 09:45 | |
*** yaawang has joined #openstack | 09:46 | |
*** imega has joined #openstack | 09:48 | |
*** suuuper has joined #openstack | 09:51 | |
*** random_yanek has joined #openstack | 09:55 | |
*** k_mouza has joined #openstack | 09:58 | |
*** msalo has quit IRC | 10:00 | |
*** msalo has joined #openstack | 10:01 | |
*** wpp has joined #openstack | 10:03 | |
*** rcernin has quit IRC | 10:06 | |
*** pcaruana has joined #openstack | 10:08 | |
*** msalo has quit IRC | 10:16 | |
*** electrofelix has joined #openstack | 10:22 | |
*** coboluxx has quit IRC | 10:22 | |
*** msalo has joined #openstack | 10:23 | |
*** fandi has joined #openstack | 10:25 | |
citadelcore | Is placement even necessary? I've seen some bundles omit it completely | 10:25 |
*** sshnaidm|afk is now known as sshnaidm | 10:26 | |
*** chenhaw has quit IRC | 10:27 | |
*** soniya29 has joined #openstack | 10:28 | |
*** fandi has quit IRC | 10:34 | |
*** lpetrut has joined #openstack | 10:34 | |
*** brokencycle has quit IRC | 10:43 | |
*** skyraven has joined #openstack | 10:51 | |
*** rgogunskiy has joined #openstack | 10:58 | |
*** skyraven has quit IRC | 11:06 | |
DHE | the placement API is mandatory as of the O or P release I think... | 11:11 |
citadelcore | ah | 11:13 |
citadelcore | well, it's not doing its job :P | 11:13 |
*** rpittau is now known as rpittau|bbl | 11:18 | |
*** SurajPatil has joined #openstack | 11:22 | |
citadelcore | I can't deploy any servers as I get back "No valid host was found." | 11:23 |
citadelcore | and looking at the logs, this is caused by placement because it thinks the only storage is the local disks of the hosts | 11:23 |
*** surpatil has quit IRC | 11:24 | |
*** msalo_ has joined #openstack | 11:24 | |
citadelcore | but my storage is Ceph RBD via Cinder... | 11:24 |
*** msalo__ has joined #openstack | 11:25 | |
*** msalo has quit IRC | 11:25 | |
*** msalo has joined #openstack | 11:26 | |
*** msalo_ has quit IRC | 11:29 | |
*** msalo__ has quit IRC | 11:29 | |
*** laurent\ has quit IRC | 11:30 | |
*** laurent\ has joined #openstack | 11:31 | |
*** bengates has quit IRC | 11:33 | |
*** bengates has joined #openstack | 11:33 | |
*** awalende_ has joined #openstack | 11:37 | |
*** trident has quit IRC | 11:40 | |
*** awalende has quit IRC | 11:41 | |
*** msalo_ has joined #openstack | 11:42 | |
*** trident has joined #openstack | 11:42 | |
*** msalo_ has quit IRC | 11:44 | |
*** msalo_ has joined #openstack | 11:45 | |
*** msalo has quit IRC | 11:46 | |
*** SurajPatil has quit IRC | 11:51 | |
*** SurajPatil has joined #openstack | 11:51 | |
*** lpetrut has quit IRC | 11:53 | |
*** surpatil has joined #openstack | 11:54 | |
*** bengates has quit IRC | 11:55 | |
*** zbr_ has quit IRC | 11:55 | |
*** mikecmpbll has joined #openstack | 11:56 | |
*** bengates has joined #openstack | 11:56 | |
*** zbr has joined #openstack | 11:56 | |
*** SurajPatil has quit IRC | 11:57 | |
*** gmoro has quit IRC | 11:59 | |
*** gmoro has joined #openstack | 12:01 | |
*** gmoro has quit IRC | 12:02 | |
*** gmoro_ has joined #openstack | 12:02 | |
frickler | citadelcore: if you only use boot from volume, you likely could use flavors with 0 GB root disk size. otherwise maybe you want to configure nova to place root disks also on rbd | 12:04 |
*** msalo_ has quit IRC | 12:06 | |
*** SurajPatil has joined #openstack | 12:06 | |
*** msalo has joined #openstack | 12:06 | |
*** gmoro__ has joined #openstack | 12:08 | |
*** surpatil has quit IRC | 12:09 | |
*** gmoro_ has quit IRC | 12:11 | |
*** gmoro has joined #openstack | 12:11 | |
*** SurajPatil is now known as surpatil | 12:12 | |
*** gmoro__ has quit IRC | 12:13 | |
*** gmoro_ has joined #openstack | 12:13 | |
*** gmoro has quit IRC | 12:15 | |
*** bengates has quit IRC | 12:15 | |
*** bengates has joined #openstack | 12:16 | |
*** msalo has quit IRC | 12:24 | |
*** macz has joined #openstack | 12:33 | |
*** msalo has joined #openstack | 12:33 | |
*** gmoro has joined #openstack | 12:34 | |
*** servagem has joined #openstack | 12:35 | |
*** gmoro_ has quit IRC | 12:36 | |
*** macz has quit IRC | 12:38 | |
*** msalo has quit IRC | 12:38 | |
*** chrizl has joined #openstack | 12:43 | |
*** gmoro has quit IRC | 12:46 | |
*** morazi has joined #openstack | 12:46 | |
*** gmoro has joined #openstack | 12:46 | |
*** msalo has joined #openstack | 12:49 | |
*** msalo has quit IRC | 12:54 | |
*** msalo has joined #openstack | 12:55 | |
*** drewlander has joined #openstack | 13:02 | |
*** skyraven has joined #openstack | 13:02 | |
*** msalo has quit IRC | 13:11 | |
*** dasp has quit IRC | 13:12 | |
*** dasp has joined #openstack | 13:12 | |
*** skyraven has quit IRC | 13:16 | |
*** msalo has joined #openstack | 13:20 | |
*** maddtux has quit IRC | 13:21 | |
*** schwicht has joined #openstack | 13:23 | |
*** msalo has quit IRC | 13:24 | |
*** msalo has joined #openstack | 13:29 | |
citadelcore | frickler: yeah, I believe it should be set to boot from volume... but I'm thinking this could be some other issue | 13:30 |
citadelcore | as it was working when I performed a deploy in admin_domain | 13:31 |
citadelcore | but in a new project in a new domain I created, it has this issue | 13:31 |
citadelcore | just curious, how would I configure nova to put root disks on the rbd store? | 13:32 |
*** lpetrut has joined #openstack | 13:40 | |
*** mikecmpbll has quit IRC | 13:40 | |
frickler | citadelcore: hmm, the documentation on ceph.com looks broken, mainly something like this https://cloud.garr.it/support/kb/cloud/rbd_backend_for_ehpemeral/ | 13:43 |
citadelcore | Ah cool, thanks | 13:45 |
*** rpittau|bbl is now known as rpittau | 13:46 | |
*** schwicht has quit IRC | 13:49 | |
*** mikecmpbll has joined #openstack | 13:53 | |
*** mcornea has joined #openstack | 13:57 | |
citadelcore | fricker: Thank you, that fixed the issue! | 14:01 |
citadelcore | frickler* | 14:01 |
citadelcore | Shows the correct size of the RBD volume in Placement and everything | 14:02 |
*** leanderthal has joined #openstack | 14:06 | |
*** schwicht has joined #openstack | 14:09 | |
*** __cf has joined #openstack | 14:10 | |
*** Goneri has joined #openstack | 14:12 | |
*** tinwood_ is now known as tinwood | 14:13 | |
*** strobert1 has quit IRC | 14:14 | |
*** strobert1 has joined #openstack | 14:17 | |
*** trident has quit IRC | 14:24 | |
*** trident has joined #openstack | 14:25 | |
*** jhesketh has quit IRC | 14:27 | |
*** jhesketh has joined #openstack | 14:28 | |
*** ab2434_ has joined #openstack | 14:32 | |
*** pcaruana has quit IRC | 14:33 | |
*** surpatil has quit IRC | 14:35 | |
*** aconole has joined #openstack | 14:40 | |
*** soniya29 has quit IRC | 14:46 | |
*** aakarsh has joined #openstack | 14:56 | |
*** igordc has joined #openstack | 14:57 | |
*** aakarsh|2 has joined #openstack | 14:58 | |
*** admin0 has joined #openstack | 14:59 | |
*** aakarsh has quit IRC | 15:00 | |
*** Lucas_Gray has joined #openstack | 15:01 | |
*** pcaruana has joined #openstack | 15:04 | |
*** aakarsh|2 has quit IRC | 15:06 | |
*** rgogunskiy has quit IRC | 15:12 | |
*** skyraven has joined #openstack | 15:12 | |
*** lightstalker has quit IRC | 15:13 | |
*** igordc has quit IRC | 15:17 | |
*** oncall-pokemon has joined #openstack | 15:21 | |
*** igordc has joined #openstack | 15:25 | |
*** awalende_ has quit IRC | 15:25 | |
*** awalende has joined #openstack | 15:26 | |
*** skyraven has quit IRC | 15:27 | |
*** mcornea has quit IRC | 15:28 | |
*** igordc has quit IRC | 15:30 | |
*** awalende has quit IRC | 15:30 | |
*** miloa has quit IRC | 15:31 | |
*** miloa has joined #openstack | 15:32 | |
*** tesseract has quit IRC | 15:37 | |
*** msalo has quit IRC | 15:41 | |
*** jtomasek has quit IRC | 15:42 | |
*** mcornea has joined #openstack | 15:42 | |
*** tesseract has joined #openstack | 15:48 | |
*** morazi has quit IRC | 15:52 | |
*** jmlowe has quit IRC | 15:52 | |
*** msalo has joined #openstack | 15:56 | |
*** morazi has joined #openstack | 15:57 | |
*** miloa has quit IRC | 16:00 | |
*** miloa has joined #openstack | 16:00 | |
*** miloa has quit IRC | 16:00 | |
*** miloa has joined #openstack | 16:03 | |
*** jmlowe has joined #openstack | 16:09 | |
*** ivve has quit IRC | 16:15 | |
*** jab416171 has joined #openstack | 16:17 | |
*** gyee has joined #openstack | 16:19 | |
*** msalo has quit IRC | 16:19 | |
*** ymasson has joined #openstack | 16:25 | |
*** jamesdenton has quit IRC | 16:25 | |
*** avivgta has quit IRC | 16:26 | |
*** jeremy_h has joined #openstack | 16:28 | |
jeremy_h | Im trying to use web download to import an image in glance, but its stuck in queued status. journalctl doesnt return errors from any service in logs. Any idea what could cause this? | 16:28 |
jeremy_h | working with glance in devstack, stable/stein branches for both | 16:29 |
*** electrofelix has quit IRC | 16:29 | |
*** rainmanjam has quit IRC | 16:32 | |
*** chrizl has quit IRC | 16:37 | |
*** lpetrut has quit IRC | 16:38 | |
*** damien_r has quit IRC | 16:40 | |
*** leanderthal has quit IRC | 16:42 | |
*** aakarsh has joined #openstack | 16:42 | |
*** leanderthal has joined #openstack | 16:43 | |
*** bengates has quit IRC | 16:43 | |
*** mikecmpbll has quit IRC | 16:45 | |
*** miloa has quit IRC | 16:45 | |
*** suuuper has quit IRC | 16:45 | |
*** ejat has joined #openstack | 16:46 | |
*** avivgt has quit IRC | 16:46 | |
*** jathan has joined #openstack | 16:58 | |
*** jklare has quit IRC | 16:59 | |
*** tesseract has quit IRC | 17:03 | |
*** aedc has joined #openstack | 17:04 | |
*** jklare has joined #openstack | 17:04 | |
*** morazi has quit IRC | 17:11 | |
*** morazi has joined #openstack | 17:11 | |
*** rpittau is now known as rpittau|afk | 17:12 | |
*** mikecmpbll has joined #openstack | 17:15 | |
*** Lucas_Gray has quit IRC | 17:15 | |
*** mikecmpbll has quit IRC | 17:20 | |
*** skyraven has joined #openstack | 17:22 | |
*** aconole has quit IRC | 17:24 | |
*** aconole has joined #openstack | 17:28 | |
*** dudek has joined #openstack | 17:36 | |
*** skyraven has quit IRC | 17:36 | |
*** jonaspaulo has joined #openstack | 17:38 | |
*** links has quit IRC | 17:40 | |
*** jhesketh has quit IRC | 17:42 | |
*** jhesketh has joined #openstack | 17:44 | |
*** rgogunskiy has joined #openstack | 17:55 | |
*** rgogunskiy has quit IRC | 17:59 | |
*** k_mouza has quit IRC | 18:00 | |
*** renich has joined #openstack | 18:06 | |
*** aedc has quit IRC | 18:09 | |
*** jmlowe has quit IRC | 18:15 | |
*** gagan662 has quit IRC | 18:15 | |
*** igordc has joined #openstack | 18:15 | |
*** jmlowe has joined #openstack | 18:15 | |
*** sshnaidm is now known as sshnaidm|afk | 18:21 | |
*** jmlowe has quit IRC | 18:24 | |
*** jtomasek has joined #openstack | 18:25 | |
*** awalende has joined #openstack | 18:27 | |
*** k_mouza has joined #openstack | 18:30 | |
*** awalende has quit IRC | 18:31 | |
*** k_mouza has quit IRC | 18:36 | |
*** mcornea has quit IRC | 18:36 | |
*** elico has joined #openstack | 18:36 | |
*** mcornea has joined #openstack | 18:36 | |
*** skyraven has joined #openstack | 18:37 | |
*** jmlowe has joined #openstack | 18:40 | |
*** bobmel has joined #openstack | 18:44 | |
*** bobmel has quit IRC | 18:49 | |
*** tonythomas has quit IRC | 18:50 | |
*** jeremy_h has quit IRC | 18:51 | |
*** k_mouza has joined #openstack | 18:56 | |
*** aakarsh|2 has joined #openstack | 18:56 | |
*** damien_r has joined #openstack | 18:57 | |
*** aakarsh has quit IRC | 18:59 | |
*** gmann is now known as gmann_afk | 19:00 | |
*** jamesdenton has joined #openstack | 19:00 | |
*** sauvin has quit IRC | 19:02 | |
*** laerlingSAP has joined #openstack | 19:02 | |
*** engine20191 has joined #openstack | 19:16 | |
*** awalende has joined #openstack | 19:20 | |
*** morazi has quit IRC | 19:21 | |
*** awalende has quit IRC | 19:24 | |
*** ivve has joined #openstack | 19:28 | |
*** aakarsh|3 has joined #openstack | 19:38 | |
*** aakarsh|2 has quit IRC | 19:41 | |
*** msalo has joined #openstack | 19:43 | |
*** msalo has quit IRC | 19:46 | |
*** iniazi_ has joined #openstack | 19:53 | |
*** iniazi has quit IRC | 19:57 | |
*** aakarsh|3 is now known as aakarsh | 19:58 | |
*** laerlingSAP has quit IRC | 19:59 | |
*** msalo has joined #openstack | 20:16 | |
*** msalo has quit IRC | 20:19 | |
*** msalo has joined #openstack | 20:20 | |
*** gmann_afk is now known as gmann | 20:25 | |
citadelcore | Anyone else experienced intermittent timeouts with various API services? | 20:26 |
citadelcore | I've traced it back to once in a while, Keystone will give 503 errors... | 20:26 |
citadelcore | Nothing in the logs about it though | 20:26 |
*** cyberworm54 has joined #openstack | 20:45 | |
*** vesper11 has quit IRC | 20:49 | |
*** vesper11 has joined #openstack | 20:51 | |
*** avivgt has joined #openstack | 20:57 | |
umbSublime | citadelcore: Is that for long-running operations ? | 21:09 |
umbSublime | How do you reproduce the issue ? Is it only when talking to keystone. Or once you've got your token and start using other services ? | 21:10 |
*** aedc has joined #openstack | 21:18 | |
*** idlemind has quit IRC | 21:21 | |
*** daniel1302 has joined #openstack | 21:21 | |
daniel1302 | Hi :) | 21:21 |
daniel1302 | I have installed microstack on Ubuntu Server 18.10. then i ran sudo microstack.init. But now I can see Waiting for 10.20.20.1:5672 | 21:22 |
daniel1302 | And I can see it for last 15 minutes | 21:22 |
daniel1302 | How Can I debug it? | 21:22 |
*** idlemind has joined #openstack | 21:24 | |
*** RickDeckard has joined #openstack | 21:26 | |
*** engine20191 has quit IRC | 21:29 | |
*** Goneri has quit IRC | 21:33 | |
*** servagem has quit IRC | 21:33 | |
*** dudek has quit IRC | 21:35 | |
*** aedc has quit IRC | 21:40 | |
*** aedc has joined #openstack | 21:41 | |
citadelcore | umbSublime: I believe it's after the token's acquired as the errors seem to come up from the various API services that are called... | 21:41 |
citadelcore | All of them have the same message, which is "The Keystone service is temporarily unavailable." with a code 503 | 21:41 |
citadelcore | And no not for long running operations... it just happens randomly | 21:42 |
*** skyraven has quit IRC | 21:43 | |
*** aedc_ has joined #openstack | 21:43 | |
umbSublime | Do you have say many nova-api's running on different "controller" nodes ? | 21:44 |
citadelcore | Nope... just one nova api unit. | 21:44 |
*** aakarsh has quit IRC | 21:46 | |
citadelcore | Also it's worth noting I had a look at the keystone apache2 logs and there doesn't seem to be any 503 errors in the request log. | 21:46 |
*** aedc has quit IRC | 21:47 | |
umbSublime | citadelcore: how do you see this ? from openstack cli ? | 21:52 |
umbSublime | if so can you share an example output | 21:52 |
*** rgogunskiy has joined #openstack | 21:55 | |
citadelcore | It's most prelavent on the horizon dashboard where it was first observed happening (lots of errors when navigating around) but I swear it happened in the CLI as well... am trying to re-replicate that to ensure it isn't just the dashboard | 21:58 |
*** aedc_ has quit IRC | 21:58 | |
citadelcore | https://i.imgur.com/aDm4G37.png | 21:58 |
*** aedc has joined #openstack | 21:58 | |
citadelcore | This can happen with pretty much any endpoint it tries to make a request to, hell, I've even had it happen to the dashboard itself where it would just straight up return a 503 | 21:59 |
*** awalende has joined #openstack | 22:00 | |
*** rgogunskiy has quit IRC | 22:00 | |
*** awalende has quit IRC | 22:04 | |
*** pcaruana has quit IRC | 22:06 | |
*** mcornea has quit IRC | 22:07 | |
*** aedc_ has joined #openstack | 22:09 | |
*** aedc has quit IRC | 22:11 | |
*** msalo has quit IRC | 22:13 | |
*** msalo has joined #openstack | 22:13 | |
*** thorre has quit IRC | 22:14 | |
*** skyraven has joined #openstack | 22:15 | |
*** slaweq has quit IRC | 22:15 | |
*** thorre has joined #openstack | 22:17 | |
*** aedc_ has quit IRC | 22:18 | |
*** msalo has quit IRC | 22:20 | |
*** alexmcleod has quit IRC | 22:22 | |
*** skyraven has quit IRC | 22:25 | |
*** aakarsh has joined #openstack | 22:29 | |
*** elico has quit IRC | 22:36 | |
ozzzo | citadelcore: how many nodes in your cluster? If it's a large number maybe you're maxing out a keystone connection setting | 22:47 |
*** bobmel has joined #openstack | 22:48 | |
*** elico has joined #openstack | 22:51 | |
*** elico has quit IRC | 22:52 | |
*** elico has joined #openstack | 22:52 | |
*** msalo has joined #openstack | 22:54 | |
*** jab416171 has quit IRC | 22:56 | |
*** rcernin has joined #openstack | 22:57 | |
*** avivgt has quit IRC | 22:57 | |
*** k_mouza has quit IRC | 23:01 | |
*** aakarsh has quit IRC | 23:08 | |
*** jonaspaulo has quit IRC | 23:10 | |
*** epei has joined #openstack | 23:16 | |
*** cyberworm54 has quit IRC | 23:17 | |
*** epei has quit IRC | 23:19 | |
citadelcore | ozzzo: only four nova-compute nodes | 23:20 |
citadelcore | it's a small deployment | 23:21 |
*** elico has quit IRC | 23:23 | |
*** k_mouza has joined #openstack | 23:23 | |
*** k_mouza has quit IRC | 23:23 | |
*** epei has joined #openstack | 23:24 | |
citadelcore | https://i.imgur.com/fRNsYUN.png -> even horizon won't load sometimes | 23:25 |
*** slaweq has joined #openstack | 23:25 | |
*** ab2434_ has quit IRC | 23:27 | |
*** fsimonce has quit IRC | 23:28 | |
*** msalo has quit IRC | 23:30 | |
*** slaweq has quit IRC | 23:31 | |
ozzzo | citadelcore: are you using LB or is 188 a controller? | 23:32 |
citadelcore | .188 is just the LXD container running the horizon dashboard. | 23:32 |
*** epei has quit IRC | 23:33 | |
*** msalo has joined #openstack | 23:35 | |
*** msalo has quit IRC | 23:40 | |
citadelcore | ozzzo: it seems like it's a good chance it could be some performance issue, but I haven't been able to nail down what | 23:41 |
citadelcore | everytime I do something as simple as try and download a image from glance for conversion, the whole node appears to fall over | 23:42 |
citadelcore | I am fairly certain it's not hitting resource limits... it's on a SSD, has a 10Gbps interconnect, and plenty of RAM left | 23:43 |
citadelcore | (and by "fall over" I mean API services timing out and the containers being generally slow up to a point where they can become unresponsive) | 23:44 |
*** calbers has quit IRC | 23:44 | |
*** satanist has quit IRC | 23:46 | |
*** satanist has joined #openstack | 23:46 | |
*** epei has joined #openstack | 23:47 | |
*** ivve has quit IRC | 23:47 | |
*** epei has quit IRC | 23:50 | |
citadelcore | Nvm. I think I might see the issue. Host is out of memory and it's also ran out of swap | 23:53 |
*** epei has joined #openstack | 23:55 | |
*** calbers has joined #openstack | 23:55 | |
citadelcore | MySQL has spawned a shit-ton of processes | 23:55 |
*** linuxdaemon has left #openstack | 23:56 | |
citadelcore | about 60 or so, and they're all demanding 700M each | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!