*** bjolo_ has joined #openstack-kolla | 00:06 | |
*** bjolo has quit IRC | 00:06 | |
*** zhurong has quit IRC | 00:07 | |
*** huikang has joined #openstack-kolla | 00:09 | |
*** mbound has joined #openstack-kolla | 00:11 | |
*** huikang has quit IRC | 00:14 | |
*** mbound has quit IRC | 00:16 | |
*** banix has quit IRC | 00:16 | |
*** banix has joined #openstack-kolla | 00:20 | |
*** jtriley has joined #openstack-kolla | 00:21 | |
*** sdake_ has quit IRC | 00:28 | |
*** jtriley has quit IRC | 00:37 | |
*** banix has quit IRC | 00:44 | |
*** dwalsh has quit IRC | 00:46 | |
*** dwalsh_ has quit IRC | 00:46 | |
*** Jeffrey4l has joined #openstack-kolla | 00:51 | |
*** Jeffrey4l has quit IRC | 00:51 | |
*** huikang has joined #openstack-kolla | 01:01 | |
*** ssurana has quit IRC | 01:09 | |
*** bjolo_ has quit IRC | 01:10 | |
*** zhurong has joined #openstack-kolla | 01:13 | |
*** britthou_ has joined #openstack-kolla | 01:25 | |
*** huikang has quit IRC | 01:26 | |
*** huikang has joined #openstack-kolla | 01:27 | |
*** britthouser has quit IRC | 01:28 | |
*** huikang has quit IRC | 01:31 | |
*** Liuqing has joined #openstack-kolla | 01:34 | |
*** haplo37_ has joined #openstack-kolla | 01:34 | |
*** bjolo has joined #openstack-kolla | 01:36 | |
*** harlowja has joined #openstack-kolla | 01:37 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: implement Ansible Tempest role https://review.openstack.org/321522 | 01:43 |
---|---|---|
*** jtriley has joined #openstack-kolla | 02:03 | |
*** bjolo_ has joined #openstack-kolla | 02:06 | |
*** bjolo has quit IRC | 02:06 | |
*** huikang has joined #openstack-kolla | 02:30 | |
*** huikang has quit IRC | 02:32 | |
*** huikang has joined #openstack-kolla | 02:33 | |
*** unicell has quit IRC | 02:38 | |
*** huikang has quit IRC | 02:38 | |
*** banix has joined #openstack-kolla | 02:47 | |
*** yuanying has quit IRC | 02:51 | |
openstackgerrit | Merged openstack/kolla: Add named volume for nova-libvirt https://review.openstack.org/344134 | 02:53 |
openstackgerrit | Merged openstack/kolla: Add named volume for nova-libvirt https://review.openstack.org/344135 | 02:54 |
openstackgerrit | Merged openstack/kolla: Fix the failure to create instance snapshot https://review.openstack.org/344309 | 02:54 |
*** ssurana has joined #openstack-kolla | 02:59 | |
*** zhurong has quit IRC | 02:59 | |
*** Liuqing has quit IRC | 02:59 | |
*** Liuqing has joined #openstack-kolla | 03:00 | |
*** zhurong has joined #openstack-kolla | 03:00 | |
*** bjolof__ has joined #openstack-kolla | 03:06 | |
*** bjolo_ has quit IRC | 03:06 | |
*** huikang has joined #openstack-kolla | 03:07 | |
*** jeh has quit IRC | 03:13 | |
*** jeh has joined #openstack-kolla | 03:13 | |
*** jeh has quit IRC | 03:13 | |
*** jeh has joined #openstack-kolla | 03:13 | |
*** huikang has quit IRC | 03:24 | |
*** jtriley has quit IRC | 03:30 | |
*** yuanying has joined #openstack-kolla | 03:47 | |
*** david-lyle has joined #openstack-kolla | 03:49 | |
*** banix has quit IRC | 03:55 | |
*** aernhart has quit IRC | 03:56 | |
*** banix has joined #openstack-kolla | 04:03 | |
*** banix has quit IRC | 04:09 | |
*** bjolof__ has quit IRC | 04:09 | |
coolsvap | ssurana: hi are you still getting the issue reported in https://bugs.launchpad.net/kolla/+bug/1491782 | 04:10 |
openstack | Launchpad bug 1491782 in kolla "Fail to create haproxy mysql user" [Critical,Triaged] - Assigned to Sidharth Surana (ssurana) | 04:10 |
*** david-lyle_ has joined #openstack-kolla | 04:19 | |
*** david-lyle has quit IRC | 04:19 | |
*** bdaca has joined #openstack-kolla | 04:19 | |
*** david-lyle_ has quit IRC | 04:26 | |
*** ssurana has quit IRC | 04:26 | |
*** daneyon_ has quit IRC | 04:31 | |
*** daneyon has joined #openstack-kolla | 04:32 | |
*** bjolo has joined #openstack-kolla | 04:36 | |
*** salv-orlando has joined #openstack-kolla | 04:52 | |
*** unicell has joined #openstack-kolla | 05:05 | |
*** daneyon has quit IRC | 05:10 | |
*** bjolo has quit IRC | 05:10 | |
*** unicell1 has joined #openstack-kolla | 05:12 | |
*** unicell has quit IRC | 05:12 | |
*** dmueller-evoila has joined #openstack-kolla | 05:26 | |
*** daneyon has joined #openstack-kolla | 05:44 | |
*** daneyon_ has joined #openstack-kolla | 05:48 | |
openstackgerrit | Bartłomiej Daca proposed openstack/kolla: /run/nologin file removal https://review.openstack.org/344574 | 05:50 |
*** haplo37_ has quit IRC | 05:52 | |
*** daneyon_ has quit IRC | 05:52 | |
*** mewald has joined #openstack-kolla | 06:01 | |
mewald | morning | 06:01 |
bdaca | hello | 06:05 |
*** daneyon has quit IRC | 06:07 | |
*** nradojevic has joined #openstack-kolla | 06:14 | |
*** bjolo has joined #openstack-kolla | 06:17 | |
bjolo | morning | 06:17 |
*** bjolo_ has joined #openstack-kolla | 06:19 | |
*** bjolo_ has quit IRC | 06:19 | |
*** bjolo_ has joined #openstack-kolla | 06:19 | |
*** bjolo has quit IRC | 06:23 | |
bjolo_ | morning | 06:30 |
*** bjolo_ is now known as bjolo | 06:30 | |
mewald | double good morning bjolo :D | 06:32 |
bjolo | high five! | 06:32 |
bjolo | :) | 06:33 |
mewald | :D | 06:33 |
mewald | guys this shit drives me nuts: https://gist.github.com/mewald1/50678e1433c583b86e47bfa1f72021cc Can someone show me how to get the escaping stuff right in Ansible? | 06:33 |
mewald | current error is https://gist.github.com/mewald1/17e43f2b9ece35f36551521158d65cc7 | 06:33 |
bjolo | tired today. had friends over for dinner so it got late, and then the kids kept me up most of the night | 06:33 |
bjolo | mewald, very helpful ansible error msg | 06:34 |
bjolo | not | 06:34 |
bjolo | i go on vacation friday and will be out for a few weeks. | 06:35 |
mewald | nice for you :D where to? | 06:35 |
bjolo | so i really have to stop playing around and do my job! :) need to get a kolla 2 up and runing so users can play with it while im gone | 06:36 |
bjolo | we have a summer house in karlskrona, sweden. | 06:36 |
bjolo | on one of the islands | 06:37 |
bjolo | gonna spend some time there and just unplug and relax | 06:37 |
bjolo | after that we are off to seattle for a wedding | 06:37 |
*** mewald1 has joined #openstack-kolla | 06:37 | |
bjolo | so i wont be back fulltime until end of august | 06:38 |
bjolo | mewald, are you good with SSL? | 06:39 |
*** JianqingJiang has joined #openstack-kolla | 06:39 | |
mewald1 | I dont speak it natively :D What's the problem? | 06:40 |
bjolo | i have a certificate (symantec) and kolla deploys it well and horizon works | 06:40 |
bjolo | but not the openstack client | 06:40 |
*** mewald has quit IRC | 06:41 | |
bjolo | unknown ssl error | 06:41 |
mewald1 | puhh unknown errors always suck :D Is the cert signed by an official CA who's Cert is installed on your local box? | 06:41 |
*** BernhardW has joined #openstack-kolla | 06:43 | |
bjolo | openssl x509 -in mycert.crt -text -noout | grep -i issuer | 06:45 |
bjolo | Issuer: C=US, O=Symantec Corporation, OU=Symantec Trust Network, CN=Symantec Class 3 Secure Server CA - G4 | 06:46 |
bjolo | CA Issuers - URI:http://ss.symcb.com/ss.crt | 06:46 |
bjolo | i downloaded the intermediate crt from symantec and put my crt and intermediate crt in the pem file | 06:46 |
bjolo | it works for both my private docker registry and for horizon, but not for openstack client. | 06:47 |
mewald1 | I've had similar issues a few weeks ago … the problem was the order in which I concatenated the different cert files and keys | 06:48 |
mewald1 | maybe turn the order around or something | 06:49 |
bjolo | i have also downloaded the intermediate crt to my client and used openstatck --os-cacert | 06:49 |
bjolo | ok currently i have mycrt, mykey, interdediate crt | 06:49 |
BernhardW | hi, I guess you'll need the root ca cert also, not only the intermediate | 06:49 |
BernhardW | you should be able to download that where you found the intermediate | 06:50 |
mewald1 | yeah you need the entire chain | 06:50 |
bjolo | ok, will try. but as i said it works for horizon and my private docker reg | 06:51 |
BernhardW | I guess you are accessing horizon from a workstation browser, which has the root cert installed by the os vendor | 06:52 |
BernhardW | as symantec is a trusted ssl authority | 06:53 |
mewald1 | I have seen totally different behavior of browsers in such situations. | 06:56 |
bjolo | so i should include the crt from CA Issuers - URI:http://ss.symcb.com/ss.crt | 06:57 |
bjolo | in my pem file | 06:57 |
mewald1 | Guys, does Kolla not create a "user" role in keystone? I am getting error messages from Horizon about non-existent default user of "_member_" | 06:58 |
mewald1 | can anyone confirm? | 06:58 |
BernhardW | this is a intermediate certificate also according to OSX | 06:58 |
bjolo | ok just gonna reset my nodes (broken kolla 3) and deploy kolla 2 | 06:58 |
bjolo | mewald1, all my kolla 2 deploys have had the same issue | 06:59 |
BernhardW | mewald1: I'll take alook at my setup | 06:59 |
bjolo | before i can create any projects or users, i need to create the _member_ role | 06:59 |
mewald1 | Ok, so it has to be a bug then … shit. Looks like people never actually try to use kolla deployed environments. Browser to VIP, see login screen, done, git push | 07:00 |
bjolo | i to new to kolla, so i thought that it was intended to be like this :) | 07:01 |
*** belmoreira has joined #openstack-kolla | 07:01 | |
bjolo | BernhardW, so how do i find the root crt for CA Issuers - URI:http://ss.symcb.com/ss.crt | 07:02 |
bjolo | what type of build and gating is kolla using? what infrastructure? | 07:02 |
BernhardW | which OS are you using on the workstation, you should be able to export from there | 07:02 |
bjolo | windows 7 and chrome is what ive been using | 07:03 |
bjolo | but i run the openstack client on a centos 7 machine (also my deployer node) | 07:03 |
BernhardW | it seems you can download them here, but don't ask me which one :( https://knowledge.symantec.com/support/code-signing-support/index?page=content&id=SO4785 | 07:04 |
BernhardW | Windows also has a keystore somewhere, it should be possible to export the root ca cert from there, but it should also be downloadable from the symantec website | 07:05 |
bdaca | mewald1: still have a problem with ansible? | 07:06 |
bdaca | maybe try this: | 07:06 |
bdaca | local_action: shell cat {{ cephx_keyring_files.files[0].path }} | grep -E 'key\s*=' | awk '{ print $3 }' | 07:06 |
BernhardW | mewald1: no user role here either, I never noticed as I'm using admin for my evaluation purposes | 07:06 |
BernhardW | guys, how do I change the hypervisor type? I edited /etc/kolla/nova-compute/nova.conf but every time I do a reconfigure it's overwritten by the default? | 07:10 |
mewald1 | BernhardW: Use the ini merge mechanism | 07:10 |
BernhardW | shouldn't that get don automatically? | 07:11 |
BernhardW | apart from that the documentation seems outdated | 07:11 |
bdaca | the problem is the path I think, /etc/kolla/config/nova.conf will be ok | 07:12 |
BernhardW | documentation states: "For this, change the virt_type option in the [libvirt] section of nova-compute.conf file inside the /etc/kolla/config/ directory." where I do not have a config directory but a directory for each service | 07:12 |
BernhardW | or are these the templates and I need to create a new file for the merge algorithm to factor in? | 07:13 |
bdaca | just put the nova-compute directory into the /etc/kolla/config | 07:13 |
mewald1 | https://github.com/openstack/kolla/blob/master/ansible/roles/nova/tasks/config.yml#L56 | 07:13 |
bdaca | s/nova-compute/nova/ | 07:14 |
*** Serlex has joined #openstack-kolla | 07:14 | |
mewald1 | The file should be /etc/kolla/config/nova/nova-compute.conf | 07:14 |
BernhardW | ok, from the source it's clear, thanks | 07:15 |
BernhardW | still, the documentation is a bit misleading I think | 07:16 |
*** unicell has joined #openstack-kolla | 07:16 | |
*** athomas has joined #openstack-kolla | 07:16 | |
*** unicell1 has quit IRC | 07:16 | |
mewald1 | BernhardW: full ack | 07:18 |
*** bootsha has joined #openstack-kolla | 07:19 | |
BernhardW | and how do I remove a config line during reconfig, it added virt_type=kvm now but still shows qemu, probably as "connection_uri = "qemu+tcp://192.168.50.11/system" is still in there? | 07:19 |
mewald1 | BernhardW: I think you cannot remove it. What you can do is set it empty though | 07:20 |
mewald1 | but the connection_uri is correct for kvm | 07:22 |
BernhardW | I just read libvirt doc and came to the same conclusion | 07:24 |
BernhardW | so then the question remains as horizon shows QEMU as hypervisor | 07:24 |
BernhardW | even though it's now kvm | 07:25 |
mewald1 | BernhardW: Have you ever seen it otherwise? My environment shows QEMU, too | 07:25 |
mewald1 | an in fact KVM is just accellerated qemu | 07:25 |
BernhardW | sure, in my rdo-based bare-metal install it's showing KVM | 07:25 |
mewald1 | oh ok | 07:26 |
mewald1 | then I have a problem, too :D | 07:26 |
BernhardW | probably as this uses the local socket and not the tcp transport | 07:26 |
*** b_bezak has joined #openstack-kolla | 07:26 | |
*** shardy has joined #openstack-kolla | 07:27 | |
BernhardW | probably it's only a glitch in displaying it correctly | 07:27 |
mewald1 | BernhardW: https://gist.github.com/mewald1/f80fcdc60f560391a1fa9da003d55ed4 | 07:28 |
mewald1 | Is this using KVM now? | 07:28 |
BernhardW | hmm, let me check, I read something as few min ago but do not remember | 07:30 |
*** britthouser has joined #openstack-kolla | 07:33 | |
BernhardW | so, from what I see it's using kvm | 07:34 |
BernhardW | libvirt states: "KVM hypervisor: The driver will probe /usr/bin for the presence of qemu-kvm and /dev/kvm device node. If both are found, then KVM fullyvirtualized, hardware accelerated guests will be available." | 07:35 |
mewald1 | yeah I think accel=kvm says it | 07:35 |
*** britthou_ has quit IRC | 07:36 | |
*** bdaca_ has joined #openstack-kolla | 07:36 | |
BernhardW | question is: would the command fail if kvm is not available or would it fall back to qemu... but for now I'd say its fine | 07:36 |
mewald1 | and horizon still says qemu | 07:36 |
mewald1 | hmm good question ^^ | 07:36 |
BernhardW | seems it would complain: determine if kvm accelleration is used | 07:37 |
BernhardW | sorry | 07:37 |
BernhardW | http://www.linux-kvm.org/page/FAQ#How_can_I_check_that_I.27m_not_falling_back_to_QEMU_with_no_hardware_acceleration.3F | 07:37 |
*** bdaca__ has joined #openstack-kolla | 07:50 | |
*** bdaca_ has quit IRC | 07:54 | |
mewald1 | Can someone have a look ha https://gist.github.com/mewald1/06fcbad28572ac5a6f533354bca08edf I got a little close with the ansible command module here but still got an error as shown. If we get this to run quickly, I will submit a patch for external ceph for Nova today and we can close the bluepring. | 07:57 |
mewald1 | -g +t | 07:57 |
bdaca__ | mewald1: I wrote it to you several minutes ago | 07:57 |
bdaca | maybe try this: | 07:58 |
bdaca | local_action: shell cat {{ cephx_keyring_files.files[0].path }} | grep -E 'key\s*=' | awk '{ print $3 }' | 07:58 |
mewald1 | bdaca__: oh I totally missed this | 07:58 |
mewald1 | will try now | 07:58 |
bdaca | :) | 07:59 |
Kdecherf | hey there | 08:02 |
bdaca__ | hello | 08:02 |
mewald1 | hi | 08:02 |
bjolo | just some trivial knowledge for the kolla project :) | 08:05 |
bjolo | we have the word kolla in swedish as well | 08:05 |
bjolo | it means something along the line "check this out!" "look!" | 08:05 |
bjolo | so it gets kinda funny when i tell another swede to try check kolla out | 08:06 |
bjolo | kolla in kolla | 08:06 |
Kdecherf | kolla-ception | 08:08 |
bdaca__ | yo dawg! | 08:08 |
BernhardW | bjolo: you also have a bank with that some or something I think, found references when searching for "kolla" | 08:09 |
bjolo | hmm let me google that | 08:10 |
BernhardW | mewald1: /usr/libexec/qemu-kvm -name instance-00000001 -S -machine pc-i440fx-rhel7.2.0,accel=kvm,usb=off... I'm not sure why it says qemu-system-x86_64 in your snippet? | 08:10 |
*** bdaca_ has joined #openstack-kolla | 08:10 | |
*** bdaca__ has quit IRC | 08:14 | |
Kdecherf | hm, interesting | 08:19 |
Kdecherf | I stopped my cluster yesterday, and now the container mariadb restarts itself continuously in recovery mode | 08:20 |
*** derekjhyang has quit IRC | 08:22 | |
bdaca_ | Kdecherf: have you tried kolla-ansible mariadb_recovery ? | 08:22 |
Kdecherf | bdaca_: i'm checking | 08:22 |
*** aernhart has joined #openstack-kolla | 08:24 | |
*** gfidente has joined #openstack-kolla | 08:28 | |
*** salv-orlando has quit IRC | 08:30 | |
*** daneyon has joined #openstack-kolla | 08:30 | |
*** aernhart_ has joined #openstack-kolla | 08:30 | |
*** bdaca__ has joined #openstack-kolla | 08:31 | |
Kdecherf | bdaca_: it partially worked | 08:34 |
Kdecherf | the main node failed to restart and ansible timed out | 08:34 |
*** aernhart has quit IRC | 08:34 | |
*** daneyon has quit IRC | 08:35 | |
*** bdaca_ has quit IRC | 08:35 | |
bjolo | question about default options in multinode | 08:43 |
bjolo | rados GW and swift proxy are default to run on the controler nodes | 08:44 |
bjolo | to me that sounds wrong. shouldnt they be on the network nodes? | 08:45 |
bjolo | it is a public facing service just like horizon | 08:45 |
bjolo | hmm let me retract on what i just said | 08:46 |
*** unicell1 has joined #openstack-kolla | 08:50 | |
*** bdaca_ has joined #openstack-kolla | 08:51 | |
*** b_bezak has quit IRC | 08:51 | |
*** unicell has quit IRC | 08:52 | |
BernhardW | bjolo: in my opinion they should be on a "storage" node, not on a network node, "controller" would be the fallback as it is for network too | 08:54 |
*** mgoddard_ has joined #openstack-kolla | 08:55 | |
*** bdaca__ has quit IRC | 08:55 | |
*** BernhardW is now known as bwe_ | 08:57 | |
*** mgoddard has quit IRC | 08:58 | |
*** mgoddard has joined #openstack-kolla | 09:03 | |
*** mgoddard_ has quit IRC | 09:03 | |
bjolo | bwe_, can agree on that as well depending on your topology and how many nodes you have etc. In my setyp i have a small l2 segment for public facing services. Only network nodes have interfaces on it | 09:06 |
bjolo | my point is that i dont think anyone wants to bugg down the controller nodes with massive traffic to/from object store | 09:07 |
bjolo | but again, this is just the default location and configurable by operator | 09:08 |
Kdecherf | well, one of my mariadb node is completing down with this error: 160720 10:55:28 [ERROR] Found 3 prepared transactions! It means that mysqld was not shut down properly last time and critical recovery information (last binlog or tc.log file) was manually deleted after a crash. You have to start mysqld with --tc-heuristic-recover switch to commit or rollback pending transactions. | 09:08 |
Kdecherf | how can i handle it with kolla? (or what is the complete command to handle it manually?) | 09:08 |
bjolo | default option in multinode example file | 09:08 |
*** bdaca__ has joined #openstack-kolla | 09:11 | |
*** bdaca_ has quit IRC | 09:14 | |
*** mgoddard_ has joined #openstack-kolla | 09:15 | |
*** mewald1 has quit IRC | 09:16 | |
*** mewald has joined #openstack-kolla | 09:16 | |
*** salv-orlando has joined #openstack-kolla | 09:17 | |
*** mewald has quit IRC | 09:17 | |
*** mgoddard has quit IRC | 09:18 | |
*** salv-orl_ has joined #openstack-kolla | 09:19 | |
*** sdake has joined #openstack-kolla | 09:21 | |
*** salv-orlando has quit IRC | 09:22 | |
*** sdake has quit IRC | 09:23 | |
bwe_ | bjolo: you are free to change the assignment of nodes to "classes" in multinode config file | 09:23 |
bjolo | Kdecherf, is mariadb runing on all the nodes? i.e. can you find the most advanced node? | 09:23 |
bwe_ | and services to classes of course too | 09:23 |
Kdecherf | bjolo: mariadb is running and healthy on the two other nodes | 09:24 |
bjolo | Kdecherf, looked at this? http://galeracluster.com/documentation-webpages/quorumreset.html | 09:24 |
bjolo | bwe_, would love to but i go on vacation friday and have pile of work to get out the door | 09:25 |
bwe_ | https://github.com/openstack/kolla/blob/master/doc/multinode.rst | 09:25 |
bwe_ | it's not that complicated | 09:25 |
bjolo | i should not even be here on IRC to be honest! :) | 09:25 |
bjolo | ok damn you, i will take a look :) | 09:25 |
bwe_ | "Edit the inventory file" is the section you are looking for | 09:26 |
*** mewald has joined #openstack-kolla | 09:26 | |
nradojevic | Kdecherf, did you find a way to solve your mysql problem? | 09:31 |
*** bdaca_ has joined #openstack-kolla | 09:31 | |
bwe_ | I've seen containers in the docker registry for trove but cannot find any reference to it in the kolla sources, does anyone know in what state that development is? | 09:31 |
bwe_ | ah, wrong, there is something, did look at the wrong place | 09:32 |
bwe_ | building a container now... ;-) sorry | 09:32 |
*** hanchao has quit IRC | 09:34 | |
*** bdaca__ has quit IRC | 09:34 | |
Mech422 | morning | 09:36 |
*** salv-orl_ has quit IRC | 09:37 | |
Kdecherf | nradojevic: not yet | 09:38 |
nradojevic | Ok, perhaps I can help you | 09:38 |
nradojevic | I had the same error yesterday | 09:38 |
*** athomas has quit IRC | 09:39 | |
Kdecherf | yeah? | 09:40 |
nradojevic | try to enter this command: "docker restart mariadb && docker exec -it -u root mariadb mysqld_safe --tc-heuristic-recover=ROLLBACK" on the host where your database is located | 09:40 |
nradojevic | afterwards: "docker restart mariadb && docker exec -it -u root mariadb mysqld_safe --tc-heuristic-recover=COMMIT" | 09:41 |
*** bdaca_ has quit IRC | 09:42 | |
Kdecherf | hm, not very effective | 09:43 |
nradojevic | ok..worked for me | 09:51 |
*** aernhart__ has joined #openstack-kolla | 09:52 | |
Kdecherf | nradojevic: i managed to restart the missing node but i have the feeling that it forked from the other nodes | 09:52 |
Mech422 | Kdecherf: from the mysql container, you can login to mysql shell and 'show..like ws_rep' | 09:54 |
Mech422 | Kdecherf: that should show you the cluster size | 09:54 |
*** aernhart_ has quit IRC | 09:55 | |
mewald | bwe_: Looks like somebody added the container but didnt contribute the ansible part | 09:56 |
Kdecherf | Mech422: well, it splitted | 09:57 |
Kdecherf | all nodes have the same cluster uuid | 09:57 |
Kdecherf | but they don't have the same cluster size | 09:57 |
Mech422 | Kdecherf: that sounds more like comms error then a 'real' split | 09:57 |
Mech422 | Kdecherf: are you sure the 'bad' node has finished its state transfer ? | 09:57 |
Kdecherf | Mech422: the bad node does not seem to talk to other nodes | 09:58 |
*** b_bezak has joined #openstack-kolla | 09:58 | |
Mech422 | Kdecherf: yeah - that sounds like a comms error | 09:59 |
Mech422 | Kdecherf: does it list the other nodes in the mysql config ? | 09:59 |
Kdecherf | Mech422: how can i see that? | 09:59 |
Mech422 | Kdecherf: err..off the top of my head? I'd docker exec bash in the 'bad' mysql node and look in /etc/mysql? | 10:00 |
*** mgoddard_ has quit IRC | 10:00 | |
Mech422 | Kdecherf: not sure if the containers keep configs in the 'normal' locations though | 10:01 |
*** mgoddard has joined #openstack-kolla | 10:01 | |
Kdecherf | Mech422: i checked the configuration from /etc/kolla/mariadb/galera.cnf and it looks good | 10:01 |
*** zhurong has quit IRC | 10:02 | |
Mech422 | Kdecherf: check you can ping the other nodes, and look in heka container for logs | 10:03 |
*** Liuqing has quit IRC | 10:03 | |
Mech422 | should be under /var/log/kolla or something in the heka container | 10:04 |
Kdecherf | Mech422: checked the logs, there is no indication in the log that mariadb/galera talks to other nodes | 10:04 |
Mech422 | Kdecherf: Hmm - it should show a bunch of stuff about the cluster... | 10:04 |
Mech422 | Kdecherf: what does it say ? | 10:04 |
*** jmccarthy has joined #openstack-kolla | 10:04 | |
mewald | Booting an instance I see this: https://gist.github.com/mewald1/55abfd5898ccbe84ed1c1497e8285e9c Anyone know what it is and how to solve? | 10:05 |
Kdecherf | Mech422: on healthy nodes, galera ejected the failed node from the map | 10:06 |
Kdecherf | Mech422: and the failed node decided to start a cluster alone, with the same id | 10:06 |
jmccarthy | Hiya ! Any suggestions about how to narrow down murano/keystone issue ? http://paste.openstack.org/show/538788/ | 10:06 |
Mech422 | Kdecherf: well - I'm a lazy fuck...I'd probably just blow away the mysql data files and restart the container.. | 10:07 |
Mech422 | Kdecherf: if that doesn't cause a full re-sync, you have bigger issues :-) | 10:07 |
Kdecherf | my main issue right now is that the galera's documentation is down | 10:07 |
*** aernhart__ has quit IRC | 10:07 | |
*** mgoddard has quit IRC | 10:08 | |
Mech422 | Kdecherf: the percona site ? or mariadb ? | 10:08 |
*** mgoddard has joined #openstack-kolla | 10:08 | |
Mech422 | Kdecherf: I usually use the docs from percona | 10:08 |
Kdecherf | Mech422: galeracluster.com | 10:09 |
Mech422 | oh - never saw that site | 10:09 |
Mech422 | try percona - galera is the 'xtradb cluster' stuff | 10:09 |
Kdecherf | oh, thanks | 10:10 |
Mech422 | percona actually wrote galera, so the docs are pretty good | 10:10 |
Kdecherf | it reminds me, the task "Starting first mariadb container" from the task recover_cluster actually starts the container with --wsrep-new-cluster | 10:11 |
*** dwalsh has joined #openstack-kolla | 10:12 | |
*** dwalsh_ has joined #openstack-kolla | 10:12 | |
bwe_ | mewald: it seems everything is there but I have a strange network problem to solve first, kolla-build is unable to download percona-release | 10:12 |
*** sdake has joined #openstack-kolla | 10:14 | |
openstackgerrit | Mathias proposed openstack/kolla: External Ceph - Implementation Nova https://review.openstack.org/344705 | 10:17 |
*** sdake_ has joined #openstack-kolla | 10:17 | |
Mech422 | Kdecherf: yeah - I don't think you should start your 'bad' node like that though | 10:18 |
Mech422 | Kdecherf: you want to join the cluster, not start a new one | 10:19 |
*** JianqingJiang has quit IRC | 10:19 | |
*** sdake has quit IRC | 10:19 | |
Mech422 | bwe_: I'm running around trying to find an old ubuntu package for gnutls - it got updated on my machine and now ldap doesn't work | 10:20 |
Mech422 | bwe_: gnutls apperenty deprecated md5sum'd certs, and I don't control the ldap server :-/ | 10:20 |
*** sdake_ has quit IRC | 10:22 | |
bwe_ | I'm not really the ubuntu guy but a quick search pointed that out: http://askubuntu.com/questions/138284/how-to-downgrade-a-package-via-apt-get | 10:24 |
Mech422 | bwe_: yeah - I know HOW to install it, I just don't know WHERE to get it from.. | 10:25 |
bwe_ | apt-get fetches it from the mirror | 10:25 |
*** sdake has joined #openstack-kolla | 10:25 | |
Mech422 | bwe_: ubuntu seems to have wiped the version I need from archives.ubuntu.com | 10:25 |
Mech422 | bwe_: yeah - problem is, the .deb isn't available to apt anymore | 10:25 |
Mech422 | bwe_: I need to manually download it from somewhere and dpkg -i | 10:25 |
bwe_ | probably in the install ISOs? | 10:26 |
sdake | morning | 10:26 |
bwe_ | hi | 10:26 |
bwe_ | Mech422: probably breaks dependencies, this will get you to hell eventually | 10:27 |
Mech422 | bwe_: ohh - good idea... I'd have to check the full dvd though :-/ the NetInst images pull from repo's | 10:27 |
Mech422 | sdake: Morning | 10:27 |
sdake | up late or early Mech422 :) | 10:27 |
Mech422 | bwe_: yeah - I'm NOT a happy camper atm :-/ | 10:27 |
sdake | nothing like deprecations without warnings | 10:27 |
sdake | atleast openstack got that part right | 10:27 |
Mech422 | bwe_: I was hoping to pull it from /var/cache/apt on one of our working boxes, but our provisioning stuff cleans that | 10:27 |
Kdecherf | /usr/bin/mysqld_safe: line 183: 178 Aborted (core dumped) | 10:28 |
Kdecherf | ok, i guess it gets better | 10:28 |
openstackgerrit | Mathias proposed openstack/kolla: External Ceph - Implementation Nova https://review.openstack.org/344705 | 10:28 |
* Kdecherf sets fire on the node | 10:28 | |
Mech422 | sdake: yeah - I can't believe ubuntu doesn't have a 'historical' archive with all the releases somewhere | 10:28 |
openstackgerrit | Mathias proposed openstack/kolla: External Ceph - Implementation Nova https://review.openstack.org/344705 | 10:29 |
sdake | they probably do - you just dont know how to find it :) | 10:29 |
sdake | on fedora its called koji | 10:29 |
bwe_ | Mech422: you could try debian, still will get you to hell eventually ;-) | 10:29 |
Mech422 | sdake: it appears to have been pulled from archive.ubuntu.com - not sure where else to try | 10:30 |
sdake | Mech422 what your looking for is ubuntu's build server | 10:30 |
Mech422 | sdake: for old stuff ? wouldn't that be for new stuff ? | 10:30 |
sdake | it should be for all stuff | 10:30 |
*** mbound has joined #openstack-kolla | 10:30 | |
sdake | koji keeps everything ever built that was successful | 10:30 |
Mech422 | sdake: oh nice | 10:31 |
sdake | i dont know if ubuntu has an analog | 10:31 |
sdake | but i'd think they do | 10:31 |
Mech422 | bwe_: I've had really good luck with debian - 15 years or so now, and no major issues.. | 10:31 |
sdake | i am not a ubuntu jockey sorry can't help more ;) | 10:31 |
Mech422 | bwe_: ubuntu has been a bit less fortunate :-P | 10:31 |
Mech422 | sdake: Thanks - it gives me more stuff to google anyway...maybe something will turn up | 10:32 |
bwe_ | mee too, you know what they say: "Ubuntu is an ancient african word, meaning: I can't install debian" ;-) | 10:32 |
Mech422 | bwe_: LOL | 10:32 |
Mech422 | bwe_: I use deb for my 'servers', and ubuntu for my disposable nodes/development | 10:32 |
Mech422 | bwe_: shorewall firewall + debian ROCK btw :-) | 10:33 |
bwe_ | ok, it seems trove support is only half way there, image building is there, deployment not :( | 10:34 |
Kdecherf | Mech422: well, finally the node is back online | 10:35 |
Mech422 | Kdecherf: oh cool... setting fire to it always works! | 10:35 |
Mech422 | Kdecherf: gotta show it who's boss, and you mean business! :-) | 10:36 |
Kdecherf | Mech422: haha, indeed | 10:36 |
Kdecherf | it depends on the day but a hammer can be more effective than fire, sometimes | 10:37 |
Mech422 | Kdecherf: yeah - it just depends how pis^H^H^Hserious you are ... | 10:37 |
*** sdake has quit IRC | 10:38 | |
Mech422 | Kdecherf: hammer is for attitude adjustment, fire is for kill-it-with-fire-and-scatter-the-ashes | 10:38 |
Kdecherf | it also depends on how hungry you are, servers can make good bbq | 10:38 |
Kdecherf | (true story) | 10:38 |
Mech422 | Kdecherf: hehe | 10:40 |
Mech422 | Kdecherf: on of the guys I work with has an old HD he put a musket shot thru...I guess these drives had a 'somewhat' high failure rate and he finally couldn't take it | 10:41 |
*** sdake has joined #openstack-kolla | 10:42 | |
jmccarthy | Ok, I think I found my issue is to do with keystone, any suggestions for this here ? http://paste.openstack.org/show/538796/ | 10:48 |
Mech422 | jmccarthy: did you forget to create the murano service user ? | 10:50 |
jmccarthy | Mech422: Maybe ? How do I check ? | 10:52 |
bdaca | jmccarthy: from console or horizon? | 10:54 |
Mech422 | jmccarthy: umm - I'd have to look it up - nova list users or keystone list users or something | 10:54 |
bdaca | in horizon log in as admin and see Identity->Users | 10:54 |
bdaca | or from the console openstack user list | 10:55 |
bdaca | "openstack user list" <- this is the command ;) | 10:55 |
jmccarthy | openstack user list shows murano | 10:56 |
*** britthou_ has joined #openstack-kolla | 10:58 | |
bdaca | maybe try to obtain a token as a murano? | 10:58 |
*** zhubingbing has joined #openstack-kolla | 10:59 | |
jmccarthy | bdaca: Not sure how to test that .. | 11:00 |
*** britthouser has quit IRC | 11:00 | |
Kdecherf | hm, well, it seems that the network on my deployment with linuxbridge does not work | 11:03 |
*** aernhart__ has joined #openstack-kolla | 11:03 | |
bdaca | jmccarthy: create openrc file for murano user, source it and run "openstack token issue" | 11:04 |
bdaca | do you know how to create openrc file? | 11:04 |
jmccarthy | bdaca: Ok I've got one of those, which things to I change for murano user ? Let me see | 11:06 |
Kdecherf | I have a lot of zombie dnsmasq processes in neutron-dhcp-agent, and the master node does not have healthy dnsmasq at all | 11:07 |
*** zhurong has joined #openstack-kolla | 11:07 | |
jmccarthy | bdaca: Just change OS_USERNAME to murano is it ? | 11:08 |
bdaca | no, if you have everything as the defaults for murano, it should be: | 11:08 |
bdaca | project/user_domain = default, project/tenant_name = service, username = murano and password = XXX, proper for the murano user of course | 11:10 |
*** zhurong has quit IRC | 11:11 | |
*** britthou_ has quit IRC | 11:11 | |
bdaca | you can find password in /etc/kolla/passwords.yml | 11:11 |
bdaca | as murano_keystone_password | 11:11 |
*** sdake has quit IRC | 11:12 | |
*** daneyon has joined #openstack-kolla | 11:12 | |
jmccarthy | bdaca: Apologies, I'm fried - can you post a sample openrc ? | 11:13 |
bdaca | of course, just give me a sec | 11:13 |
*** zhurong has joined #openstack-kolla | 11:14 | |
bjolo | Kdecherf, what version of kolla and containers are you running? | 11:14 |
bdaca | http://paste.openstack.org/show/J0ccPXksozSgaMuVOGjn/ | 11:15 |
Kdecherf | bjolo: 2.0.2 | 11:15 |
bjolo | Kdecherf, same here | 11:15 |
*** britthouser has joined #openstack-kolla | 11:16 | |
bdaca | just change the OS_PASSWORD and OS_AUTH_URL | 11:16 |
Kdecherf | hm, very nice | 11:16 |
bjolo | im doing a new deployment right now. 2.0.2 but with my own images (updated sources to stable-mitaka tarballs for all core services) | 11:16 |
bjolo | i remember also seing defunct dnsmasq processes. will check again once the deployment is done | 11:17 |
Kdecherf | i run docker restart neutron_dhcp_agent and all my controllers are dying, waiting for oom-killer to hit some memory eaters | 11:17 |
*** daneyon has quit IRC | 11:17 | |
*** shardy has quit IRC | 11:18 | |
jmccarthy | bdaca: Thanks ! checking | 11:18 |
*** britthou_ has joined #openstack-kolla | 11:19 | |
*** britthouser has quit IRC | 11:20 | |
openstackgerrit | Prithiv proposed openstack/kolla: Support Networking-SFC Container https://review.openstack.org/344762 | 11:20 |
Mech422 | Woot! Got my ldap back! Found a repo someone had setup in the company | 11:21 |
mewald | Kdecherf: had the same thing, I killed everything, reployed, worked | 11:21 |
jmccarthy | bdaca: Ok interesting ! When I do that, I am able to get a token: | 11:22 |
jmccarthy | +------------+----------------------------------+ | 11:22 |
jmccarthy | | Field | Value | | 11:22 |
jmccarthy | +------------+----------------------------------+ | 11:22 |
jmccarthy | | expires | 2016-07-20T12:19:51.045887Z | | 11:22 |
jmccarthy | | id | 23accd441f664cff8ac49b261e4b2f65 | | 11:22 |
jmccarthy | | project_id | c2b4d2efd1124eb3b0bd990e479fe096 | | 11:22 |
jmccarthy | | user_id | 9716b8b745304b60b3ddbf01df1f02b3 | | 11:22 |
jmccarthy | +------------+----------------------------------+ | 11:22 |
Kdecherf | well, not really a production-friendly way of fixing things | 11:22 |
jmccarthy | (9716b8b745304b60b3ddbf01df1f02b3 is murano) | 11:22 |
mewald | Kdecherf: nope :D I was never able to dig into it as the system becomes entirely unavailable | 11:24 |
Kdecherf | haha nice, my mariadb cluster died, again | 11:25 |
*** zhubingbing has quit IRC | 11:27 | |
*** gfidente is now known as gfidente|lunch | 11:27 | |
Mech422 | Kdecherf: you sure you don't have some networking issue? packet loss or something... | 11:27 |
Mech422 | Kdecherf: seems odd it fails so often | 11:28 |
*** dwalsh has quit IRC | 11:30 | |
*** dwalsh_ has quit IRC | 11:30 | |
*** mewald has quit IRC | 11:31 | |
*** mewald1 has joined #openstack-kolla | 11:31 | |
bjolo | when building my own images, is it possible to customize the ceph images as well? i cant see any options for ceph kolla-build.conf | 11:35 |
bjolo | kolla 2 is using ceph hammer, would like to use jewel | 11:36 |
bjolo | rpm packages located here http://download.ceph.com/rpm-jewel/ | 11:36 |
bdaca | ok, so looks like keystone is rather ok... can you describe me your scenario, jmccarthy? I can try to reproduce this in my env if you give me some time | 11:38 |
jmccarthy | bdaca: It's to do with when I try to deploy a murano environment - but I am suspicious now of my murano.conf may be off, I'll go and research that :) | 11:40 |
Mech422 | bjolo: hmm - looks like the ceph Dockerfile is hardcoded... | 11:42 |
bjolo | thats what i mean | 11:42 |
Mech422 | bjolo: you can do what I do, and before running the build, patch the dockerfile | 11:42 |
bdaca | jmccarthy: I will try it this evening. what kolla version do you use? | 11:43 |
*** britthou_ has quit IRC | 11:43 | |
bjolo | Mech422, what do you do it? just adding the ceph repo prior to yum install? | 11:44 |
Mech422 | bjolo: I don't do it for ceph specifically, but yes - I imagine you have to add the repo to the host, and apt-get update, and check the package names in the Dockerfile | 11:45 |
bjolo | http://docs.ceph.com/docs/master/install/get-packages/ | 11:45 |
openstackgerrit | Will Rouesnel proposed openstack/kolla: Volume specification for ironic-api was invalid (should be a list). https://review.openstack.org/344775 | 11:45 |
Mech422 | bjolo: not sure what the equivalent of 'apt-get update' is for RH systems | 11:46 |
bjolo | yum update | 11:46 |
Mech422 | bjolo: dont forget to check that the 'ceph.com' package names are the same as the ones in the Dockerfile | 11:47 |
bjolo | i think i skip this for now | 11:47 |
bjolo | just need ceph to work for now so i can get the cloud up for testing out customizations (keystone domains with AD auth, multiple external networks, SSL certs) | 11:49 |
bjolo | plan is to go prod with kolla 3 using external ceph (tnx to mewald1 :) ) | 11:50 |
Mech422 | bjolo: I would HIGHLY recommend creating an ansible playbook of the customizatons you do along the way | 11:50 |
Mech422 | bjolo: I actually 'drive' kolla via a set of custom playbooks so I can apply patches, change configs, etc etc | 11:51 |
bjolo | cool | 11:51 |
bjolo | do you have any playbooks to share to get me started on this approach? | 11:52 |
Mech422 | bjolo: err..not really - it's all pretty site specific | 11:53 |
*** cristicalin has joined #openstack-kolla | 11:55 | |
mewald1 | bjolo: is everything working ok with the external ceph stuff? | 11:56 |
bjolo | have not had time to really try it out... frankly i tried to do a basic multinode deploy of kolla 3 but it broke quite early on | 11:57 |
bjolo | since im on vacation friday i dont have time to dig into it | 11:57 |
mewald1 | ok let me know if there are any problems | 11:57 |
bjolo | oh i will :) | 11:57 |
Mech422 | mewald1: just a heads up - there is an issue with the 'read gpt partition' table stuff in find_disks.py | 11:58 |
Mech422 | mewald1: thats not your patch, but related | 11:58 |
bjolo | i be back end of august. will try it out then | 11:58 |
bjolo | and do what i can to help out get kolla 3 out the door | 11:59 |
Mech422 | mewald1: for one thing - it hard codes the location of sgdisk to /usr/sbin but .deb systems put it in /sbin | 11:59 |
mewald1 | Mech422: but we're talking about the code that deploys ceph, right? I didnt code that | 11:59 |
Mech422 | mewald1: right - I said its not your patch :-P | 12:00 |
mewald1 | yeah read it afterwards :D | 12:00 |
*** bdaca has quit IRC | 12:00 | |
mewald1 | can you file a bug report and propose a patch? | 12:00 |
Mech422 | mewald1: I wrote the patch :-P but it got 'enhanced' along the way | 12:00 |
Mech422 | mewald1: and like any program, it got enhanced to the point where it doesn't work anymore :-P | 12:01 |
openstackgerrit | Dennis Mueller proposed openstack/kolla: Added ceilometer decision in neutron.conf for event notifications https://review.openstack.org/344782 | 12:02 |
*** athomas has joined #openstack-kolla | 12:03 | |
mewald1 | Mech422: Can you send me a link? | 12:05 |
Mech422 | mewald1: https://review.openstack.org/326609 | 12:06 |
Mech422 | mewald1: I'm trying to see whats up with it now | 12:07 |
Mech422 | mewald1: it should probably 'shell' out to sgisk so search path can locate the binary | 12:07 |
*** banix has joined #openstack-kolla | 12:07 | |
Mech422 | mewald1: and I have a sneaking suspicion that the udev library needs to be higher then 1880 | 12:07 |
*** banix has quit IRC | 12:09 | |
*** Liuqing has joined #openstack-kolla | 12:10 | |
*** jmccarthy has left #openstack-kolla | 12:13 | |
*** jmccarthy has quit IRC | 12:13 | |
*** gfidente|lunch is now known as gfidente | 12:26 | |
*** cristicalin has quit IRC | 12:41 | |
mewald1 | Does anyone have any experience with influxdb clustering? I am working on deployment of collectd + influxdb + grafana and was wondering if the effort to cluster influxdb was worth it | 12:44 |
*** salv-orlando has joined #openstack-kolla | 12:44 | |
Mech422 | mewald1: I was looking at using influx with promethus - how you liking it ? | 12:45 |
Mech422 | mewald1: from what I've read, clustering is a weak spot for influxdb | 12:46 |
mewald1 | what is promethus? | 12:46 |
mewald1 | found it | 12:46 |
Mech422 | mewald1: https://prometheus.io/ | 12:46 |
mewald1 | :) | 12:47 |
openstackgerrit | Dennis Mueller proposed openstack/kolla: Added neutron-metering-agent https://review.openstack.org/344808 | 12:47 |
Mech422 | mewald1: I'm debating prometheus + grafana vs the TICK stack with influx | 12:47 |
mewald1 | I have not arguments available to debate this :D All I can add is: people a probably more familiar with grafana | 12:49 |
Mech422 | mewald1: yeah - though you can use grafana with TICK too | 12:49 |
Kdecherf | mewald1: the native clustering on influxdb is now a business option | 12:49 |
Mech422 | Kdecherf: supposedly there some half-asses HA stuff you can do with the OSS version | 12:50 |
Mech422 | Kdecherf: I think its something like DRDB + HAProxy type stuff | 12:50 |
mewald1 | DRBD … I hope not :D | 12:51 |
Kdecherf | Mech422: there is indeed a kind-of HA feature on the new community edition which consist of proxifying data and replicate them on two separate influxdb nodes | 12:52 |
Kdecherf | worse than drbd :D | 12:52 |
Mech422 | Kdecherf: ahh... | 12:53 |
Mech422 | Kdecherf: have you used infuxdb/TICK ? I just want something relatively painless for my home lab monitoring.. | 12:53 |
Kdecherf | (ha mechanism is completely removed from community edition) | 12:53 |
Mech422 | Kdecherf: cassandra based stuff seems like overkill, and influxdb sounds easy to setup - but I keep hearing its not quite 'stable' yet.. | 12:54 |
Kdecherf | i deployed a TIG stack on my lab env | 12:54 |
Kdecherf | (telegraf/influxdb without HA/grafana) | 12:54 |
Mech422 | oh - how do you like it ? | 12:54 |
Kdecherf | it's really simple and works quite out of the box | 12:54 |
Mech422 | Kdecherf: that might be the deciding factor for me...ease of setup | 12:55 |
Mech422 | Kdecherf: how is telegraf compared to collectd/diamond? It sounds pretty light weight ? | 12:55 |
*** rhallisey has joined #openstack-kolla | 12:56 | |
mewald1 | one thing I wanna know is: how many plugins are there for telegraf? Will it be pain in the ass to monitor a ceph cluster or openstack metrics or is there something we can use? | 12:56 |
Kdecherf | Mech422: my setup is really simple atm but it works and it gives me a good summary of performance of my nodes (10s collect, 7d retention), seems really fast on queries | 12:56 |
Kdecherf | mewald1: i didn't play with collectd, so I can't tell | 12:56 |
mewald1 | I wanna know for telegraf. For collectd I know it has all I need | 12:57 |
Mech422 | mewald1: I thought I saw a ceph plugin listed for telegraph | 12:57 |
Kdecherf | but telegraf seems really light, small footprint and the configuration file is really really short | 12:57 |
*** JianqingJiang has joined #openstack-kolla | 12:58 | |
Kdecherf | (which is good, it generates metrics for network, cpu, disks, memory and other stuff out of the box) | 12:58 |
Mech422 | mewald1: https://github.com/influxdata/telegraf/tree/master/plugins/inputs/ceph | 12:59 |
Mech422 | Kdecherf: seems like I should give it a go ... | 13:00 |
*** cristicalin has joined #openstack-kolla | 13:00 | |
Kdecherf | Mech422: yep | 13:00 |
*** daneyon has joined #openstack-kolla | 13:01 | |
Kdecherf | anyway i'm interested if anyone has feedback on the Kapacitor/alerting part | 13:01 |
Mech422 | Kdecherf: I actually wasn't gonna bother with that - seemed like grafana or promethus could do it? | 13:01 |
Kdecherf | i'm not sure that it's the job of grafana | 13:02 |
Mech422 | Kdecherf: probably not | 13:02 |
mewald1 | I guess we should somehow vote to get a majority behind a certain monitoring stack | 13:03 |
mewald1 | before I starting putting time into this | 13:03 |
Mech422 | mewald1: for kolla ? | 13:03 |
Mech422 | mewald1: operators are going to have monitoring in place already, so I'm not sure kolla should setup a 'snowflake' | 13:04 |
Mech422 | mewald1: probably just have the operator install their collector of choice as part of host setup before deploying kolla ? | 13:05 |
*** daneyon has quit IRC | 13:05 | |
Kdecherf | well, as long as openstack has its own influxdb competitor (gnocchi), it could be natural to deploy gnocchi for that | 13:05 |
Kdecherf | oh, docker killed one of my controllers, again | 13:06 |
Mech422 | Kdecherf: I wasn't aware of gnocchi... | 13:06 |
Mech422 | sooo many openstack projects :-P | 13:06 |
Kdecherf | Mech422: it's quite new, and the main goal of gnocchi seems to be a replacement of ceilometer | 13:06 |
Kdecherf | (another openstack project) | 13:07 |
mewald1 | Mech422: if that was Kolla's approach we wouldnt have elasticsearch + kibana in the stack | 13:07 |
Mech422 | Kdecherf: oh - ceilometer is going away ? | 13:09 |
Mech422 | mewald1: perhaps - I kinda think ELK is there for debugging, not production :-P | 13:09 |
Kdecherf | Mech422: not to my knowledge | 13:09 |
Kdecherf | Mech422: ELK is production-proof | 13:09 |
Mech422 | mewald1: so you can corrolate all the messages that fly between containers when you make a request | 13:10 |
Mech422 | Kdecherf: no - I mean ELK specifically in Kolla ... it must have been a bitch trying to follow a request thru all the containers and logs without it | 13:10 |
Mech422 | but thats just my guess | 13:10 |
*** JianqingJiang has quit IRC | 13:11 | |
Kdecherf | oh, i see | 13:11 |
*** salv-orlando has quit IRC | 13:11 | |
Mech422 | for some reason, kibana never worked on my kolla cluster... all I get is horizon logs | 13:13 |
Mech422 | that'll be the next thing I work on after I get ceph working again | 13:13 |
mewald1 | I dont believe ELK is there to help developers | 13:13 |
Kdecherf | hm, the behavior of this controller is really weird | 13:16 |
*** jtriley has joined #openstack-kolla | 13:17 | |
Kdecherf | top - 15:17:17 up 5 min, 3 users, load average: 126.41, 45.97, 16.93 | 13:17 |
Kdecherf | yeah, nice | 13:17 |
bjolo | has anyone tried to deploy kolla-ansible ontop of coreos or atomic or any other minimal distro? | 13:17 |
bjolo | Kdecherf, ouch | 13:17 |
Mech422 | Kdecherf: Did you forget to put the fire out ? :-) | 13:18 |
Mech422 | Kdecherf: whats thrashing the machine ? | 13:18 |
*** JianqingJiang has joined #openstack-kolla | 13:18 | |
Kdecherf | bjolo: i am tempted to replace docker with rkt | 13:20 |
*** cristicalin has quit IRC | 13:21 | |
Kdecherf | Mech422: well, i though we could have more heat in the room, it's pretty cold right now | 13:21 |
bjolo | dont know much about rkt | 13:21 |
Mech422 | Kdecherf: yeah - that'll make a nice lil space heater :-) | 13:21 |
*** sdake has joined #openstack-kolla | 13:21 | |
Mech422 | Kdecherf: what sort of hosts you running on ? | 13:21 |
Kdecherf | bjolo: coreos's container tool | 13:22 |
bjolo | was more wondering if there is anything in the kolla-ansible design that prevents it from working on minial os distros. e.g. net=host, host mounts, etc that kolla is making use of | 13:22 |
*** mewald has joined #openstack-kolla | 13:22 | |
rhallisey | bjolo, I've done it on atomic | 13:22 |
mewald1 | how is a question like which perf monitoring stack to use or whether to use one at all solved in a open source community like this? | 13:23 |
bjolo | rhallisey, cool | 13:23 |
bjolo | rhallisey, any workarounds neeeded or worked out of the box? | 13:23 |
rhallisey | bjolo, worked for me | 13:25 |
Kdecherf | http://i.imgur.com/4nown7C.png well.. | 13:25 |
rhallisey | any issues I had in the past I added into kolla | 13:25 |
rhallisey | so it should work fine | 13:25 |
bjolo | from a sysadmin/operator perspective, i see a bright future for minimal distros. (and equally dark future for phat distros like ubuntu, rhel, etc). Devs prefer to use the container approach for development | 13:25 |
sdake | mewald1 whoever writes the code gets to decide | 13:25 |
rhallisey | https://github.com/openstack/kolla/blob/cac7be2f3bf5fddd48aa35e83a855681ae93aafb/docker/nova/nova-libvirt/extend_start.sh#L6 | 13:25 |
bjolo | meaning that ALL physical hosts will be sort of hypervisor | 13:26 |
sdake | mewald1 naturally the individual most interested in wrigin the code is most likely to have the best opinions about which choice to make ;) | 13:26 |
mewald | sdake: that's good news:D | 13:27 |
sdake | Kdecherf you have a kernel backtrace | 13:27 |
*** mewald1 has quit IRC | 13:27 | |
Mech422 | Kdecherf: Ouch! | 13:28 |
*** cristicalin has joined #openstack-kolla | 13:28 | |
*** athomas has quit IRC | 13:29 | |
Kdecherf | sdake: i have a lot of kernel backtraces here | 13:30 |
sdake | fwiw a system should never backtrace | 13:30 |
*** dwalsh has joined #openstack-kolla | 13:34 | |
*** dwalsh_ has joined #openstack-kolla | 13:34 | |
*** Jeffrey4l has joined #openstack-kolla | 13:36 | |
*** nradojevic has left #openstack-kolla | 13:37 | |
*** diogogmt has quit IRC | 13:42 | |
*** dwalsh has quit IRC | 13:43 | |
*** dwalsh_ has quit IRC | 13:43 | |
*** cristicalin has quit IRC | 13:43 | |
*** diogogmt has joined #openstack-kolla | 13:44 | |
*** mgoddard_ has joined #openstack-kolla | 13:45 | |
*** mgoddard has quit IRC | 13:49 | |
*** lyncos has joined #openstack-kolla | 13:52 | |
*** diogogmt has quit IRC | 13:55 | |
*** athomas has joined #openstack-kolla | 13:58 | |
*** sdake_ has joined #openstack-kolla | 14:02 | |
*** shardy has joined #openstack-kolla | 14:03 | |
*** sdake has quit IRC | 14:03 | |
*** sdake has joined #openstack-kolla | 14:05 | |
*** diogogmt has joined #openstack-kolla | 14:05 | |
*** JianqingJiang has quit IRC | 14:05 | |
bjolo | mewald, tnx for the SSL tip about the order to cat them together. I switched around to mycrt, intermediate crt, my key and now it works | 14:05 |
Kdecherf | it's time to burn this test env | 14:06 |
*** rhallisey has quit IRC | 14:07 | |
*** sdake_ has quit IRC | 14:07 | |
*** rhallisey has joined #openstack-kolla | 14:08 | |
*** salv-orlando has joined #openstack-kolla | 14:08 | |
*** salv-orlando has quit IRC | 14:09 | |
*** JianqingJiang has joined #openstack-kolla | 14:09 | |
*** salv-orlando has joined #openstack-kolla | 14:10 | |
Mech422 | Kdecherf: yeah - I fully reformat my test machines once a day... | 14:10 |
Kdecherf | Mech422: well, i will just pause my eval of kolla | 14:11 |
Mech422 | Kdecherf: yeah - might be good to make sure the hardware/network isn't causing you grief... | 14:12 |
Mech422 | I'm sat here trying to figure out some stupid GSSAPI error on my ldap stuff | 14:13 |
coolsvap | sdake: we need more milestones for stable branches | 14:14 |
*** diogogmt has quit IRC | 14:14 | |
*** bdaca has joined #openstack-kolla | 14:14 | |
sdake | agree | 14:14 |
sdake | i'm goin gback to bed - bbiaf :) | 14:15 |
*** unicell1 has quit IRC | 14:15 | |
coolsvap | :) | 14:15 |
*** dwalsh has joined #openstack-kolla | 14:17 | |
*** dwalsh_ has joined #openstack-kolla | 14:18 | |
*** JianqingJiang has quit IRC | 14:20 | |
*** salv-orlando has quit IRC | 14:21 | |
*** unicell has joined #openstack-kolla | 14:22 | |
*** bjolo has quit IRC | 14:29 | |
*** britthouser has joined #openstack-kolla | 14:30 | |
*** dave-mccowan has joined #openstack-kolla | 14:33 | |
*** lyncos has quit IRC | 14:34 | |
*** shardy is now known as shardy_mtg | 14:35 | |
*** huikang has joined #openstack-kolla | 14:37 | |
*** huikang has quit IRC | 14:41 | |
*** huikang has joined #openstack-kolla | 14:42 | |
*** daneyon has joined #openstack-kolla | 14:49 | |
*** zhurong has quit IRC | 14:50 | |
*** daneyon has quit IRC | 14:53 | |
*** jruano has joined #openstack-kolla | 14:54 | |
*** mgoddard_ has quit IRC | 14:58 | |
*** mgoddard has joined #openstack-kolla | 14:59 | |
*** diogogmt has joined #openstack-kolla | 15:02 | |
*** bootsha has quit IRC | 15:02 | |
*** b_bezak has quit IRC | 15:04 | |
*** haplo37_ has joined #openstack-kolla | 15:04 | |
*** b_bezak has joined #openstack-kolla | 15:04 | |
*** Liuqing has quit IRC | 15:07 | |
*** b_bezak has quit IRC | 15:09 | |
*** banix has joined #openstack-kolla | 15:09 | |
*** unicell has quit IRC | 15:16 | |
*** jogam has quit IRC | 15:17 | |
*** jogam has joined #openstack-kolla | 15:17 | |
*** belmoreira has quit IRC | 15:18 | |
*** vhosakot has joined #openstack-kolla | 15:24 | |
*** jogam has quit IRC | 15:24 | |
*** jogam has joined #openstack-kolla | 15:24 | |
*** sdake has quit IRC | 15:26 | |
*** dave-mccowan has quit IRC | 15:29 | |
*** sdake has joined #openstack-kolla | 15:29 | |
bdaca | I have a weird question... is there any reason why mitaka uses nova api v2, not v2.1 by default? | 15:29 |
*** inc0 has joined #openstack-kolla | 15:29 | |
inc0 | good morning | 15:30 |
Mech422 | inc0: Morning | 15:30 |
dasm | bdaca: it's not in kolla, but johnthetubaguy answered for neutron: https://review.openstack.org/#/c/324232/4//COMMIT_MSG@10 | 15:30 |
patchbot | dasm: patch 324232 - neutron - Update nova api 2.0 to 2.1 | 15:31 |
dasm | bdaca: "I just wanted to be clear, Nova still supports the /2.0 API, and has no plans to drop that API. All the same requests that worked before, should continue to work today, and long into the future." | 15:31 |
Mech422 | anyone tried the Quanta 10Gig switches? They're going cheap on Ebay.... | 15:36 |
*** lyncos has joined #openstack-kolla | 15:39 | |
*** dmsimard is now known as dmsimard|afk | 15:39 | |
bdaca | dasm: so as I understand kolla keeps v2 API because it works, but switching to 2.1 should be probably safe (as v2.1 is suggested in official mitaka deployment guide) | 15:39 |
dasm | bdaca: but in the same time: "This change will stops neutron working with older versions of Nova that didn't have the v2.1 API. Although moving to v2.1 API is probably a good overall, because you will get some stronger input validation." | 15:40 |
dasm | bdaca: but i'm not quite ure why kolla keeps v2 | 15:41 |
inc0 | well, I'd love 2.1 to be up for at least a release | 15:41 |
inc0 | so if we upgrade neutron first nova second, it won't break | 15:41 |
inc0 | however we upgrade nova first now, but just to be on the safe side | 15:41 |
*** dave-mccowan has joined #openstack-kolla | 15:42 | |
*** mewald has quit IRC | 15:43 | |
harlowja | coolsvap whats up, saw some ping :-P | 15:44 |
harlowja | ping/mention | 15:44 |
*** inc0 has quit IRC | 15:45 | |
coolsvap | harlowja: related to the oslo.context issue related to requirements | 15:45 |
coolsvap | i saw mention in oslo meeting | 15:45 |
*** inc0 has joined #openstack-kolla | 15:45 | |
coolsvap | ;) | 15:45 |
harlowja | ah | 15:46 |
*** mbound has quit IRC | 15:46 | |
harlowja | afaik its not an issue, people are doing things weirdly with tests in there project, lol | 15:47 |
Mech422 | inc0: so, I think I'm working thru my ceph issues. That patch hard codes the location of '/usr/sbin/sgdisk', which breaks on ubuntu...Any objection to just running it with shell=True and letting the search path find the bin ? | 15:47 |
coolsvap | harlowja: yes | 15:47 |
inc0 | Mech422, not really | 15:47 |
coolsvap | topic for sometime later at #openstack-dev perhaps | 15:47 |
inc0 | I mean shell=true has security issues | 15:47 |
coolsvap | harlowja: ^^ | 15:48 |
*** lyncos has quit IRC | 15:48 | |
harlowja | coolsvap sure | 15:48 |
Mech422 | inc0: yeah - but if someone can mess with your containers during build, you have bigger issues | 15:48 |
inc0 | publish a patch, I'll review | 15:48 |
*** daneyon_ has joined #openstack-kolla | 15:49 | |
Mech422 | inc0: also, logic was added to try and use that udev library if its 'new enough' - I have a suspicion thats not working .. | 15:49 |
inc0 | Paul, who added it, is on PTO now | 15:49 |
inc0 | so you might want to hold on to that thought till he's back | 15:49 |
Mech422 | yeah - I know | 15:49 |
Mech422 | fair enough | 15:49 |
inc0 | I'm sure he'd like to know too | 15:50 |
*** hrito has joined #openstack-kolla | 15:50 | |
inc0 | but what is it? | 15:50 |
Mech422 | inc0: what is what ? | 15:50 |
inc0 | the suspicion | 15:50 |
inc0 | what's not working? | 15:50 |
Mech422 | inc0: oh - it says something like 'if udev.version > 1800 then use udev' | 15:51 |
*** v1k0d3n has joined #openstack-kolla | 15:51 | |
sdake | inc0 speculation is the word your looking for ;) | 15:51 |
Mech422 | inc0: my udev is higher then that, but it appears not to be working | 15:51 |
inc0 | sdake, I know I always can count on you ;) | 15:51 |
inc0 | in that matter at least;) | 15:51 |
sdake | gotta be good at something | 15:51 |
sdake | grammar policia ftw | 15:51 |
inc0 | maybe it's version that's needs checking? | 15:51 |
inc0 | or it's not about udev version at all? | 15:52 |
Mech422 | inc0: but I haven't looked to see if the partition table re-write does the 'force udev reload' thing | 15:52 |
*** harlowja has quit IRC | 15:52 | |
Mech422 | inc0: dunno | 15:52 |
inc0 | sdake, https://www.reddit.com/r/Jokes/comments/2dmirb/sir_were_mining_too_many_useless_minerals/ | 15:52 |
inc0 | sdake, I'll miss todays meeting unfortunately:( | 15:54 |
*** mbound has joined #openstack-kolla | 15:54 | |
*** unicell has joined #openstack-kolla | 15:57 | |
*** mgoddard_ has joined #openstack-kolla | 16:00 | |
coolsvap | meeting time | 16:01 |
*** lyncos has joined #openstack-kolla | 16:01 | |
coolsvap | sdake: ^^ | 16:02 |
*** mgoddard has quit IRC | 16:03 | |
Mech422 | coolsvap: openstack-meeting4 ? | 16:03 |
coolsvap | yes | 16:04 |
coolsvap | Mech422: yes | 16:04 |
Mech422 | coolsvap: thx! | 16:04 |
*** vhosakot has quit IRC | 16:07 | |
*** vhosakot has joined #openstack-kolla | 16:08 | |
*** dmueller-evoila has quit IRC | 16:10 | |
*** vhosakot has quit IRC | 16:14 | |
*** vhosakot has joined #openstack-kolla | 16:14 | |
*** mgoddard_ has quit IRC | 16:14 | |
*** mgoddard has joined #openstack-kolla | 16:14 | |
*** david-lyle has joined #openstack-kolla | 16:19 | |
*** mdnadeem_home has joined #openstack-kolla | 16:20 | |
*** dwalsh has quit IRC | 16:21 | |
*** dwalsh_ has quit IRC | 16:21 | |
*** shardy_mtg has quit IRC | 16:27 | |
*** Serlex has quit IRC | 16:32 | |
*** athomas has quit IRC | 16:33 | |
*** vhosakot has quit IRC | 16:36 | |
*** unicell has quit IRC | 16:36 | |
*** vhosakot has joined #openstack-kolla | 16:36 | |
*** daneyon has joined #openstack-kolla | 16:38 | |
*** ayoung has joined #openstack-kolla | 16:38 | |
*** lyncos has quit IRC | 16:39 | |
*** harlowja has joined #openstack-kolla | 16:40 | |
*** mark-casey has joined #openstack-kolla | 16:40 | |
*** daneyon has quit IRC | 16:42 | |
*** david-lyle has quit IRC | 16:42 | |
*** jruano has quit IRC | 16:48 | |
openstackgerrit | Prithiv proposed openstack/kolla: Support Networking-SFC Container https://review.openstack.org/344930 | 16:53 |
*** vhosakot has quit IRC | 16:54 | |
*** bdaca has quit IRC | 16:55 | |
Mech422 | inc0: so yeah - forcing the ceph stuff thru the sgdisk code seems to get my cluster back.. | 16:56 |
*** hrito has left #openstack-kolla | 16:56 | |
Mech422 | inc0: I'll try and crank out a patch, and I can just apply it locally till pburke gets back | 16:56 |
*** vhosakot has joined #openstack-kolla | 17:01 | |
*** jascott1_tmp has joined #openstack-kolla | 17:03 | |
*** gfidente has quit IRC | 17:04 | |
*** sdake has quit IRC | 17:07 | |
*** sdake has joined #openstack-kolla | 17:11 | |
sdake | inc0 around? | 17:11 |
*** sdake has quit IRC | 17:16 | |
*** unicell has joined #openstack-kolla | 17:18 | |
*** vhosakot has quit IRC | 17:20 | |
*** mdnadeem_home has quit IRC | 17:26 | |
*** dave-mccowan has quit IRC | 17:37 | |
*** ntpttr has quit IRC | 17:47 | |
*** ntpttr has joined #openstack-kolla | 17:48 | |
*** lyncos has joined #openstack-kolla | 17:50 | |
*** Jeffrey4l has quit IRC | 17:51 | |
*** bootsha has joined #openstack-kolla | 17:53 | |
*** dave-mccowan has joined #openstack-kolla | 17:57 | |
*** michauds has joined #openstack-kolla | 18:01 | |
openstackgerrit | Christian Berendt proposed openstack/kolla: [ceilometer] use haproxy to access mongodb https://review.openstack.org/344961 | 18:02 |
*** mbound has quit IRC | 18:04 | |
*** jascott1_tmp has quit IRC | 18:16 | |
*** jruano has joined #openstack-kolla | 18:17 | |
*** harlowja has quit IRC | 18:19 | |
*** bootsha has quit IRC | 18:23 | |
*** bootsha has joined #openstack-kolla | 18:25 | |
*** dmsimard|afk is now known as dmsimard | 18:26 | |
*** jruano has quit IRC | 18:28 | |
v1k0d3n | hey all...starting to move my kolla testing phase into a multi-node deployment rather than just straight aio...would it be ok to use a 5 node cluster running all containers (both controllers network and compute)? | 18:28 |
rhallisey | v1k0d3n, ya go for it | 18:29 |
v1k0d3n | ok, so no real issues to worry about then or consider? | 18:29 |
v1k0d3n | also, i guess do i put all node everywhere...like for glance nova-compute etc? | 18:29 |
v1k0d3n | or do i need to leave the additional controls in place? | 18:30 |
*** bootsha has quit IRC | 18:30 | |
*** bootsha has joined #openstack-kolla | 18:30 | |
v1k0d3n | just just edit network, compute and control sections? | 18:30 |
rhallisey | v1k0d3n, depends what you're after. Check out the multinode inventory file | 18:31 |
rhallisey | kolla/ansible/inventory/multinode | 18:31 |
v1k0d3n | that's what i'm looking at now. lot of inventory groups. i kind of want all boxes to be the same, and share resources/control. | 18:32 |
openstackgerrit | Prithiv proposed openstack/kolla: Support Networking-SFC Container https://review.openstack.org/344930 | 18:32 |
rhallisey | ok so add the addresses for all machines under all roles | 18:32 |
*** jruano has joined #openstack-kolla | 18:33 | |
*** jruano has quit IRC | 18:35 | |
*** bootsha has quit IRC | 18:59 | |
*** unicell1 has joined #openstack-kolla | 19:03 | |
*** jruano has joined #openstack-kolla | 19:03 | |
*** jruano has quit IRC | 19:04 | |
*** unicell has quit IRC | 19:04 | |
*** mbound has joined #openstack-kolla | 19:04 | |
*** jruano has joined #openstack-kolla | 19:05 | |
*** jruano has quit IRC | 19:05 | |
*** unicell1 has quit IRC | 19:06 | |
*** mbound has quit IRC | 19:10 | |
*** unicell has joined #openstack-kolla | 19:10 | |
*** unicell1 has joined #openstack-kolla | 19:11 | |
*** unicell has quit IRC | 19:11 | |
*** unicell1 has quit IRC | 19:12 | |
*** unicell has joined #openstack-kolla | 19:12 | |
*** harlowja has joined #openstack-kolla | 19:19 | |
*** harlowja has quit IRC | 19:36 | |
*** sdake has joined #openstack-kolla | 19:38 | |
*** lyncos has quit IRC | 19:39 | |
v1k0d3n | ok, that's what i thought. | 19:39 |
v1k0d3n | @rhallisey is pretty much everything else the same as it would in the main config file? | 19:40 |
v1k0d3n | i mean same as it would be for an AIO node? | 19:40 |
v1k0d3n | seems like it really...if it is, that's super straight forward, unless i'm missing something. | 19:40 |
*** smartshader has joined #openstack-kolla | 19:45 | |
smartshader | Hi everyone, I am playing a little bit with kolla and have a question regarding nova-compute container and nova-ssh container | 19:46 |
smartshader | how does nova-compute container use the ssh-agent inside the nova-ssh container | 19:46 |
*** sdake has quit IRC | 19:47 | |
*** bwe_ has quit IRC | 19:52 | |
rhallisey | v1k0d3n, ya if you put all you hosts under each role, you can leave everything the same | 19:56 |
*** Liuqing has joined #openstack-kolla | 19:58 | |
*** aernhart__ has quit IRC | 20:00 | |
*** prithiv has joined #openstack-kolla | 20:01 | |
rhallisey | smartshader, Jeffrey4l would know. He's not around at the moment | 20:02 |
*** mewald has joined #openstack-kolla | 20:02 | |
smartshader | rhallisey, thank you for the prompt response. I will stay around to look for Jeffrey4l | 20:03 |
rhallisey | smartshader, he's UTC+8 I think. He won't be around for a few hours | 20:04 |
*** jascott1_tmp has joined #openstack-kolla | 20:10 | |
smartshader | rhallisey, Thanks but after thinking with my collegues we got our answer | 20:12 |
rhallisey | awesome | 20:13 |
*** daneyon has joined #openstack-kolla | 20:14 | |
sean-k-mooney | smartshader: nova or rather libvirt use the nova-ssh container to supprot livemightion | 20:14 |
sean-k-mooney | /livemightion/live migration/ | 20:15 |
*** daneyon has quit IRC | 20:18 | |
*** huikang has quit IRC | 20:26 | |
*** smartshader has quit IRC | 20:28 | |
*** salv-orlando has joined #openstack-kolla | 20:30 | |
*** jtriley_ has joined #openstack-kolla | 20:31 | |
*** jtriley has quit IRC | 20:34 | |
*** jtriley_ has quit IRC | 20:36 | |
*** mbound has joined #openstack-kolla | 20:51 | |
*** jogam has quit IRC | 20:52 | |
*** jogam has joined #openstack-kolla | 20:52 | |
*** salv-orl_ has joined #openstack-kolla | 20:59 | |
*** salv-orlando has quit IRC | 20:59 | |
*** jruano has joined #openstack-kolla | 20:59 | |
*** salv-orlando has joined #openstack-kolla | 21:03 | |
*** salv-orl_ has quit IRC | 21:04 | |
*** Liuqing has quit IRC | 21:12 | |
*** banix has quit IRC | 21:17 | |
*** prithiv has quit IRC | 21:21 | |
*** jascott1_tmp has quit IRC | 21:21 | |
*** jascott1_tmp has joined #openstack-kolla | 21:22 | |
*** jruano has quit IRC | 21:26 | |
*** haplo37_ has quit IRC | 21:27 | |
*** rhallisey has quit IRC | 21:32 | |
*** aernhart__ has joined #openstack-kolla | 21:35 | |
*** aernhart__ has quit IRC | 21:40 | |
*** britthou_ has joined #openstack-kolla | 21:42 | |
*** britthouser has quit IRC | 21:44 | |
*** inc0 has quit IRC | 21:48 | |
*** daneyon has joined #openstack-kolla | 22:02 | |
*** daneyon has quit IRC | 22:07 | |
*** britthouser has joined #openstack-kolla | 22:10 | |
*** harlowja has joined #openstack-kolla | 22:11 | |
*** rhallisey has joined #openstack-kolla | 22:11 | |
*** harlowja has quit IRC | 22:11 | |
*** britthou_ has quit IRC | 22:12 | |
*** signed8bit has joined #openstack-kolla | 22:12 | |
*** mark-casey has quit IRC | 22:44 | |
*** rhallisey has quit IRC | 22:45 | |
*** jascott1_tmp has quit IRC | 22:50 | |
*** rhallisey has joined #openstack-kolla | 22:57 | |
*** harlowja has joined #openstack-kolla | 23:00 | |
*** signed8bit is now known as signed8bit_Zzz | 23:03 | |
*** sogabe has joined #openstack-kolla | 23:03 | |
*** harlowja has quit IRC | 23:03 | |
*** michauds has quit IRC | 23:03 | |
*** harlowja has joined #openstack-kolla | 23:07 | |
*** britthouser has quit IRC | 23:11 | |
*** britthouser has joined #openstack-kolla | 23:12 | |
*** harlowja has quit IRC | 23:12 | |
*** mbound has quit IRC | 23:37 | |
*** ayoung has quit IRC | 23:39 | |
*** aernhart has joined #openstack-kolla | 23:39 | |
*** inc0 has joined #openstack-kolla | 23:47 | |
*** zhurong has joined #openstack-kolla | 23:48 | |
openstackgerrit | David Wang proposed openstack/kolla-kubernetes: WIP(do not merge) Add status command for Workflow Engine https://review.openstack.org/345102 | 23:51 |
*** daneyon has joined #openstack-kolla | 23:51 | |
*** daneyon has quit IRC | 23:55 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!