lifeless | uhm | 00:12 |
---|---|---|
lifeless | colour me confused :) | 00:12 |
lifeless | metadata is at 169.254.169.254/latest... | 00:12 |
lifeless | something very odd going on there | 00:13 |
clarkb | shouldnt you be at an hp party? | 00:16 |
greghaynes | clarkb: shouldnt you be downstairs? | 00:19 |
clarkb | yes | 00:22 |
clarkb | >_> | 00:22 |
Lotus907efi | hmmm | 00:22 |
Lotus907efi | yeah, I know the metadata is supposed to be at that IP | 00:23 |
Lotus907efi | i.e. at 169.254.169.254/latest | 00:23 |
Lotus907efi | I do not know why it is trying to connect to 192.0.2.21 | 00:23 |
Lotus907efi | I grepped through all of the stuff under /etc/cloud and /var/lib/cloud | 00:24 |
Lotus907efi | but that IP does not seem to show up | 00:24 |
lifeless | greghaynes: dev/fd was missing | 00:24 |
Lotus907efi | The output from running "cloud-init init" is at http://paste.openstack.org/show/80281/ | 00:25 |
greghaynes | huh.... I wonder what changed? | 00:31 |
*** chuckC has quit IRC | 00:33 | |
lifeless | greghaynes: somwthign deleted it | 00:37 |
lifeless | now, the problem is that the server thinks its own ip address is ...147 but its got ...145 onbr-ctlplane | 00:37 |
lifeless | ah no | 00:40 |
lifeless | greghaynes: Booting from filename "pxelinux.0" | 00:40 |
lifeless | tftp://192.168.122.168/pxelinux.0............. Connection timed out (0x4c126035) | 00:40 |
*** julim has joined #tripleo | 00:42 | |
GheRivero | did you redeploy the seed? | 00:43 |
lifeless | yes | 00:43 |
lifeless | GheRivero: ^ | 00:44 |
lifeless | GheRivero: what is the fix? | 00:45 |
GheRivero | the tftp should be working | 00:45 |
*** eguz has quit IRC | 00:45 | |
lifeless | GheRivero: did you change something ? | 00:45 |
*** eghobo has joined #tripleo | 00:46 | |
GheRivero | nothing. I just added the iptables prerouting rule for the metadata server, but looks like now is applied | 00:46 |
GheRivero | althoug the tftp server is down | 00:47 |
lifeless | GheRivero: huh | 00:47 |
lifeless | GheRivero: the redirect rule was already there | 00:47 |
lifeless | GheRivero: see theip address | 00:47 |
lifeless | GheRivero: its wrong | 00:47 |
lifeless | GheRivero: I believe someone saw this before | 00:47 |
lifeless | greghaynes: ^ | 00:48 |
lifeless | manuallyfixing | 00:50 |
*** eguz has joined #tripleo | 00:53 | |
greghaynes | I havent encountered that before | 00:56 |
*** eghobo has quit IRC | 00:57 | |
*** xuhaiwei has joined #tripleo | 01:01 | |
GheRivero | failed. No valid host.. agh | 01:02 |
*** ramishra has quit IRC | 01:09 | |
*** ramishra has joined #tripleo | 01:13 | |
*** newell_ has quit IRC | 01:21 | |
GheRivero | lifeless: https://review.openstack.org/#/c/93078/ | 01:27 |
*** nosnos has joined #tripleo | 01:43 | |
*** shardy has quit IRC | 01:49 | |
lifeless | GheRivero: we lost https://review.openstack.org/#/c/93133/ as well | 01:49 |
SpamapS | so what's the status? | 01:50 |
lifeless | GheRivero: why not use the keystone location ? | 01:50 |
* SpamapS just waking from an evening nap :P | 01:50 | |
lifeless | SpamapS: ust kicking off a deploy now, hopefully it will go further | 01:51 |
lifeless | then we'll apply the manual fixes to the resulting undercloud and try an overcloud, then work back with ful automation at each step | 01:51 |
SpamapS | so are we convinced the change to element-deps handling was the culprit? | 01:51 |
SpamapS | or am I WAY out of date? | 01:51 |
*** yamahata has joined #tripleo | 01:53 | |
lifeless | way out of date | 02:00 |
lifeless | we're not even sure thats a thing now | 02:00 |
*** dkehnx1 has joined #tripleo | 02:10 | |
*** ramishra has quit IRC | 02:11 | |
*** dkehnx1 has quit IRC | 02:12 | |
*** chuckC has joined #tripleo | 02:31 | |
lifeless | 0k now we are back to our old friend trusty hang | 02:40 |
lifeless | we have the REDIRECT rule in place for metadata, so not that. | 02:40 |
GheRivero | :( | 02:43 |
GheRivero | don't tear down the undercloud | 02:43 |
lifeless | greg wanted to redo the seed earlier | 02:44 |
*** julim has quit IRC | 02:45 | |
GheRivero | stupid vpn. It's logging me out | 02:45 |
*** chuckC has quit IRC | 02:48 | |
lifeless | GheRivero: you need to update the vpn cert | 02:51 |
lifeless | GheRivero: I just asked NOC | 02:51 |
lifeless | ok undercloud init progressing | 02:52 |
lifeless | image built successfully | 02:52 |
lifeless | yay | 02:52 |
lifeless | -> hotel where I shall tickle an overcloud deploy | 02:52 |
greghaynes | Ah, our old friend trusty hnnng | 02:55 |
GheRivero | Ok. My laptop and the hotel wifi don't want to play together :( | 02:58 |
*** chuckC has joined #tripleo | 02:58 | |
*** untriaged-bot has joined #tripleo | 03:00 | |
untriaged-bot | Untriaged bugs so far: | 03:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1318767 | 03:00 |
uvirtbot | Launchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New] | 03:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317446 | 03:00 |
uvirtbot | Launchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress] | 03:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1314978 | 03:00 |
untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1319027 | 03:00 |
uvirtbot | Launchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New] | 03:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1315355 | 03:00 |
uvirtbot | Launchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New] | 03:00 |
uvirtbot | Launchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New] | 03:00 |
untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1318717 | 03:00 |
uvirtbot | Launchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress] | 03:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317778 | 03:00 |
uvirtbot | Launchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New] | 03:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1316675 | 03:00 |
uvirtbot | Launchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress] | 03:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317056 | 03:00 |
uvirtbot | Launchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New] | 03:00 |
*** untriaged-bot has quit IRC | 03:00 | |
GheRivero | amd back | 03:10 |
*** jang has joined #tripleo | 03:11 | |
*** ramishra has joined #tripleo | 03:12 | |
*** ramishra has quit IRC | 03:16 | |
GheRivero | greghaynes: are you redeploying the seed? | 03:17 |
greghaynes | no | 03:17 |
GheRivero | it's down | 03:18 |
GheRivero | virsh # list --all | 03:18 |
GheRivero | Id Name State | 03:18 |
GheRivero | ---------------------------------------------------- | 03:18 |
GheRivero | - seed shut off | 03:18 |
GheRivero | at least the undercloud is up | 03:19 |
greghaynes | GheRivero: You ran into the issue "ImportError: No module named nova.scheduler.ironic_host_manager" right? | 03:22 |
greghaynes | for nova-scheduler | 03:22 |
GheRivero | this afternoon | 03:22 |
greghaynes | No fix up for it yet? | 03:23 |
greghaynes | Just checking before I start debugging | 03:23 |
GheRivero | we didn't hit it now. So maybe it was a messed up undercloud image | 03:24 |
greghaynes | This is on my dev box | 03:24 |
*** jang has quit IRC | 03:24 | |
greghaynes | for the seed | 03:24 |
*** cody-somerville has joined #tripleo | 03:25 | |
GheRivero | you hit it? | 03:26 |
greghaynes | yep | 03:26 |
GheRivero | ironic is not instaled inside the nova venv. | 03:27 |
*** jang has joined #tripleo | 03:27 | |
greghaynes | https://bugs.launchpad.net/tripleo/+bug/1319241 | 03:28 |
uvirtbot | Launchpad bug 1319241 in tripleo "nova-scheduler fails to start with ImportError: No module named nova.scheduler.ironic_host_manager" [Undecided,New] | 03:29 |
*** jang has quit IRC | 03:29 | |
*** jang has joined #tripleo | 03:30 | |
GheRivero | noted | 03:31 |
*** nosnos has quit IRC | 03:33 | |
lifeless | GheRivero: no_proxy was teh thing :) | 03:33 |
lifeless | GheRivero: oh yiou've reproeduced the bug ? | 03:34 |
GheRivero | :/ stupid corporate policies | 03:34 |
GheRivero | greghaynes did | 03:34 |
lifeless | erm | 03:34 |
lifeless | greghaynes: ^ ? | 03:34 |
*** nati_ueno has joined #tripleo | 03:35 | |
lifeless | greghaynes: https://bugs.launchpad.net/diskimage-builder/+bug/1319152 was abut the same thing; may want to dup | 03:35 |
uvirtbot | Launchpad bug 1319152 in diskimage-builder "regression in dependency expansion" [Critical,Incomplete] | 03:35 |
greghaynes | ah | 03:35 |
lifeless | GheRivero: ok, I'm going to apply the ironic fixes | 03:35 |
lifeless | GheRivero: by hand | 03:35 |
GheRivero | lifeless: did you tear down the seed node? | 03:36 |
greghaynes | lifeless: Oh, I have ironic installed in /opt/stack | 03:36 |
lifeless | GheRivero: no | 03:36 |
lifeless | GheRivero: error: unsupported configuration: Domain requires KVM, but it is not available. Check that virtualization is enabled in the host BIOS, and host configuration is setup to load the kvm modules. | 03:36 |
GheRivero | greghaynes: do you have it installed inside the nova venv? | 03:37 |
lifeless | GheRivero: I think /dev got eaten | 03:37 |
lifeless | GheRivero: I think /dev got eaten | 03:37 |
GheRivero | :? | 03:37 |
lifeless | abah | 03:37 |
greghaynes | lifeless: ironic==2013.2.dev244.g9654a4e says pip freeze | 03:37 |
lifeless | build failed and rm'd /dev/* | 03:37 |
lifeless | greghaynes: ok thats better than we had here | 03:38 |
GheRivero | what the... | 03:38 |
lifeless | GheRivero: we'll want to reboot the jump host before we use the seed again | 03:40 |
GheRivero | we can wait for a overcloud test | 03:41 |
lifeless | installed NobodyCam 's fix rev 3 | 03:42 |
lifeless | oh nuts I just wedged it by doing o-c-c when the seed was down no heat metadata and it fails badly | 03:43 |
lifeless | fingers crossed, rebooting jump host | 03:43 |
*** morganfainberg_Z is now known as morganfainberg | 03:50 | |
*** jang has quit IRC | 03:50 | |
*** jang has joined #tripleo | 03:51 | |
lifeless | ok its booted | 03:54 |
*** eguz has quit IRC | 04:00 | |
lifeless | mkdir: cannot create directory �/var/run/rabbitmq�: Permission denied | 04:03 |
lifeless | /usr/lib/rabbitmq/bin/rabbitmq-server: 80: /usr/lib/rabbitmq/bin/rabbitmq-server: cannot create /var/run/rabbitmq/pid: Directory nonexistent | 04:03 |
lifeless | on reboot of the seed | 04:03 |
lifeless | and _mysql_exceptions.OperationalError: (2002, "Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)") | 04:04 |
lifeless | now back on undercloud | 04:10 |
lifeless | refreshing its config | 04:10 |
*** ramishra has joined #tripleo | 04:12 | |
lifeless | deploying overcloud | 04:14 |
GheRivero | ERROR | 04:15 |
lifeless | sadface | 04:16 |
lifeless | no walid host | 04:16 |
*** ramishra has quit IRC | 04:17 | |
xuhaiwei | lifeless:in undercloud, trying to boot an instance, but failed | 04:17 |
xuhaiwei | lifeless: can i boot an instance like usual | 04:19 |
lifeless | xuhaiwei: should be able to | 04:19 |
xuhaiwei | where is the log? | 04:19 |
*** cody-somerville has quit IRC | 04:22 | |
*** nosnos has joined #tripleo | 04:22 | |
lifeless | xuhaiwei: which log? | 04:22 |
xuhaiwei | lifeless: the instance booting failed, i want to see the log | 04:22 |
lifeless | xuhaiwei: sure; which one? | 04:23 |
lifeless | xuhaiwei: nova-conductor? -api? -scheduler? -baremetal ? | 04:23 |
lifeless | keystone, neutron etc... | 04:23 |
xuhaiwei | nova compute | 04:23 |
lifeless | most logs are in /var/log/upstart | 04:23 |
xuhaiwei | thank you | 04:24 |
GheRivero | lifeless: what did you change in ironic? | 04:32 |
lifeless | GheRivero: undercloud? pulled in NobodyCam's fix for parted | 04:36 |
*** nati_ueno has quit IRC | 04:36 | |
lifeless | GheRivero: set debug logging, and pulled in NobodyCam's fix tor rpc workers | 04:36 |
xuhaiwei | lifeless:I got a NoValidHost exception when booting an instance on undercloud, does this mean i should create a vm to be a host before booting an instance? | 04:37 |
lifeless | https://review.openstack.org/#/c/93463/1/elements/ironic/os-apply-config/etc/ironic/ironic.conf | 04:37 |
lifeless | xuhaiwei: no, it means that something went wrong | 04:37 |
xuhaiwei | I can't see the error message from nova-compute.log.1 | 04:37 |
lifeless | GheRivero: devananda: Ironic is responding super slowly | 04:37 |
lifeless | 11 seconds to do a node-show | 04:37 |
*** nati_ueno has joined #tripleo | 04:38 | |
lifeless | xuhaiwei: oh, I see - are you manually installing things? If so are you following devtest or just exploring? | 04:38 |
lifeless | xuhaiwei: nova hypervisor-stats will tell you if you have machines registered with the scheduler | 04:38 |
xuhaiwei | lifeless: I am not following devtest now, I have got a devtest enviroment, now just try to use it, for example booting another compute node | 04:40 |
xuhaiwei | lifeless:i can see free_disk_gb and free_ram_mb are 0, is this the reason? and why there is no new nova-compute log in /var/log/upstart | 04:42 |
lifeless | xuhaiwei: if there is nothing being written there is no log written | 04:43 |
xuhaiwei | lifeless: even if i start an instance? | 04:43 |
*** jang has quit IRC | 04:44 | |
lifeless | xuhaiwei: the request never hits the compute process if there is nowhere to deploy - it stops at the scheduler | 04:44 |
*** jang has joined #tripleo | 04:44 | |
lifeless | GheRivero: 2014-05-14 04:44:12.123 25940 WARNING nova.scheduler.filters.compute_filter [req-816dc5b9-4493-4592-af78-d5924f2 | 04:46 |
lifeless | 1e4bd7e1) ram:98304 disk:1638400 io_ops:0 instances:0 has not been heard from in a while | 04:46 |
lifeless | 16 seconds to run ironic driver-list | 04:47 |
lifeless | I'm going to try unregistering all but 5 nodes | 04:47 |
lifeless | I think this is a regression, since this *did* work a motnh ago | 04:48 |
*** dkehn_ has joined #tripleo | 04:58 | |
xuhaiwei | lifeless: i think devtest is designed to allocate specific memory for the seed,under and overcloud, so there is no free memory for user to create new overcloud, is it true? | 04:59 |
*** jang has quit IRC | 04:59 | |
lifeless | xuhaiwei: no | 04:59 |
*** ramishra has joined #tripleo | 04:59 | |
*** dkehn__ has quit IRC | 05:01 | |
xuhaiwei | lifeless: so in my environment on undercloud there is no free disk and memory, if i want to create a new overcloud what should i do? | 05:04 |
*** ramishra has quit IRC | 05:04 | |
lifeless | xuhaiwei: you need to register baremetal nodes with the undercloud | 05:07 |
lifeless | xuhaiwei: this is what devtest_undercloud does in setup-baremetal | 05:07 |
lifeless | ok, night all, I'm out | 05:15 |
xuhaiwei | lifeless: bye | 05:15 |
*** rlandy has joined #tripleo | 05:38 | |
*** nati_ueno has quit IRC | 05:44 | |
*** rakesh_hs has joined #tripleo | 05:46 | |
*** ramishra has joined #tripleo | 06:00 | |
*** ramishra has quit IRC | 06:05 | |
*** rakesh_hs has quit IRC | 06:13 | |
*** rakesh_hs has joined #tripleo | 06:13 | |
*** d0ugal has joined #tripleo | 06:25 | |
*** d0ugal has quit IRC | 06:25 | |
*** d0ugal has joined #tripleo | 06:25 | |
*** jtomasek has joined #tripleo | 06:32 | |
*** nati_ueno has joined #tripleo | 06:35 | |
*** kevinbenton has quit IRC | 06:37 | |
*** gcha has joined #tripleo | 06:38 | |
*** kevinbenton has joined #tripleo | 06:38 | |
*** ifarkas has joined #tripleo | 06:40 | |
*** nati_ueno has quit IRC | 06:40 | |
*** ifarkas has quit IRC | 06:41 | |
*** ifarkas has joined #tripleo | 06:41 | |
openstackgerrit | A change was merged to openstack/tripleo-incubator: Add keepalived to overcloud, control vip to heat https://review.openstack.org/89613 | 06:44 |
*** hashar has joined #tripleo | 06:47 | |
*** jtomasek has quit IRC | 06:47 | |
*** hashar has quit IRC | 06:52 | |
*** peoplemerge has joined #tripleo | 06:52 | |
*** hashar has joined #tripleo | 06:53 | |
*** geertj has joined #tripleo | 06:54 | |
*** pblaho has joined #tripleo | 06:59 | |
*** e0ne has joined #tripleo | 07:00 | |
*** jprovazn has joined #tripleo | 07:01 | |
*** ramishra has joined #tripleo | 07:01 | |
*** e0ne has quit IRC | 07:02 | |
*** ramishra has quit IRC | 07:05 | |
*** yamahata has quit IRC | 07:21 | |
goneri | hi all, can a core take a look on https://review.openstack.org/#/c/91829/ to unblock https://review.openstack.org/#/c/88534/ | 07:28 |
*** rcarrillocruz has joined #tripleo | 07:30 | |
jprovazn | goneri: hi, sure | 07:30 |
*** rcarrill` has quit IRC | 07:30 | |
goneri | jprovazn: thanks :) | 07:33 |
*** nati_ueno has joined #tripleo | 07:36 | |
*** nati_ueno has quit IRC | 07:41 | |
*** jtomasek has joined #tripleo | 07:51 | |
*** darraghb has joined #tripleo | 07:53 | |
*** hashar has quit IRC | 07:58 | |
*** ramishra has joined #tripleo | 08:02 | |
*** ramishra has quit IRC | 08:06 | |
*** xuhaiwei has quit IRC | 08:09 | |
lxsli | +A for https://review.openstack.org/90983 https://review.openstack.org/93072 please? | 08:18 |
lxsli | Also https://review.openstack.org/#/c/91801/ | 08:19 |
lxsli | All those have a +2 already | 08:20 |
lxsli | 90983+93072 have dependent patches, also with +2 | 08:20 |
*** ramishra has joined #tripleo | 08:20 | |
*** hashar has joined #tripleo | 08:22 | |
*** jp_at_hp has joined #tripleo | 08:22 | |
openstackgerrit | A change was merged to openstack/diskimage-builder: 4 spaces indent https://review.openstack.org/91829 | 08:26 |
lxsli | goneri: nice one! | 08:27 |
goneri | I pretty surprise I didn't have to go in a “rebase dance” for this one :) | 08:28 |
goneri | probably because everybody is at the summit | 08:28 |
lxsli | Zuul queue is pretty nice too :) | 08:31 |
goneri | yeah :) | 08:32 |
openstackgerrit | A change was merged to openstack/diskimage-builder: indent: search for !=4 spaces indentation https://review.openstack.org/88534 | 08:33 |
openstackgerrit | A change was merged to openstack/tripleo-image-elements: Add IPv4 flag for Ironic's TFTP setup https://review.openstack.org/87208 | 08:33 |
*** ramishra has quit IRC | 08:34 | |
goneri | well I'm also interested by some +A on these patches, all of them are pretty trivial and already come with +2 https://review.openstack.org/#/c/91823/ https://review.openstack.org/#/c/91818/ https://review.openstack.org/#/c/85271/ https://review.openstack.org/#/c/85272/ | 08:35 |
*** martyntaylor has joined #tripleo | 08:36 | |
*** nati_ueno has joined #tripleo | 08:37 | |
*** giulivo has joined #tripleo | 08:38 | |
*** martyntaylor has left #tripleo | 08:38 | |
*** nati_ueno has quit IRC | 08:42 | |
rcarrillocruz | morning tripleo! | 08:48 |
giulivo | hi rcarrillocruz :) | 08:49 |
giulivo | morning for me too on this side of the world | 08:49 |
rcarrillocruz | heh, yeah, not that many people on this side of the world this week :P | 08:50 |
giulivo | not for the people in atlanta though | 08:50 |
giulivo | indeed | 08:50 |
*** untriaged-bot has joined #tripleo | 09:00 | |
untriaged-bot | Untriaged bugs so far: | 09:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1318767 | 09:00 |
uvirtbot | Launchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New] | 09:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317446 | 09:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1314978 | 09:00 |
uvirtbot | Launchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress] | 09:00 |
untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1319027 | 09:00 |
uvirtbot | Launchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New] | 09:00 |
uvirtbot | Launchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New] | 09:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1315355 | 09:00 |
uvirtbot | Launchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New] | 09:00 |
untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1318717 | 09:00 |
uvirtbot | Launchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress] | 09:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317778 | 09:00 |
uvirtbot | Launchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New] | 09:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1316675 | 09:00 |
uvirtbot | Launchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress] | 09:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317056 | 09:00 |
*** untriaged-bot has quit IRC | 09:00 | |
uvirtbot | Launchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New] | 09:00 |
*** ramishra has joined #tripleo | 09:01 | |
*** gcha has quit IRC | 09:01 | |
goneri | lxsli: sorry for -1 but I think it the good time to remove the MysqlInnodbBufferPoolSize hack too https://review.openstack.org/#/c/93072/ | 09:04 |
*** rlandy has quit IRC | 09:04 | |
*** bkero has quit IRC | 09:06 | |
*** hashar has quit IRC | 09:07 | |
*** NobodyCam has quit IRC | 09:07 | |
*** bkero has joined #tripleo | 09:07 | |
*** NobodyCam has joined #tripleo | 09:08 | |
*** gcha has joined #tripleo | 09:10 | |
lxsli | goneri: did you see the dependent patch? | 09:14 |
lxsli | https://review.openstack.org/#/c/93073/ | 09:14 |
goneri | lxsli: oh | 09:15 |
goneri | lxsli: the // operator is a “or” | 09:17 |
goneri | the code snippet works https://review.openstack.org/#/c/93072/1/scripts/devtest_undercloud.sh works | 09:17 |
goneri | it seems to me more natural than https://review.openstack.org/#/c/93073/1/scripts/devtest_undercloud.sh | 09:17 |
lxsli | I see what you mean, I'm using a bit of a trick whereas // is more obvious | 09:21 |
lxsli | let me think a little - either way, I'll change 93073 not 93072 | 09:21 |
lxsli | goneri: did I do something wrong? http://paste.openstack.org/show/80326/ | 09:32 |
*** nati_ueno has joined #tripleo | 09:38 | |
*** hashar has joined #tripleo | 09:38 | |
goneri | echo '{}'| jq '.parameters += {"a": (.parameters.a // 123)}' | 09:41 |
goneri | echo '{ "parameters": { "a": "lapin"} }'| jq '.parameters += {"a": (.parameters.a // 123)}' | 09:41 |
*** nati_ueno has quit IRC | 09:42 | |
*** ramishra has quit IRC | 09:42 | |
goneri | I'm not sure I understand your comment | 09:43 |
goneri | with this filter, we keep parameters.a if it is defined. Or we define it at 123. right? | 09:44 |
lxsli | goneri: both tests show "a" being overwritten whether or not it is set initially | 09:45 |
lxsli | we want the default to only be applied if "a" is unset | 09:46 |
goneri | lxsli: http://paste.openstack.org/show/80331/ | 09:47 |
goneri | parameters.a is not overwritten in the second case | 09:47 |
lxsli | Are you using jq v1.2? | 09:48 |
goneri | lxsli: that's the script I used to reproduce your code http://paste.openstack.org/show/80332/ | 09:48 |
lxsli | this is getting weird | 09:48 |
goneri | 1.3 here | 09:49 |
lxsli | aha! Let me upgrade | 09:49 |
*** ekarlso has joined #tripleo | 09:52 | |
ekarlso | Hi guys | 09:52 |
ekarlso | i'm seeing a problem with rmq clusters not coming up properly on some runs | 09:52 |
ekarlso | the first node typically comes up but 2-3rd doesn't due to random failures by the looks ranging from the rmq service restart hanging or the mnesia tables not being found on the node | 09:53 |
*** ramishra has joined #tripleo | 09:55 | |
openstackgerrit | Dmitry Shulyak proposed a change to openstack/tripleo-image-elements: Allow services ports configuration https://review.openstack.org/92550 | 10:00 |
lxsli | goneri: I'm not sure how to guarantee jq 1.3 is installed, so using a solution that works on 1.2 seems safer. I'll comment to that effect | 10:02 |
goneri | lxsli: or, use the 1.3 solution and keep the 1.2 hack with a message | 10:06 |
goneri | http://packages.ubuntu.com/search?keywords=jq | 10:07 |
goneri | trusty comes with 1.3 | 10:07 |
lxsli | What base image distros is TripleO targeted at? I think there are others than Ubuntu | 10:08 |
*** rameshg87 has joined #tripleo | 10:09 | |
goneri | I don't know, I cannot find the information. I would say, the last Ubuntu LTS and Fedora 20. | 10:11 |
lxsli | I think RHEL + SUSE too | 10:12 |
goneri | hum right | 10:13 |
* goneri connect on RHN to see the current jq version | 10:13 | |
goneri | jq 1.3 is in EPEL | 10:14 |
*** jtomasek has quit IRC | 10:15 | |
lxsli | looks like it might be on OpenSUSE too | 10:15 |
lxsli | So I guess the question is whether Saucy is still a target | 10:16 |
goneri | I drop the -1. I will propose a patch when jq 1.3 will be the default everywhere :) | 10:22 |
goneri | BTW, I like these changes, it's much more clean. Thank you. | 10:23 |
lxsli | OK thanks goneri :) | 10:25 |
lxsli | had a chat with a colleague and ofc this is part of a devtest script so it's the user's local workstation that matters not the base image | 10:25 |
lxsli | Which is totally uncontrolled atm, afaik we have no way to say a local package must have version >= X | 10:26 |
*** ramishra has quit IRC | 10:29 | |
*** akrivoka has joined #tripleo | 10:37 | |
*** nati_ueno has joined #tripleo | 10:38 | |
goneri | lxsli: this may be a solution :) https://github.com/mwilliamson/jq.py | 10:40 |
goneri | but it's not pure perl | 10:40 |
lxsli | Warning: the API is not stable. | 10:40 |
goneri | s/perl/python/ | 10:40 |
lxsli | Thank the lords above it's not pure Perl :) | 10:40 |
goneri | =) | 10:41 |
lxsli | I started trying to explain blessed references to someone last year and they nearly cried | 10:41 |
*** ramishra has joined #tripleo | 10:43 | |
*** nati_ueno has quit IRC | 10:43 | |
lifeless | ohhhh, eth0 vs eth2 again. that might explain it. | 10:44 |
lxsli | lifeless! | 10:45 |
lxsli | https://review.openstack.org/93072 https://review.openstack.org/93073 | 10:45 |
lifeless | morning :) | 10:45 |
lxsli | https://review.openstack.org/90983 https://review.openstack.org/93041 | 10:45 |
lxsli | https://review.openstack.org/91801 pretty please? | 10:45 |
lxsli | I think you've seen it all before + they have +2s so should be quick | 10:46 |
*** mestery has joined #tripleo | 10:55 | |
*** mestery has quit IRC | 10:59 | |
lifeless | lxsli: will look a little later today | 11:01 |
* SpamapS awakens, fully refreshed | 11:03 | |
lxsli | thanks lifeless | 11:03 |
lxsli | ooh, if you could argue directly about https://review.openstack.org/92356 that would also be great :) | 11:04 |
lxsli | morning | 11:04 |
lifeless | SpamapS: I think I know twhat the trusty deadlock might be | 11:07 |
lifeless | 1 | 11:08 |
lifeless | we booted with eth0 not eth2 in the metadata | 11:08 |
*** jtomasek has joined #tripleo | 11:11 | |
*** ramishra has quit IRC | 11:11 | |
*** chuckC has quit IRC | 11:14 | |
lifeless | oh yeah thats a lot happier. | 11:16 |
lifeless | bug etc coming in a bit | 11:16 |
openstackgerrit | Giulio Fidente proposed a change to openstack/tripleo-incubator: Clarify the requirements for the TRIPLEO_ROOT variable https://review.openstack.org/92611 | 11:26 |
*** geertj has quit IRC | 11:30 | |
SpamapS | lifeless: interesting | 11:32 |
*** chuckC has joined #tripleo | 11:32 | |
*** gcha has quit IRC | 11:36 | |
openstackgerrit | Dmitry Shulyak proposed a change to openstack/tripleo-image-elements: Allow services ports configuration https://review.openstack.org/92550 | 11:38 |
*** gcha has joined #tripleo | 11:38 | |
*** weshay has quit IRC | 11:39 | |
*** nati_ueno has joined #tripleo | 11:39 | |
*** nati_ueno has quit IRC | 11:44 | |
*** geertj has joined #tripleo | 11:49 | |
*** akrivoka has quit IRC | 11:52 | |
*** rlandy has joined #tripleo | 11:54 | |
*** mestery has joined #tripleo | 11:56 | |
*** weshay has joined #tripleo | 11:57 | |
openstackgerrit | Nicholas Randon proposed a change to openstack/tripleo-incubator: Export seed ip instead of gateway ip. https://review.openstack.org/93553 | 12:00 |
*** akrivoka has joined #tripleo | 12:00 | |
*** nati_ueno has joined #tripleo | 12:03 | |
*** mestery has quit IRC | 12:04 | |
*** pblaho has quit IRC | 12:06 | |
*** gcha has quit IRC | 12:07 | |
*** nati_ueno has quit IRC | 12:08 | |
*** nati_ueno has joined #tripleo | 12:09 | |
*** gcha has joined #tripleo | 12:09 | |
*** gcha has quit IRC | 12:09 | |
*** gcha has joined #tripleo | 12:10 | |
*** mestery has joined #tripleo | 12:11 | |
lifeless | -> conf | 12:12 |
*** nati_ueno has quit IRC | 12:13 | |
GheRivero | morning all | 12:16 |
dshulyak | morning | 12:18 |
openstackgerrit | Dmitry Shulyak proposed a change to openstack/tripleo-heat-templates: WIP: Haproxy configuration https://review.openstack.org/93554 | 12:22 |
*** rameshg87 has left #tripleo | 12:25 | |
*** yamahata has joined #tripleo | 12:26 | |
*** e0ne has joined #tripleo | 12:29 | |
*** mestery has quit IRC | 12:33 | |
*** e0ne has quit IRC | 12:33 | |
*** akrivoka has quit IRC | 12:38 | |
jp_at_hp | any tripleo cores able to approve this please? https://review.openstack.org/#/c/93042/ devtest is currently broken over it... | 12:40 |
*** yamahata has quit IRC | 12:41 | |
*** akrivoka has joined #tripleo | 12:46 | |
*** akrivoka has quit IRC | 12:46 | |
GheRivero | sorry jp_at_hp, I can't give more votes :( | 12:47 |
*** gcha has quit IRC | 12:47 | |
*** akrivoka has joined #tripleo | 12:47 | |
lxsli | GheRivero: if you're in a giving mood I pasted a ton of +2'd changes above. All pretty simple :) | 12:48 |
GheRivero | lxsli: I have like... 10 minutes before the summit sessions start, but will try to look at some | 12:48 |
lxsli | that'd be great, thanks! | 12:49 |
*** gcha has joined #tripleo | 12:50 | |
*** noslzzp has joined #tripleo | 12:51 | |
*** chuckC has quit IRC | 12:52 | |
openstackgerrit | Nicholas Randon proposed a change to openstack/tripleo-incubator: Separate Heat BM and VM configs for Nova-BM. https://review.openstack.org/90033 | 12:53 |
*** nati_ueno has joined #tripleo | 12:54 | |
*** gcha has quit IRC | 12:54 | |
*** chuckC has joined #tripleo | 12:55 | |
*** gcha has joined #tripleo | 12:55 | |
*** rakesh_hs has quit IRC | 12:55 | |
*** lazy_prince has joined #tripleo | 12:58 | |
*** ramishra has joined #tripleo | 12:59 | |
*** eghobo has joined #tripleo | 13:00 | |
*** morazi has joined #tripleo | 13:02 | |
*** gcha has quit IRC | 13:03 | |
*** gcha has joined #tripleo | 13:03 | |
*** dshulyak has quit IRC | 13:10 | |
*** dshulyak has joined #tripleo | 13:14 | |
*** morganfainberg is now known as morganfainberg_Z | 13:16 | |
openstackgerrit | Nicholas Randon proposed a change to openstack/tripleo-incubator: Export seed ip instead of gateway ip. https://review.openstack.org/93553 | 13:17 |
*** julim has joined #tripleo | 13:17 | |
*** morazi has quit IRC | 13:19 | |
*** morazi has joined #tripleo | 13:20 | |
*** funzo has joined #tripleo | 13:20 | |
lifeless | https://etherpad.openstack.org/p/tripleo-end-to-end-automatic-bm <- folk interested in bringup of tripleo on a rack with no hands-on-fiddling | 13:26 |
lifeless | greghaynes: https://review.openstack.org/#/c/93132/ failed on overcloud | 13:31 |
lifeless | Can I get a review on https://review.openstack.org/#/c/93475/ ? | 13:31 |
lifeless | oh, failedovercloud | 13:31 |
*** julim has quit IRC | 13:34 | |
StevenK | lifeless: I'm going to Abandon https://review.openstack.org/#/c/93489/ | 13:34 |
lifeless | ack | 13:35 |
*** ramishra has quit IRC | 13:35 | |
openstackgerrit | Ghe Rivero proposed a change to openstack/tripleo-image-elements: Fix ironic api port in nova element https://review.openstack.org/93078 | 13:38 |
*** eghobo has quit IRC | 13:40 | |
*** morazi has quit IRC | 13:43 | |
*** nati_ueno has quit IRC | 13:44 | |
*** nati_ueno has joined #tripleo | 13:45 | |
*** e0ne has joined #tripleo | 13:46 | |
*** ramishra has joined #tripleo | 13:49 | |
*** nati_uen_ has joined #tripleo | 13:49 | |
goneri | jp_at_hp: thanks for your feedback. Yes, it's obvious it's not a good idea with the Galera<>MySQL example. | 13:49 |
*** nati_ueno has quit IRC | 13:50 | |
jp_at_hp | goneri: no probs. I thought the original to only allow 1 type of operating-system was good, but I guess you can't please all of the people all of the time :D | 13:50 |
*** noslzzp has quit IRC | 13:51 | |
*** nati_uen_ has quit IRC | 13:53 | |
goneri | jp_at_hp: ahah :) I was about to adjust to change back to the “operating-system” check, but the backlog is huge. I will prepare another patch in the future. | 13:56 |
tchaypo | GOOD MORNING FREEDOM LOVERS | 13:58 |
StevenK | tchaypo: Who do you think you are, jdub? | 13:58 |
*** nati_ueno has joined #tripleo | 13:58 | |
GheRivero | tchaypo: Freedom lovers? You are attached to your 'portable' system | 13:59 |
tchaypo | StevenK: I'm so glad someone understood | 13:59 |
StevenK | tchaypo: Anyway, it doesn't feel like morning, I've been at GWCC since 7:20 | 14:00 |
tchaypo | GheRivero: you'll have to speak up, i can't hear you over top of my screen ;) | 14:01 |
tchaypo | StevenK: yes, i saw you walking that way while I was enjoying breakfast at the doubletree | 14:01 |
tchaypo | GheRivero: okay, the noise cancelling headphones may have something to do with not being able to hear you as well... maybe.. | 14:01 |
* StevenK had breakfast with the Foundation board | 14:02 | |
lifeless | GheRivero: I got things working | 14:02 |
lifeless | GheRivero: https://etherpad.openstack.org/p/tripleo-end-to-end-automatic-bm | 14:02 |
GheRivero | lifeless: cool! | 14:02 |
*** nosnos has quit IRC | 14:03 | |
GheRivero | agh! I do really need a machine for the VPN. Too bad it doesn't work from the hpcloud | 14:04 |
lifeless | GheRivero: yeah :( | 14:04 |
GheRivero | I think I will try recover my 'server' from my former university datacenter now that they are freeing a bunch of machines by replacing Exchange Mail with GMail | 14:06 |
StevenK | GheRivero: And host it where? | 14:09 |
lifeless | is there a bug for the truty boot hang ? | 14:09 |
GheRivero | At the university datacenter. I still have 'privileges' there :) And a 10Gb bandwidth | 14:10 |
StevenK | GheRivero: Oh, recover, but not move it | 14:10 |
GheRivero | lifeless: https://bugs.launchpad.net/tripleo/+bug/1316475 | 14:12 |
uvirtbot | Launchpad bug 1316475 in tripleo "trusty hang on first boot post deploy" [Critical,Triaged] | 14:12 |
*** blamar has joined #tripleo | 14:14 | |
lifeless | it looks like overcloud-precise is broken in all jobs? | 14:16 |
GheRivero | do you what happened to http://goodsquishy.com/downloads/tripleo-jobs.html? | 14:17 |
GheRivero | was really cool to check out those things | 14:17 |
lifeless | derekh will | 14:17 |
*** d0ugal has quit IRC | 14:20 | |
*** lazy_prince has quit IRC | 14:22 | |
lifeless | hmm | 14:23 |
lifeless | + os-svc-restart -n neutron-openvswitch-agent | 14:23 |
lifeless | stop: Unknown instance: | 14:23 |
lifeless | start: Job failed to start | 14:23 |
jp_at_hp | so - is anyonw able to approve either of the commits that will fix the current devtest.sh breakage? | 14:23 |
StevenK | jp_at_hp: Oh? | 14:24 |
*** lazy_prince has joined #tripleo | 14:25 | |
*** d0ugal has joined #tripleo | 14:25 | |
*** d0ugal has quit IRC | 14:25 | |
*** d0ugal has joined #tripleo | 14:25 | |
*** deklan has joined #tripleo | 14:26 | |
jp_at_hp | https://review.openstack.org/93042 or https://review.openstack.org/90033 | 14:26 |
*** deklan has quit IRC | 14:30 | |
*** deklan has joined #tripleo | 14:30 | |
GheRivero | lifeless: are you rebuilding the overcloud? | 14:31 |
lifeless | GheRivero: yes, hoping its as simple as a stale image | 14:32 |
*** ramishra has quit IRC | 14:33 | |
*** deklan has quit IRC | 14:36 | |
*** e0ne has quit IRC | 14:36 | |
*** jprovazn has quit IRC | 14:36 | |
*** chuckC has quit IRC | 14:36 | |
GheRivero | btw. did you said yesterday that an image build failed and rm /dev ? Sounds weird! | 14:37 |
tchaypo | GheRivero: I've had that happen to me once | 14:40 |
*** eghobo has joined #tripleo | 14:43 | |
*** e0ne has joined #tripleo | 14:45 | |
*** blamar has quit IRC | 14:45 | |
*** noslzzp has joined #tripleo | 14:46 | |
*** blamar has joined #tripleo | 14:53 | |
*** chuckC has joined #tripleo | 14:57 | |
lifeless | GheRivero: yes, occasional dib fffail | 14:58 |
*** untriaged-bot has joined #tripleo | 15:00 | |
untriaged-bot | Untriaged bugs so far: | 15:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1318767 | 15:00 |
uvirtbot | Launchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New] | 15:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317446 | 15:00 |
uvirtbot | Launchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress] | 15:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1314978 | 15:00 |
uvirtbot | Launchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New] | 15:00 |
untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1319027 | 15:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1315355 | 15:00 |
uvirtbot | Launchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New] | 15:00 |
untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1318717 | 15:00 |
uvirtbot | Launchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New] | 15:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317778 | 15:00 |
uvirtbot | Launchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress] | 15:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1316675 | 15:00 |
uvirtbot | Launchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New] | 15:00 |
uvirtbot | Launchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress] | 15:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317056 | 15:00 |
*** untriaged-bot has quit IRC | 15:00 | |
uvirtbot | Launchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New] | 15:00 |
*** julim has joined #tripleo | 15:02 | |
*** killer_p- has joined #tripleo | 15:04 | |
*** ramishra has joined #tripleo | 15:04 | |
*** killer_p- is now known as killer_prince | 15:04 | |
*** sballe has joined #tripleo | 15:06 | |
*** rbrady has joined #tripleo | 15:10 | |
*** killer_p- has joined #tripleo | 15:12 | |
*** killer_prince has quit IRC | 15:14 | |
*** killer_p- is now known as killer_prince | 15:14 | |
*** ifarkas has quit IRC | 15:14 | |
*** julim has quit IRC | 15:17 | |
*** shakayumi has joined #tripleo | 15:18 | |
*** cody-somerville has joined #tripleo | 15:20 | |
*** IvanBerezovskiy1 has left #tripleo | 15:23 | |
*** deklan has joined #tripleo | 15:23 | |
openstackgerrit | Dmitry Shulyak proposed a change to openstack/tripleo-image-elements: Add haproxy stats to listen on 9000 port https://review.openstack.org/93580 | 15:23 |
*** jeremydei_ has joined #tripleo | 15:25 | |
*** jeremydei has quit IRC | 15:25 | |
*** blamar has quit IRC | 15:28 | |
*** shakayumi has quit IRC | 15:28 | |
*** shakayumi has joined #tripleo | 15:31 | |
giulivo | guys, to avoid the devtest script being stopped in the middle of devtest_setup for the user to relogin with the new group, how about we move the libvirt membership addition out of install-dependencies and in a own script launched _after_ setup-clienttools ? | 15:32 |
*** shakayumi has quit IRC | 15:33 | |
StevenK | giulivo: I thought we needed to re-exec _setup after the group membership anyway? | 15:33 |
giulivo | hi StevenK indeed at the moment that it how it goes but we can avoid asking to re-run _setup if the libvirt membership addition happens at the end of the script | 15:34 |
*** blamar has joined #tripleo | 15:35 | |
StevenK | giulivo: I thought portions of _setup required the membership ? | 15:35 |
StevenK | giulivo: Perhaps move the check and group addition to a script that is run before _setup if I'm correct. | 15:36 |
*** chuckC has quit IRC | 15:36 | |
giulivo | StevenK, also valid for me yes | 15:36 |
giulivo | as long as we avoid stopping the script in between the steps I think that would be better | 15:36 |
* giulivo thinks it is only cleanup-env which depends on the libvirtd membership though | 15:37 | |
*** eghobo has quit IRC | 15:37 | |
StevenK | _testenv is after _setup, I *think*, in which case a seperate script is fine | 15:37 |
StevenK | And it removes some *horrible* code from _setup, so +1 | 15:38 |
giulivo | StevenK, ok, thanks for the quick chat, I'll try that and add you to the review | 15:40 |
*** nati_ueno has quit IRC | 15:40 | |
*** julim has joined #tripleo | 15:41 | |
*** nati_ueno has joined #tripleo | 15:41 | |
giulivo | StevenK, I'm also unsure if/when we should use "sudo virsh" when we want the user to be in the libvirtd group | 15:43 |
*** noslzzp has quit IRC | 15:43 | |
giulivo | StevenK, is there a reason why some commands use "sudo virsh" and others do stuff with user's credentials? | 15:44 |
*** shakayumi has joined #tripleo | 15:44 | |
StevenK | giulivo: Some commands may require creating or deleting files in root-owned directories, AFAIR | 15:45 |
*** chuckC has joined #tripleo | 15:45 | |
giulivo | as far as I understand, we need the user to be in the libvirtd group so that baremetal can do poweron/poweroff using user's credentials, is that correct? | 15:45 |
StevenK | Right | 15:46 |
*** nati_ueno has quit IRC | 15:46 | |
giulivo | but if a user belongs to the libvirtd group, hopefully libvirt is not going to require user to have privileges to write in its config directory | 15:46 |
StevenK | giulivo: Feel free to remove the sudo from the calls, and see which ones break | 15:47 |
StevenK | Less sudo is also a win | 15:47 |
giulivo | hehe yeah I'll try to mess up a bit and see, thanks! | 15:47 |
*** deklan has quit IRC | 15:47 | |
*** rbrady has quit IRC | 15:48 | |
*** lazy_prince has quit IRC | 15:51 | |
*** beecee has joined #tripleo | 15:53 | |
*** nati_ueno has joined #tripleo | 15:54 | |
*** blamar has quit IRC | 15:54 | |
*** rbrady has joined #tripleo | 15:59 | |
*** hashar has quit IRC | 16:01 | |
openstackgerrit | Michael Tupitsyn proposed a change to openstack/tripleo-incubator: Handy utility to deep merge JSON strings https://review.openstack.org/92881 | 16:02 |
*** julim has quit IRC | 16:03 | |
*** mestery has joined #tripleo | 16:06 | |
*** marun has joined #tripleo | 16:08 | |
openstackgerrit | Coleman Corrigan proposed a change to openstack/diskimage-builder: Added a DIB_TIDY_IMAGE toggle for image tidy up https://review.openstack.org/93594 | 16:10 |
openstackgerrit | A change was merged to openstack/tripleo-incubator: tripleo not configuring baremetal correctly in undercloud https://review.openstack.org/93042 | 16:12 |
*** deklan has joined #tripleo | 16:15 | |
openstackgerrit | Jon-Paul Sullivan (jp_at_hp) proposed a change to openstack/tripleo-incubator: Revert to correctly determining nodes needed https://review.openstack.org/93597 | 16:17 |
*** mestery has quit IRC | 16:21 | |
*** deklan has quit IRC | 16:21 | |
openstackgerrit | Jon-Paul Sullivan (jp_at_hp) proposed a change to openstack/tripleo-incubator: Revert to correctly determining nodes needed https://review.openstack.org/93597 | 16:22 |
*** ramishra has quit IRC | 16:23 | |
*** shakayumi has quit IRC | 16:24 | |
*** newell_ has joined #tripleo | 16:25 | |
*** nati_ueno has quit IRC | 16:27 | |
goneri | can a core take a look on the following (trivial) patches https://review.openstack.org/#/c/91823/ and https://review.openstack.org/#/c/91818/ | 16:27 |
*** nati_ueno has joined #tripleo | 16:27 | |
lifeless | ok so I don't know what teh trusty lockup is | 16:28 |
*** noslzzp has joined #tripleo | 16:28 | |
lifeless | GheRivero: / greghaynes: I think we're back to hacking on that now | 16:29 |
lifeless | I have a 40 node cluster thats got 40 active nodes, but multiple stuck on the lockup | 16:29 |
*** chuckC has quit IRC | 16:29 | |
lifeless | e.g. * Stopping DHCP any connected, but unconfigured network interfaces [ OK ] | 16:29 |
GheRivero | ok. taking a look | 16:29 |
lifeless | * Starting configure network device [ OK ] | 16:29 |
GheRivero | which one is the one you have the console open? | 16:30 |
lifeless | on the node with ip 10.22.157.153 (screen window 2 atm ) | 16:30 |
lifeless | gotta run, meeting :( - ping a node that you can't ssh to from nova-list :) | 16:30 |
GheRivero | I will reboot it to inspect the logs | 16:31 |
*** nati_ueno has quit IRC | 16:31 | |
*** rbrady has quit IRC | 16:31 | |
*** marun has quit IRC | 16:33 | |
*** noslzzp has quit IRC | 16:35 | |
*** sballe has quit IRC | 16:36 | |
openstackgerrit | Coleman Corrigan proposed a change to openstack/diskimage-builder: Added a DIB_TIDY_IMAGE toggle for image tidy up https://review.openstack.org/93594 | 16:36 |
*** noslzzp has joined #tripleo | 16:38 | |
*** akuznetsov has quit IRC | 16:39 | |
GheRivero | the check-tripleo-overcloud-precise is failing due to a rabbitmq issue | 16:48 |
GheRivero | start: Job is already running: rabbitmq-server | 16:49 |
*** eghobo has joined #tripleo | 16:52 | |
*** nati_ueno has joined #tripleo | 16:55 | |
*** akuznetsov has joined #tripleo | 16:58 | |
geertj | Hi all, I was looking into adding support for ravellosystems.com to devtest.sh. | 17:00 |
geertj | I was looking at the code, and not sure where to start. | 17:01 |
geertj | Any pointers? | 17:01 |
*** nati_ueno has quit IRC | 17:03 | |
*** nati_ueno has joined #tripleo | 17:04 | |
*** eghobo has quit IRC | 17:07 | |
*** eghobo has joined #tripleo | 17:07 | |
*** blamar has joined #tripleo | 17:08 | |
*** nati_ueno has quit IRC | 17:08 | |
*** e0ne has quit IRC | 17:16 | |
*** e0ne has joined #tripleo | 17:18 | |
openstackgerrit | Christian Berendt proposed a change to openstack/python-tuskarclient: replaced e.message with unicode(e) https://review.openstack.org/93606 | 17:18 |
*** darraghb has quit IRC | 17:28 | |
*** nati_ueno has joined #tripleo | 17:31 | |
victor_lowther | In the Docker stuff I am working on I handle that by telling libvirtd that anyone can access it via the unix socket and that everyone has to use qemu:///system. | 17:32 |
*** eguz has joined #tripleo | 17:33 | |
victor_lowther | er, w.r.t virsh stuff. | 17:33 |
*** chuckC has joined #tripleo | 17:35 | |
*** eguz has quit IRC | 17:36 | |
*** akuznetsov has quit IRC | 17:37 | |
*** eghobo has quit IRC | 17:37 | |
*** nati_ueno has quit IRC | 17:43 | |
*** e0ne has quit IRC | 17:43 | |
*** nati_ueno has joined #tripleo | 17:44 | |
*** nati_ueno has quit IRC | 17:45 | |
*** nati_ueno has joined #tripleo | 17:46 | |
*** jrist has joined #tripleo | 17:46 | |
*** chuckC has quit IRC | 17:49 | |
*** mestery has joined #tripleo | 17:51 | |
*** ramishra has joined #tripleo | 17:52 | |
*** noslzzp has quit IRC | 17:53 | |
*** chuckC has joined #tripleo | 17:54 | |
*** rwsu has quit IRC | 17:55 | |
*** julim has joined #tripleo | 17:56 | |
*** marun has joined #tripleo | 17:57 | |
*** geertj has quit IRC | 18:00 | |
lifeless | hi | 18:03 |
lifeless | I might try saucy again | 18:03 |
lifeless | would I annoy anyone if I did that? | 18:04 |
*** akrivoka has quit IRC | 18:04 | |
lifeless | the deploy layer is trusty, and I want to just flush out if there are heat issue etc still lukring | 18:04 |
GheRivero | :/ I was trying to debug some nodes and getting a list of failing ones, just in case is something hw | 18:04 |
greghaynes | GheRivero: I was thinking we might also do the set -x in dhcp-all-interfaces and output console in the upstart job for the whole overcloud | 18:05 |
greghaynes | just to get more info | 18:05 |
*** deklan has joined #tripleo | 18:05 | |
GheRivero | lifeless: opinion on that? ^^ | 18:06 |
lifeless | GheRivero: it could be | 18:06 |
lifeless | GheRivero: can I help ? | 18:06 |
lifeless | GheRivero: are you going top-> down ? | 18:07 |
GheRivero | I'm going in order | 18:07 |
lifeless | which order - nova? ironic? | 18:07 |
lifeless | ip ? | 18:07 |
GheRivero | don't know if all the ips are actually leased | 18:08 |
lifeless | nova list will tell you | 18:08 |
GheRivero | ip order 149-> and increasing. | 18:09 |
lifeless | jogo_: you're not in the upgrade ssession | 18:09 |
GheRivero | :) not the best way. but don;t have to keep track where I am in the list | 18:09 |
StevenK | lifeless: Lies | 18:10 |
StevenK | ;-) | 18:10 |
*** deklan has quit IRC | 18:12 | |
*** shakayumi has joined #tripleo | 18:14 | |
lifeless | GheRivero: nova list | grep ctlplane | sed -e 's/^.*10.22.157.\(.*\) .*$/heat-admin@10.22.157.\1/' | xargs -n1 ssh :) | 18:19 |
GheRivero | I already got the list.. Now I'm translating the nova ips to ipmi ip | 18:19 |
lifeless | kk | 18:21 |
*** ramishra has quit IRC | 18:21 | |
*** ramishra has joined #tripleo | 18:21 | |
*** ramishra_ has joined #tripleo | 18:24 | |
*** ramishra has quit IRC | 18:24 | |
*** shakayumi has quit IRC | 18:26 | |
*** deklan has joined #tripleo | 18:26 | |
*** e0ne has joined #tripleo | 18:28 | |
*** marun has quit IRC | 18:31 | |
*** chuckC has quit IRC | 18:31 | |
lifeless | ok powering off the clood | 18:31 |
StevenK | lifeless: Out of context, that's a pretty funny comment | 18:32 |
*** mestery has quit IRC | 18:32 | |
* greghaynes envisions death star power down noise | 18:32 | |
GheRivero | the rabbitmq server in the controller node can be restarted without problem (that's the issue in the check-tripleo-overcloud-precise) | 18:33 |
SpamapS | lifecycle callbacks sessionn starting in 5 min | 18:34 |
GheRivero | I mean, in the check-tripleo-overcloud-precise if fails to restart | 18:34 |
SpamapS | important for TripleO's heat HA story | 18:34 |
*** chuckC has joined #tripleo | 18:36 | |
lifeless | hmm heat | 18:37 |
lifeless | why for you not deleting my stack ? | 18:37 |
greghaynes | HA HA HA | 18:37 |
lifeless | SpamapS: oh hai | 18:37 |
StevenK | SpamapS: I was going to yell at the keystone guys about v3 client | 18:38 |
lifeless | SpamapS: do you want me there ? | 18:38 |
StevenK | fatal: unable to access 'https://git.openstack.org/openstack/heat.git/': GnuTLS recv error (-9): A TLS packet with unexpected length was received. | 18:38 |
lifeless | SpamapS: also heat in the undercloud on this rack is not deleting the instances | 18:38 |
lifeless | psits in lalala land | 18:38 |
*** deklan has quit IRC | 18:40 | |
*** deklan has joined #tripleo | 18:40 | |
*** saurabhs has joined #tripleo | 18:40 | |
*** deklan_ has joined #tripleo | 18:41 | |
*** deklan has quit IRC | 18:42 | |
*** mestery has joined #tripleo | 18:42 | |
*** lazy_prince has joined #tripleo | 18:45 | |
*** cody-somerville has quit IRC | 18:45 | |
*** jrist has quit IRC | 18:46 | |
*** shakayumi has joined #tripleo | 18:48 | |
*** shakayumi has quit IRC | 18:49 | |
*** blamar has quit IRC | 18:57 | |
*** ramishra_ has quit IRC | 18:57 | |
*** lazy_prince has quit IRC | 18:59 | |
*** julim has quit IRC | 19:00 | |
*** eghobo has joined #tripleo | 19:00 | |
*** lazy_prince has joined #tripleo | 19:01 | |
*** eghobo has quit IRC | 19:01 | |
*** eghobo has joined #tripleo | 19:01 | |
*** saurabhs has quit IRC | 19:03 | |
StevenK | WTB local mirror on my laptop | 19:07 |
lifeless | finally, it is dead | 19:08 |
GheRivero | :/ RIP | 19:11 |
*** jang has joined #tripleo | 19:11 | |
lifeless | honestly, it was a zombie stack | 19:17 |
lifeless | resouuuurces | 19:17 |
*** jrist has joined #tripleo | 19:17 | |
*** jang has quit IRC | 19:18 | |
*** julim has joined #tripleo | 19:19 | |
*** deklan_ has quit IRC | 19:19 | |
*** deklan has joined #tripleo | 19:20 | |
*** julim has quit IRC | 19:20 | |
*** mestery has quit IRC | 19:21 | |
*** eghobo has quit IRC | 19:21 | |
*** geertj has joined #tripleo | 19:21 | |
*** deklan has quit IRC | 19:24 | |
*** ramishra has joined #tripleo | 19:26 | |
*** ramishra has quit IRC | 19:26 | |
*** jrist has quit IRC | 19:27 | |
*** jrist has joined #tripleo | 19:29 | |
*** rbrady has joined #tripleo | 19:30 | |
openstackgerrit | Ghe Rivero proposed a change to openstack-infra/tripleo-ci: Add /mnt/state/var/log to the host state files https://review.openstack.org/93627 | 19:31 |
lifeless | 10 seconds to do heat stack-list | 19:32 |
lifeless | we're threashing or something | 19:32 |
*** deklan has joined #tripleo | 19:32 | |
*** marun has joined #tripleo | 19:41 | |
*** noslzzp has joined #tripleo | 19:41 | |
SpamapS | lifeless: stack-list parses the whole stack | 19:45 |
lifeless | SpamapS: for every stack? | 19:45 |
lifeless | SpamapS: so I have heat wedged here. I would like you to analyse ploease | 19:45 |
*** deklan has quit IRC | 19:46 | |
*** deklan has joined #tripleo | 19:46 | |
*** marun has quit IRC | 19:46 | |
lifeless | SpamapS: e.g. + os-apply-config --key db-password | 19:46 |
lifeless | [2014/05/14 07:40:45 PM] [ERROR] key db-password does not exist in ['/var/lib/os-collect-config/heat_local.json', '/var/lib/os-collect-config/ec2.json', '/var/lib/os-collect-config/cfn.json'] | 19:46 |
lifeless | + db_pass= | 19:46 |
lifeless | SpamapS: on ze controller | 19:47 |
*** blamar has joined #tripleo | 19:48 | |
*** lazy_prince has quit IRC | 19:51 | |
*** deklan has quit IRC | 19:51 | |
SpamapS | lifeless: heat stack-metadata-show stackname controllername | 19:51 |
SpamapS | err | 19:52 |
SpamapS | resource-metadata-show | 19:52 |
*** lazy_prince has joined #tripleo | 19:52 | |
lifeless | resource-metadata ? | 19:54 |
lifeless | SpamapS: ^? | 19:54 |
SpamapS | lifeless: sure | 19:55 |
SpamapS | lifeless: you at pod? | 19:56 |
lifeless | SpamapS: 306, coming out in a sec | 19:57 |
lifeless | it takes about 10-15 seconds to show each resource, be done soon | 19:57 |
SpamapS | lifeless: I don't care much about resource api versioning so I would be interested in side by side hacking at the pod | 19:58 |
openstackgerrit | Victor Lowther proposed a change to openstack/tripleo-incubator: Let devtest.sh run in a Docker container. https://review.openstack.org/91867 | 19:58 |
SpamapS | (resource api versioning being the next heat session) | 19:58 |
StevenK | I would also be interested in the pod, but that's because I'm chewing through battery | 20:00 |
SpamapS | StevenK: try soaking it in milk.. will require less chewing | 20:01 |
StevenK | Sob | 20:01 |
StevenK | I've been trying to create images so I can break keystone on a local seed and see how my os-cloud-config change works | 20:02 |
SpamapS | StevenK: oh! want a new tag? | 20:03 |
StevenK | SpamapS: Nope, I want to fix this bug first | 20:04 |
lifeless | SpamapS: http://paste.openstack.org/show/80390/ | 20:04 |
lifeless | SpamapS: I can come to the pod now | 20:04 |
SpamapS | lifeless: weird! the deployment isn't IN PROGRESS | 20:04 |
SpamapS | lifeless: heading to pod now | 20:04 |
*** hashar has joined #tripleo | 20:10 | |
*** nati_ueno has quit IRC | 20:11 | |
*** nati_ueno has joined #tripleo | 20:12 | |
*** chuckC has quit IRC | 20:12 | |
*** noslzzp has quit IRC | 20:12 | |
*** lazy_prince has quit IRC | 20:13 | |
*** rbrady has quit IRC | 20:26 | |
*** nati_ueno has quit IRC | 20:26 | |
openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-image-elements: Make ironic virtual pm key permissions 600 https://review.openstack.org/93629 | 20:27 |
*** rbrady has joined #tripleo | 20:28 | |
*** cody-somerville has joined #tripleo | 20:29 | |
lifeless | /win goto #heat | 20:29 |
lifeless | win goto #heat | 20:29 |
*** nati_uen_ has joined #tripleo | 20:30 | |
*** rlandy has quit IRC | 20:32 | |
*** mestery has joined #tripleo | 20:33 | |
*** nealph has joined #tripleo | 20:40 | |
*** chuckC has joined #tripleo | 20:44 | |
*** e0ne has quit IRC | 20:58 | |
*** untriaged-bot has joined #tripleo | 21:00 | |
untriaged-bot | Untriaged bugs so far: | 21:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1318767 | 21:00 |
uvirtbot | Launchpad bug 1318767 in tripleo "apache element SSL cert check fails" [Undecided,New] | 21:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317446 | 21:00 |
uvirtbot | Launchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress] | 21:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1314978 | 21:00 |
uvirtbot | Launchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New] | 21:00 |
untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1319027 | 21:00 |
uvirtbot | Launchpad bug 1319027 in diskimage-builder "dib install packages not document in the command help" [Undecided,New] | 21:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1315355 | 21:00 |
uvirtbot | Launchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New] | 21:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1319473 | 21:00 |
uvirtbot | Launchpad bug 1319473 in tripleo "devtest_testenv.sh doesn't honour overcoud_computescale or overcloud_controlscale" [Undecided,In progress] | 21:00 |
untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1318717 | 21:00 |
uvirtbot | Launchpad bug 1318717 in diskimage-builder "image with rhel element can't be built if DIB_RHSM_* variables aren't set" [Undecided,In progress] | 21:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317778 | 21:00 |
uvirtbot | Launchpad bug 1317778 in tripleo "Rabbit "guest from everywhere" should be reverted" [Undecided,New] | 21:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1316675 | 21:00 |
uvirtbot | Launchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress] | 21:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317056 | 21:00 |
uvirtbot | Launchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New] | 21:00 |
*** untriaged-bot has quit IRC | 21:00 | |
*** mestery has quit IRC | 21:01 | |
*** mestery has joined #tripleo | 21:02 | |
*** jeremydei_ is now known as jeremydei | 21:08 | |
*** nati_uen_ has quit IRC | 21:11 | |
notq | running devtest_seed getting failed to start domain seed, error sata is not supported with this qemu binary | 21:12 |
notq | googling now, but thought i'd ask for thoughts if it's a common problem | 21:12 |
*** eghobo has joined #tripleo | 21:12 | |
*** chuckC has quit IRC | 21:12 | |
*** eghobo has quit IRC | 21:13 | |
*** eghobo has joined #tripleo | 21:13 | |
StevenK | notq: Where did the qemu binary come from? | 21:13 |
victor_lowther | if it is rhel or centos 6, that is true. | 21:14 |
notq | just installed ubuntu newest version. so default | 21:14 |
victor_lowther | notq: ok, that is weird. | 21:14 |
victor_lowther | sata has been supported in qemu for a few years norw. | 21:15 |
victor_lowther | ubuntu 14.04? | 21:15 |
notq | yep | 21:15 |
victor_lowther | well, it is supported in qemu 2.0.0 | 21:15 |
*** mestery has quit IRC | 21:16 | |
victor_lowther | what version are you using? | 21:16 |
*** chuckC has joined #tripleo | 21:16 | |
notq | not sure, default install. should i rpm -qa | grep qemu ? | 21:16 |
victor_lowther | um | 21:16 |
victor_lowther | not really. :) | 21:16 |
*** ramishra has joined #tripleo | 21:16 | |
StevenK | Not on Ubuntu :-) | 21:16 |
notq | oh, heh | 21:16 |
notq | sorry i'm mostly a redhat guy | 21:16 |
victor_lowther | qemu-system-x86_64 --version | 21:16 |
notq | 2.0 | 21:17 |
victor_lowther | super weird. | 21:17 |
*** nati_ueno has joined #tripleo | 21:18 | |
*** morazi has joined #tripleo | 21:20 | |
openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Run free https://review.openstack.org/93634 | 21:22 |
notq | hrm | 21:22 |
victor_lowther | notq: what does virsh dumpxml seed |grep machine show? | 21:23 |
notq | arch=i686 machine ='pc-1.0' hvm | 21:24 |
*** eguz has joined #tripleo | 21:28 | |
*** eguz has quit IRC | 21:28 | |
victor_lowther | that looks reasonable-ish | 21:29 |
*** eghobo has quit IRC | 21:29 | |
notq | it has been a new ubuntu install, and following this. that's it http://docs.openstack.org/developer/tripleo-incubator/devtest.html | 21:29 |
*** blamar has quit IRC | 21:31 | |
victor_lowther | If you feel adventurous, you can modify the vm.xml template to zap the machine= part of the <type> tag. | 21:31 |
victor_lowther | since that is overspecified anyways. | 21:32 |
*** jml has quit IRC | 21:36 | |
*** jml has joined #tripleo | 21:39 | |
lifeless | greghaynes: https://etherpad.openstack.org/p/tripleo-end-to-end-automatic-bm | 21:40 |
openstackgerrit | Ghe Rivero proposed a change to openstack/tripleo-image-elements: WIP - Lill rabbit before restarting int https://review.openstack.org/93637 | 21:40 |
notq | vm.xml template somewhere in tripleo-incubator? | 21:40 |
notq | editing no | 21:41 |
notq | now | 21:41 |
victor_lowther | ok | 21:41 |
notq | rerunning devtest_seed | 21:41 |
*** hashar has quit IRC | 21:42 | |
*** cody-somerville has quit IRC | 21:44 | |
*** geertj has quit IRC | 21:46 | |
*** ramishra has quit IRC | 21:48 | |
*** nealph has quit IRC | 21:52 | |
openstackgerrit | Gregory Haynes proposed a change to openstack/diskimage-builder: Add -x and console output for dhcp-all-interfaces https://review.openstack.org/93640 | 21:53 |
notq | same error, sata is not supported with this qemu binary | 21:53 |
greghaynes | lifeless: https://review.openstack.org/#/c/93640/ | 21:54 |
*** chuckC has quit IRC | 21:56 | |
*** nati_ueno has quit IRC | 21:56 | |
*** jrist has quit IRC | 21:58 | |
*** morazi has quit IRC | 22:02 | |
*** giulivo has quit IRC | 22:05 | |
*** rbrady has quit IRC | 22:06 | |
*** geerdest has quit IRC | 22:07 | |
openstackgerrit | Victor Lowther proposed a change to openstack/tripleo-incubator: Let devtest.sh run in a Docker container. https://review.openstack.org/91867 | 22:10 |
*** nati_ueno has joined #tripleo | 22:11 | |
*** nati_ueno has quit IRC | 22:14 | |
*** nati_ueno has joined #tripleo | 22:15 | |
victor_lowther | StevenK: https://gist.github.com/VictorLowther/a8e502ec56a4acddbe90 | 22:15 |
*** nati_ueno has quit IRC | 22:19 | |
*** sballe has joined #tripleo | 22:32 | |
*** sballe has quit IRC | 22:36 | |
*** eghobo has joined #tripleo | 22:37 | |
*** eghobo has quit IRC | 22:38 | |
*** eghobo has joined #tripleo | 22:38 | |
*** chuckC has joined #tripleo | 23:00 | |
*** chuckC has quit IRC | 23:31 | |
*** newell_ has quit IRC | 23:35 | |
*** Hefeweizen has quit IRC | 23:47 | |
*** ramishra has joined #tripleo | 23:51 | |
*** ramishra has quit IRC | 23:53 | |
*** ramishra has joined #tripleo | 23:54 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!