| *** jcooley_ has joined #tripleo | 00:07 | |
| openstackgerrit | Steve Kowalik proposed a change to openstack/tripleo-incubator: Shift NODE_{CPU,DISK,MEM} into the JSON data file https://review.openstack.org/73145 | 00:10 |
|---|---|---|
| *** jcooley_ has quit IRC | 00:13 | |
| *** cd-undercloud has joined #tripleo | 00:21 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 00:21 |
| *** cd-undercloud has quit IRC | 00:21 | |
| *** matsuhashi has joined #tripleo | 00:23 | |
| *** jcooley_ has joined #tripleo | 00:30 | |
| *** e0ne_ has quit IRC | 00:31 | |
| *** matsuhashi has quit IRC | 00:33 | |
| *** matsuhashi has joined #tripleo | 00:34 | |
| *** jcooley_ has quit IRC | 00:37 | |
| *** matsuhashi has quit IRC | 00:38 | |
| *** tserong has quit IRC | 00:41 | |
| *** tserong has joined #tripleo | 00:44 | |
| *** weshay has quit IRC | 01:03 | |
| *** matsuhashi has joined #tripleo | 01:04 | |
| *** dkehn__ has joined #tripleo | 01:04 | |
| *** dkehn has quit IRC | 01:05 | |
| *** nosnos has joined #tripleo | 01:05 | |
| *** dkehn__ has quit IRC | 01:05 | |
| *** dkehn__ has joined #tripleo | 01:05 | |
| *** dkehn_ has quit IRC | 01:06 | |
| *** dkehn has joined #tripleo | 01:07 | |
| openstackgerrit | Steve Kowalik proposed a change to openstack/tripleo-incubator: Stop exporting in devtest_testenv https://review.openstack.org/73891 | 01:07 |
| lifeless | yay bandersnatch up to R | 01:09 |
| *** dkehn__ is now known as dkehn_ | 01:09 | |
| *** jcooley_ has joined #tripleo | 01:30 | |
| StevenK | lifeless: So, re: apt-sources, we have now have DIB_DISTRIBUTION_MIRROR supported by the ubuntu element itself, and DIB_DEBIAN_MIRROR used by debian, as well as DIB_APT_SOURCES | 01:31 |
| StevenK | In other words ":-(" | 01:32 |
| *** jcooley_ has quit IRC | 01:37 | |
| lifeless | StevenK: right | 01:38 |
| lifeless | StevenK: so, apt-sources is the most general | 01:38 |
| lifeless | debian should clearly use DIB_DISTRIBUTION_MIRROR | 01:38 |
| lifeless | IMNSHO | 01:38 |
| StevenK | I suppose apt-sources allows you to inject third-party sources | 01:41 |
| StevenK | Which may or may not be intended | 01:41 |
| lifeless | disable or enable universe | 01:41 |
| lifeless | multiverse etc | 01:41 |
| lifeless | like e.g. a vendor local repo | 01:41 |
| *** cd-undercloud has joined #tripleo | 01:41 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 01:41 |
| *** cd-undercloud has quit IRC | 01:41 | |
| lifeless | or a chef local repo | 01:41 |
| *** e0ne has joined #tripleo | 01:42 | |
| StevenK | lifeless: See 'third-party sources' | 01:43 |
| lifeless | well | 01:43 |
| lifeless | from the perspective of someone doing that, they're first party ;) | 01:43 |
| *** e0ne has quit IRC | 01:47 | |
| openstackgerrit | Lee Li proposed a change to openstack/tuskar: Replace assertEqual(None, *) with assertIsNone in tests https://review.openstack.org/73774 | 01:49 |
| *** yamahata__ has quit IRC | 01:49 | |
| openstackgerrit | Steve Kowalik proposed a change to openstack/diskimage-builder: Shift debian element to DIB_DISTRIBUTION_MIRROR https://review.openstack.org/73893 | 01:52 |
| StevenK | lifeless: Given the above, I'll re-review the apt-sources reviews after lunch | 01:53 |
| *** yamahata_ has joined #tripleo | 01:54 | |
| lifeless | SpamapS: ideas on on expressing apache configurations via heat? | 01:55 |
| *** ramishra has joined #tripleo | 01:55 | |
| *** ramishra has quit IRC | 01:55 | |
| *** ramishra has joined #tripleo | 01:56 | |
| SpamapS | lifeless: don't do it? ;) | 01:58 |
| lifeless | SpamapS: ok, and more usefully? | 01:58 |
| SpamapS | lifeless: sorry what exactly do you want? Full structure -> apache generator, or just common patterns? | 01:58 |
| lifeless | SpamapS: specifically I want to export a debian mirror and a pypi mirror on a cinder volume | 01:58 |
| lifeless | the apache2 element is very limited today. | 01:59 |
| SpamapS | lifeless: Heat will give you the volume ID and its device mapping... I'd use that to mount it in a known place and just have a static apache config. | 01:59 |
| SpamapS | perhaps allow customizing the Location | 02:00 |
| lifeless | does cloud-init automate mounting of volumes? | 02:00 |
| SpamapS | It can, but Heat makes it hard to put cloud-config syntax in. | 02:01 |
| SpamapS | lifeless: so you'll have a VolumeAttachment resource to reference, and I believe you'll have the offset (like block-device0) to dig out in the ec2 metadata block-device-mapping.. | 02:02 |
| SpamapS | http://docs.openstack.org/developer/heat/template_guide/openstack.html#OS::Cinder::VolumeAttachment | 02:03 |
| SpamapS | lifeless: ^^ | 02:03 |
| lifeless | SpamapS: so the thing in my head is that we manually make the volume, so that when we heat stack-delete we don't have to lose the data :P | 02:03 |
| lifeless | for now | 02:03 |
| SpamapS | lifeless: so /dev/disk/by-id/virtio-<VolumeId> | 02:03 |
| lifeless | lsblk | grep VolumeId ? | 02:04 |
| SpamapS | lifeless: same thing | 02:04 |
| SpamapS | lifeless: the volume_id is passed in as a property of VolumeAttachment | 02:04 |
| lifeless | ok | 02:05 |
| lifeless | so; tl;dr - static file in the element with the vhost in it | 02:05 |
| lifeless | elements for the mirror etc | 02:05 |
| lifeless | roll the http element + the mirror elements into one image and booyah | 02:05 |
| lifeless | its a backburner thing, not actively on it | 02:06 |
| lifeless | but it would likely make test runs substantially faster | 02:06 |
| SpamapS | lifeless: cool | 02:06 |
| lifeless | StevenK: https://review.openstack.org/#/c/73145/ failed tess | 02:08 |
| lifeless | tests | 02:08 |
| StevenK | lifeless: Yes, I saw. But the toci change to add the keys to the json landed | 02:13 |
| *** matsuhashi has quit IRC | 02:18 | |
| lifeless | StevenK: oh! | 02:19 |
| lifeless | StevenK: so ok, this is something, but I actually had a rather more comprehensive refactoring in mind :) | 02:19 |
| openstackgerrit | Richard Su proposed a change to openstack/tripleo-incubator: Messaging backend selection https://review.openstack.org/73897 | 02:20 |
| openstackgerrit | Richard Su proposed a change to openstack/tripleo-incubator: Separate OVERCLOUD_DIB_EXTRA_ARGS into two new variables https://review.openstack.org/73842 | 02:20 |
| lifeless | StevenK: rather than redeploying the testenvironments right now, how about going straight onto the bigger thing ? [your call] | 02:20 |
| StevenK | lifeless: The nodes: [] thing? | 02:20 |
| lifeless | yes | 02:21 |
| SpamapS | lifeless: have we put the cd cloud entirely on the backburner at this point? | 02:21 |
| lifeless | SpamapS: nope | 02:21 |
| SpamapS | I feel like I'm the only one who cares about it anymore. | 02:21 |
| lifeless | SpamapS: I am all about it | 02:21 |
| lifeless | I'm logged in right now poking around | 02:21 |
| SpamapS | mmk | 02:21 |
| openstackgerrit | Richard Su proposed a change to openstack/tripleo-incubator: Messaging backend selection https://review.openstack.org/72524 | 02:21 |
| StevenK | lifeless: But we'll need both? | 02:21 |
| lifeless | SpamapS: I'm providing care and feeding for the folk that can't ssh into it to debug because they haven't earnt admin access yet | 02:21 |
| SpamapS | lifeless: I mean tripleo-cd .. not all the other weird stuff | 02:22 |
| lifeless | SpamapS: root@undercloud-notcompute-jws3awlsb2kh:~# | 02:22 |
| lifeless | SpamapS: ci-overcloud only exists because we still have downtime on cd-overcloud. | 02:22 |
| SpamapS | the ci thing.. I really want that to work, but I feel like it has taken all of the focus away from "having a working cloud" | 02:22 |
| SpamapS | lifeless: have we got working swift yet? Once Greg gets Galera working, we'll have to get an HA glance backend up. | 02:23 |
| lifeless | StevenK: can you enlarge please? | 02:23 |
| lifeless | SpamapS: yes, we use swift for images already by default | 02:24 |
| SpamapS | assuming Rabbit works too .. :) | 02:24 |
| SpamapS | oh thats good ok | 02:24 |
| lifeless | remember I was debugging that | 02:24 |
| lifeless | SpamapS: so, re: focus. | 02:24 |
| lifeless | SpamapS: to a degree, yes. But... | 02:24 |
| lifeless | SpamapS: the CI folk were doing CI previously anyhow, in the little RH lab toci stuff | 02:24 |
| lifeless | SpamapS: what we've done is brought them so they are working on the elements that make up cd-overcloud | 02:25 |
| lifeless | SpamapS: which is a huge step into common effort. | 02:25 |
| lifeless | SpamapS: there is still a layer that cd-overcloud's deployment and use-as-a-user doesn't need that CI does. | 02:25 |
| lifeless | SpamapS: its a bit of a balance | 02:25 |
| *** jcooley_ has joined #tripleo | 02:26 | |
| lifeless | StevenK: the reason I'm suggesting StevenK get this refactoring done isn't for CI, but for bare metal deployers | 02:26 |
| SpamapS | I love the balance. A CD system without automated tests isn't really a CD system I want to use.. ;) | 02:26 |
| *** matsuhashi has joined #tripleo | 02:26 | |
| SpamapS | I just think the current tripleo-cd cloud is basically forgotten. | 02:26 |
| lifeless | SpamapS: who need to be able to describe their hardware to the system | 02:26 |
| SpamapS | Unless I log in and look at errors and attack them. | 02:26 |
| lifeless | SpamapS: or I do.. | 02:26 |
| lifeless | SpamapS: I seem to recall monkeying around with mysql and tokens a tonne last week | 02:27 |
| lifeless | SpamapS: to fix cd-overcloud deploys | 02:27 |
| SpamapS | I am starting to think that focusing on a running cloud, before focusing on testing for it, seems cart before horse. | 02:27 |
| lifeless | SpamapS: I like to think of it as cart beside horse | 02:27 |
| SpamapS | we have many carts and horses.. :-P | 02:27 |
| SpamapS | oh I think we might have a status=0 right now | 02:28 |
| lifeless | create-complete anyhow | 02:28 |
| SpamapS | but.. we've yet to pass an update in a while. | 02:28 |
| SpamapS | lifeless: anyway I'm just making sure I'm focusing my non-heat-get-things-landed time on the right things. | 02:29 |
| lifeless | SpamapS: HA updates is the critical thing I believe | 02:29 |
| lifeless | SpamapS: btw I asked wendar to do a favor for me | 02:29 |
| lifeless | SpamapS: for an HP internal firedrill-priority security review | 02:29 |
| SpamapS | stevebaker seems to think he'll have his hot-software-config ready for our consumption the next few days or so.. | 02:29 |
| lifeless | great | 02:30 |
| SpamapS | and he also thinks we'll be able to use that for specifying graceful updating rather than a new field on the resource root. | 02:30 |
| stevebaker | thats the plan | 02:30 |
| lifeless | then we just need to rewrite merge.py to use it :) | 02:30 |
| SpamapS | If we can't manage that pipeline in time.. | 02:30 |
| lifeless | users are being created | 02:30 |
| lifeless | so yes, cloud up | 02:30 |
| SpamapS | I have already made a POC graceful update that is just a subclass of server | 02:30 |
| lifeless | which is great, because I'm now going to disable tripleo-cd so I can really poke at live migration | 02:31 |
| SpamapS | and takes a property which is the structure in my etherpad. | 02:31 |
| lifeless | I got some infos from HP's Nova folk | 02:31 |
| SpamapS | anyway.. should go do some stuff at home | 02:31 |
| *** jcooley_ has quit IRC | 02:31 | |
| *** cd-undercloud has joined #tripleo | 02:32 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 02:32 |
| *** cd-undercloud has quit IRC | 02:32 | |
| lifeless | stopped | 02:32 |
| *** lifeless changes topic to "/win 48" | 02:32 | |
| lifeless | bah | 02:32 |
| greghaynes | not sure we can handle that much win as a topic | 02:32 |
| lifeless | tripleo-cd stopped for live migration tests | tripleo-cd running preserve-ephemeral WIP patches and https://review.openstack.org/#/c/62042/ | Using OpenStack to deploy OpenStack;meetings Tuesday 1900 UTC in #openstack-meeting-alt | 02:33 |
| lifeless | nuts | 02:36 |
| lifeless | | d0738177-1b69-4cac-9e23-95242e216315 | live-migration-test | ERROR | None | NOSTATE | default-net=10.0.0.4 | | 02:36 |
| lifeless | le cloud le fail | 02:36 |
| lifeless | | | _("Unexpected vif_type=%s") % vif_type) | 02:38 |
| lifeless | novacompute0 neutron agent hasn't checked in. | 02:39 |
| lifeless | SpamapS: ^ remember what I said :P | 02:39 |
| *** StevenK changes topic to "tripleo-cd stopped for live migration tests | tripleo-cd running preserve-ephemeral WIP patches and https://review.openstack.org/#/c/62042/ | Using OpenStack to deploy OpenStack;meetings Tuesday 1900 UTC in #openstack-meeting-alt" | 02:39 | |
| lifeless | 2014-02-16 21:53:53.174 2633 CRITICAL neutron [-] Unexpected boolean value '' | 02:41 |
| lifeless | 2014-02-16 21:53:53.399 2754 CRITICAL neutron [-] Unexpected boolean value '' | 02:41 |
| lifeless | in the ovs log | 02:41 |
| lifeless | argh | 02:45 |
| lifeless | date again | 02:45 |
| lifeless | must | 02:45 |
| lifeless | do | 02:45 |
| lifeless | NTP | 02:45 |
| lifeless | 4.5 hours out | 02:46 |
| lifeless | that may explain a bunch of the fails | 02:46 |
| greghaynes | re the DIB_APT_SOURCES and friends: although the apt souces is most general, it seems like it could lead to pain if two elements wanted to depend on it to add their own vendor repo | 02:47 |
| lifeless | greghaynes: its for end users. | 02:48 |
| lifeless | greghaynes: elements adding a vendor repo should add a dedicated list file. | 02:48 |
| greghaynes | makes sense | 02:48 |
| lifeless | oh man | 02:49 |
| lifeless | I do have to replace the entuire upstart service file for libvirt | 02:49 |
| lifeless | because the 'will be deprecated soon' actually means 'does not work as of now' | 02:49 |
| greghaynes | so really the only use case I can think of is enabling distribution components | 02:49 |
| greghaynes | and disabling | 02:49 |
| lifeless | greghaynes: and local repos | 02:50 |
| lifeless | greghaynes: which you can admittedly write a custom element for | 02:50 |
| greghaynes | ah, I get what youre saying re the end user thing now :) | 02:50 |
| * lifeless whinges in public | 02:53 | |
| lifeless | https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1280936 | 02:53 |
| lifeless | SpamapS: another thing we need | 02:55 |
| lifeless | SpamapS: a mapping of all the hypervisors to the hosts files for the hypervisors | 02:55 |
| lifeless | https://trello.com/c/C9yVYbpY/78-nova-live-migration-setup-and-working | 02:55 |
| lifeless | trying with block_migration_flag=VIR_MIGRATE_LIVE,VIR_MIGRATE_TUNNELLED,VIR_MIGRATE_PEER2PEER,VIR_MIGRATE_NON_SHARED_INC | 02:59 |
| lifeless | oh man | 03:00 |
| lifeless | I still can't get nova keypair-show working | 03:01 |
| lifeless | nova keypair-show default | 03:01 |
| lifeless | ERROR: can't set attribute | 03:01 |
| *** jcooley_ has joined #tripleo | 03:01 | |
| lifeless | ruh roh | 03:02 |
| lifeless | 2014-02-17 03:02:39,353 - url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [18/120s]: bad status code [500] | 03:02 |
| lifeless | thats not good | 03:02 |
| lifeless | oh yay | 03:04 |
| lifeless | metadata agent barfing all over | 03:04 |
| lifeless | sigh | 03:04 |
| lifeless | I will bet large amounts of money its an unreleased version of a client library | 03:05 |
| lifeless | huh, no | 03:06 |
| lifeless | not keystoneclient anyhow | 03:06 |
| lifeless | which is what I was expecting | 03:06 |
| lifeless | 02baef46968b816ac544b037297273ff6a4e8e1b | 03:09 |
| lifeless | yup | 03:09 |
| lifeless | fixed in trunk | 03:09 |
| lifeless | not released | 03:09 |
| openstackgerrit | Steve Kowalik proposed a change to openstack/diskimage-builder: Shift debian element to DIB_DISTRIBUTION_MIRROR https://review.openstack.org/73893 | 03:17 |
| lifeless | SpamapS: around ? | 03:25 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Workaround broken Neutron requirements. https://review.openstack.org/73904 | 03:26 |
| lifeless | SpamapS: if you get a timeslice ^ is needed to unfuck the neutron metadata agent on cd-overcloud | 03:26 |
| StevenK | lifeless: ... why not git.openstack.org ? | 03:26 |
| lifeless | yeah just fixing that | 03:26 |
| lifeless | as to why, because I resurrected an old file | 03:27 |
| StevenK | Right | 03:27 |
| StevenK | lifeless: Not that it means much, but +1 from me when I see a patchset with git.o.o | 03:27 |
| SpamapS | lifeless: it's almost like Neutron isn't actually used by any CD shops. :-/ | 03:27 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Workaround broken Neutron requirements. https://review.openstack.org/73904 | 03:27 |
| lifeless | SpamapS: ^ fixed version | 03:28 |
| StevenK | SpamapS: Perhaps they're still using nova-network | 03:29 |
| lifeless | ok, vm up | 03:29 |
| lifeless | lets see, whats else on the checklist to test this? | 03:29 |
| lifeless | oh right, go pick up Cynthia | 03:29 |
| lifeless | I'm going to leave tripleo-cd stopped, I will poke at this more in a few | 03:29 |
| lifeless | hours | 03:29 |
| lifeless | SpamapS: remember you can +2 that | 03:29 |
| lifeless | SpamapS: as you +m = 2 reviewers and its a firedrill | 03:30 |
| *** ENDERSON has joined #tripleo | 03:37 | |
| *** ENDERSON has left #tripleo | 03:38 | |
| *** dkehn__ has joined #tripleo | 03:39 | |
| *** dkehn_ has quit IRC | 03:41 | |
| *** dkehn has quit IRC | 03:41 | |
| *** dkehn has joined #tripleo | 03:42 | |
| *** matsuhashi has quit IRC | 03:48 | |
| *** jcooley_ has quit IRC | 03:53 | |
| *** ccrouch has joined #tripleo | 04:15 | |
| *** dkehn__ is now known as dkehn_ | 04:16 | |
| *** AaronGr_Zzz is now known as AaronGr | 04:22 | |
| *** AaronGr is now known as AaronGr_Zzz | 04:23 | |
| *** matsuhashi has joined #tripleo | 04:32 | |
| *** noslzzp has quit IRC | 04:35 | |
| *** Qiming has joined #tripleo | 04:39 | |
| *** edmund has quit IRC | 04:45 | |
| *** ramishra has quit IRC | 04:53 | |
| *** ramishra has joined #tripleo | 05:04 | |
| *** AaronGr_Zzz is now known as AaronGr | 05:22 | |
| *** AaronGr is now known as AaronGr_Zzz | 05:23 | |
| *** killer_prince has quit IRC | 05:35 | |
| *** killer_prince has joined #tripleo | 05:39 | |
| *** rcarrillocruz has joined #tripleo | 06:03 | |
| tchaypo | that awkward moment when HR asks you to submit paperwork within 14 days to authorise something that's happening in ~6.5 days. | 06:04 |
| *** ramishra has quit IRC | 06:06 | |
| *** rcarrillocruz has quit IRC | 06:06 | |
| *** rcarrillocruz has joined #tripleo | 06:09 | |
| *** saju_m has joined #tripleo | 06:15 | |
| *** rcarrillocruz1 has joined #tripleo | 06:21 | |
| *** rcarrillocruz has quit IRC | 06:23 | |
| *** rcarrillocruz1 has quit IRC | 06:24 | |
| *** rcarrillocruz has joined #tripleo | 06:26 | |
| *** akuznetsov has quit IRC | 06:26 | |
| *** akuznetsov has joined #tripleo | 06:29 | |
| *** rcarrillocruz has quit IRC | 06:31 | |
| openstackgerrit | Yongli He proposed a change to openstack/tuskar: Use six.moves cStringIO instead of cStringIO https://review.openstack.org/73936 | 06:34 |
| *** rcarrillocruz has joined #tripleo | 06:38 | |
| *** nosnos has quit IRC | 06:42 | |
| lifeless | tchaypo: lol | 06:45 |
| *** nosnos has joined #tripleo | 06:52 | |
| *** rlandy has joined #tripleo | 07:04 | |
| *** mrunge has joined #tripleo | 07:18 | |
| openstackgerrit | Yongli He proposed a change to openstack/tuskar: Use six.moves cStringIO instead of cStringIO https://review.openstack.org/73936 | 07:20 |
| marios | lifeless: ping. hi, i see you picked up one of my neutron reviews @ https://review.openstack.org/#/c/62042/ | 07:21 |
| marios | lifeless: i was away all last week, so just getting through email now | 07:21 |
| *** rcarrillocruz has quit IRC | 07:26 | |
| *** ifarkas has joined #tripleo | 07:30 | |
| lifeless | marios: I fixed it up enough to work | 07:35 |
| lifeless | marios: didn't do any of the review feedback though | 07:35 |
| lifeless | marios: welcome back :) | 07:35 |
| marios | lifeless: hehe :) thanks, it *was* working as far as i recall, didn't get to it yet though. is there something i can/need to do to it today? or just waitin on reviews now? | 07:36 |
| lifeless | marios: there was a -1 on it | 07:37 |
| lifeless | marios: needs fixing style stuff | 07:37 |
| lifeless | marios: and no, it wasn't working when you pushed it, it just didn't crash - totally different ;) | 07:37 |
| lifeless | marios: I wrote a client patch too | 07:37 |
| *** boris-42 has quit IRC | 07:40 | |
| marios | lifeless: haha, well if its isn't crashing ... :) ok thanks, will get to it in a bit | 07:40 |
| lifeless | marios: https://review.openstack.org/#/c/71815/ | 07:41 |
| lifeless | marios: I'd live it if you pick that up, just rebase it off my other patch onto trunk and add co-authored-by you ;) | 07:41 |
| lifeless | marios: in https://review.openstack.org/#/c/62042/6..10/neutron/db/db_base_plugin_v2.py you can see the missing code | 07:42 |
| lifeless | marios: that I added | 07:42 |
| lifeless | s/live it/love it/ | 07:43 |
| marios | lifeless: i see - so i wasn't creating the new pools correctly | 07:46 |
| marios | lifeless: i wonder if i should add more tests then cos to be sure I didn't really stress this code too much when i was testing | 07:47 |
| marios | lifeless: (i mean to exercise the code you added ) | 07:47 |
| marios | lifeless: i will add that client review to my list | 07:47 |
| *** jprovazn has joined #tripleo | 07:47 | |
| *** akuznetsov has quit IRC | 07:48 | |
| *** dko has joined #tripleo | 07:49 | |
| *** akuznetsov has joined #tripleo | 07:51 | |
| *** jtomasek has joined #tripleo | 07:51 | |
| openstackgerrit | Ladislav Smola proposed a change to openstack/tuskar: Wrong params passed to tempalte create https://review.openstack.org/73960 | 07:58 |
| *** bauzas has joined #tripleo | 08:22 | |
| *** jcoufal has joined #tripleo | 08:26 | |
| *** jcoufal has quit IRC | 08:28 | |
| *** jcoufal has joined #tripleo | 08:29 | |
| *** saju_m has quit IRC | 08:31 | |
| lifeless | marios: yes, you should :) | 08:34 |
| lifeless | marios: yeah, the pool has a separate object tracking free slots, which wasn't filled out | 08:35 |
| *** dtantsur has joined #tripleo | 08:35 | |
| *** rpodolyaka has joined #tripleo | 08:37 | |
| rpodolyaka | morning tripleo | 08:37 |
| shadower | hey | 08:38 |
| *** akrivoka has joined #tripleo | 08:38 | |
| *** hashar has joined #tripleo | 08:43 | |
| *** hashar has quit IRC | 08:44 | |
| *** hashar has joined #tripleo | 08:46 | |
| *** kwwii has joined #tripleo | 08:49 | |
| *** jtomasek has quit IRC | 08:52 | |
| *** jtomasek has joined #tripleo | 08:52 | |
| lifeless | ifarkas: hi - on https://review.openstack.org/#/c/73683/ there was a failed jenkins test | 08:55 |
| lifeless | ifarkas: please don't approve such things! | 08:56 |
| lifeless | http://lists.openstack.org/pipermail/openstack-dev/2014-February/027286.html | 08:56 |
| ifarkas | lifeless, ah, okay, sry. I should start with emails in the morning I guess :-) | 08:57 |
| ifarkas | taking back my approved vote | 08:57 |
| *** saju_m has joined #tripleo | 08:58 | |
| jprovazn | lifeless: so if there is a jenkins failure on patches prior your mail (e.g. https://review.openstack.org/#/c/70238/) should I resubmit the patch to enfore jenkins re-run? | 08:59 |
| *** jistr has joined #tripleo | 09:01 | |
| lifeless | jprovazn: recheck no bug | 09:01 |
| lifeless | jprovazn: or a rebase, either will trigger a new check | 09:01 |
| *** e0ne has joined #tripleo | 09:02 | |
| ifarkas | lifeless, should I revoke my +A from tuskar patches too? eg. https://review.openstack.org/#/c/73400/ | 09:02 |
| ifarkas | I guess they have nothing to do with the jenkins failure | 09:02 |
| lifeless | ifarkas: we're not testing tuskar [yet] so less worried about interactions with the new CI stuff there | 09:02 |
| ifarkas | cool. that was what I thought | 09:03 |
| lifeless | however we really should be :) | 09:04 |
| lifeless | like, there should be a job that bootstraps via devtest_seed and then runs tuskar API calls to deploy an overcloud | 09:04 |
| ifarkas | lifeless, yeah, that would be cool. lsmola pushed a patch last Friday which allows tuskar to deploy an overcloud. A bunch of stuff still missing but it is slowly getting there... | 09:06 |
| lifeless | oh great, apparmor breaks live migrate. Yay. | 09:07 |
| lifeless | ifarkas: so add it :) | 09:07 |
| ifarkas | sure ;-) | 09:07 |
| * lifeless is trolling ever so slightly | 09:07 | |
| lifeless | I know its a ramp-up | 09:07 |
| lsmola | ifarkas: lifeless yeas we are getting there :-) | 09:10 |
| *** e0ne has quit IRC | 09:11 | |
| *** e0ne has joined #tripleo | 09:13 | |
| *** derekh has joined #tripleo | 09:14 | |
| derekh | lifeless: on check-tripleo-overcloud-precise if we're to treat that as a vote, do you know if its possible to up the timeout a little ? | 09:17 |
| derekh | the time it takes to run the tests is pretty much the same as the time it takes for jenkins to time it out | 09:18 |
| lifeless | derekh: yes | 09:18 |
| *** lucasagomes has joined #tripleo | 09:18 | |
| lifeless | derekh: patch to infra | 09:18 |
| derekh | lifeless: ok, cool | 09:18 |
| lifeless | derekh: or we work on pre-heated cloud-before's. | 09:18 |
| derekh | lifeless: yup, that would work too :-) | 09:19 |
| lifeless | or both! | 09:20 |
| derekh | lifeless: so as I see it we have 3 options, for the pre-heated clouds, I'll write them down somewhere and you can comment or add a 4th option etc.. | 09:21 |
| lifeless | tripleo-parallel-tests ? | 09:23 |
| lifeless | I'll add a card | 09:23 |
| lifeless | https://trello.com/c/cNvdtISc/96-test-different-layers-in-parallel | 09:24 |
| lifeless | derekh: ^ has a etherpad url in it | 09:24 |
| derekh | lifeless: ok, will start to populate it | 09:24 |
| lifeless | gnight | 09:25 |
| derekh | night | 09:25 |
| *** mrunge has quit IRC | 09:43 | |
| openstackgerrit | Dmitry Tantsur proposed a change to openstack/tuskar-ui: Add list/create/delete operations for node profiles https://review.openstack.org/73576 | 09:52 |
| *** boris-42_ has joined #tripleo | 09:52 | |
| *** bogdando has joined #tripleo | 09:53 | |
| *** Qiming has quit IRC | 09:53 | |
| *** matsuhashi has quit IRC | 09:54 | |
| *** markmc has joined #tripleo | 09:55 | |
| *** lazy_prince has joined #tripleo | 09:57 | |
| *** killer_prince has quit IRC | 09:58 | |
| *** lazy_prince is now known as killer_prince | 09:58 | |
| *** athomas has joined #tripleo | 10:02 | |
| *** matsuhashi has joined #tripleo | 10:02 | |
| *** akuznetsov has quit IRC | 10:08 | |
| *** pbelanyi has joined #tripleo | 10:09 | |
| *** akuznetsov has joined #tripleo | 10:09 | |
| *** juice has quit IRC | 10:12 | |
| *** cd-undercloud has joined #tripleo | 10:13 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 10:13 |
| *** cd-undercloud has quit IRC | 10:13 | |
| *** juice has joined #tripleo | 10:15 | |
| *** matsuhashi has quit IRC | 10:17 | |
| *** matsuhashi has joined #tripleo | 10:17 | |
| *** matsuhashi has quit IRC | 10:22 | |
| *** gcha has joined #tripleo | 10:22 | |
| *** e0ne_ has joined #tripleo | 10:29 | |
| *** panda_ has joined #tripleo | 10:32 | |
| *** e0ne has quit IRC | 10:33 | |
| *** panda has quit IRC | 10:34 | |
| *** mrunge has joined #tripleo | 10:37 | |
| *** ramishra has joined #tripleo | 10:38 | |
| *** martyntaylor has joined #tripleo | 10:45 | |
| *** vkozhukalov has joined #tripleo | 10:46 | |
| *** matsuhashi has joined #tripleo | 10:47 | |
| *** al has quit IRC | 10:55 | |
| *** al has joined #tripleo | 10:56 | |
| *** ramishra has quit IRC | 11:08 | |
| *** ramishra has joined #tripleo | 11:09 | |
| openstackgerrit | Ladislav Smola proposed a change to openstack/tuskar-ui: Passing real params to TuskarAPI https://review.openstack.org/73999 | 11:20 |
| *** athomas has quit IRC | 11:34 | |
| *** cd-undercloud has joined #tripleo | 11:35 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 11:35 |
| *** cd-undercloud has quit IRC | 11:35 | |
| *** e0ne has joined #tripleo | 11:37 | |
| *** matsuhashi has quit IRC | 11:37 | |
| *** e0ne_ has quit IRC | 11:41 | |
| *** athomas has joined #tripleo | 11:44 | |
| *** gcha has quit IRC | 11:47 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Update keystone config to use external paste.ini https://review.openstack.org/73871 | 11:47 |
| *** CaptTofu has joined #tripleo | 11:59 | |
| *** killer_prince has quit IRC | 12:01 | |
| *** jang1 has joined #tripleo | 12:16 | |
| *** jang1 has left #tripleo | 12:17 | |
| *** jang1 has joined #tripleo | 12:18 | |
| *** e0ne has quit IRC | 12:18 | |
| *** e0ne_ has joined #tripleo | 12:18 | |
| *** e0ne_ has quit IRC | 12:26 | |
| *** e0ne has joined #tripleo | 12:26 | |
| *** e0ne_ has joined #tripleo | 12:28 | |
| *** e0ne has quit IRC | 12:28 | |
| *** lucasagomes is now known as lucas-hungry | 12:32 | |
| *** e0ne_ has quit IRC | 12:41 | |
| *** e0ne has joined #tripleo | 12:42 | |
| *** gcha has joined #tripleo | 12:43 | |
| *** weshay has joined #tripleo | 12:45 | |
| *** cd-undercloud has joined #tripleo | 12:57 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 12:57 |
| *** cd-undercloud has quit IRC | 12:57 | |
| *** jcoufal has quit IRC | 12:58 | |
| *** jcoufal has joined #tripleo | 12:59 | |
| *** noslzzp has joined #tripleo | 13:00 | |
| *** nosnos has quit IRC | 13:08 | |
| *** CaptTofu has quit IRC | 13:13 | |
| *** mrunge has quit IRC | 13:16 | |
| lsmola | derekh: hello | 13:22 |
| lsmola | derekh: trying latest master, there is again a problem with ssh to seed | 13:22 |
| lsmola | derekh: but reverting to your patch, it works | 13:22 |
| lsmola | derekh: I am hallucinating? :-D | 13:22 |
| openstackgerrit | Stuart McLaren proposed a change to openstack/tripleo-image-elements: Glance: make 'workers' configurable https://review.openstack.org/74037 | 13:25 |
| *** jcoufal has quit IRC | 13:29 | |
| *** hashar has quit IRC | 13:32 | |
| *** jcoufal has joined #tripleo | 13:36 | |
| derekh | lsmola: hadn't noticed any problems, I'll kick of a clean run now and see | 13:38 |
| derekh | lsmola: kicked it off, I'll get back to you in a bit | 13:39 |
| marios | lsmola: have you seen this at all? http://paste.openstack.org/show/66466/ | 13:40 |
| marios | lsmola: trying a post http://localhost:8585/v1/overclouds/ | 13:41 |
| *** jdob has joined #tripleo | 13:41 | |
| *** lucas-hungry is now known as lucasagomes | 13:42 | |
| derekh | so ci-overcloud controller appears to be busted, can't ssh to it from the undercloud node, logging onto the console I see ssh packets hitting it and it sends out response but response doesn't get back to the controller, any ideas ... | 13:43 |
| *** dprince has joined #tripleo | 13:43 | |
| *** d0ugal has quit IRC | 13:45 | |
| lsmola | marios: :-o | 13:45 |
| lsmola | marios: please apply the one small patch from me in tuskar | 13:46 |
| derekh | problem appears to have started around 2:47AM utc | 13:46 |
| lsmola | marios: I am woking on proper fix | 13:46 |
| marios | lsmola: get same for python tools/initial_data.py | 13:46 |
| marios | lsmola: ok, going to fetch it now | 13:46 |
| lsmola | marios: ok, then you have some db problem | 13:46 |
| *** d0ugal has joined #tripleo | 13:47 | |
| lsmola | marios: the initial data should work | 13:47 |
| marios | lsmola: gives me 404 strangely enough http://paste.openstack.org/show/66467/ | 13:48 |
| *** hashar has joined #tripleo | 13:49 | |
| derekh | Ng: SpamapS lifeless any ideas if anything was happening on the rack at that time ^^? | 13:49 |
| lsmola | marios: :-O | 13:50 |
| lsmola | marios: can you check it your db is ok? | 13:50 |
| lsmola | marios: liek you have the schema, etc. | 13:50 |
| marios | lsmola: yah am trying again | 13:51 |
| marios | dbsync et | 13:51 |
| *** funzo has joined #tripleo | 13:52 | |
| lsmola | marios: ok | 13:53 |
| jprovazn | derekh: routing? | 13:53 |
| openstackgerrit | Stuart McLaren proposed a change to openstack/tripleo-image-elements: Glance: Add 'db' to README.md https://review.openstack.org/74043 | 13:54 |
| *** kwwii has quit IRC | 13:56 | |
| marios | lsmola: does your https://review.openstack.org/#/c/73960/1 fix http://paste.openstack.org/show/66473/ | 13:56 |
| derekh | jprovazn: seems like it but I think routes on the box are ok | 13:56 |
| *** rbrady has joined #tripleo | 13:56 | |
| lsmola | marios: yes | 13:56 |
| *** funzo has quit IRC | 13:58 | |
| *** CaptTofu has joined #tripleo | 13:59 | |
| *** ramishra_ has joined #tripleo | 14:01 | |
| marios | lsmola: gives me 400. but strange thing is when i get v1/overclouds/template_get > OUT.txt and heat-template-validate OUT.txt it gives True | 14:01 |
| marios | lsmola: http://paste.openstack.org/show/66479/ | 14:01 |
| *** ramishra has quit IRC | 14:02 | |
| *** pbelanyi has quit IRC | 14:04 | |
| *** ramishra_ has quit IRC | 14:06 | |
| *** julim has joined #tripleo | 14:09 | |
| *** lblanchard has joined #tripleo | 14:13 | |
| lsmola | marios: hm, this is after applying the patch and restarting API? | 14:14 |
| openstackgerrit | Ladislav Smola proposed a change to openstack/tuskar: Passing correct count to template creation https://review.openstack.org/74049 | 14:14 |
| *** funzo has joined #tripleo | 14:15 | |
| *** ramishra has joined #tripleo | 14:15 | |
| *** saju_m has quit IRC | 14:15 | |
| *** cd-undercloud has joined #tripleo | 14:18 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 14:18 |
| *** cd-undercloud has quit IRC | 14:18 | |
| marios | lsmola: yeah, i put in a pdb.set_trace and trying to see why | 14:18 |
| *** jdob has quit IRC | 14:19 | |
| lsmola | marios: this seems like there is still some parameter that is going to template | 14:19 |
| derekh | lsmola: Waiting for the undercloud stack to be ready | 14:19 |
| *** jdob has joined #tripleo | 14:19 | |
| derekh | lsmola: so got paste to point where your hitting problems | 14:19 |
| lsmola | derekh: hm, ok | 14:19 |
| lsmola | derekh: thanks, I am going to rebuild everything and try again | 14:20 |
| derekh | lsmola: is it possible the premissions on your private key are wrong ? | 14:21 |
| *** jeremydei has quit IRC | 14:24 | |
| *** jpeeler has joined #tripleo | 14:24 | |
| *** jpeeler has joined #tripleo | 14:24 | |
| *** jeremydei has joined #tripleo | 14:24 | |
| *** ramishra has quit IRC | 14:31 | |
| openstackgerrit | Ladislav Smola proposed a change to openstack/tuskar: Passing correct count to template creation https://review.openstack.org/74049 | 14:33 |
| marios | lsmola: i think may be my undercloud setup | 14:36 |
| *** jdob_ has joined #tripleo | 14:37 | |
| *** jdob has quit IRC | 14:37 | |
| *** blamar has joined #tripleo | 14:38 | |
| *** jdob_ is now known as jdob | 14:38 | |
| *** blamar has quit IRC | 14:40 | |
| *** blamar has joined #tripleo | 14:40 | |
| *** dkehn__ has joined #tripleo | 14:41 | |
| *** dkehn has quit IRC | 14:43 | |
| *** dkehn_ has quit IRC | 14:44 | |
| *** dkehn has joined #tripleo | 14:46 | |
| *** dkehn__ is now known as dkehn_ | 14:46 | |
| *** matty_dubs|gone is now known as matty_dubs | 14:47 | |
| *** CaptTofu has quit IRC | 14:52 | |
| *** killer_prince has joined #tripleo | 14:52 | |
| *** noslzzp has quit IRC | 14:57 | |
| * marios biab | 15:01 | |
| *** julim_ has joined #tripleo | 15:02 | |
| *** julim has quit IRC | 15:05 | |
| *** rwsu has joined #tripleo | 15:09 | |
| *** cd-undercloud has joined #tripleo | 15:11 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 15:11 |
| *** cd-undercloud has quit IRC | 15:11 | |
| *** noslzzp has joined #tripleo | 15:26 | |
| *** coolsvap has joined #tripleo | 15:26 | |
| *** CaptTofu has joined #tripleo | 15:31 | |
| *** derekh changes topic to "Firedrill : CI down, Approve patches as usual | tripleo-cd stopped for live migration tests | tripleo-cd running preserve-ephemeral WIP patches and https://review.openstack.org/#/c/62042/ | Using OpenStack to deploy OpenStack;meetings Tuesday 1900 UTC in #openstack-meeting-alt" | 15:31 | |
| *** ramishra has joined #tripleo | 15:32 | |
| *** beekneemech is now known as bnemec | 15:34 | |
| *** AaronGr_Zzz is now known as AaronGr | 15:35 | |
| *** ramishra has quit IRC | 15:37 | |
| *** e0ne has quit IRC | 15:38 | |
| *** ramishra has joined #tripleo | 15:44 | |
| *** edmund has joined #tripleo | 15:45 | |
| openstackgerrit | Ana Krivokapic proposed a change to openstack/tuskar: Fix typos and formatting in documentation https://review.openstack.org/74077 | 15:46 |
| *** e0ne has joined #tripleo | 15:47 | |
| *** hashar has quit IRC | 15:54 | |
| *** hashar has joined #tripleo | 15:54 | |
| *** ramishra has quit IRC | 15:55 | |
| *** jprovazn has quit IRC | 15:56 | |
| fungi | derekh: i see your /topic and recent discussion... is it safe to say that ci-overcloud.tripleo.org is out of commission for an indeterminate amount of time, starting around 00:00 utc today? | 15:58 |
| *** e0ne_ has joined #tripleo | 15:59 | |
| derekh | fungi: yup, I had estimated the time around 2:50 utc | 15:59 |
| derekh | fungi: but maybe earlier | 15:59 |
| fungi | looks like maybe started by 01:08 | 16:00 |
| fungi | you have a tripleo-incubator change waiting for a check job worker assignment for 14 hours 53 minutes at this point | 16:01 |
| *** boris-42_ has quit IRC | 16:01 | |
| derekh | fungi: ok | 16:01 |
| fungi | cool, just making sure this is a known issue and no eta for resolution yet, so we know what to expect from the nodepool/zuul end of things. thanks again! | 16:02 |
| *** e0ne has quit IRC | 16:02 | |
| derekh | fungi: no prob, trying to figure out the problem but no ETA will update once I know more | 16:02 |
| fungi | appreciated | 16:03 |
| *** dko has quit IRC | 16:11 | |
| *** CaptTofu has quit IRC | 16:14 | |
| *** CaptTofu has joined #tripleo | 16:23 | |
| *** CaptTofu has quit IRC | 16:23 | |
| *** cd-undercloud has joined #tripleo | 16:32 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 16:32 |
| *** cd-undercloud has quit IRC | 16:32 | |
| *** jcoufal has quit IRC | 16:34 | |
| *** dtantsur has quit IRC | 16:35 | |
| *** jistr has quit IRC | 16:35 | |
| *** bauzas has quit IRC | 16:38 | |
| mordred | how are you guys installing pip for your pip based things in dib? | 16:42 |
| mordred | on a quick scan, it appears you may be using pip from distro packages? | 16:42 |
| mordred | and it looks like it gets installed via os-config-applier elements? | 16:44 |
| *** lazy_prince has joined #tripleo | 16:44 | |
| mordred | oh - I found the install_packages python-pip lines | 16:45 |
| mordred | I'm going to suggest that you do not want to do that | 16:45 |
| mordred | I'm going to STRONGLY suggest that | 16:45 |
| mordred | using distro pip is always the wrong choice | 16:46 |
| *** e0ne has joined #tripleo | 16:48 | |
| *** e0ne_ has quit IRC | 16:50 | |
| *** jp_at_hp has joined #tripleo | 16:51 | |
| jp_at_hp | NobodyCam: or SpamapS,  I'm looking at the environment override variables for the source-repositories element, and am concerned that a lot of the names have a "-" in them... | 16:53 |
| *** gcha has quit IRC | 16:54 | |
| *** lazy_prince has quit IRC | 16:55 | |
| * NobodyCam takes look | 16:55 | |
| jp_at_hp | nevermind | 16:57 |
| jp_at_hp | I can see the bash variable substitution to replace - with _ in the source_repositories element | 16:57 |
| NobodyCam | looks like /98-source-repositories handles that | 16:57 |
| NobodyCam | :-p ya | 16:57 |
| *** vkozhukalov has quit IRC | 17:00 | |
| *** rcarrillocruz has joined #tripleo | 17:05 | |
| *** hashar has quit IRC | 17:09 | |
| *** bauzas has joined #tripleo | 17:11 | |
| *** martyntaylor has left #tripleo | 17:11 | |
| *** lazy_prince has joined #tripleo | 17:12 | |
| *** e0ne has quit IRC | 17:16 | |
| openstackgerrit | A change was merged to openstack/tuskar-ui: Add list/create/delete operations for node profiles https://review.openstack.org/73576 | 17:16 |
| *** cwolferh has joined #tripleo | 17:18 | |
| openstackgerrit | A change was merged to openstack/tuskar-ui: Fixing the nodes table https://review.openstack.org/72648 | 17:25 |
| *** akuznetsov has quit IRC | 17:26 | |
| *** matty_dubs is now known as matty_dubs|lunch | 17:39 | |
| *** boris-42_ has joined #tripleo | 17:40 | |
| *** marun has joined #tripleo | 17:41 | |
| *** akuznetsov has joined #tripleo | 17:42 | |
| *** akuznetsov has quit IRC | 17:42 | |
| *** akrivoka has quit IRC | 17:44 | |
| derekh | lifeless: you there yet ? | 17:45 |
| *** akuznetsov has joined #tripleo | 17:47 | |
| *** cd-undercloud has joined #tripleo | 17:52 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 17:52 |
| *** cd-undercloud has quit IRC | 17:52 | |
| derekh | lifeless: sending you a mail, will be back later. | 17:54 |
| *** derekh has quit IRC | 17:54 | |
| *** lazy_prince has quit IRC | 17:55 | |
| *** akuznetsov has quit IRC | 17:57 | |
| *** akuznetsov has joined #tripleo | 18:00 | |
| openstackgerrit | Ladislav Smola proposed a change to openstack/tuskar: Passing correct count to template creation https://review.openstack.org/74049 | 18:07 |
| *** jp_at_hp has quit IRC | 18:08 | |
| openstackgerrit | Ladislav Smola proposed a change to openstack/tuskar: Passing correct count to template creation https://review.openstack.org/74049 | 18:08 |
| lifeless | morning | 18:11 |
| *** athomas has quit IRC | 18:12 | |
| *** matty_dubs|lunch is now known as matty_dubs | 18:14 | |
| openstackgerrit | Dan Prince proposed a change to openstack/diskimage-builder: Remove ext4 resize= option. https://review.openstack.org/73854 | 18:21 |
| *** jang1 has quit IRC | 18:24 | |
| lifeless | dprince: good morning :P | 18:29 |
| dprince | lifeless: Hi. I figured we'd bump into each other today :P | 18:30 |
| dprince | lifeless: I can make the conversion to raw go away... | 18:30 |
| openstackgerrit | Ladislav Smola proposed a change to openstack/tuskar-ui: Passing real params to TuskarAPI https://review.openstack.org/73999 | 18:31 |
| *** lucasagomes is now known as lucas-afk | 18:32 | |
| lifeless | dprince: conversion to raw? | 18:33 |
| dprince | lifeless: Sorry. I've been touching too many things. That was a reply to your Nova branch. | 18:33 |
| lifeless | oh | 18:34 |
| dprince | lifeless: My ext4 resize2fs fixes actually make your threading issue (by avoiding the conversion to raw) a possibility | 18:34 |
| lifeless | so, ah | 18:36 |
| lifeless | yeah, I think you and I have a fairly fundamental disagreement on this :) | 18:37 |
| dprince | lifeless: which issue. | 18:37 |
| lifeless | I consider dd / its just a bunch of bytes as a fundamental abstraction here. | 18:38 |
| dprince | lifeless: I question the utility of that abstraction. It gives us a really crappy FS layout, and is causing chicken/egg sorts of problems w/ DIB. | 18:39 |
| dprince | lifeless: Plus w/ mkfs/rsync you get it done 15-20 percent faster. Better and faster. Sounds like a win to me. | 18:40 |
| lifeless | dprince: it gives us precisely the layout every other instance created via nova has, virt or otherwise | 18:40 |
| dprince | lifeless: By my reading the ext4 maintainers are saying 'Don't do this' to us. | 18:40 |
| dprince | lifeless: resize2fs wasn't intended to be used on an order of magnitude. | 18:41 |
| dprince | lifeless: For cloudy images... sure. | 18:41 |
| dprince | lifeless: it is okay to use it there. Going from say 1 2 GB iamge to a 200GB image. | 18:41 |
| lifeless | well, we're going from 2GB to 20GB | 18:42 |
| lifeless | and its failing | 18:42 |
| dprince | lifeless: But going from a 2G image to 1PB is uncharted territory. We are hitting bugs (which may get fixed) but Ted basically said it wasn't designed for that. | 18:42 |
| dprince | lifeless: it is failing because of the parameters to resize= | 18:42 |
| dprince | lifeless: not because we are using the mechanism itself. | 18:42 |
| lifeless | dprince: I haven't seen that discussion with him :( | 18:42 |
| dprince | lifeless: it is in the ticket I filed... one sec | 18:43 |
| dprince | lifeless: http://marc.info/?l=linux-ext4&m=139232631720458&w=2 | 18:43 |
| *** vkozhukalov has joined #tripleo | 18:44 | |
| dprince | lifeless: I also find other links with similar info | 18:44 |
| dprince | lifeless: https://bugs.launchpad.net/ubuntu/+source/e2fsprogs/+bug/656115/comments/2 | 18:44 |
| dprince | lifeless: words like, crazy, insane insane, performance-destroying hack are how he describes what we are doing now... | 18:45 |
| dprince | lifeless: at least that is how I read it... | 18:45 |
| dprince | lifeless: all we gotta do is mkfs/rsync at the right place and everything works perfectly... | 18:45 |
| dprince | lifeless: I actually would like that place to be the ramdisk (long term). But today we use nova-baremetal-deploy-helper for this so I see this as a step in the right direction. | 18:46 |
| lifeless | dprince: mmm so that was 4 years ago | 18:47 |
| dprince | lifeless: The new thread (which uses my image from two weeks ago) is fresh! | 18:48 |
| lifeless | missed that link, looking now | 18:49 |
| lifeless | " | 18:49 |
| lifeless | Don't get me wrong; we should be able to handle this case correctly, | 18:49 |
| lifeless | and not trigger a BUG_ON, but this is why most people aren't seeing" | 18:49 |
| dprince | lifeless: handling it is one thing. It clearly isn't as effecient to do this. | 18:50 |
| dprince | lifeless: mkfs.ext4 works best when used *on* the actual file system where it intends to live | 18:50 |
| dprince | lifeless: So while he'll look at fixing (may take weeks or months to propigate that fix) we should still consider ways to raise the bar here anyway. | 18:51 |
| dprince | lifeless: we already do this for ephemeral | 18:51 |
| dprince | lifeless: all we are doing here is making it right for the root as well | 18:52 |
| lifeless | there's a couple of huge differences | 18:52 |
| lifeless | the primary one is that we're reopening the quite significant security hole that guestfs is aimed at | 18:53 |
| lifeless | and limiting users to whatever the cloud provider offers fs wise | 18:53 |
| lifeless | thats less of alimit with ephemeral (we only format there because nova does, not because I think we *should*) | 18:53 |
| *** openstackgerrit has quit IRC | 18:53 | |
| lifeless | bah that sounds arrogant | 18:54 |
| *** openstackgerrit has joined #tripleo | 18:54 | |
| dprince | lifeless: we aren't even using guestfs w/ TripleO right now? | 18:54 |
| lifeless | I mean to say that in my ideal world cloud-init would be responsible for formatting the ephemeral partition on boot | 18:54 |
| lifeless | dprince: we haven't needed to because we don't poke inside user supplied images | 18:54 |
| lifeless | dprince: your patch changes that :( | 18:54 |
| dprince | lifeless: This isn't poking around. | 18:54 |
| dprince | lifeless: just mounting. | 18:55 |
| lifeless | right, which means a bad fs image can attack kernel drivers. | 18:55 |
| dprince | lifeless: which we *have* done before | 18:55 |
| lifeless | dprince: in nova bm? no | 18:55 |
| dprince | lifeless: yes. We already have code that mounts for the injection. Now I understand we don't need that anymore but still. | 18:55 |
| lifeless | dprince: not since we got rid of file injection | 18:55 |
| lifeless | dprince: we got rid of file injection to get rid of this | 18:55 |
| dprince | lifeless: code is there, it is just off | 18:55 |
| lifeless | dprince: it doesn't exist in ironic at all, and won't. | 18:56 |
| dprince | lifeless: Look, regardless of what you think of my Nova patch... the DIB patch is the right thing to do IMO. A 1PB root is like overshooting the moon. | 18:56 |
| dprince | lifeless: Who has a 1PB read only root anyways? | 18:57 |
| * dprince knows we aren't using read only yet... but still | 18:57 | |
| *** e0ne has joined #tripleo | 18:57 | |
| dprince | lifeless: the DIB fix is the right thing to do IMO. See patchset 1 where I made it an option if you like. | 18:57 |
| dprince | lifeless: once I figured out the Nova side of things I became convinced this was the right thing to do and just removed it entirely | 18:58 |
| *** lucas-afk is now known as lucasagomes | 18:58 | |
| lifeless | dprince: sorry, little distracted with family breakfast | 19:02 |
| lifeless | dprince: haven't abandoned the conversation | 19:02 |
| *** jprovazn has joined #tripleo | 19:04 | |
| lifeless | dprince: making it an option seems like an important facility given the bug in resize2fs | 19:05 |
| dprince | lifeless: Well, I'm happy to resurect that as a means to move forward. But I'd like to explore the Nova side further... perhaps using libguestfs even to ward off that concern. | 19:06 |
| lifeless | dprince: it also means we'll have massively more complexity as we move to multicast/torrent approaches, particularly for things like selinux | 19:07 |
| lifeless | dprince: I'm presuming your x% faster metric was on 10Gbs baremetal to baremetal test rig? | 19:07 |
| dprince | lifeless: my take home for all this is we should run mkfs on filesystems if we can and avoid resize2fs for grossly out of range resizes. | 19:08 |
| openstackgerrit | Richard Su proposed a change to openstack/tripleo-heat-templates: Add username parameter for rabbit https://review.openstack.org/71430 | 19:08 |
| lifeless | dprince: I agree we need to avoid the resize bug until its fixed; I'm not at all convinced of the rest | 19:08 |
| *** e0ne has quit IRC | 19:09 | |
| *** e0ne has joined #tripleo | 19:09 | |
| lifeless | dprince: this stuff isn't any cheaper for kvm, but we don't mkfs the root in kvm | 19:12 |
| lifeless | block devices as a bucket of bits is supremely useful at preserving the integrity of operating system images | 19:12 |
| lifeless | I think we should think -very- long and hard before looking through that layer | 19:12 |
| dprince | lifeless: right. And we don't have TBs or PBs of data for VMs so this isn't a concern. | 19:12 |
| dprince | lifeless: for bare metal having as efficent FS as possible seems like a reasonable goal | 19:13 |
| dprince | lifeless: Just because the cloud does something doesn't mean it is an excuse for us to use it at the lower level here. | 19:14 |
| *** cd-undercloud has joined #tripleo | 19:14 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 19:14 |
| *** cd-undercloud has quit IRC | 19:14 | |
| *** e0ne has quit IRC | 19:14 | |
| *** jcooley_ has joined #tripleo | 19:15 | |
| lifeless | dprince: I'm not arguing excuses, I'm arguing useful abstractions, more flexability for users, lower design risk of security holes | 19:17 |
| lifeless | dprince: greater ease of support for alternative operating systems | 19:17 |
| lifeless | dprince: easier support for massively parallel deployments | 19:17 |
| dprince | lifeless: we can itereate to solve the security issues fairly quickly here I think. As for the rest I'm arguing for the same things. | 19:18 |
| dprince | lifeless: My main arguement is DIB shouldn't have to know about the max size of the eventual root partition. | 19:19 |
| lifeless | dprince: I agree that it shouldn't | 19:19 |
| dprince | lifeless: For bare metal we are potentially dealing with *much* larger disks that normal VMs have. | 19:19 |
| lifeless | dprince: the only reason it does is an ext4 bug; if we built xfs images or btrfs or zfs it wouldn't need to. | 19:19 |
| lifeless | dprince: How so? | 19:20 |
| lifeless | dprince: VMs (on cinder devices) may have many TB volumes. | 19:20 |
| lifeless | dprince: larger than baremetal infact - thats why we went with 1PB, *for* VMs | 19:20 |
| dprince | lifeless: sure. And we can got into the TB with the ext defaults. | 19:20 |
| dprince | lifeless: re, btrfs or zfs, that is what you *think*. We don't know what would happend if we tried the same things there... | 19:21 |
| lifeless | so | 19:22 |
| lifeless | I'm not feeling swayed | 19:22 |
| lifeless | and it's clear I'm not managing to communicate the terror of this abstraction violation that I have | 19:22 |
| lifeless | so lets focus on finding a compromise so we can fix the pragmatic issue and move forward | 19:22 |
| dprince | lifeless: I like how it is okay for TripleO to do injection for months but this terrifies you :) | 19:23 |
| dprince | lifeless: I'm talking about RO mounting an image w/ guestfs and that terrifies you. | 19:23 |
| dprince | lifeless: *and* we already run mkfs for the ephemeral partition | 19:23 |
| *** e0ne has joined #tripleo | 19:23 | |
| dprince | lifeless: My take is like get over it, Its Nova. That is what Nova does. | 19:24 |
| dprince | lifeless: the FS guys basically told us this is a design issue. i.e. run mkfs on the disk where you use it (if you can) and you'll be good. | 19:24 |
| dprince | lifeless: I think that is good advice. | 19:24 |
| dprince | lifeless: Now we can do the OpenStack thing and "roll our own" here but I think that may be questionable | 19:25 |
| dprince | lifeless: at least it is by me | 19:25 |
| lifeless | dprince: file injection was never ok | 19:28 |
| lifeless | dprince: I hated every minute of it, but we had a plan to get away from it, and we did | 19:28 |
| dprince | lifeless: this isn't file injection. It is mount (safely) a RO partition and copy data to something we just ran fdisk/mkfs on. (which we do already) | 19:30 |
| lifeless | dprince: now we're going in circles. The mount isn't safe (today), its limited by fs's the deploy engine supports, the output is limited by fs's the deploy engine supports, the copy isn't as trivially parallelised, and the fact we run mkfs for ephemeral is itself arguably a bug (but its what nova does) | 19:32 |
| dprince | lifeless: I don't think we are going in circles at all. Just a simple step in the right direction. At the end of the day I would rather our deployment ramdisk to much of this heavy lifting for us. | 19:33 |
| lifeless | dprince: I know its not file injection, you said that my being terrified by the consequences of the proposed approach was hypocritical because we did file injection - and I pointed out that the very first thing I did when I realised we did file injection was to file bugs... | 19:33 |
| lifeless | so its not hypocritical at all | 19:34 |
| lifeless | the partition table on a machine is a well defined standard, its a grey area whether we should touch it or not (smoser argues we shouldn't - I argue that its very well defined) | 19:35 |
| dprince | lifeless: And the ext4 authors say it is best to mkfs *on* the disks themselves. That will give us the best layout. | 19:36 |
| *** weshay has quit IRC | 19:36 | |
| lifeless | thats a problem shared with vms, and solving it should be shared with vms | 19:39 |
| lifeless | thats a fundamental design approach for tripleo, that we align with and share solutions with the whole stack | 19:39 |
| dprince | lifeless: the issue we are dealing w/ is really large root filesystems. | 19:39 |
| dprince | lifeless: I don't think that is that common for VMs | 19:40 |
| dprince | lifeless: most VMs are going to have a smaller root and larger ephemeral... | 19:40 |
| lifeless | our rootfs is 20GB deployed today, which is not really large | 19:40 |
| lifeless | why do you say we're dealing with really large root file systems? | 19:40 |
| dprince | lifeless: then why not remove the 1PB resize= option like I'm proposing? | 19:40 |
| lifeless | dprince: because VM's suffer the issue; which is why I said I'm happy for it to be made optional | 19:41 |
| openstackgerrit | Dan Prince proposed a change to openstack/diskimage-builder: Make max-online-resize an option. https://review.openstack.org/73854 | 19:42 |
| dprince | lifeless: so be it ^^ | 19:42 |
| lifeless | what do you think of the suggestion I made on patch set 1 - to link to the resize2fs bug ? | 19:43 |
| dprince | lifeless: it is linked? https://bugs.launchpad.net/diskimage-builder/+bug/1280709/comments/2 | 19:44 |
| lifeless | dprince: not *our* bug, whatever bug ted will close when he fixes the issue | 19:44 |
| dprince | lifeless: That is beyond the scope of DIB IMO. Their mailing list is the place for that I think. | 19:45 |
| lifeless | dprince: right, my thought was to have a link to something so that folk who use the option, shoot themselves in the foot by making it too big, have a pointer for where to go | 19:46 |
| dprince | lifeless: I linked to the thread in the bug already :) | 19:46 |
| lifeless | dprince: from the commit message | 19:46 |
| lifeless | dprince: ? | 19:46 |
| lifeless | dprince: For clarity - I'm suggesting in the help, so that users see it without having to have access to the git history. | 19:47 |
| *** e0ne has quit IRC | 19:47 | |
| lifeless | dprince: because folk with installed packages won't have git history. | 19:47 |
| *** e0ne has joined #tripleo | 19:47 | |
| dprince | lifeless: this is why I wanted to rip this out, It is a bad option. | 19:47 |
| dprince | lifeless: but whatever. I can pollute the codebase further I guess... | 19:48 |
| dprince | lifeless: I personally prefer less options here. they are always better if you can pull it of (which we can) | 19:48 |
| *** jcoufal has joined #tripleo | 19:51 | |
| openstackgerrit | James Slagle proposed a change to openstack/tripleo-incubator: Add LICENSE https://review.openstack.org/74140 | 19:52 |
| openstackgerrit | Jay Dobies proposed a change to openstack/tuskar: Eager load role data with count information https://review.openstack.org/74142 | 20:00 |
| *** lucasagomes is now known as lucas-afk | 20:02 | |
| *** gcha has joined #tripleo | 20:10 | |
| *** weshay has joined #tripleo | 20:13 | |
| lifeless | back | 20:23 |
| lifeless | had to do kindy run, sorry | 20:24 |
| lifeless | dprince: I agree with a preference for less options, but not at the cost proposed - which is going from a single narrow interface (partition table + PXE boot) that supports most OS's to support on an OS by OS basis. | 20:24 |
| lifeless | dprince: that shifts things inappropriately | 20:25 |
| *** jcooley_ has quit IRC | 20:25 | |
| dprince | lifeless: I think you overstate this as an OS issue. It isn't like what we do today supports Windows or something. We support any OS that has ext varients currently and if people are interested in other filesystems we can add those easy enough I think. | 20:26 |
| lifeless | dprince: AIUI we support windows just fine in nova-bm | 20:27 |
| lifeless | dprince: you have to change a bunch of global options, but no code | 20:27 |
| lifeless | dprince: ditto freebsd etc | 20:27 |
| dprince | lifeless: I really like how we throw around rsync for other TripleO use cases (like potentially for in-place image updates) but I throw it out here for provisioning and all of a sudden it is evil. | 20:28 |
| lifeless | dprince: its not evil, its an abstraction layer issue | 20:28 |
| *** e0ne has quit IRC | 20:28 | |
| lifeless | dprince: in-instance its clearly fine, it doesn't affect the core | 20:28 |
| lifeless | dprince: it will work for both VMs and BM | 20:28 |
| dprince | lifeless: an ephemeral mkfs. I suppose taht works on "other OS's" too then? | 20:28 |
| *** e0ne has joined #tripleo | 20:29 | |
| dprince | lifeless: again, I think you are overstating the facts a bit | 20:29 |
| *** akuznetsov has quit IRC | 20:29 | |
| lifeless | dprince: I am not going to support ephemeral mkfs, because I don't like it, but yes - for other OSs they can format that partition themselves. | 20:29 |
| lifeless | dprince: which I think we should be doing anyhow | 20:29 |
| lifeless | dprince: Any chance you'll remove your -2 on https://review.openstack.org/#/c/71219/ ? I don't think it conflicts with your proposed change at all (and even with your change, I still would worry about thrashing) | 20:30 |
| dprince | lifeless: I'd like to test it first.... | 20:31 |
| dprince | lifeless: but then maybe. ALthough I do think it may be worth discussing this on the list too. | 20:31 |
| dprince | lifeless: perhaps if nothing else this helps us get a good end goal in mind here. | 20:31 |
| lifeless | dprince: in case you aren't aware, please read through the discussion I had with deva on that patch about concurrency elsewhere in the system. | 20:31 |
| dprince | lifeless: I'm displeased with DIB at this point and how it mucks w/ the filesystem. | 20:32 |
| devananda | lifeless: oh hai! | 20:32 |
| lifeless | dprince: its really orthogonal to your patch - it applies whether or not you use rsync or dd, and whether or not one does a convert to raw or not. | 20:32 |
| dprince | lifeless: So we have a tradeoff here. Abstraction vs. a bad file system layout. | 20:32 |
| lifeless | dprince: what does 'bad filesystem layout' mean for this specific use case | 20:32 |
| lifeless | dprince: in really specific terms. | 20:33 |
| dprince | lifeless: I'm not talking about your patch man :). I already gave you the answer there... I just want to test it. | 20:33 |
| lifeless | dprince: I am | 20:33 |
| *** e0ne has quit IRC | 20:33 | |
| lifeless | dprince: ok; please do. | 20:33 |
| devananda | lifeless: haven't seen you chime in the couple times it's come up, so just checking - have you seen the comments re: ironic's graduation blocked on Nova driver CI ? | 20:34 |
| lifeless | devananda: possibly not; link me up ? | 20:34 |
| devananda | sec | 20:34 |
| lifeless | dprince: w.r.t. bad filesystem layout, I meant - whats 'bad' about it, what performance /robustness impact does it have (given that its (in principle) read only?) | 20:35 |
| *** cd-undercloud has joined #tripleo | 20:35 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 20:35 |
| *** cd-undercloud has quit IRC | 20:35 | |
| devananda | lifeless: http://lists.openstack.org/pipermail/openstack-dev/2014-February/027189.html | 20:36 |
| devananda | lifeless: that's the tail of the ML thread with russel's comment | 20:36 |
| devananda | he repeated it in today's meeting | 20:36 |
| *** markmc has quit IRC | 20:36 | |
| lifeless | righto | 20:37 |
| lifeless | so, AIUI you can deploy cirros images in devstack-gate, so you should be able to do full CI there. | 20:37 |
| lifeless | yes, it doesn't test IPMI, but CI and testing-every-single-implementation are separate things | 20:38 |
| lifeless | like, we don't test every version of kvm | 20:38 |
| lifeless | Ironic is a layer, so to me you test the nova-ironic-$pick-a-power-driver-deploy path works, which tells you that nova<->Ironic - the nova ironic driver - works | 20:39 |
| lifeless | and you test all the possible Ironic backends separately | 20:39 |
| lifeless | I don't think we can even once RH region comes online, do per-nova commit baremetal test runs | 20:39 |
| lifeless | too much bandwidth | 20:39 |
| lifeless | we can do per-Ironic baremetal runs I expect | 20:40 |
| lifeless | but a lot of optimisation will be needed | 20:40 |
| lifeless | or we can do a check-on-+2 feature for zuul | 20:40 |
| lifeless | which is whats needed I think anyhow, based on a discussion with sdague | 20:40 |
| openstackgerrit | Ben Nemec proposed a change to openstack/diskimage-builder: Add RHEL 7 image element https://review.openstack.org/74146 | 20:40 |
| devananda | lifeless: right | 20:42 |
| devananda | lifeless: that's the plan | 20:42 |
| devananda | lifeless: in infra's VMs, do integration tests with cirros images | 20:42 |
| devananda | which will exercise nova, nova-ironic driver, ironic-neutron interaction, and the PXE driver, etc... | 20:43 |
| devananda | i'm going to focus on that, and hopefully a few folks will dog pile with me on getting it done ASAP | 20:43 |
| *** ifarkas has quit IRC | 20:44 | |
| devananda | once we have it, hopefully nova-core will start actually reviewing our driver patches and grant a FFE ... | 20:44 |
| *** jcoufal has quit IRC | 20:48 | |
| *** jcoufal has joined #tripleo | 20:48 | |
| openstackgerrit | Dirk Mueller proposed a change to openstack/tripleo-image-elements: Nova package install support (openSUSE) https://review.openstack.org/71139 | 21:16 |
| *** jtomasek has quit IRC | 21:18 | |
| *** gcha has quit IRC | 21:20 | |
| *** derekh has joined #tripleo | 21:31 | |
| lifeless | derekh: HALLO MY FRIEND | 21:32 |
| lifeless | ahh I'm finally into the box | 21:32 |
| lifeless | serial console headaches | 21:32 |
| derekh | lifeless: to get a console on the overcloud machine I used the interface, cou;dn't get sol to work | 21:32 |
| lifeless | interface? | 21:33 |
| lifeless | derekh: anyhow, this is a known issue | 21:33 |
| derekh | lifeless: *web interface | 21:33 |
| lifeless | now that I'm on the box | 21:33 |
| lifeless | in trello, firedrill column | 21:33 |
| lifeless | https://trello.com/c/ruXSHgYq/85-dhcp-all-interfaces-breaking-our-brains | 21:33 |
| lifeless | should be fixed now | 21:35 |
| lifeless | I've made eth2 manual\n pre-up ip link set eth2 up | 21:36 |
| lifeless | rather than dhcp | 21:36 |
| lifeless | it'll probably take out the compute nodes next | 21:36 |
| derekh | lifeless: ok, cool, I saw the duplicate IP on br-untagged and eth2 but comparing it to ci-overcloud-novacompute9 it seemed to be the same | 21:37 |
| lifeless | derekh: yeah, thats a broken config that only ever works randomly | 21:37 |
| openstackgerrit | Dirk Mueller proposed a change to openstack/diskimage-builder: Pep8/Pyflakes fixing https://review.openstack.org/74169 | 21:37 |
| lifeless | derekh: look at /etc/network/interfaces now on the control plane | 21:38 |
| *** lucas-afk has left #tripleo | 21:38 | |
| *** e0ne has joined #tripleo | 21:39 | |
| derekh | lifeless: ok, got it | 21:39 |
| derekh | darn it, spend a crap load of today trying to figure it out :-( | 21:40 |
| lifeless | sorry - there is a critical bug filed about it :) | 21:41 |
| openstackgerrit | Dirk Mueller proposed a change to openstack/diskimage-builder: Add helper to map service users https://review.openstack.org/74171 | 21:41 |
| lifeless | always look for firedrill cards/critical bugs :) | 21:41 |
| derekh | lifeless: yup | 21:42 |
| lifeless | so, we now need to fixup the compute nodes | 21:42 |
| lifeless | where fixup == ifdown eth2; fix /e/n/i; ifup eth2 | 21:42 |
| lifeless | or | 21:42 |
| lifeless | fixup /e/n/i, kill the rogue dhclient, and ip addr del the address from eth2 | 21:43 |
| lifeless | which can be done without console access | 21:43 |
| *** rbrady is now known as rbrad-afk | 21:43 | |
| *** rbrad-afk is now known as rbrady-afk | 21:43 | |
| derekh | brb, can help out with it in a couple of minutes | 21:44 |
| *** coolsvap has quit IRC | 21:44 | |
| *** e0ne has quit IRC | 21:44 | |
| *** hashar has joined #tripleo | 21:44 | |
| *** hashar has quit IRC | 21:52 | |
| *** vkozhukalov has quit IRC | 21:53 | |
| derekh | lifeless: passing over machines doing option 2 | 21:53 |
| *** jdob has quit IRC | 21:54 | |
| *** jprovazn has quit IRC | 21:55 | |
| lifeless | derekh: awesome, sorry, multiplexing here | 21:56 |
| *** cd-undercloud has joined #tripleo | 21:56 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 21:56 |
| *** cd-undercloud has quit IRC | 21:56 | |
| *** cwolferh has quit IRC | 22:01 | |
| *** spzala has joined #tripleo | 22:02 | |
| ccrouch | swift question: | 22:08 |
| ccrouch | so what does the mount of /srv/node/d1 needed for | 22:08 |
| ccrouch | https://github.com/openstack/tripleo-heat-templates/blob/4aff0fb3f718ee0e55f39f5d0663feb22a14e9a3/swift-source.yaml#L29 | 22:08 |
| ccrouch | ? | 22:08 |
| *** jcoufal has quit IRC | 22:12 | |
| *** lblanchard has quit IRC | 22:13 | |
| derekh | ccrouch: needs to be a filesystem that supports extended attributes | 22:14 |
| derekh | ccrouch: swift doesn't need it to be a seperate filesystem unless configured that way, checking | 22:15 |
| derekh | lifeless: done | 22:15 |
| lifeless | derekh: cool | 22:15 |
| derekh | ccrouch: so https://github.com/openstack/tripleo-image-elements/blob/master/elements/swift-storage/os-config-applier/etc/swift/object-server.conf#L3 | 22:16 |
| derekh | ccrouch: i.e. it doesn;t need to be a seperate mount | 22:16 |
| ccrouch | derekh: ah! | 22:16 |
| ccrouch | so it will just | 22:16 |
| ccrouch | mkdir d1 | 22:16 |
| derekh | ccrouch: swift will do that iirc | 22:16 |
| ccrouch | right, ok that makes a tonne of sense, and explains how this works at all :-) | 22:17 |
| ccrouch | thanks | 22:17 |
| derekh | ccrouch: np | 22:17 |
| *** julim_ has quit IRC | 22:19 | |
| derekh | lifeless: so we got a load of instances in error state, do they need to be deleted by us? | 22:21 |
| lifeless | derekh: if they are nodepool instances, shouldn't no. | 22:21 |
| lifeless | lets -> -infra | 22:21 |
| derekh | lifeless: k | 22:21 |
| SpamapS | [ 3.356865] init: mountall main process (209) terminated with status 127 | 22:25 |
| SpamapS | [ 303.072130] EXT4-fs (vda1): error count: 9 | 22:25 |
| SpamapS | [ 303.073668] EXT4-fs (vda1): initial error at 1392632867: ext4_mb_generate_buddy:755 | 22:25 |
| SpamapS | [ 303.076503] EXT4-fs (vda1): last error at 1392633406: ext4_mb_generate_buddy:755 | 22:25 |
| SpamapS | something borken on booting instance | 22:25 |
| SpamapS | mordred: FYI, we do not use distro pip for anything other than installing virtualenv. From that point on we use the pip from the virtualenv. | 22:27 |
| mordred | SpamapS: you shouldn't use distro pip for that | 22:28 |
| mordred | it's probably broken or insecure | 22:28 |
| SpamapS | so, download pip tarball? | 22:28 |
| mordred | yeah. I can link you to scripts and whatnot | 22:28 |
| SpamapS | or you could submit a patch | 22:28 |
| SpamapS | :) | 22:28 |
| *** cwolferh has joined #tripleo | 22:32 | |
| derekh | lifeless: ok, verified cloud, create instance, ssh to vm so we should be good to go | 22:35 |
| *** dprince has quit IRC | 22:35 | |
| *** vipuls is now known as vipul | 22:38 | |
| *** EntropyWorks has quit IRC | 22:38 | |
| bnemec | mordred: SpamapS: FWIW, I had to install pip from source in my rhel 7 image: https://review.openstack.org/#/c/74146/1/elements/rhel7/pre-install.d/50-install-pip | 22:41 |
| bnemec | I see it's available in epel now, but it wasn't when I started working on that. | 22:41 |
| *** EntropyWorks has joined #tripleo | 22:41 | |
| lifeless | derekh: lol | 22:41 |
| lifeless | ERROR: Cannot 'forceDelete' while instance is in vm_state error (HTTP 409) (Request-ID: req-1c4a88c3-4ea1-45a8-b987-629a69b4af06) | 22:41 |
| lifeless | force delete not so forceful | 22:41 |
| derekh | maybe there is a --really-force flag | 22:45 |
| slagle | i fall back to mysql | 22:45 |
| slagle | i know, shame on me | 22:45 |
| lifeless | slagle: do you file bugs ? :) | 22:46 |
| * lifeless files a bug | 22:47 | |
| slagle | i didn't consider it a bug | 22:48 |
| lifeless | a VM you can't delete? definitely a bug | 22:48 |
| derekh | lifeless: ok, I'm outta here, cloud is up, cancel firedrill as appropriate , | 22:49 |
| *** derekh has quit IRC | 22:49 | |
| lifeless | derekh: thanks man! | 22:49 |
| mordred | bnemec: well.... let me make some suggestions... | 22:52 |
| *** cwolferh has quit IRC | 22:56 | |
| *** rcarrillocruz has quit IRC | 23:00 | |
| *** rcarrillocruz has joined #tripleo | 23:00 | |
| *** noslzzp has quit IRC | 23:09 | |
| *** rlandy has quit IRC | 23:13 | |
| *** cd-undercloud has joined #tripleo | 23:18 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 23:18 |
| *** cd-undercloud has quit IRC | 23:18 | |
| *** matty_dubs is now known as matty_dubs|gone | 23:22 | |
| *** rcarrillocruz has quit IRC | 23:24 | |
| *** noslzzp has joined #tripleo | 23:25 | |
| *** cwolferh has joined #tripleo | 23:28 | |
| rwsu | is there a reason why horizon isn't installed on the overcloud control? | 23:33 |
| SpamapS | rwsu: nobody asked for it yet? ;) | 23:33 |
| rwsu | haha, ok I think it is time | 23:34 |
| *** jcooley_ has joined #tripleo | 23:37 | |
| mordred | bnemec: http://git.openstack.org/cgit/openstack-infra/config/tree/install_puppet.sh#n20 | 23:46 |
| mordred | bnemec: lines 20-26 are what you want | 23:46 |
| mordred | bnemec: if you want to install pip somewhere | 23:47 |
| mordred | lifeless: ^^ | 23:47 |
| mordred | those lines encapsulate the published process from setuptools and pip upstream | 23:48 |
| lifeless | thanks | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!