*** rbrady-afk has quit IRC | 00:15 | |
*** cd-undercloud has joined #tripleo | 00:18 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 00:18 |
---|---|---|
*** cd-undercloud has quit IRC | 00:18 | |
*** e0ne has joined #tripleo | 00:21 | |
*** CaptTofu has joined #tripleo | 00:23 | |
*** StevenK_ is now known as StevenK | 00:25 | |
*** StevenK is now known as Guest99695 | 00:26 | |
*** e0ne has quit IRC | 00:26 | |
*** Guest99695 is now known as StevenK | 00:26 | |
StevenK | lifeless: I wasn't touching power yet | 00:30 |
*** matsuhashi has joined #tripleo | 00:31 | |
lifeless | StevenK: all the same thing :) | 00:31 |
*** lazy_prince has quit IRC | 00:31 | |
*** cadenzajon has quit IRC | 00:32 | |
*** killer_prince has joined #tripleo | 00:32 | |
lifeless | SpamapS: still up ? | 00:33 |
*** hashar has quit IRC | 00:35 | |
lifeless | nvm | 00:37 |
*** edmund has quit IRC | 00:38 | |
*** dkehn__ has joined #tripleo | 00:46 | |
*** howleyt_ has joined #tripleo | 00:48 | |
*** matsuhas_ has joined #tripleo | 00:48 | |
*** tteggel_ has joined #tripleo | 00:48 | |
*** nijaba_ has joined #tripleo | 00:48 | |
*** dkehn___ has joined #tripleo | 00:49 | |
*** csd has quit IRC | 00:49 | |
*** AaronGreen has joined #tripleo | 00:49 | |
*** csd has joined #tripleo | 00:50 | |
*** matty_du1s|gone has joined #tripleo | 00:51 | |
openstackgerrit | A change was merged to openstack/tripleo-image-elements: Restart libvirt-bin when reconfiguring. https://review.openstack.org/74559 | 00:55 |
openstackgerrit | A change was merged to openstack/tripleo-image-elements: Stop using deprecated libvirt_type setting. https://review.openstack.org/74609 | 00:55 |
openstackgerrit | A change was merged to openstack/tripleo-image-elements: Enable live block migration for libvirt. https://review.openstack.org/74610 | 00:55 |
*** matsuhashi has quit IRC | 00:55 | |
*** nijaba has quit IRC | 00:55 | |
*** tteggel has quit IRC | 00:55 | |
*** dkehn_ has quit IRC | 00:55 | |
*** dkehn has quit IRC | 00:55 | |
*** lifeless has quit IRC | 00:55 | |
*** howleyt has quit IRC | 00:55 | |
*** AaronGr has quit IRC | 00:55 | |
*** Daviey has quit IRC | 00:55 | |
*** matty_dubs|gone has quit IRC | 00:55 | |
*** tteggel_ is now known as tteggel | 00:56 | |
*** cd-undercloud has joined #tripleo | 00:57 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 00:57 |
*** cd-undercloud has quit IRC | 00:57 | |
*** AaronGreen is now known as AaronGr | 00:57 | |
*** lifeless has joined #tripleo | 00:57 | |
*** dickson.freenode.net sets mode: +v lifeless | 00:57 | |
openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Add a Merge::Map feature. https://review.openstack.org/74921 | 00:58 |
*** Daviey has joined #tripleo | 00:58 | |
lifeless | go you beauty | 00:58 |
openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Gather all hypervisor names into /etc/hosts. https://review.openstack.org/74928 | 00:58 |
*** lifeless has quit IRC | 01:02 | |
*** lifeless has joined #tripleo | 01:02 | |
*** dickson.freenode.net sets mode: +v lifeless | 01:02 | |
greghaynes | anyone made an overcloud recently? mine seems to not be starting amqp | 01:10 |
lifeless | greghaynes: you're missing rabbitmq-server | 01:11 |
lifeless | greghaynes: pull incubator | 01:11 |
greghaynes | that would probably do it :p | 01:11 |
lifeless | and look at the log | 01:11 |
*** weshay has joined #tripleo | 01:15 | |
*** openstackgerrit has quit IRC | 01:18 | |
*** openstackgerrit has joined #tripleo | 01:19 | |
*** cd-undercloud has joined #tripleo | 01:21 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 01:21 |
*** cd-undercloud has quit IRC | 01:21 | |
*** e0ne has joined #tripleo | 01:21 | |
*** e0ne has quit IRC | 01:26 | |
openstackgerrit | Alex Holden proposed a change to openstack/tripleo-image-elements: Fixing error in readme https://review.openstack.org/75276 | 01:27 |
*** edmund has joined #tripleo | 01:32 | |
*** nosnos has joined #tripleo | 01:34 | |
greghaynes | seems somewhat odd that setting DIB_EXTRA_ARGS actually removed rabitmq-server | 01:37 |
greghaynes | not that I have a better solution in mind | 01:37 |
jog0 | lifeless: ping | 01:38 |
*** kfox1111 has quit IRC | 01:43 | |
*** cd-undercloud has joined #tripleo | 01:45 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 01:45 |
*** cd-undercloud has quit IRC | 01:45 | |
*** cd-undercloud has joined #tripleo | 01:47 | |
cd-undercloud | ************** overcloud complete status=128 ************ | 01:47 |
*** cd-undercloud has quit IRC | 01:47 | |
lifeless | jog0: pong | 01:48 |
jog0 | lifeless: bug 1282842 is ugly | 01:48 |
jog0 | wanted to move over here because infra is a little overwhealmed | 01:48 |
jog0 | with other work | 01:48 |
lifeless | yeah, thats cool | 01:48 |
lifeless | I know | 01:48 |
lifeless | its a shotgun bug | 01:48 |
*** newell has quit IRC | 01:48 | |
jog0 | heh yeah | 01:49 |
jog0 | so I am not surprised | 01:49 |
jog0 | only surprising thing is how come you didn't notice earlier? | 01:49 |
lifeless | of 40 instances nodepool spawned 22 ended up in error. | 01:49 |
jog0 | ouch | 01:49 |
lifeless | well, I've whinged to you about this with nova baremetal before | 01:49 |
jog0 | so I does tripleo cloud preserve instances accross updates now? | 01:49 |
lifeless | this time I caught it in the act on kvm | 01:50 |
lifeless | jog0: yes, and we have live migration too | 01:50 |
jog0 | thats what I thought nice | 01:50 |
lifeless | though see https://review.openstack.org/#/c/74600/ | 01:50 |
lifeless | nova default is not live | 01:50 |
jog0 | oh yeah saw that | 01:50 |
jog0 | anyway winding down for the day | 01:51 |
lifeless | the ci-overcloud isn't being updated though | 01:51 |
lifeless | so there are no updates to worry about here | 01:51 |
jog0 | wasted 2 hours fighting HP's neutron or rather quantum | 01:51 |
lifeless | oh | 01:51 |
jog0 | it didn't set up a default network for me | 01:51 |
lifeless | in the public cloud ? | 01:52 |
jog0 | anyway I am happy to help dig on your shotgun bug | 01:52 |
jog0 | yeah | 01:52 |
lifeless | wow | 01:52 |
jog0 | it was because I am special flower | 01:52 |
lifeless | so its 'nothing by default' ? | 01:52 |
lifeless | or you has some special setting ? | 01:52 |
lifeless | anyhow yeah it it might be e.g. keystone failing to be useful | 01:53 |
jog0 | its because my account was created differently | 01:53 |
*** shakayumi has quit IRC | 01:53 | |
lifeless | only 400K tokens | 01:53 |
jog0 | yeah this bug sounds like keystone derping | 01:53 |
jog0 | ^_^ | 01:54 |
lifeless | so shouldn't be the usual fail | 01:54 |
lifeless | SpamapS: did we automate that tuning we did ? | 01:54 |
* jog0 goes AFK | 01:54 | |
lifeless | hmm, i need another +2er | 01:54 |
lifeless | marios_: around ? | 01:55 |
*** cd-undercloud has joined #tripleo | 01:57 | |
cd-undercloud | ************** overcloud complete status=6 ************ | 01:57 |
*** cd-undercloud has quit IRC | 01:57 | |
StevenK | Hm, 6? | 01:57 |
*** dkehn___ is now known as dkehn | 02:07 | |
*** cwolferh has joined #tripleo | 02:07 | |
lifeless | Fetching Base Image | 02:08 |
lifeless | curl: (6) Couldn't resolve host 'cloud-images.ubuntu.com' | 02:08 |
lifeless | Fetching Base Image | 02:08 |
lifeless | curl: (6) Couldn't resolve host 'cloud-images.ubuntu.com' | 02:08 |
lifeless | 'yay' | 02:08 |
*** cd-undercloud has joined #tripleo | 02:08 | |
cd-undercloud | ************** overcloud complete status=128 ************ | 02:08 |
*** cd-undercloud has quit IRC | 02:08 | |
lifeless | error: Unable to find 6f8f611cbeb83ea38563ca09abcde925e05e32fd under https://git.openstack.org/cgit/openstack/swift | 02:09 |
lifeless | Cannot obtain needed tree 6f8f611cbeb83ea38563ca09abcde925e05e32fd | 02:09 |
lifeless | -special- | 02:09 |
lifeless | while processing commit a94be9443d639dc0ac8498d8a35fed2832379ee7. | 02:09 |
lifeless | error: Fetch failed. | 02:09 |
StevenK | lifeless: AKA "Hm, where did the Internet go?" | 02:10 |
*** dkehn__ is now known as dkehn_ | 02:10 | |
*** e0ne has joined #tripleo | 02:21 | |
openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Don't use /cgit/ urls for git. https://review.openstack.org/75283 | 02:25 |
*** e0ne has quit IRC | 02:26 | |
*** weshay has quit IRC | 02:28 | |
*** tzumainn has quit IRC | 02:28 | |
*** saurabhs has quit IRC | 02:32 | |
*** matsuhas_ has quit IRC | 02:34 | |
*** matsuhas_ has joined #tripleo | 02:36 | |
*** marun has quit IRC | 02:37 | |
*** tzumainn has joined #tripleo | 02:42 | |
SpamapS | lifeless: remove the /cgit | 02:43 |
SpamapS | lifeless: it doesn't really work | 02:43 |
lifeless | SpamapS: which one did I leave? | 02:44 |
lifeless | SpamapS: also good...morning ? | 02:44 |
lifeless | SpamapS: or did you just get back from irish hospitality ? | 02:44 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Fix the hosts setting - nova uses novalocal. https://review.openstack.org/75287 | 02:45 |
lifeless | SpamapS: one small erraa ^ | 02:45 |
SpamapS | lifeless: I'm still in .ie .. flight leaves in ~ 7 hours | 02:45 |
SpamapS | officially in the clutches of the lag monster | 02:46 |
lifeless | SpamapS: can you +2 75287 before you flap flap flap away | 02:46 |
SpamapS | lifeless: isn't that just the example? | 02:47 |
lifeless | headdesk | 02:47 |
SpamapS | ;) | 02:47 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Fix the hosts setting - nova uses novalocal. https://review.openstack.org/75287 | 02:47 |
openstackgerrit | lifeless proposed a change to openstack/diskimage-builder: Better apt-sources docs. https://review.openstack.org/73035 | 02:49 |
*** cd-undercloud has joined #tripleo | 03:02 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 03:02 |
*** cd-undercloud has quit IRC | 03:02 | |
*** matsuhas_ has quit IRC | 03:03 | |
*** cd-undercloud has joined #tripleo | 03:03 | |
cd-undercloud | ************** overcloud complete status=7 ************ | 03:03 |
*** cd-undercloud has quit IRC | 03:03 | |
SpamapS | 7?! | 03:05 |
*** matsuhas_ has joined #tripleo | 03:06 | |
lifeless | SpamapS: dunno, looking | 03:10 |
lifeless | SpamapS: two reviews up there plox ;) | 03:10 |
lifeless | yay | 03:11 |
lifeless | https://jenkins05.openstack.org/job/check-tripleo-seed-precise/3/ | 03:11 |
SpamapS | \o/ testing | 03:12 |
*** cd-undercloud has joined #tripleo | 03:12 | |
cd-undercloud | ************** overcloud complete status=6 ************ | 03:12 |
*** cd-undercloud has quit IRC | 03:12 | |
lifeless | dats a norty word | 03:13 |
*** lifeless changes topic to "tripleo-cd running preserve-ephemeral WIP patches and https://review.openstack.org/#/c/62042/ | Using OpenStack to deploy OpenStack;meetings Tuesday 1900https://review.openstack.org/#/c/62042/ | Using OpenStack to deploy OpenStack;meetings Tuesday 1900 UTC in #openstack-meeting-alt" | 03:15 | |
*** jcooley_ has joined #tripleo | 03:17 | |
openstackgerrit | A change was merged to openstack-infra/tripleo-ci: Get logs from undercloud https://review.openstack.org/73635 | 03:20 |
*** e0ne has joined #tripleo | 03:21 | |
*** cd-undercloud has joined #tripleo | 03:24 | |
cd-undercloud | ************** overcloud complete status=128 ************ | 03:24 |
*** cd-undercloud has quit IRC | 03:24 | |
*** e0ne has quit IRC | 03:26 | |
lifeless | SpamapS: you might want to +A the cgit thing to unbreak tripleo-cd | 03:29 |
*** matsuhas_ has quit IRC | 03:29 | |
lifeless | seed didn't come up | 03:32 |
lifeless | https://jenkins05.openstack.org/job/check-tripleo-seed-precise/3/console | 03:32 |
lifeless | we're broken atm | 03:32 |
openstackgerrit | A change was merged to openstack/tripleo-image-elements: Don't use /cgit/ urls for git. https://review.openstack.org/75283 | 03:33 |
*** jcooley_ has quit IRC | 03:34 | |
*** jcooley_ has joined #tripleo | 03:35 | |
*** ramishra has joined #tripleo | 03:37 | |
*** killer_prince2 has joined #tripleo | 03:39 | |
*** jcooley_ has quit IRC | 03:39 | |
*** killer_prince2 is now known as lazy_prince | 03:39 | |
*** lazy_prince has quit IRC | 03:50 | |
StevenK | lifeless: So, yes, DIB_DISTRIBUTION_MIRROR is a subset, but I think you could mention both, now that the security.u.c change has landed. "If you want to point to a closer Ubuntu mirror, or an internal mirror, use DIB_DISTRIBUTION_MIRROR. If you'd like fine-grained control over the contents of the deployed sources.list, perhaps by adding other repositories, use the apt-sources element." | 04:01 |
*** CaptTofu has quit IRC | 04:02 | |
SpamapS | lifeless: btw, regarding mellanox, I have it on good authority that our mellanox networking troubles will go away if we install the latest driver and firmware. | 04:04 |
*** cd-undercloud has joined #tripleo | 04:09 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 04:09 |
*** cd-undercloud has quit IRC | 04:09 | |
SpamapS | ah back to failing the right way ... ;) | 04:09 |
lifeless | StevenK: I could; tell you what - if you have prose in mind, push an iteration with that. | 04:11 |
*** csd has quit IRC | 04:11 | |
lifeless | StevenK: I wanted to capture pointers for folk, not embed an entire dib manual :) - but I'm not against more. | 04:11 |
lifeless | StevenK: I just have little motivation for more. | 04:12 |
StevenK | lifeless: I was thinking of a few sentences | 04:17 |
*** ramishra has quit IRC | 04:19 | |
lifeless | StevenK: thats fine, I'm just saying - I won't push back against it, but I don't really feel the need to add it. | 04:19 |
*** ramishra has joined #tripleo | 04:19 | |
lifeless | StevenK: so I'd be delighted if you want to add it in | 04:20 |
*** e0ne has joined #tripleo | 04:21 | |
lifeless | StevenK: for context, I didn't set out to improve the docs, I just had a seniors moment when I went to use my local proxy, so captured a pointer in the relevant script | 04:23 |
openstackgerrit | A change was merged to openstack/tripleo-incubator: Remove duplicate configure-vm call in create-nodes https://review.openstack.org/74890 | 04:24 |
StevenK | Ooh | 04:24 |
StevenK | More yak shaving from yesterday landing | 04:25 |
*** matsuhashi has joined #tripleo | 04:25 | |
StevenK | lifeless: So I reach for DIB_DISTRIBUTION_MIRROR first, but that's probably because I wrote the support for it. | 04:25 |
*** e0ne has quit IRC | 04:26 | |
lifeless | the reason I like apt-sources is I can point it at my actual apt-sources | 04:26 |
lifeless | and it DTRT thing to build as long as my laptop is configured for wherever I am | 04:26 |
StevenK | Mmm | 04:27 |
*** epim has joined #tripleo | 04:33 | |
lifeless | SpamapS: https://review.openstack.org/#/c/74548/ | 04:33 |
SpamapS | lifeless: shouldn't it be DIB_PYPI_MIRROR_URL ? Or is PYPI_MIRROR_URL something special ? | 04:35 |
*** jcooley_ has joined #tripleo | 04:35 | |
lifeless | SpamapS: its not special, so I can change it if you like | 04:37 |
SpamapS | lifeless: we have been pretty consistent with that prefix | 04:38 |
SpamapS | but | 04:38 |
SpamapS | It is very late/early here depending on how you look at it | 04:38 |
lifeless | so, I don't really care either way, rebase is easy. | 04:38 |
SpamapS | and I may have just done way too many reviews on an empty stomach, and may be a bit grumpy now | 04:38 |
lifeless | but I want to get away from variables anyway | 04:38 |
lifeless | so | 04:38 |
SpamapS | true | 04:39 |
lifeless | your call | 04:39 |
SpamapS | so let's do it and we'll trash the variables later | 04:39 |
*** jcooley_ has quit IRC | 04:40 | |
openstackgerrit | A change was merged to openstack/diskimage-builder: Permit using arbitrary PyPI urls. https://review.openstack.org/74548 | 04:43 |
SpamapS | lifeless: the recent status=1 fail was 500's from nova-api | 04:44 |
SpamapS | lifeless: we have a bit of convincing to do in #heat soon... there's hesitance to just ignore/retry on 500... :-/ | 04:44 |
SpamapS | but anyway.. I need a nap... bbl | 04:44 |
lifeless | have they actually used heat? | 04:44 |
StevenK | lifeless: I think I'm ready to test my nodes change, I suspect kicking off a hpcloud node to use it for devtest would be a terrible idea? | 04:44 |
lifeless | StevenK: you don't have 16GB yet? | 04:46 |
StevenK | lifeless: Nope | 04:46 |
StevenK | I can probably just run it locally like my existing setup | 04:48 |
lifeless | whats your existing setup ? | 04:48 |
lifeless | cloud nodes are terrrrribly slow due to nested virt | 04:48 |
StevenK | lifeless: The devtest I have currently on my local desktop | 04:49 |
lifeless | StevenK: you could just tear that down and run in its place, no? | 04:49 |
StevenK | Right, hence "I can probably just run it locally like my existing setup" | 04:50 |
lifeless | it would be nice to have a test job that deploys a CI node and runs regular gate checks against it | 04:51 |
lifeless | but we either end up with nested virt, or we need undercloud user keys for it | 04:52 |
lifeless | so it would need to be secured and I don't think zuul is quite up to that | 04:52 |
*** cd-undercloud has joined #tripleo | 04:53 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 04:53 |
*** cd-undercloud has quit IRC | 04:53 | |
*** epim has quit IRC | 04:53 | |
*** lazy_prince has joined #tripleo | 04:55 | |
*** noslzzp has quit IRC | 04:55 | |
StevenK | lifeless: I shall have to troll Craige mercilessly on your behalf when I see him tonight | 04:55 |
lifeless | definitely | 04:58 |
*** jcooley_ has joined #tripleo | 05:03 | |
*** akuznets_ has quit IRC | 05:07 | |
*** jcooley_ has quit IRC | 05:11 | |
*** michchap has quit IRC | 05:14 | |
*** cwolferh has quit IRC | 05:14 | |
lifeless | hmm overcloud failing | 05:15 |
*** akuznetsov has joined #tripleo | 05:20 | |
*** e0ne has joined #tripleo | 05:21 | |
*** matsuhashi has quit IRC | 05:23 | |
*** e0ne has quit IRC | 05:26 | |
*** matsuhashi has joined #tripleo | 05:33 | |
*** jcooley_ has joined #tripleo | 05:47 | |
*** killer_prince has quit IRC | 06:01 | |
*** killer_p- has joined #tripleo | 06:02 | |
*** killer_p- is now known as killer_prince | 06:02 | |
*** CaptTofu has joined #tripleo | 06:03 | |
*** akuznetsov has quit IRC | 06:04 | |
*** CaptTofu has quit IRC | 06:08 | |
*** cd-undercloud has joined #tripleo | 06:08 | |
cd-undercloud | ************** overcloud complete status=255 ************ | 06:08 |
*** cd-undercloud has quit IRC | 06:08 | |
*** akuznetsov has joined #tripleo | 06:09 | |
*** coolsvap has joined #tripleo | 06:13 | |
lifeless | 255 now | 06:17 |
lifeless | wtf is this lotto | 06:17 |
*** mrunge has joined #tripleo | 06:17 | |
*** e0ne has joined #tripleo | 06:21 | |
*** saurabhs has joined #tripleo | 06:22 | |
*** e0ne has quit IRC | 06:26 | |
*** vkozhukalov has joined #tripleo | 06:33 | |
*** saju_m has joined #tripleo | 06:36 | |
SpamapS | lifeless: fail to ssh into the instance.. that's a fairly encouraging failure. :-P | 06:38 |
*** lsmola has joined #tripleo | 06:42 | |
lifeless | SpamapS: its certainly a new one | 06:42 |
*** lsmola has quit IRC | 06:42 | |
*** lsmola has joined #tripleo | 06:43 | |
lsmola | lifeless: hello, can i have a quick question? | 06:43 |
lsmola | lifeless: we are trying to solve initialization of overcloud in tuskar | 06:43 |
lsmola | lifeless: in short, these API calls https://etherpad.openstack.org/p/tuskar_init_after_create | 06:44 |
lsmola | lifeless: does it make sense for us to pack this all to TuskarAPI, and then use tuskar client in the devtest? | 06:44 |
lsmola | lifeless: or that initialization will be soon moved into template? So we should rather use the devtest scripts | 06:45 |
lsmola | SpamapS: ^ | 06:45 |
lsmola | lifeless: btw. using the devtest scripts would mean, we will just invoke it from tuskarAPI, which will be very ugly... | 06:47 |
*** jprovazn has joined #tripleo | 06:49 | |
lifeless | so | 06:53 |
lifeless | there are two things there | 06:53 |
lifeless | one is sshing in | 06:53 |
lifeless | which is ugly | 06:53 |
lifeless | we should find a good reliable way to avoid that | 06:53 |
lifeless | the second is a very small number (2 I think) of API calls to make keystone remotely usable | 06:54 |
lsmola | lifeless: yeah, the first one, right? | 06:54 |
lifeless | then the third thing (sorry, off by one error:P) is a bunch of normal API calls that wouldin a non-scripted setup be done via the overcloud horizon | 06:54 |
lsmola | lifeless: right, I am skipping that, that is the creating of demo user, uploading image, twc. yes that will be done in overcloud horizon | 06:55 |
lifeless | we can actually trim init-keystone down | 06:55 |
lifeless | only need admin + admin user + endpoint registration IIRC | 06:55 |
lsmola | lifeless: ok cool | 06:56 |
lsmola | lifeless: so does it make sense for us to do this in TuskarAPI? | 06:56 |
lsmola | lifeless: when it will be ready, we would put TuskarAPI CLI inside devtest? | 06:56 |
lifeless | just thinking, be a few:) | 06:57 |
lsmola | hehe, ok :-) | 06:57 |
lifeless | ok so the problem is this with keystone | 06:58 |
lifeless | we need the same certs on all the boxes | 06:58 |
lifeless | so we need something syncing them | 06:58 |
lifeless | probably we need to generate them and inject into the template in the absence of barbican | 06:58 |
lsmola | lifeless: right | 06:59 |
lifeless | and secondly we don't have tuskarAPI to bring up the seed | 06:59 |
lsmola | lifeless: yes | 06:59 |
lsmola | lifeless: so that was my second question | 06:59 |
lsmola | lifeless: he have been thinking about tuskar only in Overcloud ocntext | 07:00 |
lifeless | so I think we want some code that can be called from tuskarAPI and from shell | 07:00 |
lifeless | I don't mind if its python with a CLI wrapper or more shell or $whatever | 07:00 |
lifeless | but lets make sure that tuskar can wrap it nicely | 07:01 |
lsmola | lifeless: ok, so Undercloud would use shell, and overcloud tuskarAPI | 07:01 |
lifeless | e.g. no parsing freetext output or anything | 07:01 |
lifeless | seed will use shell | 07:01 |
lsmola | lifeless: oh yeah, sry | 07:01 |
lifeless | undercloud shell or tuskar CLI (pref tuskar CLI), overcloud shell or tuskar CLI (pref tuskar CLI) | 07:01 |
lsmola | lifeless: well if we leave out the certificates, it should be just API calls, so we can do that clean Openstack way | 07:02 |
lsmola | lifeless: ok, so I'll start with admin + admin user + endpoint | 07:03 |
lsmola | lifeless: should I create a bug for the certificate? | 07:03 |
lsmola | lifeless: is it easy to pack it to template? | 07:03 |
lifeless | so taking a step back | 07:04 |
lifeless | here is what I think | 07:04 |
lifeless | we need to aim for: | 07:04 |
lifeless | - shared code for the bring-up | 07:04 |
lifeless | - tuskar has all the complex scaling code | 07:05 |
lifeless | - seed deployment is a static configuration so doesn't need any of that | 07:05 |
lifeless | I think calling shell from within tuskarAPI is ok, its no worse than calling e.g. C | 07:06 |
lifeless | I'll walk through that ether pad and annotate line by line in a little bit for you | 07:06 |
lsmola | lifeless: hm | 07:06 |
lsmola | lifeless: so we will start with wrapping those scripts in tuskarAPI? | 07:07 |
lsmola | lifeless: but if we will be wrapping just API calls, we might rewrite that to using pythonclients | 07:08 |
lsmola | lifeless: and just wrap the one shell with certificate, until we get rid of that | 07:09 |
lifeless | lsmola: sure, but then you'll need to expose that rewritten python with a CLI | 07:09 |
lifeless | lsmola: for 'shared code for the bring-up' | 07:09 |
lsmola | lifeless: yeah | 07:09 |
lsmola | lifeless: we already have cli | 07:09 |
lifeless | lsmola: we don't want to maintain two copies of it, whatever it is. | 07:09 |
lsmola | lifeless: so that should not be hard | 07:09 |
lifeless | lsmola: not tuskar-cli | 07:09 |
lifeless | lsmola: the seed case. | 07:09 |
lsmola | lifeless: right | 07:09 |
lsmola | lifeless: darn | 07:10 |
lifeless | so whats unique between the seed and (undercloud, overcloud) | 07:10 |
lifeless | they both have varying networks to create, which are user modifiable | 07:11 |
lifeless | so a little bit of data processing | 07:11 |
lsmola | lifeless: well, it should be the same | 07:11 |
lsmola | lifeless: except templates | 07:11 |
lifeless | yeah broadly | 07:11 |
lifeless | template forseed is static | 07:11 |
lifeless | template for undercloud/overcloud is tuskar owned | 07:11 |
*** jcooley_ has quit IRC | 07:12 | |
lsmola | lifeless: ok | 07:12 |
lsmola | lifeless: so, if we will expose the rewritten code in TuskarCLI, the general part? | 07:13 |
lsmola | lifeless: and we make also CLI code specially for Overcloud? | 07:13 |
lsmola | lifeless: seed could use tuskar too right? it would just use some general function with few API calls in it | 07:14 |
lifeless | seed can't use tuskar API | 07:14 |
lifeless | we can install the CLI and run it yes | 07:14 |
lifeless | but It would be ugly IMO to have a circular dep tuskar API -> tuskar CLI -> tuskar API | 07:15 |
*** jcooley_ has joined #tripleo | 07:15 | |
lifeless | lets have a specific thing - library or whatever - for this one-time-setup stuff | 07:15 |
lsmola | lifeless: hm the problem is that CLi should just call API | 07:15 |
lsmola | lifeless: well not sure if general library will help | 07:16 |
lifeless | look at it like a graph | 07:16 |
lifeless | we have a thing | 07:16 |
lsmola | lifeless: cause the right way, when using UI, we should skip the CLI, and call pythonclients | 07:16 |
lifeless | call it 'cloud-setup' | 07:16 |
lifeless | its some code we need to call | 07:16 |
lifeless | but nice and ugly | 07:16 |
lifeless | -api uses it | 07:16 |
lifeless | and we setup the seed with it too | 07:17 |
*** jcooley_ has quit IRC | 07:18 | |
lsmola | hm | 07:18 |
lifeless | so it needs a python api (the most basic of which is subprocess.call()) and a CLI for the seed setup | 07:18 |
lifeless | but some folk may want a GUI to setup the seed | 07:18 |
lifeless | local html5 or something | 07:18 |
lifeless | I dunno - but that has to run privileged calls etc etc, so - lets not engineer it just yet | 07:18 |
lsmola | lifeless: just a little step back, what is the problem with seed having tuskar installed? | 07:19 |
*** e0ne has joined #tripleo | 07:21 | |
lsmola | lifeless: if we have API call cloud_setup, that will be used by CLi and just take params like passwords? | 07:21 |
lsmola | lifeless: so for seed we would use tuskar setup-cloud IP PARAMS=... | 07:22 |
lsmola | lifeless: the same we would use for overcloud | 07:22 |
lsmola | lifeless: and we would just use puthonclinet from UI, that would call the same | 07:23 |
lifeless | lsmola: what API does tuskar stuff depend on? | 07:23 |
lsmola | lifeless: https://github.com/tuskar/tuskar/blob/master/requirements.txt | 07:24 |
lsmola | lifeless: should not be different from any other service | 07:24 |
lifeless | I meant HTTP API | 07:24 |
lifeless | tuskarAPI uses heat right | 07:24 |
lifeless | what heat would you use to deploy the seed | 07:24 |
lsmola | lifeless: yeah it call heat now | 07:24 |
lsmola | lifeless: and it would use also keystone | 07:25 |
lsmola | lifeless: that should be it | 07:25 |
lsmola | lifeless: so we would just have to setup it correctly | 07:25 |
lifeless | but there is no heat until we *have configured the seed* | 07:26 |
lsmola | lifeless: though, I am not sure how far we should go with this, should all of this init be part of the template in J? | 07:26 |
*** e0ne has quit IRC | 07:26 | |
lifeless | the template can't orchestrate things in the cloud above | 07:26 |
lifeless | maybe in future we'll teach it how to do that, but as it stands, it can't | 07:26 |
lsmola | lifeless: hm, the heat should not be a problem, unless you call the heat related action | 07:26 |
lifeless | lsmola: and there's no nova | 07:26 |
lsmola | lifeless: this action in tuskar API would just create some stuff in keystone DB | 07:27 |
lsmola | lifeless: so for this call, it wouldn't need the other stuff | 07:27 |
lifeless | lsmola: it seems very odd | 07:28 |
lsmola | lifeless: if you would call overcloud_create, it would fail with no heat service available | 07:28 |
lifeless | lsmola: that you'd have an API server which you can't use except for some-end stuff | 07:28 |
tzumainn | lsmola, just to check - are you talking about having seed creation depend upon tuskar api? | 07:28 |
lsmola | lifeless: or | 07:28 |
lsmola | lifeless: the third option is | 07:29 |
lsmola | lifeless: we will call the keystone api call directly from UI | 07:29 |
lsmola | lifeless: which is not bad | 07:29 |
lifeless | lsmola: then we have two copies of the setup code | 07:29 |
lsmola | lifeless: the problem here is that it should not take very long | 07:29 |
lsmola | lifeless: well, the CLI way of install and Horizon way are always different i think | 07:30 |
lsmola | lifeless: because Horizon doesn't call CLI | 07:30 |
lsmola | lifeless: that should be alright i suppose | 07:30 |
lifeless | so, what do you dislike about my suggestion? | 07:30 |
*** vkozhukalov has quit IRC | 07:31 | |
lsmola | lifeless: to pack it in a general lib that will be used by everything? | 07:31 |
lifeless | 'lib' | 07:31 |
lifeless | yes, in a common place | 07:31 |
lsmola | tzumainn: yea something like that | 07:31 |
tzumainn | lsmola, I think that expands the scope of tuskar in a dangerous way | 07:31 |
lsmola | lifeless: hm ok | 07:32 |
lsmola | lifeless: and inside of this lib, we would call the pythonclients? | 07:32 |
lsmola | lifeless: and we would expose API and CLI for it? | 07:33 |
lifeless | its an abstraction, we can do whatever we want | 07:33 |
lifeless | it would have a Python API for TuskarAPI and a CLI for seed setup | 07:33 |
lsmola | lifeless: and this would mean to start another service for it? | 07:34 |
lsmola | lifeless: like TripleoCloudSetup ? | 07:34 |
lifeless | no, no service | 07:34 |
SpamapS | lifeless: I have another reason to have Barbican as raised by a nova person... we need to do cert setups for live migration as well | 07:34 |
lifeless | SpamapS: the reference docs dont do that ;) | 07:35 |
lifeless | SpamapS: but yes | 07:35 |
lsmola | lifeless: so where would it live, just as some egg? | 07:36 |
lifeless | lsmola: yes | 07:36 |
lsmola | lifeless: and we would just sent it AdminCredentials, so it can talk to anything? | 07:37 |
lifeless | I don't know all that we'd pass it. Quite a bit I imagine. | 07:37 |
lsmola | lifeless: hm, I can't think about anything better right now | 07:38 |
lsmola | lifeless: this will keep the coed in one place | 07:39 |
lsmola | lifeless: we will need another repo, under tripleo project | 07:39 |
lifeless | yes, don't want tuskar-api depending on incubator :) | 07:40 |
lsmola | lifeless: yeah, this is probably the best we can do right now | 07:40 |
lifeless | this stuff has been fairly stable for a bit now | 07:40 |
lifeless | so I think its time | 07:40 |
lifeless | brainstorming for names... | 07:40 |
lsmola | lifeless: ok, now we need to find some volunteers to extract it | 07:41 |
lsmola | lifeless: tripleo-cloud-setup sounds nice | 07:41 |
lifeless | Purple! | 07:41 |
lifeless | (sure) | 07:42 |
lsmola | lifeless: though we can pack there the init and also the "create a demo horizon for me with some vms" | 07:42 |
lifeless | I still need one more +2 on this https://review.openstack.org/#/c/75287/ | 07:42 |
lifeless | and we can close the live migration card | 07:42 |
lifeless | lsmola: lets not conflate the demo stuff | 07:42 |
lsmola | lifeless: ok, just an idea :-) | 07:43 |
*** rdopieralski has joined #tripleo | 07:43 | |
lsmola | lol Purple | 07:43 |
lifeless | lsmola: so - can has review please ^ :)- its not related to the failures (affects overcloud only and the seed failed) | 07:44 |
lsmola | lifeless: so do you have anybody up there who can extract it like in 2 weeks? :-D so we can use it in Icehouse.. | 07:44 |
lsmola | lifeless: on it | 07:45 |
*** jang1 has joined #tripleo | 07:45 | |
lsmola | lifeless: ok, the failures looks scary, but approving | 07:46 |
openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Fix the hosts setting - nova uses novalocal. https://review.openstack.org/75287 | 07:46 |
SpamapS | regarding the initialize keystone stuff.. | 07:48 |
SpamapS | kind of feels like that should be built into keystone-manage | 07:48 |
SpamapS | but... finally... time to go to the airport | 07:48 |
*** jistr has joined #tripleo | 07:48 | |
*** jcooley_ has joined #tripleo | 07:49 | |
lifeless | SpamapS: yeah, we need to talk to uhm $name about that | 07:49 |
lsmola | SpamapS: yeah, that might be the long term placement | 07:49 |
lsmola | lifeless: lol | 07:49 |
lsmola | lifeless: do you see this landing in Icehouse timeframe? | 07:50 |
saurabhs | lifeless: I am trying to understand how is metadata, cloudinit and userdata is related. | 07:50 |
lifeless | lsmola: we can do the common lib pretty quickly | 07:50 |
saurabhs | When I am trying to add metadata to instance using heat template | 07:50 |
saurabhs | Â Â "Metadata" : { | 07:50 |
saurabhs | Â Â Â Â "admin-password": "Test123", | 07:50 |
saurabhs | Â Â Â Â "AWS::CloudFormation::Init" : { | 07:50 |
saurabhs | Â Â Â Â Â "config" : { | 07:50 |
saurabhs | Â Â Â Â Â Â "packages" : { | 07:50 |
saurabhs | Â Â Â Â Â Â Â "yum" : { | 07:50 |
saurabhs | Â Â Â Â Â Â Â Â "mysql" Â Â Â Â : [], | 07:50 |
saurabhs | Â Â Â Â Â Â Â Â "mysql-server" : [], | 07:50 |
saurabhs | Â Â Â Â Â Â Â Â "httpd" Â Â Â Â : [], | 07:50 |
saurabhs | Â Â Â Â Â Â Â Â "wordpress" Â Â : [] | 07:50 |
saurabhs | Â Â Â Â Â Â Â } | 07:50 |
saurabhs | Â Â Â Â Â Â } | 07:50 |
saurabhs | Â Â Â Â } | 07:50 |
lifeless | lsmola: it may be heinous, but still | 07:50 |
lsmola | lifeless: :-) ok I've never done it so I don't know | 07:50 |
lsmola | lifeless: though I 've created plenty of gems, that was almost easy :-) | 07:51 |
lsmola | lifeless: will you have time to take this one? | 07:51 |
lifeless | lsmola: sure | 07:53 |
lsmola | lifeless: excellent, thank you | 07:53 |
lsmola | lifeless: then it will probably take some more time to rewrite it into API, cli... | 07:54 |
*** jcooley_ has quit IRC | 07:54 | |
lsmola | lifeless: but for now we are good with something that we can import to python and call, shellscript or whatever :-) | 07:54 |
lsmola | lifeless: without rewriting it to other place | 07:55 |
lifeless | saurabhs: go on | 07:55 |
saurabhs | lifeless: When I am trying to add metadata to instance using heat template | 07:56 |
saurabhs | https://gist.github.com/saurabhsurana/9130382 | 07:56 |
lifeless | lsmola: I've added a card for it | 07:56 |
saurabhs | it is showing up in | 07:56 |
saurabhs | curl http://169.254.169.254/openstack/latest/user_data | 07:56 |
saurabhs | and not in | 07:56 |
saurabhs | cult curl http://169.254.169.254/openstack/latest/user_datameta_data.json | 07:56 |
lsmola | lifeless: excellent, thank you | 07:56 |
lifeless | saurabhs: ok, so thats the ec2 metadata server, which (today) only has things nova knows about | 07:57 |
lifeless | saurabhs: there is a separate CFN metadata url we use which is random and delivered to us by the user-data from nova | 07:57 |
lifeless | saurabhs: but also note that for golden imagse we don't choose software packages in heat templates- we do that in the image build | 07:58 |
lifeless | saurabhs: we only deliver configuration | 07:58 |
saurabhs | when I query : curl http://169.254.169.254/openstack/latest/user_data | 08:00 |
openstackgerrit | andrea-frittoli proposed a change to openstack/tripleo-image-elements: Fixes links in README.md https://review.openstack.org/75332 | 08:00 |
saurabhs | it gives me https://gist.github.com/saurabhsurana/9130429 | 08:00 |
saurabhs | what is all that data the actual user_data script in the template was very small | 08:01 |
*** e0ne has joined #tripleo | 08:01 | |
lifeless | thats heats bootstrap code | 08:01 |
lifeless | you should basically ignore all of this :) | 08:01 |
saurabhs | lifeless: how to get hold of CFN metadata url | 08:02 |
lifeless | that bootstrap code writes it to disk | 08:03 |
lifeless | uhm | 08:03 |
lifeless | /var/lib/cloud/ I think | 08:03 |
*** CaptTofu has joined #tripleo | 08:04 | |
*** e0ne has quit IRC | 08:05 | |
saurabhs | its giving me : http://10.7.53.115:8000/ how do I get the metadata from here now | 08:06 |
lifeless | use os-collect-config or cfn-hup | 08:07 |
saurabhs | lifeless: are you saying that os-collect-config internally uses this url to get the data ? | 08:07 |
lifeless | yse | 08:08 |
lifeless | I haven't looked at the plumbing layer for ages | 08:08 |
*** CaptTofu has quit IRC | 08:09 | |
lifeless | I think its great you're interested, but you'll need to deep dive through the code - these days its just an abstraction we depend on | 08:09 |
lifeless | not something we interact with directly | 08:09 |
saurabhs | lifeless: going back to the os-config-refresh and os-config-apply. | 08:11 |
saurabhs | if I have to use these for building trove images, do I have to write these elements seperately for trove image elements or I will have to extend these elements there. | 08:11 |
saurabhs | trove will have different configuration keys and multiple configuration files, how do we plug the metadata into those files correctly | 08:11 |
lifeless | saurabhs: os-refresh-config and os-apply-config are both generic, you never change them. You use them. | 08:12 |
lifeless | saurabhs: have you looked into them yet? | 08:13 |
*** cd-undercloud has joined #tripleo | 08:15 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 08:15 |
*** cd-undercloud has quit IRC | 08:15 | |
rpodolyaka | morning tripleo | 08:15 |
saurabhs | lifeless: I was going though os-apply-config earlier. I think the use of this is to read the parameters from metadata and write that into the configs right? | 08:16 |
saurabhs | did I interpret that incorrectly? | 08:17 |
*** bauzas has joined #tripleo | 08:18 | |
lifeless | it does two things | 08:18 |
lifeless | a) it gives you a language (moustache) to capture metadata into config files | 08:18 |
lifeless | so you got that | 08:18 |
lifeless | and b) it gives a command line query language for selecting specific values out of the metadata | 08:19 |
saurabhs | so now what to read and where to write, how do we control that? | 08:19 |
*** shardy_afk is now known as shardy | 08:20 | |
saurabhs | ok I guess I should aks how to I use os-apply-config to control what to read and where to write? can you point me to a sample? | 08:20 |
jprovazn | lifeless, ping | 08:22 |
lifeless | saurabhs: https://git.openstack.org/cgit/openstack/tripleo-image-elements/tree/elements/nova/os-apply-config/etc/nova/nova.conf | 08:23 |
lifeless | jprovazn: pong | 08:23 |
lifeless | saurabhs: in general, you could do worse than looking around in that git repo and the tripleo-heat-templates repo | 08:24 |
jprovazn | lifeless, Hi, myaybe you might help me with one issue - when defining a list of nodes for rabbit mq cluster, I also define "master" node - to distinguish first node in cluster which doesn't try to connect to others and which other nodes will try to connect to. Disadvantage of this is that it's "extra" setting for one specific node in heat template | 08:26 |
jprovazn | lifeless, which makes scaling conf worse | 08:26 |
lifeless | jprovazn: is that a rabbit requirement ? | 08:26 |
jprovazn | rabbit requirement is to start first node in a different way than others | 08:27 |
jprovazn | lifeless, ^ | 08:27 |
lifeless | jprovazn: what happens when that node crashes, or if we have to reboot it? | 08:27 |
lifeless | or is this a one-time setup thing? | 08:28 |
jprovazn | lifeless, one-time | 08:28 |
lifeless | so after that, when we restart it, it has the same config file as the others | 08:29 |
lifeless | ? | 08:29 |
jprovazn | lifeless, when we restart the "master" node? yes - then it remembers that it was joined in a cluster before | 08:30 |
lifeless | ok, so what greghaynes is proposing for galera is to use the $0 node to do that init. | 08:30 |
lifeless | jprovazn: how is this extra setting expressed to rabbit ? | 08:31 |
lifeless | like, is it command line, or a config file option, or a client command you run ? | 08:31 |
*** saju_m has quit IRC | 08:31 | |
jprovazn | lifeless, well, both is possible but I use command line | 08:32 |
lifeless | ok, so whats the extra setting ? | 08:33 |
lifeless | in the heat template? | 08:33 |
jprovazn | lifeless, https://review.openstack.org/#/c/68392/5/elements/rabbitmq-server/README.md | 08:33 |
jprovazn | lifeless, the "master" node | 08:33 |
greghaynes | In the xtradb cluster its a config file setting - you start the first node without specifying rest of the cluster and then once others join you change config file to match rest of cluster incase of restart | 08:34 |
jprovazn | greghaynes, you can use an extra param (mysqld pxc) to start the first node - to avoid editing config file twice | 08:35 |
lifeless | jprovazn: so, is the question 'how does a node know it is/is not the initial master' ? | 08:35 |
lifeless | jprovazn: could you just see if its hostname ends in [^\d]0 ? | 08:35 |
jprovazn | lifeless, no, question is: is there a better way how to recognize that some node is "first" to avoid defining the master node | 08:35 |
greghaynes | I do like the idea of being explicit about which is master rather than implicit, the 0th node being a more implicit system | 08:36 |
lifeless | I'd like to actually run paxos to select a node | 08:36 |
lifeless | but maybe I'm a little nuts | 08:36 |
greghaynes | You might be the only one of us that actually read a paxos whitepaper :) | 08:36 |
greghaynes | although maybe thats not a bad idea | 08:37 |
*** al has quit IRC | 08:37 | |
lifeless | it would mean that we don't try to start the cluster we have a quorum at least transiently available | 08:37 |
lifeless | which I think is actually a nice property | 08:37 |
saurabhs | lifeless: I understood os-apply-config. also as per my understanding os-collect-config only triggeres os-refresh is that right? or it does something more than that? | 08:37 |
*** al has joined #tripleo | 08:37 | |
jprovazn | lifeless, greghaynes: well, I could check for "[^\d]0" if it would be preferred way | 08:37 |
lifeless | jprovazn: do you have a sane answer in the templates today ? | 08:38 |
greghaynes | oh, I was arguing against that, it was just an idea I had for now | 08:38 |
lifeless | saurabhs: it queries all the metadata sources (ec2, cfn, local file, possibly chef and or puppet) and provides all of their metadata for the node in a cache to o-r-c | 08:38 |
lifeless | lol https://twitter.com/MesosUrDrunk | 08:39 |
greghaynes | wow | 08:40 |
saurabhs | and then os-refresh-config provides that a way of running predefined scripts. is that right? | 08:40 |
lifeless | saurabhs: yes | 08:40 |
jprovazn | lifeless, I don't know about any existing param in our templates which could help, for this reason I explicitly add ""master" node, I was just wondering if there is a better way | 08:40 |
lifeless | jprovazn: ok so heres a thought | 08:41 |
lifeless | lets make an abstract interface | 08:41 |
lifeless | a 5 line shell script for now | 08:41 |
*** jcooley_ has joined #tripleo | 08:41 | |
lifeless | os-am-i-master <servicename> | 08:41 |
lifeless | it should look at the hostname for now | 08:41 |
greghaynes | +1 | 08:41 |
lifeless | do the 'ends in 0 but not [0-9]0 :) | 08:42 |
*** pblaho has joined #tripleo | 08:42 | |
lifeless | we can loop back and make it fancy without having to rejigger a bunch of elements | 08:42 |
jprovazn | lifeless, ok | 08:42 |
lifeless | because having a special node in scaling groups will be uhm, hard. | 08:42 |
lifeless | and I don't think we should add a dependency on unique attributes for that reason | 08:43 |
jprovazn | yes | 08:43 |
saurabhs | lifeless: so os-collect-config triggers os-refresh-config but then who triggeres os-apply-config? I mean if there is an change in metadata, and it refers to one of the keys in the configs the config will be update by os-apply-config right? if so somebody has to trigger it | 08:43 |
*** panda has joined #tripleo | 08:43 | |
lifeless | but I don't like the hostname trick, so I want to know precisely where it lives so we can take it out back and sacrifice it when the time is right | 08:43 |
lifeless | saurabhs: look at elements/os-apply-config/os-refresh-config/configure.d/50-os-config-applier in the tripleo-image-elements tree | 08:44 |
*** jang1 has quit IRC | 08:46 | |
saurabhs | lifeless: thanks. I will trouble you again tomorrow with further set of questions | 08:47 |
lifeless | saurabhs: tomorrow I'll be spending time with family - saturday :) | 08:47 |
lifeless | saurabhs: but there are plenty of folk here that live in the past | 08:48 |
lifeless | saurabhs: so just ask here, I'm reasonably sure someone will chime in | 08:48 |
*** e0ne has joined #tripleo | 08:48 | |
saurabhs | sure thanks | 08:48 |
*** saurabhs has quit IRC | 08:48 | |
*** saurabhs has joined #tripleo | 08:49 | |
*** jcooley_ has quit IRC | 08:51 | |
*** saurabhs has left #tripleo | 08:52 | |
lifeless | thinking out loud about the init problem | 08:52 |
lifeless | what we really want is some sort of distributed while true: try:init and break; except:pass | 08:52 |
lifeless | e.g. paxos to pick someone to do init; wait while they do it and if they go away go back to paxos to find a new leader, keep doing that until | 08:53 |
lifeless | the init reports completed, then get additional nodes replicated, and if that process fails due to the master going away, go back to paxos again, and loop... | 08:54 |
lifeless | wipe all trace of dbs whenever someone gets elected | 08:54 |
*** jtomasek has joined #tripleo | 08:56 | |
*** pblaho has quit IRC | 08:56 | |
*** akrivoka has joined #tripleo | 08:57 | |
lifeless | oh cool | 08:59 |
lifeless | http://openreplica.org/faq/ | 08:59 |
*** saju_m has joined #tripleo | 09:01 | |
*** saju_m has quit IRC | 09:02 | |
lifeless | SpamapS: ^ when you get off your plane; new shiny | 09:05 |
lifeless | License: 3-Clause BSD | 09:05 |
*** vkozhukalov has joined #tripleo | 09:07 | |
rdopieralski | I didn't know someone still uses 3-clause one | 09:07 |
lifeless | rdopieralski: thats the stock BSD :) | 09:08 |
*** derekh has joined #tripleo | 09:10 | |
lifeless | derekh: hai | 09:17 |
derekh | lifeless: hi | 09:18 |
lifeless | derekh: we're back with CI | 09:19 |
lifeless | derekh: overcloud jobs have the timeout increased but failingm not sure why | 09:19 |
derekh | \o/ | 09:19 |
lifeless | derekh: I merged your log change but suggested an alternate implementation in the review | 09:19 |
derekh | lifeless: looking at it at the moment, it looks like its a problem getting the log info | 09:19 |
lifeless | derekh: I'm thinking the next stage is to run tempest against the overcloud job | 09:19 |
lifeless | derekh: from the jenkins slave | 09:20 |
*** saju_m has joined #tripleo | 09:20 | |
derekh | lifeless: ok, we could add that tempest element I created to the overcloud and run it | 09:21 |
derekh | lifeless: Although it hasn't been used in a long time so may need some updates | 09:22 |
derekh | lifeless: I see a fedora template | 09:23 |
derekh | lifeless: is that just left over after some tests? | 09:23 |
derekh | must be : | OS-SRV-USG:launched_at | 2014-02-14T19:44:09.000000 | | 09:23 |
lifeless | derekh: no element needed | 09:23 |
lifeless | derekh: run it like d-g does from the slave | 09:23 |
derekh | lifeless: k | 09:24 |
*** martyntaylor has joined #tripleo | 09:24 | |
openstackgerrit | A change was merged to openstack/tuskar: Fix default path in tools/with_venv.sh https://review.openstack.org/75030 | 09:25 |
lifeless | derekh: we should be able to reuse a bunch of d-g code | 09:26 |
lifeless | that way | 09:26 |
derekh | lifeless: ok | 09:26 |
openstackgerrit | A change was merged to openstack/tuskar: Removed unnecessary nova client https://review.openstack.org/75122 | 09:27 |
jistr | lsmola: a nit - please give also +2 when giving Approved. Patches should have at least two +2 reviews before going approved. E.g. this patch has only one +2 review then in "Notes": https://git.openstack.org/cgit/openstack/tuskar/commit/?id=f8e87cb6cc735e9742c798ae66dd2dc984536845 | 09:28 |
*** pbelanyi has joined #tripleo | 09:30 | |
lsmola | jistr: yeah I do that randomly | 09:30 |
lsmola | jistr: cause giving just approved is safer, in case I have misread it and there is no +2 | 09:30 |
*** cd-undercloud has joined #tripleo | 09:30 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 09:30 |
*** cd-undercloud has quit IRC | 09:30 | |
lsmola | jistr: if I give both, I can approve it all by myself | 09:31 |
lsmola | jistr: :-) | 09:31 |
lsmola | jistr: I did that by mistake once | 09:31 |
jistr | lsmola: i think best is not to misread and make sure there are two +2 as the OpenStack rules say :)D | 09:31 |
lsmola | jistr: yeah, prerequisite for the is having a good sleep :-D | 09:32 |
jistr | yeah :D | 09:32 |
*** lucasagomes has joined #tripleo | 09:33 | |
*** dtantsur has joined #tripleo | 09:33 | |
openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Write host_info.txt with "sudo dd" https://review.openstack.org/75353 | 09:38 |
derekh | lifeless: lets see if that sorts out the log issue .... in 2 hours :-( | 09:39 |
*** max_lobur_afk is now known as max_lobur | 09:43 | |
*** dtantsur has quit IRC | 09:46 | |
*** jcooley_ has joined #tripleo | 09:47 | |
lifeless | derekh: heh | 09:48 |
*** dtantsur has joined #tripleo | 09:48 | |
derekh | lifeless: adding idempotentcy to test env scripts, | 09:48 |
lifeless | derekh: I've read your etherpad on test optimisation, have some thoughts but haven't serialised them yet | 09:48 |
lifeless | derekh: awesome! | 09:48 |
lifeless | derekh: while you're there, you might like to start calling devtest_testenv.sh to make the environment | 09:49 |
lifeless | derekh: its intended for reuse | 09:49 |
lifeless | I need to halt() - gnight! | 09:49 |
derekh | lifeless: will do, night | 09:50 |
*** jcooley_ has quit IRC | 09:52 | |
*** akrivoka has quit IRC | 09:56 | |
*** CaptTofu has joined #tripleo | 10:05 | |
*** CaptTofu has quit IRC | 10:09 | |
*** derekh has quit IRC | 10:27 | |
*** derekh has joined #tripleo | 10:31 | |
*** jp_at_hp has joined #tripleo | 10:34 | |
openstackgerrit | Jon-Paul Sullivan proposed a change to openstack/diskimage-builder: Set noclobber around element consolidation https://review.openstack.org/75097 | 10:35 |
*** jcooley_ has joined #tripleo | 10:41 | |
*** akrivoka has joined #tripleo | 10:44 | |
*** athomas has joined #tripleo | 10:45 | |
*** coolsvap has quit IRC | 10:45 | |
*** jcooley_ has quit IRC | 10:46 | |
openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Actually get node profiles from the API https://review.openstack.org/74762 | 10:47 |
*** jcooley_ has joined #tripleo | 10:47 | |
* jistr relocates | 10:48 | |
*** jistr has quit IRC | 10:48 | |
*** jcooley_ has quit IRC | 10:52 | |
*** coolsvap has joined #tripleo | 10:52 | |
*** bauzas has quit IRC | 10:53 | |
*** athomas has quit IRC | 10:54 | |
*** cd-undercloud has joined #tripleo | 10:56 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 10:56 |
*** cd-undercloud has quit IRC | 10:56 | |
*** CaptTofu has joined #tripleo | 10:57 | |
*** nosnos has quit IRC | 10:58 | |
*** geerdest has joined #tripleo | 11:01 | |
*** matsuhashi has quit IRC | 11:02 | |
*** athomas has joined #tripleo | 11:03 | |
*** jistr has joined #tripleo | 11:05 | |
*** vkozhukalov has quit IRC | 11:08 | |
*** bauzas has joined #tripleo | 11:19 | |
*** vkozhukalov has joined #tripleo | 11:20 | |
*** coolsvap has quit IRC | 11:28 | |
jp_at_hp | SpamapS: Can you re-review https://review.openstack.org/#/c/75097/ please? | 11:31 |
*** jcooley_ has joined #tripleo | 11:48 | |
openstackgerrit | Jon-Paul Sullivan proposed a change to openstack/diskimage-builder: Enable custom apt.conf in apt-conf element https://review.openstack.org/74992 | 11:50 |
*** jcooley_ has quit IRC | 11:53 | |
*** jcoufal has joined #tripleo | 11:54 | |
*** cd-undercloud has joined #tripleo | 12:00 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 12:00 |
*** cd-undercloud has quit IRC | 12:00 | |
*** dshurtle has joined #tripleo | 12:32 | |
*** vkozhukalov has quit IRC | 12:39 | |
*** cd-undercloud has joined #tripleo | 12:48 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 12:48 |
*** cd-undercloud has quit IRC | 12:48 | |
*** e0ne_ has joined #tripleo | 12:49 | |
*** cd-undercloud has joined #tripleo | 12:49 | |
cd-undercloud | ************** overcloud complete status=6 ************ | 12:49 |
*** cd-undercloud has quit IRC | 12:49 | |
*** weshay has joined #tripleo | 12:51 | |
*** slagle has joined #tripleo | 12:51 | |
*** e0ne has quit IRC | 12:53 | |
*** vkozhukalov has joined #tripleo | 12:55 | |
*** cd-undercloud has joined #tripleo | 13:03 | |
cd-undercloud | ************** overcloud complete status=128 ************ | 13:03 |
*** cd-undercloud has quit IRC | 13:03 | |
*** bauzas has quit IRC | 13:03 | |
openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Gracefully handle commands that outlive test env https://review.openstack.org/75402 | 13:03 |
openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Increase the testenv-worker timeout https://review.openstack.org/75403 | 13:03 |
openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Don't truncate the logged json https://review.openstack.org/75404 | 13:03 |
derekh | Anybody looking at ci jobs for testenv overcloud will see it complete but jenkins thinks it failed https://review.openstack.org/75402 should fix it | 13:04 |
*** mrunge has quit IRC | 13:06 | |
slagle | derekh: small nit there in the comment for 75402 | 13:10 |
*** cd-undercloud has joined #tripleo | 13:10 | |
cd-undercloud | ************** overcloud complete status=128 ************ | 13:10 |
*** cd-undercloud has quit IRC | 13:10 | |
*** julim has joined #tripleo | 13:13 | |
*** julim has quit IRC | 13:14 | |
openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Actually get node profiles from the API https://review.openstack.org/74762 | 13:14 |
openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Update the deployment design page https://review.openstack.org/73238 | 13:14 |
*** CaptTofu has quit IRC | 13:19 | |
openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Actually get node profiles from the API https://review.openstack.org/74762 | 13:23 |
*** jdob has joined #tripleo | 13:24 | |
*** bauzas has joined #tripleo | 13:25 | |
Ng | morning | 13:40 |
*** max_lobur is now known as max_lobur_afk | 13:41 | |
openstackgerrit | James Slagle proposed a change to openstack-infra/tripleo-ci: Gracefully handle commands that outlive test env https://review.openstack.org/75402 | 13:42 |
slagle | derekh: do you know how we trigger a new check job for things like: https://review.openstack.org/#/c/71606/ ? | 13:43 |
*** cd-undercloud has joined #tripleo | 13:44 | |
cd-undercloud | ************** overcloud complete status=100 ************ | 13:44 |
*** cd-undercloud has quit IRC | 13:44 | |
*** jcooley_ has joined #tripleo | 13:47 | |
derekh | slagle: try "recheck no bug", although I'm not 100% sure with the new queues that we added last night | 13:47 |
derekh | slagle: thanks for the fixup | 13:47 |
derekh | slagle: actually | 13:48 |
derekh | slagle: maybe unapprove and approve again, I'll do it since you were author | 13:49 |
openstackgerrit | A change was merged to openstack/tripleo-image-elements: Fix neutron package install https://review.openstack.org/71606 | 13:49 |
slagle | oh, there it goes :) | 13:49 |
slagle | ah, you +A'd again. thx | 13:50 |
derekh | slagle: yup, np | 13:50 |
*** lblanchard has joined #tripleo | 13:52 | |
*** jcooley_ has quit IRC | 13:52 | |
SpamapS | and one more airport | 13:53 |
* SpamapS is at LHR | 13:53 | |
openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Don't truncate the logged json https://review.openstack.org/75404 | 13:54 |
openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Increase the testenv-worker timeout https://review.openstack.org/75403 | 13:54 |
*** dprince has joined #tripleo | 13:55 | |
openstackgerrit | Ladislav Smola proposed a change to openstack/tuskar-ui: Showing configuration tab of deployed overcloud https://review.openstack.org/74750 | 13:58 |
*** saju_m has quit IRC | 14:10 | |
dprince | derekh: re: Increase the testenv-worker timeout (review 75403). Does that mean the tests take 3 hours? | 14:10 |
derekh | dprince: the overcloud test takes just over 2 hours, so the jenkins timeout is 2hrs 25 minutes https://review.openstack.org/#/c/73986/1/modules/openstack_project/files/jenkins_job_builder/config/tripleo.yaml | 14:12 |
*** julim has joined #tripleo | 14:12 | |
derekh | dprince: the timeout on the testenv-work MUST be longer then the jenkins timout if its not we get false negative results and risk | 14:12 |
derekh | dprince: having 2 jobs using the same test env at the same time | 14:13 |
derekh | dprince: this handles the false negatives https://review.openstack.org/#/c/75402/ or at least we'll know once its finished running | 14:13 |
dprince | derekh: yep. that is a super long test cycle... but we'll take what we can get I guess. | 14:14 |
derekh | dprince: and thios ensures we don't doubley allocate the test env https://review.openstack.org/#/c/75403/ | 14:14 |
dprince | derekh: be interesting to see if things run faster on our rack once it is up and running. | 14:14 |
derekh | dprince: but a new test env will need to be built for the TE worker change to take effect | 14:14 |
derekh | dprince: yes it is super long and will be interesting | 14:15 |
derekh | dprince: (and anybody else who has been following), we have plans in place to speed this up a bit, https://etherpad.openstack.org/p/tripleo-parallel-test | 14:15 |
derekh | dprince: we have to decide on the best option, I've jotted down my ideas there so we can assess the options properly | 14:17 |
dprince | derekh: So each image gets 4MB of RAM right now? Could we tinker with increasing that... and decreasing the number of workers per server? | 14:25 |
openstackgerrit | Ladislav Smola proposed a change to openstack/tuskar-ui: Showing configuration tab of deployed overcloud https://review.openstack.org/74750 | 14:27 |
derekh | dprince: I think most of the time is spent building the images on the jenkins node so I don't think tinkering with the test env will help much | 14:27 |
dprince | derekh: okay | 14:28 |
* dprince looks some more | 14:28 | |
derekh | dprince: looks like the test for that testenv-clinet change failed https://jenkins04.openstack.org/job/check-tripleo-overcloud-precise/5/ | 14:28 |
derekh | looks unrelated | 14:28 |
*** noslzzp has joined #tripleo | 14:29 | |
derekh | dprince: actually it restarted it on another jenkins https://jenkins06.openstack.org/job/check-tripleo-overcloud-precise/5/ | 14:30 |
dprince | derekh: magical | 14:30 |
openstackgerrit | A change was merged to openstack/diskimage-builder: Add 00-fedora-fixup-vim https://review.openstack.org/74711 | 14:31 |
dprince | derekh: I think our biggest bang might be to go for shared venvs then | 14:32 |
dprince | derekh: which is what devstack does | 14:32 |
*** akrivoka has quit IRC | 14:33 | |
dprince | derekh: seems like we are spending a bunch of time compiling the same old things in our DIB images... | 14:33 |
dprince | derekh: so if we shared venvs... or better yet pre-created a beefed up venv which would get used by all-the-apps then we'd save a good bit of time I think on the image building... | 14:34 |
openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Actually get node profiles from the API https://review.openstack.org/74762 | 14:34 |
openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Update the deployment design page https://review.openstack.org/73238 | 14:34 |
dprince | derekh: or we could just use real packages which solve this problem nicely as well :) | 14:34 |
*** dmitry_tantsur has joined #tripleo | 14:35 | |
derekh | dprince: yup, it would, I was about to suggest a little mad, we could find common lines in all the requirements files, build a venv with common entries and then copy that as a base for the others, so we still avoid conflicting requirments | 14:35 |
*** akrivoka has joined #tripleo | 14:36 | |
derekh | dprince: I might give that a go and see if it works | 14:36 |
derekh | dprince: yup, packages would do it too :-) | 14:36 |
*** jprovazn has quit IRC | 14:37 | |
*** dtantsur has quit IRC | 14:38 | |
dprince | derekh: I would say we can do whatever devstack does here and get by w/ it. If devstack uses a shared venv then we should be able to as well. | 14:38 |
derekh | dprince: so what happens when one project has a conflicting requirement with another ? | 14:39 |
dprince | derekh: there is a global requirements file now as well so that should help to slow down the adoption of random new versions of things for each project | 14:39 |
*** jtomasek has quit IRC | 14:39 | |
derekh | dprince: looks like it could still have problems at a glance in various projects we have | 14:41 |
derekh | python-keystoneclient>=0.4.1 | 14:41 |
derekh | python-keystoneclient>=0.4.2 | 14:41 |
derekh | python-keystoneclient>=0.5.0 | 14:41 |
derekh | python-neutronclient>=2.3.0,<3 | 14:41 |
derekh | python-neutronclient>=2.3.3,<3 | 14:41 |
derekh | WebOb>=1.2.3 | 14:41 |
derekh | WebOb>=1.2.3,<1.3 | 14:41 |
derekh | and lots or other example of differences | 14:41 |
dprince | derekh: with WebOb, perhaps. The others should be retaining backwards compat. | 14:41 |
dprince | derekh: plus it isn't like distros do that w/ packages. | 14:41 |
dprince | derekh: stable clients should be deprecating things so there is an upgrade path... | 14:42 |
dprince | derekh: so in general we'd use the newest version I think and it should work | 14:42 |
derekh | dprince: agreed they should be | 14:42 |
derekh | dprince: this handles the false negatives https://review.openstack.org/#/c/75402/ or at least we'll know once its finished running | 14:42 |
*** hewbrocc` is now known as hewbrocca | 14:43 | |
derekh | dprince: ^^ pasted from history ignore | 14:43 |
*** ramishra_ has joined #tripleo | 14:43 | |
*** ramishra has quit IRC | 14:43 | |
*** markmc has joined #tripleo | 14:43 | |
*** matty_du1s|gone is now known as matty_dubs | 14:48 | |
*** afrittoli has joined #tripleo | 14:48 | |
*** jcooley_ has joined #tripleo | 14:48 | |
*** max_lobur_afk is now known as max_lobur | 14:49 | |
*** jprovazn has joined #tripleo | 14:50 | |
*** CaptTofu has joined #tripleo | 14:50 | |
*** jcooley_ has quit IRC | 14:54 | |
*** jtomasek has joined #tripleo | 14:55 | |
*** jprovazn has quit IRC | 14:58 | |
*** slagle has quit IRC | 15:05 | |
openstackgerrit | andrea-frittoli proposed a change to openstack/tripleo-image-elements: Fixes links in README.md https://review.openstack.org/75332 | 15:06 |
*** jcooley_ has joined #tripleo | 15:09 | |
*** coolsvap has joined #tripleo | 15:10 | |
*** akuznetsov has quit IRC | 15:19 | |
*** akrivoka has quit IRC | 15:41 | |
*** spzala has joined #tripleo | 15:41 | |
*** lazy_prince has quit IRC | 15:44 | |
*** max_lobur is now known as max_lobur_afk | 15:45 | |
openstackgerrit | Michael Kerrin proposed a change to openstack/tripleo-image-elements: Make the pypi mirror configurable via a DIB_PYPI_INDEX_URL https://review.openstack.org/75085 | 15:45 |
openstackgerrit | Michael Kerrin proposed a change to openstack/tripleo-image-elements: Install latest version of pip and virtualenv https://review.openstack.org/75071 | 15:45 |
*** tserong has quit IRC | 15:56 | |
*** jcoufal has quit IRC | 15:57 | |
*** jcoufal has joined #tripleo | 15:57 | |
*** tserong has joined #tripleo | 15:59 | |
*** jcooley_ has quit IRC | 16:00 | |
*** jcooley_ has joined #tripleo | 16:01 | |
*** spzala has quit IRC | 16:02 | |
derekh | ci jobs failing now because nova isn't ready (not keystone as I originally thought), its almost as if the "nova-manage db sync" in os-refresh-config is taking longer then usual | 16:03 |
*** ramishra_ has quit IRC | 16:03 | |
*** bauzas has quit IRC | 16:05 | |
*** tserong has quit IRC | 16:05 | |
*** jcooley_ has quit IRC | 16:06 | |
*** coolsvap has quit IRC | 16:08 | |
openstackgerrit | Ralf Haferkamp proposed a change to openstack/tripleo-incubator: Use baremetal element to extract kernel and initrd for undercloud https://review.openstack.org/71912 | 16:08 |
*** coolsvap1 has joined #tripleo | 16:08 | |
*** coolsvap1 has quit IRC | 16:08 | |
*** slagle has joined #tripleo | 16:09 | |
*** jcooley_ has joined #tripleo | 16:10 | |
*** coolsvap1 has joined #tripleo | 16:14 | |
openstackgerrit | Ralf Haferkamp proposed a change to openstack/diskimage-builder: Update openSUSE package mapping for libffi-dev https://review.openstack.org/75444 | 16:14 |
*** CaptTofu has quit IRC | 16:16 | |
*** jcoufal has quit IRC | 16:16 | |
*** jtomasek has quit IRC | 16:17 | |
*** Lotus907efi_ has quit IRC | 16:19 | |
*** dmitry_tantsur has quit IRC | 16:26 | |
*** CaptTofu has joined #tripleo | 16:30 | |
*** tserong has joined #tripleo | 16:34 | |
*** tserong has joined #tripleo | 16:34 | |
*** rdopieralski has quit IRC | 16:34 | |
*** jistr has quit IRC | 16:37 | |
*** rha has quit IRC | 16:43 | |
*** jcooley_ has quit IRC | 16:44 | |
*** jcooley_ has joined #tripleo | 16:44 | |
*** al has quit IRC | 16:45 | |
*** al has joined #tripleo | 16:45 | |
*** max_lobur_afk is now known as max_lobur | 16:54 | |
*** jcooley_ has quit IRC | 16:57 | |
*** jcooley_ has joined #tripleo | 16:58 | |
*** matty_dubs is now known as matty_dubs|lunch | 16:58 | |
*** ccrouch has quit IRC | 16:59 | |
*** saurabhs has joined #tripleo | 17:01 | |
*** jcooley_ has quit IRC | 17:02 | |
*** derekh has quit IRC | 17:04 | |
*** akuznetsov has joined #tripleo | 17:04 | |
*** jp_at_hp has quit IRC | 17:07 | |
*** cwolferh has joined #tripleo | 17:14 | |
*** epim has joined #tripleo | 17:16 | |
*** jcooley_ has joined #tripleo | 17:17 | |
*** epim_ has joined #tripleo | 17:19 | |
*** e0ne_ has quit IRC | 17:19 | |
*** ccrouch has joined #tripleo | 17:19 | |
*** e0ne has joined #tripleo | 17:19 | |
*** lsmola has quit IRC | 17:20 | |
*** epim has quit IRC | 17:20 | |
*** epim_ is now known as epim | 17:20 | |
*** jcooley_ has quit IRC | 17:21 | |
*** newell has joined #tripleo | 17:21 | |
*** spzala has joined #tripleo | 17:22 | |
*** jcooley_ has joined #tripleo | 17:22 | |
*** e0ne has quit IRC | 17:24 | |
*** jcooley_ has quit IRC | 17:24 | |
*** markmc has quit IRC | 17:25 | |
*** geerdest has quit IRC | 17:29 | |
*** jog0 is now known as flashgordon | 17:30 | |
*** jcooley_ has joined #tripleo | 17:31 | |
*** rha has joined #tripleo | 17:32 | |
*** jcooley_ has quit IRC | 17:32 | |
*** akuznetsov has quit IRC | 17:34 | |
*** cadenzajon has joined #tripleo | 17:39 | |
*** vkozhukalov has quit IRC | 17:40 | |
*** epim has quit IRC | 17:48 | |
*** akuznetsov has joined #tripleo | 17:49 | |
*** matty_dubs|lunch is now known as matty_dubs | 17:51 | |
*** max_lobur is now known as max_lobur_afk | 17:55 | |
*** wendar has quit IRC | 17:57 | |
*** pbelanyi has quit IRC | 17:59 | |
openstackgerrit | Tzu-Mainn Chen proposed a change to openstack/tuskar: Remove object storage from initial data https://review.openstack.org/75474 | 17:59 |
*** kfox1111 has joined #tripleo | 18:02 | |
openstackgerrit | Ben Nemec proposed a change to openstack/diskimage-builder: Add RHEL 7 image element https://review.openstack.org/74146 | 18:03 |
openstackgerrit | Ben Nemec proposed a change to openstack/diskimage-builder: Generalize install-packages for yum https://review.openstack.org/74865 | 18:03 |
openstackgerrit | Ben Nemec proposed a change to openstack/diskimage-builder: Add redhat-common element https://review.openstack.org/74866 | 18:03 |
openstackgerrit | Ben Nemec proposed a change to openstack/diskimage-builder: Use redhat-common in fedora element https://review.openstack.org/74867 | 18:03 |
kfox1111 | I'm following: http://docs.openstack.org/developer/tripleo-incubator/deploying.html just built a seed vm. launched it. need to get in to configure it. don't know the pw. do I need to root it or is there a default? | 18:04 |
kfox1111 | the shadow file has no pw entires. guess I did have to root it. | 18:11 |
*** marun has joined #tripleo | 18:12 | |
*** akuznetsov has quit IRC | 18:14 | |
*** akuznetsov has joined #tripleo | 18:17 | |
*** cadenzajon has quit IRC | 18:21 | |
NobodyCam | StevenK: happen to be around? | 18:22 |
*** lucasagomes has quit IRC | 18:24 | |
NobodyCam | kfox1111: did you include the stack user element | 18:24 |
*** UtahDave has joined #tripleo | 18:24 | |
kfox1111 | no. the doc didn't say to. | 18:25 |
kfox1111 | that element lets you configure the user? | 18:25 |
NobodyCam | that element add a user "stack" with same pass | 18:26 |
kfox1111 | ah. | 18:26 |
kfox1111 | do you have the ability to amend the doc? | 18:27 |
NobodyCam | kfox1111: yes and so do you... would need a review put up for https://github.com/openstack/tripleo-incubator/blob/master/doc/source/deploying.rst | 18:28 |
*** cadenzajon has joined #tripleo | 18:28 | |
NobodyCam | thou I use: this Doc: http://docs.openstack.org/developer/tripleo-incubator/devtest.html | 18:28 |
NobodyCam | which now seem to have broken links | 18:29 |
NobodyCam | :-p | 18:29 |
kfox1111 | how do I do the review? | 18:29 |
NobodyCam | have you used git? | 18:30 |
*** cody-somerville has joined #tripleo | 18:30 | |
*** cody-somerville has joined #tripleo | 18:30 | |
kfox1111 | I was afraid you were going to say that. :/ My company has been fighting through the CLA issues since September. :/ | 18:31 |
NobodyCam | ahh | 18:31 |
kfox1111 | still an indeterminate amount of time left before I can contribute. :/ | 18:31 |
NobodyCam | it is requied | 18:31 |
NobodyCam | https://wiki.openstack.org/wiki/Gerrit_Workflow | 18:31 |
kfox1111 | yeah. | 18:31 |
NobodyCam | but that is the work flow | 18:31 |
kfox1111 | yeah. I'm going to avoid creating any more patches until the layers can get their acts together. | 18:31 |
kfox1111 | I already have three patches waiting since September. | 18:32 |
NobodyCam | :) :-p | 18:32 |
kfox1111 | they are all public domain, and prior art up the wazoo, but everyone's scared of being sued. | 18:32 |
NobodyCam | :) | 18:32 |
kfox1111 | one of the patches is a sort comparater function. :/ Sort this way instead of that. its depressing. | 18:33 |
NobodyCam | lol yea, but the laywers got get paid too :-p | 18:34 |
kfox1111 | I dont mind them getting paid. I just mind them taking more then 4 months to let me contribute a patch that took litterally 1 hour to write. | 18:34 |
kfox1111 | so, I rooted the seed. Its up and running. | 18:35 |
kfox1111 | no nova services running. | 18:35 |
NobodyCam | are then installed in /opt/stack? | 18:35 |
kfox1111 | yeah. lots of stuff. | 18:36 |
kfox1111 | does the vm need an eth0 and eth1? I only have an eth0 at the moment and looks like upstart may not be starting things cause of it? | 18:37 |
NobodyCam | your logs should be in /var/log/upstart | 18:37 |
lifeless | the seed needs eth1 yes | 18:38 |
lifeless | but its a vm, should have been created that way automatically | 18:38 |
kfox1111 | network is showing its trying to dhcp off of eth0. I don't have it setup that way. do I make that a nat interface? | 18:39 |
kfox1111 | I manually created the libvirt xml file. didn't see an example in the doc. | 18:39 |
NobodyCam | kfox1111: have you seen the devtest.sh script? | 18:40 |
kfox1111 | no. was trying to hack things into a sort of working environment. wasn't sure things would work if I didn't manually configure some stuff. | 18:41 |
kfox1111 | thats in incubation repository? | 18:41 |
NobodyCam | yea - https://github.com/openstack/tripleo-incubator/blob/master/scripts/devtest.sh | 18:42 |
kfox1111 | I have an older box hosting the seed. I had to qemu-img convert the image just to get it to boot. I built it on a newer ubuntu box. | 18:42 |
NobodyCam | I recamend starting with a clean slate! the devtest script should get you up and running from a clean start | 18:43 |
NobodyCam | morning lifeless | 18:44 |
NobodyCam | hey quick question ... what time zone is StevenK in? | 18:44 |
kfox1111 | yeah. I was trying to get someting up and working quickly to kick some tires. | 18:45 |
lifeless | NobodyCam: UTC+10[11] | 18:45 |
lifeless | NobodyCam: 11 right now | 18:46 |
kfox1111 | I've got access to a bit of old hpc hardware for just a little bit. | 18:46 |
NobodyCam | ahh :) :) | 18:46 |
kfox1111 | maybe I should switch gears and try: http://openstack.redhat.com/Deploying_RDO_using_Tuskar_and_TripleO | 18:46 |
*** dprince has quit IRC | 18:46 | |
NobodyCam | kfox1111: I have not tested that at all | 18:46 |
lifeless | kfox1111: the script setup-seed-vm will setup a seed vm correctly for you and you can then copy your disk image over the top | 18:47 |
lifeless | kfox1111: but, there have been lots of changes and bugfixes to nova etc; you may find yourself debugging issues that were solved weeks ago | 18:47 |
kfox1111 | so... more complicated then that. My laptop where i can build images is on the internet and far away from the rack of nodes I can do testing with. | 18:47 |
kfox1111 | the rack of hardware in question is on a private only network so I can't build things there since all the tripleo scripts assume they can pull lots of random things in. | 18:48 |
lifeless | kfox1111: thats ok, the USE_CACHE=1 flag will tell the scripts not to build images | 18:48 |
kfox1111 | we usually use rpm mirroring to work around that. | 18:48 |
kfox1111 | ah. ok. | 18:48 |
lifeless | we don't yet have a good 'and these are the files you need to copy across' thing though | 18:48 |
lifeless | we do have some build here, run-there support which we use for tripleo-ci | 18:49 |
lifeless | so perhaps you would have success taking that and improving it for baremetal | 18:49 |
openstackgerrit | Dustin J. Mitchell proposed a change to openstack/diskimage-builder: order phase subdirs by execution order, add subheadings, fix formatting https://review.openstack.org/75480 | 18:50 |
kfox1111 | I think I'm going to give the rdo prebuilt images a shot real quick. would help me ensure I have a working hardware/vm setup without having to worry about ensuring all the vm images are built properly too. | 18:51 |
kfox1111 | hmm.. maybe not. | 18:52 |
kfox1111 | the instructions look like everything may be virtual. | 18:53 |
matty_dubs | kfox1111: Let me see if I can find the instructions -- that's the default, but it doesn't have to be all virtual | 18:53 |
kfox1111 | if just the overcloud was physical that would work. | 18:53 |
matty_dubs | Oh wow, the devtest.html page's formatting is all screwed up | 18:55 |
NobodyCam | matty_dubs: ya | 18:55 |
kfox1111 | matty_dubs: thanks. | 18:56 |
matty_dubs | So I can't find my notes. I've gone through this guide (but without broken formatting) and just used physical machines instead of VMs. | 18:57 |
matty_dubs | I thought I had a bookmark with exactly what I did, but no such luck :( | 18:58 |
kfox1111 | no worries. thanks for checking. | 19:01 |
kfox1111 | no major problems though? | 19:01 |
matty_dubs | No. The whole thing does take a long time, but it all worked last time I ran through it. | 19:02 |
kfox1111 | cool. thanks. :) | 19:02 |
*** athomas has quit IRC | 19:02 | |
NobodyCam | kfox1111: when i was testing on real hardware i recall having to replace the DIB vm element with baremetal element... i think i recall that any way. | 19:04 |
NobodyCam | there may be other elements like that too.. its been awhile sense i've had real hardware | 19:05 |
kfox1111 | hmm.. so I might have to hack an image slightly to get it to boot. | 19:05 |
kfox1111 | was kind of expecting that anyway. booting on real hardware is always touchy... :) | 19:06 |
NobodyCam | things changing the | 19:06 |
kfox1111 | this hardware has those weird cciss raid stuff. | 19:06 |
NobodyCam | VirtualPowerManager to IPMI and such | 19:06 |
kfox1111 | ah. yeah. | 19:07 |
*** athomas has joined #tripleo | 19:10 | |
*** wendar has joined #tripleo | 19:11 | |
kfox1111 | hmm.. that doc says to look at http://openstack.redhat.com/TripleO_VM_Setup instead. | 19:13 |
kfox1111 | looks good but its again pointing to go git pull stuff. :/ | 19:13 |
kfox1111 | I guess I can pull on one box and copy the whole tree over. | 19:13 |
NobodyCam | rsync is your friend | 19:14 |
NobodyCam | lol | 19:14 |
kfox1111 | If I were going to do it alot, I could probably set it up so I could git clone it, and push from it to the isolated box. | 19:16 |
kfox1111 | gits very nice that way. I'm so glad to be mostly off of svn now. | 19:16 |
NobodyCam | :) | 19:16 |
matty_dubs | A previous employer tried to switch from svn to git, and I pushed back because it seemed really complicated. | 19:17 |
matty_dubs | I was _sooo_ wrong. | 19:17 |
matty_dubs | Well, totally right about it being complicated, but totally wrong about it not being worth it. | 19:18 |
matty_dubs | ;) | 19:18 |
kfox1111 | ah. so this set is putting a generic set of binaries in the image, and doing all the config with configdrive. clever. | 19:18 |
kfox1111 | yeah. the few extra steps seems like it would be slowing you down all the time. but way worth it. :) | 19:18 |
kfox1111 | I was extatic the first time I was able to do a partial single file commit. | 19:19 |
NobodyCam | i liked bazzar | 19:19 |
kfox1111 | didn't play too much with bazar but it seemed nice. | 19:19 |
NobodyCam | we should all just go mack to M$ sourceSafe | 19:20 |
NobodyCam | lol | 19:20 |
NobodyCam | and never git anything done again | 19:20 |
matty_dubs | Haha | 19:20 |
kfox1111 | you say that in jest, but there still are folks around that... ;) | 19:21 |
* NobodyCam was old school foxpro... and has spent many many hours fighting with / fixing / cursing M$ SS | 19:22 | |
cody-somerville | NobodyCam: I liked bzr as well. However, I used it the other day and was like "wow. I forgot how slow this really was". | 19:22 |
kfox1111 | I'm sorry. :) | 19:22 |
* kfox1111 wonders what will replace git some day | 19:23 | |
kfox1111 | cvs was so much better then rcs. svn was so much better then cvs. git is so much better then svn... | 19:24 |
NobodyCam | :) | 19:25 |
*** vkozhukalov has joined #tripleo | 19:25 | |
NobodyCam | cody-somerville: ya.. its been quite awhile sense i've use bzr | 19:27 |
*** UtahDave has quit IRC | 19:29 | |
*** panda___ has joined #tripleo | 19:31 | |
*** kfox1111 has quit IRC | 19:34 | |
*** panda has quit IRC | 19:34 | |
*** kfox1111 has joined #tripleo | 19:35 | |
*** hashar has joined #tripleo | 20:12 | |
kfox1111 | ok. got the rdo undercloud vm image booted. :) | 20:14 |
NobodyCam | kfox1111: :) awesome ness | 20:16 |
NobodyCam | humm devtest currently has not idea of what the virt_type is for the nodes its is managing | 20:18 |
*** afrittoli has quit IRC | 20:18 | |
kfox1111 | just gota get the nodes enrolled now... | 20:23 |
saurabhs | I have a doubt around building tripleO image. As per the instruction from https://github.com/openstack/tripleo-image-elements/blob/master/README.md. | 20:24 |
saurabhs | To build a tripleO image I can use | 20:24 |
saurabhs | diskimage-builder/bin/disk-image-create -u base vm bootstrap local-config stackuser heat-cfntools -a i386 -o bootstrap | 20:24 |
saurabhs | want to understand where does this hooks up os-config-apply, os-config-refresh, os-collect-config? | 20:25 |
saurabhs | do I have to explicitly mention every element I want to include their or these 3 always get included whether we specify it or not | 20:25 |
greghaynes | Is there a fix for http://docs.openstack.org/developer/tripleo-incubator/devtest.html up for review somewhere? | 20:27 |
*** cadenzajon has quit IRC | 20:29 | |
NobodyCam | saurabhs: is bootstrap still a valid element? | 20:30 |
NobodyCam | that may be a old create line | 20:30 |
saurabhs | NobodyCam: looks like it give me error | 20:32 |
saurabhs | ERROR: Element 'bootstrap' not found in 'tripleo-image-elements/elements:diskimage-builder/bin/../elements' | 20:32 |
saurabhs | I will replace it with ubuntu | 20:32 |
saurabhs | but I am not able to figure out if I have specify os-confg-apply explicitly or they get included by default | 20:32 |
bnemec | saurabhs: os-refresh-config is listed in element-deps for the elements that use it. Or should be anyway. | 20:33 |
NobodyCam | saurabhs: you may want to give this script a read thru: https://github.com/openstack/tripleo-incubator/blob/master/scripts/boot-seed-vm#L31 | 20:34 |
NobodyCam | note the elements it is including | 20:34 |
*** ccrouch1 has joined #tripleo | 20:40 | |
slagle | anyone know what's up with the devtest formatting: http://docs.openstack.org/developer/tripleo-incubator/devtest.html | 20:41 |
slagle | i generated locally, and they look ok | 20:41 |
greghaynes | hrm | 20:42 |
greghaynes | slagle: how do you gen docs localy? | 20:42 |
slagle | actually, i should probably blow away my tox venvs and try again | 20:42 |
slagle | tox -e venv python setup.py build_sphinx | 20:42 |
slagle | greghaynes: ^ | 20:42 |
greghaynes | ty | 20:42 |
slagle | then they are under doc/build | 20:42 |
*** ccrouch has quit IRC | 20:43 | |
slagle | yea, still look ok locally | 20:43 |
*** ekarlso has quit IRC | 20:50 | |
*** ekarlso has joined #tripleo | 20:50 | |
*** martyntaylor has quit IRC | 20:58 | |
*** e0ne has joined #tripleo | 20:59 | |
*** cadenzajon has joined #tripleo | 21:13 | |
*** e0ne has quit IRC | 21:16 | |
*** e0ne has joined #tripleo | 21:18 | |
*** noslzzp has quit IRC | 21:20 | |
*** e0ne has quit IRC | 21:22 | |
*** noslzzp has joined #tripleo | 21:24 | |
greghaynes | I first noticed the doc thing last night, and I dont think anything has merged to t-i since then.... | 21:25 |
tchaypo | I noticed that about a week ago, been meaning to look at it on monday | 21:33 |
tchaypo | it looks like there's a bit of awk that parses a script (devtest.sh?) and pulls out the comments, and it's not taking out the ## at the start of the comments | 21:34 |
greghaynes | odd because it seems to work fine locally | 21:35 |
tchaypo | https://git.openstack.org/cgit/openstack/tripleo-incubator/tree/scripts/extract-docs is the script that does the extracting | 21:36 |
tchaypo | It's broken for me locally :) | 21:36 |
greghaynes | oh? | 21:36 |
greghaynes | you have a useful setup :) | 21:36 |
tchaypo | let me check that it hasn't mysteriously fixed itself.. | 21:39 |
tchaypo | still broken. | 21:40 |
tchaypo | but I am being called away. I'll dig into it some more later on. I can't see any recent changes to the extract-docs, extract-docs.awk,and the changes to devtest.sh seem innocuous | 21:44 |
tchaypo | so I'm suspect awk or sphinx version changes | 21:44 |
*** jcooley_ has joined #tripleo | 21:50 | |
kfox1111 | ok. finally got the bare metal nodes enroled. just gota upload an image and give it a try. :) | 21:57 |
*** jdob has quit IRC | 22:00 | |
*** lblanchard has quit IRC | 22:03 | |
*** matty_dubs is now known as matty_dubs|gone | 22:05 | |
*** hashar has quit IRC | 22:09 | |
*** CaptTofu has quit IRC | 22:10 | |
*** CaptTofu has joined #tripleo | 22:12 | |
kfox1111 | does the console work with nova bare metal? | 22:18 |
kfox1111 | Can an admin get to the console without booting an instance? | 22:18 |
NobodyCam | ie console before there anything to connect it to? | 22:20 |
*** cwolferh_ has joined #tripleo | 22:22 | |
*** cwolferh has quit IRC | 22:25 | |
kfox1111 | I know some of these nodes probably don't have hardware virtualization turned on in the bios. | 22:27 |
kfox1111 | I guess I could just boot an instance and console attach right away if that works. | 22:27 |
NobodyCam | kfox1111: I believe console does work ( i have not tested it ) but have heard many a tail of others using it | 22:29 |
kfox1111 | k. thx. | 22:29 |
kfox1111 | do you need to use a kernel/initrd seperate or does a regular grub/linux kerel boot work? | 22:30 |
NobodyCam | its pxe booting each time not just for the deploy | 22:32 |
kfox1111 | ah. ok. so the deploy kernel/image are for getting the image onto the node, not for booting the node. | 22:35 |
kfox1111 | or both? Does it reboot after it puts the image on the node, booting local? | 22:36 |
*** julim has quit IRC | 22:36 | |
lifeless | kfox1111: ot netboots every time | 22:38 |
lifeless | kfox1111: deploy is one boot, run is a second boot with the users provided kernel + ramdisk | 22:38 |
kfox1111 | can the user not provide a kernel/ramdisk but just use whats in the image? | 22:40 |
lifeless | not today | 22:40 |
lifeless | but the user typically pulls their kernel/ramdisk out of the image | 22:40 |
lifeless | so same same | 22:40 |
kfox1111 | k. so I'll have to extract it then. Thanks. | 22:41 |
lifeless | kfox1111: load-image will do that for you (and the baremetal element does it at image build time for you) | 22:42 |
NobodyCam | ha lifeless is faster then i I was going to reffer you to https://github.com/openstack/tripleo-incubator/blob/master/scripts/load-image | 22:43 |
kfox1111 | ah. ok. | 22:43 |
*** edmund has quit IRC | 22:44 | |
kfox1111 | ah. I see load-image calling out to disk image builder's script to pull the kernel bits. yeah. | 22:46 |
*** CaptTofu has quit IRC | 22:54 | |
*** ccrouch has joined #tripleo | 22:58 | |
*** jcooley_ has quit IRC | 22:59 | |
*** ccrouch1 has quit IRC | 23:00 | |
kfox1111 | where does tripleo put log files? | 23:09 |
lifeless | running ubuntu? /var/log/upstart/ | 23:10 |
kfox1111 | it a fedora build. | 23:12 |
kfox1111 | ah. so systemd. | 23:12 |
kfox1111 | its just throwing things in /var/log/messages. | 23:18 |
kfox1111 | ok. trying to boot a vm gets no valid host found... | 23:19 |
kfox1111 | ah. looks like maybe x86_64 vs amd64 difference somewhere... | 23:20 |
NobodyCam | :) | 23:20 |
lifeless | nova.conf has an arch value for nova baremetal | 23:20 |
lifeless | the extra specs on the flavor have to match | 23:20 |
lifeless | and the servicehost on the node has to match the nova-compute agent name | 23:21 |
lifeless | unless both match it won't advertise the node to the scheduler | 23:21 |
lifeless | nova hypervisor-stats lets you see whats advertised without poking around log files | 23:21 |
kfox1111 | ah. cool. thanks. | 23:21 |
NobodyCam | nova hypervisor-stats nice /me way way to use to check the log | 23:22 |
NobodyCam | TY lifeless | 23:23 |
kfox1111 | ok. changing nova.conf to match x86_64 got farter. | 23:25 |
kfox1111 | looks like it wont make any further progress until I extract the kernel/initrd from the image. was hoping I could atleast get to the bios first. oh well. | 23:26 |
lifeless | there's also nova host-list and nova host-descriobe | 23:26 |
lifeless | kfox1111: we use amd64 everywhere FWIW | 23:26 |
lifeless | kfox1111: consistency. | 23:26 |
kfox1111 | http://openstack.redhat.com/TripleO_VM_Setup theres a step configure-vm '--arch x86_64' | 23:27 |
kfox1111 | I thought that was what ARCH was set to. I guessed wrong I guess. | 23:28 |
lifeless | oh | 23:34 |
lifeless | all our tooling uses amd64 | 23:34 |
lifeless | slagle has documented a different key there | 23:34 |
lifeless | I presume its slagle anyhow, he did a bunch of nice tooling support for RHer's getting started with this | 23:34 |
lifeless | I'd prefer to see that also say amd64, just to avoid confusion like you have just experienced. | 23:35 |
kfox1111 | going to be confusion both ways I'm afraid. the debian/ubuntu guys use amd64. the redhatish folks use x86_64 all over the place. its really odd to me to see amd64, though it makes sense. | 23:39 |
kfox1111 | odd... Error: Image 7ea-d86e-4174-b696-19c56a191c87 could not be found. | 23:44 |
kfox1111 | there is no 7ea as far as I can tell, so its right... | 23:45 |
*** sdake_ has joined #tripleo | 23:45 | |
*** sdake_ has quit IRC | 23:45 | |
*** sdake_ has joined #tripleo | 23:45 | |
kfox1111 | do I have to restart something after I upload the deploy images to glance? | 23:46 |
*** athomas has quit IRC | 23:46 | |
NobodyCam | shouldn't | 23:48 |
NobodyCam | just deploy with that image | 23:48 |
openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-image-elements: Use xtradb-cluster in place of mysql https://review.openstack.org/75540 | 23:52 |
kfox1111 | does it make up a uuid for the customized image? is it complaining about that, or is it saying the deploy image it cant find or something? | 23:52 |
NobodyCam | oh you did remove the other images | 23:53 |
NobodyCam | i'll bet | 23:53 |
NobodyCam | glance image-list | 23:53 |
NobodyCam | glance image-delete UUID | 23:53 |
kfox1111 | deleting and booting the vm clames it cant find 7ea-d86e-4174-b696-19c56a191c87 | 23:54 |
kfox1111 | so, same image... | 23:54 |
kfox1111 | hmm.. the kerenl image I uploaded is "639197ea-d86e-4174-b696-19c56a191c87" | 23:56 |
kfox1111 | bare metal deploy kernel... | 23:56 |
kfox1111 | flavor metadata maybe? | 23:56 |
kfox1111 | yeah. the string is truncated there. | 23:57 |
NobodyCam | kfox1111: ya extra specs | 23:58 |
NobodyCam | on the flavor | 23:58 |
kfox1111 | there we go.... | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!