*** chlong has quit IRC | 00:05 | |
*** saneax is now known as saneax_AFK | 00:13 | |
*** dmacpher-afk has quit IRC | 00:15 | |
*** fragatin_ has quit IRC | 00:17 | |
*** dtantsur has joined #tripleo | 00:22 | |
*** MaxPC has quit IRC | 00:25 | |
*** fragatina has joined #tripleo | 00:29 | |
*** fragatina has quit IRC | 00:33 | |
*** noslzzp has joined #tripleo | 00:34 | |
*** noslzzp has quit IRC | 00:38 | |
*** akshai has joined #tripleo | 00:40 | |
*** fragatina has joined #tripleo | 00:41 | |
*** akshai_ has joined #tripleo | 00:42 | |
*** fragatina has quit IRC | 00:42 | |
*** akshai has quit IRC | 00:45 | |
*** saneax_AFK is now known as saneax | 00:47 | |
*** skinjo has quit IRC | 00:47 | |
*** tdasilva has quit IRC | 00:50 | |
*** fragatina has joined #tripleo | 00:51 | |
*** fragatin_ has joined #tripleo | 00:52 | |
*** tdasilva has joined #tripleo | 00:52 | |
*** fragatin_ has quit IRC | 00:53 | |
*** fragatin_ has joined #tripleo | 00:53 | |
*** fragatina has quit IRC | 00:55 | |
*** fragatina has joined #tripleo | 00:56 | |
*** fragatin_ has quit IRC | 00:57 | |
*** fragatina has quit IRC | 01:01 | |
*** dmacpher has joined #tripleo | 01:06 | |
*** chlong has joined #tripleo | 01:30 | |
*** fragatina has joined #tripleo | 01:34 | |
*** egafford has joined #tripleo | 01:34 | |
*** fultonj has quit IRC | 01:34 | |
*** tzumainn has quit IRC | 01:41 | |
*** yamahata has quit IRC | 01:43 | |
*** Goneri has joined #tripleo | 01:48 | |
*** jcoufal has joined #tripleo | 01:56 | |
*** jcoufal has quit IRC | 02:03 | |
*** egafford has quit IRC | 02:10 | |
*** saneax is now known as saneax_AFK | 02:20 | |
*** fragatina has quit IRC | 02:24 | |
*** absubram has joined #tripleo | 02:53 | |
*** absubram_ has joined #tripleo | 02:55 | |
*** ccamacho has quit IRC | 02:57 | |
*** absubram has quit IRC | 02:58 | |
*** absubram_ is now known as absubram | 02:58 | |
*** ccamacho has joined #tripleo | 02:58 | |
*** shivrao_ has quit IRC | 03:00 | |
*** MaxPC has joined #tripleo | 03:03 | |
*** egafford has joined #tripleo | 03:09 | |
openstackgerrit | Merged openstack/puppet-tripleo: Add dport/sport parameter to firewall rule https://review.openstack.org/308358 | 03:10 |
---|---|---|
*** cwolferh has quit IRC | 03:15 | |
*** akshai_ has quit IRC | 03:15 | |
*** fragatina has joined #tripleo | 03:16 | |
*** fragatina has quit IRC | 03:16 | |
*** fragatina has joined #tripleo | 03:16 | |
*** egafford has quit IRC | 03:22 | |
*** absubram has quit IRC | 03:26 | |
*** julim has quit IRC | 03:33 | |
*** julim has joined #tripleo | 03:33 | |
*** panda has quit IRC | 03:42 | |
*** panda has joined #tripleo | 03:42 | |
*** masco has joined #tripleo | 03:57 | |
*** links has joined #tripleo | 04:02 | |
*** MaxPC has quit IRC | 04:11 | |
*** coolsvap has joined #tripleo | 04:20 | |
*** saneax_AFK is now known as saneax | 04:35 | |
*** aufi has joined #tripleo | 04:59 | |
*** saneax is now known as saneax_AFK | 05:00 | |
*** saneax_AFK is now known as saneax | 05:10 | |
*** mbound has joined #tripleo | 05:18 | |
*** jprovazn has joined #tripleo | 05:38 | |
*** mbound has quit IRC | 05:43 | |
*** social has quit IRC | 05:51 | |
openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Fix validation for stable branch https://review.openstack.org/312350 | 05:53 |
*** mikelk has joined #tripleo | 05:56 | |
*** social has joined #tripleo | 05:57 | |
openstackgerrit | Gerard Braad proposed openstack/instack: Correct example url in README https://review.openstack.org/313235 | 06:02 |
openstackgerrit | Gerard Braad proposed openstack/instack: Correct example url in README https://review.openstack.org/313235 | 06:05 |
*** bandini has quit IRC | 06:09 | |
*** bandini has joined #tripleo | 06:09 | |
*** paramite has joined #tripleo | 06:16 | |
*** jkraj has joined #tripleo | 06:17 | |
*** apetrich has joined #tripleo | 06:29 | |
*** dmacpher has quit IRC | 06:40 | |
*** spredzy has quit IRC | 06:48 | |
*** tremble has joined #tripleo | 06:54 | |
*** athomas has joined #tripleo | 06:55 | |
*** shivrao has joined #tripleo | 06:56 | |
*** shivrao has quit IRC | 06:56 | |
*** shivrao_ has joined #tripleo | 06:56 | |
*** shivrao has joined #tripleo | 06:58 | |
*** saneax is now known as saneax_AFK | 07:09 | |
*** zoli_gone-proxy is now known as zoliXXL | 07:11 | |
zoliXXL | good morning | 07:13 |
*** saneax_AFK is now known as saneax | 07:16 | |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Collect the common logic in tripleo-common https://review.openstack.org/228991 | 07:17 |
*** ifarkas has joined #tripleo | 07:21 | |
*** hjensas has quit IRC | 07:22 | |
*** jprovazn has quit IRC | 07:34 | |
*** jprovazn has joined #tripleo | 07:36 | |
*** openstackstatus has quit IRC | 07:38 | |
*** openstackstatus has joined #tripleo | 07:41 | |
*** ChanServ sets mode: +v openstackstatus | 07:41 | |
*** saneax is now known as saneax_AFK | 07:43 | |
*** shivrao has quit IRC | 07:44 | |
*** jpena|off is now known as jpena | 07:44 | |
*** shivrao has joined #tripleo | 07:46 | |
*** shivrao has quit IRC | 07:47 | |
*** ohamada has joined #tripleo | 07:51 | |
*** saneax_AFK is now known as saneax | 07:52 | |
*** chlong has quit IRC | 07:54 | |
*** mcornea has joined #tripleo | 08:04 | |
*** hjensas has joined #tripleo | 08:05 | |
*** dmk0202 has joined #tripleo | 08:08 | |
*** jprovazn has quit IRC | 08:10 | |
*** jprovazn has joined #tripleo | 08:11 | |
*** florianf has joined #tripleo | 08:11 | |
*** lucas-afk is now known as lucasagomes | 08:15 | |
*** devvesa has joined #tripleo | 08:17 | |
*** shardy has joined #tripleo | 08:28 | |
*** jaosorior has joined #tripleo | 08:32 | |
*** jistr has joined #tripleo | 08:32 | |
*** pcaruana has joined #tripleo | 08:36 | |
*** derekh has joined #tripleo | 08:38 | |
*** fragatina has quit IRC | 08:41 | |
*** abehl has joined #tripleo | 08:43 | |
openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Fix validation for stable branch https://review.openstack.org/312350 | 08:44 |
jaosorior | shardy hey dude, are you around? | 08:49 |
shardy | jaosorior: Hi, yup | 08:49 |
*** fragatina has joined #tripleo | 08:50 | |
jaosorior | shardy: Hey man, I need a bit of help. So I'm still trying to get the keystone endpoints and services to be configured via puppet. And it seems pretty close with this CR https://review.openstack.org/#/c/304125/ | 08:50 |
jaosorior | except that it's failing at upgrades. And it's failing because that patch depends on this one https://review.openstack.org/#/c/244162/ which is not present during the first overcloud deploy run in that gate | 08:51 |
shardy | jaosorior: that hard-coded list of include $project::keystone::auth isn't great from a composable services perspective :( | 08:52 |
jaosorior | shardy: It isn't great, but as discussed a couple of days ago. It is alright as a first iteration | 08:52 |
shardy | is the plan to break that out into each service template when they're all done? | 08:53 |
jaosorior | shardy: yes | 08:53 |
shardy | Ok, cool | 08:53 |
jaosorior | discussed it with marios a couple of days ago | 08:53 |
shardy | maybe add a FIXME comment to save folks going "OH NO" like I just did :D | 08:53 |
jaosorior | that is actually a pretty good idea | 08:53 |
jaosorior | will do | 08:53 |
jaosorior | but anyway | 08:54 |
jaosorior | the reason it fails is because it needs a parameter from the review I was talking about | 08:54 |
jaosorior | which is not present, since that patch is missing from the first run in the upgrade gate | 08:54 |
jaosorior | so... what to do in that case? | 08:55 |
shardy | Hmm, surely it should install pre-upgrade with neither of those patches | 08:55 |
shardy | then upgrade to the branch with both of them? | 08:55 |
shardy | So, during the upgrade, the dependency will be satisfied? | 08:56 |
*** tesseract has joined #tripleo | 08:56 | |
* shardy looks at logs | 08:56 | |
jaosorior | yeah, during upgrade it will be alright, since the parameter should be present | 08:56 |
*** tesseract is now known as Guest42930 | 08:56 | |
*** abehl has quit IRC | 08:57 | |
*** anshul has joined #tripleo | 08:57 | |
jaosorior | basically, the password for the services is mandatory for those resources. And that is only present with the addition of the t-h-t patch | 08:57 |
*** anshul is now known as Guest14219 | 08:57 | |
jaosorior | so basically that would fail in the case were a deployer would update the images (or the puppet manifests) and do a deployment, but with an older t-h-t. | 08:58 |
shardy | Yes, but it's failing deploying the trunk delorean-current t-h-t isn't it? | 08:58 |
marios | jaosorior: shardy .* o/ | 08:58 |
marios | jaosorior: did you try asking gfidente about that one? | 08:58 |
jaosorior | shardy: Yes, because it first tries to deploy without the t-h-t patch and with the puppet-tripleo patch | 08:59 |
shardy | jaosorior: Ah, gotcha, new image, old templates | 08:59 |
* shardy really needs a coffee | 08:59 | |
jaosorior | marios: I haven't yet. I probably forgot due to my crippling jetlag haha | 08:59 |
jaosorior | gfidente, are you around yet? | 08:59 |
jaosorior | I guess not :/ | 09:03 |
jaosorior | anyway, marios, shardy: Any idea on how to go forward there? | 09:03 |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: WIP: Composable roles NTP: PT https://review.openstack.org/310725 | 09:04 |
shardy | jaosorior: I think it's a bug in CI - we should be building the pre-update image from trunk, then updating the node to the new puppet-tripleo as part of the update | 09:04 |
shardy | (or ideally using a pre-cached trunk overcloud image) | 09:05 |
*** electrofelix has joined #tripleo | 09:07 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Create keystone endpoints in keystone profile https://review.openstack.org/304125 | 09:08 |
jaosorior | shardy, marios: Alright, added the comment that indicates that it will be moved to the individual profiles ^^ | 09:08 |
*** mkovacik has joined #tripleo | 09:09 | |
marios | anyone played with mistral and/or yaql at all/help comments appreciated https://review.openstack.org/#/c/313084/1/mistral/overcloud_shell.yaml | 09:12 |
jaosorior | shardy, marios: could we merge the dependency then? https://review.openstack.org/#/c/244162/ It would fix that CI issue, and would finally allow me to start pushing subsequent commits to get those endpoints/services created in the profiles instead of all in the keystone profile | 09:13 |
shardy | Well, it won't really fix the CI issue, which is that we should be using trunk images | 09:13 |
jaosorior | shardy: it doesn't fix the real issue. But it will allow it to pass, so I will be able to test breaking it up subsequently | 09:14 |
shardy | marios: I spent some time yesterday playing with mistral, will take a look | 09:14 |
*** sambetts|afk is now known as sambetts | 09:14 | |
marios | shardy: thx is kinda cool but also scary. not much fond of yaql - mostly cos docs are awful (or haven't found them yet) | 09:14 |
shardy | marios: the docs nearly all just say TODO IIRC | 09:15 |
*** dbecker has joined #tripleo | 09:15 | |
shardy | the action interfaces are kinda awkward too in places, because they directly surface any inconsistencies in the python clients | 09:15 |
shardy | so it's kinda like writing a python script in the workflow dsl ;) | 09:16 |
marios | shardy: and subsequent error handling is pretty bad (when things do go wrong on an action as you say) | 09:17 |
marios | shardy: ERROR "error" | 09:17 |
shardy | jaosorior: sure - I guess I was hoping you might take a quick look at actually fixing CI | 09:17 |
marios | something like that anyway | 09:17 |
marios | :) | 09:17 |
shardy | I'll chat with derekh and slagle about it later | 09:17 |
marios | shardy: so that enforcement on the python clients is possibly a good thing though | 09:18 |
shardy | marios: Yeah, but you can get detail from mistral execution-get which normally helps somewhat | 09:18 |
shardy | marios: well, yeah, but it also makes it hard to code a workflow without constantly referring to the python code in all the *-clients | 09:18 |
shardy | whereas it'd be somewhat nicer if there was a translation e.g so "id" could be used universally instead of switching between "id" and "uuid" in various places | 09:19 |
marios | shardy: yeah i see what you mean, but am saying it isn't really mistral's fault that there is this inconsistency | 09:20 |
derekh | shardy: whats up? | 09:21 |
shardy | marios: yeah - I guess coming from a Heat background we tried to provide a more uniform interface via properties | 09:21 |
shardy | whereas mistral feels like a more low-level tool, which is fine I guess | 09:21 |
shardy | derekh: so, jaosorior noticed an issue with the upgrades job, where a patch depends on something that updates the image, we do the initial (pre-update) deploy with an updated non-trunk image, but trunk t-h-t | 09:22 |
shardy | I was wondering do we have cached overcloud images yet? | 09:22 |
marios | shardy: well it feels pretty immature still so we could look to improve it/add stuff if we like/want to use it ... | 09:22 |
shardy | marios: Yup, agreed | 09:23 |
derekh | shardy: we now have the cached overcloud image available, but are not using it yet, this is the patch to use it https://review.openstack.org/#/c/312397/3 | 09:24 |
derekh | shardy: but I've just remembered I need to update the puppet modules in it, will do that now | 09:24 |
derekh | shardy: having trouble following the logic of the problem you described, will read back and see if I can follow | 09:25 |
shardy | derekh: Ok, thanks - I'm wondering if we can fix the upgrades job issue by just switching to use the pre-cached image | 09:25 |
jaosorior | derekh: Do we do anything for the puppet-modules on the upgrades gate? | 09:25 |
jaosorior | From what I can see in the ci scripts. It seems that it only takes t-h-t into account, does it? | 09:25 |
*** mgould has joined #tripleo | 09:26 | |
shardy | jaosorior: Yes, but really we should actually be upgrading the nodes by updating to a new delorean repo provided by CI | 09:26 |
shardy | https://github.com/openstack/mistral-extra/blob/master/examples/v2/openstack/crawl_specific_data.yaml#L36 | 09:29 |
shardy | marios: is that what you need? | 09:29 |
marios | shardy: heh thanks i already have something similar on line 25 | 09:33 |
*** chem has joined #tripleo | 09:33 | |
marios | shardy: the problem is matching on the input param. and ultimately making it regex if possble | 09:33 |
shardy | Ok, that's my yaql/google fu exhausted them I'm afraid | 09:34 |
marios | shardy: i actually started my one from https://github.com/openstack/mistral-extra/blob/master/examples/v2/openstack/update_kernel.yaml which is similar to what you pointed at and then adapted it | 09:34 |
shardy | You could ask in the openstack-mistral channel I guess | 09:34 |
marios | shardy: yeah will play some more later and take it from there but thenks for looking much appreciated/know i'm not just missing an obvious thing | 09:34 |
jaosorior | derekh: So basically in this concrete case, we have a puppet-tripleo that depends on a t-h-t patch. now, the puppet-tripleo change is failing the the upgrades job because the first overcloud deploy run contains the puppet patch but not the t-h-t patch | 09:37 |
shardy | simple review needs a second +2/A https://review.openstack.org/#/c/307884/2 | 09:37 |
jaosorior | derekh: And the behavior should be that it should do the deploy, and the upgrade should then contain the desired patches, I think? | 09:38 |
derekh | shardy: jaosorior ok, was very confused there for a few minutes, but I think I understand now | 09:38 |
derekh | shardy: jaosorior my confusion was caused because I didn't know we down graded t-h-t as pard of the upgrades job | 09:39 |
derekh | shardy: jaosorior http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/deploy.sh#n101 | 09:39 |
shardy | Yeah the issue is when you have a chain of dependencies that affect both templates and $stuff-inside-image | 09:39 |
derekh | I think jaosorior is correct we should do the initial deploy with no ci repository at all | 09:40 |
shardy | derekh: Yeah, we start with the trunk t-h-t package, but keep everything else in the dependency chain | 09:40 |
jaosorior | derekh: well, I didn't know either | 09:40 |
jaosorior | I honestly was extremely confused | 09:40 |
derekh | then add the ci repositry to the undercloud, yum update it | 09:40 |
derekh | then add the ci repository to the overcloud images | 09:40 |
derekh | and run tripleo.sh --overcloud-update | 09:41 |
shardy | derekh: well we have to add the CI repository to the deployed nodes (possibly via a DeployArtefact) I think, because the images are already deployed at that point | 09:41 |
shardy | and tweak --overcloud-update so it enables the yum-update tasks on the nodes | 09:42 |
derekh | shardy: yup, thats what i meant s/images/instances/ | 09:42 |
shardy | ack | 09:42 |
shardy | jistr: is anyone working on upgrades looking at implementing ^^ in CI? | 09:42 |
* jistr reads | 09:43 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Additional parameters for Nuage Neutron plugin integration https://review.openstack.org/307884 | 09:43 |
derekh | brb | 09:43 |
shardy | https://review.openstack.org/#/c/310732/1 another simple one ready to merge | 09:45 |
*** tosky has joined #tripleo | 09:47 | |
shardy | dtantsur, lucasagomes: Hey if you get a moment, could you please check out https://review.openstack.org/#/c/313048/1/workflows/baremetal_deploy.yaml ? | 09:48 |
shardy | I'm trying to define the correct workflow to deploy nodes via Ironic without Nova, still using Neutron for the DHCP | 09:48 |
shardy | I've been copying the neutron/ironic port settings from a deployment driven via nova, and likewise updating instance_info | 09:49 |
jistr | shardy, derekh: yea that sounds good re repositories. However, to test minor update fully, we should probably run `openstack overcloud update` instead of `openstack overcloud deploy`, however. It probably takes much more time though, so starting with `deploy` should be fine i hope. As discussed on the summit, current 'upgrade' job is testing something that is closer to update rather than upgrade, but that's fine, as in reality we'd probably | 09:49 |
jistr | want to test both. | 09:49 |
shardy | however the node fails to get a DHCP response, so I'm pretty sure I'm missing some key step | 09:49 |
* dtantsur looks | 09:49 | |
jistr | i'm not aware of anyone looking into CI changes in this respect though | 09:50 |
shardy | I wanted a quick check from folks who know the nova->Ironic interaction better before I spend a lot of time debugging | 09:50 |
shardy | the mistral actions are basically calls to ironcclient and neutronclient | 09:50 |
jistr | personally i'm tasked downstream now and in the meantime i'm implementing a service manifest which we'll need both for upgrades and also probably for cert refreshment via certmonger | 09:52 |
jistr | cc jaosorior re certmonger ^^ | 09:52 |
*** fragatina has quit IRC | 09:52 | |
jistr | not sure if i'll have finished reviews today (depends on getting booked downstream i guess) but i'll at least post a WIP if nothing else | 09:53 |
shardy | jistr: Ok thanks for the update | 09:53 |
jaosorior | jistr: can you elaborate on that service manifest? | 09:54 |
dtantsur | shardy, commented. I assume you're aware about https://github.com/dtantsur/metalsmith, but reminding anyway :) | 09:54 |
shardy | dtantsur: Yeah I took a look at that, but was unsure of it's status | 09:54 |
shardy | there are a lot of files with "Provisioning (does not work)" in there ;) | 09:55 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Fixes ovs bonding option https://review.openstack.org/310732 | 09:55 |
shardy | I'm basically trying to do the same thing via mistral but without any concept of reservations | 09:55 |
jistr | jaosorior: basically we'd have a text file similar to puppet package manifest. It would allow us to query which service roles are deployed on the node even outside config management tooling, which is a necessity for anything happening outside a stack-update, e.g. certmonger refreshes, or upgrades if we ever do them outside heat. | 09:55 |
dtantsur | shardy, I was assuming it does not, when creating that commit, because it didn't work on devstack. it did work on undercloud for me though | 09:55 |
* jistr tries to dig up relevant #tripleo log | 09:56 | |
dtantsur | shardy, it's racy without reservations, that's why I do that. assigning instance_uuid is atomic | 09:56 |
shardy | dtantsur: sure, this would just loop over a pre-determined list of node IDs | 09:56 |
dtantsur | cool | 09:56 |
jistr | jaosorior: http://eavesdrop.openstack.org/irclogs/%23tripleo/%23tripleo.2016-05-03.log.html#t2016-05-03T09:41:51 | 09:56 |
*** jkraj has quit IRC | 09:57 | |
*** sshnaidm has quit IRC | 09:57 | |
jistr | jaosorior: you weren't online at that time i think, it was on Tuesday | 09:57 |
shardy | thanks for the feedback, I'll compare with the metalsmith code | 09:57 |
jaosorior | jistr: duuude, that IS a good idea! | 09:58 |
jistr | jaosorior: awesome, i'm glad you like it. Hoping i'll have it up for review soon. | 09:59 |
*** rasca has quit IRC | 09:59 | |
* jistr -> lunch for now | 09:59 | |
jaosorior | jistr: Let me know when you have a WIP patch or something of the sort | 09:59 |
jistr | ack | 09:59 |
jaosorior | jistr: And that's a good idea too | 09:59 |
jistr | haha | 09:59 |
*** jaosorior is now known as jaosorior_lunch | 09:59 | |
lucasagomes | shardy, sure, will do | 10:19 |
*** electrofelix has quit IRC | 10:20 | |
*** jprovazn has quit IRC | 10:20 | |
*** rasca has joined #tripleo | 10:25 | |
*** electrofelix has joined #tripleo | 10:32 | |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: WIP: Composable roles NTP: PT https://review.openstack.org/310725 | 10:35 |
*** gfidente has joined #tripleo | 10:44 | |
*** mdnadeem_ has joined #tripleo | 10:46 | |
*** mdnadeem has quit IRC | 10:49 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: WIP: integrate PCS provider in the merge. https://review.openstack.org/310713 | 10:51 |
*** florianf has quit IRC | 10:51 | |
*** florianf has joined #tripleo | 10:51 | |
*** Goneri has quit IRC | 10:52 | |
*** dmk0202 has quit IRC | 10:57 | |
*** dmk0202 has joined #tripleo | 10:57 | |
*** jtomasek has quit IRC | 10:59 | |
shardy | Simple stable backport needs a second review/approve: https://review.openstack.org/#/c/309662/ | 11:00 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Explicit Teardown and accessories changes https://review.openstack.org/313127 | 11:01 |
*** jaosorior_lunch has quit IRC | 11:11 | |
derekh | shardy: so the RAM and SSD's have arrived at the data center, we need to schedule a time to take things down and do the installs and bring it all back up again | 11:11 |
*** jaosorior_lunch has joined #tripleo | 11:12 | |
*** jaosorior_lunch is now known as jaosorior | 11:12 | |
shardy | derekh: Nice - but how does the timeline fit wrt the DC move and switching to RDO cloud? | 11:13 |
derekh | shardy: the guy in the data center says he is available most times next week to do the upgrades if we want | 11:13 |
shardy | derekh: ack - well if we can do it that fast we may as well go for it I guess - can we do it in batches to avoid a complete outage, or do we take the whole cloud down? | 11:14 |
derekh | shardy: the DC move date is all up in the air and maybe pushed out a little, wont know until next week | 11:14 |
weshay | trown|outtypewww, morning.. I was thinking of using gerrit change 313155 in a jjb change so it can just override the config. | 11:15 |
weshay | changing to -e | 11:15 |
derekh | shardy: at some stage the controller would have to go down, which will cause a complete outage, so I'm thinking we just bit the bullet and do it all in one go | 11:15 |
derekh | *bite | 11:16 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: WIP: integrate PCS provider in the merge. https://review.openstack.org/310713 | 11:16 |
shardy | derekh: Ok - what are your plans for the disk upgrade - are we going to add the SSDs just for certain mount points, or image the old disks completely? | 11:17 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: allow for individual ansible parameters to be overriden outside of a config file https://review.openstack.org/313155 | 11:17 |
derekh | shardy: I'm thinking, just for certain MP's, bring the machines up as normal, mount SSD's and copy the instance data to them, then mount to the instance directory | 11:20 |
*** pkovar has joined #tripleo | 11:20 | |
shardy | derekh: cool, that sounds like the quickest and least-risky plan :) | 11:20 |
shardy | derekh: want to start a ML thread so we can discuss the window to do the upgrade? | 11:21 |
shardy | I'm +1 on doing it next week if we can keep the outage time fairly small | 11:21 |
derekh | shardy: will do | 11:21 |
shardy | Weird https://review.openstack.org/#/c/313068/ the check-tripleo pipeline only ran the containers job | 11:23 |
*** jprovazn has joined #tripleo | 11:27 | |
*** ccamacho is now known as ccamacho|lunch | 11:30 | |
*** zoliXXL is now known as zoli|lunch | 11:37 | |
*** zoli|lunch is now known as zoli_gone-proxy | 11:38 | |
*** rook-lappy has joined #tripleo | 11:39 | |
rook-lappy | shardy ping - hopefully the last for a while :) | 11:40 |
shardy | rook-lappy: Hi! | 11:41 |
rook-lappy | so, trying to use your blog post to debug this : https://gist.github.com/jtaleric/cbc58f0ead159b9c7aa692b2dd89149e | 11:41 |
*** panda has quit IRC | 11:41 | |
rook-lappy | however shardy there is no resource id associated. | 11:42 |
shardy | rook-lappy: Did you manage to resolve your timeout issue btw? I tried a few ways and could quite replicate what you were seeing. | 11:42 |
shardy | coudn't quite replicate | 11:42 |
rook-lappy | shardy yeah, i plan to NOTABUG that bug | 11:42 |
*** panda has joined #tripleo | 11:42 | |
rook-lappy | shardy not sure why, but i had to restart openstack-heat* | 11:42 |
rook-lappy | to get the client to accept the --timeout (not sure how that is even related) | 11:43 |
rook-lappy | not sure if something could get cached? | 11:43 |
shardy | rook-lappy: Hmm, that is strange - it should just respect the value in the request, and I thought we saw the client passing the wrong value | 11:44 |
shardy | rook-lappy: Oh well, glad you got it working | 11:44 |
rook-lappy | shardy: yeah, we did see it still get the 240 -- however now when i pass --timeout i see the value set correctly | 11:44 |
rook-lappy | shardy so we are still failing, but IMHO are close. | 11:45 |
rook-lappy | I am not sure why we are seeing the failure, seems to be this : ComputeArtifactsDeploy | 11:45 |
rook-lappy | which hits the 400M timeout | 11:45 |
shardy | rook-lappy: strange, it's not showing the actual resource that failed, both of those are nested stacks | 11:45 |
shardy | can you do heat resource-list 3ffeec84-3a25-46b8-b219-4f2bfce141fe ? | 11:46 |
*** jpena is now known as jpena|lunch | 11:46 | |
shardy | (and likewise for the other failure) | 11:46 |
shardy | and also heat stack-show on each | 11:46 |
shardy | is it possible you just hit the timeout and heat killed the update on those stacks? | 11:46 |
rook-lappy | pdated the gist with the first | 11:47 |
shardy | (stack-show should tell us) | 11:47 |
rook-lappy | oh my | 11:47 |
rook-lappy | heat stack-show.... not sure i will be able to pastebin that | 11:47 |
shardy | rook-lappy: Just grep out the stack_status_reason | 11:47 |
rook-lappy | Timed Out | 11:48 |
rook-lappy | for the 1f3 | 11:48 |
rook-lappy | 1fe* | 11:49 |
rook-lappy | hm, the other mentions : | 11:49 |
rook-lappy | [stack@r710-undercloud ~]$ heat stack-show 189eb75d-ef4e-4efb-89d1-2c3fa94e55f7 | grep stack_status_reason | stack_status_reason | Stack UPDATE completed successfully | | 11:49 |
shardy | 189eb75d-ef4e-4efb-89d1-2c3fa94e55f7 is the one we're interested in I think | 11:49 |
rook-lappy | well that one shows all is well | 11:50 |
rook-lappy | even on the resource-list | 11:50 |
shardy | But the status_reason shows the update was cancelled due to hitting the timeout? | 11:50 |
rook-lappy | update & create compute for all... | 11:50 |
rook-lappy | the status_reason for 1fe was timed out | 11:51 |
rook-lappy | the status_reason for 5f7 was update complete | 11:51 |
shardy | Ok, another approach is heat resource-show 3ffeec84-3a25-46b8-b219-4f2bfce141fe ComputeArtifactsDeploy | 11:52 |
shardy | Thats the ComputeNodesPostDeployment stack, which contains the ComputeArtifactsDeploy resource | 11:53 |
shardy | If that reason doesn't give enough info we may have to look at the heat-engine log to see why the ComputeArtifactsDeploy resource failed when the underlying stack didn't | 11:54 |
rook-lappy | shardy ok updated gist, i dont really get why -- update aborted? | 11:55 |
rook-lappy | my guess is it hit the 400M timeout | 11:55 |
rook-lappy | so it just gave up | 11:55 |
* rook-lappy wants to know why it just was spinning its wheels on a resource | 11:55 | |
shardy | Yeah, the question is did it get stuck there, or was it just the unlucky victim at the time the timeout happened | 11:56 |
shardy | heat event-list 3ffeec84-3a25-46b8-b219-4f2bfce141fe may show that | 11:56 |
*** MaxPC has joined #tripleo | 11:56 | |
shardy | rook-lappy: yeah update aborted means it hit the timeout | 11:56 |
*** thrash|g0ne is now known as thrash | 11:57 | |
rook-lappy | yeah, i see the same thing in the event-list | 11:57 |
rook-lappy | shardy: I can try bumping the timeout... however, my guess is we will see the same issue | 11:57 |
rook-lappy | i think the deployment is just spinning its wheels on something | 11:57 |
rook-lappy | shardy: updated the gist with the two failures seen in the eventlist | 11:58 |
shardy | rook-lappy: did you tee the openstack overcloud deploy cmd output? | 11:58 |
shardy | you should see from the events there where it got stuck | 11:58 |
rook-lappy | yeah shardy it timed out | 11:59 |
rook-lappy | this is what is mentioned where things timed out : overcloud-ComputeNodesPostDeployment-ws3b7l4bgvh5 | 11:59 |
rook-lappy | FYI going to depth 5, at this size of stack takes ~ 11 minutes to return :-O | 11:59 |
rook-lappy | heat resource-list -n5 overcloud | 12:00 |
shardy | rook-lappy: Yeah, we discussed that in the heat performance improvements session | 12:00 |
shardy | the implementation isn't well optimized for huge stacks atm - we're planning to fix it (soon hopefully) | 12:00 |
shardy | basically we need a smart DB query instead of a bunch of recursion :( | 12:00 |
rook-lappy | shardy++ | 12:00 |
rook-lappy | i have a guy looking at the DB of heat right now. | 12:01 |
shardy | rook-lappy: awesome, well, patches welcome ;) | 12:01 |
shardy | it is a known issue tho, as well as recursive event-list (which is actually worse) | 12:01 |
rook-lappy | shardy so, do we think if i bump the timeout i _might_ have success? | 12:02 |
rook-lappy | shardy the partner is getting awfully antsy | 12:02 |
rook-lappy | shardy we are so close i might just manually fix the 20 last compute nodes. | 12:02 |
rook-lappy | they are deployed and up -- it is just to get the puppet stuff to complete across all 300 compute nodes (and 3 controllers) | 12:03 |
shardy | rook-lappy: sure, I can appreciate it's frustrating | 12:03 |
*** rasca has quit IRC | 12:03 | |
rook-lappy | shardy lol | 12:03 |
shardy | from a bug-fix perspective, ideally we need a bit more info about exactly why it's getting stuck (before anything gets killed by the timeout) | 12:03 |
shardy | e.g checking on the node why overcloud-ComputeNodesPostDeployment-ws3b7l4bgvh5 gets stuck | 12:03 |
*** rasca has joined #tripleo | 12:04 | |
shardy | assuming it is ComputeArtifactsDeploy, are you deploying any artefacts via swift? | 12:04 |
rook-lappy | shardy unless a base deployment does, no. | 12:05 |
shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/deploy-artifacts.yaml | 12:05 |
rook-lappy | shardy: updated the gust with the last couple of messages about the PostDeployment-ws* | 12:05 |
shardy | so in that case, it should just run a script over an empty list, which is a round-trip from node->heat, but should be pretty fast modulo a bug | 12:06 |
slagle | rook-lappy: this sounds like the same thing when i looked into it the other day | 12:06 |
slagle | orc was never triggered on the node | 12:06 |
shardy | rook-lappy: I'd probably run it until it gets stuck, then ps ax on the nodes and see if that script (deploy-artefacts.sh) is actually running | 12:06 |
shardy | aha | 12:07 |
rook-lappy | slage very similar. | 12:07 |
rook-lappy | slage however this go, when the stack failed there was no resource id | 12:07 |
rook-lappy | slage so I cannot pin-point to a node that orc didn't run. | 12:07 |
*** rhallisey has joined #tripleo | 12:07 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: setuptools >= 11.3 is required for ansible on RHEL 7 https://review.openstack.org/313524 | 12:08 |
*** lblanchard has joined #tripleo | 12:10 | |
*** lucasagomes is now known as lucas-hungry | 12:11 | |
*** dprince has joined #tripleo | 12:11 | |
*** trown|outtypewww is now known as trown | 12:17 | |
*** fultonj has joined #tripleo | 12:19 | |
openstackgerrit | Marios Andreou proposed openstack/puppet-tripleo: Adds the puppet-tripleo manifests for manila https://review.openstack.org/313527 | 12:23 |
*** jayg|g0n3 is now known as jayg | 12:25 | |
*** morazi has joined #tripleo | 12:27 | |
*** saneax is now known as saneax_AFK | 12:28 | |
*** rodrigods has quit IRC | 12:29 | |
*** rodrigods has joined #tripleo | 12:29 | |
marios | shardy: hey, not sure if you'd seen/noticed in the review deluge, there was an update/rebase for the manila patch. I think composable roles is going to be a good way to get that landed finally... i commented at https://review.openstack.org/#/c/188137/59 (link to first pass at doing the puppet-tripleo side for it for now) | 12:31 |
*** nico_auv has joined #tripleo | 12:33 | |
shardy | marios: thanks, will check it out | 12:44 |
*** Goneri has joined #tripleo | 12:44 | |
*** ayoung has quit IRC | 12:48 | |
openstackgerrit | Marios Andreou proposed openstack/puppet-tripleo: Adds the puppet-tripleo manifests for manila https://review.openstack.org/313527 | 12:49 |
*** athomas has quit IRC | 12:49 | |
*** zoli_gone-proxy is now known as zoliXXL | 12:49 | |
*** hrybacki|gone is now known as hrybacki | 12:51 | |
*** ccamacho|lunch is now known as ccamacho | 12:52 | |
*** BassT has joined #tripleo | 12:52 | |
*** rook-lappy has quit IRC | 12:53 | |
*** akshai has joined #tripleo | 12:53 | |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Initial Integration of Mistral into TripleO https://review.openstack.org/282366 | 12:54 |
openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-quickstart: allow for individual ansible parameters to be overriden outside of a config file https://review.openstack.org/313155 | 12:59 |
*** ifarkas has quit IRC | 13:01 | |
*** rookie has joined #tripleo | 13:03 | |
*** athomas has joined #tripleo | 13:04 | |
*** trozet has quit IRC | 13:09 | |
openstackgerrit | Jiri Stransky proposed openstack/puppet-tripleo: Add a service manifest https://review.openstack.org/313543 | 13:12 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates: Write service manifest on the controllers https://review.openstack.org/313544 | 13:12 |
*** jpena|lunch is now known as jpena | 13:12 | |
jistr | jaosorior: service manifest patches ^^ | 13:12 |
jaosorior | jistr: awesome! Added myself as reviewer | 13:13 |
jistr | cool, thanks | 13:13 |
openstackgerrit | Merged openstack/puppet-tripleo: add metadata.json file https://review.openstack.org/313068 | 13:13 |
*** tzumainn has joined #tripleo | 13:14 | |
*** zoliXXL is now known as zoli|brb | 13:14 | |
EmilienM | jistr: https://review.openstack.org/#/c/313543/ what is the use case? | 13:15 |
EmilienM | upgrades? | 13:15 |
*** BassT has left #tripleo | 13:16 | |
jistr | EmilienM: yes, and also things that need to know what's deployed but are executed outside of config management (outside of stack-update). An example of that is certmonger renewing certificates. After the renewal it's supposed to trigger service reload, but for that it needs to know what's deployed. | 13:17 |
EmilienM | jistr: when we did spinalstack, we wrote a tool, that was able to query a puppet catalog to list all services / packages running on a node (or any resource) | 13:18 |
EmilienM | let me find the code, maybe it can inspire you | 13:18 |
*** lucas-hungry is now known as lucasagomes | 13:18 | |
EmilienM | michchap_ initiated the tool btw | 13:18 |
hrybacki | matbu: ping | 13:18 |
EmilienM | jistr: https://github.com/michaeltchapman/puppet-partial | 13:18 |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui: Remove module cache files from git https://review.openstack.org/313546 | 13:19 |
EmilienM | jistr: https://github.com/michaeltchapman/puppet-partial/blob/master/lib/puppet/face/partial.rb#L108 | 13:19 |
EmilienM | so basically, we ran "puppet partial --tag service" and it returned a list of services that are in the catalog. | 13:19 |
rook | shardy: is there a way I an query the DB to get the heat resource-list -n5 overcloud? | 13:20 |
rook | related question, if I run heat event-list overcloud, should it show old entries or the current event list? | 13:23 |
jistr | EmilienM: yeah that would be a way and it's nicely simple, but with this approach it would return probably quite different things in case the service is managed by pacemaker. So it would provide a much more "raw" output, and we might have to put more logic into the other parts (upgrades, certmonger hooks) to process such raw output as we need. Also i recall someone mentioning that IPv6 might have its own role too, so perhaps we can use such | 13:24 |
jistr | tool for determining "is this node in an IPv6 deployment" etc. | 13:24 |
*** pcaruana has quit IRC | 13:25 | |
EmilienM | jistr: cool no prob, I'm just showing you what we used to solve this issue | 13:25 |
jistr | The main difference is probably in what we want to use as the source of data. Either the roles themselves, or puppet. Puppet way means things happen more automatically, role way means we're able to tailor the information that we want to put into the manifest. | 13:25 |
marios | jistr: (driveby you may have already mentinoed) the other use case was for managing services on a node - when we move to pacemaker light and no longer have the cluster to bring all the things down/up for example | 13:26 |
shardy | rook: I'm sure there is, but I don't have the required query handy (or I'd probably have wired it into heat ;) | 13:26 |
jistr | marios: yeah could be too | 13:26 |
shardy | rook: re events, yes by default we list all events, but you can pass a marker if you only want new ones | 13:26 |
*** jcoufal has joined #tripleo | 13:26 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Deploy RabbitMQ as a composable role https://review.openstack.org/311863 | 13:27 |
jistr | EmilienM: the link is very helpful, thanks. Makes me realize we might want to rename the manifest file to capture that it doesn't have to capture just services. The patch is in a very early phase currently, it may need to be tweaked in order to make it as useful as possible. | 13:28 |
EmilienM | jistr: do you have a demo / spec or something I can see to understand the use case? some code even...? | 13:30 |
shardy | derekh: Hey did we change something recently so we don't show e.g stack-show and resource-list in postci on failure? | 13:30 |
shardy | e.g http://logs.openstack.org/63/311863/10/check-tripleo/gate-tripleo-ci-f22-nonha/66f8929/console.html | 13:31 |
derekh | shardy: ya, its in postci.log | 13:31 |
shardy | Ah, it's just moved then | 13:31 |
shardy | *and* there's even a message saying so - duh :) | 13:31 |
jistr | EmilienM: not anything that's using it yet, but here's how the values are fed from t-h-t https://review.openstack.org/#/c/313544/ | 13:32 |
derekh | shardy: my fault, I piped all of the output from the postci function into that log file, so that people would see the error closer to the end of the main log, without have to scroll way up | 13:32 |
shardy | EmilienM: http://logs.openstack.org/63/311863/10/check-tripleo/gate-tripleo-ci-f22-nonha/66f8929/logs/postci.txt.gz shows the same error | 13:32 |
jistr | EmilienM: and here's a spec for how the manifest can look on the inside, lines 18-34 https://review.openstack.org/#/c/313543/1/spec/unit/provider/service_manifest/flat_file_spec.rb | 13:33 |
shardy | derekh: no worries, I just missed the "See postci.txt ..." | 13:33 |
derekh | sambetts: ack | 13:33 |
derekh | shardy: ack, sambetts sorry | 13:33 |
*** trozet has joined #tripleo | 13:35 | |
EmilienM | shardy: yes, this is where I saw the issue | 13:36 |
EmilienM | but indeed, it would be cool to see which params is failing | 13:36 |
EmilienM | jistr: it looks cool | 13:36 |
shardy | EmilienM: yup, I'll raise a heat bug for that | 13:37 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Explicit Teardown and accessories changes https://review.openstack.org/313127 | 13:38 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Move image cache dir to a different location https://review.openstack.org/313553 | 13:42 |
*** ifarkas has joined #tripleo | 13:43 | |
*** absubram has joined #tripleo | 13:46 | |
*** absubram_ has joined #tripleo | 13:47 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Fixes for inventory file creation https://review.openstack.org/313557 | 13:47 |
panda | larsks: splitted, going to put workflow -1 on everything for now. | 13:49 |
*** trown is now known as trown|outtypewww | 13:50 | |
*** absubram has quit IRC | 13:50 | |
*** absubram_ is now known as absubram | 13:50 | |
matbu | hrybacki: pong sorry , i didn't have an eyes on freenode | 13:53 |
*** Guest14219 has quit IRC | 13:54 | |
shardy | dtantsur: Hey, thanks for you feedback on the mistral workflow - is there any way I can validate the DHCP configuration resulting from the neutron port vif_port association? | 13:55 |
dtantsur | shardy, not something I can think of. it's done in run time during deployment | 13:55 |
shardy | I'm clearly missing something as the node boots but doesn't get a lease | 13:55 |
shardy | dtantsur: Ok, I'll dig further, thanks | 13:56 |
dtantsur | shardy, of course you can watch neutron port details during the deployment | 13:57 |
dtantsur | maybe it's not created correctly or something like that | 13:57 |
*** akshai has quit IRC | 13:57 | |
*** jkraj has joined #tripleo | 13:58 | |
hrybacki | matbu: no worries it was just the tempest stuff that i shot you internally as well | 13:59 |
*** akshai has joined #tripleo | 13:59 | |
*** jtomasek has joined #tripleo | 13:59 | |
shardy | dtantsur: http://paste.openstack.org/show/496334/ is what it looks like | 13:59 |
*** zoli|brb is now known as zoli | 14:00 | |
dtantsur | status DOWN, I wonder why... | 14:00 |
*** Goneri has quit IRC | 14:01 | |
dtantsur | shardy, would be cool to ask neutron folks if status DOWN is actually the cause and how to make it up | 14:01 |
pabelanger | derekh: left some comments on the review | 14:02 |
*** social has quit IRC | 14:04 | |
*** egafford has joined #tripleo | 14:07 | |
*** ayoung has joined #tripleo | 14:07 | |
*** ramishra has quit IRC | 14:07 | |
*** ramishra has joined #tripleo | 14:07 | |
derekh | pabelanger: looking | 14:08 |
*** mgould has quit IRC | 14:08 | |
*** coolsvap has quit IRC | 14:09 | |
openstackgerrit | Merged openstack/tripleo-docs: Document accessing stored introspection ramdisk logs https://review.openstack.org/312979 | 14:10 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Document IPv6 syntax for GlanceFilePcmkDevice https://review.openstack.org/304298 | 14:10 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Fix controller-no-external.yaml in bonded configs. https://review.openstack.org/309662 | 14:11 |
*** mgould has joined #tripleo | 14:11 | |
*** jkraj has quit IRC | 14:11 | |
*** ppradhan has joined #tripleo | 14:12 | |
*** florianf has quit IRC | 14:14 | |
*** pabelanger has quit IRC | 14:14 | |
*** pabelanger has joined #tripleo | 14:14 | |
*** Goneri has joined #tripleo | 14:14 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Add Emilien Macchi blog to TripleO blogs feed https://review.openstack.org/313566 | 14:15 |
beagles | shardy: you mentioned permissions for bug cleanup earlier this week. I started going through some yesterday, setting incomplete and invalid, but some were clearly closable or "wish list" items. Could I get perms so I can set the bzs to these statuses as appropriate | 14:16 |
beagles | (or whatever the plural of status properly is ;)) | 14:16 |
-openstackstatus- NOTICE: Zuul is currently recovering from a large number of changes, it will take a few hours until your job is processed. Please have patience and enjoy a great weekend! | 14:17 | |
*** links has quit IRC | 14:17 | |
beagles | I would've started sooner but this cold I had over summit is being a pain - I hope I didn't infect too many people! | 14:17 |
derekh | pabelanger: replied | 14:18 |
pabelanger | derekh: ack | 14:18 |
*** masco has quit IRC | 14:21 | |
*** florianf has joined #tripleo | 14:23 | |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: WIP: Add gating repo injecting for undercloud https://review.openstack.org/313570 | 14:25 |
*** ccamacho has quit IRC | 14:25 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Increase timeout and logging for crm_resource https://review.openstack.org/313011 | 14:27 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Use megabytes for overcloud image size https://review.openstack.org/312594 | 14:27 |
weshay | adarazs, this should be an external role right? https://review.openstack.org/#/c/313570/ | 14:28 |
*** ccamacho has joined #tripleo | 14:29 | |
*** nico_auv has quit IRC | 14:29 | |
adarazs | weshay: no. it relies on the ansible-role-tripleo-gate role. it consumes the gating repo that was created by that role. | 14:29 |
weshay | adarazs, ah ok, I see thanks | 14:29 |
adarazs | weshay: but we need quickstart to inject the gating changes in the undercloud. if we want to do it before we even boot up the image. | 14:30 |
adarazs | weshay: the magic still happens here: https://review.gerrithub.io/#/c/274535/5/tasks/main.yml :) | 14:30 |
openstackgerrit | Joe Talerico proposed openstack/tripleo-quickstart: Teardown network fix https://review.openstack.org/313575 | 14:31 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: composable heat services https://review.openstack.org/313577 | 14:37 |
openstackgerrit | Merged openstack/tripleo-docs: Document ready-state configuration https://review.openstack.org/299481 | 14:37 |
*** dprince has quit IRC | 14:37 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Disable VIPs before stopping cluster during version upgrade https://review.openstack.org/312454 | 14:37 |
ansiwen | shardy: if I remember correctly you said you let heat run in devstack, right? | 14:38 |
rook | shardy so, since I cannot look at the resource list to determine if things are hung up, what is another way to do that? | 14:38 |
rook | i bumped the timeout to 450 | 14:38 |
rook | however, i am doubting that will help | 14:39 |
*** absubram has quit IRC | 14:41 | |
*** jprovazn has quit IRC | 14:42 | |
openstackgerrit | Merged openstack/tripleo-quickstart: allow for individual ansible parameters to be overriden outside of a config file https://review.openstack.org/313155 | 14:43 |
*** paramite has quit IRC | 14:44 | |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Add gating repo injecting for undercloud https://review.openstack.org/313570 | 14:44 |
-openstackstatus- NOTICE: Zuul has been restarted. As a results, we only preserved patches in the gate queue. Be sure to recheck your patches in gerrit if needed. | 14:47 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: move most things out from the playbooks dir, and use config for release info https://review.openstack.org/313116 | 14:51 |
hrybacki | weshay: did I answer your question clearly regarding the setup.cfg stuff for https://review.gerrithub.io/#/c/273711/5 ? | 14:54 |
weshay | hrybacki, ya.. | 14:55 |
openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Deploy and Upgrade Ironic to run in mod_wsgi https://review.openstack.org/309140 | 14:55 |
hrybacki | cool, I think it's ready to merge in that case | 14:55 |
jaosorior | Any reviews on this would be appreciated https://review.openstack.org/#/c/244162/ :D | 14:56 |
weshay | hrybacki, did you see the gate failure? | 14:56 |
shardy | ansiwen: I do run heat in devstack, but not for TripleO | 14:56 |
hrybacki | weshay: /me looks | 14:56 |
ansiwen | shardy: yes, that's what I mean. I wanted to look into heat, before I have my 64GB machine | 14:56 |
hrybacki | weshay: yes, that was because the gate wasn't prepared to use it though | 14:57 |
hrybacki | per apetrich | 14:57 |
shardy | ansiwen: Ah - yeah we discussed it, sorry didn't recognize your IRC nick :) | 14:57 |
hrybacki | I saw a job using it this morning (closed link) and it ran succesffully | 14:57 |
hrybacki | and I've verified it locally a few times | 14:57 |
ansiwen | shardy: oh, yes, sorry, ansiwen = Sven Anderson @ Red Hat | 14:57 |
shardy | http://docs.openstack.org/developer/heat/getting_started/on_devstack.html | 14:57 |
weshay | hrybacki, is the gate ready now? | 14:57 |
shardy | ansiwen: that should get you started, here's my localrc: | 14:58 |
hrybacki | weshay: not sure @apetrich ^^ | 14:58 |
hrybacki | I believe we merged the last thing needing it last night | 14:58 |
shardy | http://paste.fedoraproject.org/363402/46755146 | 14:59 |
hrybacki | weshay: we got it running on apetrich's POC gate (disabled now) https://ci.centos.org/job/poc-apetrich_CAT-gate/94/console | 14:59 |
shardy | ansiwen: that's my devstack local.conf - note that one uses nova network, not neutron | 14:59 |
shardy | the other option to experiment with heat is to install a package based environment with packstack: | 14:59 |
shardy | https://www.rdoproject.org/install/quickstart/ | 15:00 |
shardy | rook: assuming the events logged don't show where it's getting stuck, I'd probably ssh onto one of the boxes and ps ax to see if there's a heat hook running | 15:01 |
*** akshai has quit IRC | 15:01 | |
shardy | e.g ps ax |grep -e deploy-art -e puppet | 15:01 |
*** jaosorior has quit IRC | 15:02 | |
shardy | rook: it's fair to say we need a better way to monitor in-progress deployments | 15:02 |
shardy | that was also discussed in the heat sessions last week | 15:02 |
rook | it will always will be better | 15:02 |
ansiwen | shardy: awesome, thanks! | 15:04 |
*** Guest42930 has quit IRC | 15:05 | |
openstackgerrit | imain proposed openstack/tripleo-heat-templates: Use docker-cmd hook. https://review.openstack.org/313158 | 15:06 |
*** david-lyle has joined #tripleo | 15:06 | |
rook | hm, shardy running that across all my nodes i get nothing ( i just grep for puppet) | 15:09 |
*** dtrainor has quit IRC | 15:10 | |
*** rbrady has quit IRC | 15:11 | |
rook | maybe things aren't that far along yet. | 15:11 |
*** r-mibu has quit IRC | 15:13 | |
*** r-mibu has joined #tripleo | 15:13 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Pass MysqlVirtualIP via EndpointMap https://review.openstack.org/305751 | 15:20 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Deploy RabbitMQ as a composable role https://review.openstack.org/311863 | 15:22 |
*** tremble has quit IRC | 15:22 | |
hrybacki | weshay: gate looks like it should be setup correctly. There were some scripts that apetrich had disabled at the end of the job from running on his POC -- will do a test job and verify | 15:23 |
*** rbrady has joined #tripleo | 15:24 | |
*** akshai has joined #tripleo | 15:25 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Move image cache dir to a different location https://review.openstack.org/313553 | 15:32 |
*** dmk0202 has quit IRC | 15:33 | |
*** jtomasek has quit IRC | 15:33 | |
*** dmk0202 has joined #tripleo | 15:34 | |
weshay | hrybacki, if you think the gate is ready just rekick the job | 15:35 |
*** dtantsur is now known as dtantsur|afk | 15:35 | |
openstackgerrit | Ethan Gafford proposed openstack/puppet-tripleo: Add non-pcmk Trove API/Conductor/Taskmanager profiles https://review.openstack.org/310795 | 15:35 |
hrybacki | weshay: did, it's running now. Should be collecting logs for all jobs now | 15:35 |
*** absubram has joined #tripleo | 15:36 | |
matbu | hrybacki: weshay are we ok to submit this one https://review.gerrithub.io/#/c/275660/1 | 15:38 |
matbu | hrybacki: weshay it will avoid some failures with the validate role | 15:38 |
hrybacki | matbu: +1 from me | 15:38 |
*** jcoufal has quit IRC | 15:38 | |
hrybacki | matbu: meant to +1 that earlier, sorry | 15:38 |
*** mikelk has quit IRC | 15:38 | |
matbu | ok no pb :) | 15:39 |
*** dmk0202 has quit IRC | 15:39 | |
*** fragatina has joined #tripleo | 15:41 | |
*** panda has quit IRC | 15:42 | |
matbu | hrybacki: for the other one (regarding fedora) i -1 for now, because the sleep should biggest than 30 sec | 15:42 |
matbu | hrybacki: but i have to go now, i'll change it a bit later | 15:42 |
*** panda has joined #tripleo | 15:42 | |
hrybacki | matbu: +1 | 15:42 |
*** jcoufal has joined #tripleo | 15:44 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Move image cache dir to a different location https://review.openstack.org/313553 | 15:48 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: WIP: integrate PCS provider in the merge. https://review.openstack.org/310713 | 15:49 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Explicit Teardown and accessories changes https://review.openstack.org/313127 | 15:53 |
*** zoli is now known as zoli|mtg | 15:53 | |
*** cwolferh has joined #tripleo | 15:56 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: WIP: integrate PCS provider in the merge. https://review.openstack.org/310713 | 15:56 |
*** aufi has quit IRC | 15:57 | |
panda | larsks: not sure I understand this comment https://review.openstack.org/#/c/313127/3/playbooks/roles/libvirt/setup/undercloud/tasks/fetch_image.yml@a12 you want the task to check if the dir does not exist, and create it if it's in a path that can be created by the user ? | 16:00 |
*** derekh has quit IRC | 16:06 | |
openstackgerrit | Merged openstack/tripleo-quickstart: setuptools >= 11.3 is required for ansible on RHEL 7 https://review.openstack.org/313524 | 16:08 |
*** stendulker has joined #tripleo | 16:11 | |
*** florianf has quit IRC | 16:11 | |
openstackgerrit | Martin André proposed openstack/tripleo-common: Validations actions and workbook https://review.openstack.org/313632 | 16:15 |
*** florianf has joined #tripleo | 16:15 | |
*** florianf has quit IRC | 16:16 | |
mandre | rbrady: ^ | 16:20 |
rbrady | mandre: thanks, will take a look | 16:21 |
*** dprince has joined #tripleo | 16:25 | |
mandre | rbrady: it should be working fine, I tested earlier | 16:26 |
mandre | probably I should have extracted the ansible dynamic inventory script in its own commit | 16:26 |
mandre | bah.. I'll see what the reviewers say | 16:26 |
*** hjensas has quit IRC | 16:28 | |
*** zoli|mtg has quit IRC | 16:28 | |
*** jidar has quit IRC | 16:29 | |
*** stevebaker has quit IRC | 16:29 | |
openstackgerrit | Ethan Gafford proposed openstack/puppet-tripleo: Add non pcmk Sahara API/Engine profiles https://review.openstack.org/313634 | 16:30 |
*** devvesa has quit IRC | 16:30 | |
*** zoliXXL has joined #tripleo | 16:33 | |
*** stevebaker has joined #tripleo | 16:33 | |
*** pblaho has quit IRC | 16:35 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Deploy Loadbalancer as a composable role https://review.openstack.org/313029 | 16:38 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-common: Adds a simple 'overcloud_shell' mistral worfklow https://review.openstack.org/313084 | 16:38 |
openstackgerrit | Martin André proposed openstack/tripleo-common: Validations actions and workbook https://review.openstack.org/313632 | 16:39 |
*** jidar has joined #tripleo | 16:39 | |
*** dmk0202 has joined #tripleo | 16:40 | |
*** mgould has quit IRC | 16:40 | |
*** zoliXXL is now known as zoli|gone | 16:42 | |
*** tosky has quit IRC | 16:43 | |
zoli|gone | have a good weekend | 16:44 |
*** zoli|gone is now known as zoli_gone-proxy | 16:45 | |
*** tosky has joined #tripleo | 16:45 | |
*** athomas has quit IRC | 16:45 | |
*** electrofelix has quit IRC | 16:50 | |
*** dmk0202 has quit IRC | 16:55 | |
*** dmk0202 has joined #tripleo | 16:57 | |
*** shivrao has joined #tripleo | 16:59 | |
*** dmk0202 has quit IRC | 17:01 | |
*** shardy has quit IRC | 17:02 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: add the option to specify an alternative requirements file https://review.openstack.org/313646 | 17:05 |
*** dtrainor has joined #tripleo | 17:07 | |
*** jistr has quit IRC | 17:07 | |
*** yamahata has joined #tripleo | 17:12 | |
*** stendulker_ has joined #tripleo | 17:12 | |
openstackgerrit | Ben Swartzlander proposed openstack/tripleo-heat-templates: Enable Manila integration https://review.openstack.org/188137 | 17:13 |
openstackgerrit | Ben Swartzlander proposed openstack/tripleo-heat-templates: Enable Manila integration https://review.openstack.org/188137 | 17:13 |
openstackgerrit | Ben Swartzlander proposed openstack/tripleo-heat-templates: Add integration with NetApp Manila driver https://review.openstack.org/188138 | 17:13 |
*** jpena is now known as jpena|off | 17:14 | |
*** stendulker has quit IRC | 17:15 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Calculate deployment times for the Heat resources https://review.openstack.org/313097 | 17:17 |
*** weshay has quit IRC | 17:18 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Composable role for RabbitMQ https://review.openstack.org/311849 | 17:21 |
*** jtomasek has joined #tripleo | 17:21 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Deploy RabbitMQ as a composable role https://review.openstack.org/311863 | 17:22 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Deploy Loadbalancer as a composable role https://review.openstack.org/313029 | 17:22 |
*** fragatina has quit IRC | 17:26 | |
*** fragatina has joined #tripleo | 17:26 | |
openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 17:28 |
openstackgerrit | James Slagle proposed openstack/instack-undercloud: Move parts of undercloud-install to puppet https://review.openstack.org/312931 | 17:33 |
openstackgerrit | James Slagle proposed openstack/instack-undercloud: Use tripleo::selinux https://review.openstack.org/310565 | 17:33 |
openstackgerrit | James Slagle proposed openstack/instack-undercloud: Move persistent journal to puppet https://review.openstack.org/310564 | 17:33 |
openstackgerrit | James Slagle proposed openstack/instack-undercloud: Don't use ironic-conductor element https://review.openstack.org/312932 | 17:33 |
openstackgerrit | James Slagle proposed openstack/instack-undercloud: Don't use os-cloud-config/common-venv elements https://review.openstack.org/308550 | 17:33 |
openstackgerrit | James Slagle proposed openstack/instack-undercloud: Create firewall rules with puppet https://review.openstack.org/308374 | 17:33 |
*** fragatina has quit IRC | 17:34 | |
openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Remove manage_service and enabled from TripleO implementation https://review.openstack.org/313649 | 17:39 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Ensure manage_service and enabled are false for Pacemaker https://review.openstack.org/313650 | 17:40 |
*** pkovar has quit IRC | 17:42 | |
*** gfidente has quit IRC | 17:44 | |
*** coolsvap has joined #tripleo | 17:46 | |
larsks | panda: right; I want to keep that check there for situations where those roles are run without first running the environment role. Depending on the local situation, we may still be able to create the image_cache_dir as an unprivileged user, depending on where it is located. If it already exists (e.g., it was created by the environment role), this check is a no-op. So it's not a problem in either case. | 17:51 |
*** sambetts is now known as sambetts|afk | 17:53 | |
*** fragatina has joined #tripleo | 17:55 | |
*** stendulker_ has quit IRC | 17:55 | |
panda | larsks: well, there are other problems to that (variables like non_root_user and non_root_group are not included anywhere in that playbook, and I had to pass them as facts), but I'll see if I can add a conditional task on that spot | 17:55 |
*** fragatin_ has joined #tripleo | 17:55 | |
larsks | I think it can just stand as it is. | 17:56 |
*** ohamada has quit IRC | 17:56 | |
larsks | It doesn't need conditionals. | 17:56 |
larsks | It shouldn't be trying to set ownership or group. | 17:56 |
larsks | panda: ^^^ | 17:56 |
larsks | panda: That is, just leave it there, like it right now. | 17:57 |
*** fragatina has quit IRC | 17:59 | |
*** weshay has joined #tripleo | 18:02 | |
openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: tests/elements/fake-os: add '/tmp' as top level dir https://review.openstack.org/313660 | 18:04 |
*** lucasagomes is now known as lucas-afk | 18:07 | |
*** tosky has quit IRC | 18:08 | |
larsks | weshay: in what situations do we need an alternative requirements file for the quickstart? | 18:12 |
weshay | larsks, for running downstream.. one would need to add | 18:13 |
weshay | git+https://code.engineering.redhat.com/gerrit/p/tripleo-environments.git/#egg=tripleo-environments | 18:13 |
weshay | or for any of the following roles | 18:14 |
weshay | https://github.com/redhat-openstack/?utf8=%E2%9C%93&query=ansible-role-tripleo | 18:14 |
weshay | I think it makes setting up a downstream scenario and overriding roles in the quickstart itself fairly easy | 18:15 |
weshay | larsks, I would think we let the repos in redhat-openstack incubate until we get them upstream or if we do *need* to I'm not sure.. I think we probably want to.. these roles can be directly in the main requirements. Until then we may want keep a separate requirements file. Also the downstream role will obviously never be checked into quickstart | 18:19 |
larsks | Fair enough. Thanks! | 18:19 |
weshay | larsks, an alternative requirements file would look something like.. https://github.com/redhat-openstack/ci-ansible-tripleo/blob/master/requirements.txt | 18:20 |
weshay | np man | 18:20 |
*** coolsvap has quit IRC | 18:29 | |
*** rdopiera has quit IRC | 18:30 | |
*** rdopiera has joined #tripleo | 18:30 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Move image cache dir to a different location https://review.openstack.org/313553 | 18:33 |
panda | larsks: should be fixed not. | 18:37 |
panda | now* | 18:37 |
openstackgerrit | Martin André proposed openstack/tripleo-common: Validations actions and workbook https://review.openstack.org/313632 | 18:38 |
*** apetrich has quit IRC | 18:41 | |
*** eil397 has joined #tripleo | 18:46 | |
*** rdopiera has quit IRC | 18:47 | |
*** rdopiera has joined #tripleo | 18:47 | |
openstackgerrit | Ethan Gafford proposed openstack/puppet-tripleo: Add non pcmk Sahara API/Engine profiles https://review.openstack.org/313634 | 18:52 |
*** paramite has joined #tripleo | 18:55 | |
openstackgerrit | ayoung proposed openstack/tripleo-quickstart: Check that cached file is symlink https://review.openstack.org/313671 | 18:59 |
leifmadsen | weshay: testing out tripleo-quickstart :) | 19:06 |
*** ifarkas has quit IRC | 19:08 | |
rook | leifmadsen++ | 19:16 |
leifmadsen | rook: plan is to get that going, then setup browbeat, run a deploy and get stats on heat, then try out heat convergence and see if there is any memory improvement | 19:17 |
*** apetrich has joined #tripleo | 19:19 | |
rook | leifmadsen: I am attempting the same thing ow. | 19:21 |
rook | now* | 19:21 |
rook | meow | 19:21 |
leifmadsen | rook: sweet, let me know when you finish it up for me | 19:21 |
* leifmadsen sits back and sips coffee while rook does all the work... again | 19:21 | |
rook | leifmadsen using cat right now. | 19:21 |
rook | which uses tripleo-qs | 19:21 |
leifmadsen | cat? | 19:23 |
leifmadsen | I wanna play with skydive too | 19:23 |
*** rcernin has joined #tripleo | 19:26 | |
thrash | Ok... got me on this one... Anybody seen this before? Resource CREATE failed: The Referenced Attribute (ControllerServiceChain config_settings) is incorrect. | 19:28 |
EmilienM | leifmadsen: if you want to play with skydive, you need to ping nplanel or safchain (on #openstack-neutron) | 19:33 |
leifmadsen | EmilienM: oh? | 19:34 |
*** absubram has quit IRC | 19:35 | |
EmilienM | leifmadsen: they are main devs | 19:35 |
*** panda has quit IRC | 19:42 | |
*** panda has joined #tripleo | 19:43 | |
slagle | thrash: we were getting that error on stack-update a while back | 19:43 |
slagle | thrash: it was fixed in a Heat patch | 19:43 |
*** dsneddon has quit IRC | 19:46 | |
thrash | slagle: hmm. I just updated my undercloud. I'm getting it on stack-create, with my composable heat role. I'm not seeing anything wrong with it... | 19:47 |
openstackgerrit | imain proposed openstack/tripleo-common: WIP: Replace docker compose hook with a straight docker one. https://review.openstack.org/312723 | 19:48 |
*** dsneddon has joined #tripleo | 19:49 | |
*** igorbelikov has quit IRC | 19:52 | |
*** igorbelikov has joined #tripleo | 19:54 | |
*** dprince has quit IRC | 19:59 | |
*** mkovacik_ has joined #tripleo | 20:05 | |
*** dmk0202 has joined #tripleo | 20:05 | |
*** mkovacik has quit IRC | 20:07 | |
*** mcornea has quit IRC | 20:11 | |
*** jayg is now known as jayg|g0n3 | 20:20 | |
EmilienM | slagle: we're going to do a first release of puppet-ceph, and create stable/hammer (it was latest LTS) and push new features in master (Jewel, current and next LTS) | 20:23 |
EmilienM | slagle: which means we're going to bring some non backward compatible changes in master | 20:23 |
EmilienM | which means we might break tripleo CI if we don't pin puppet-ceph, because AFIK we deploy Hammer in tripleo | 20:23 |
slagle | EmilienM: do we run tripleo-ci on puppet-ceph? | 20:24 |
EmilienM | yes of course | 20:25 |
EmilienM | I'll take care of the pin if I see Jewel breaks OOO CI | 20:25 |
EmilienM | slagle: I still need to find a tatoo | 20:26 |
slagle | yes you do :) | 20:32 |
*** openstackgerrit has quit IRC | 20:32 | |
*** openstackgerrit has joined #tripleo | 20:33 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Composable role for RabbitMQ https://review.openstack.org/311849 | 20:47 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Deploy RabbitMQ as a composable role https://review.openstack.org/311863 | 20:47 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Deploy Loadbalancer as a composable role https://review.openstack.org/313029 | 20:47 |
*** fragatin_ has quit IRC | 20:53 | |
*** dmk0202 has quit IRC | 20:58 | |
*** lblanchard has quit IRC | 21:09 | |
*** fultonj has quit IRC | 21:17 | |
*** ayoung has quit IRC | 21:20 | |
openstackgerrit | imain proposed openstack/tripleo-common: WIP: Create new docker command hook. https://review.openstack.org/312723 | 21:26 |
*** jcoufal has quit IRC | 21:35 | |
*** egafford has quit IRC | 21:35 | |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Initial Integration of Mistral into TripleO https://review.openstack.org/282366 | 21:39 |
*** fragatina has joined #tripleo | 21:42 | |
*** fragatin_ has joined #tripleo | 21:43 | |
*** rwsu has quit IRC | 21:43 | |
*** fragatina has quit IRC | 21:47 | |
*** penick has joined #tripleo | 21:47 | |
*** pradk has quit IRC | 21:52 | |
*** thrash is now known as thrash|wknd | 21:54 | |
*** ppradhan has left #tripleo | 21:58 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/313721 | 22:16 |
*** ayoung has joined #tripleo | 22:16 | |
*** rhallisey has quit IRC | 22:18 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-cloud-config: Updated from global requirements https://review.openstack.org/313748 | 22:21 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-refresh-config: Updated from global requirements https://review.openstack.org/303137 | 22:21 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/268528 | 22:22 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/313777 | 22:24 |
*** david-lyle has quit IRC | 22:35 | |
*** rbrady_ has joined #tripleo | 22:37 | |
*** david-lyle has joined #tripleo | 22:37 | |
*** rbrady has quit IRC | 22:37 | |
*** mkovacik__ has joined #tripleo | 22:42 | |
*** mkovacik_ has quit IRC | 22:45 | |
*** yamahata has quit IRC | 23:04 | |
*** saneax_AFK is now known as saneax | 23:15 | |
*** akshai has quit IRC | 23:35 | |
*** panda has quit IRC | 23:42 | |
*** panda has joined #tripleo | 23:42 | |
*** apetrich has quit IRC | 23:43 | |
*** MaxPC has quit IRC | 23:44 | |
*** absubram has joined #tripleo | 23:48 | |
*** absubram_ has joined #tripleo | 23:49 | |
*** absubram has quit IRC | 23:53 | |
*** absubram_ is now known as absubram | 23:53 | |
*** akshai has joined #tripleo | 23:57 | |
*** akshai_ has joined #tripleo | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!