Tuesday, 2014-01-28

lifelesswe should00:00
*** openstack has joined #tripleo00:02
-wolfe.freenode.net- [freenode-info] channel flooding and no channel staff around to help? Please check with freenode support: http://freenode.net/faq.shtml#gettinghelp00:02
greghaynesany reason we dont do the raw image boot in devtest for demo vm?00:03
lifelessEPARSE00:06
*** jcooley_ has quit IRC00:08
greghaynessry, in the devtest_overcloud.sh we dont use load-image where we boot the kernel/initrd for the demo vm, why not?00:08
*** jcooley_ has joined #tripleo00:09
*** CaptTofu has joined #tripleo00:12
*** jcooley_ has quit IRC00:16
SpamapSgreghaynes: normal VM images just boot from grub and the kernel inside them.00:21
SpamapSgreghaynes: so we can just upload the qcow2 to glance and boot it00:22
greghaynesok, so the alternative is the special case?00:22
SpamapSgreghaynes: right, baremetal images need partitions and stuff00:22
SpamapSand split out kernel/ramdisk00:23
greghaynesoh, right, these are emulating baremetal00:23
* greghaynes head->desk00:23
*** matsuhashi has joined #tripleo00:27
greghaynesSpamapS: Any idea what would be responsible for chmod'ing /etc/nova on nova compute node during stack-update?00:44
SpamapSgreghaynes: something in /opt/stack/os-config-refresh00:45
*** jcooley_ has joined #tripleo00:48
lifelessgreghaynes: it was chmodded so that user nova couldn't read it?00:50
lifelesstrolololol00:50
greghaynesA guess00:50
greghaynesalthough IMBW00:50
greghaynesthe perms dont match my undercloud node but looks like it still should be readable00:51
*** jcooley_ has quit IRC00:54
lifelessStevenK: around? Can I throw a couple of nova patches your way?00:59
StevenKlifeless: I am currently watching flash videos01:00
lifelessStevenK: onboarding stuff?01:00
StevenKYeah01:00
lifelessStevenK: well when you get depressed enough, I have code for you01:00
StevenKHahahaha01:00
greghaynesugh, I should do some of that01:00
lifelessyou'll go blind01:00
greghaynes:(01:00
StevenKgreghaynes: When did you start?01:06
greghayneslast tues01:06
greghaynes21st01:06
StevenKgreghaynes: My first day was the 6th01:07
StevenKgreghaynes: So, welcome :-)01:07
greghaynesSweet! Thanks01:07
greghaynesWhere are you based?01:08
StevenKgreghaynes: Sydney, .au01:08
greghaynesbaw. So getting started hacksession not likely :P01:09
StevenKgreghaynes: How far away is Sydney, then? :-)01:10
greghaynesA ways, im in Portland OR01:10
StevenKIt's only what, 16 hours by plane ... :-P01:11
greghayneshaha, exactly01:12
*** CaptTofu has quit IRC01:13
*** CaptTofu has joined #tripleo01:13
*** CaptTofu has quit IRC01:18
*** ccrouch has quit IRC01:34
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Update README as we do support updates now  https://review.openstack.org/6943601:34
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Update tripleo-heat-templates: mention merge tool  https://review.openstack.org/6943801:34
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Add in missing definite article in README  https://review.openstack.org/6943901:34
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Update os-*-config section of README  https://review.openstack.org/6943401:34
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Update README - file injection is not required  https://review.openstack.org/6943001:34
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Heat is quite usable in more than Grizzly  https://review.openstack.org/6943101:34
*** CaptTofu has joined #tripleo01:34
SpamapSahh the infinite hampster-wheel of rebases01:35
*** nosnos has joined #tripleo01:36
mordredyay rebase!01:40
SpamapSmordred: the next hip hop song should be 'stone cold rebasin'01:40
mordredyeah. that'll be a sure grammy winner01:40
SpamapScomizzle your chizzle to the gizzle repizzle the submit it to gerizzle for community revizzle01:42
*** jcooley_ has joined #tripleo01:42
lifelessok, now where was I01:47
lifelessthats right, MVP4 stuff01:47
StevenKOne more module ...01:47
*** jcooley_ has quit IRC01:48
greghaynesSpamapS: Was that bill cosby's guide on how to submit to openstack?01:52
SpamapSgreghaynes: you mean snoop right?01:54
greghayneshah, they must share material01:55
*** julim has quit IRC01:56
SpamapSgreghaynes: https://bugs.launchpad.net/tripleo/+bug/1273489 <-- triaged.. please read comments and add anything if you have more. :)02:01
*** ccrouch has joined #tripleo02:01
lifelessSpamapS: are you going to flesh out heat specs/blah about rolling ?02:02
greghaynesSpamapS: What was bugging me with that was it attempting to connect to 'local mysqld' rather than over IP02:03
SpamapSlifeless:  it is so elegant.. just 4 points..02:03
greghaynesnova-compute was also unable to start, assumed it was due to taht02:03
SpamapSgreghaynes: it is likely a bug in nova-compute that it won't start without a working conductor.02:04
SpamapSs/likely //02:04
SpamapSit should just start and spin until conductor does things properly02:04
SpamapSgreghaynes: the error was not from nova-compute though, it was from the conductor which is configured for localhost db02:05
greghaynesGotcha :)02:05
lifelessSpamapS: I know, its what you get when I get time to think about a problem :P02:05
lifelessSpamapS: OTOH, 4 bullet points can hide a tonne of mess :)02:06
SpamapSlifeless: Yeah so #2 at https://etherpad.openstack.org/p/tripleo-rolling-upgrades is basically all that my original assessment covers.02:06
openstackgerritA change was merged to openstack/tripleo-incubator: Document stable branches in devtest  https://review.openstack.org/6827402:09
openstackgerritA change was merged to openstack/tripleo-incubator: Setup libvirt/kvm permissions on openSUSE  https://review.openstack.org/6879402:11
*** vkozhukalov has joined #tripleo02:15
jamezpolleyStevenK: greghaynes might be too far away, but that doesn't mean you've escaped all threat of being dragged into a getting started hacksession02:18
jamezpolleyStevenK: you'll be an entire month ahead of me, so practically an old hand!02:20
greghaynesonly if he survives those onboarding videos02:23
StevenKBwahaha02:23
StevenKHm, no, this isn't #slug ...02:25
*** jcooley_ has joined #tripleo02:36
*** jcooley_ has quit IRC02:42
jamezpolleys/an entire month/two entire months/02:43
lifelessjamezpolley: you're keen to start aren't you :)02:51
jamezpolleyI don't know why you'd think that :)02:53
greghaynesjamezpolley: When do you start?02:54
lifelessStevenK: if you fix https://review.openstack.org/#/c/68308/ we can land it02:56
jamezpolleyMarch 302:56
greghaynesjamezpolley: Awesome :)02:57
openstackgerritA change was merged to openstack/tripleo-image-elements: Do not drop databases without a good reason  https://review.openstack.org/6900302:57
lifelessslagle: hey02:57
lifelesshttps://review.openstack.org/#/c/67343/ wondering if you coud add the systemd unit ?02:57
*** CaptTofu has quit IRC03:00
*** matsuhashi has quit IRC03:13
*** matsuhashi has joined #tripleo03:14
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Stop sourcing devtest_seed.sh.  https://review.openstack.org/6928603:15
*** rwsu has quit IRC03:18
StevenKlifeless: Sure, so indent the whole debian-mirror: block by 4 spaces?03:30
lifelessyes,, and s/ - comment/ # comment/03:32
*** ccrouch has quit IRC03:32
*** ccrouch has joined #tripleo03:33
lifelessSpamapS: around ?03:39
*** ccrouch has quit IRC03:42
openstackgerritA change was merged to openstack/tripleo-incubator: Update README - file injection is not required  https://review.openstack.org/6943003:45
openstackgerritA change was merged to openstack/tripleo-incubator: Heat is quite usable in more than Grizzly  https://review.openstack.org/6943103:45
openstackgerritA change was merged to openstack/tripleo-incubator: Update os-*-config section of README  https://review.openstack.org/6943403:45
openstackgerritA change was merged to openstack/tripleo-incubator: Update README as we do support updates now  https://review.openstack.org/6943603:45
lifelessSpamapS: your stack needs rebasing03:48
*** matsuhashi has quit IRC03:49
*** CaptTofu has joined #tripleo03:55
*** AaronGr is now known as AaronGr_Zzz03:57
*** jcooley_ has joined #tripleo03:57
lifelessSpamapS: so whats nova-compute-group.yaml for03:59
*** CaptTofu has quit IRC04:00
*** jcooley_ has quit IRC04:02
StevenKlifeless: Right, but the -'s in the text are fine as-is?04:10
lifelessStevenK: - indicates a list item in yaml04:11
lifelessStevenK: or do you mean '# foo - bar\n' <- thats ok04:12
StevenKlifeless: I'm refering to suites: ["saucy", "saucy-updates", "saucy-security"]04:12
lifelessyes, thats fine04:12
lifelessits in a string04:12
StevenKlifeless: http://paste.openstack.org/show/6198004:13
lifelessI think that will work04:17
StevenKlifeless: So perhaps we should enable the cron job.04:23
*** AaronGr_Zzz is now known as AaronGr04:24
lifelessStevenK: heh yes04:24
lifelessStevenK: and as you say, we'll need apache2 config fluff for the heat template04:25
StevenKlifeless: Do you think that's enough, or should we fiddle something for first boot?04:26
lifelessStevenK: what sort of thing are you thinking of ?04:26
StevenKI'm not certain, that's part of the problem.04:26
lifelessok04:27
lifelessso what should happen once and only once for this thing?04:27
StevenKWell, the mirror should keep itself up to date -- perhaps we want that configurable too?04:28
lifelessthats ongoing04:28
lifelessnot once and only once04:28
lifelessfirst-boot stuff is once and only once, right ?04:28
*** jcooley_ has joined #tripleo04:28
StevenKWe have the configuration written, we just need to run apt-mirror as the right user as the cronjob will do04:29
StevenKSo there's no one-time setup to populate the mirror for the first time04:29
*** jcooley_ has quit IRC04:30
lifelessrighto then04:31
lifelessso just diddle the cronjob at build time04:31
StevenKlifeless: And provide debian-mirror.update-schedule as a string or so?04:31
lifelessStevenK: why?04:33
lifelessStevenK: simplest thing tome seems to be sed /#//04:33
lifelessStevenK: if we find there isn't a right setting for it, then sure, we can allow configuring it04:34
StevenKlifeless: The timestamp is what I'm talking about04:34
lifelessStevenK: what timestamp? Do you mean the cronspec ?04:34
StevenKlifeless: Yeah04:34
lifelessStevenK: so, is the default wrong ?04:35
StevenKThe path needs fiddling04:35
StevenK4am is probably not a bad default for updating the mirror04:36
lifelessso, unless you have a better time, sounds good to me04:36
lifelessI'm not a huge believer in pick-your-own-adventure04:36
lifelessflexability we expect folk to need - sure04:37
StevenKAnd people are free to puppet it up or hand edit it04:37
lifelessright; if we ship in the image a sane default04:39
lifelesswe can always make it a template later04:39
lifelessjust saying, don't overpredict things04:39
StevenKlifeless: Right, let me distractedly build an image that includes this element, and then I'll push it up04:40
StevenKIn other news, section 4.7 ...04:40
*** UtahDave has quit IRC04:43
*** matsuhashi has joined #tripleo04:45
*** weshay has quit IRC04:49
lifelessSpamapS: bwahahahaahahah our wait condition stuff is -so- broken04:56
lifelessSpamapS: e.g. we hard code '2' for the count in overcloud-source, and then '1' in -instance04:58
lifelessbut the thing in -instance isn't merged at all04:58
*** akuznetsov has joined #tripleo05:00
*** jcooley_ has joined #tripleo05:06
*** jcooley_ has quit IRC05:07
StevenKlifeless: The cron.d file looks good, but does the heat template stuff need to be in place for the mirror.list generation to fire?05:16
lifelessStevenK: when someone uses it yes05:25
lifelessbut they are separate repos, decoupled landing05:25
StevenKRight05:25
openstackgerritSteve Kowalik proposed a change to openstack/tripleo-image-elements: Add a debian-mirror element  https://review.openstack.org/6830805:26
lifelessSpamapS: whats __include__ vs FileInclude ?05:28
*** CaptTofu has joined #tripleo05:56
*** CaptTofu has quit IRC06:00
*** jcoufal has joined #tripleo06:12
lifelessSpamapS: ^ enjoy, off to movie.06:41
openstackgerritlifeless proposed a change to openstack/tripleo-heat-templates: Permit writing output to other than stdout.  https://review.openstack.org/6954506:41
openstackgerritlifeless proposed a change to openstack/tripleo-heat-templates: Make debugging merge.py in the test suite possible.  https://review.openstack.org/6954606:41
openstackgerritlifeless proposed a change to openstack/tripleo-heat-templates: Make scaling out a feature for merge.py.  https://review.openstack.org/6954706:41
openstackgerritlifeless proposed a change to openstack/tripleo-heat-templates: Update overcloud to support N compute hosts.  https://review.openstack.org/6954806:41
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Deploy 2 hypervisors, not 1.  https://review.openstack.org/6954906:44
openstackgerritlifeless proposed a change to openstack-infra/tripleo-ci: Build test environments for 2 hypervisors.  https://review.openstack.org/6955006:47
*** vkozhukalov has quit IRC06:51
*** rpodolyaka has joined #tripleo07:10
*** coolsvap has joined #tripleo07:17
*** mrunge has joined #tripleo07:31
*** vkozhukalov has joined #tripleo07:33
*** jprovazn has joined #tripleo07:35
*** rlandy has joined #tripleo07:46
*** rdopieralski has joined #tripleo07:48
*** markmc has joined #tripleo07:56
markmclifeless, howdy07:57
*** CaptTofu has joined #tripleo07:57
markmclifeless, so, the short notice makes things a little difficult, but maybe 4-6 should be able to go07:57
markmclifeless, mar 3rd is likely to work fine for that many07:57
*** CaptTofu has quit IRC08:01
openstackgerritRalf Haferkamp proposed a change to openstack/tripleo-image-elements: Fix mysql installation on openSUSE  https://review.openstack.org/6827808:02
*** sdake has quit IRC08:14
*** sdake has joined #tripleo08:15
*** jistr has joined #tripleo08:19
*** rha has quit IRC08:19
*** rha has joined #tripleo08:20
*** rha has joined #tripleo08:20
*** e0ne has joined #tripleo08:27
ProfFalkenhey all, I've got devstack working and tuskar/horizon installed, however I can't log in to Horizon using the creds in stackrc from the undercloud machine. "nova list" works fine, can anyone tell me where to find the logs to troubleshoot this?08:40
*** e0ne has quit IRC08:44
ProfFalkennm, found it, I get a 503.  Tracking it down now08:45
*** e0ne has joined #tripleo08:45
openstackgerritMatthew Macdonald-Wallace proposed a change to openstack/tuskar-ui: Switch from using the git protocol to https for pip requirements  https://review.openstack.org/6955908:45
*** pblaho has joined #tripleo08:47
*** e0ne has quit IRC08:49
openstackgerritRonelle Landy proposed a change to openstack/tripleo-image-elements: Moving iptables rules to the relevant elements  https://review.openstack.org/6807508:51
*** vkozhukalov has quit IRC08:51
jprovaznlifeless: ping08:52
*** derekh has joined #tripleo09:05
*** lsmola_ has joined #tripleo09:08
*** matsuhashi has quit IRC09:09
*** athomas has joined #tripleo09:12
*** matsuhas_ has joined #tripleo09:14
*** marun has quit IRC09:19
*** rpodolyaka has quit IRC09:21
*** jtomasek has joined #tripleo09:26
*** e0ne has joined #tripleo09:28
*** athomas has quit IRC09:38
*** athomas has joined #tripleo09:49
rlandyderekh: hi  ... I'm testing out the iptables changes (permissions updated). Your comments says "with iptables enabled during image build". How do I enable iptables for image building?09:51
rlandyright now I am checking the seed vm and keystone can't be reached so I'm missing something09:52
*** CaptTofu has joined #tripleo09:57
*** lsmola_ has quit IRC09:58
*** martyntaylor has joined #tripleo10:02
*** CaptTofu has quit IRC10:02
derekhrlandy: I meant you would enable the service during image build so that the when the vm comes up your rules would be tested,10:02
derekhrlandy: firewalld seems to not be installed, looking10:03
*** e0ne_ has joined #tripleo10:06
derekhrlandy: you'll probably have to put something like this into an element to turn on the firewall10:07
derekhyum install firewalld ; rm /etc/systemd/system/firewalld.service ; systemctl daemon-reload ; systemctl enable firewalld10:07
*** e0ne has quit IRC10:10
rlandyderekh: ok  - I'll try that in keystone since that seemed to be the first element to hit the problem. How did the rules work previously though? boot-stack included it?10:10
derekhrlandy: ya boot stack included them, are the rules present on your seed vm to allow access to keystone?10:12
*** lsmola_ has joined #tripleo10:13
rlandyderekh: ssh'ing in to the seed - looks like the rules for some of the files I changed exist but iptables --list doesn't show keystone10:14
*** martyntaylor has quit IRC10:15
rlandyinit-keystone returns "Unable to establish connection to http://192.0.2.1:35357/v2.0/tenants" so there's no rule10:15
derekhrlandy: weird, off the top of my head I can't think of anything, any errors in the os-coolect-config log ? if you want to send me details I can log in a have a look10:17
derekhrlandy: is keystone running ? :-)10:17
rlandyyes10:17
ProfFalkenwhen running tripleo/devtest is there any way to see the logs for the Nova scheduler? It says it's set to debug but I can't see anything in the various config files that indicate where that is output to...10:18
derekhProfFalken: if you on ubuntu it should be in /var/log/upstart/nova-scheduler.log10:18
derekhProfFalken: or something like that10:19
ProfFalkenderekh: I am and it is. thanks :)10:19
derekhProfFalken: np10:19
*** matsuhas_ has quit IRC10:22
rlandyderekh:  lsof -Pnl | grep "35357"10:23
rlandykeystone- 2735           997    3u     IPv4      19707       0t0        TCP *:35357 (LISTEN)10:23
derekhrlandy: is it possible its the IP address 192.0.2.1 perhapes it failed to get assigned to the device, you should be able to test the 192.168.122.XXX address10:24
rlandyderekh: ok - checking a few more things here10:26
*** max_lobur_afk is now known as max_lobur10:29
*** martyntaylor has joined #tripleo10:31
*** matsuhashi has joined #tripleo10:31
*** vkozhukalov has joined #tripleo10:37
*** lsmola_ has quit IRC10:43
*** coolsvap has quit IRC10:47
*** lsmola_ has joined #tripleo10:56
*** coolsvap has joined #tripleo11:00
*** matsuhashi has quit IRC11:00
openstackgerritA change was merged to openstack/tuskar-ui: Run PEP8 check by default when tests are run  https://review.openstack.org/6944411:06
openstackgerritA change was merged to openstack/tuskar-ui: Switch from using the git protocol to https for pip requirements  https://review.openstack.org/6955911:08
* ProfFalken is gonna work with tripleo/tuskar more often - that's the fastest openstack merge I've ever seen! :D11:10
ProfFalkenthanks all11:10
*** boris-42 has quit IRC11:11
ProfFalkenIf I wanted to add more nodes to the underlcoud to spawn more vms in the overcloud, would I just re-run the steps from http://docs.openstack.org/developer/tripleo-incubator/devtest_undercloud.html ?11:14
*** matsuhashi has joined #tripleo11:14
*** matsuhashi has quit IRC11:17
*** lucasagomes has joined #tripleo11:22
*** coolsvap has quit IRC11:30
*** jprovazn has quit IRC11:30
openstackgerritRonelle Landy proposed a change to openstack/tripleo-image-elements: Moving iptables rules to the relevant elements  https://review.openstack.org/6807511:35
*** akrivoka has joined #tripleo11:36
*** mrunge has quit IRC11:36
*** jprovazn has joined #tripleo11:44
*** panda__ has joined #tripleo11:54
*** panda has quit IRC11:55
*** CaptTofu has joined #tripleo11:58
*** panda has joined #tripleo12:00
*** mrunge has joined #tripleo12:03
*** panda__ has quit IRC12:03
*** CaptTofu has quit IRC12:04
*** vipul has quit IRC12:10
*** vipul has joined #tripleo12:12
rlandyderekh: iptables changes are working now in the seed. It was the file permissions again :(. But patch 3 should fix that12:14
derekhrlandy: cool, will check it in a bit12:16
lifelessderekh: looks like nodepool isn't reusing tripleo nodes now12:27
lifelessderekh: which is a bit sad but meh12:27
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Don't delete test VMs by default.  https://review.openstack.org/6884112:28
derekhlifeless: ok, will be interesting to see if the time to run a job increases much12:30
lifelessderekh: well, we need to add the additional jobs12:30
lifelessderekh: (undercloud and overcloud, and also preconfigured environments for them) and so on12:30
*** boris-42 has joined #tripleo12:31
lifelessfarking neutron :(12:31
* lifeless restarts neutron-dhcp-agent on the ci-overcloud12:32
derekhlifeless: yup,12:32
derekhthat neutron problem sounds like a PITA12:32
lifelessyuo can tell it's happening if in zuul status all our jobs have (queued)12:32
lifeless(starting at the top)12:32
lifelessand then nova console-log $instance12:33
lifelessshows12:33
lifelesscloud-init-nonet waiting 120 seconds for a network device.12:33
derekhlifeless: should we add a restart cron job  on the overcloud to workaround it?12:34
lifelessderekh: shudder.12:36
lifelessderekh: we should debug whats causing it12:36
lifelessderekh: someone needs to look at the neutron code, see what is meant to happen, then gather data to show what /is/ happening12:37
derekhlifeless: ok, I doubt I'm the right person but will poke at it a little bit and see if I can find anything12:38
openstackgerritlifeless proposed a change to openstack/tripleo-heat-templates: Update overcloud to support N compute hosts.  https://review.openstack.org/6954812:40
openstackgerritlifeless proposed a change to openstack/tripleo-heat-templates: Permit writing output to other than stdout.  https://review.openstack.org/6954512:40
openstackgerritlifeless proposed a change to openstack/tripleo-heat-templates: Make debugging merge.py in the test suite possible.  https://review.openstack.org/6954612:40
openstackgerritlifeless proposed a change to openstack/tripleo-heat-templates: Make scaling out a feature for merge.py.  https://review.openstack.org/6954712:40
lifelessderekh: I have put some reasonable diagnostics in the bug already12:40
derekhlifeless: ok12:40
lifelessderekh: the rabbit disconnects AFAICT are a distraction and not correlated nor causative12:40
*** max_lobur is now known as max_lobur_afk12:41
openstackgerritA change was merged to openstack/tripleo-incubator: Don't delete test VMs by default.  https://review.openstack.org/6884112:42
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Stop sourcing devtest_seed.sh.  https://review.openstack.org/6928612:42
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Deploy 2 hypervisors, not 1.  https://review.openstack.org/6954912:42
*** CaptTofu has joined #tripleo12:46
lifelessNg: hey, have you had a walkthrough with Colin yet?12:47
*** tserong has quit IRC12:49
*** tserong has joined #tripleo12:50
*** tserong has quit IRC12:50
*** tserong has joined #tripleo12:50
Nglifeless: no, I've not had a reply. I'll chase again12:50
*** bauzas has joined #tripleo12:57
*** dprince has joined #tripleo12:59
openstackgerritA change was merged to openstack/tripleo-image-elements: Add package install support to openstack-clients  https://review.openstack.org/6902213:01
openstackgerritA change was merged to openstack/tripleo-image-elements: Add package install support to novnc  https://review.openstack.org/6794513:01
openstackgerritA change was merged to openstack/tripleo-image-elements: Add package install support to nova  https://review.openstack.org/6794613:01
openstackgerritA change was merged to openstack/tripleo-image-elements: Install nova-manage into /usr/local/bin  https://review.openstack.org/6794713:01
openstackgerritA change was merged to openstack/tripleo-image-elements: Install nova-baremetal-manage into /usr/local/bin  https://review.openstack.org/6794813:01
*** max_lobur_afk is now known as max_lobur13:04
*** jdob has joined #tripleo13:04
*** hewbrocca has joined #tripleo13:06
*** nosnos has quit IRC13:08
*** pblaho has quit IRC13:11
*** morazi has joined #tripleo13:15
*** funzo has quit IRC13:22
*** pblaho has joined #tripleo13:24
*** funzo has joined #tripleo13:27
*** panda__ has joined #tripleo13:29
*** michchap has quit IRC13:31
*** panda has quit IRC13:31
*** michchap has joined #tripleo13:31
*** funzo has quit IRC13:35
*** funzo has joined #tripleo13:36
*** michchap has quit IRC13:36
*** noslzzp has joined #tripleo13:38
*** julim has joined #tripleo13:56
*** ccrouch has joined #tripleo14:01
SpamapSlifeless: UGH.. you're improving merge.py in ways that Heat desperately needs to be improved.14:03
*** mestery has quit IRC14:03
slagleheh, 100'ish lines added to merge.py14:04
* slagle just saw that14:04
SpamapSmakes me sad14:05
SpamapSPoor Heat just can't keep up with a lean and mean piece of crap like merge.py ;)14:06
slagleit might, arguably, be better if merge.py was in Heat as-is14:07
slagleat least then, where we're at, and where we want to get to is in the same place14:07
slaglebut, maybe not14:08
*** lblanchard has joined #tripleo14:08
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Update tripleo-heat-templates: mention merge tool  https://review.openstack.org/6943814:10
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Add in missing definite article in README  https://review.openstack.org/6943914:10
SpamapSslagle: so Heat is landing most of these things now, but with a whole design rather than "just get it done like now" design.14:11
*** matty_dubs|gone is now known as matty_dubs14:11
SpamapSslagle: and stevebaker has asked for volunteers to help with said features. :-P14:11
*** dkehn_ has joined #tripleo14:13
*** pblaho has quit IRC14:14
*** mestery has joined #tripleo14:15
mariosSpamapS: weird, i keep getting ERROR: Unknown resource Type : OS::Heat::UpdateWaitConditionHandle from heat template-validate... but i see that this landed in heat and the templates https://review.openstack.org/#/c/63245/14:16
SpamapSmarios: perhaps you didn't restart heat-engine after updating it?14:20
mariosSpamapS: yeah likely some issue. i'm just with devstack right now and i screen -rd and stop/pull/restart heat engine and api14:21
mariosSpamapS: not a biggie i'll just comment it out for now (main goal is getting multiple computes/block merging correctly, at least to pass validation)14:22
SpamapSmarios: there is something tricky in that14:22
SpamapSmarios: also why devstack and not devtest?14:22
mariosSpamapS: time mainly and prioritization of tasks (no point trying to deploy the thing if heat isn't even validating it)14:23
mariosSpamapS: next step is getting devtest up again on some lab machine so i can try the deploys14:23
*** jayg|g0n3 is now known as jayg14:27
*** spzala has joined #tripleo14:30
*** michchap has joined #tripleo14:32
mariosSpamapS: are you giving me the silence of disapproval :D. good news is 2 computes, a controller and 2 block-storage are producing a validatable template https://gist.github.com/anonymous/866869414:33
* marios goes to find a beaker machine14:33
mariosrbrady1: how did it go with the 'multi-cinder' approach. did you get it deployed ok?14:34
*** michchap has quit IRC14:36
openstackgerritDougal Matthews proposed a change to openstack/python-tuskarclient: Add bindings for overcloud API entrypoints  https://review.openstack.org/6931214:37
*** michchap has joined #tripleo14:39
SpamapSmarios: yay :)14:39
SpamapSmarios: I'm giving you the "it is 06:39AM here and children are waking up" silent treatment :)14:39
rbrady1marios: The create-stack is completing.  It's slower14:39
mariosrbrady1: thats awesome14:39
*** rbrady1 is now known as rbrady14:39
mariosrbrady: i finally got  a template validating (needs nit in cinder yaml from tht, sending review now)14:40
mariosrbrady: 2 computes and 2 cinder14:40
rbradymarios: thanks14:40
SpamapSbtw, I'm working out a way to solve our scaling-by-generating-templates problem..14:40
*** mestery_ has joined #tripleo14:40
rbradymarios: I pulled down lifeless' patch for scaling out and wanting to try it re: cinder14:40
SpamapSI think what we need is for Heat to be able to reference a list, passed in via parameter, for a resource name.14:41
openstackgerritDougal Matthews proposed a change to openstack/python-tuskarclient: Add bindings for Resource Category API entrypoints  https://review.openstack.org/6931314:41
SpamapSso instead of NovaCompute0:  you'd have  {Ref: NovaComputeList} .. and then you just pass in a list of uuids or names of planets or whatever you want.. and then when you want one gone, you just delete it from said list.14:42
SpamapSthat way you are just auto-generating _a list_ .. not an entire template.14:42
*** mestery__ has joined #tripleo14:42
mariosSpamapS: is this part of the greater 'lets gets things we need into Heat' ?14:42
mariosSpamapS: how far off do you see these in play, at least enough for debug?14:42
SpamapSmarios: yes.. but it is also part of "lets scale things down intelligently" :)14:43
*** michchap has quit IRC14:43
*** meste____ has joined #tripleo14:43
SpamapSmarios: I have to focus on rolling-updates .. which may be 2 weeks of dev. Then I can get to this. Or I can guide someone else. It should be a relatively easy feature to complete in Heat as it is entirely in the parsing phase.14:43
*** mestery has quit IRC14:43
SpamapSanyway.. -> chaos monkies are awake14:44
mariosSpamapS: haha.good morning14:44
*** mestery_ has quit IRC14:46
*** mestery__ has quit IRC14:46
openstackgerritMarios Andreou proposed a change to openstack/tripleo-heat-templates: Remove InstanceType and ImageId from cinder template  https://review.openstack.org/6961814:49
openstackgerritMarios Andreou proposed a change to openstack/tripleo-heat-templates: Remove InstanceType and ImageId from cinder template  https://review.openstack.org/6961814:50
*** jcoufal has quit IRC14:53
*** jcoufal has joined #tripleo14:54
openstackgerritRyan Brady proposed a change to openstack/tripleo-image-elements: Fixes authentication for cinder  https://review.openstack.org/6961914:55
*** mrunge has quit IRC14:55
*** martyntaylor1 has joined #tripleo14:56
*** mestery has joined #tripleo14:57
*** martyntaylor has quit IRC14:58
*** mestery_ has joined #tripleo14:58
*** meste____ has quit IRC15:00
*** mestery__ has joined #tripleo15:01
*** mestery has quit IRC15:02
openstackgerritDougal Matthews proposed a change to openstack/python-tuskarclient: Add bindings for overcloud API entrypoints  https://review.openstack.org/6931215:02
*** mestery_ has quit IRC15:03
openstackgerritDougal Matthews proposed a change to openstack/python-tuskarclient: Add bindings for overcloud API entrypoints  https://review.openstack.org/6931215:04
*** weshay has joined #tripleo15:05
*** mestery has joined #tripleo15:05
*** ftcjeff has joined #tripleo15:07
openstackgerritDougal Matthews proposed a change to openstack/python-tuskarclient: Add bindings for Resource Category API entrypoints  https://review.openstack.org/6931315:08
*** mestery__ has quit IRC15:09
*** jtomasek has quit IRC15:09
*** rwsu has joined #tripleo15:12
*** coolsvap has joined #tripleo15:16
openstackgerritJiri Stransky proposed a change to openstack/tripleo-incubator: Ensure libvirtd is always configured on Red Hat  https://review.openstack.org/6962715:22
*** jtomasek has joined #tripleo15:25
matty_dubsIs there a default password for things built with dib? I'm trying to debug a failure.15:28
Ngmatty_dubs: if the stackuser element was included, it's stack/stack15:29
Ngotherwise you're likely going to be sshing in as heat-admin with whatever ssh key was found on the build host15:29
matty_dubsAh-ha! I must have confused this with something else. stack/stack is exactly what I needed.15:30
matty_dubsThanks, Ng!15:30
*** rbrady is now known as rbrady-brb15:34
*** HInfoForIRC has joined #tripleo15:37
*** HInfoForIRC has left #tripleo15:37
openstackgerritJiri Stransky proposed a change to openstack/tripleo-incubator: Ensure libvirtd is always configured on Red Hat  https://review.openstack.org/6962715:38
*** mrunge has joined #tripleo15:38
*** michchap has joined #tripleo15:39
openstackgerritA change was merged to openstack/tripleo-incubator: Update tripleo-heat-templates: mention merge tool  https://review.openstack.org/6943815:40
*** rbrady-brb is now known as rbrady15:42
openstackgerritA change was merged to openstack/tripleo-incubator: Add in missing definite article in README  https://review.openstack.org/6943915:43
*** michchap has quit IRC15:44
*** lucasagomes is now known as lucas-hungry15:44
*** jcoufal has quit IRC15:50
*** jcoufal-mobile has joined #tripleo15:51
*** jistr has quit IRC15:51
*** jtomasek has quit IRC15:54
openstackgerritJames Slagle proposed a change to openstack/diskimage-builder: Add ability to use local cloud image  https://review.openstack.org/6813316:02
*** jtomasek has joined #tripleo16:06
*** boris-42 has quit IRC16:07
*** jcooley_ has joined #tripleo16:09
openstackgerritRonelle Landy proposed a change to openstack/tripleo-image-elements: Updates permissions on 97-mysql-iptables  https://review.openstack.org/6963916:12
rlandyrbrady: ^^ let me know if you object16:13
*** jcoufal-mobile has quit IRC16:15
*** jcoufal-mobile has joined #tripleo16:15
matty_dubsOh, hi, rlandy! Long time no see!16:15
rlandymatty_dubs: hi there. yes - it's been a while16:16
*** hughsaunders has left #tripleo16:17
*** vkozhukalov has quit IRC16:19
matty_dubsSo have you folks noticed tests failing, with "ERROR: HTTPConnectionPool(host='192.0.2.1', port=8774): Max retries exceeded with url ..." timing out?16:19
matty_dubsI just spent a bit prodding; it looks like it's genuinely just timing out. It takes about 10 minutes (?!) for nova-api to come up.16:19
rbradyrlandy: +116:19
*** rdopieralski has quit IRC16:21
*** jcoufal has joined #tripleo16:23
*** jprovazn has quit IRC16:25
*** jcoufal-mobile has quit IRC16:26
*** rlandy is now known as rlandy|bbl16:28
*** martyntaylor1 has quit IRC16:29
*** michchap has joined #tripleo16:32
*** michchap has quit IRC16:37
*** lucas-hungry is now known as lucasagomes16:37
*** martyntaylor has joined #tripleo16:38
*** michchap has joined #tripleo16:40
*** michchap has quit IRC16:45
openstackgerritChris Krelle proposed a change to openstack/tripleo-image-elements: Add nova-ironic element to replace nova-baremetal  https://review.openstack.org/6646116:57
*** cwolferh has joined #tripleo16:59
*** e0ne_ has quit IRC17:03
*** matty_dubs is now known as matty_dubs|lunch17:03
*** marun has joined #tripleo17:03
*** e0ne has joined #tripleo17:04
*** marun has quit IRC17:05
*** jtomasek has quit IRC17:07
*** noslzzp has quit IRC17:07
*** boris-42 has joined #tripleo17:07
*** marun has joined #tripleo17:08
*** e0ne has quit IRC17:09
*** noslzzp has joined #tripleo17:10
*** mrunge has quit IRC17:14
openstackgerritChris Krelle proposed a change to openstack/tripleo-image-elements: Ensure correct tftp directory ownership for Ironic  https://review.openstack.org/6901317:18
*** ifarkas has quit IRC17:19
*** jtomasek has joined #tripleo17:22
*** martyntaylor has quit IRC17:27
derekhslagle: not sure what ports I had missing (I've destroyed the vm that wasn't working but) https://review.openstack.org/#/c/67949/4/elements/neutron-ovs-cleanup/os-refresh-config/post-configure.d/81-neutron-ovs-cleanup17:40
*** michchap has joined #tripleo17:41
wendargreghaynes/StevenK/jamezpolley: would you all be interested in starting a shared etherpad doc of all our notes on "getting started with tripleo"?17:41
*** michchap has quit IRC17:41
*** michchap has joined #tripleo17:42
wendargreghaynes/StevenK/jamezpolley: heading toward something like http://docs.openstack.org/developer/nova/devref/index.html, but just random notes is a great place to start17:42
*** jtomasek has quit IRC17:44
slaglederekh: hmm, i wonder why i added that17:44
*** athomas has quit IRC17:45
*** michchap has quit IRC17:46
derekhslagle: suppose whats the point in enabling a service without starting it...17:46
slaglederekh: well, yea. i suspect i added the line when i was refactoring for adding the os-svc-restart and map-services17:47
slagleso i assumed there should have been a restart there17:47
derekhyup17:47
slaglei'll remove it17:48
slagleif it needs to be there, it obviously needs some work, and shouldnt be part of the package patchset anyway17:48
derekhsounds good17:49
dkehn_lifeless, so from yesterdays markmcclain conversion I did see anymore after your request for a recommendation, was wondering if that was the end of it17:49
openstackgerritDerek Higgins proposed a change to openstack/tripleo-incubator: Fix seed domain name  https://review.openstack.org/6967917:52
*** e0ne has joined #tripleo17:59
*** matty_dubs|lunch is now known as matty_dubs18:05
*** meera has joined #tripleo18:05
greghayneswendar: Awesome idea18:08
greghaynesDefinitely interested in doing that18:08
*** ifarkas has joined #tripleo18:11
pleia2derekh, dprince - not sure if you saw, but I have started a WIP to start fixing some of the fedora issues we're seeing with it being a nodepool slave https://review.openstack.org/#/c/69510/18:13
pleia2and left some notes as to TODOs in there18:13
dprincepleia2: cool, sounds good18:14
*** martyntaylor has joined #tripleo18:15
*** vkozhukalov has joined #tripleo18:22
wendargreghaynes/StevenK/jamezpolley: https://etherpad.openstack.org/p/tripleo-newdev-notes18:25
*** rlandy|bbl is now known as rlandy18:35
*** martyntaylor has quit IRC18:38
*** edmund1 has joined #tripleo18:40
*** michchap has joined #tripleo18:42
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Install glance-manage into /usr/local/bin  https://review.openstack.org/6795618:45
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Add package install support to horizon  https://review.openstack.org/6795218:45
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Add package install support to heat  https://review.openstack.org/6795318:45
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Install heat-manage into /usr/local/bin  https://review.openstack.org/6795418:45
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Add package install support to glance  https://review.openstack.org/6795518:45
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Add package install support to neutron  https://review.openstack.org/6794918:45
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Install keystone-manage into /usr/local/bin  https://review.openstack.org/6795118:45
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Add package install support to keystone  https://review.openstack.org/6795018:45
matty_dubsslagle: You've been busy. ;)18:45
*** jcoufal-mobile has joined #tripleo18:47
*** michchap has quit IRC18:47
*** e0ne has quit IRC18:47
*** sdague has quit IRC18:51
*** e0ne has joined #tripleo18:55
*** sdague has joined #tripleo18:56
*** jistr has joined #tripleo19:00
dkehnwe meeting?19:00
*** shadower_ is now known as shadower19:01
*** pblaho has joined #tripleo19:02
*** jcoufal-mobile has quit IRC19:03
*** panda has joined #tripleo19:08
*** panda__ has quit IRC19:11
*** max_lobur is now known as max_lobur_afk19:17
*** jprovazn has joined #tripleo19:18
*** lsmola has joined #tripleo19:34
*** pblaho has quit IRC19:34
*** rwsu has quit IRC19:36
matty_dubsSo can someone elaborate, in more of a for-dummies manner, how the CD cloud is being used right now? Is it actually testing each commit, or is that still WIP?19:36
*** rwsu has joined #tripleo19:40
slaglethe CD cloud is running in a loop updating itself from master19:41
slaglethat is different from the CI-testenv stuff that is testing each commit before it's merged19:41
slagleand that is non-voting right now. e.g., it won't block commits19:42
slagle(someone correct me if i'm wrong)19:42
jamezpolleywendar: thanks19:42
matty_dubsAh, so it's testing commits after they're merged?19:42
*** michchap has joined #tripleo19:43
matty_dubsI had been out of the loop on it so today's update left me still in the dark.19:43
*** michchap has quit IRC19:43
*** michchap has joined #tripleo19:43
*** lsmola has quit IRC19:44
slaglematty_dubs: right, the CD cloud is deploying directly from master19:45
slagleit finds bugs that have already been merged :)19:45
*** michchap has quit IRC19:49
openstackgerritJames Slagle proposed a change to openstack/tripleo-incubator: Use relative path for keystone-manage  https://review.openstack.org/6970919:51
SpamapSactually said loop still seems stuck.. hmm19:52
SpamapSahh, it was that pull-tools bug.. hah19:54
SpamapSpull-tools was preventing itself from updating19:54
SpamapSwow I think git might be broken actually19:54
SpamapSit is testing if _stdout_ is a terminal19:54
SpamapSit should only be testing stdin19:54
SpamapSno use using a pager if stdin is /dev/null19:55
lifelesssorry y'all being away @ 2am -> beeing asleep @ 8am19:57
SpamapSlifeless: np, we managed to assign all work items and git blame history to you in the meeting so its all good19:59
lifelessgreat20:00
lifelessmatty_dubs: I wouldn't say cd-overcloud 'tests after merges' but more we get to use what was merged20:00
lifelessmatty_dubs: and if we don't check hard enough, what we want to use is broken20:01
Nglifeless: FYI the broken-fans machine is back in rotation20:01
Ngthey ended up replacing the motherboard20:01
*** jcoufal has quit IRC20:01
lifelessNg: nice20:01
lifelessNg: have you updated all ze metadata in nova-bm + machine-info-tab etc etc20:02
lifelessNg: (I really shouldn't have asked that..!)20:02
matty_dubslifeless: Ah, that makes sense. So it should be a good way to catch integration issues, etc.20:02
lifelessmatty_dubs: so any tripleo ATC can get a user account on cd-overcloud20:02
lifelessmatty_dubs: help tell us whats good and whats bust20:02
Nglifeless: I have. They kept the same iLO config afaics, so all that changed was the eth MACs in bm_interfaces/m-i-t and I reset the service_host to undercloud20:03
lifelessNg: cool20:03
lifelessNg: I shall learn not to ask :)20:03
*** jistr has quit IRC20:03
Nglifeless: defence in depth, keep asking :)20:03
lifelessdkehn: I didn't see anything more either20:03
lifelessNg: hah! ok20:03
*** vkozhukalov has quit IRC20:03
Nglifeless: also, I went through and audited all the iLO serials and we have a complete set now, which was the pre-requisite for writing a "how to file a DC/Sys/Net ticket to get stuff fixed" guide, so I'll likely do that tomorrow20:04
*** lucasagomes has quit IRC20:04
Ngsome of the DC folk know what "freecloud" means, but none of the Sys/Net folk do, which is fair enough I guess ;020:04
Ngbut everyone seems to understand the serials20:04
lifelessNg: FANTASTIC20:05
*** bashok has joined #tripleo20:05
*** bashok has left #tripleo20:06
lifelessdprince: hey so you disappeared yesterday, I was hoping to spend some quality high bw time discussing the dhcp-all-interfaces thing20:09
lifelessdprince: we have the immediate bug20:09
lifelessdprince: but we also have had issues contacting metadata servers during reboot, and I think thats tied in20:09
lifelessdprince: (because of br-ctlplane20:09
dprinceyes. lets talk20:10
dprincewrapping up on a phone call now....20:10
lifelessok, take your time, I'll grab breakfast and make myself presentable20:10
lifelessSpamapS: what did you think of my hypervisor scaling set ?20:11
lifelessmmmm my dashboard is getting a little long20:11
lifelesshttps://review.openstack.org/#/dashboard/419020:11
lifelessslagle: ah, so it was 80 but @ 30G / node that should have been 90.... we really shouldn't specify the numbers separately20:13
SpamapSlifeless: I am apalled that you would continue the farce of merge.py :(20:13
SpamapSlifeless: but I understand. ;)20:13
slaglelifeless: yea, i think it was wrong before your change to begin with20:13
*** rlandy has quit IRC20:13
lifelessslagle: so, I don't think disk will ever be a dominating factor - I'm inclined to ignore and fix the root cause when we have some itch scratching time20:13
lifelessslagle: what do you think?20:13
lifeless100G / 1500G = 15, 5 / 24 = 4.mumble20:14
lifelessslagle: OTOH it is easy enough to edit20:14
dprincelifeless: I'm back20:15
slaglethe disks are sparsely allocated right, so yea, it's not likely to matter20:16
dprincelifeless: I think https://bugs.launchpad.net/tripleo/+bug/1272969 and https://bugs.launchpad.net/tripleo/+bug/1272803 are related to the same root issue20:16
slaglei think the fact that something is specified there is what is confusing20:16
slaglebut yea, it's likely good enough as-is20:16
openstackgerritAna Krivokapic proposed a change to openstack/tuskar-ui: WIP: Add node detail view  https://review.openstack.org/6946220:24
dprincelifeless: ping me when you are back...20:24
slagledoes anyone know what the plan for /mnt/state is in regard to the openstack config files like /etc/nova/nova.conf?20:28
slaglewill they eventually be moved to /mnt/state?20:28
slagletrying to understand how this might impact systemd service files from the package installs, which are using /etc/...20:28
dprincelifeless: re the DHCP issue. I added a comment block to the ticket here: https://bugs.launchpad.net/tripleo/+bug/1272969. ping me when you are back20:29
lifelessdprince: just nomming, back v soon20:30
lifelessslagle: /var/run perhaps20:30
lifelessdprince: IRC/hngouts/?20:30
slaglehmm, ok. wonder if we could symlink from /etc/foo to /var/run/foo during install.d. probably20:32
lifelessslagle: whatever path we choose I am of the opinion that leaving symlinks behind obfuscates the design20:33
lifelessslagle: so I propose we make the system/upstart job definitions point directly at the place we write configs too20:34
*** e0ne has quit IRC20:34
lifelesss/oo/o/20:34
dprincelifeless: either is fine w/ me20:34
dprincelifeless: if you want to hangout lets do it now20:34
slagleyea, just trying to figure out how that will play nicely with the systemd files that are packaged20:34
slaglefor the installs from source, it's fine, since we write the systemd files20:35
* dprince warns lifeless that if he does a hangout other agenda items are likely to come up as well20:35
lifelessdelete the packaged one then write the systemd files?20:35
lifelessdprince: fine with me20:35
dprinceslagle: re the systemd files I mentioned this on the list and go no reply20:36
dprinceslagle: it would be very nice to use the packaged versions... but there are some cases where things don't line up20:36
dprinceslagle: are you hitting issues there?20:36
*** panda_ has joined #tripleo20:36
slaglenot yet; b/c os-apply-config is still writing them under /etc20:36
lifelessanyone else want in on this hangout action?20:37
dprinceslagle: well, let me know how it goes when you do try them :)20:37
lifelessng? kids asleep, want some dhcp-all-interfaces design time?20:37
dprinceslagle: many of my concerns were just suspicious... I didn't actually try them20:37
slagledprince: i see your reply now.20:38
slagleusing the packaged systemd files actually appears to be working fine20:38
*** akrivoka has quit IRC20:38
dprincelifeless: lets go, we can add whoever in if people jump in20:38
* dprince only has 20-30 minutes anyway20:39
slagleit shouldn't be an issue until the config is moved out from under /etc, which are service files expect20:39
slagles/are/our20:39
lifelessdprince: roger20:39
Nglifeless: I'm already moonlighting on Rike time by having IRC open, so I'd best regretfully decline ;(20:39
ccrouchslagle: and that move hasn't been done yet, because that config isn't "precious state" ?20:39
lifelessNg: https://etherpad.openstack.org/p/tripleo-dhcp-all-interfaces-iteration-220:40
*** panda has quit IRC20:40
openstackgerritJan Provaznik proposed a change to openstack/tripleo-image-elements: Fix exit status of haproxy install script  https://review.openstack.org/6971620:40
ccrouchreading back20:40
slagleccrouch: right, it doesn't need to be saved to /mnt/state b/c os-apply-config will just reapply it on reboot20:41
*** cd-undercloud has joined #tripleo20:41
cd-undercloud************** overcloud complete status=0 ************20:41
*** cd-undercloud has quit IRC20:41
lifeless\o/20:41
*** michchap has joined #tripleo20:43
*** michchap has quit IRC20:44
ccrouchslagle: so as long root filesystem is NOT read-only (i.e. o-a-c can do its thing) everything should work fine20:44
*** michchap has joined #tripleo20:44
slagleyes, oac still writes to /etc as of now20:44
ccrouchlifeless: is "oac still writes to /etc as of now" something that was missed for MVP3, something targetted for MVP4, some future area for optimization or something else?20:46
*** michchap has quit IRC20:48
*** markmc has quit IRC20:54
*** e0ne has joined #tripleo20:55
*** UtahDave has joined #tripleo20:56
lifelessccrouch: future IMO21:02
openstackgerritRyan Brady proposed a change to openstack/tripleo-image-elements: Fixes authentication for cinder  https://review.openstack.org/6961921:06
ccrouchas long as " getting oac to  use /mnt/state" is not going to block anything else, i think we're fine21:07
ccrouchi.e. "future" would have to be after we've figured out how config files in /mnt/state play nicely with the packaged service files21:07
ccrouchlifeless: ^21:07
*** UtahDave has quit IRC21:10
SpamapSccrouch: IMO that is my argument against bothering with packages.21:13
SpamapSccrouch: they are so different from what we're trying to achieve that you end up with none of the benefits.21:13
*** NewInformator has joined #tripleo21:14
*** NewInformator has left #tripleo21:14
*** noslzzp has quit IRC21:16
ccrouchSpamapS: choice of the format of the code we distribute is above my paygrade I'm afraid :-)21:18
ccrouchwe are trying to see what the best way is to combine the approaches in play in triple along with some "fixed choices", one of which is the use of packages.21:19
*** e0ne has quit IRC21:20
SpamapSyeah, totally get it.. totally think it is lol21:20
SpamapSas in ludicrously, overtly, laughable :)21:20
SpamapSccrouch: anyway, you'll just have to patch the unit files to call with --config-dir /mnt/state/etc/nova ... _or_ we have to maintain a whole mess of symlinks21:21
SpamapSccrouch: I prefer the former, because it is more discoverable and obvious21:22
openstackgerritJay Dobies proposed a change to openstack/tuskar: API controllers for icehouse domain model  https://review.openstack.org/6871621:23
lifelessSpamapS: or /var/run/nova/etc/ ?21:23
ccrouchmaintaining patch sets is probably the worst of two bad options from our side. Hopefully there will be some more palatable alternatives if the "future" ever comes21:24
*** dprince has quit IRC21:25
SpamapSlifeless: yeah /var/run would be fine too.21:27
SpamapSwe also have to figure out how to make systemd write to "not /etc" too21:28
*** cd-undercloud has joined #tripleo21:28
cd-undercloud************** overcloud complete status=0 ************21:28
*** cd-undercloud has quit IRC21:28
*** markmcclain has joined #tripleo21:32
*** cody-somerville has quit IRC21:33
dkehnlifeless: u around21:33
dkehnmarkmcclain: hi21:33
lifelessdkehn: I'm just stepping out for a bit, back soon21:34
markmcclaindkehn: hi21:34
dkehnmarkmcclain: yesterday we were talking about HA route and control plane you had mentioned the https://review.openstack.org/#/c/64553/21:34
dkehnbut that it might not be there yet21:35
dkehnmarkmcclain: wondering about any recommendations you might have21:35
*** coolsvap has quit IRC21:35
markmcclain64553 is probably the most promising21:36
markmcclainI'm also certain that sylvain would be happy to get more testing21:36
dkehnmarkmcclain: so basically that would be the best approach in your opinion, start there and go throough it with ouor env, and when we bump into something fix it21:38
openstackgerritTzu-Mainn Chen proposed a change to openstack/tuskar-ui: Combined Instance and Node objects into Node  https://review.openstack.org/6972421:39
pleia2lifeless: woo, new error: OverLimit: Quota exceeded for cores: Requested 4, but already used 28 of 28 cores (HTTP 413)21:40
SpamapSccrouch: with RPM is there a way for one package to "take over" a file from another package? In dpkg we have dpkg-divert .. that allows you to have a package which basically represents an alternate universe for a package.. so you guys could have openstack-nova-tripleo packages which just have different systemd unit files...21:40
ccrouchSpamapS: thats an interesting idea21:42
openstackgerritTzu-Mainn Chen proposed a change to openstack/tuskar-ui: Combined Instance and Node objects into Node  https://review.openstack.org/6972421:42
*** michchap has joined #tripleo21:44
bnemecSpamapS: ccrouch: I think slagle was looking into the possibility of having separate systemd files for tripleo because of naming differences.  Might solve this problem too.21:44
*** michchap has quit IRC21:44
*** michchap has joined #tripleo21:45
slagleyea, we could package some systemd service files. but given the existing packages already provide those files, we'd have to install with --replacefiles21:46
slaglewhich is generally frowned upon21:46
slaglestill, hardly the end of the world21:46
SpamapSslagle: yeah thats not what you want21:46
SpamapSI'm a bit surprised RPM doesn't let you express it in packaging.21:47
lifelesspleia2: you haven't updated your creds properly, thats still on the infra-nodepool account21:47
ccrouchyeah that sounds roughly like maintaing our own patches to the unit files21:47
SpamapSslagle: what about splitting the unit files into their own package, like openstack-nova-systemd, and then making the openstack-nova-systemd-tripleo package provide openstack-nova-systemd ?21:48
lifelessmarkmcclain: so the question is ; do we start using that patch ahead of trunk / does neutron land that patch now so that we can use trunk and provide feedback / should we use pacemaker per the openstack HA manual ?21:48
lifelessmarkmcclain: we're looking for a recommendation from you21:48
slagleSpamapS: yea that would work21:49
*** michchap has quit IRC21:49
slaglewe'd still be maintaining our own though21:49
dkehnmarkmcclain: ^^^21:49
*** shakayumi has joined #tripleo21:49
slaglewe need like an install time macro or something21:50
markmcclainlifeless: might have to carry it outside of our tree for a bit21:50
lifelessmarkmcclain: so which is your recommendation - run the out of tree patchset, or pacemaker ?21:51
markmcclainI'd look at running the out of tree21:52
*** ifarkas has quit IRC21:52
*** jprovazn has quit IRC21:52
lifelessok21:52
lifelessmarkmcclain: sylvain is the person to chat with yeah?21:53
markmcclainyes.. he is heading it up21:54
lifelessmarkmcclain: whats his irc nick?21:54
markmcclainhe's UTC+121:54
markmcclainsafchain21:54
lifelesscool21:54
dkehnyepper21:55
lifelessdkehn: can you have a chat to hi and see how he feels - if we run it we'll be looking for some degree of don't-break-us (e.g. database migrations shouldn't change )21:55
dkehnlifeless: yepper, on it21:56
lifelessdkehn: plus we (tripleo) will need to figure out a nice way to express 'and run with this patchset', we've got most of the plumbing for that I think, but we will need to override zuul in check21:56
*** rollerj has joined #tripleo21:56
dkehnlifeless: k21:56
lifelessdkehn: but that can wait for an ack from him that he's ready for users21:56
lifelessearly adopters21:56
lifelessSpamapS: slagle: So, I'd like to get the 2 hypervisor thing fully landed today; can we do that ?21:57
slaglelifeless: sure, if you're not worried about the disk space, i'm fine to +221:58
SpamapSlifeless: I'll start reviewing shortly.21:58
lifelessslagle: I'm not - thanks!21:58
openstackgerritA change was merged to openstack-infra/tripleo-ci: Build test environments for 2 hypervisors.  https://review.openstack.org/6955021:59
*** lblanchard has quit IRC22:13
*** cd-undercloud has joined #tripleo22:14
cd-undercloud************** overcloud complete status=0 ************22:14
*** cd-undercloud has quit IRC22:14
openstackgerritA change was merged to openstack/tripleo-heat-templates: Permit writing output to other than stdout.  https://review.openstack.org/6954522:17
*** jcoufal has joined #tripleo22:19
*** jcoufal has quit IRC22:28
ccrouchlifeless: i think we briefly discussed last week the fact that neutron is setup in the heat templates to use openvswitch with GRE in the overcloud.22:30
ccrouchif we could get it to work, would there be any objection to switching that to openvswitch + vxlan?22:30
ccrouchor does using vxlan require parameterizing the template and allowing people to pick either GRE or vxlan?22:30
*** e0ne has joined #tripleo22:31
*** jdob has quit IRC22:33
*** e0ne has quit IRC22:36
*** CaptTofu has quit IRC22:41
*** CaptTofu has joined #tripleo22:41
*** epim has joined #tripleo22:44
*** epim has quit IRC22:44
*** michchap has joined #tripleo22:45
*** michchap has quit IRC22:45
lifelessccrouch: hi so22:45
lifelessccrouch: vxlan would be a nice feature; I haven't read enough up about it to have an opinion about whether to change to it or support both22:45
*** michchap has joined #tripleo22:46
*** CaptTofu has quit IRC22:46
lifelessSpamapS: slagle: open reviews for this list: https://review.openstack.org/#/c/69549/22:50
*** michchap has quit IRC22:50
lifelesshttps://review.openstack.org/#/c/69548/22:50
ccrouchsomeone elsewhere mentioned a preference for vxlan, so we would have to could come up with enough reasons why it was better than GRE22:51
ccrouchi'm just wary of the extra work to support both GRE and vxlan.22:51
lifelesshttps://review.openstack.org/#/c/69547/22:51
lifelesshttps://review.openstack.org/#/c/69546/22:51
ccrouchi mean support either, via configuration22:51
lifelesshttps://review.openstack.org/#/c/69286/22:51
ccrouchthough i can see having that as a goal22:52
lifelessccrouch: I think it's certainly a goal22:56
lifelessbecause if we could only deploy one network layer, it would be a uge chilling effect foro other network vendors22:56
lifelessman, latency breaks my typing. gnarh22:56
*** jayg is now known as jayg|g0n322:59
*** cd-undercloud has joined #tripleo23:00
cd-undercloud************** overcloud complete status=0 ************23:00
*** cd-undercloud has quit IRC23:00
ccrouchagreed. I guess we would have to see if we could make a good enough argument to have vxlan be  the default. That would be a first step.23:00
ccrouchthen the next step would be letting you configure either.23:00
lifelesswell23:01
lifelesswe have gre working23:01
lifelessso I think the first step is to add vxlan as an option23:01
openstackgerritA change was merged to openstack/tripleo-heat-templates: Make debugging merge.py in the test suite possible.  https://review.openstack.org/6954623:01
lifelessthen we can armwrestle over defaults23:01
*** rollerj has quit IRC23:01
*** openstack has joined #tripleo23:04
greghaynesTo get os-collect-config --force --one to complete on my overcloud I had to add a killfilter to neutrons rootwrap.d/l3.filters so it could kill the l3 agent.. seems odd others havent run into that?23:11
*** matty_dubs is now known as matty_dubs|gone23:13
greghayneslifeless: tips on somewhere I might be able to help with new mvp? I was looking at the HA metadata API bit but not sure if its too early to poke away at23:13
SpamapSgreghaynes: regarding your o-c-c neutron fail.. can you file a bug report with the errors you saw? I don't want us to forget about it.23:14
greghayneson it23:15
lifelessgreghaynes: hey cool23:15
lifelessgreghaynes: I have run into that killfilter thing23:15
lifelessgreghaynes: just looking for where I jnonoted it23:17
SpamapSlifeless: while looking for a bugtracker to report git being stupid about pagers I found this: http://www.bugseverywhere.org/ ... ever seen that? "Distributed bug tracker"23:18
lifelessyup23:18
lifelessseen it23:18
*** bauzas has quit IRC23:19
lifelessdisagree with the complecting with the code base being tracked23:19
*** hewbrocca has quit IRC23:21
SpamapSlifeless: yeah code bases aren't necessarily 1:1 with applications23:21
lifelessnor bugs with point in time of code23:22
*** cwolferh has quit IRC23:22
lifelessgreghaynes: ok, I thought i twas a thing I'd see a ways back, but its new23:22
lifelessgreghaynes: so first thing I'd do is fix that upstream ;)23:23
greghayneshttps://bugs.launchpad.net/tripleo/+bug/127388223:23
lifelessgreghaynes: then, look at  https://trello.com/b/0jIoMrdo/tripleo and pick a card, put your name on it (not to 'claim it but to say you are pushing on that) and push.23:23
lifelessif folk are already pushing on it, talk with them to coordinate23:23
greghaynessweet :)23:23
lifelessgreghaynes: for https://bugs.launchpad.net/tripleo/+bug/1273882I'd add a neutron task, cause it's a neutron bug23:24
greghaynesI assume that means 'also affects project'23:26
lifelessyes23:26
*** julim has quit IRC23:27
*** noslzzp has joined #tripleo23:27
lifelessSpamapS: what parameter changes ?23:29
*** shakayumi has quit IRC23:31
*** michchap has joined #tripleo23:33
lifelessslagle: hey, can I ask a favour ?23:41
lifelessslagle: https://review.openstack.org/#/c/67343/9 needs a systemd unit added apparently - could you add one and push it up?23:41
StevenKSpamapS: http://paste.openstack.org/show/6205223:42
*** cwolferh has joined #tripleo23:42
*** cd-undercloud has joined #tripleo23:51
cd-undercloud************** overcloud complete status=1 ************23:51
*** cd-undercloud has quit IRC23:51
lifelessoooh23:53
lifelessWaiting for the overcloud stack to be ready23:54
lifeless/root/.ssh/known_hosts updated.23:54
lifelessOriginal contents retained as /root/.ssh/known_hosts.old23:54
lifelessTiming out - last probe output:23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!