Friday, 2014-01-31

*** CaptTofu_ has joined #tripleo00:05
*** cd-undercloud has joined #tripleo00:06
cd-undercloud************** overcloud complete status=1 ************00:06
*** cd-undercloud has quit IRC00:06
SpamapSmy ccache hit rate sucks on this build.. I wonder if some libc header changed00:07
*** CaptTofu has quit IRC00:08
*** cody-somerville has quit IRC00:10
SpamapShttps://blueprints.launchpad.net/heat/+spec/hot-select <-- might be a good enough reason on its own to move to HOT00:13
SpamapSWe could replace all that Fn::Select garbage with one call to get_attr.00:13
*** CaptTofu_ has quit IRC00:16
SpamapSok tested.. all tables are utf8 now00:20
SpamapSand heat works in my new seed00:22
SpamapSbnemec: thanks for raising the issue. :)00:22
*** TravT has joined #tripleo00:23
*** matsuhashi has joined #tripleo00:24
* SpamapS -> kids00:24
*** epim has joined #tripleo00:26
*** CaptTofu has joined #tripleo00:27
*** epim_ has joined #tripleo00:30
*** cd-undercloud has joined #tripleo00:30
cd-undercloud************** overcloud complete status=1 ************00:30
*** cd-undercloud has quit IRC00:30
*** epim has quit IRC00:30
*** epim_ is now known as epim00:30
lifelessSpamapS: why wouldn't select come into cfn too ?00:30
*** epim_ has joined #tripleo00:33
*** jhurlbert has quit IRC00:35
lifelessright00:35
*** epim has quit IRC00:35
*** epim_ is now known as epim00:35
lifelessnew car picked up00:35
openstackgerritlifeless proposed a change to openstack-infra/tripleo-ci: Run undercloud tests as well.  https://review.openstack.org/7026900:37
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Add package install support to cinder  https://review.openstack.org/7027100:39
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Install openstack-neutron-ml2  https://review.openstack.org/6988000:39
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Create /var/run/neutron  https://review.openstack.org/7002300:39
*** CaptTofu has quit IRC00:49
*** epim has quit IRC00:53
slaglelifeless: you around?00:53
lifelesshi00:54
slagleso...i'm not seeing a great way to get this /var/run/neutron dir created00:54
slagleany other thoughts?00:54
slaglei can drop a script into os-refresh-config, but that would only apply to the package install00:55
lifelessslagle: well, why isn't this needed for non-package installs ?00:55
lifelessslagle: and why would that script only apply to package installs ?00:55
StevenKlifeless: re -nova, I came to that conclusion last night, and I'd changed it with a comment.00:55
lifelessStevenK: changed it?00:55
slagleb/c the source installs create 2 servce files for every service: one called *-create-dir which creates the dir, and the other actual service file00:55
slaglesince i'm not using the source install, i don't get that first service00:55
slaglenor do i want it really00:56
lifelessslagle: is that a systemd thing ?00:56
slagleno, that's how someone who wrote the elements chose to do it :)00:56
lifelessI mean, is *-create-dir creating systemd files00:56
slagleoh, yes00:56
lifelessso, why doesn't that approach work for the packaged install ?00:57
StevenKlifeless: http://paste.openstack.org/show/6221100:57
slaglethe logic to add the create-dir services is os-svc-daemon, which i'm not using for the packaged installs00:58
slaglei could factor that out i suppose00:58
lifelessStevenK: looks good. btw, why do you paste rather than pushing ?00:58
slaglethen call it from the package install as well00:58
slagleas long as i could get the service deps right00:58
StevenKlifeless: Because I'm a terrible person and it's not finished -- needs a test00:59
lifelessStevenK: so? push, mark WIP00:59
*** CaptTofu has joined #tripleo00:59
lifelessStevenK: btw, the usual convention on collaborated patches isn't to do --reset-author, but to just add yourself as co-authored-by01:00
*** cwolferh has joined #tripleo01:00
lifelessStevenK: not a biggy either way, just struck me as odd when I lokoed at the other patch01:00
*** markmcclain has quit IRC01:01
*** markmcclain has joined #tripleo01:02
*** epim has joined #tripleo01:06
StevenKlifeless: Ah, so I'm backward. :-(01:09
lifelessStevenK: yeah - so imagine that there are three people collaborating01:09
lifelessStevenK: it would be a PITA if everyone that touches it last had to reset author.01:10
lifelessStevenK: and re-edit the list of collaborators01:10
*** epim has quit IRC01:11
openstackgerritA change was merged to openstack/tripleo-image-elements: Move heat-manage call to heat-engine  https://review.openstack.org/7025501:15
*** cwolferh has quit IRC01:15
*** cwolferh has joined #tripleo01:15
openstackgerritJames Slagle proposed a change to openstack/diskimage-builder: Update map-services for Fedora  https://review.openstack.org/7027701:22
*** CaptTofu_ has joined #tripleo01:31
*** CaptTofu has quit IRC01:31
*** markmcclain has quit IRC01:40
*** nosnos has joined #tripleo01:41
lifelessnuts02:03
lifelesstestenv2-testenv0-vgk5lo7tq6uf         | ERROR  | None       | NOSTATE     |                       |02:03
lifelessStderr: 'Error: Unable to establish IPMI v2 / RMCP+ session\\r\                                                                                                                               |02:03
lifelessdead machine ...  bad creds,s omething.02:06
lifelesstaking it out of service02:06
*** matsuhashi has quit IRC02:34
*** matsuhas_ has joined #tripleo02:37
*** newell has quit IRC02:38
*** panda_ has quit IRC02:41
*** panda_ has joined #tripleo02:43
*** cwolferh has quit IRC02:50
lifelessdoh02:50
lifelessneutron really was unhappy02:50
lifelessConnection to neutron failed: Maximum attempts reached02:50
lifelessfrom the testenv machine I just looked at02:50
lifelessand we've got two more badish machines - hung spawning02:51
lifelessid 40 and 3702:52
lifelessmarking bad, tearing testenvs down again02:52
openstackgerritlifeless proposed a change to openstack/tripleo-image-elements: Add a helper to deploy testenvironments.  https://review.openstack.org/7028502:58
lifelesspoor neutron02:58
*** matsuhashi has joined #tripleo03:07
*** matsuhas_ has quit IRC03:08
*** matsuhashi has quit IRC03:08
*** CaptTofu_ has quit IRC03:15
*** matsuhashi has joined #tripleo03:20
*** CaptTofu has joined #tripleo03:29
*** CaptTofu has quit IRC03:30
*** matsuhashi has quit IRC03:34
*** matsuhashi has joined #tripleo03:35
*** CaptTofu has joined #tripleo03:40
*** matsuhashi has quit IRC03:43
*** matsuhashi has joined #tripleo03:50
*** AaronGr is now known as AaronGr_Zzz04:03
*** CaptTofu has quit IRC04:31
*** spzala has quit IRC04:40
*** blamar has quit IRC04:40
*** blamar has joined #tripleo04:45
*** weshay has quit IRC04:57
*** akuznetsov has joined #tripleo05:00
*** coolsvap_away has quit IRC05:08
*** blamar has quit IRC05:13
*** vkozhukalov has joined #tripleo05:25
openstackgerritSteve Kowalik proposed a change to openstack/tripleo-heat-templates: Add a debian-mirror heat template  https://review.openstack.org/6854105:57
*** rwsu has quit IRC05:59
*** coolsvap has joined #tripleo06:12
*** e0ne has joined #tripleo06:19
*** jprovazn has joined #tripleo06:25
*** CaptTofu has joined #tripleo06:32
SpamapShrm.. failed devtest on some heat weirdness.. says heat_stack_user role didn't exist.. but it does...06:35
*** CaptTofu has quit IRC06:36
SpamapSgah, massively out of date seed.. wtf06:37
lifelessoh hai06:37
lifelessI can't figure out how derek ever got a test env to go live06:38
SpamapSwill power06:38
SpamapSits now or06:38
SpamapSneverrrrrr06:38
SpamapS;)06:38
lifelesssince it can't talk to neutron as neutron's endpoints are all on 13806:38
lifelessand its' deployed on the 10.*06:38
SpamapSlifeless: maybe it is talking to a different neutron?06:39
lifelessSpamapS: the ci-undercloud ?06:40
SpamapSlifeless: I'm really just reflecting things back at you.. 1 step above a teddy bear.06:41
lifelessSpamapS: teddy bears adsorb06:42
lifelessSpamapS: felt, not reflective :P06:42
SpamapSright... I'm like a mirror smeared with vaseline... reflecting your ideas, but making them more amorphous and less useful06:43
greghaynesThe evil rubber duck06:44
lifelessewwwwwwwwww06:44
lifelessDID NOT NEED THAT06:44
lifelesskeystone endpoint-list06:46
lifelesshanging06:46
lifeless...06:46
lifelessSpamapS: seen that before ?06:48
*** vkozhukalov has quit IRC06:51
lifelessselect count(*) from token;07:06
lifeless+----------+07:06
lifeless| count(*) |07:06
lifeless+----------+07:06
lifeless|    64224 |07:06
lifelessSpamapS: / devananda: / mordred: how do you identify db lock contention on mysql?07:07
mordreddepends07:08
lifelessdelete from token limit 5000;07:08
lifelessis hung07:08
mordredshow full processlist;07:08
mordredis a starting point07:08
mordredyou can also run "show engine innodb status;"07:09
mordredwhich will tell you about things that might be locked inside of innodb07:09
mordredalthough you might want to execute it as "show engine innodb status \G"07:10
lifelessgnar07:13
lifelessmordred: thanks07:13
lifelessnow onto ConnectionFailed: Connection to neutron failed: Maximum attempts reached07:13
lifelessok so ah - manual hostname override07:17
lifelesswe need to bake that in07:17
mordredlifeless: what is "manual hostname override" ?07:19
lifelessmordred: an entry in /hosts07:20
openstackgerritlifeless proposed a change to openstack-infra/tripleo-ci: Provide for adding a string to /etc/hosts.  https://review.openstack.org/7030407:28
*** akuznetsov has quit IRC07:33
SpamapSlifeless: did you figure out the token problem?07:35
lifelessSpamapS: think it was a false problem07:35
SpamapSah ok07:35
SpamapSit was just slow07:35
SpamapS?07:35
lifelessbad client signallin07:35
SpamapSah07:35
lifelesswas actually host resolution problem on one end07:38
lifelessand black hole routing on the other07:38
SpamapSlifeless: where are we actually relying on a sane response to gethostbyname() ?07:39
SpamapSor gethostinfo() I guess is the new hotness07:39
SpamapSbut you know what I mean. :)07:39
lifelesstheres no dns for the testenv servers07:39
lifelessand if there was we'd need split brain07:39
lifelessas they aren't internet routed07:39
lifelessSpamapS: will oac make directories as needeD?07:43
SpamapSlifeless: yes07:46
SpamapSthey'll just get root's umask07:46
SpamapSso 0755 I think07:46
SpamapSlifeless: https://git.openstack.org/cgit/openstack/os-apply-config/tree/os_apply_config/apply_config.py#n8107:47
*** shardy_afk is now known as shardy07:48
SpamapSlifeless: I'm about to head to bed. Anything you need before that?07:53
lifelessSpamapS: few more minutes and yu could review these :)07:55
lifelessSpamapS: but its fine, I'll hit up the europeans07:55
SpamapSlifeless: about to == 10 min or so07:56
lifelessSpamapS: any tricks off top of head07:59
lifelessSpamapS: for seeing if content X is in file Y w/out python07:59
lifelessor hmm, fuckit, python time07:59
SpamapSlifeless: sorry did you mean without grep? because...08:00
lifelessSpamapS: grep does regexs etc though,no ?08:00
SpamapSfgrep08:00
SpamapSaka grep -F08:00
lifelesshmm08:01
lifelessmight be good enough08:01
openstackgerritlifeless proposed a change to openstack/tripleo-image-elements: Permit injecting entries into /etc/hosts.  https://review.openstack.org/7030708:06
openstackgerritlifeless proposed a change to openstack/tripleo-image-elements: Add a helper to deploy testenvironments.  https://review.openstack.org/7028508:10
openstackgerritlifeless proposed a change to openstack/tripleo-image-elements: Permit injecting entries into /etc/hosts.  https://review.openstack.org/7030708:10
lifelessSpamapS: ok, if you want to unblock stuff I need08:10
*** markmc has joined #tripleo08:10
lifelesshttps://review.openstack.org/70307 + https://review.openstack.org/7030408:10
lifelessand their dependency stacks :)08:10
lifelessI'm now going to build an image and see if it works :P08:12
lifelessnuts still leaking tmpfs08:12
lifelessanyhoo08:12
SpamapSlifeless: sorry... too sleepy to be effective. g'nite08:15
lifelessSpamapS: gnight08:15
SpamapS(note that I got a working seed just now.. undercloud is still coming up)08:15
lifelesscool08:15
*** e0ne has quit IRC08:15
*** e0ne has joined #tripleo08:16
*** e0ne has quit IRC08:18
*** e0ne has joined #tripleo08:18
lifelessoh yay08:21
lifelesshttp://seclists.org/oss-sec/2014/q1/18708:21
*** e0ne has quit IRC08:23
*** panda has joined #tripleo08:25
*** jcoufal has joined #tripleo08:26
*** panda_ has quit IRC08:27
*** vkozhukalov has joined #tripleo08:29
*** CaptTofu has joined #tripleo08:33
*** matsuhashi has quit IRC08:37
*** CaptTofu has quit IRC08:37
*** jistr has joined #tripleo08:58
*** d0ugal has joined #tripleo08:58
*** d0ugal has joined #tripleo08:58
*** jcoufal has quit IRC09:00
*** bauzas has joined #tripleo09:07
*** bauzas has quit IRC09:07
*** bauzas has joined #tripleo09:07
*** rlandy has joined #tripleo09:19
*** jcoufal has joined #tripleo09:28
*** athomas has joined #tripleo09:35
*** e0ne has joined #tripleo09:38
*** e0ne has quit IRC09:42
*** e0ne_ has joined #tripleo09:42
*** matsuhashi has joined #tripleo09:44
*** d0ugal has quit IRC09:47
*** d0ugal has joined #tripleo09:48
*** markmc has quit IRC09:48
*** cody-somerville has joined #tripleo09:49
*** bauzas has quit IRC09:51
openstackgerritA change was merged to openstack/tripleo-image-elements: Delete stale file injection option.  https://review.openstack.org/7022609:55
GheRiverothe level of detail in the commits messages is really scarce lately :)09:56
*** matsuhashi has quit IRC10:05
*** e0ne_ has quit IRC10:05
*** bauzas has joined #tripleo10:05
*** e0ne has joined #tripleo10:05
*** athomas has quit IRC10:05
*** athomas has joined #tripleo10:12
lifelessahahahah10:14
lifelessGheRivero: sorry :(10:15
lifelessGheRivero: Please do push back and ask for more!10:15
*** martyntaylor has joined #tripleo10:16
*** matsuhashi has joined #tripleo10:16
ProfFalkenlol, at least it's concise and sets out the future for this option - I've seen project roadmaps (outside the OS community) with less content than that last commit... :P10:16
*** d0ugal has quit IRC10:18
*** martyntaylor has quit IRC10:20
*** gcha has joined #tripleo10:21
*** d0ugal has joined #tripleo10:32
*** bauzas has quit IRC10:33
*** CaptTofu has joined #tripleo10:33
lifelessright 10 TE machines running10:35
lifelessnext step is to scale up the ci-overcloud, which will be 'interesting'10:35
lifelesssince it doesn't have fullyautomated setup10:35
lifelessmay end up redoing from scratch.... still can wait10:35
lifelesscheck jobs are unblocked.10:36
lifelessttyl10:36
*** martyntaylor has joined #tripleo10:38
*** CaptTofu has quit IRC10:38
*** max_lobur_afk is now known as max_lobur10:39
*** akrivoka has joined #tripleo10:46
*** bauzas has joined #tripleo10:49
*** e0ne has quit IRC10:50
*** e0ne has joined #tripleo10:51
*** akuznetsov has joined #tripleo10:53
*** markmc has joined #tripleo10:53
*** e0ne has quit IRC10:55
*** bauzas has quit IRC10:58
*** cody-somerville has quit IRC11:17
*** jcoufal has quit IRC11:17
*** akuznetsov has quit IRC11:18
*** markmc has quit IRC11:24
*** akuznetsov has joined #tripleo11:30
*** lucasagomes has joined #tripleo11:37
*** bauzas has joined #tripleo11:39
*** viktors has joined #tripleo11:59
*** bauzas has quit IRC12:00
*** bauzas has joined #tripleo12:02
*** michchap has quit IRC12:05
*** michchap has joined #tripleo12:06
*** bauzas has quit IRC12:07
*** morazi has quit IRC12:10
*** michchap has quit IRC12:10
*** e0ne has joined #tripleo12:13
*** akrivoka has quit IRC12:17
*** akrivoka has joined #tripleo12:19
*** coolsvap has quit IRC12:24
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Install openstack-swift-object  https://review.openstack.org/7033512:29
*** CaptTofu has joined #tripleo12:34
*** CaptTofu has quit IRC12:39
*** bogdando has quit IRC12:39
*** akrivoka has quit IRC12:42
*** bogdando has joined #tripleo12:42
*** akrivoka has joined #tripleo12:44
*** CaptTofu has joined #tripleo12:55
*** e0ne has quit IRC12:57
*** julim has joined #tripleo13:00
*** morazi has joined #tripleo13:09
*** ProfFalken has quit IRC13:12
*** d0ugal has quit IRC13:19
*** d0ugal has joined #tripleo13:21
*** d0ugal has quit IRC13:24
*** d0ugal has joined #tripleo13:24
*** d0ugal has joined #tripleo13:24
Ngmorning13:31
*** michchap has joined #tripleo13:33
*** jdob has joined #tripleo13:38
*** michchap has quit IRC13:38
*** matsuhashi has quit IRC13:41
*** max_lobur is now known as max_lobur_afk13:49
*** matsuhashi has joined #tripleo13:50
*** e0ne has joined #tripleo13:50
*** bauzas has joined #tripleo13:54
*** matsuhashi has quit IRC13:57
* erwan_taf wonder how had the HP server problem here14:01
erwan_tafwho14:01
erwan_taflifeless: was it you ?14:01
*** morazi has quit IRC14:03
*** matsuhashi has joined #tripleo14:04
*** bauzas has quit IRC14:08
openstackgerritRonelle Landy proposed a change to openstack/tripleo-incubator: Documents workarounds for tmpfs space errors  https://review.openstack.org/7008014:14
rlandyslagle: thanks for your review comments/corrections. pls let me know if ^^ captures your suggested changes correctly.14:17
erwan_taf"Addressed an issue when using PXELinux to boot to the local hard drive instead of the network drive that can result in a Red Screen Illegal Opcode."14:17
erwan_taf\o/14:17
erwan_taflifeless: ^14:17
*** morazi has joined #tripleo14:18
*** CaptTofu has quit IRC14:21
*** rlandy has quit IRC14:23
*** lblanchard has joined #tripleo14:26
*** matty_dubs|gone is now known as matty_dubs14:27
*** bauzas has joined #tripleo14:27
*** jayg|g0n3 is now known as jayg14:27
*** matsuhashi has quit IRC14:28
*** nosnos has quit IRC14:37
*** weshay has joined #tripleo14:39
*** noslzzp has joined #tripleo14:40
*** morazi has quit IRC14:45
*** bauzas has quit IRC14:48
*** jcoufal has joined #tripleo14:56
*** morazi has joined #tripleo14:57
*** max_lobur_afk is now known as max_lobur15:09
*** rwsu has joined #tripleo15:13
*** ftcjeff has joined #tripleo15:19
*** lblanchard has quit IRC15:22
*** lblanchard has joined #tripleo15:23
*** lucasagomes is now known as lucas-hungry15:26
*** ko__ has joined #tripleo15:30
*** CaptTofu has joined #tripleo15:32
*** bnemec is now known as beekneemech15:33
*** markmcclain has joined #tripleo15:33
*** coolsvap has joined #tripleo15:38
*** michchap has joined #tripleo15:39
*** michchap has quit IRC15:44
*** AaronGr_Zzz is now known as AaronGr15:46
openstackgerritA change was merged to openstack/tripleo-incubator: Documents workarounds for tmpfs space errors  https://review.openstack.org/7008015:58
*** akrivoka has quit IRC16:00
*** vkozhukalov has quit IRC16:04
*** lucas-hungry is now known as lucasagomes16:28
matty_dubsslagle: Say, do you have any experience building images for EFI hosts? Deploying a diskimage-builder-built image appears to result in a kernel panic. I'm completely ignorant about how that works.16:28
matty_dubsIt's not actually a blocker for me; I was testing that Ironic could deploy with the PXE driver on bare metal, which it can. But I figured I'd poke into why I seem incapable of running images on EFI hosts.16:29
*** jistr has quit IRC16:30
slaglematty_dubs: no experience directly16:30
slaglematty_dubs: can just plain old Fedora 20 boot on the host?16:31
slaglelike from iso or whatever16:31
matty_dubsYeah16:31
matty_dubsThere was a bug when building for VMs where the image was non-EFI (I think), but configured to boot as EFI, and blew up. I'm seeing something similar on hardware deploys now.16:31
slaglehmm, ok, well i wonder if there are special EFI bits, and if those bits are in the Fedora cloud image16:31
slaglebecause we use the Fedora cloud image as the source for diskimage-builder16:31
matty_dubsOK, just finished another build, this time on F20. I'll try another deploy once I get the box registered.16:42
matty_dubsThe problem is that I know next to nothing about EFI.16:42
SpamapSThere are likely special EFI things in grub16:42
SpamapSmatty_dubs: I'd ping Matt Gerret about it if you can.16:43
*** gcha has quit IRC16:43
*** viktors has left #tripleo16:45
matty_dubsSpamapS: So is it fair to say that it's not something that's been tested with diskimage-builder? My issue is that I really have no idea where the problem lies, so I'm reluctant to end up wasting the wrong peoples' time.16:45
SpamapSmatty_dubs: We have not tested it with any of our servers no.16:47
SpamapSmatty_dubs: did the deploy ramdisk work?16:47
matty_dubsSpamapS: I'm going to redeploy to test that. I _think_ it may have.16:48
matty_dubsSpamapS: The other thing is that this isn't actually a blocker for me right now; I just figured I'd see if I could get it working (or reported if not) while I'm testing on a box that turns out to be UEFI-equipped.16:49
*** akrivoka has joined #tripleo16:49
*** CaptTofu has quit IRC16:50
*** akuznetsov has quit IRC16:50
*** e0ne has quit IRC16:52
*** e0ne has joined #tripleo16:53
*** jprovazn has quit IRC16:55
*** jcoufal has quit IRC16:55
*** e0ne has quit IRC16:57
*** markmcclain has quit IRC17:01
*** rbrady is now known as rbrady-afk17:03
*** martyntaylor has quit IRC17:04
*** jeremydei has quit IRC17:08
*** markmcclain has joined #tripleo17:09
*** cwolferh has joined #tripleo17:16
*** shakayumi has joined #tripleo17:18
*** matty_dubs is now known as matty_dubs|lunch17:19
*** shakayum_ has joined #tripleo17:21
*** shakayumi has quit IRC17:24
*** lblanchard has quit IRC17:24
openstackgerritA change was merged to openstack/tuskar-ui: Remove nodes method from Overcloud object  https://review.openstack.org/7014517:25
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Add needed swift storage dirs for packaged install  https://review.openstack.org/7038117:25
*** CaptTofu has joined #tripleo17:46
SpamapSERROR: The Parameter (notcomputeImage) was not defined in template.18:00
SpamapSanybody getting that with latest devtest when trying to build overcloud?18:00
*** CaptTofu_ has joined #tripleo18:01
*** CaptTofu has quit IRC18:01
SpamapSlooks like half-done stuff18:01
*** lblanchard has joined #tripleo18:02
*** akuznetsov has joined #tripleo18:05
*** sdague_ has joined #tripleo18:10
*** sdague has quit IRC18:10
*** sdague_ is now known as sdague18:11
*** markmcclain has quit IRC18:12
*** shakayum_ has quit IRC18:12
*** matty_dubs|lunch is now known as matty_dubs18:13
openstackgerritDougal Matthews proposed a change to openstack/python-tuskarclient: [WIP] - Add CLI/shell support for Overclouds  https://review.openstack.org/7038818:15
*** shakayumi has joined #tripleo18:16
*** rbrady-afk is now known as rbrady18:17
slagleSpamapS: didn't lifeless's patch change that to not*C*ompute ?18:18
slaglethat may have gotten missed18:18
SpamapSlooking18:18
*** akuznetsov has quit IRC18:19
SpamapSso in overcloud-source.yaml , it is just notcomputeImage18:19
SpamapSbut merge.py is for some reason changing that18:19
*** athomas has quit IRC18:20
SpamapSI think there may be some accidental case insensitive matches or something18:20
SpamapSyeah some weirdness is happening18:22
SpamapSnotcomputeImage is completely ansent from overcloud18:22
SpamapSreplaced by notCompute0Image18:22
*** michchap has joined #tripleo18:22
SpamapSeven weirder, it does this no matter what the image is for notCompute18:23
lifelessSpamapS: means I've got a bug somehere18:25
lifelesseither in docs or the code18:27
SpamapSlifeless: yeah, this case is not handled in the tests18:27
SpamapSCould be bad interaction with the rest of the monster. :-/18:27
*** michchap has quit IRC18:27
SpamapSlifeless: either way, overcloud is broken right now18:27
lifelesserwan_taf: we did have that yes18:27
SpamapSERROR: Property error : notCompute0: image_update_policy "" is not an allowed value [REBUILD, REPLACE, REBUILD_PRESERVE_EPHEMERAL]18:28
SpamapSoh no thats my problem n/m18:29
SpamapSlifeless:ERROR: Neither image nor bootable volume is specified for instance NovaCompute018:30
lifelessSpamapS: thoroughly broken huh? :)18:30
SpamapSno18:30
SpamapSthese are all my problems trying to do the steps myself18:30
SpamapSlifeless: no the only problem is the notCompute0Image in overcloud.yaml18:31
*** jog0 is now known as flashgordon18:32
lifelessnotCompute0Image? thats new18:32
lifelesshmm, i see18:33
SpamapScan't see how this template ever would work. :/18:34
SpamapSI mean it will, if you change the parameter names. :)18:34
openstackgerritJay Dobies proposed a change to openstack/tuskar: API controllers for icehouse domain model  https://review.openstack.org/6871618:34
* SpamapS wants gating so bad.. :-/18:35
*** akuznetsov has joined #tripleo18:35
lifelessSpamapS: Thats why I'm scaling up the ci infra18:35
SpamapSlifeless: what makes no sense to me, and why I think this is bad interaction with the rest of merge.py, is that if I change the name to not include the prefix, it still gets changed18:35
lifelessSpamapS: got 10 testenv nodes yesterday18:35
lifelessSpamapS: *blink*18:35
SpamapSlifeless: I think merge.py runs through the resources and horks with the params.18:36
SpamapSI know I wrote it and I should remember what it does.. but.. it was supposed to go away. Rapidly. :-/18:36
lifelessso scaling only looks for named keys/values18:36
SpamapSlesson learned: the worst code you write will be the longest lived.18:36
lifelesswe're not passing in a notCompute scale arg18:36
SpamapSfix_ref may be the culprit18:37
lifelessand in fact a non-1 scale request for notCompute doesn't work yet18:38
lifeless  File "./tripleo_heat_merge/merge.py", line 39, in apply_scaling18:38
lifeless    assert len(new_values) == 118:38
lifelessindicating there's more work needed (which we knew)18:38
lifelessSpamapS: I can't work on this today, sorry :(.18:41
greghaynesYerp, I was poking around that a bit yesterday18:41
greghaynesA little beyond my current understanding but been learning a lot about our heat stuff :)18:42
SpamapSlifeless: no worries I'm on it18:42
SpamapSlifeless: I think it may be something unrelated to your scaling code, and more to do with changes in the templates18:42
lifelessif you want more gating, approve https://review.openstack.org/#/c/70269/18:43
SpamapSI see what you did there18:43
lifeless(after debugging it, of course :P)18:43
lifelessbut I think it was broken by my having the test environments down for hours18:44
lifelessso rechecking it18:44
*** cody-somerville has joined #tripleo18:44
SpamapSlifeless: yeah so this is just merge.py doing things that are a bit magical18:45
SpamapSit basically hits resources with a hammer and makes the image parameter name match the resource name.18:46
lifelessnaughty18:48
lifelesscan we rip that out?18:48
SpamapSlifeless: thats exactly what I'm testing now18:48
lifelesshttp://logs.openstack.org/69/70269/1/check/check-tripleo-undercloud-precise/5713d63/console.html is a genuine failure I think18:50
lifelessit did run the undercloud ops but failed asking for a token from the seed18:50
SpamapSlifeless: looks like maybe it can18:50
lifelessOTOH as I say, I may have messed it18:50
*** newell has joined #tripleo18:51
*** ko__ has quit IRC18:51
*** e0ne has joined #tripleo18:51
lifelessok and ci-overcloud control plane needed it's link toggled because mellanox fail18:53
SpamapSlifeless: ok so this is behavior we have been testing all along, but it only is annoying when we change merged resources18:54
SpamapSperhaps my question about parameter changes was informed by my subconscious. ;)18:55
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Ability to add *-create-dir service seperately  https://review.openstack.org/7039918:59
*** CaptTofu_ has quit IRC19:01
slaglesight19:01
slagleone day i will learn how to spell separately19:01
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Ability to add *-create-dir service separately  https://review.openstack.org/7039919:02
*** spzala has joined #tripleo19:07
*** akuznetsov has quit IRC19:07
SpamapSlifeless: ok, merge.py.. going to hide the broken behavior behind a flag just in case somebody still wants it.19:07
tzumainnlifeless, ping19:08
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-heat-templates: Remove image parameter changing from merge  https://review.openstack.org/7040619:13
SpamapSgreghaynes: ^^ fixes overcloud generation19:13
greghaynes\O/19:13
SpamapSalso likely to break some things19:14
GheRiverofor those who have already been in HP Sunnyvale, any recomendation about a hotel for the mid-cycle?19:14
SpamapSaaaand more brokenness19:15
SpamapSexport OVERCLOUD_IP=$(nova list | grep notcompute.*ctlplane | sed  -e "s/.*=\\([0-9.]*\\).*/\1/")19:15
SpamapSneeds to be notCompute0 now19:15
SpamapSGheRivero: I think we should coordinate on that. My preference is the Hilton Santa Clara19:16
greghaynes+1 coordination19:16
SpamapSGheRivero: if we coordinate we can at least carpool. :)19:16
GheRivero+219:16
GheRiveroApproved :)19:16
SpamapSthere is one thing a little closer19:16
*** CaptTofu has joined #tripleo19:16
SpamapSbut it is.. meh19:16
SpamapS5 minute drive to the office. :)19:17
SpamapSor you can actually take a light rail, but that takes like 45 minutes19:17
GheRivero45 minutes? It's indeed in the middle of nowhere19:18
*** vkozhukalov has joined #tripleo19:19
*** markmcclain has joined #tripleo19:20
SpamapSGheRivero: http://goo.gl/maps/EabML19:20
SpamapSGheRivero: Sheraton Sunnyvale is the one that is "meh"19:21
SpamapSbut really, you don't end up saving any time.19:21
*** CaptTofu has quit IRC19:22
greghayneshah, I think I stayed there for pycon last year19:22
SpamapSalso it is the nearest hilton.. gold status ftw :)19:22
SpamapSgreghaynes: yeah that is the overflow hotel for pycon19:23
SpamapSgreghaynes: make sure to setup your hilton honors gold thing before you book :)19:23
clarkbif I ever go back staying in that hilton for light rail19:23
clarkbthen I don't need a car19:23
greghayneshehe19:23
clarkbSpamapS: that promo ended19:23
SpamapSall it really gets you is free crappy breakfast :p19:23
SpamapSclarkb: wha?19:23
SpamapSnewbies don't get it?19:23
clarkbSpamapS: let me rephrase, the documentation said it ended Dec 31st. I did it early january and I seem to have gotten gold anyways19:23
clarkbso it is derpy19:23
SpamapSweird19:24
clarkbmaybe they renewed it without updating the landing page with the disclaimer at the bottom?19:24
pleia2documentation on the intranet not being updated? say it ain't so :)19:24
clarkbno this was on the hilton side19:24
pleia2ah19:24
pleia2the breakfast in perth was good19:25
SpamapSThe breakfast at the Hilton SC is very, very meh19:27
greghaynesIts also kind of a food desert there19:28
SpamapSIn fact when I've stayed there in the past I've often popped over to IHOP.. ;)19:28
pleia2I kind of prefer us doing sprints in Seattle, takes me at least 2 hours to get down to sunnyvale office from SF :\19:28
SpamapSwe have enough coming, we may want to get our admin peeps to book a block of rooms19:28
SpamapSpleia2: haha, probably faster to get to Seattle via SFO ;)19:29
pleia2srsly19:29
greghaynesNeat thing I found about seattle office too - you can walk from amtrak to downtown office19:29
greghaynesalthough that might only be useful for pdxers19:29
SpamapSgreghaynes: yeah .. DT offices ftw19:29
SpamapSDreamHost's offices are 1 block from the DT metro stop in LA... I can take the bus -> redline in almost less time than I can drive and park there.19:30
*** CaptTofu has joined #tripleo19:30
*** max_lobur is now known as max_lobur_afk19:32
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Fix grep for notCompute in devtest_overcloud  https://review.openstack.org/7041519:32
*** CaptTofu_ has joined #tripleo19:36
*** CaptTofu has quit IRC19:37
*** CaptTofu_ has quit IRC19:42
SpamapSaaand cloud-init failed to contact nova api20:00
SpamapS:-/20:00
lifelessSpamapS: https://jenkins02.openstack.org/job/check-tripleo-undercloud-precise/60/console seems to be going well20:00
lifelesswoo20:03
lifeless2014-01-31 20:03:22.816 | | 8910f243-da19-47b6-a68e-1f7d052a5bed | undercloud | CREATE_IN_PROGRESS | 2014-01-31T20:06:27Z |20:03
lifelessbbiaw but damn it +A that :p20:03
rbradyAnybody: What's the process for configuring my overcloud to talk to remote/external services (like an NFS server)?20:07
*** michchap has joined #tripleo20:11
*** michchap has quit IRC20:15
SpamapSrbrady: add an element to install any client code, and change config templates to support a new Metadata section configuring it to point at the external service.20:16
*** lucasagomes has quit IRC20:18
* SpamapS rips it all back down20:20
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Make wait_for print out command on timeout.  https://review.openstack.org/6991520:24
*** CaptTofu has joined #tripleo20:26
SpamapSalright, off to run errands20:32
ccrouchSpamapS: I think rbrady was meaning was there anything specific you had to do from a networking stand point20:32
ccrouchto enable access from the overcloud to something which was not undercloud/overcloud20:33
*** vkozhukalov has quit IRC20:34
*** ccrouch has quit IRC20:47
*** matty_dubs is now known as matty_dubs|gone20:47
*** lblanchard has quit IRC20:51
slaglerbrady: are you asking in the context of devtest specifically? or just generally?21:00
slaglethe overcloud in devtest is only routed to 192.0.2.*21:00
slagleso if the service is somewhere else and not running locally in that subnet, you have no connectivity21:01
slaglein a real deployment, the overcloud is likely to have multiple interfaces that could have any connectivity/routes really21:01
rbradyslagle: to test something, I need that external connectivity21:08
rbradyI'm looking at masquerading all outgoing traffic.  I think.21:09
*** ccrouch has joined #tripleo21:10
rbradyslagle: the host is still reachable at 192.168.122.1, right?21:10
slagleyea, should be21:11
rbradyslagle: I can probably use that for the test, but out of curiosity is there a simple way just to open up the overcloud to outgoing traffic?21:12
rbradyslagle: iptables -t nat -A POSTROUTING -o virbr0 -j MASQUERADE ?21:13
*** bauzas has joined #tripleo21:23
openstackgerritA change was merged to openstack-infra/tripleo-ci: Run undercloud tests as well.  https://review.openstack.org/7026921:23
slaglerbrady: either that or a forwarding rule21:28
openstackgerritA change was merged to openstack/tripleo-image-elements: Fix mysql installation on openSUSE  https://review.openstack.org/6827821:30
*** e0ne has quit IRC21:37
*** jdob has quit IRC21:40
*** openstackgerrit has quit IRC21:53
*** openstackgerrit has joined #tripleo21:53
*** michchap has joined #tripleo22:00
*** michchap has quit IRC22:05
*** rbrady is now known as rbrady-afk22:14
*** shakayumi has quit IRC22:14
*** shakayumi has joined #tripleo22:14
*** jamezpolley has quit IRC22:35
*** morazi has quit IRC22:42
*** d0ugal_ has joined #tripleo22:46
*** d0ugal has quit IRC22:49
pleia2getting timeouts in the tripleo cloud again :\23:05
*** CaptTofu has quit IRC23:07
NobodyCamGood after noon TripleO23:29
NobodyCamanyone seeing a pip wheel error (pip's wheel support requires setuptools >= 0.8 for dist-info support.) running install-dependencies23:29
clarkbwheels are relatively new, if you want to use them you need new setuptools23:32
clarkbNobodyCam: try a pip install --upgrade setuptools23:32
NobodyCami did that23:33
NobodyCamhumm23:38
NobodyCampip install -U 'setuptools>=1.0'23:38
NobodyCamclarkb: 2.1 is latest?23:40
clarkbthat should be new enough23:43
*** CaptTofu has joined #tripleo23:48
*** bauzas has quit IRC23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!