Sunday, 2014-03-02

*** CaptTofu has quit IRC00:03
*** d0ugal has joined #tripleo00:04
*** cody-somerville has joined #tripleo00:05
*** cody-somerville has joined #tripleo00:05
*** rbrady-afk has joined #tripleo00:11
*** CaptTofu has joined #tripleo00:17
*** cd-undercloud has joined #tripleo00:18
cd-undercloud************** overcloud complete status=1 ************00:18
*** cd-undercloud has quit IRC00:18
*** cd-undercloud has joined #tripleo00:46
cd-undercloud************** overcloud complete status=7 ************00:46
*** cd-undercloud has quit IRC00:46
lifelessfungi: yesterday, when you said infra's nodepool was saturated by rax stuff01:02
lifelessfungi: AFAIK it hasn't been down sine01:02
lifelessfungi: poking from the airport01:02
*** julim has joined #tripleo01:04
lifelessfungi: fungi I just spawneda new instance and sshed into it01:05
lifelessfungi: and I'm pulling an iso at 20MBps01:06
lifelessfungi: 11s for fedora01:06
lifelessfungi: so networking is well, working.01:06
lifelessSpamapS: tag - can you liase with fungi/clarkb etc to get slaves running?01:07
lifelessthe cloud is AFAICT finel.01:07
*** julim has quit IRC01:09
openstackgerritlifeless proposed a change to openstack/os-cloud-config: First post.  https://review.openstack.org/7737801:09
mordredwhat's os-cloud-config?01:15
*** rwsu has joined #tripleo01:20
*** cd-undercloud has joined #tripleo01:27
cd-undercloud************** overcloud complete status=1 ************01:27
*** cd-undercloud has quit IRC01:27
*** DuncanT has quit IRC01:29
*** DuncanT- has joined #tripleo01:30
*** CaptTofu has quit IRC01:31
tchaypoI'm trying to figure out why the `heat create-stack undercloud` step fails; the most meaningful error message I've found so far is01:46
tchaypo2014-03-02 01:42:29.796 3108 ERROR nova.api.metadata.handler [-] Failed to get metadata for ip: 192.0.2.201:46
tchaypolooking at `nova network-show ctlplane` it seems strangely devoid of information - just an id and a label01:47
tchaypoI'm guessing the two things are related01:47
*** CaptTofu has joined #tripleo01:58
tchayponope, it looks like 192.0.2.0/24 is declared in neutron, not nova.02:07
*** cd-undercloud has joined #tripleo02:10
cd-undercloud************** overcloud complete status=1 ************02:10
*** cd-undercloud has quit IRC02:10
*** cd-undercloud has joined #tripleo02:13
cd-undercloud************** overcloud complete status=7 ************02:13
*** cd-undercloud has quit IRC02:13
*** sseago has quit IRC02:17
*** sseago has joined #tripleo02:17
*** cd-undercloud has joined #tripleo02:22
cd-undercloud************** overcloud complete status=7 ************02:22
*** cd-undercloud has quit IRC02:22
*** CaptTofu has quit IRC02:27
*** cd-undercloud has joined #tripleo02:32
cd-undercloud************** overcloud complete status=7 ************02:32
*** cd-undercloud has quit IRC02:32
*** rwsu has quit IRC03:06
*** cd-undercloud has joined #tripleo03:22
cd-undercloud************** overcloud complete status=1 ************03:22
*** cd-undercloud has quit IRC03:22
*** CaptTofu has joined #tripleo03:43
lifelesstchaypo: failed to get metadata is indeed odd03:49
lifelesstchaypo: what emits that message and underst what circumstances?03:49
lifelesstchaypo: also, did you travel get organised?03:50
lifelessmordred: ping03:50
lifelessmordred: what should setup.py look like in my os-cloud-config review ?03:50
lifelessmordred: also, what are we turning up at your place?03:59
*** cd-undercloud has joined #tripleo04:00
cd-undercloud************** overcloud complete status=1 ************04:00
*** cd-undercloud has quit IRC04:00
lifelesss/what/what time/04:03
*** marun has joined #tripleo04:11
*** CaptTofu has quit IRC04:18
openstackgerritlifeless proposed a change to openstack/os-cloud-config: First post.  https://review.openstack.org/7737804:29
*** marun has quit IRC04:31
*** cd-undercloud has joined #tripleo04:38
cd-undercloud************** overcloud complete status=1 ************04:38
*** cd-undercloud has quit IRC04:38
*** cd-undercloud has joined #tripleo04:41
cd-undercloud************** overcloud complete status=7 ************04:41
*** cd-undercloud has quit IRC04:41
*** lazy_prince is now known as killer_prince04:45
openstackgerritlifeless proposed a change to openstack/os-cloud-config: First post.  https://review.openstack.org/7737804:46
openstackgerritlifeless proposed a change to openstack/os-cloud-config: First post.  https://review.openstack.org/7737805:00
openstackgerritlifeless proposed a change to openstack/os-cloud-config: First post.  https://review.openstack.org/7737805:05
lifelessok ^ is ready for reviews. yayayayayay05:07
tchaypolifeless: looking into the logs more, I found this as well:05:07
tchaypo2014-03-02 02:31:00.132 2485 WARNING keystone.common.wsgi [-] Could not find credential, 7ddd72de4d958f6b42ca7d4a7011a6c605007fdac2e1a0e7a76c97b221d45271.05:07
lifelessthat seems ominous indeed05:08
tchaypothe former message was from nova-api.log, the latter from keystone.log, both at the same time while `heat-stack create undercloud` is busy failing.05:08
tchaypoMy suspicion is that somewhere along the way nova has ended up with the wrong credential, which would explain both messages.05:08
lifelesstchaypo: did you get travel organised ?05:08
lifelesstchaypo: alt: did travel for you, get organised?05:09
tchaypoI've been running the devtest_* scripts by hand one at a time though, so I'm assuming that could be my mistake... except that I've just run devtest.sh to eliminate any chance of me getting things out of order, and it's failed at the same place05:09
lifelessthis could be a regression, without CI though I can't trivially point at a working tip rev05:10
tchaypoYes, I'm in wild palms now. Once I got set up on wednesday I booked the flights, and got the stern "you should have booked this >21 days" warnings as expected05:10
lifelessthe way metadata is meant to work05:10
lifelesstchaypo: oh nice, I'm still in AKL05:10
lifelessso the way metadata works for us05:10
lifelessfor undercloud deploy05:10
lifelesswe can't use the neutron agent05:10
lifelessso we're just hitting the nova API directly05:11
lifelessand it's using our IP05:11
lifelessshouldn't be any keystone interactions there, as our request will be anonymous05:11
lifelessof course, who knows!05:11
lifelesslets have a look at nova commits in the last wek05:11
tchayposo the "couldn't find 192.0.2.2" message, probably means "I got this requiest from this weird IP that I know nothing about"?05:12
lifelesspossibly05:12
lifelessyou could look it up  in the code ;)05:12
lifelesscommit cb310143535501dddd50ed09a824d948b4ae23dc05:12
lifelessDate:   Fri Feb 28 09:07:46 2014 +000005:13
lifeless    Merge "Refactoring metadata/base"05:13
lifelessseems awfully coicidental05:13
lifelesscommit d98bb1705ac5cce044c5bd7594ceebb420ebf06805:13
lifeless is the actual change05:13
lifelessyou might try building a seed without that commit (or live editing your running seed to back that out)05:13
lifelessto build a seed without that commit, easiest way is to make a proposed revert for it in gerrit05:14
lifelessand use source-repositories to reference your review05:14
tchaypong pointed me at heat event-list which let me get a tiny bit more detail out of heat, but not much05:15
lifelesswhat you may not know is that there is approx zero test coverage of the metadata api in nova today05:16
tchaypo in this most recent failure, `nova list` actually shows an active undercloud server05:17
lifelessthis is consistent with a nova metadata api regresion05:18
lifelesstl;dr tempest only has one configuration that tests metadata server and that tests it via the neutron agent - so signed requests, not direct use.05:18
lifelessAnd there was a change to the metadata code landed on friday.05:19
lifelessso yeah - strong recommendation to build without d98bb1705ac5cce044c5bd7594ceebb420ebf068 in your nova05:19
lifelessI have to run ~now.05:19
* lifeless goes05:19
tchaypoI have to sleep, but I'll try that out in the morning :)05:20
*** cd-undercloud has joined #tripleo05:24
cd-undercloud************** overcloud complete status=1 ************05:24
*** cd-undercloud has quit IRC05:24
*** e0ne has quit IRC05:47
*** cd-undercloud has joined #tripleo05:59
cd-undercloud************** overcloud complete status=1 ************05:59
*** cd-undercloud has quit IRC05:59
*** marun has joined #tripleo06:09
*** jcooley_ has joined #tripleo06:14
*** CaptTofu has joined #tripleo06:19
*** CaptTofu has quit IRC06:24
*** jcooley_ has quit IRC06:24
*** jcooley_ has joined #tripleo06:24
*** rsacharya has quit IRC06:29
*** jcooley_ has quit IRC06:29
*** rsacharya has joined #tripleo06:34
*** rsacharya has quit IRC06:37
*** killer_prince is now known as lazy_prince06:41
*** cd-undercloud has joined #tripleo06:42
cd-undercloud************** overcloud complete status=1 ************06:42
*** cd-undercloud has quit IRC06:42
*** rsacharya has joined #tripleo06:58
*** rsacharya has quit IRC07:02
*** jcooley_ has joined #tripleo07:12
*** akuznetsov has quit IRC07:12
*** akuznetsov has joined #tripleo07:14
*** jcooley_ has quit IRC07:18
*** lazy_prince is now known as killer_prince07:19
*** rsacharya has joined #tripleo07:19
*** cd-undercloud has joined #tripleo07:21
cd-undercloud************** overcloud complete status=1 ************07:21
*** cd-undercloud has quit IRC07:21
*** rsacharya has quit IRC07:36
*** rsacharya has joined #tripleo07:41
*** rsacharya has quit IRC07:47
*** killer_prince is now known as lazy_prince07:53
*** rsacharya has joined #tripleo07:55
*** vkozhukalov has joined #tripleo07:56
*** cd-undercloud has joined #tripleo07:57
cd-undercloud************** overcloud complete status=1 ************07:57
*** cd-undercloud has quit IRC07:57
*** vkozhukalov has quit IRC08:03
*** rcarrillocruz has joined #tripleo08:12
*** rcarrillocruz1 has quit IRC08:13
*** CaptTofu has joined #tripleo08:20
*** CaptTofu has quit IRC08:24
*** rcarrillocruz1 has joined #tripleo08:29
*** rcarrillocruz has quit IRC08:32
*** cd-undercloud has joined #tripleo08:36
cd-undercloud************** overcloud complete status=1 ************08:36
*** cd-undercloud has quit IRC08:36
*** e0ne has joined #tripleo08:42
*** e0ne has quit IRC08:47
*** e0ne has joined #tripleo08:47
*** rlandy has joined #tripleo08:51
*** rcarrillocruz has joined #tripleo08:59
*** rcarrillocruz1 has quit IRC09:01
*** jcooley_ has joined #tripleo09:04
*** jcooley_ has quit IRC09:09
*** cd-undercloud has joined #tripleo09:14
cd-undercloud************** overcloud complete status=1 ************09:14
*** cd-undercloud has quit IRC09:14
*** akuznetsov has quit IRC09:22
*** ramishra has joined #tripleo09:31
*** lazy_prince is now known as killer_prince09:36
*** cd-undercloud has joined #tripleo09:44
cd-undercloud************** overcloud complete status=128 ************09:44
*** cd-undercloud has quit IRC09:44
*** panda has joined #tripleo09:54
*** akuznetsov has joined #tripleo09:56
*** panda___ has quit IRC09:57
*** jcooley_ has joined #tripleo10:00
*** ramishra has quit IRC10:02
*** jcooley_ has quit IRC10:04
*** panda has quit IRC10:05
*** killer_prince2 has joined #tripleo10:07
*** cd-undercloud has joined #tripleo10:19
cd-undercloud************** overcloud complete status=1 ************10:19
*** cd-undercloud has quit IRC10:19
*** panda has joined #tripleo10:20
*** CaptTofu has joined #tripleo10:21
*** rcarrillocruz1 has joined #tripleo10:23
*** rcarrillocruz has quit IRC10:25
*** CaptTofu has quit IRC10:25
*** killer_prince2 has quit IRC10:28
*** killer_prince is now known as lazy_prince10:33
*** e0ne has quit IRC10:35
*** e0ne has joined #tripleo10:36
*** e0ne has quit IRC10:37
*** e0ne has joined #tripleo10:40
*** cd-undercloud has joined #tripleo10:49
cd-undercloud************** overcloud complete status=7 ************10:49
*** cd-undercloud has quit IRC10:49
*** cd-undercloud has joined #tripleo11:15
cd-undercloud************** overcloud complete status=128 ************11:15
*** cd-undercloud has quit IRC11:15
*** rcarrillocruz has joined #tripleo11:17
*** rcarrillocruz1 has quit IRC11:20
*** e0ne has quit IRC11:36
*** CaptTofu has joined #tripleo11:44
*** rcarrillocruz1 has joined #tripleo11:45
*** rcarrillocruz has quit IRC11:46
*** cd-undercloud has joined #tripleo11:53
cd-undercloud************** overcloud complete status=1 ************11:53
*** cd-undercloud has quit IRC11:53
*** cd-undercloud has joined #tripleo12:21
cd-undercloud************** overcloud complete status=128 ************12:21
*** cd-undercloud has quit IRC12:21
*** rcarrillocruz has joined #tripleo12:40
*** rcarrillocruz1 has quit IRC12:42
*** e0ne has joined #tripleo12:52
*** e0ne has quit IRC12:54
*** CaptTofu has quit IRC13:02
*** cd-undercloud has joined #tripleo13:04
cd-undercloud************** overcloud complete status=1 ************13:04
*** cd-undercloud has quit IRC13:04
*** akuznetsov has quit IRC13:11
*** akuznetsov has joined #tripleo13:12
*** e0ne has joined #tripleo13:17
*** e0ne has quit IRC13:30
*** cd-undercloud has joined #tripleo13:40
cd-undercloud************** overcloud complete status=1 ************13:40
*** cd-undercloud has quit IRC13:40
*** cd-undercloud has joined #tripleo14:20
cd-undercloud************** overcloud complete status=1 ************14:20
*** cd-undercloud has quit IRC14:20
Ngmorning all14:43
greghaynesO/14:43
greghaynesYou stateside?14:43
Nggreghaynes: yep, got to the hotel yesterday afternoon14:44
Ngpondering what to do with my day14:44
greghaynesmmm. Im on plane right now14:44
greghaynesso ill be there in not long :)14:44
greghaynesLet me know if you find somewhere to get some hacking done because ill be looking for the same in a couple hrs14:44
Nggreghaynes: I was pondering whether to be a lazy person and just watch movies in my room, or to head into SF and wander around for the day ;)14:45
greghaynesoo14:45
NgI got a good night's sleep, but I wouldn't say my brain is hack-ready just yet14:45
greghaynesSF isn ta bad city to wander14:46
NgI have no particular aims there, it just seems slightly healthier for my soul if I at least spend my rest day getting a bit of air and sun ;)14:47
*** CaptTofu has joined #tripleo15:03
*** slagle_ has quit IRC15:06
*** CaptTofu has quit IRC15:07
*** cd-undercloud has joined #tripleo15:20
cd-undercloud************** overcloud complete status=1 ************15:20
*** cd-undercloud has quit IRC15:20
*** jcooley_ has joined #tripleo15:24
*** rcarrillocruz1 has joined #tripleo15:25
*** rcarrillocruz has quit IRC15:27
*** jcooley_ has quit IRC15:28
*** panda__ has joined #tripleo15:45
*** cd-undercloud has joined #tripleo15:46
cd-undercloud************** overcloud complete status=128 ************15:46
*** cd-undercloud has quit IRC15:46
*** panda has quit IRC15:48
*** rcarrillocruz has joined #tripleo15:59
Nghmm, the SF plan is rapidly receding as an option, looks like it'll take 2 hours to get there on public transit :/16:01
*** rcarrillocruz1 has quit IRC16:02
clarkbya that is about accurate16:04
*** panda has joined #tripleo16:06
*** panda__ has quit IRC16:09
*** tzumainn_ has quit IRC16:24
*** cd-undercloud has joined #tripleo16:27
cd-undercloud************** overcloud complete status=1 ************16:27
*** cd-undercloud has quit IRC16:27
*** CaptTofu has joined #tripleo17:03
*** cd-undercloud has joined #tripleo17:06
cd-undercloud************** overcloud complete status=1 ************17:06
*** cd-undercloud has quit IRC17:06
*** CaptTofu has quit IRC17:08
*** cody-somerville has quit IRC17:13
*** rcarrillocruz1 has joined #tripleo17:19
*** rcarrillocruz has quit IRC17:21
*** rcarrillocruz has joined #tripleo17:24
*** rcarrillocruz1 has quit IRC17:24
*** adrian17od has joined #tripleo17:29
*** adrian17od has left #tripleo17:31
*** adrian17od has joined #tripleo17:32
*** adrian17od has left #tripleo17:33
*** rcarrillocruz1 has joined #tripleo17:38
*** rcarrillocruz has quit IRC17:40
*** cd-undercloud has joined #tripleo17:43
cd-undercloud************** overcloud complete status=1 ************17:43
*** cd-undercloud has quit IRC17:43
*** e0ne has joined #tripleo17:49
*** e0ne has quit IRC18:03
*** jcooley_ has joined #tripleo18:06
*** jcooley_ has quit IRC18:11
*** cd-undercloud has joined #tripleo18:26
cd-undercloud************** overcloud complete status=1 ************18:26
*** cd-undercloud has quit IRC18:26
*** rlandy has quit IRC18:28
*** cd-undercloud has joined #tripleo18:29
cd-undercloud************** overcloud complete status=128 ************18:29
*** cd-undercloud has quit IRC18:29
openstackgerritBen Kero proposed a change to openstack/tripleo-incubator: add mkdir ~/.ssh/ to install-dependencies script  https://review.openstack.org/7744518:40
*** jcooley_ has joined #tripleo18:48
*** jcooley_ has quit IRC18:50
*** jcooley_ has joined #tripleo18:56
* greghaynes wonders if there are any good lunch ideas around hotel19:02
*** CaptTofu has joined #tripleo19:04
* GheRivero leaving SLC finally!19:08
*** CaptTofu has quit IRC19:09
*** cd-undercloud has joined #tripleo19:13
cd-undercloud************** overcloud complete status=1 ************19:13
*** cd-undercloud has quit IRC19:13
*** jcooley_ has quit IRC19:15
tchaypoThere's a Wendy's right across the road from the hotel19:16
tchaypooh wait, you said "good"19:16
* tchaypo recycles old jokes19:16
tchaypoIf you like indian, there are about a dozen places within an easy walk19:18
greghayneshehe19:18
greghaynesooo19:18
tchaypoIf you like japanese or korean, only about a half dozen19:18
greghayneshave you tried any of them yet?19:18
tchaypoI had lunch at Ariake yesterday, and Ng and I had dinner at Blue Ocean19:20
greghaynesresults?19:21
greghaynes:p19:21
greghaynesTheres a persian place that looks ok19:21
Ngblue ocean was nice19:21
tchaypoAriake is cheap'n'cheerful19:22
greghayneswait, you double sushid yesterday?19:22
greghaynesim jealous19:22
GheRiverois there any public transport from the airport to the hotel?19:25
*** e0ne has joined #tripleo19:25
tchayponope, double japanese. a bento for lunch and udon for dinner19:25
greghaynesah. Still jealous :p19:26
tchaypoGheRivero: I caught a taxi, was about $35. There were shuttles waiting at the airport as well, probably cheaper.19:28
tchaypoGheRivero: http://www.flysanjose.com/fl/travelers.php?page=ground_trans/public&subtitle=Ground+Transportation+%7C+Public+Transportation19:28
NgGheRivero: I just grabbed an Uber :)19:28
greghaynesTheres uber down here!?19:28
greghaynes\O/19:28
GheRiverouber?19:29
Nggreghaynes: yup19:29
NgGheRivero: it's like a taxi, but you book it with an app on your phone and it's all futurey and magical ;)19:29
greghaynesFinally got to try it in seattle the other weekend, was awesome19:29
Ng(and they do direct billing to your credit card, so you can just have the trips go right to your corp amex \o/ )19:30
tchaypoIf you have one *grumble*19:30
tchaypo(if this wasn't IRC it would be easier to tell that I'm not actually grumbling)19:32
tchaypoI was going to ask ng to explain what lifeless meant by "make a gerrit review and use source-repositories", but then I used google instead19:34
tchaypoand ng answered anyway - http://lists.openstack.org/pipermail/openstack-dev/2013-December/022895.html19:34
Ng:D19:36
tchaypoIt turns out my noise-cancelling headphones do a good job, even without the noise cancelling turned on. Housekeeping lady and I were equally shocked when she walked around the corner after cleaning the bathroom and found me sitting at the desk19:45
greghayneshaha19:46
*** cd-undercloud has joined #tripleo19:51
cd-undercloud************** overcloud complete status=1 ************19:51
*** cd-undercloud has quit IRC19:51
*** hashar_ has joined #tripleo19:51
greghaynesok, I think im going to walk down to house of pho in 15 or so if anyone wants to join for vietnameese lunch19:53
tchaypomeet in lobby?19:59
greghaynesyep19:59
* greghaynes -> lobby20:02
StevenKAww, am I too late?20:10
Nghey StevenK20:14
*** cd-undercloud has joined #tripleo20:17
cd-undercloud************** overcloud complete status=7 ************20:17
*** cd-undercloud has quit IRC20:17
StevenKNg: O HAI20:20
tchaypogreghaynes and I are back in the lobby20:23
* GheRivero landed20:23
tchaypoNg: joining us?20:23
Ngtchaypo: are you just hanging out in the lobby? I'm trying to figure out what to get for lunch20:27
Ngand whether I can muster up the motivation to Uber over to Cupertino to catch a movie ;)20:27
tchaypoYes, hanging out. Come down now!20:27
*** e0ne has quit IRC20:28
Ngtchaypo: I need to sort some stuff out here, I'll wander over in a bit20:29
tchaypolifeless: So about that car...20:37
*** hashar_ has quit IRC20:45
*** cd-undercloud has joined #tripleo20:51
cd-undercloud************** overcloud complete status=1 ************20:51
*** cd-undercloud has quit IRC20:51
* GheRivero hotel, sweet hotel21:00
*** CaptTofu has joined #tripleo21:05
*** CaptTofu has quit IRC21:10
*** e0ne has joined #tripleo21:20
SpamapSo/21:31
*** cd-undercloud has joined #tripleo21:31
cd-undercloud************** overcloud complete status=1 ************21:31
*** cd-undercloud has quit IRC21:31
Nghey SpamapS, just get in?21:32
SpamapSNg: heck no21:32
SpamapSI have a 50 minute flight21:32
SpamapSI leave LAX at 9:50 arrive SJC 10:50 :)21:33
SpamapSOddly enough running around putting buckets under my leaks and fretting about the rainfall has left me feeling like I'm jet lagged.. ;)21:33
Ngerk21:34
Ngwe're just having our roof room remodelled and as they stripped everything back, they found a few gaps in the roof ;(21:34
Ngstupid houses!21:34
SpamapSI knew my roof leaked when I bought the place.21:35
SpamapSFixed a few obvious leaks21:35
SpamapSbut we had 4" of rain in ~24 hours .. which is highly unusual.. and it ended up backing up the drains on the roof and leading to unique leaks..21:35
SpamapSand also it appears my tar patch in the most obious hole was eaten away by mulching leaves21:36
SpamapSwhich I knew would happen..21:36
SpamapSSo in a bit here I'm going to drill a hole in the sheet rock and see if there is water trapped in that wall. :-/21:36
SpamapSand if so.. drain it, make bigger holes, and rent an industrial dryer21:36
SpamapSand hope I don't have to replace all the drywall/insulation :-P21:37
tchaypoin tripleo-related news21:40
tchaypoi can't virsh console to my baremetal node21:40
SpamapStchaypo: fail21:41
tchaypothis feels like a bug to me. Before I start working on fixing it, I thought I'd check if it was intentional...21:41
SpamapStchaypo: I assume you mean your libvirt simulated baremetal node ;)21:41
tchaypoindeed21:41
SpamapStchaypo: I've never gotten virsh console to work21:41
SpamapStchaypo: I've used the VNC bits always21:41
SpamapSbut thats like, ALWAYS .. I've literally never gotten _virsh console_ to work. :-P21:41
SpamapSdon't know what is wrong with it21:42
SpamapSI give up and just port forward to vnc glory21:42
tchaypohah.21:42
StevenKSpamapS: I tend to open virt-manager and double things until I get a console window21:43
SpamapStchaypo: if you're on your laptop... just use virt-manager.. I promise nobody will make fun of you for not keepin it real.21:43
StevenKdouble click, that is21:43
StevenKSpamapS: But they might for his choice of laptop21:43
lifelessSpamapS: hi, youlooking at the nodepool quota issue?21:45
SpamapSlifeless: I am21:45
SpamapSlifeless: and welcome :)21:45
SpamapSlifeless: I'm guessing quotas is eventually consistent or something.. trying to learn about it now as I've never looked at the thing before.21:46
SpamapSAPI seems to offer no help for looking at what the quotas are21:47
SpamapSlifeless: l3 agent was also dead21:47
*** e0ne has quit IRC21:47
SpamapSwe have a bug there in that we need to update rootwrap configs to allow killing /opt/stack/venvs/*/bin/python21:47
tchaypoas far as i can tell, virt-manager won't give me anything except point-and-drool replacement for virsh. am i missing something?21:48
lifelessSpamapS: there's a bug open21:48
StevenKtchaypo: We figure you need it.21:48
lifelessSpamapS: bug 128442421:48
*** e0ne has joined #tripleo21:48
lifelessSpamapS: should link in the etherpad I suspect21:48
SpamapStchaypo: it uses vnc, instead of virsh console21:48
*** e0ne has quit IRC21:48
lifelessSpamapS: did we have another outage?21:49
SpamapSlook at that.. first bug in my auto-complete in firefox :-P21:49
SpamapSlifeless: we were not attaching floating ips, so yes21:49
SpamapSlifeless: existing floating ips were working, but new ones were not21:49
lifelessSpamapS: ok, new bug to file ?21:49
SpamapSlifeless: yes, l3 agent can't be restarted without a fix to rootwrap configs21:49
SpamapSand I suspect other problems will arise21:50
SpamapSas there are many /usr/bin/python listings there21:50
lifelessSpamapS: greghaynes filed a bug around that and was looking into it21:50
SpamapSok good21:51
*** e0ne has joined #tripleo21:54
greghayneshttps://bugs.launchpad.net/neutron/+bug/127388221:54
*** e0ne has quit IRC21:56
*** e0ne_ has joined #tripleo21:58
lifelessSpamapS: you here?21:58
SpamapSlifeless: no21:58
SpamapS10:50 tonight21:58
* StevenK is hoping to be in a coma by then21:59
SpamapSwhy does the quota_usages table even exist?21:59
SpamapSis it a materialized view of select count(*), project_id from instances group by 2 ? if so.. it is not being kept up to day :-P22:00
*** d0ugal has quit IRC22:00
SpamapSactually, 'where deleted_at is null' needed too22:01
*** e0ne_ has quit IRC22:04
SpamapSlifeless: ok so I manually shoved the correct values into quota_usages, and nodepool is happily spinning up vms now22:07
SpamapSmysql> select count(*), sum(vcpus), sum(memory_mb), project_id from instances where deleted_at is null group by 4;22:08
SpamapS+----------+------------+----------------+----------------------------------+22:08
SpamapS| count(*) | sum(vcpus) | sum(memory_mb) | project_id                       |22:08
SpamapS+----------+------------+----------------+----------------------------------+22:08
SpamapS|       38 |         38 |         305152 | 64d2d3bc07084ef1accd4e3502909c77 |22:08
SpamapSlifeless: I think there is a chance we're back up22:10
*** cd-undercloud has joined #tripleo22:11
cd-undercloud************** overcloud complete status=1 ************22:11
*** cd-undercloud has quit IRC22:11
lifeless\o/22:14
SpamapS2014-03-02 22:09:33.022 12127 WARNING nova.api.openstack.compute.contrib.floating_ips [req-32071aa1-98a9-4918-b7b6-d89af6485c51 35ef3ce265cb4a25b5303f3daa143f4e 64d2d3bc07084ef1accd4e3502909c77] multiple fixed_ips exist, using the first: 10.0.57.2222:15
SpamapShow is that ever useful to a cloud operator?22:16
* Ng -> lobby22:28
lifelessSpamapS: gives em something to whinge about ?22:30
*** cd-undercloud has joined #tripleo22:39
cd-undercloud************** overcloud complete status=128 ************22:39
*** cd-undercloud has quit IRC22:39
*** cd-undercloud has joined #tripleo22:40
cd-undercloud************** overcloud complete status=6 ************22:40
*** cd-undercloud has quit IRC22:40
*** jcooley_ has joined #tripleo22:43
*** blamar has quit IRC22:43
*** jcooley_ has quit IRC22:45
*** jcooley_ has joined #tripleo22:56
*** e0ne has joined #tripleo22:58
*** e0ne has quit IRC23:02
*** CaptTofu has joined #tripleo23:06
*** jcooley_ has quit IRC23:08
*** jcooley_ has joined #tripleo23:09
*** CaptTofu has quit IRC23:11
*** jcooley_ has quit IRC23:13
*** jcooley_ has joined #tripleo23:18
*** jcooley_ has quit IRC23:25
*** jcooley_ has joined #tripleo23:26
*** jcooley_ has quit IRC23:31
openstackgerrittom-howley proposed a change to openstack/tripleo-incubator: WIP - Add script to build all images.  https://review.openstack.org/7746223:58
*** e0ne has joined #tripleo23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!