Tuesday, 2012-01-10

spackestanyone using debian with openstack?00:01
*** lloydde has quit IRC00:06
*** crescendo has quit IRC00:08
flaviamissispackest: I have **00:10
*** oubiwann1 has quit IRC00:10
*** oubiwann has joined #openstack00:10
*** crescendo has joined #openstack00:12
*** rnirmal has quit IRC00:13
*** aculich has joined #openstack00:14
*** bengrue has quit IRC00:16
*** pixelbeat has quit IRC00:18
*** dwcramer has joined #openstack00:21
*** sleepsonthefloo has quit IRC00:21
*** rods has quit IRC00:23
spackestflaviamissi: what flavor of debian and how did it go?00:23
spackestcan I just follow the normal getting started guide you think?  I've been through it a couple times00:23
flaviamissispackest: I've used the same installation script and worked fine00:23
flaviamissidebian squeeze00:23
*** willaerk has quit IRC00:24
*** rods has joined #openstack00:24
spackestthanks, I'll take a look00:24
flaviamissi:)00:25
flaviamissispackest: I just remembered, I had an issue with creation of log files00:27
flaviamissispecifically logs/startup.log00:27
*** rods has left #openstack00:34
*** spackest has quit IRC00:36
*** whenry has quit IRC00:36
*** micadeyeye has quit IRC00:38
*** micadeyeye_ has quit IRC00:38
*** datajerk has joined #openstack00:40
uvirtbotNew bug: #914049 in nova "EC2 API CreateKeyPair writes private key to log in verbose mode" [Undecided,New] https://launchpad.net/bugs/91404900:41
*** p0 has quit IRC00:42
*** yshh has joined #openstack00:42
*** yshh has joined #openstack00:43
*** rods has joined #openstack00:46
*** yshh has quit IRC00:47
warikwhat needs to be setup for the nova-network service to give ip address onto a remote nova-compute? Which flags allows that?00:51
*** aculich has quit IRC00:54
*** dragondm has quit IRC00:58
*** livemoon has joined #openstack01:01
*** longhudou has joined #openstack01:02
*** hdms has quit IRC01:04
*** hdms has joined #openstack01:04
longhudoudoes openstack support vm  live_migration on ubuntu11.04?01:09
*** ccc1 has joined #openstack01:10
*** jakedahn has quit IRC01:11
*** krow has quit IRC01:12
*** Binbin has joined #openstack01:14
*** sleepsonthefloo has joined #openstack01:14
*** wilmoore has quit IRC01:17
*** rods has quit IRC01:20
*** scalability-junk has quit IRC01:20
*** rods has joined #openstack01:21
*** ben_duyujie has joined #openstack01:22
*** floehmann has quit IRC01:23
*** vendemiat has quit IRC01:23
*** clauden_ has quit IRC01:24
*** mszilagyi has quit IRC01:24
*** ccc1 has left #openstack01:24
*** rods has quit IRC01:25
tightworkwarik: shot in the dark, all compute nodes to have the same --flat_network_dhcp_start= ?01:26
*** krow has joined #openstack01:26
*** rods has joined #openstack01:26
tightworkwarik: which should be the nova-network dnsmasq dhcp server01:27
*** krow has quit IRC01:28
*** donaldngo_hp has quit IRC01:28
*** dragondm has joined #openstack01:29
*** andrewsmedina has joined #openstack01:29
wariktightwork: thanks for your answer! The cc doesn't have this flag ( the instances are getting an ip) and the other nova-compute server has this flag currently (but the instances are not getting ups) however, I tried before without this flag and the result was the same.01:30
*** rods has quit IRC01:30
wariki'm using FlatDHCP01:30
*** rods has joined #openstack01:32
*** maplebed has quit IRC01:32
*** tmichael has quit IRC01:32
tightworkwarik: their building but no IP?01:33
*** ben_duyujie has quit IRC01:33
wariktightwork: here are my config files, you might spot something wrong right away!   http://pastebin.com/DcHd3Xrp01:33
wariktightwork: that's correct01:33
warikno issue in the logs, whatsoever01:34
*** ben_duyujie has joined #openstack01:35
*** tmichael has joined #openstack01:36
*** osier has joined #openstack01:36
tightworkwarik: I want to say you cant multi node out a single nic...01:37
tightworkid like to think I read that in a doc01:37
*** krow has joined #openstack01:37
*** aculich has joined #openstack01:38
wariktightwork: hmm, possible. Although, this setup was working under the 2011.3 version01:38
*** krow has quit IRC01:39
warikI'm running 2012.101:39
*** dprince has joined #openstack01:41
*** spiffxp has quit IRC01:42
*** rustam has quit IRC01:46
*** lzyeval has joined #openstack01:48
tightworkwarik: examples im seeing show --flat_interface=eth1. You seem to be almost there with the two systems. Networking I've seen is a big part of cloud and making it right can definitely keep your head on... if you have the extra nics and switch.. do it01:48
warikyes! i guess it's worth the try, I'm running this test environment under virtualbox, that will be easy to test01:49
*** igors has joined #openstack01:50
*** paulmillar has joined #openstack01:50
*** gyee has quit IRC01:56
*** usef has joined #openstack02:03
*** usef has quit IRC02:03
*** usef has joined #openstack02:04
hugokuoanyone around ?02:05
hugokuoI need some more information about nova-volume in Essex ......  how to specify the iscsi target location under essex02:06
*** msavy has quit IRC02:07
*** pradeep1 has joined #openstack02:13
*** rods has quit IRC02:15
*** erkules|away has joined #openstack02:17
*** erkules has quit IRC02:20
*** warik has quit IRC02:27
*** datajerk has quit IRC02:28
*** datajerk has joined #openstack02:28
*** datajerk has joined #openstack02:29
*** jfluhmann_ has joined #openstack02:31
*** rods has joined #openstack02:35
*** mrjazzcat has quit IRC02:35
*** winston-d has joined #openstack02:37
*** _adjohn has joined #openstack02:41
*** sandywalsh has quit IRC02:43
*** adjohn has quit IRC02:43
*** _adjohn is now known as adjohn02:43
*** rods has quit IRC02:46
*** _adjohn has joined #openstack02:46
*** adjohn has quit IRC02:49
*** flaviamissi has quit IRC02:50
*** _adjohn has quit IRC02:50
*** pradeep1 has quit IRC02:52
*** aliguori_ has quit IRC02:54
uvirtbotNew bug: #822813 in quantum "Improve pylint score" [Medium,In progress] https://launchpad.net/bugs/82281302:55
*** wilmoore has joined #openstack02:57
uvirtbotNew bug: #822519 in quantum "Quantum plugin extension should be able to load from multiple folders" [Undecided,Fix committed] https://launchpad.net/bugs/82251903:02
uvirtbotNew bug: #826563 in quantum "add version.py, similar to nova" [Low,Fix committed] https://launchpad.net/bugs/82656303:02
*** usef has quit IRC03:02
*** usef has joined #openstack03:03
*** andrewbogott has quit IRC03:05
uvirtbotNew bug: #837693 in quantum "Incorrect assertion in test case - _test_show_port_detail()" [Undecided,New] https://launchpad.net/bugs/83769303:06
uvirtbotNew bug: #832338 in quantum "Show a specific extension" [Low,New] https://launchpad.net/bugs/83233803:11
*** wariola has joined #openstack03:11
*** dprince has quit IRC03:11
*** jdurgin has quit IRC03:13
longhudouanyone who have tested vm live_migration?03:17
*** ejat has joined #openstack03:18
*** ejat has joined #openstack03:18
Ryan_Lanelonghudou: I've used it. it's slightly buggy for me in diablo03:18
longhudounova service is running as root?03:18
Ryan_Lanewell, I chose to use tls and certificates for authentication03:19
Ryan_Laneand I'm using gluster as the instance storage03:19
longhudoui am using NFS03:19
Ryan_Laneif you use qemu+ssh, then you need to install ssh keys for root and nova03:19
Ryan_Laneif you are using NFSv4, ensure your users map appropriately03:20
Ryan_Laneor just switch to NFSv3 with auth=sys03:20
*** jfluhmann_ has quit IRC03:20
Ryan_LaneNFSv4 with auth=sys and a properly mapped domain will work, though03:21
longhudouI think I am using just NFSv303:21
longhudoussh keys for root and nova?03:21
longhudouthat is what?03:21
Ryan_Laneif you are using qemu+ssh03:21
Ryan_Laneif you are not, then you don't need to worry about that03:21
*** RobertLaptop has joined #openstack03:22
*** ejat has quit IRC03:22
longhudouwhen i use ps -ef|grep nova, the user of all nova service  is nova,not root03:22
Ryan_Laneif you didn't change --live_migration_uri, then you are using qemu+tcp03:22
Ryan_Laneor qemu+tls03:23
Ryan_Lanelonghudou: yes, but, nova runs some commands via sudo03:23
Ryan_Lanewhich turns the user into root03:23
longhudouI don't change that live_migration_rui03:23
Ryan_Lanethen you don't need to worry about ssh keys03:24
Ryan_Laneor the fact that it occasionally runs as root03:24
Ryan_Lanewhat problem are you having, exactly?03:24
longhudou Returning exception (404, u"NOT_FOUND - no exchange '08cb3ce723a1494b8d0969a495e6ebe2' in vhost '/'", (60, 40), 'Channel.basic_publish') to caller03:25
*** ejat has joined #openstack03:25
longhudouerr log in nova-scheduler.log03:26
longhudounot sure what caused that03:26
*** feiyuliu has quit IRC03:26
*** RobertLaptop has left #openstack03:26
Ryan_Laneah. I've seen this too03:26
Ryan_LaneI have no idea why this occurs03:27
longhudouthen how did you solve this03:27
Ryan_LaneI haven't. that's why I mentioned it's buggy03:27
Ryan_Laneit works for me occasionally03:27
Ryan_Laneas long as I only run one migration at a time03:28
Ryan_Laneeven then occasionally I have problems03:28
Ryan_LaneI'd be lying if I said it was actually usable.03:28
longhudouok,I got it,you mean now you can occasionally succeed in live_migration03:28
longhudouam i right?03:28
Ryan_Laneyes03:29
Ryan_Lanebut, as mentioned, I've run into problems: http://ryandlane.com/blog/2012/01/06/fixing-a-very-broken-instance-live-migration-manually/03:29
*** andrewsmedina has quit IRC03:30
longhudouok,let me see03:31
*** longhudou_ has joined #openstack03:33
*** eglynn_ has joined #openstack03:35
*** andrewbogott has joined #openstack03:35
*** andrewbogott has quit IRC03:35
*** andrewbogott has joined #openstack03:35
*** longhudou has quit IRC03:36
*** andrewbogott has quit IRC03:36
*** ben_duyujie has left #openstack03:38
*** eglynn has quit IRC03:39
*** longhudou_ has quit IRC03:40
*** longhudou has joined #openstack03:41
*** judd7 has joined #openstack03:46
*** usef has quit IRC03:50
*** saberman_1 has joined #openstack03:51
*** koolhead17|zzZZ is now known as koolhead1703:52
*** saberman_1 has quit IRC03:52
*** judd7 has quit IRC03:55
*** lzyeval has quit IRC03:55
*** igors has quit IRC03:56
*** dwcramer has quit IRC03:58
*** saberman_1 has joined #openstack04:00
*** saberman_1 has quit IRC04:01
*** hdms has quit IRC04:02
*** dwcramer has joined #openstack04:10
*** dragondm has quit IRC04:13
*** rnorwood has joined #openstack04:15
*** krow has joined #openstack04:18
*** dragondm has joined #openstack04:20
*** endzYme has joined #openstack04:25
*** dwcramer has quit IRC04:29
*** Rajaram has joined #openstack04:29
*** tmichael has quit IRC04:34
*** CrazyThinker has quit IRC04:34
*** hadrian has quit IRC04:35
*** tmichael has joined #openstack04:35
*** pradeep1 has joined #openstack04:37
*** deshantm_ has joined #openstack04:43
*** deshantm has quit IRC04:46
*** rnorwood has quit IRC04:49
*** jfluhmann has joined #openstack04:52
*** dragondm has quit IRC04:53
*** mjfork has quit IRC05:17
*** manish has joined #openstack05:24
manishEthernet interface of my instance is not enble05:25
manishplease help05:25
manishi am able to take VNC on my instance but Ethernet hardware is not present05:25
manishfor instance05:26
winston-dmanish : did u check the libvirt.xml for your instance? also the log for qemu?05:28
manishHello Winston05:30
manishthanks for replying05:31
manishi checked qemu log05:31
manishhttp://paste.openstack.org/show/4183/05:31
manishno -nic Argument passed over it05:31
*** koolhead17 has quit IRC05:34
manishlibvirt.xml log http://paste.openstack.org/show/4184/05:35
*** wilmoore has quit IRC05:37
*** dpippenger has quit IRC05:40
manishwinston-d libvirt.xml log http://paste.openstack.org/show/4184/05:44
winston-dmanish : your libvirt.xml is too simple, there's no NIC session.05:45
winston-dyou should check libvirt.template.xml05:45
manishyes winston05:45
manishhow can i fix it05:45
manishwinston-d how can i fix it05:47
winston-dfix your libvirt.template05:48
manishwhere is it excalty05:48
manishon nova-compute05:48
manishwinston-d where is it exacltly nova-compute05:50
manishwinston-d my openstack archtecture http://paste.openstack.org/show/4185/05:50
manishwinston-d my nova.conf file http://paste.openstack.org/show/4186/05:51
winston-dmanish : i don't know ubuntu, i'm using RHEL.  can you check /var/lib/nova ?05:52
manishyes sure05:53
*** pradeep1 has quit IRC05:53
manishwinston-d yes sure05:54
manishthere is no file with name libvirt.tmplet05:54
manishthere is no file with name libvirt.templet05:55
manishwinston-d there is no file with name libvirt.templet05:55
*** pradeep1 has joined #openstack05:55
manishwinston-d which service is responsible for creating libvirt.xml05:56
manishwinston-d for instance05:57
winston-dmanish : how about /usr/share/nova?05:57
winston-dmanish : nova-compute is.05:57
*** deshantm_ has quit IRC05:57
manishwinston-d there is no such file /usr/share/nova05:58
winston-dmanish : well, then I can do anything to help.  I don't know where ubuntu package puts the libvirt template.  sorry05:59
manishwinston-d all nova in my system http://paste.openstack.org/show/4187/05:59
winston-dmanish : you can check /usr/share/pyshared/nova, /usr/lib/python2.6/dist-packages/nova and /usr/lib/python2.7/dist-packages/nova06:00
manishwinston-d i am checking06:01
*** anpl1 has quit IRC06:04
*** oubiwann has quit IRC06:08
manishwinston-d http://paste.openstack.org/show/4189/06:13
manishwinston-d lot of files is here which is exactly responsible for genreting libvirt.xml06:14
winston-dwell, inside virt/libvirt/connection.py, there's a function call 'spawn', the thing it does, is to generate xml06:18
*** zigo has joined #openstack06:21
*** smoser has quit IRC06:23
hugokuobonjour06:30
manishwinston-d def spawn http://paste.openstack.org/show/4190/06:30
*** zigo-_- has joined #openstack06:31
*** zigo has quit IRC06:32
*** mohits has joined #openstack06:32
winston-dmanish : i think you need to crack down this issue via: 1) find your libvirt.template, 2) add debug output to see what network_info is.06:32
*** bepernoot has joined #openstack06:33
manishwinston-d i in my system there is no file named libvirt.templet so better to be go with log06:34
winston-dmanish : you better find someone who is using ubuntu to help u06:34
winston-dthere should be one, but the naming may be different06:35
manishwinston-d def spawn  what its mean exactly block_device_info=None06:35
manishwinston-d http://paste.openstack.org/show/4190/06:36
winston-dmanish : that means, the default value for block_device_info is None if there's no input06:36
manishwinston-d k06:37
manishwinston-d thanks winston-d i trying with logs if you find any suggestion regarding libvirt.xml please revert06:39
winston-dyou can ask hugokuo, i think he's using ubuntu06:39
*** smoser has joined #openstack06:40
hugokuowasup06:40
manishhello hugkuo06:40
manishhugkuo http://paste.openstack.org/show/4184/ look this file network is not attched with that06:41
*** Ryan_Lane has quit IRC06:42
manishhello hugokuo06:44
manishhugokuo http://paste.openstack.org/show/4184/ look this file network is not attched with that06:45
*** mohits1 has joined #openstack06:47
*** mohits has quit IRC06:47
*** mohits1 is now known as mohits06:48
*** mohits has joined #openstack06:48
*** ejat has quit IRC06:49
*** ejat has joined #openstack06:50
*** guigui has joined #openstack06:50
*** bobi111 has joined #openstack06:51
bobi111Hi,I tried to upgrade glance on Ubuntu 11.10  using trunk repository. And I get this error: http://pastebin.com/upSwAsT8. Any idea how to fix?06:51
*** ejat has quit IRC06:52
*** Ryan_Lane has joined #openstack06:54
*** ejat has joined #openstack06:54
manishhello i need help on ubuntu openstack06:58
manishhello hugokuo i need help regarding ubuntu openstack06:59
*** hingo has joined #openstack07:00
*** ejat has quit IRC07:03
*** adjohn has joined #openstack07:03
*** adjohn has quit IRC07:04
*** bepernoot has quit IRC07:08
*** Ryan_Lane has quit IRC07:08
*** mohits1 has joined #openstack07:08
*** CrazyThinker has joined #openstack07:11
*** mohits has quit IRC07:11
*** mohits has joined #openstack07:12
*** mohits1 has quit IRC07:13
*** ldlework has joined #openstack07:13
hugokuomanish , there's my libvirt.xml   http://paste.openstack.org/show/4191/07:16
*** mohits has quit IRC07:16
hugokuo--flat_injected=False    plz try to set it as "True"07:17
*** mindpixel has joined #openstack07:17
*** Remco_ has joined #openstack07:17
manishhugokuo interface is missing in my libvirt.xml07:19
*** mohits has joined #openstack07:19
manishhugokuo how can i fix it have u any idea about that07:20
*** llang629 has joined #openstack07:20
*** llang629 has left #openstack07:21
hugokuomanish , I'm not sure if flatmode will generate nic interface info in libvirt.xml07:21
manishk07:22
hugokuomaybe you can try to setup network manager as FlatDHCP07:22
*** katkee has joined #openstack07:22
*** zigo-_- has quit IRC07:23
manishhugokuo Right Hugokuo http://paste.openstack.org/show/4186/07:23
*** zigo has joined #openstack07:23
*** GheRivero has quit IRC07:26
*** mgoldmann has joined #openstack07:29
*** miclorb_ has quit IRC07:33
*** CrazyThinker has quit IRC07:34
*** CrazyThinker has joined #openstack07:35
*** lionel has quit IRC07:36
*** lionel has joined #openstack07:37
*** Remco_ has quit IRC07:38
winston-dhugokuo : i've got some questions about multizone. maybe you can help?07:39
*** hggdh has joined #openstack07:39
*** zigo has quit IRC07:43
*** zigo has joined #openstack07:45
*** popux has joined #openstack07:47
*** saju_m has joined #openstack07:48
bobi111Hi,What should I do If I have errors when upgrading glance from trunk repository?07:50
*** davlap has quit IRC07:52
*** mohits has quit IRC07:52
*** mohits has joined #openstack07:52
longhudoucan not start instance on one of the compute node07:54
longhudouerror is " waiting for metadata service at http://169.254.169.254/2009-04-04/meta-data/instance-id"07:54
longhudouanyone know that07:54
*** rgidron2 has joined #openstack07:56
*** ejat has joined #openstack07:58
*** ejat has joined #openstack07:58
*** marcuz has joined #openstack07:59
*** lionel has quit IRC08:04
*** lionel has joined #openstack08:04
*** reidrac has joined #openstack08:04
*** zigo-_- has joined #openstack08:05
*** zigo has quit IRC08:05
*** ninkotech has quit IRC08:09
*** bepernoot has joined #openstack08:10
*** heyho has joined #openstack08:14
*** rocambole has joined #openstack08:16
*** zigo-_- has quit IRC08:18
*** zigo has joined #openstack08:18
*** antenagora has joined #openstack08:25
*** Remco_ has joined #openstack08:27
*** robbiew has joined #openstack08:30
*** ccc1 has joined #openstack08:31
*** mrevell has joined #openstack08:33
*** krow has quit IRC08:34
*** zul has joined #openstack08:34
*** thickskin has joined #openstack08:36
*** ccc1 has quit IRC08:41
*** sleepsonthefloo has quit IRC08:42
*** Remco_ has quit IRC08:44
*** tmichael has quit IRC08:46
*** nacx has joined #openstack08:48
*** mohits has left #openstack08:48
*** shaon has joined #openstack08:52
manishwinston-d i find the file libvirt.xml.template08:52
*** Ramonster has joined #openstack08:52
manishwinston-d  path is /usr/lib/python2.7/dist-packages/nova/virt/libvirt.xml.template08:53
*** katkee has quit IRC08:53
winston-dgood 4 u08:54
manishwinston-d  templet have interface tag08:56
*** mohits has joined #openstack08:57
manishwinston-d  http://paste.openstack.org/show/4192/08:57
manishwinston-d  so why it not reflected on generated  file08:58
*** ldlework has quit IRC08:59
*** eglynn_ has quit IRC09:06
*** foexle has joined #openstack09:08
foexleahoi09:08
*** KAM has joined #openstack09:10
*** mrevell has quit IRC09:11
*** mrevell has joined #openstack09:12
*** mrevell has joined #openstack09:12
*** KAM has left #openstack09:13
*** LinuxJedi has joined #openstack09:14
*** eglynn_ has joined #openstack09:18
*** uksysadmin has joined #openstack09:21
Madkisshi uksysadmin09:24
Madkissdid you get swift+keystone to work by any chance? ;)09:25
uksysadminMadkiss, yes.09:27
uksysadminAlthough I tried to reproduce my working yesterday on a test set up and it didn't work so going back over my notes again.09:28
*** thickskin has left #openstack09:28
*** katkee has joined #openstack09:28
heyhohello, I can't ping my instances, not even inside the private network..reading a few irc logs it seems that the --vlan flag in nova.conf need to be set with eth# and not br100.. should this change solve my problem?09:36
manishheyho try to VNC on instances09:38
manishheyho through private network09:39
manishheyho vnc://nova-compute-ip:vncport09:39
uksysadminheyho, and see what the console output says for the instance to see if your interfaces have actually come up09:39
*** eglynn_ has quit IRC09:39
heyhook thanks manish and uksysadmin  I'll try that09:40
*** darraghb has joined #openstack09:41
uksysadminOn a 2 interface VM, I've got an interface that has my private network on, and an interface that serves my public network that I use to communicate with the api server and access instances09:41
uksysadminin my nova.conf I have --vlan_interface=${PRIVATE_INTERFACE}09:41
manishuksysadmin interface file is not generated in libvirt.xml  http://paste.openstack.org/show/4184/ Networking Mode is Flat Mode09:41
uksysadminmanish, I've not set up an openstack environment using flat mode yet09:43
manishuksysadmin http://paste.openstack.org/show/4186/09:44
manishuksysadmin is these error due to Flat Mode09:44
uksysadminsorry manish, do you have an issue? I was giving that info to heyho to see if this helps him.09:44
uksysadminmanish, I'm not sure - never used flat mode09:45
*** ejat has quit IRC09:45
*** JesperA has joined #openstack09:45
manishuksysadmin ok09:45
*** miclorb_ has joined #openstack09:46
uksysadminmanish, I would suggest viewing the console output to see if you have interfaces coming up too if you're finding that you're not getting IPs assigned to instances09:46
uksysadminand view the compute and network logs09:46
*** perestrelka has quit IRC09:47
*** rustam has joined #openstack09:48
manishuksysadmin i am able to take VNC of Instance09:56
manishuksysadmin its Working Fine09:56
uksysadminvnc is a direct connection - its not using networking09:56
uksysadminbut if you can get on, do ifconfig09:57
manishuksysadmin ya i tried ifconfig or lspci09:57
uksysadminand is anything listed? what's the instance os?09:57
manishuksysadmin ethernet hardware is not present09:57
manishuksysadmin http://paste.openstack.org/show/4186/09:58
manishuksysadmin sorry  http://paste.openstack.org/show/4184/09:58
manishuksysadmin no interface tag09:58
*** Carmivore has quit IRC09:59
uksysadminwhat's the instance os and distro?09:59
manishuksysadmin debian09:59
manishuksysadmin libvirt.xml created before instance spaned so no interface argument passed with kvm09:59
uksysadminwhere di you get it from? sounds like it doesn't have virtio drivers?10:00
uksysadminI've not used debian under my openstack install, nor used flat mode so don't know the effects/expected outcome10:00
*** zigo has quit IRC10:01
*** zigo has joined #openstack10:02
manishuksysadmin yes this sys file have't any network interface10:03
manishuksysadmin yes this libvirt.xml file have't any network interface10:03
manishuksysadmin i triied ubuntu & windows as A image all have same problem10:04
*** Carmivore has joined #openstack10:04
*** micadeyeye has joined #openstack10:04
*** micadeyeye_ has joined #openstack10:04
*** micadeyeye has quit IRC10:04
*** mohits has quit IRC10:06
*** micadeyeye has joined #openstack10:06
heyhouksysadmin manish: i tried to use xtightvncviewer from my compute node and specify the private ip of a running instance.. but nothing happens. Also, this is a console log http://paste.openstack.org/show/3rD7IE8XszcLv4cGmxxq/  route failed :/10:06
*** micadeyeye_ has quit IRC10:06
*** Kyle__ has quit IRC10:10
*** ccustine has quit IRC10:10
*** perestrelka has joined #openstack10:11
*** ccustine has joined #openstack10:11
manishheyho go to /var/log/libvirt/qemu/instance-name.log check on winch particular port vnc is working10:12
*** Kyle__ has joined #openstack10:12
manishheyho first try to ping your nova-compute node if its reachable then try to vnc over that10:13
*** livemoon has quit IRC10:15
heyhoI can ping and ssh my nova-compute node..actually I run commands in it via ssh. Reading the log of one of my instance, it seems that the vnc uri is 0.0.0.0:0 (maybe because the instance is in the same compute node?) but at the bottom of the log I read http://paste.openstack.org/show/JDUa20mcrfDn8AnklnIh/10:18
*** maploin has joined #openstack10:21
*** eglynn_ has joined #openstack10:22
*** erkules|away has quit IRC10:25
*** erkules|away has joined #openstack10:25
*** erkules|away is now known as erkules10:25
*** wariola has quit IRC10:27
*** Carmivore has quit IRC10:27
*** zigo has quit IRC10:29
*** zigo-_- has joined #openstack10:29
*** nid0 has quit IRC10:30
*** nid0 has joined #openstack10:30
manishheyho make fresh image and bundle it http://cssoss.wordpress.com/2011/11/28/bundling-debian-image-for-openstack/10:31
*** Carmivore has joined #openstack10:32
*** eglynn_ has quit IRC10:33
*** robbiew has quit IRC10:36
*** Remco_ has joined #openstack10:37
heyhothanks manish, will try10:40
*** robbiew has joined #openstack10:42
*** miclorb_ has quit IRC10:43
*** paulmillar has quit IRC10:44
uksysadminheyho, you using debian too?10:52
uksysadminI'd keep things simple and try known distros that work with OpenStack first then try to use something that you've created yourself10:53
*** paulmillar has joined #openstack10:56
heyhouksysadmin: I'm using Ubuntu 11.1011:01
*** zigo-_- has quit IRC11:02
uksysadminheyho, at least yours has the interface present - its just not communicating with your environment to get an address - which is very probably down to configuration11:03
*** eglynn_ has joined #openstack11:03
*** lionel has quit IRC11:04
*** lionel has joined #openstack11:04
*** flaviamissi has joined #openstack11:05
*** Arminder-Office has quit IRC11:05
*** Arminder has joined #openstack11:07
*** GheRivero has joined #openstack11:08
*** Arminder has quit IRC11:08
*** Arminder has joined #openstack11:08
*** ahasenack has joined #openstack11:09
*** Arminder has quit IRC11:12
*** mcclurmc has quit IRC11:14
*** mcclurmc has joined #openstack11:14
*** hggdh has quit IRC11:21
rgidron2hi - how do I get the ip adress of a running instance?11:22
rgidron2euca-describe-instance does not show an ip-address11:27
heyhouksysadmin: other than not getting an address, my instance is also not finding the ramdisk (Couldn't find valid RAM disk image starting at 0) which I think is a more serious problem.. also, the vnc console shows just the seabios string and nothing else.. :/11:27
*** eglynn_ has quit IRC11:27
*** eglynn_ has joined #openstack11:28
uksysadminrgidron2, it means your instances hasn't started yet - check the state... probably says "pending"11:28
rgidron2state is running11:28
uksysadminrgidron2, euca-get-console of the instance id and view the console output to see why your interface hasn't come up11:29
uksysadminheyho, the ubuntu cloud images don't ship with a ramdisk so you can ignore that11:30
*** James has joined #openstack11:30
Jameshello all11:31
uksysadminheyho, ah - I thought you showed output where it was getting console output11:31
*** James is now known as Guest2971611:31
rgidron2uksysadmin: euca-get-console-output just hangs11:31
Guest29716if have a relative easy question to ask, but i can't seem to find any answer to it in the documentation11:31
Guest29716if i want to set up a server as a cloud controller, does it require the nova-compute component, or can it be omitted?11:32
uksysadminheyho, I'm a bit confused - you can vnc in but your instance isn't spitting out stuff to console log? that sounds like two different instances you're looking at?11:32
uksysadminomitted11:32
*** jedi4ever has joined #openstack11:33
Guest29716currently it is installed, if i perform an uninstall it won't affect my current installation other than removing a compute node form the system right?11:33
uksysadminrgidron2, check all your logs - esp the nova-api log11:34
Kialland nova-compute for errors re reading the console log file...11:35
uksysadminGuest29716, shouldn't do - not done it, but its not a pre-req11:35
Guest29716ok11:35
Guest29716thanks for the help11:35
uksysadminproduction setups don't run compute on the controller boxes11:35
Guest29716ok11:36
*** Guest29716 has left #openstack11:36
heyhouksysadmin: I used the wrong vnc port actually.. the console log spits out stuff and doing vncviewer 10.10.10.2:0 I get to a login screen! ubuntu:ubuntu doesn't seem to be the credentials. Is there a way I can pass the keypair?11:37
*** flaviamissi has quit IRC11:38
rgidron2uksysadmin: is there a way to "kill" and instance?11:38
*** livemoon has joined #openstack11:38
uksysadminheyho, keypairs are only for ssh11:40
uksysadminrgidron2, euca-terminate-instances id11:40
* Kiall wonders why people use the euca tools with openstack, the native tools offer more functionality :/11:41
rgidron2uksysadmin: thanks, terminated and used cloud-run-instances - now I have an IP but instance is pending... too long, any clue?11:42
Kiallrgidron: have you checked the logs? The client side tools (ie euca_* and cloud_*) are designed not to reveal anything about the internal workings of the cloud...11:43
uksysadmineuca-get-console-output again to see if it is booting11:44
Kialluksysadmin: if its in the "pending" state, nova wont even attempt to access the logfile..11:44
uksysadminKiall, people use euca2ools because it fits better with a hyrbid cloud solution... many enterprises are using OpenStack along with EC211:45
uksysadminsure, there are nova specifics, but there are installations that use the pretty much unofficial standard which is the EC2 api11:45
Kialluksysadmin: good point .. didnt think of that to be honest!11:45
uksysadmin:)11:46
rgidron2get-console-output returns an error, nova-api log shows errors relating to the console.fifo.out file saying it does not exist11:48
heyhouksysadmin: using vnc, how do I log in the instance? user:ubuntu password:ubuntu doesnt work and I'm using uec images11:49
Kiallrgidron2: yes, the instance changes to "active" the moment the KVM command runs, so if its not active, there will never be a logfile to check11:49
Kiallthe only way to diagnose an instance stuck as pending is via the server side logs..11:50
Kiallheyho: Can you imagine how many pawned instances would be sitting around on EC2 if there was a default password? ;)11:50
rgidron2kiall; makes sense of course, server side logs are where?11:50
KiallYou need to supply an ssh key name with the -k option, and SSH to it using that..11:50
Kiallyou can then set a root password if you like..11:51
Kiallrgidron2: usually /var/log/nova/*11:51
KiallDepends how you installed everything though..11:51
rgidron2I followed the diablo getting started guide, have the logs all at the standard /var/log location11:52
rgidron2I will try to look closer at nova-api.log11:52
KiallThen thats where the logs are :)11:52
rgidron2:-)11:53
Kiallusually, issue re pending instances have something useful in the nova-compute or nova-network logs11:53
*** andrewsmedina has joined #openstack11:53
heyhoKiall: I can't ssh in it.. I can't even ping the instance private ip inside the network; the only things that show me something are the log and vncviewer .. I may have network configuration problems..11:55
Kiallheyho: can you ping/ssh to it from the controller node, or the compute node the instance is running on?11:56
rgidron2kiall: ERROR: trying to add VLAN #100 to IF -:br100:-  error: No such device\n' in nova-compute11:56
heyhono :/11:56
Kiall(ie, you might be trying from you're desktop)11:56
rgidron2does that mean anything to you?11:56
Kiallrgidron2: sounds like you need to fixup your /etc/network/interfaces11:56
KiallYou're using VLAN networking I assume?11:57
Kiallnot flat or flatDHCP/11:57
Kiallnot flat or flatDHCP?*11:57
bobi111Hi.After installing and running nova-manage db sync I get ""Lost connection to MySQL server at 'reading initial communication packet', system error: 0"11:57
uksysadminheyho, you can't log in11:58
rgidron2this is where my newbie face comes out screaming if it hasn't yet Kiall11:58
heyhoKiall: Yes, I created three private networks.. I have two tenants but three private networks11:58
uksysadminnot via the console11:58
rgidron2I don't know, I installed from scratch using to PC's with ubuntu and 2 nics on each11:58
heyhouksysadmin: yes, I got it thanks11:58
Kiallheyho: something in your network config is off if you cant ping it on its fixed IP from both the controller for compute nodes..11:59
*** markvoelker1 has joined #openstack11:59
KiallI'd go through the docs on networking again to be sure you didn't miss anything..11:59
heyhoKiall: yes that's what I'll do11:59
rgidron2kiall: if I pasebin my /etc/network/interfaces would you be able to tell anything from it?11:59
*** ahasenack has quit IRC11:59
Kiallrgidron2: lol .. there are 3 different network modes.. flat, flat dhcp and vlan.. It's important you understand the differences and choose the one appropriate for you12:00
*** ahasenack has joined #openstack12:00
Kiallrgidron2: the docs page on "networking options" gives a somewhat cryptic explanation of the three options.. but worth a read anyhow..12:01
KiallI use the VLAN mode, But most people choose the FlatDHCP mode...12:01
Kiallthe "Flat" mode is almost never used (that I'm aware of)12:01
rgidron2http://paste.openstack.org/show/4196/ is mt interfaces file12:02
*** mrevell has quit IRC12:02
Kiallrgidron2: without knowing which network mode you need/want, there is no point checking the file.. the file would look different depending on the modes..12:02
*** zul has quit IRC12:03
*** heyho has quit IRC12:04
Kiallrgidron2: a (potentially) easy way to tell, are your switches VLAN capable?12:04
*** bobi111 has quit IRC12:04
*** pradeep1 has quit IRC12:05
rgidron2kiall: is this networking mode a setting to nova in any of the config files? I believe I should be using flatDHCP because I don't have a vlan enables switch in my setup here12:05
*** ninja4u has joined #openstack12:05
*** msavy has joined #openstack12:05
Kiallrgidron2: okay, then you have some misconfiguration.. :)12:06
KiallThere is an example config for FlatDHCP here.. http://docs.openstack.org/diablo/openstack-compute/admin/content/configuring-flat-dhcp-networking.html12:06
*** ninja4u has quit IRC12:06
KiallOnce you have that right, you will need to empty the "networks" and "fixed_ips" tables in MySQL, and re-add the networks using "nova-manage network add ...."12:06
*** waytogobastard has joined #openstack12:07
rgidron2kiall: wow, nice.. I will get started with the link example you provided and probably be back for help with that mysql cleanup12:07
rgidron2Thanks!!12:07
Kiallnp, good luck ;)12:08
*** heyho has joined #openstack12:08
*** ahasenack has quit IRC12:10
rgidron2kiall: interestingly enough I don't have a --network_manager entry in my nova.conf at all12:11
*** ahasenack has joined #openstack12:11
rgidron2is that supposed to work?12:11
Kiallrgidron2: exactly, the default is VLAN mode :)12:11
Kiallyea you can leave options out and the defaults will be assumed12:11
*** eagles051387|| has joined #openstack12:12
eagles051387||hey guys what exactly is open stack12:12
eagles051387||is it its own virtualization technology or does it work in conjunction with existing virtualization technology12:12
*** manish has left #openstack12:12
rgidron2OK so this is a demo setup for research purposes, is there an easy way to fixup my setup - for example if I added a network manager flat entry12:13
Kiallit sits on top of kvm/xen/lxc etc etc12:13
rgidron2what does the range entry do?12:13
eagles051387||Kiall: does it make setting up ipv6 guests easy to do12:13
Kiallrgidron2: I've honestly never used the flatDHCP manager and have no clue what the settings mean, sorry ;)12:13
rgidron2np12:13
*** manish has joined #openstack12:14
Kialleagles051387||: it supports ipv6, but I've not used it..12:14
eagles051387||ahh ok12:14
manishkiall hello12:14
eagles051387||:-/ humm also does open stack support provisioning of guests12:14
Kiallipv6 is on my list of todo's.. we have an assignment just sitting there ;)12:14
eagles051387||hehe12:14
eagles051387||what about provisioning of guests Kiall12:15
Kiallno - openstack can be considered equal to EC2 and S3..12:15
eagles051387||does openstack do that12:15
manishkiall i have problem with FLATMANAGER12:15
eagles051387||humm ok guess on ubuntu thats where orchestra and cobbler comes in handy I'm guessing12:15
KiallIt provisions instances based on an disk image, nothing more12:15
eagles051387||nothing with lvm12:15
Kiallmanish: not sure why you're asking me directly ;)12:15
KiallAnyway - Back to work I go..12:16
eagles051387||have fun Kiall12:16
eagles051387||i need to do some testing on my desktop at home12:16
eagles051387||my linux drive12:16
*** aculich has quit IRC12:17
manishany one have idea about FlatManger in my libvirt.xml no interface tag http://paste.openstack.org/show/4184/12:17
*** bobi111 has joined #openstack12:18
manishin my libvirt.xml there is no interface tag12:19
*** alekibango_ has quit IRC12:20
*** alekibango_ has joined #openstack12:20
*** mjfork has joined #openstack12:21
*** flaviamissi has joined #openstack12:21
*** rgidron2 has quit IRC12:29
*** robbiew has quit IRC12:31
*** hugo_kuo has joined #openstack12:36
*** E has joined #openstack12:37
*** E is now known as Guest1462612:38
*** alekibango_ has quit IRC12:38
*** praefect has joined #openstack12:39
uksysadminso, ec2 + keystone - what do all the environment variables look like - what does a 'novarc' file look like when communicating with keystone?12:39
*** aculich has joined #openstack12:40
*** hugo_kuo has quit IRC12:40
Kialluksysadmin: I have an example here: https://github.com/managedit/openstack-setup/blob/master/openrc.tmpl12:42
Kiallthat works for both the euca and native client tools..12:42
uksysadminKiall, awesome, thanks.12:42
Guest14626someone knows about the Atlas-Load-balancer?12:42
Kialluksysadmin: Well .. Mostly works.. you cant publish images via the euca/cloud/ec2 utils when keystone is used...12:43
tightworkanyone check out opendedup?12:43
uksysadminKiall, I'll give it a whirl12:43
*** uncleofthestick has joined #openstack12:44
*** stewart has quit IRC12:44
*** Guest14626 has quit IRC12:48
*** PeteDaGuru has joined #openstack12:50
*** nevrax has joined #openstack12:51
lxumjforl12:52
mjforkyes12:52
*** alekibango has joined #openstack12:53
*** mrevell has joined #openstack12:58
*** MrHeat has joined #openstack12:59
*** jedi4ever has quit IRC13:00
uksysadmindoes anyone know if any user authentication of any kind happens with nova?13:00
longhudoumjfork:13:01
uksysadminI've just set my username, password, tenant, etc up as "fake", "fake", "fake" and the only thing it did was complain that my chosen keypair didn't exist (so I created one using the fake user and it accepted it) and running only after I launched the instance did it complain about no network available in the logs - the client happily thinks its ok13:02
Kialluksysadmin: It certainly should complain!13:03
KiallWhat command were you running, I'll double check if I get the same error..13:03
*** mrevell has joined #openstack13:04
uksysadminindeed it should - but my euca-describe-instances has: pendingfake (fake, None)13:04
uksysadminactually its errorfake (fake, openstack1)  where openstack1 is my host13:04
KiallOkay, can you pastebin your nova.conf and your api-paste file? One of those is bound to be incorrect13:05
uksysadminsure13:05
Kiallwith invalid details, I can't even do a euca-describe-images13:05
*** aculich has quit IRC13:06
*** bobi111 has quit IRC13:08
*** MrHeat has quit IRC13:09
uksysadminKiall, http://paste.openstack.org/show/4198/13:12
KiallYea.. You have auth disabled in the api-paste13:13
*** Arminder has joined #openstack13:13
Kiallpipeline = ec2faultwrap logrequest *ec2noauth* cloudrequest authorizer ec2executor13:13
uksysadminhaha, lol13:13
*** zul has joined #openstack13:13
Kialluksysadmin: https://github.com/managedit/openstack-setup/blob/master/api-paste-keystone.ini.tmpl13:13
KiallJust the settings at the  very end should need changing for nova+keystone :)13:13
*** aliguori has joined #openstack13:14
uksysadminI don't think a LOL describes how much I'm laughing at myself here13:14
Kiall;)13:15
*** dolphm has joined #openstack13:17
*** manish has quit IRC13:18
*** aculich has joined #openstack13:23
uksysadminI use your api-paste.ini and I get my old friend back: ImportError: No module named metadatarequesthandler13:24
Kialluksysadmin: you using essex by any chance?13:24
*** Birk_ has joined #openstack13:25
KiallThe metadata service was changed a fair bit in essex, I would imagine the api paste for it changed too13:25
uksysadminaye13:25
uksysadminI'll try mangling the the two and remove the glaring error ;-)13:26
KiallAdd L25 -> 29 of your pastebin back in13:26
Kiallthen remove L62 -> 66 from mine13:26
KiallActually - looks like more than that has changed13:26
KiallMuch more ;)13:26
uksysadminindeed13:27
*** BuZZ-T has quit IRC13:28
*** jfluhmann has quit IRC13:28
*** BuZZ-T has joined #openstack13:28
*** robbiew has joined #openstack13:29
*** stewart has joined #openstack13:29
*** yshh has joined #openstack13:37
*** rustam has quit IRC13:38
*** andreas__ has joined #openstack13:43
*** ahasenack has quit IRC13:43
*** dprince has joined #openstack13:44
*** 94SAAECOX has joined #openstack13:45
*** shaon has quit IRC13:50
heyhokiall uksysadmin I reconfigured my private networks (nova-manage network...) and now i can ping the instance private ip and even ssh into the instance.. But I'm still unable to ping or ssh the floating ip I associate to the instance13:50
Kiallheyho: chances are you forgot to enable ping and SSH in the firewall rules..13:51
Kiallthe `euca-authorize` command handles that stuff..13:51
heyhoKiall: I added the rules via the dashboard the tcp port 22.. as for icmp I may have made a syntax error13:51
Kiallimcp should be -1 / -1 usually (First box = ICMP Type, Second box = ICMP Code)13:52
Kiall-1 means "any"13:52
KiallTry that and see if you can ping.. If you can ping, but cant SSH, the instance likely failed to boot.. Most often getting this far, but failing SSH means the instance could not reach the metadata service part of nova-api13:53
Kiallthe console output would show if thats the case13:53
heyholook what i did http://i41.tinypic.com/1268k7o.png13:54
Kiallyea - 0 / 0 means only ping replys can go to the instance...13:54
Kiallif you added 8 / 0 aswell it would let ping requests through.. (or -1 / -1 for all)13:54
*** hadrian has joined #openstack13:55
*** PiotrSikora has quit IRC13:55
heyhoKiall.. yes thank you! I changed it from -1 -1 to 0 0 when in my previous attemps.. now ping works :)13:56
*** PiotrSikora has joined #openstack13:58
*** Shentonfreude has joined #openstack14:00
heyhoI can also ssh.. the remaining problem now is the novnc console... If I try to connect using chrome I receive "server disconnected" error14:01
*** hggdh has joined #openstack14:02
KiallYea, Its not compatible with the latest versions of chrome..14:04
KiallThe websockets spec is (was) too unstable and implementations kept changing..14:04
Madkissintersting. Fresh Ubuntu 11.10 installation, after trying to start nova, I see all nova components crashing after some seconds, but there is not a single line about it in any of the logs14:07
*** paulmillar has quit IRC14:09
*** Leander has joined #openstack14:09
Leanderhello all14:09
*** paulmillar has joined #openstack14:09
*** mattray has joined #openstack14:09
Leanderi'm having trouble terminating an instance14:09
Leanderhere's what happend, i stopped the instances14:10
Leanderand forgot to terminate it before removing the nova-compute  component from the controller14:10
*** paulmillar has quit IRC14:10
Leanderthe problem now is that i can't terminate that instance14:10
KiallLeander: easy way, install nova-compute again for a few mins..14:11
KiallHard way, use `virsh` to kill+remove the VM from libvirt then `rm -rf /var/lib/nova/instance/instance-ID`, then mark the instance as terminated in the DB manually...14:11
Leanderto remove the compute node from the service list14:12
Leanderdo have to use a sql command?14:13
Leanderok that did it14:14
Leanderthanks14:14
KiallYea, You have to edit the DB by hand for that..14:15
heyhoKiall: you were right! IE9 worked.. now, if I want to access to the instance via vnc I have to setup a cloudpipe server?14:16
*** Shentonfreude has left #openstack14:16
Kiallhuh?14:17
Kiallyou mean via VPN?14:17
*** rustam has joined #openstack14:18
Kiallheyho: It sounds like you are using keystone, which I don't believe is compatible with cloudpipe in diablo.. (I've never tried, Only heard reports of them being incompatible)14:18
heyhoKiall: yes I'm using keystone..so as for now I can't access the instance via the vnc console (I dont know login and password that are promped) and I cant setup cloudpipe for imcompatibility..right?14:20
KiallOh, No .. cloudpipe has nothing to do with VNC14:21
*** eagles051387|| has quit IRC14:21
KiallIf you want to login via VNC, then you just need to assign the root (or another) user a password14:21
Kiallyou can do that via SSH14:21
Kiallcloudpipe is for VPN, not VNC14:21
heyhoKiall: thank you for the explanation14:22
*** Leander has quit IRC14:25
*** lborda has joined #openstack14:28
*** mrjazzcat has joined #openstack14:32
*** livemoon has quit IRC14:35
Madkisshm14:36
Madkisscan sombody supple me with an api-paste.ini for Oneiric that supports keystone? uksysadmin, maybe?14:36
uksysadminif uksysadmin had one that worked I would gladly share it14:36
uksysadmin;-)14:36
Madkissgood to hear :)14:36
mjforkMadkiss: paste yuor existing14:36
mjforki will check it out14:36
*** HugoKuo_ has joined #openstack14:37
Madkisswell, the error message I get is ImportError: No module named nova_keystone_context14:37
Madkissmust be from14:37
Madkisspaste.filter_factory = keystone.middleware.nova_keystone_context:NovaKeystoneContext.factory14:37
Madkissi guess ;)14:37
mjforkok14:37
*** berendt has joined #openstack14:37
mjforkMadkiss:  install from package?14:37
*** tdi_ has joined #openstack14:37
Madkissyes. still.14:37
*** rustam_ has joined #openstack14:38
KiallMadkiss: this works for the diablo version.. https://github.com/managedit/openstack-setup/blob/master/api-paste-keystone.ini.tmpl14:38
berendtis it a normal behavior that swift-proxy processes run a couple of minutes on 100% cpu usage after using swift-init proxy stop/start ?14:38
uksysadminI'm using this: https://github.com/openstack/keystone/blob/milestone-proposed/doc/source/nova-api-paste.rst14:39
uksysadminbut fails on the paste.app_factory = nova.api.ec2.metadatarequesthandler:MetadataRequestHandler.factory14:39
*** jeblair_ has joined #openstack14:39
*** jstraw has joined #openstack14:39
uksysadminthere is no metadatarequesthandler class14:39
*** mnemonic_ has joined #openstack14:39
MadkissKiall: produces the same error message, actually ;)14:39
Madkissoh, no14:39
Madkissnot quite.14:39
*** nijaba_afk has joined #openstack14:40
*** jamespage has quit IRC14:40
*** markwash has quit IRC14:40
*** Lumiere has quit IRC14:40
*** jeblair has quit IRC14:40
*** tdi has quit IRC14:40
*** ches has quit IRC14:40
*** paltman has quit IRC14:40
*** mnemonic has quit IRC14:40
*** heydrick has quit IRC14:40
*** hugokuo has quit IRC14:40
*** ChrisAM has quit IRC14:40
*** nijaba has quit IRC14:40
*** evxd has quit IRC14:40
*** statik has quit IRC14:40
*** jstraw is now known as Lumiere14:40
*** mrjazzcat has quit IRC14:40
*** andreas__ has quit IRC14:40
Madkissroot@netbook:/etc/nova# dpkg -L keystone | grep ec214:40
Madkissroot@netbook:/etc/nova#14:40
*** andreas__ has joined #openstack14:40
*** rustam has quit IRC14:40
*** exekias has quit IRC14:40
Madkisswhich consequently results in ImportError: No module named ec2_token14:40
*** exekias has joined #openstack14:40
*** kloeri has quit IRC14:41
*** markwash has joined #openstack14:41
KiallMadkiss: .. ah .. you are using the stock ubuntu packages for keystone?14:41
mjforkMadkiss: what version of packages14:41
*** kloeri has joined #openstack14:41
KiallThey don;t work.14:41
MadkissKiall: keystone.middleware.ec2_token is present in 2012.1 only.14:41
*** nijaba_afk is now known as nijaba14:41
*** paltman has joined #openstack14:41
*** mrjazzcat has joined #openstack14:41
Madkissthat's good to hear, which will I have to use then?14:41
*** ChrisAM1 has joined #openstack14:41
*** nijaba has quit IRC14:41
*** nijaba has joined #openstack14:41
KiallMadkiss: yea.. the ubuntu packages for keystone and dashboard are broken, not diablo itself ;)14:41
*** evxd has joined #openstack14:41
Madkiss(they are from ubuntu oneiric-proposed)14:41
KiallI've got fixed packages here: launchpad.net/~managedit/+archive/openstack14:41
MadkissKiall: r0x0r.14:42
mjforkKiall: are those diabo or essex?14:42
Kialldiablo14:42
mjforkMadkiss:  you want essex right?14:42
Madkissno14:42
MadkissI want diablo for now.14:42
Madkissafter all the moan caused by essex.14:42
Madkissthis is all making me nuts. nothing's properly documented, and findign something _always_ is diggin' in the dark ;)14:43
*** praefect has quit IRC14:43
*** heydrick has joined #openstack14:43
KiallBTW - Maybe the oneiric-proposed packages have been fixed, and there is something else wrong.. I haven't looked at those, and I know the ubuntu guys are planning on fixing the packages eventually14:43
Madkissthere is only nova in there anyway.14:43
uksysadminI was running diablo from proposed and it caused problems - in fact, I was getting that infernal metadatarequesthandler issues so I went to essex from milestones and still no joy then went to trunk and still no  joy14:44
*** dendrobates is now known as dendro-afk14:44
mjforkMadkiss: so why the 2012.1 packageS?14:44
uksysadminso there's a mismatch between keystone trunk and packages14:44
Madkissuksysadmin: that principle just doesn't work with openstack right now apparently.14:44
Madkissmjfork: i am just and simply trying to get something that works. really. I swear.14:44
KiallMadkiss: .. lol clone git://github.com/managedit/openstack-setup .. edit settings file .. type ./all-in-one.sh .. enjoy ;)14:45
Madkissthat's gonna caused exactly the same effects once I want to update something.14:45
Madkissno really.14:45
*** RainbowDash36 has joined #openstack14:45
MadkissI know I can get stuff to work by building it by hand, i've been a debian developer for 9 years, but that's not my goal :)14:45
*** lborda has quit IRC14:46
*** RainbowDash36 has quit IRC14:46
*** kloeri has quit IRC14:46
KiallMadkiss: sadly, there are no official openstack or ubuntu packages for diablo that work..14:46
*** kloeri has joined #openstack14:46
*** jfluhmann has joined #openstack14:46
KiallAnd essex is in development, I wouldn't be counting on it to be bug free and reliable ;)14:46
MadkissKiall: If yours work, i'm perfectly fine with that. I am mainly looking for stuff I can use for demonstrational purposes.14:46
uksysadminKiall, diablo isn't exactly bug free and reliable neither14:47
MadkissBut telling people to "just clone that git repostiry from there" during a workshop is not gonna work ;)14:47
*** cereal_bars has joined #openstack14:47
Kialluksysadmin: that might be true of the 2011.3 tag.. but not of the stable/diablo branch that I build my packages from..14:47
*** ChrisAM1 is now known as ChrisAM14:47
KiallThere have been hundreds of bugfixes that the ubuntu packages dont have...14:48
uksysadminMadkiss, I feel your pain.  Best you can do is reach out to the mailing list.14:48
*** andreas__ has quit IRC14:48
uksysadminlots of developers are state side and will be online later on in the day14:48
KiallMadkiss: the packages are in a PPA ;)14:48
Madkissthe oneiric-proposed-ones?14:48
Kiallanyway .. as I said... Sadly, there are no official openstack or ubuntu packages for diablo that work..14:48
mjforkmadkiss, give me a few. looks like you have mismatched packages.14:48
mjforkyou can use the RCB pacakges, or install nova from PPA and keystone/dashbaord from source.14:49
Kiallwell - no keystone or dashboard packages that work, and the ubuntu nova etc is minus a few hundred bug fixes*14:49
MadkissGive me some minutes to sort all this stuff out14:50
Madkisswell.14:50
MadkissInvalid command 'WSGIScriptAlias', perhaps misspelled or defined by a module not included in the server configuration14:50
Madkiss;)14:50
*** lborda has joined #openstack14:51
*** kloeri has quit IRC14:51
Madkissfunny, dpkg --configure -a made it all good again.14:51
Madkissoh well.14:51
*** kloeri has joined #openstack14:51
*** mrevell has quit IRC14:54
*** longhudou has quit IRC14:54
*** rods has joined #openstack14:55
MadkissKiall: okay, these start up like a charm at least14:56
*** dwcramer has joined #openstack14:56
Madkisssend: 'POST /v2.0/tokens HTTP/1.1\r\nHost: 10.42.0.6:5000\r\nContent-Length: 102\r\ncontent-type: application/json\r\naccept-encoding: gzip, deflate\r\nuser-agent: python-novaclient\r\n\r\n{"auth": {"tenantName": "admin", "passwordCredentials": {"username": "admin", "password": "hastexo"}}}'14:56
Madkissreply: 'HTTP/1.1 500 Internal Server Error\r\n'14:56
Madkissahum.14:56
*** kloeri has quit IRC14:56
*** kloeri has joined #openstack14:57
MadkissOpenStack is like a tomato made of error messages. Wherever you bite into it, random error messages will float out14:57
mjforkMadkiss: what is in keystone logs?14:57
*** livemoon has joined #openstack14:58
KiallMadkiss: lol...14:58
*** mrevell has joined #openstack14:59
Madkissoh look! after stopping keystone, deleting the old keystone.db and re-creating it, it works!14:59
*** mrevell has joined #openstack14:59
MadkissKiall: am I using "deprecated auth" now?15:00
KiallNo, not if you are using keystone15:00
Birk_I'm having some problems when trying to ssh to my instances. I'm getting this error. Permission denied (publickey). My instance is running on a local network and the nova-controller is the the gateway to the external network.15:01
MadkissKiall: just wondering because keystone logs this into /var/log/keystone/keystone-legacy-auth.log ...15:01
Kiallthat git repo I linked has working/example configs + setup scripts for everything you can use as a reference... (for diablo..)15:01
*** robbiew has quit IRC15:02
Kiallweird, my keystone-legacy-auth.log file is basically empty...15:02
*** robbiew has joined #openstack15:02
*** Ryan_Lane has joined #openstack15:05
*** nevrax has quit IRC15:05
Madkisswell, this seems to work like a charm, great!15:05
KiallMadkiss: its actually quite easy to get working once you dont have to install from source, or broken packages ;)15:06
*** PotHix has joined #openstack15:07
heyhoGuys, How can I force the removal of an old instance stuck in build state? I  may log to mysql and do a query like "remove * from instances where keyname="oldkey" ...could it work?15:07
heyhoI only see the instance in the dashboard.. is not even in /var/lib/nova/instances..15:08
mjforkheyho: try nova-manage or delete it directly in teh DB?15:08
KiallYou can set terminated = 1, and terminated_date to the current time..15:08
mjforkthere ya go ^15:08
*** arun has quit IRC15:08
KiallThats basically what nova would do if you still had nova-compute on that server15:09
Kiallwell .. that and remove it from libvirt and /var/lib/nova/instances aswell..15:09
heyhothere's no instance folder in /var/lib/nova/instances .. and where do I ser terminated = 1 and terminanted_date .. I didnt understand sorry15:10
Kiallin the DB `instances` table..15:10
*** rnorwood has joined #openstack15:10
heyhoso, like my previous query but instead of keyname parameter using the terminated one?15:11
MadkissAttributeError: 'NoneType' object has no attribute 'find'15:11
Madkisshm15:11
Kiallheyho: yea.. basically :)15:12
heyhook thanks Kiall15:12
*** judd7 has joined #openstack15:12
*** jamespage has joined #openstack15:13
MadkissKiall: http://paste.debian.net/151691/ -- this has something to do with keystone, i guess?15:14
KiallYea - I dont use swift, but it looks like the "keystone_url" variable isn't set..15:15
*** ben_duyujie has joined #openstack15:15
Madkisskeystone_url or KEYSTONE_URL?15:17
*** endzYme_ has joined #openstack15:17
Birk_mjfork: Hey mjfork, can you try to help me with some details ? I'm trying a diferente installation now. Im using this architecture http://imageshack.us/photo/my-images/839/architecture.png/ . The yellow circle represents the nova controller and the gateway between the local and external network. The controller machine have 2 network interfaces.15:18
Madkissah15:18
Madkissnevermind15:18
*** saju_m has quit IRC15:18
MadkissI see15:18
MadkissWhat do service_host, service_port and service_pass actually do? They are described in every howto, but they are not actually explained15:19
Kialllol15:19
KiallI'm guessing thats the keystone host, port and a long life token15:19
KiallBut - As I said, I don't use swift.. I don't need it...15:20
Birk_mjfork: i can create new instances and ping them from the controller server, but when i try to ssh the instances (all instances run just on the compute server on local network) i got this error: Permission denied (publickey). I've already tried to generate the keys again, but have no success.15:20
Madkisshear, hear, swift started.15:21
*** rods has quit IRC15:21
Birk_mjfork: it can be the network interfaces configuration ?15:21
mjforkBirk_: look at the console for the VMs to see if you see the SSH denial15:21
mjforkBirk_: wher are you trying to SSH from? try it from ther controller to the VM15:21
Spirilishey so can anyone comment on NASA's Nebula project... is it based on openstack?  or did openstack grow out of nebula code?15:22
Birk_mjfork: yes, i'm trying from the controller to the VM, but i got that message.15:22
Spirilis(writing notes for my presentation this afternoon :D)15:22
mjforkSpirilis: i understand it as the nebula code base seeded openstack?15:22
Spirilisyeah that's what I'm reading... cool15:22
*** rods has joined #openstack15:22
mjforkSp "NASA will contribute technology used to power its Nebula Cloud Platform."15:23
uksysadminyeah my interpretation of Nebula too15:23
*** livemoon has left #openstack15:23
Spirilissounds good on a note sheet :)15:23
*** jfluhmann has quit IRC15:23
Madkissto whom are you presenting, Spirilis?15:25
Spirilisfellow sysadmin and IT folks, a couple apps folks too15:26
Spirilismy POC efforts thus far have been in a vacuum that only me and my boss know about.  so here's the big "coming out"15:26
KiallSpirilis: My understanding is that nova started live as nasa's nebula, and swift started life as rackspace cloud files.. and that both companies are using (or planning on using) OpenStack in production...15:28
Spirilisah interesting.15:29
Birk_mjfork: I've tried to catch some errors in the vm console with euca-get-console-output after the ssh attempt, but i didn't find anything.15:29
Madkisshmpf.15:30
mjforkBirk_: can you VNC in and looka at /var/log/messages15:30
Madkisshttp://paste.debian.net/151693/15:30
Madkisscan I make swift more verbose anyhow?15:30
mjforkKiall is right about Swift - "Rackspace is donating the code that powers its files and servers, the foundation for its public-cloud offerings."15:30
mjforkMadkiss: look like URL failed to parse and is not an object15:31
mjforkguessing that keystone isn't returning the storage URL?15:31
mjforkare you trying swift + keystone on diablo?15:31
notmynameSpirilis: ya, swift is running in production (and always has) at rackspace as our cloud files product. we run the latest version of swift, and have (to my knowledge) the largest swift clusters in the world15:31
Madkissmjfork: yes.15:31
mjforkMadkiss: hmm, i was thinking the keystone middleware was broken there.  was that fixed?15:31
*** imsplitbit has joined #openstack15:31
MadkissKiall: is it in your version?15:31
*** endzYme has quit IRC15:32
KiallMadkiss: what now?15:32
MadkissKiall: keystone middleware for swift appears to be broken in the Diablo packages; is it fixed in yours (if you know this, by any chance)15:32
KiallIts likely not, Since I dont use swift :)15:33
Madkissgna15:33
Madkissmjfork: How can I see what swift is actually *doing*=15:33
Madkiss-v doesn't make it any more verbose, actually15:33
Spirilisnotmyname: very cool... thanks for the info!15:33
uksysadminMadkiss, I've a nice working keystone + swift set up from packages15:35
MadkissOneiric default packages?15:35
Madkiss(could I see your proxy-server.conf please?)15:36
Birk_mjfork: how can i VNC to the machine that is on the local network ? because i don't have graphic interface in the controller server.15:36
Spirilisdoes anyone know if NASA's Nebula stands separate from openstack, or is it mostly openstack at this point, or openstack with cutting edge extras that they're keeping close to the chest or whatever?15:36
uksysadminno - ppa:swift-core/trunk15:36
uksysadminppa:keystone-core/trunk15:36
mjforkSpirilis: i don't know that i have seen an annoucement, but i would expect the Nasa is building off/using OpenSTack15:36
mjforkSpirilis: i am sure the ponit of open sourcing it was to save development/support costs15:37
Spirilisyeah, agreed15:37
mjforkand nasa doesn't have much reason to keep anything in house15:37
*** Xenith has quit IRC15:37
uksysadminMadkiss, http://paste.openstack.org/show/4201/15:37
*** Xenith has joined #openstack15:37
uksysadminnotmyname, what is the service_pass flag in swift proxy-server.conf?15:38
notmynameuksysadmin: in the keystone section? I have no idea. that's the realm of keystone15:39
*** dillon-w has joined #openstack15:39
*** Xenith has quit IRC15:40
uksysadminnp... just I didn't set a password if that's what it is so assuming its for "future use"15:40
uksysadminyet all examples of this have this set15:40
*** Xenith has joined #openstack15:40
btorchuksysadmin: I never used that setting on my tests (keystone services access password) ... although I kept my distance from "egg:keystone#swiftauth" and " egg:keystone#tokenauth" and instead used " egg:swiftkeystone2#keystone2"15:43
*** zzed has joined #openstack15:43
uksysadminbtorch, what's the difference? what does keystone2 provide that tokenauth doesn't?15:43
btorchuksysadmin: Last time I checked tokenauth had a pretty bad bug and should not be used15:44
dillon-wi've got some questions about multizone setup, anyone care to share some experience?15:44
uksysadminbtorch, thanks - and I was sitting here quietly smug that I have a nice swift + keystone test setup! ;-)15:44
btorchuksysadmin: if I remember correctly it allowed a valid token to talk to any account15:44
Madkissmjfork: do you have any idea what is supposedly "broken"?15:45
uksysadminah - that would make sense and highlight the big error message on their doc page regarding that - but didn't know why15:45
uksysadmin(did I say big - there's a mention of it)15:45
*** ben_duyujie has quit IRC15:46
mjforki know the original, rleeased PPA packages where broken15:46
mjforkthen i was thinking that swift + keystone was still broken, check the answers section of launchpad15:46
*** mgoldmann has quit IRC15:47
*** tmichael has joined #openstack15:48
notmynamethe proper middleware to use with swift for keystone is swift_auth (at least it used to be)15:48
notmynametoken auth has/had the issue that btorch mentioned15:49
*** Xenith has quit IRC15:49
btorchuksysadmin: it could have changed ... last time a checked was last year but either way I remember sometime ago some someone telling me to use swiftauth instead but never got that working (didn't feel like wasting time either) so I used chmouel_'s keystone2 filter15:49
*** Xenith has joined #openstack15:50
Madkissuksysadmin: you are running today's trunk of keystoneà according to adam_g, something is broken there ...15:51
*** robbiew has quit IRC15:51
*** krish has joined #openstack15:54
*** ben_duyujie has joined #openstack15:55
*** rustam_ has quit IRC15:55
*** dragondm has joined #openstack15:55
*** adjohn has joined #openstack15:55
*** rustam has joined #openstack15:56
*** mrevell has quit IRC15:56
*** ppradhan has joined #openstack15:57
XenithHmm. Is the keystone package still broken in ubuntu 11.10?15:59
*** mrevell has joined #openstack16:01
*** antenagora has quit IRC16:03
*** pbacterio has joined #openstack16:05
*** ldlework has joined #openstack16:06
*** panterax has joined #openstack16:07
*** joesavak has joined #openstack16:07
*** pbacterio has quit IRC16:08
*** rods has quit IRC16:10
*** reed_ has quit IRC16:11
*** rods has joined #openstack16:11
*** andreas__ has joined #openstack16:12
*** reidrac has quit IRC16:12
*** guigui has quit IRC16:13
sante_Hi all. I'm trying to build an openstack lab with XenServer and Essex-2. I did some test on Xenserver6 and Xenserver 5.6. On both version I'm unable to resize a virtual machine more than once. On second resize I receive errors on both hypervisor's version16:13
*** deshantm has joined #openstack16:13
*** freeflyi1g has quit IRC16:14
*** rods has quit IRC16:14
*** robbiew has joined #openstack16:14
*** rods has joined #openstack16:15
*** freeflying has joined #openstack16:15
sante_to let you figure out the type of problem, on 5.6, on second resize, when the vm has been copyed on destination host (xensource.log) I receive an error like this:  http://paste.openstack.org/show/4108/16:15
sante_is there some xen people that can address me to a solution?16:16
deshantmsante_: you want to try to ask in ##xen and #xen-api16:18
*** mindpixel has quit IRC16:18
dillon-wif i'd like to setup two zones, one parent + one child, what is least keystone/glance service i should have?16:19
*** cp16net has joined #openstack16:22
*** Hakon|mbp has quit IRC16:23
*** Hakon|mbp has joined #openstack16:23
uksysadminMadkiss, I did an update earlier on - seems fine but I've not really done anything apart from curl some containers and view them, etc.16:29
*** localadmin__ has joined #openstack16:30
*** bepernoot has quit IRC16:30
localadmin__Has anyone come across this nova-network error: ERROR: trying to add VLAN #100 to IF -:br100:-  error: No such device16:32
*** Remco_ has quit IRC16:32
*** waytogobastard has quit IRC16:34
*** yshh has quit IRC16:35
*** ben_duyujie has quit IRC16:36
*** ben_duyujie has joined #openstack16:36
*** koolhead17 has joined #openstack16:37
uksysadminlocaladmin__, I have done numerous times and I've forgotten how to get around it.16:37
uksysadminessentially your bridging hasn't worked16:37
*** jeblair_ is now known as jeblair16:38
*** nebuchadnezzar has joined #openstack16:39
nebuchadnezzarhello16:39
*** spiffxp has joined #openstack16:39
localadmin__uksysadmin: any clue as to what I should do? i did apt-get on vlan and it said I was up to notch16:40
localadmin__how does one debug bridging issues?16:40
*** dnjaramba has joined #openstack16:41
*** spackest has joined #openstack16:41
*** rods has quit IRC16:42
*** pixelbeat has joined #openstack16:43
*** rods has joined #openstack16:46
*** robbiew has quit IRC16:47
*** foexle has quit IRC16:49
*** maploin has quit IRC16:50
*** popux has quit IRC16:50
*** krow has joined #openstack16:50
*** zul has quit IRC16:51
uksysadminbrctl show16:52
uksysadminbut this is controlled by nova-network so check out /var/log/nova-network.log16:52
*** krow has quit IRC16:52
*** uksysadmin has quit IRC16:53
*** daysmen_ has joined #openstack16:54
*** zzed has quit IRC16:55
*** dolphm has quit IRC16:58
*** cereal_bars has quit IRC16:58
*** primeministerp has joined #openstack16:58
*** rnorwood1 has joined #openstack17:01
Birk_If i'm using two network interfaces in the nova controller I have to do anything different in the nova.conf file or i need just to configure the local network properly ?17:01
*** adjohn has quit IRC17:01
*** 94SAAECOX has quit IRC17:03
*** heyho has quit IRC17:03
*** devananda has joined #openstack17:03
*** rnorwood has quit IRC17:03
*** rocambole has quit IRC17:03
*** ben_duyujie has quit IRC17:04
*** codatory has joined #openstack17:06
*** hggdh has quit IRC17:06
*** ben_duyujie has joined #openstack17:07
*** heckj has joined #openstack17:07
*** dwcramer has quit IRC17:08
*** hugokuo has joined #openstack17:09
*** cp16net has quit IRC17:10
hugokuoanyone around ?17:10
hugokuoI'm confusing about nova-volume concept .....17:10
*** freeflying has quit IRC17:11
*** cp16net has joined #openstack17:11
hugokuoa question , does the nova-volumes group must be located on same host with nova-volume service ?   as I know , not necessary though17:11
*** Ramonster has quit IRC17:11
*** sleepsonthefloo has joined #openstack17:11
mjforklocaladmin__: run "mysql -uroot -pnova -e "select bridge_interface from networks;" nova" and i bet the bridge_itnerface is br100 instead of ethX17:12
mjforkBirk_:  you need to specify public ineteface17:13
*** ben_duyujie has quit IRC17:13
Birk_mjfork: the public interface is the interface that connects to the external network or with the local ?17:14
mjforkBirk_: are you usign vlan17:14
Birk_mjfork: I'm using flatDHCP17:15
*** codatory has left #openstack17:15
dillon-whugokuo : working so late?17:15
Birk_mjfork: in my nova.conf the pub. interface is eth0. Mine eth0 is connecting with the external network17:15
hugokuojust can not sleep well if I can not figure out this issue ....17:15
mjforkBirk_:  what problem do you have17:16
Birk_the flat_network is configured eth1. eth1 is connecting with the lan17:16
hugokuothat makes me so confuse …….17:16
mjforkHugoKuo: are you using standard nova-voume driver against LVM?17:16
hugokuoas default …. I guess it's standard nova-volume manager17:16
Birk_mjfork: My VM is running in a compute node that is located ins the local network. I'm trying to ssh this VM but i got Permission denied (publickey)17:17
mjforkHugoKuo then yes, run nova-volume on every machine you want to export storage from LVM17:17
Birk_I've executed the sames steps as in my other configurations that are working17:17
mjforkBirk_: are you SSHing from outside the cloud? have your tiredit from compute node?17:17
*** freeflying has joined #openstack17:17
hugokuomjfork , wow …..seems my consideration totally wrong ....17:18
Birk_mjfork: I'm trying to ssh from the gateway (nova-controller)17:18
Birk_mjfork: i'll try from the compute node in the lan now17:18
*** hky has quit IRC17:18
mjforkHugoKuo the nova-compute then mounts the iscsi export by discovering it17:18
mjforkHugoKuo doesn't work through nova-volume17:18
hugokuoSo do ya means that nova-volume worker must run with all VGs those I want to export ?17:18
hugokuoa question about the flag   --iscsi_ip_perfix  â€¦.17:19
Birk_mjfork: from the compute node i got the same error. Permission denied (publickey).17:19
mjforkBirk_: how did you launch17:20
hugokuowhat's the real usage ?  I thought it's for specifying the address which has the sharing VG ….. am I right ?17:20
*** maplebed has joined #openstack17:20
Birk_mjfork: do you men how did i created the VM ?17:20
mjforkHugoKuo my understanding is that iscsi prefix just scopes the search to the right range, some expoerts are on multiple IPs, you want the one for your network17:21
mjforkBirk_: yes17:21
Birk_mjfork: with this: euca-run-instances  ami-00000002 -k nuvemcpca -t m1.tiny.17:21
Birk_mjfork: I'm trying to ssh with ssh -i nuvemcpca.priv ubuntu@10.0.0.217:22
*** reed_ has joined #openstack17:22
*** dwcramer has joined #openstack17:22
mjforkBirk_:  do you have verbose on in the conf?17:22
mjforkHugoKuo don't need to specify the whole IP address, many machines can run nova-volume17:23
dillon-whugokuo : just FYI, i encountered an issue when i didn't set iscsi_ip_prefix correctly.17:23
mjforkHugoKuo are you on diablo or exsex ?17:23
*** dillon-w has quit IRC17:24
hugokuomjfork , nova essex trunk ….17:24
hugokuodillon-w , thx17:24
Birk_mjfork: yes, in nova.conf i have verbose=true17:24
*** marcuz has quit IRC17:25
mjforkHugoKuo i *think* the behavior may have changed in essex, will want to do some checking17:25
mjforkBirk_: can you recycle your logs and do a new provisioning and captuer the nova-compute log?17:25
mjforkpaste bin that17:25
Birk_ok17:25
hugokuomy nova-volume always detect local VG ….. if I separate the VG from nova-volume server :<   …..  it totally failed by can't find VG named nova-volumes17:26
*** Kyle__ has quit IRC17:26
mjforkyeah, nova-volume runs on many services17:26
mjforkmany SERVERS that is17:26
mjforkHugoKuo each server with a VG to export must run nova-volume17:27
hugokuoReally !!?17:28
hugokuothere's a description in flags doc17:28
hugokuo[no]use_local_volumes: if True, will not discover local volumes17:28
hugokuo(default: 'true')17:28
hugokuoif True will not discover local volumes…..17:29
*** rnorwood1 has quit IRC17:29
*** Leander has joined #openstack17:29
Leanderhello once again17:29
Leanderi'm having some trouble with accessing virtual machine instances on the network17:30
*** rnorwood has joined #openstack17:30
*** maplebed has quit IRC17:30
Leanderi have two nodes, a controller and a compute17:30
Leanderwhich reside on separate servers17:30
mjforkHugoKuo looking at the code, that just appears to use a local path to the volume if it can17:30
mjforkHugoKuo other wise it does discovery17:30
*** LeanReox has joined #openstack17:31
*** llang629 has joined #openstack17:31
Leanderthe instances are loaded and according to euca-describe-instances they appear to be running. I've checked the logs and can't find anything wrong. They have the appropriate permissions.17:31
mjforkHugoKuo so basically, if that flag is enabeld and the VM and the sotrage being mounted are on teh same machine, then use a local path17:31
Leanderbut i can't ping them nor ssh into themm17:31
LeanReoxHi guys, trying to curl to create a security group17:31
LeanReoxgetting bad request 40017:32
LeanReoxcurl -X POST -d "{"security_group": {"name": "testSG", "description": "testSG"}}" "http://172.16.x.y:8774/v1.1/5/os-security-groups" -H "X-Auth-Token: 3dd60c26-5f1d-438a-9e26-a2ff86570196"17:32
LeanReoxthats the curl17:32
mjforkLeander: what is the error message17:32
LeanReoxis the JSON bad ?17:32
hugokuomkfork , got it …. I should dig more from codes….17:32
mjforkLeanReox: did you check the answers section of launch ad?17:32
Leandermjfork: there is no error message17:32
mjforkLeanReox: also pastebin the nova-api.log17:32
mjforkleander what does SSH do?17:32
hugokuomjfork , appreciate your help , but I'm home now …. will check it tmr17:32
LeanReoxmjfork , not seeing anything like it17:33
Leandermjfork: ssh: connect to host 10.1.1.3 port 22: No route to host17:33
LeanReoxbut cant be missing the header "application type json" ?17:33
mjforkLeander: did you euca-authorize17:33
mjforkLeanrox make sure verbose is on in the conf and pastebin the nova-api log after running17:34
Birk_mjfork: follow http://pastebin.com/RPLFt9vZ17:34
Leandermjfork: how can i check that?17:34
*** rods has quit IRC17:34
Leandereuca-describe-group?17:34
*** warik has joined #openstack17:34
mjforkLeander: http://docs.openstack.org/diablo/openstack-compute/admin/content/enabling-ping-and-ssh-on-vms.html17:34
*** rnorwood has quit IRC17:34
*** rnorwood has joined #openstack17:34
Leandermjfork: both rules already exist17:35
mjforkleander what image? is ssh running?17:35
mjforkLeander: can you VNC iN?17:35
Birk_mjfork: I'm having the same problem with the new instance17:35
Leandermjfork: i haven't configured vnc and the image is ttylinux-uec-amd64-12.1_2.6.35-22_117:36
LeanReoxmjfork im getting that that resource is specting 3 parameters and im sending 2 ... is pretty straighforward,17:36
LeanReoxgoing to check a little bit more the curl with debugginf17:36
*** andrewbogott has joined #openstack17:38
*** andrewbogott has quit IRC17:39
*** Rajaram has quit IRC17:39
*** andrewbogott has joined #openstack17:39
Leandermjfork: when i set up a single node everything worked fine, after i separated nova-compute into a separate server i couldn't connect to my instances anymore17:39
*** freeflying has quit IRC17:40
Birk_Leander: I'll try to help you. Do you have nova-controller in one machine and nova-compute in the other right ?17:41
LeanderBirk_, that is correct17:41
Birk_Leander: Ok, for me worked this way: I copied the nova.conf file from the controller and put it on the compute server.17:42
mjforkBirk_: paste bin the logs17:42
Birk_Leander: i set up my network interface bridge to promiscuous mode17:43
LeanderBirk_: i use the same config file for both the controller and the compute17:43
Birk_Leander: on the controller node17:43
mjforkleander sounds like your networkign is hosed. if you only have 1 nic, enable promisc as birk said17:43
mjforkleanrox patebin the log for nova-api17:43
Birk_Leander: you can do it with this command: sudo ifconfig br100 promisc17:44
Leandermjfork, Birk_, does that apply to a the VLAN configuration as well?17:44
mjforkLeander: i would suspect17:44
mjforknever tried it though17:44
Birk_Leander: same as mjfork17:45
Leandernow i need to restart the instance right?17:45
Birk_mjfork: what log's you want ?17:45
Leanderor nova-network? or both?17:45
Birk_Leander: try to restart nova-network, nova-compute and nova-api. I always restart all of them.17:46
Leanderwith or without stopping the instance first?17:47
mjforkleander not sure a restart is required for promisc17:47
mjforkbut provision new isntance17:47
Birk_Leander: can you create another instance ? i would try that.17:47
Birk_Leander: if you just changed the promisc you dont need to restart anything, like mjfork said17:47
mjforkBirk_: nvoa-compute17:47
Birk_follow http://pastebin.com/RPLFt9vZ17:48
Birk_mjfork: follow http://pastebin.com/RPLFt9vZ17:48
Birk_mjfork: nothing changed on log after trying to connect via ssh17:48
*** warik has quit IRC17:48
*** warik has joined #openstack17:49
*** rods has joined #openstack17:49
*** krish has quit IRC17:49
mjforkBirk_:  i was confirming key injection was ok, and it didn't error out from what i see]17:50
mjforkBirk_: since you are gettinga key error, it has to be there.17:50
mjforkBirk_: can you connect to the isntance via VNC?17:50
mjforkrun virsh dumpxml <instance id> | grep vnc on the compute node17:50
*** gyee has joined #openstack17:51
*** koolhead17 has left #openstack17:51
Leandermjfork: still nothing17:52
Leanderrestarted all services17:52
Leanderand launched new image17:52
mjforkwhat IP does your image have?17:52
*** jdurgin has joined #openstack17:52
Leander10.1.1.317:52
mjforkLeander: can you SSH to it from teh compute node or from the controller node?17:52
*** nati2 has joined #openstack17:53
Birk_mjfork: i don't have graphic interface on my servers, so i'm installing in another machine, then i will integrate this machine to the local network an then try to vnc17:53
*** rods has quit IRC17:53
Leandermjfork: not working17:54
*** rods has joined #openstack17:54
*** dcramer_ has joined #openstack17:54
Leandermjfork: on the controller it says:" ssh: connect to host 10.1.1.3 port 22: No route to host" and on the compute it just hangs17:55
Birk_Leander: can you ping your instances ?17:55
LeanderBirk_: neither ping nor ssh work17:55
mjforkleander flat dhcp?17:56
Leandermjfork: i'm using the VLAN configuration17:56
*** rods has joined #openstack17:56
mjforkBirk_:  if you have VNC port, just VNC remotely17:56
*** rods has quit IRC17:58
mjforkleander, try it from outside your env17:58
mjforki.e. outside the public interface17:58
*** dwcramer has quit IRC17:58
*** rods has joined #openstack17:59
*** rods has quit IRC17:59
*** rods has joined #openstack18:01
*** cp16net has quit IRC18:02
*** imsplitbit has quit IRC18:02
*** cp16net has joined #openstack18:02
*** pdtpatrick_ has joined #openstack18:02
*** dolphm has joined #openstack18:03
*** sleepsonthefloo_ has joined #openstack18:03
*** reed__ has joined #openstack18:03
*** bepernoot has joined #openstack18:03
*** sleepsonthefloo has quit IRC18:04
*** sleepsonthefloo_ is now known as sleepsonthefloo18:04
*** reed_ has quit IRC18:05
*** adjohn has joined #openstack18:06
*** zzed has joined #openstack18:06
*** MarkAtwood has quit IRC18:07
Leandermjfork: the network admin came by and it might be a problem with the network switch18:08
Leanderit might be blocking the vlans18:08
mjforkLeander: that would do it :-)18:08
*** darraghb has quit IRC18:08
Leandermjfork: hope that's the case. Will be back tomorrow if it's not!18:11
Leanderthanks for help so far18:11
*** rustam has quit IRC18:12
*** Leander has left #openstack18:12
*** aculich has quit IRC18:12
*** MarkAtwood has joined #openstack18:12
*** rods has quit IRC18:14
*** uncleofthestick has quit IRC18:15
*** rods has joined #openstack18:18
*** bengrue has joined #openstack18:18
*** andreas__ is now known as ahasenack18:19
*** hugokuo has left #openstack18:20
*** nacx has quit IRC18:28
*** katkee has quit IRC18:29
*** tmichael has quit IRC18:29
*** jog0 has joined #openstack18:33
*** jog0 has left #openstack18:35
*** NOKAH has joined #openstack18:36
*** spackest has quit IRC18:36
*** spackest has joined #openstack18:36
*** judd7_ has joined #openstack18:36
*** statik has joined #openstack18:37
*** judd7 has quit IRC18:38
*** judd7_ is now known as judd718:38
*** Hakon|mbp has quit IRC18:40
*** rnorwood has quit IRC18:42
*** aculich has joined #openstack18:44
*** Carmivore has quit IRC18:45
uvirtbotNew bug: #914418 in nova "Nova notifications now seem to be using the default rabbit exchange " [Undecided,New] https://launchpad.net/bugs/91441818:46
warikHi, can anyone confirm me that is possible to use cc-host (configured with nova-network FlatDHCP) to give ups to instances launched on another nova-compute server?18:47
*** Unicron-yeah has joined #openstack18:48
*** oubiwann has joined #openstack18:50
*** Unicron-yeah has quit IRC18:50
*** jakedahn has joined #openstack18:53
*** Carmivore has joined #openstack18:53
*** aculich has quit IRC18:55
*** oubiwann1 has joined #openstack18:55
*** oubiwann has quit IRC18:55
*** jog0 has joined #openstack18:56
mjforkwarik:  not following, "give ups"?18:56
warikoops, I meant "IPs"18:56
*** jakedahn has quit IRC18:57
mjforkwarik: yes, that is the basic use case18:57
*** rnorwood has joined #openstack18:58
warikok, because in my case, the second nova-compute host the instance but I don't any dhcp request on the cc-host18:58
warikmy instance got spawn, i can see the ip selected by the schedule server18:59
warikon the web interface but the nova-network never give away the ip, well it does but after 30 sec I can no longer ping my instance19:00
warikmjfork: is that sounds familiar to you ?19:00
*** davlap has joined #openstack19:00
*** reed__ has quit IRC19:00
*** aculich has joined #openstack19:00
*** lionel has quit IRC19:00
*** lionel_ has joined #openstack19:01
*** reed has joined #openstack19:01
mjforkwarik, some what. so after 30 secs what happens?19:03
*** MarkAtwood has quit IRC19:04
wariki can ping my instance for about 30/35 sec and then the instance is no reachable19:04
warikbut no error in the logs19:04
mjforkok19:05
mjforki know others have seen this19:05
mjforktrying to recal what it is19:05
mjforkcould it be firewall rules? did you euca authorize?19:05
spackestI got debian squeeze installed and am trying to get openstack up and running, but when I try apt-get install -y glance it doesn't find the package19:05
mjforkspackest: add a repostirioy?19:05
warikI have the log from the cc: http://pastebin.com/KY5vbvWN and the compute: http://pastebin.com/3LBceMJR19:05
spackestwhen I try add-apt-repository ppa:glance-core/trunk it doesn't find the command19:06
spackestyeah, guess I'm asking which repo to add :)19:06
mjforkspackest: pase the error19:06
warikI add the euca-authorize for the ICMP and the SSH19:06
uvirtbotNew bug: #914430 in openstack-ci "Config files needed on Jenkins build slaves for glance functional tests" [Medium,In progress] https://launchpad.net/bugs/91443019:06
uvirtbotNew bug: #914431 in openstack-ci "remove automatic comment text from reviews" [Low,Triaged] https://launchpad.net/bugs/91443119:06
spackest-su: add-apt-repository: command not found19:06
mjforkspackest: ok, do you want diablo19:06
spackestthat's what I was trying19:06
mjforktry sudo apt-get install python-software-properties19:06
spackestI am root and on debian so no sudo19:07
mjforkapt-get install python-software-properties19:07
spackestalready installed19:07
warikspackest: and apt-get update :)19:07
spackestcat /etc/debian_version - 6.0.319:08
*** tjikkun has quit IRC19:08
spackestand even after the update I can't find the add-apt-repository command19:09
spackestam I just missing something obvious?19:09
*** cakiiooo has joined #openstack19:10
warikthat should be it19:10
*** dnjaramba has quit IRC19:10
warikapt-get install python-software-properties then add-apt-repo then apt-get update19:10
mjforkwarik: need nova-noetwork log19:10
mjforkspackest: if still no luck ,sounds like an OS issue, i would ask on their channel19:11
*** tjikkun has joined #openstack19:11
*** tjikkun has joined #openstack19:11
*** dolphm has quit IRC19:11
warikmjfork: the nova-network logs are part of the CC log. (sorry it's messy..)19:11
mjforkwarik are you trying to access a private ip or floating ip?19:12
spackestis there a magic line I can put into /etc/apt/sources.list to point to a debian repo with openstack packages?19:12
warikprivate19:12
warikthe 10.0.0.0/8 ramge19:12
warikrange*19:12
*** funzo has joined #openstack19:12
mjforkno floating I{19:13
warikspackest: idk, I always use the add-apt-repo19:13
mjforkIP19:13
mjforkdo you have multihost?19:13
mjforkie.. does nova-network run on every node19:13
wariknope, I have only one nove-network, which sits on the cc host19:13
mjforkyou don't have the multihost flag set right?19:14
warikno19:14
*** rnorwood has quit IRC19:14
mjforknova-network was enver started on the 2nd node?19:15
wariknever installed, never run19:15
mjforkhmm, what happens after 30 secs I wonder.19:16
mjforkKiall: you around?  seems like we have answered this before.19:16
Kiallhuh?19:16
mjforkKiall: do you recall an issue where a new VM is accessible for 30-35 secs then you can no longer ping/ssh19:17
*** rnorwood has joined #openstack19:17
KiallYea - nova-api is inaccessible, there is an iptables NAT rule listed in the docs you need to use on the compute-only nodes to make it work right..19:17
spackestwarik: so add-apt-repo works for you just fine on stock debian?19:17
warikspackest:  correct19:18
spackest6.0.3?19:18
*** cakiiooo has quit IRC19:18
Kiallspackest: the apt-add-repository command is in the python-software-properties packages19:18
warik6.0.119:18
KiallOh, I thought you said the command wasnt found.. ignore me ;)19:18
warikKiall: is it this iptables rule ?   iptables -t nat -A PREROUTING -d 169.254.169.254/32 -p tcp -m tcp --dport 80 -j DNAT --to-destination $NOVA_API_IP:877319:20
KiallYup - thats the one19:20
warikhmm, I added this one to my nova-compute already19:20
*** bepernoot has quit IRC19:21
warikthe thing is, I don't get any error message in the logs..19:21
KiallAh.. Okay, in that case there are some nova flags that set the local ranges to prevent the requests from being SNAT'ed before arriving at nova-api19:21
spackesthttp://pastebin.com/nqhqCekQ19:22
*** zzed has quit IRC19:22
Kiallwarik: https://github.com/managedit/openstack-setup/blob/master/nova.conf.tmpl L27 -> L29 i think19:22
Kiallwarik: not add-apt-... its apt-add-...19:23
warikKiall: here are my config files :  http://pastebin.com/DcHd3Xrp19:23
warikKiall: yes, wrong spelling19:23
warik:S19:23
Kiallsorry - spackest: not add-apt-... its apt-add-...19:23
warikspackest:  my bad..19:24
spackest-su: apt-add-repository: command not found19:24
Kiallwarik: Add the flags from L27 -> L29  from https://github.com/managedit/openstack-setup/blob/master/nova.conf.tmpl19:24
russellbi thought it was add-apt-repository ... always thought it was weird19:24
KiallUsage: apt-add-repository <sourceline>19:24
warikKiall: to both cc and compute ?19:25
spackestequally not available :) -su: add-apt-repository: command not found19:25
Kiallyea - the same config file should work on all nodes...19:25
*** dpippenger has joined #openstack19:25
warikok19:26
warikty19:26
Kiallspackest: weird, you said this was debian?19:26
*** cp16net_ has joined #openstack19:26
KiallMaybe they dont have it ;)19:26
*** PaulM has joined #openstack19:26
Kiallspackest: the launchpad page for it also gives the apt lines you can use manually19:26
*** funzo has quit IRC19:26
*** bpg has quit IRC19:27
spackestKiall: yeah, debain squeeze from today19:27
Kiallwell .. I guess its an ubuntu addition so..19:27
*** cp16net has quit IRC19:29
*** cp16net_ is now known as cp16net19:29
*** Eyk^off is now known as Eyk19:30
spackestKiall: sorry, which launchpad page?19:31
mjforkwarik: can you uyse VNC to get console on the guest and see if it is timing out (or use teh get console feature of dashbaord)19:31
uvirtbotNew bug: #914440 in glance "No way to track show image bandwidth usage for reporting" [Undecided,In progress] https://launchpad.net/bugs/91444019:31
*** funzo has joined #openstack19:31
Kiallspackest: the page for whatever PPA you are trying to add..19:32
*** bepernoot has joined #openstack19:33
warikmjfork: I don't have VNC access, but when I try to see the log from Horizon, I get that in the log   http://pastebin.com/RyWPvRPD19:34
warikRemote error: TypeError get_console_output() got an unexpected keyword argument 'tail_length'19:35
mjforkwarik: cany ou see if VNC is open? virsh list then virsh dumpxml <id> | grep vnc19:35
Kiallwarik: sounds like you are using the essex dashboard with a diablo nova...19:35
KiallI think that was something added in essex (the tail_length param)19:35
warikKiall: it's no good to use essex ?19:36
*** mattray has quit IRC19:36
warikbecause the instances that I launched on the cc host are doing alright19:36
*** jakedahn has joined #openstack19:36
warikonly the remote ones are failing19:36
KiallI *think* the ability to tail the logfile was added in essex, which if it was, would explain that error19:36
Kialloh really? local ones work?19:37
warikyes!19:37
mjforkwarik: even for get console? or just networking?19:37
mjforkKiall's comment was just on wrong dasbhoard19:37
warikthe local instances are fully operational, both ping/ssh + console19:38
Kiallyea.. there is no reference to "tail_length" anywhere in the diablo nova code.. and a few to it in the essex code...19:39
warikinteresting, fyi, I am using the same version on both cc and compute19:40
Kiallyea.. something weird is going on there :)19:40
warikKiall: I added the dmz flags and restart the services, no change19:41
Kiallwarik: humm, can you pastebin nova-api.log ?19:42
warikKiall: http://pastebin.com/KY5vbvWN   it's a full log of the cc host (all the CC nova services are into this log, network, api, schedule)19:43
mjforkwarik what did you isntall from?19:44
warikgithub19:44
Kiallyea, I don't see any errors in those logs..19:45
warikmaster branch19:45
Kiallon both nodes?19:45
warikyep that's my problem!19:45
warikon both node19:45
warikno errors19:45
warik http://pastebin.com/3LBceMJR19:45
warikcompute node ^19:45
KiallK -  so everything is essex? no diablo anywhere?19:45
warikI don't really see any dhcp request either19:45
*** pixelbeat has quit IRC19:48
warikyes, except keystone19:48
Kiallweird - have you checked if VNC is listening like mjfork asked?19:48
mjforkwarik: so wait, how can you ping for 30 secs if there is no DHCP request?19:48
Kiallwould be worth connecting directly to that and seeing WTH is up..19:48
warikI know! it's crazy19:48
Kiallactually .. yea .. that makes no sense -_-19:48
warikI guess, it's because the schedule request this ip and somehow it's gets reachable for a sec and then it's gone19:50
mjforkIP is prob dnsmasq'edo n the host ?19:50
mjforkabut then when assigned to the guest, its not reachable?19:50
*** jedi4ever has joined #openstack19:50
*** mdomsch has joined #openstack19:52
warikKiall:  virsh dumpxml instance-00000022  |grep vnc19:52
warik    <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0' keymap='en-us'/>19:52
Kiallwarik: okay, so grab a VNC client and try to connect to "$compute_node:0"19:53
warikmjfork: I'm not following you..19:53
*** redconnection has joined #openstack19:53
mjforkwarik: n/m, lets get on VNC19:53
warikwhich packages should I install for ubuntu 11.10?19:54
Kiallany normal VNC client will do...19:54
Kiall(BTW you need a GUI for this.. so install it on your desktop)19:55
warikok19:55
Ryan_LaneI need to move my rabbit queue from one node to another. is there any recommended way of doing so?19:56
*** jedi4ever has quit IRC19:56
Ryan_Lanerabbit basically says you can't move queues. I need to change hostname.19:56
*** tr3buchet has quit IRC19:57
warikKiall: btw, I am running this test env. on virtual box ( idk if that's a clue or not)19:57
Ryan_Laneif I bring up a fresh queue, with no data, how will this affect my environment?19:57
*** tr3buchet has joined #openstack19:57
KiallRyan_Lane: you can wipe rabbitmq with no backups and reinstall fresh if you like.. no damage will be done, other than in-transit messages will be lost.. but thats no harm unless its a production environment19:58
Ryan_Laneit's a production environmnt19:58
Ryan_LaneI can disable the nova servies19:58
Ryan_Lane*services19:58
Ryan_Laneif that helps19:58
Ryan_Laneis shutting down the api server for a short period of time a reasonable way of killing in-transit messages?19:59
Ryan_LaneI can take an api outage, but I'd prefer not to corrupt things19:59
*** freeflying has joined #openstack19:59
*** carlp has joined #openstack20:00
KiallShutting down the api server will stop the majority of messages alright, a few seconds after you do that there should be nothing but helthcheck style messages bouncing around..20:00
Ryan_Lanegreat20:00
warikKiall / mjfork : I can't access the instance with VNC on the compute node, but I can with an instance on the CC node20:00
Ryan_LaneKiall: thanks20:00
*** mrmartin has joined #openstack20:01
*** adjohn has quit IRC20:02
Kiallwarik: Something is up with the instance, is the kvm process definitely running?20:02
Spiriliswhew, presentation went alright, had our unix sysadmins glassy-eyed (lol) and one of them fell asleep, the cluster crashed when we stopped rabbitmq momentarily and started back up (haven't been able to start any new instances since, nova-network isn't playing nice anymore)20:05
*** cereal_bars has joined #openstack20:05
Spirilisotherwise, I think I got the point across as to what it is, got people thinking about use cases :)20:06
*** aculich has quit IRC20:07
*** jfluhmann has joined #openstack20:08
mjforkSpirilis: nice job!20:09
Spirilislol looks like nova-network and nova-compute both bomb with some kombu error and broken pipe20:09
*** GheRivero_ has joined #openstack20:09
Spirilisthe messages all say that the AMQP connection came back (nova-compute.log, nova-network.log) but yet it takes a dump20:09
Spirilisrestarted all the services, going to try booting a VM now...20:10
Spirilisok now it's in Build state, that's further than I was getting before.  hrmm20:10
Spirilisseems like it doesn't gracefully handle RabbitMQ dieing and coming back20:10
*** willaerk has joined #openstack20:11
*** rnorwood has quit IRC20:11
*** hermy|away is now known as hermy20:12
warikKiall: yes libvirtd is running20:12
*** mdomsch has quit IRC20:12
Kiallbut is the kvm process running?20:12
warikkvm is not available on this server, it running qemu20:13
warikit's*20:13
Kiallok, is qemu running then ;)20:13
warik:)20:13
warikI can see the qemu process for the instance but no qemu process itself20:14
warikis it normal ?20:14
*** adjohn has joined #openstack20:14
Kiallyea..20:14
KiallOkay, if qemu is running and you cant VNC to it directly (ie not with the dashboard, with a real/normal VNC client) then you have qemu issues ;)20:15
warikdamn, ok20:16
KiallWell.. that or a firewall blocking you from connecting via VNC20:17
SpirilisFWIW, http://paste.openstack.org/show/4215/ ... there's an example of the rabbitmq error from nova-network's perspective20:17
warikKiall: i will look into that20:17
SpirilisIt obviously reconnects to the rabbitmq instance, but when it tries to publish a reply "2012-01-10 14:55:08,803 ERROR nova.rpc [-] Failed to publish message [Errno 32] Broken pipe"20:17
warikKiall / mjfork : thank you guys for the time!20:18
KiallSpirilis: diablo or essex? I think RMQ reconnection was fixed in essex20:18
bennerfor only running vm (compute node) only nova-compute is nessesary?20:18
*** maplebed has joined #openstack20:18
Spirilisdiablo20:18
SpirilisKiall: ahh sweet20:18
Spirilisgood to know that this is 1. a known bug and 2. fixed :)20:18
KiallActually, I think the fix might have been backported to diablo to...20:18
* Kiall tests20:19
Spirilisaye, I may have to update my copy of the codebase20:19
Spirilismine was pulled from GIT on 12/2120:20
*** krow has joined #openstack20:24
*** aculich has joined #openstack20:25
*** MarkAtwood has joined #openstack20:25
Spirilisyep there were definitely some changes to the codebase since 12/2120:26
Spirilisjust did a diff comparison20:26
*** rnorwood has joined #openstack20:27
*** bepernoot has quit IRC20:30
*** aarcane_ has quit IRC20:32
*** funzo has quit IRC20:37
*** jog0 has left #openstack20:38
*** ohnoimdead has joined #openstack20:42
*** funzo has joined #openstack20:43
*** tmichael has joined #openstack20:44
*** LeanReox has quit IRC20:46
*** katkee has joined #openstack20:47
Spirilisso it looks like restarting rabbitmq doesn't tank anything now...20:47
Spirilisbut I ran into another error, this time in nova-network20:48
Spiriliser20:48
Spirilisnova-compute20:48
Spirilis(nova.compute.manager): TRACE:     'ip_address': mapping['ips'][0]['ip'],20:48
Spirilis(nova.compute.manager): TRACE: IndexError: list index out of range20:48
Spirilisohh actually, weird, nova-api kicked off another rabbitmq reconnect error20:49
*** cp16net has quit IRC20:50
*** heckj has quit IRC20:50
*** Gordonz has quit IRC20:50
*** ppradhan has quit IRC20:50
*** dolphm has joined #openstack20:50
Tobbemjfork: So I installed devstack as per your suggestion, and I've now logged in to the dashboard. All images that came with devstack were 64bit images, so I downloaded a 32bit ubuntu image and added that to Glance. But how do I launch it?20:50
TobbeGoing to the "instances" page it tells me there are no instances but that I can create a new one from the "images" page. Going to the "images" page I see no option to start/create anything. Just "edit" and "delete"20:51
Tobbewhat am I missing?20:51
TobbeAnyone else knows?20:54
mjforkTobbe: flip over to user side20:54
Tobbeahh, there it is :)20:55
*** zzed has joined #openstack20:57
Tobbeohh, it got an IP (10.0.0.2)20:58
Tobbe"State" is still "Build"20:58
*** uksysadmin has joined #openstack20:58
*** rnorwood has quit IRC20:59
Tobbewoot, state changed to "active" :)21:00
Tobbetrying my luck with the vnc console...21:00
spackestwell, I worked through some things and got glance up and running it appears, but now when I try to install the nova components, I get this -> http://pastebin.com/FTP0sND221:02
*** bepernoot has joined #openstack21:02
*** dolphm has quit IRC21:02
spackeston debian squeeze21:02
mjforkspackest: can you use Ubuntu ?21:03
*** primeministerp has quit IRC21:03
spackestI started on ubuntu 11.10 but had troubles, was going to go to 11.04, but debian is an approved OS for us, so I was trying it out21:03
spackestI have had several issues with debian and I'm not to the point where I was on 11.10 :)21:04
*** flaviamissi has quit IRC21:04
*** Kiall2 has joined #openstack21:04
*** funzo has quit IRC21:04
Tobbewell, the vnc console says "Connected (unencrypted) to: QEMU (instance-00000001)" But I don't see any output, and I can't interact with it. At least not yet. I'm a little worried about the mention of QEMU. IIRC someone told me that qemu doesn't work inside a VirtualBox machine21:04
spackest11.10 I got all the way to starting an instance, and then things blew up on me21:04
mjforkspackest: what issues on ubunut? using devstck?21:05
spackestI need multi-node21:05
*** Kiall has quit IRC21:05
spackestan infinite loop on networking, just a sec, looks like a known bug, I just need to find it21:05
*** Kiall2 is now known as Kiall21:05
mjforkspackest: diablo release, multi node? what netowrking?21:06
spackestyes, diable release, multi node21:06
SpirilisOk well, now that I've updated nova,glance,keystone,horizon,openstackx .... The rabbitmq reconnect error has changed disposition; nova-network and nova-compute no longer dump, but nova-api does21:06
mjforkspackest: what networking?21:06
*** judd7 has quit IRC21:07
spackestbased on the networking here http://docs.openstack.org/diablo/openstack-compute/starter/content/Networking_Configuration-d1e1073.html using the extra config from the comment21:07
TobbeI get this if I click on the "log" button: http://paste2.org/p/1861335 can anyone spot anything wrong?21:08
mjforkspackest: pretty straight fowrad, what repository did you use?21:08
Tobbewhere does the nova logs end up when doing a devstack install?21:08
spackestthis is what I hit https://bugs.launchpad.net/ubuntu/+source/linux/+bug/85641721:08
Tobbe/var/log/nova does not exist21:08
spackestthe box actually locks up when I try to start an instance21:09
spackestI asked about it a couple times in here but didn't get a resposne21:09
spackestresponse21:09
spackestwasn't sure how to manually configure eth121:09
*** funzo has joined #openstack21:09
*** bepernoot has quit IRC21:10
mjforkspackest: hmm21:10
spackestmjfork: exactly :)21:12
*** BasTichelaar has quit IRC21:12
*** localhost has joined #openstack21:12
mjforkspackest: on the phone..one sec.21:12
SpirilisHere's my latest rabbitmq restart error-- http://paste.openstack.org/show/4217/ ... Note that rabbitmq was restarted at 16:07:38, so it had been running for at least 20 seconds before nova-api dumped that broken pipe error.21:12
*** JesperA has quit IRC21:14
Spirilisthen doing another hit, nova-api works correctly, but nova-network takes a dump21:17
SpirilisI'd say the rabbitmq problem's not fixed in latest git copy of stable/diablo21:18
*** Kiall_ has joined #openstack21:23
*** tmichael has quit IRC21:23
*** DigitalFlux has joined #openstack21:24
*** DigitalFlux has joined #openstack21:24
*** tmichael has joined #openstack21:26
uvirtbotNew bug: #914476 in nova "New Python-Novaclient Extension mechanism doesn't work w/ 2.6" [Medium,In progress] https://launchpad.net/bugs/91447621:36
*** andrewbogott_ has joined #openstack21:36
*** andrewbogott_ has quit IRC21:36
*** andrewbogott_ has joined #openstack21:36
*** rods has quit IRC21:39
*** rods has joined #openstack21:39
*** andrewbogott has quit IRC21:39
*** andrewbogott_ has quit IRC21:41
*** Carmivore has quit IRC21:43
*** jaypipes has quit IRC21:43
*** Trebortech has joined #openstack21:43
*** andrewbogott has joined #openstack21:45
TrebortechAnyone have an idea on how to add an additional virtual nic to a running server image?21:46
*** maplebed has quit IRC21:46
Spiriliswow weird, found a bug or quirk in the meta-data retrieval....21:46
*** dprince has quit IRC21:47
SpirilisVMs on 2 out of my 3 nova-compute nodes have no trouble hitting http://169.254.169.254/latest/meta-data21:47
Spirilisa VM on the 3rd node does... and nova-api on the first node sees the request as coming from that VM's hypervisor's IP, not the VM IP like it sees with the other 221:47
*** Carmivore has joined #openstack21:48
*** jaypipes has joined #openstack21:49
Spirilishuh... nat is definitely misbehaving on that one node21:50
uvirtbotNew bug: #914484 in nova "Boot from ISO is different in XS/KVM" [High,Triaged] https://launchpad.net/bugs/91448421:51
mjforkspackest: i apologize, i have to run. call ran over.21:54
*** uksysadmin has quit IRC21:58
*** spiffxp has quit IRC21:59
Spirilishumm ok, so with nova-network running on every node and multi_host enabled, it appears outbound 169.254.169.254 connections get masqueraded so the nova-api host thinks they're coming from the hypervisor rather than the VM22:00
*** sdake has quit IRC22:00
Spirilisif you assign a floating IP to the VM, then, somehow it works and the nova-api server sees the 192.168.* private IP22:00
TrebortechCan someone direct me to good network documentation for compute?22:01
*** hingo has quit IRC22:02
spackestmjfork: ok, I downloaded ubuntu 11.04 and will give it a god and then try to get it approved by our org somehow :)22:04
*** nati2 has quit IRC22:06
*** mcclurmc has quit IRC22:06
WormManVZW bought the MCI group I used to work for, we did back end networking for things like smog testing22:06
WormMansigh22:06
*** mcclurmc has joined #openstack22:07
* WormMan tries again, with the correct window22:07
*** leifmadsen has joined #openstack22:10
*** pixelbeat has joined #openstack22:13
*** sean_roberts has joined #openstack22:19
*** seanrob has joined #openstack22:19
*** seanrob has quit IRC22:19
*** sdake has joined #openstack22:19
*** ckleban has joined #openstack22:19
*** flaviamissi has joined #openstack22:24
*** dcramer_ has quit IRC22:25
*** tmichael has quit IRC22:27
*** tmichael has joined #openstack22:29
*** GheRivero_ has quit IRC22:30
*** andrewbogott has quit IRC22:31
*** jmoore has joined #openstack22:32
*** sean_roberts has quit IRC22:34
jmoorequick question that hopefully someone in here can answer. does the openstack interface for nova-api have functions for stopping and starting an instance? like the ec2 StartInstances and StopInstances?22:34
jmoorei spend some time looking through but didn't see anything.22:35
jmooreif there isn't, are there plans to add some functions to do that?22:35
*** krow has quit IRC22:36
*** redconnection has quit IRC22:41
*** ahasenack has quit IRC22:43
*** andrewsmedina has quit IRC22:45
*** panterax_ has joined #openstack22:45
*** andrewbogott has joined #openstack22:46
*** zzed has quit IRC22:46
*** panterax has quit IRC22:48
*** RobertLaptop has joined #openstack22:49
*** RobertLaptop has left #openstack22:49
*** lborda has quit IRC22:50
spackesthmm, looks like nova-manage recently changed?  the relevant commands here http://docs.openstack.org/diablo/openstack-compute/starter/content/Nova_conf-d2s367.html are failing22:50
spackestsudo nova-manage network create private 192.168.4.0/24 1 256 -> ValueError: invalid literal for int() with base 10: '192.168.4.0/24'22:51
Madkisshm22:52
*** miclorb_ has joined #openstack22:52
spackestsudo nova-manage floating create --ip_range=10.88.39.96/27 -> TypeError: create() takes exactly 3 arguments (2 given)22:52
*** jfluhmann has quit IRC22:52
*** joesavak has quit IRC22:53
*** Remco_ has joined #openstack22:53
*** mnabil has joined #openstack22:58
*** leifmadsen has quit IRC22:58
*** chrismsnz has joined #openstack22:58
spackestI followed the advice here https://answers.launchpad.net/nova/+question/178297 and dropped the word private, which seemed to fix things?22:59
*** mrmartin has left #openstack22:59
spackestthe command worked as documented in 11.10, but I guess not 11.04?22:59
*** Remco_ has quit IRC23:00
spackestaccording to http://nova.openstack.org/runnova/nova.manage.html nova-manage floating create --ip_range=10.88.39.96/27 should have a host in there somewhere23:02
spackestthis went through sudo nova-manage floating create 10.88.39.90 10.88.39.96/27 but I don't know if it's right23:03
Madkissopenstackx - Blah python module that adds blah and bleh23:03
Madkisswtf.23:03
*** leifmadsen has joined #openstack23:03
*** Remco_ has joined #openstack23:05
*** cereal_bars has quit IRC23:09
*** pradeep1 has joined #openstack23:10
*** jfluhmann has joined #openstack23:11
*** rnorwood has joined #openstack23:12
*** Damianz has quit IRC23:14
*** lts has quit IRC23:15
*** Eyk is now known as Eyk^off23:15
*** Remco_ has quit IRC23:15
*** andrewsmedina has joined #openstack23:17
*** markvoelker1 has quit IRC23:20
*** DanF has quit IRC23:21
*** DanF has joined #openstack23:21
*** katkee has quit IRC23:22
*** spiffxp has joined #openstack23:22
*** AlanClark has joined #openstack23:31
*** _adjohn has joined #openstack23:41
*** jfluhmann has quit IRC23:41
*** rnorwood has quit IRC23:42
*** deshantm_ has joined #openstack23:43
*** adjohn has quit IRC23:44
*** _adjohn is now known as adjohn23:44
*** nati2 has joined #openstack23:44
Spirilisheh found a workaround for my metadata-from-vms-on-multi_host-enabled-networks problem23:45
Spirilishttp://forums.openstack.org/viewtopic.php?f=16&t=562&p=2212#p221223:45
Spirilisjust run nova-api on all the compute nodes, along with nova-network, and set the --ec2_dmz_host on those nodes to point to its own IP rather than the IP of the "head" api node23:46
*** deshantm has quit IRC23:46
*** Trebortech has quit IRC23:47
*** rods has quit IRC23:51
*** cereal_bars has joined #openstack23:53
*** rods has joined #openstack23:55
*** PotHix has quit IRC23:57
*** ldlework has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!