*** ChiTo has quit IRC | 00:08 | |
*** aojea has joined #openstack-operators | 00:28 | |
*** aojea has quit IRC | 00:33 | |
*** markvoelker has quit IRC | 00:37 | |
*** chyka has quit IRC | 00:41 | |
*** gfhellma_ has quit IRC | 01:11 | |
*** gyee_ has quit IRC | 01:23 | |
*** aojea has joined #openstack-operators | 01:28 | |
*** aojea has quit IRC | 01:33 | |
*** markvoelker has joined #openstack-operators | 01:37 | |
*** Apoorva_ has quit IRC | 01:46 | |
*** vijaykc4 has joined #openstack-operators | 01:59 | |
*** chyka has joined #openstack-operators | 02:09 | |
*** chyka has quit IRC | 02:14 | |
*** AlexeyAbashkin has joined #openstack-operators | 02:22 | |
*** AlexeyAbashkin has quit IRC | 02:26 | |
*** aojea has joined #openstack-operators | 02:29 | |
*** vijaykc4 has quit IRC | 02:29 | |
*** vijaykc4 has joined #openstack-operators | 02:31 | |
*** aojea has quit IRC | 02:33 | |
*** fragatina has quit IRC | 03:10 | |
*** fragatina has joined #openstack-operators | 03:13 | |
*** fragatina has quit IRC | 03:17 | |
*** aojea has joined #openstack-operators | 03:30 | |
*** aojea has quit IRC | 03:34 | |
*** rcernin has quit IRC | 03:34 | |
*** rcernin has joined #openstack-operators | 03:36 | |
*** vijaykc4 has quit IRC | 03:40 | |
*** slaweq has joined #openstack-operators | 03:43 | |
*** slaweq has quit IRC | 03:48 | |
*** Apoorva has joined #openstack-operators | 04:08 | |
*** dbecker has quit IRC | 04:24 | |
*** sticker has quit IRC | 04:24 | |
*** aojea has joined #openstack-operators | 04:31 | |
*** aojea has quit IRC | 04:35 | |
*** dbecker has joined #openstack-operators | 04:37 | |
*** Apoorva_ has joined #openstack-operators | 04:46 | |
*** Apoorva has quit IRC | 04:49 | |
*** dmibrid_ has quit IRC | 04:52 | |
*** AlexeyAbashkin has joined #openstack-operators | 05:22 | |
*** AlexeyAbashkin has quit IRC | 05:26 | |
*** chyka has joined #openstack-operators | 05:30 | |
*** aojea has joined #openstack-operators | 05:31 | |
*** chyka has quit IRC | 05:35 | |
*** aojea has quit IRC | 05:36 | |
*** Apoorva_ has quit IRC | 05:41 | |
*** simon-AS559 has joined #openstack-operators | 05:42 | |
*** simon-AS5591 has quit IRC | 05:43 | |
*** yprokule has joined #openstack-operators | 05:57 | |
*** makowals has joined #openstack-operators | 06:27 | |
*** makowals_ has quit IRC | 06:28 | |
*** arnewiebalck has quit IRC | 06:29 | |
*** makowals has quit IRC | 06:29 | |
*** arnewiebalck has joined #openstack-operators | 06:29 | |
*** makowals has joined #openstack-operators | 06:30 | |
*** aojea has joined #openstack-operators | 06:32 | |
*** threestrands has quit IRC | 06:34 | |
*** aojea has quit IRC | 06:37 | |
*** Long_yanG has quit IRC | 06:41 | |
*** LongyanG has joined #openstack-operators | 06:41 | |
*** simon-AS559 has quit IRC | 06:41 | |
*** sticker has joined #openstack-operators | 06:42 | |
*** khyr0n has joined #openstack-operators | 06:50 | |
*** slaweq has joined #openstack-operators | 06:51 | |
*** slaweq has quit IRC | 06:55 | |
*** TuanLA has joined #openstack-operators | 06:55 | |
*** aojea has joined #openstack-operators | 06:57 | |
*** aojea has quit IRC | 06:58 | |
*** aojea has joined #openstack-operators | 06:58 | |
*** aojea has quit IRC | 06:59 | |
*** arnewiebalck_ has joined #openstack-operators | 06:59 | |
*** arnewiebalck has quit IRC | 07:00 | |
*** arnewiebalck_ is now known as arnewiebalck | 07:00 | |
*** dtrainor has quit IRC | 07:04 | |
*** slaweq has joined #openstack-operators | 07:07 | |
*** spectr has joined #openstack-operators | 07:13 | |
*** slaweq has quit IRC | 07:15 | |
*** kelv_ has quit IRC | 07:18 | |
*** rcernin has quit IRC | 07:20 | |
*** Oku_OS-away is now known as Oku_OS | 07:24 | |
*** spectr has quit IRC | 07:38 | |
*** slaweq has joined #openstack-operators | 07:47 | |
*** pcaruana has joined #openstack-operators | 07:51 | |
*** slaweq has quit IRC | 07:52 | |
*** belmoreira has joined #openstack-operators | 07:53 | |
*** mmedvede has quit IRC | 07:59 | |
*** purp has quit IRC | 07:59 | |
*** maciejjozefczyk has quit IRC | 08:00 | |
*** simon-AS559 has joined #openstack-operators | 08:01 | |
*** purp has joined #openstack-operators | 08:04 | |
*** slaweq has joined #openstack-operators | 08:05 | |
*** mmedvede has joined #openstack-operators | 08:06 | |
*** maciejjozefczyk has joined #openstack-operators | 08:06 | |
*** dtrainor has joined #openstack-operators | 08:07 | |
*** slaweq has quit IRC | 08:10 | |
*** vijaykc4 has joined #openstack-operators | 08:11 | |
*** tesseract has joined #openstack-operators | 08:17 | |
*** vijaykc4 has quit IRC | 08:17 | |
*** Jack_Iv has joined #openstack-operators | 08:33 | |
*** Jack_Iv has quit IRC | 08:33 | |
*** Jack_Iv has joined #openstack-operators | 08:34 | |
Jack_Iv | Does Magnum deploy a private etcd service for discovery? I don't have access to the public actually. What is the solution? | 08:35 |
---|---|---|
*** AlexeyAbashkin has joined #openstack-operators | 08:37 | |
*** jbadiapa_ is now known as jbadiapa | 08:43 | |
*** simon-AS559 has quit IRC | 08:45 | |
*** gkadam has joined #openstack-operators | 09:02 | |
*** chyka has joined #openstack-operators | 09:06 | |
*** zenpwner has joined #openstack-operators | 09:08 | |
*** chyka has quit IRC | 09:11 | |
*** khyr0n has quit IRC | 09:21 | |
*** simon-AS5591 has joined #openstack-operators | 09:24 | |
*** derekh has joined #openstack-operators | 09:34 | |
*** belmoreira has quit IRC | 10:01 | |
*** belmoreira has joined #openstack-operators | 10:06 | |
*** makowals has quit IRC | 10:08 | |
*** zenpwner has quit IRC | 10:15 | |
*** TuanLA has quit IRC | 10:17 | |
*** TuanLA has joined #openstack-operators | 10:18 | |
*** TuanLA has quit IRC | 10:19 | |
*** rmart04 has joined #openstack-operators | 10:40 | |
*** rmart04 has quit IRC | 11:36 | |
*** sticker_ has joined #openstack-operators | 11:36 | |
*** sticker has quit IRC | 11:40 | |
*** rmart04 has joined #openstack-operators | 11:41 | |
*** Jack_Iv has quit IRC | 11:41 | |
*** slaweq has joined #openstack-operators | 12:06 | |
*** racedo has quit IRC | 12:08 | |
*** slaweq has quit IRC | 12:11 | |
*** sticker_ has quit IRC | 12:32 | |
*** Caterpillar has quit IRC | 12:54 | |
*** Caterpillar has joined #openstack-operators | 12:54 | |
*** racedo has joined #openstack-operators | 13:00 | |
*** makowals has joined #openstack-operators | 13:11 | |
openstackgerrit | Martin Mágr proposed openstack/osops-tools-monitoring master: Fix for check_neutron_floating_ip https://review.openstack.org/516381 | 13:26 |
*** markvoelker has quit IRC | 13:29 | |
*** markvoelker has joined #openstack-operators | 13:29 | |
*** nguyentrihai has joined #openstack-operators | 13:33 | |
*** liverpooler has quit IRC | 13:34 | |
dims | folks, anyone interested in volunteering? add your name at the bottom of the etherpad - https://etherpad.openstack.org/p/LTS-proposal | 13:46 |
dims | there are 3 people already! | 13:47 |
zioproto | Hello Ops, have a look at this bug. If it matches your use case https://bugs.launchpad.net/nova/+bug/1732428 Possible data loss | 14:01 |
openstack | Launchpad bug 1732428 in OpenStack Compute (nova) "Unshelving a VM breaks instance metadata when using qcow2 backed images" [Undecided,New] | 14:01 |
*** slaweq_ has joined #openstack-operators | 14:08 | |
*** fragatina has joined #openstack-operators | 14:11 | |
*** slaweq_ has quit IRC | 14:12 | |
*** makowals has quit IRC | 14:15 | |
*** fragatina has quit IRC | 14:16 | |
*** belmoreira has quit IRC | 14:23 | |
*** liverpooler has joined #openstack-operators | 14:41 | |
*** liverpooler has quit IRC | 14:45 | |
*** liverpooler has joined #openstack-operators | 14:47 | |
*** simon-AS5591 has quit IRC | 15:20 | |
*** simon-AS559 has joined #openstack-operators | 15:20 | |
*** belmoreira has joined #openstack-operators | 15:49 | |
*** rmart04 has quit IRC | 16:07 | |
*** Oku_OS is now known as Oku_OS-away | 16:13 | |
*** markvoelker_ has joined #openstack-operators | 16:18 | |
*** markvoelker has quit IRC | 16:20 | |
*** simon-AS5591 has joined #openstack-operators | 16:29 | |
*** simon-AS559 has quit IRC | 16:30 | |
*** simon-AS559 has joined #openstack-operators | 16:35 | |
*** simon-AS5591 has quit IRC | 16:36 | |
*** simon-AS559 has quit IRC | 16:40 | |
*** Apoorva has joined #openstack-operators | 16:45 | |
*** makowals has joined #openstack-operators | 16:49 | |
*** chyka has joined #openstack-operators | 16:52 | |
*** Chris__ has joined #openstack-operators | 16:52 | |
openstackgerrit | Merged openstack/osops-tools-monitoring master: Fixed check_nova_instance https://review.openstack.org/516716 | 16:53 |
*** belmoreira has quit IRC | 16:53 | |
openstackgerrit | Merged openstack/osops-tools-monitoring master: Fix for check_neutron_floating_ip https://review.openstack.org/516381 | 16:54 |
Chris__ | Hi, I am having some issues with a compute node deployed using openstack juno. When looking at my compute logs, I am seeing this error https://paste.ofcode.org/ZXi2m8EE7U8jzfYxXW4Qzj . This seems stop the nova-compute service. I've tried deleting this instance doing a nova delete <instance_id> but it seems when I try to restart the nova-compute service this error keeps popping up. | 16:59 |
Chris__ | It seems the compute filter command its getting stuck at is, blockdev: RegExpFilter, blockdev, root, blockdev, (--getsize64|--flushbufs), /dev/.* | 16:59 |
Chris__ | Does the path /dev/.* store the instance id somewhere that nova-compute looks for when running | 17:02 |
*** tesseract has quit IRC | 17:03 | |
*** gfhellma has joined #openstack-operators | 17:09 | |
*** yprokule has quit IRC | 17:10 | |
*** ChiTo has joined #openstack-operators | 17:12 | |
*** d0ugal has quit IRC | 17:12 | |
*** masber has quit IRC | 17:15 | |
*** B_Smith has quit IRC | 17:28 | |
*** makowals has quit IRC | 17:28 | |
*** AlexeyAbashkin has quit IRC | 17:29 | |
*** gyee_ has joined #openstack-operators | 17:34 | |
*** rmart04 has joined #openstack-operators | 17:34 | |
*** gfhellma_ has joined #openstack-operators | 17:34 | |
*** rmart04 has quit IRC | 17:37 | |
*** gkadam has quit IRC | 17:37 | |
*** gfhellma has quit IRC | 17:37 | |
*** racedo has quit IRC | 17:46 | |
*** derekh has quit IRC | 17:59 | |
*** fragatina has joined #openstack-operators | 18:01 | |
*** fragatina has quit IRC | 18:01 | |
*** fragatina has joined #openstack-operators | 18:02 | |
*** pcaruana has quit IRC | 18:11 | |
*** aojea has joined #openstack-operators | 18:15 | |
*** fragatina has quit IRC | 18:15 | |
*** gfhellma__ has joined #openstack-operators | 18:20 | |
*** B_Smith has joined #openstack-operators | 18:24 | |
*** gfhellma_ has quit IRC | 18:24 | |
*** aojea has quit IRC | 18:31 | |
klindgren_ | 1 - juno is like *really* old. | 18:33 |
klindgren_ | 2.) that error looks like its coming from rootwrap - most likely that its missing a root wrap filter, so its not allowing the blockdev command to run | 18:34 |
*** fragatina has joined #openstack-operators | 18:34 | |
klindgren_ | I would look at you rootwrap.d stuff and make sure blockdev is allowed on that compute node | 18:34 |
klindgren_ | https://ask.openstack.org/en/question/56558/usrbinnova-rootwrap-unauthorized-command-blockdev-getsize64-cinder1img-no-filter-matched/ | 18:36 |
klindgren_ | Chris__, ^^ | 18:36 |
klindgren_ | also - https://review.openstack.org/#/c/65944/1/etc/nova/rootwrap.d/compute.filters | 18:37 |
*** makowals has joined #openstack-operators | 18:42 | |
*** TxGirlGeek has joined #openstack-operators | 18:55 | |
*** TxGirlGeek has quit IRC | 18:55 | |
*** TxGirlGeek has joined #openstack-operators | 18:55 | |
*** TxGirlGeek has quit IRC | 18:58 | |
*** TxGirlGeek has joined #openstack-operators | 18:58 | |
*** TxGirlGeek has quit IRC | 18:59 | |
Chris__ | thanks for the response klindgren_ | 19:00 |
*** TxGirlGeek has joined #openstack-operators | 19:02 | |
*** TxGirlGeek has quit IRC | 19:02 | |
*** TxGirlGeek has joined #openstack-operators | 19:02 | |
*** simon-AS559 has joined #openstack-operators | 19:11 | |
*** AlexeyAbashkin has joined #openstack-operators | 19:13 | |
*** AlexeyAbashkin has quit IRC | 19:17 | |
*** d0ugal has joined #openstack-operators | 19:20 | |
*** AlexeyAbashkin has joined #openstack-operators | 19:22 | |
*** TxGirlGeek has quit IRC | 19:26 | |
*** AlexeyAbashkin has quit IRC | 19:26 | |
*** TxGirlGeek has joined #openstack-operators | 19:34 | |
*** TxGirlGeek has quit IRC | 19:43 | |
*** TxGirlGeek has joined #openstack-operators | 19:44 | |
*** TxGirlGeek has quit IRC | 19:53 | |
*** TxGirlGeek has joined #openstack-operators | 19:59 | |
*** TxGirlGeek has quit IRC | 20:00 | |
*** slaweq has joined #openstack-operators | 20:10 | |
*** slaweq has quit IRC | 20:15 | |
*** dmibrid_ has joined #openstack-operators | 20:16 | |
*** d0ugal_ has joined #openstack-operators | 20:25 | |
*** d0ugal has quit IRC | 20:26 | |
*** jbadiapa_ has joined #openstack-operators | 20:33 | |
*** jbadiapa has quit IRC | 20:36 | |
*** d0ugal_ has quit IRC | 20:40 | |
*** d0ugal has joined #openstack-operators | 20:40 | |
*** d0ugal has quit IRC | 20:40 | |
*** d0ugal has joined #openstack-operators | 20:40 | |
*** Apoorva has quit IRC | 20:43 | |
*** Apoorva has joined #openstack-operators | 20:43 | |
*** Apoorva has quit IRC | 20:43 | |
*** d0ugal has quit IRC | 20:52 | |
*** TxGirlGeek has joined #openstack-operators | 21:00 | |
*** TxGirlGeek has quit IRC | 21:04 | |
*** simon-AS559 has quit IRC | 21:15 | |
*** Chris__ has quit IRC | 21:15 | |
*** liverpooler has quit IRC | 21:20 | |
*** threestrands has joined #openstack-operators | 21:32 | |
*** threestrands has joined #openstack-operators | 21:32 | |
*** mriedem has left #openstack-operators | 21:53 | |
*** mriedem has joined #openstack-operators | 21:53 | |
mriedem | klindgren_: i'm not even sure how to tell anymore, but attach interface doesn't work with upstream cells v1 right? | 21:53 |
mriedem | or, | 21:54 |
mriedem | is that routed to the child cell api? | 21:55 |
klindgren_ | attach interface - afaik always worked | 21:59 |
mriedem | yeah i got confused by something internal where it's looking at either parent api vs child api | 22:00 |
klindgren_ | the things that we have patches around is mainly creating the following from the top level: host aggregates, flavors, server_groups, (key pairs iirc), | 22:01 |
mriedem | yeah ok | 22:01 |
mriedem | everything that's now in the nova_api db now | 22:02 |
mriedem | minus placement things | 22:02 |
*** makowals has quit IRC | 22:06 | |
*** slaweq has joined #openstack-operators | 22:11 | |
*** liverpooler has joined #openstack-operators | 22:12 | |
mgagne | mriedem: there are patches floating around for that IIRC | 22:13 |
mgagne | mriedem: just grep for CellsV1 to see the extend of what I (and ops) needs to forward port each release for cellsv1: https://github.com/NeCTAR-RC/nova/commits/nectar/mitaka | 22:14 |
*** slaweq has quit IRC | 22:15 | |
mriedem | but if/when you can get to that sweet place of using cellsv2, you won't need those anymore | 22:16 |
mgagne | mriedem: sure, still playing catch up. and also, tbh, I still don't fully understand what I will need to do to get cellsv2. there are upgrade guides available but to be honest, I have a very hard time digesting the information and how I will need to update my deployment tools to make it happen. | 22:17 |
mriedem | yeah, and that's mostly because we (nova devs) don't have large cells v1 clusters to be kicking at that, so we can provide suggestions on what we think needs to happen, but are also needing large cells v1 users to help us and each other with that - which belmiro is doing a bit with what he's doing at CERN | 22:18 |
mriedem | and i think nectar is going to do it a little differently too, | 22:18 |
mgagne | mriedem: also english is not my first language so I can get lost easily trying to read and see how it applies to me (or not) | 22:18 |
mriedem | e.g. per-cell placement service or a global placement | 22:18 |
mriedem | i don't know yet what godaddy is going to do, not sure if they know :) | 22:18 |
mgagne | I have *zero* idea so far about what I will need to do to get placement api, haven't fully read about the subject yet | 22:19 |
mriedem | i think CERN is the first large cells v1 user moving to ocata? | 22:20 |
mgagne | those are major changes and slow down our upgrade pace since we need to read and try to grasp what this is all about and eventually, how to operate and support it. | 22:20 |
mriedem | yes i understand | 22:20 |
mriedem | i can't fully appreciate it, but i can understand that this isn't a simple thing | 22:20 |
*** AlexeyAbashkin has joined #openstack-operators | 22:21 | |
mriedem | fwiw, nova considers placement external and global, like keystone and neutron and cinder | 22:21 |
mgagne | compared to keystone, I jokily said to a coworker I would upgrade it in our private cloud this afternoon and did it in less than a day. Can't do the same with Nova tbh, too many changes, patches, test cases, etc. | 22:21 |
mriedem | well, that's not really a fair comparison is it? | 22:22 |
mriedem | you're not running keystone agents on 100K machines | 22:22 |
mgagne | well, nova is the only one falling being in our setup tbh =) | 22:22 |
mgagne | I think the number of agents is irrelevant | 22:22 |
mriedem | so you're falling behind because of a large number of patches to add functionality to the API because yo'ure using cellsv1 right? | 22:23 |
mgagne | because once details are ironed out, upgrade is relatively fast | 22:23 |
*** rcernin has joined #openstack-operators | 22:23 | |
mgagne | mriedem: partially, we also support baremetal/ironic. so we need to test those use cases too. | 22:23 |
mriedem | i'm not sure what "too many test cases" means | 22:23 |
mriedem | would you rather we test less? | 22:24 |
mgagne | I'm not sure what you are suggesting | 22:24 |
mriedem | you said, "Can't do the same with Nova tbh, too many changes, patches, test cases, etc." | 22:25 |
mriedem | what does 'too many test cases' mean? | 22:25 |
mriedem | i'm assuming you just mean merge conflicts or test failures when syncing up your code with upstream | 22:25 |
mgagne | "... that I have to test" | 22:25 |
mriedem | oh, because of baremetal | 22:25 |
mriedem | plus kvm | 22:25 |
mgagne | yes | 22:25 |
mgagne | ~12 images, at least ~3 major hw setup (mostly related to network) | 22:25 |
*** AlexeyAbashkin has quit IRC | 22:26 | |
mgagne | so 36 baremetal use cases if you want to fully cover | 22:26 |
mriedem | so would people rather we just say nova is feature complete and call it a day? | 22:26 |
mgagne | so it's not really nova's problem here. | 22:26 |
mgagne | but with major refactors coming (cells, placement, etc.) it's just more in my already full plate. | 22:27 |
mriedem | sure, i get that, | 22:27 |
mriedem | cellsv2 is to replace the problem that is cellsv1 | 22:27 |
mriedem | so everyone is aware | 22:27 |
mriedem | and allow non-cellsv1 people to scale out in the same way w/o all of the extra headache | 22:27 |
mgagne | sure... meanwhile, I'm forward porting patches for 4-5 releases already. | 22:27 |
mgagne | and can't easily catch up to latest nova release because I'm caught in an upgrade nightmare. | 22:28 |
mriedem | it would be useful to know how much of that forward porting work is due to being on cells v1 though | 22:28 |
mriedem | like, if 75% of your patch load is to fill gaps in the api for cells v1, that goes away if/when you get to cellsv2 | 22:29 |
mriedem | because it works natively with the compute api | 22:29 |
mriedem | if the other 25% is some amount of custom stuff or whatever, then i'm not sure what to do about that except encourage you to upstream those, like the extend volume stuff we worked on in pike, | 22:30 |
mriedem | and if half of that 25% is common across a lot of nova deployments, but ops aren't telling us everyone is caring the same patch, we need to know that | 22:30 |
mriedem | s/caring/carrying/ | 22:30 |
mgagne | sorry I don't want to be harsh but being told that cellsv2 is the holy grail for a couple of releases/years already, it's tiresome. | 22:31 |
mgagne | ops tried to upstream cellsv1 patches but were told it's non-supported and won't be merged anymore. | 22:31 |
mriedem | yeah, because we were trying to focus on cells v2 | 22:32 |
mriedem | so rather than limp along a thing we don't want, | 22:32 |
mriedem | we focused on the future replacement | 22:32 |
mriedem | which makes those api changes to make cells v1 feature complete irrelevant | 22:32 |
mgagne | ok, I don't know what to say anymore | 22:34 |
mriedem | that's fine :) | 22:34 |
mriedem | i'm not trying to argue, just trying to understand and share my perspective | 22:34 |
mgagne | because "ops aren't telling us everyone is caring the same patch, we need to know that" we did and didn't get a satisfactory answer. | 22:34 |
mriedem | i do remember going through the etherpad of patches and noting on several, things like "this shouldn't be a problem, it's a bug fix, just push it up" | 22:35 |
mriedem | for the API parity things, i did bring it up a few releases ago and the consensus was to not take those on because of the focus on v2 | 22:36 |
mgagne | I remember that one | 22:36 |
mriedem | so it's not like it wasn't considered | 22:36 |
*** ChiTo has quit IRC | 22:36 | |
mriedem | this was specifially the neutron external events / vif plug timeout stuff | 22:36 |
mgagne | I don't think there is that much patches related to API, mostly bug fixes | 22:36 |
mgagne | That being said, nectar already did the job of forward porting the patches, I can't complain. But with the actual situation on my side, it's hard to invest that much to perform an upgrade every 6 months. | 22:38 |
*** lbragstad has joined #openstack-operators | 22:43 | |
*** d0ugal has joined #openstack-operators | 22:51 | |
*** ChiTo has joined #openstack-operators | 22:51 | |
*** ChiTo has quit IRC | 22:59 | |
*** ChiTo has joined #openstack-operators | 22:59 | |
*** AlexeyAbashkin has joined #openstack-operators | 23:20 | |
*** AlexeyAbashkin has quit IRC | 23:25 | |
*** masber has joined #openstack-operators | 23:30 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!