Wednesday, 2023-02-08

opendevreviewJames Denton proposed openstack/openstack-ansible-os_nova master: Add authentication for [cinder] section of nova.conf  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/87227903:52
hamburglerHey all, I noticed that when deploying OSA Zed with OVN on Ubuntu 20.04 the additional upstream repo(s) that gets installed will allow for openvswitch to be upgraded to 2.17.0 > which is also required by an OVN deployment but the repo for openvswitch installs a version for (22.04), now the deployment works fine and it looks like all dependencies are met - but does anyone believe this is going to pose a long term problem 04:48
hamburgleror is this as expected functionality for now? Nowhere in the OSA deployment requirements does it say an OVN deployment can only be on 22.04 which is still labelled as experimental. dpkg -s openvswitch-switch : Version: 2.17.3-0ubuntu0.22.04.1~cloud004:48
NeilHanlonnoonedeadpunk: hm.. did not realize this would have an effect on OSA...07:58
noonedeadpunkhamburgler: hey there. I beleive that openvswitch comes from Ubuntu Cloud Archive. So basically that's the repository where Ubuntu maintainers does push appropriate packages (https://wiki.ubuntu.com/OpenStack/CloudArchive) that are going to work in conjuction with openstack.08:35
noonedeadpunkThat used to work good enough, and yes, they're backporting packages from newer releases back to older ones. But I don't think there's gonna be a problem with that08:36
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-openstack_hosts master: Install curl by defining binary that is provided  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/87297308:39
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Install curl by defining binary that is provided  https://review.opendev.org/c/openstack/openstack-ansible/+/87289608:39
hamburglernoonedeadpunk: wonderful thank you :)08:40
noonedeadpunkhamburgler: though, for ubuntu 20.04 they've stopped supporting it on Yoga, so we're actually installing Yoga repo there as latest supported ones. But since it's used only for things like libvirt/qemu/ovs - it should be fine as 20.04 support in openstack will remain at least until Antelope (will be dropped at Bobcat)08:43
noonedeadpunkBut you can override openstack_hosts_package_repos variables if you want (or define it to the empty list) to skip installation of UCA. Now it's defined as https://opendev.org/openstack/openstack-ansible-openstack_hosts/src/branch/master/vars/ubuntu-20.04.yml#L88-L9108:44
hamburglernoonedeadpunk: Awesome this is great thank you! Do you think it's reasonably safe to use a Zed deployment then with the yoga repo then?08:48
noonedeadpunkWell. I would make sense to use 22.04 to be frank on Zed, as if it's relatively new deployment, I'm not sure you want to upgrade OS with next OpenStack upgrade08:49
noonedeadpunkBut packages there does satisfy all minimal requirements that are set in Zed for software versions. As there should be no major changes in these requirement from Yoga to Antelope to allow SLURP upgrades08:50
hamburglerHmm yeah on the OSA deployment page it still says that 22.04 has experimental support08:50
noonedeadpunkWe should clarify that better. It's in that stage only due to ceph, since ceph comunity repo does not have anything for 22.04. So we install ceph client also from UCA, which means you're not able to control version of ceph client that will be installed comparing to community repo08:52
noonedeadpunkhamburgler: do you happen to have a link to the doc page you're reffering to ? :-)08:53
noonedeadpunk`Experimental support in Yoga release` -> I assume that...08:53
hamburglerthat's right yeah :)08:54
noonedeadpunkWell, you're running Zed, so... :p08:54
hamburglerhaha I had read that wrong :p 08:54
hamburglermy bad08:54
noonedeadpunkI will fix docs now08:54
hamburglerI appreciate all the help :) - I think we were a bit hesitant to run with 22.04 at this stage08:55
hamburglerOur Ceph role is internal though08:55
noonedeadpunkwell, I'm talking also about ceph-client one https://opendev.org/openstack/openstack-ansible-ceph_client08:56
noonedeadpunkWhich is smth you wanna use/configure for sure08:56
hamburglerAh yes08:56
noonedeadpunkiirc you will end up with quincy client there for 22.0408:57
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Update Ubuntu 22.04 support status  https://review.opendev.org/c/openstack/openstack-ansible/+/87309109:16
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Use 2.0.0 release for ansible-collections-openstack  https://review.opendev.org/c/openstack/openstack-ansible/+/87309209:20
hamburglernoonedeadpunk: Is there somewhere I can view the differences in packages between yoga and zed as it pertains to the UCA?09:23
noonedeadpunkhamburgler: So in UCA there're packages for Zed for 22.04 and for Yoga for 20.04 without any good upgrade path in between. So you can check packages on their tracker though https://openstack-ci-reports.ubuntu.com/reports/cloud-archive/yoga_versions.html 09:26
noonedeadpunkhamburgler: in case you're doing source install (default way) - you should skip all openstack packages (like cinder/nova/glance/etc) as they're not used 09:28
noonedeadpunks/skip/ignore/09:29
noonedeadpunkso we mainly use just libvirt/ovs/ovn/some dependencies for these09:30
noonedeadpunkSo it's eventually quite limited subset of packages coming from UCA by default, and eventually in some cases that could be even skipped.09:36
hamburglerWonderful thank you so much :)09:36
jrossernoonedeadpunk: i had another tricky isolated deployment thing you might be interested in - if you mirror stuff at http://mirror.example.com/ubuntu and http://mirror.example.com/uca it gets difficult to write the proper apt pins10:47
jrosserthe apt pins we have used in OSA refer to mirror.example.com sop can't distinguish for example ceph in /ubuntu and ceph in /uca10:48
jrosserbut you can easily make CNAME for the mirror to have mirror-uca.example.com or whatever else, then the apt pins all work as you'd expect10:48
noonedeadpunkwell, for that env we have 22.04, so no choice of ceph there....10:50
jrosserahh ok - becasue of ceph/22.04 we are still trying to decide what to do next :/10:50
jrosserone option which is feeling least bad, pretty unbelievably, is to build our own ceph :(10:51
noonedeadpunkWell, we have Quincy running anyway, so maybe less of an issue10:51
noonedeadpunkyeah, did that and it wasn't so bad to be frank10:51
noonedeadpunkEventually for client part I'm not sure how much it matters. But for ceph-ansible part - yeah... I'd build ceph...10:53
noonedeadpunkbut yes, that's quite interesting pinning issue...10:55
noonedeadpunkAnd tbh I wouldn't exepct such behaviour, given that today we pin based on the release - https://opendev.org/openstack/openstack-ansible-ceph_client/src/branch/master/defaults/main.yml#L4310:56
noonedeadpunkI assumed that release can distinguish source nicely tbh10:58
moha7This Chinese forum has a lot of posts related to openstack: https://zzk.cnblogs.com/s/blogpost?Keywords=openstack&DateTimeRange=OneYear11:02
moha7for example: https://www.cnblogs.com/liujitao79/p/15251805.html11:02
moha7I finally decided to use local repos as I get: opendev: less 100 KB/s | github: less than 5 MB/s | local repo: more than 20 MB/s11:03
moha7As it's recommended here: `/opt/openstack-ansible/doc/source/user/limited-connectivity/index.rst` to have your Pypi repo, I also cached the pip-required packages using Nexus Sonatype. I think it would useful if this kind of Easter egg be mentioned here: https://docs.openstack.org/project-deploy-guide/openstack-ansible/zed/targethosts.html (I'll do if I get rid of setting the stage env up soon)11:09
moha7I got demo from https://openmetal.io/, free for 32 hours. They're using Kolla-ansible.11:10
moha7I asked the "why Kolla", and here is their answer: During development we tested various deployment options including TrippleO, openstack-ansible, Juju, etc and made the decision based on our experience, familiarity, and understanding of similar systems. Our goals include the ability to deploy a production-ready OpenStack default. Some customers may customize and reconfigure their clouds as they see fit if they have or are 11:18
moha7willing to acquire the experience to modify OpenStack post our default, in fact, many do so. 11:18
moha7---11:18
moha7Maybe this question I want to ask is like the historical question of debate whether Vim or Emacs is better! But I'd like to hear your perspective on the deployment methods from Kolla to Juju and why you found OSA so valuable that you're still developing it.11:18
moha7I started from Kolla and it was deployed in half a day. Then I came to OSA and got a lot of help from you. We will choose this OSA. But knowing your point of view will help me defend my decision in the future. One of the strengths of OSA for me is its Hardenning feature and of course the active community, here.11:23
moha7Note: when Zed is released by OpenStack officially, Kolla releases its support for Yoga intended for production deployments, then OVN is not provided yet.11:24
noonedeadpunkWell, yes, it's indeed quite a debate we tend not to raise - everyone have it's own taste when it comes to technology. I'd say that main reason is that OSA is way more flexible then kolla. Then - you just need to know ansible to read the code - we're trying to keep it rather readable and use common practises. Also - with OSA you're not locked with docker containers, as it's not that easy to debug them after all, and you're able to do just 11:53
noonedeadpunkbare metal deploys without any containers in the picture11:53
noonedeadpunkmoha7: we also have some "internal" policy, that we don't suggest upgrading production environments to *.0.0 tag - we usually recommend waiting for *.1.0 before upgrading your production environments to the new release11:54
noonedeadpunkI'm not sure if it's described anywhere to be frank11:54
noonedeadpunkFrom other side - kolla is faster in execution, as they use same container image for all hosts that should contain it. We do allow to use even different versions of service in same deployment. For example it might be handy while debugging things, like you're trying some upstream patch - you can define external github repo and SHA with this patch included only for 1 compute or 1 glance-api container, and provide this backend with ACL rule 11:57
noonedeadpunkfor haproxy backend to pass all traffic from your internal IP towards this backend only11:57
noonedeadpunkSo you can do really crazy things with OSA11:57
noonedeadpunkI assume speed does matter for openmetal.io and they don't care much about use-cases we do have for our deployments as operators. As their business is mainly - spin up many clouds as fast as possible.11:59
moha7noonedeadpunk: Thanks for sharing your comments. It is a convincing conclusion.13:03
*** tosky_ is now known as tosky14:19
prometheanfireare there consultancies that work with OSA (work is asking for if I get hit by a bus)?19:19
noonedeadpunkThere for sure are!19:26
spatelprometheanfire pay me :) 19:36
spatelLet integrate OSA with AI which will self drive everything... hehe 19:37
spatelI am using ceph deployment and somehow vm boot time is slow. I thought with ceph it should be quick if using raw images 19:38
prometheanfirelolol19:39
prometheanfireceph's been quick for me19:39
jrosseryou’ve enabled all the snapshot stuff?19:39
spatelI didn't do anything, this is fresh installation 19:39
jrosserlike between glance and cinder pools19:39
spatelI have no snapshot at all19:40
jrosserit should be a noop in the storage backend to snapshot the image in glance into the cinder pool19:40
jrosserif that’s not happening you should fix that19:40
spatelhmm wait where is that setting? 19:41
jrosserI can’t look just now sorry19:41
spatellet me google it out.. thanks for the clue.. 19:41
spateljrosser not able to find any reference in nova.conf config.. 19:50
spateljust ping me whenever you available and i will give it a shot19:50
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-python_venv_build master: Drop empty elements from constraint/requirement files  https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/87320820:49
jrosserspatel: it is glance not nova https://opendev.org/openstack/openstack-ansible-os_glance/src/branch/master/templates/glance-api.conf.j2#L2820:52
jrosserhttps://docs.ceph.com/en/latest/rbd/rbd-openstack/#enable-copy-on-write-cloning-of-images20:53
spateloh!! so i need to set show_image_direct_url = True20:55
spatellet me see if i have that in place20:55
jrosserthe glance role should be doing that20:55
jrosserhttps://opendev.org/openstack/openstack-ansible-os_glance/src/branch/master/defaults/main.yml#L8520:56
jrosserspatel: you are using ceph for your glance storage too?20:56
spatelYes ceph for everything 21:02
spatelnova/glance/cinder all using ceph21:02
jrosserso you should see that the cinder rbd are snapshots of the images out of the glance pool21:07
spatelI don't have this option - show_image_direct_url = True21:22
spatelI am going to set this first and compare speed before vs after 21:23
spateljrosser do i need to re-upload images or it should work with existing images?21:48
jrosserwell question is why21:48
jrosseris this OSA?21:48
spateljrosser now its freaking fast...22:00
spatel5 min vs 30 second :) 22:00
spateli didn't re-upload image 22:00
spateljust change option and it works 22:00
admin1moha7, why are you using OSA and not kolla ? 22:09
admin1just asking as what are your points of using this 22:10
admin1as a new user 22:10
moha7OSA: endemic to OPS itself, more native + security22:24
moha7Juju: no familiarity with the stack22:24
moha7Kolla: Lack of security enhancements; If docker, why not Kubernetes by OpenStack-Helm22:24
moha7OpenStack-Helm: Not well documented, OVN is not supported yet, Need time to master structural complexity22:25
moha7VIO: Paid and exclusive22:26
moha7admin1: ^22:26
admin1i started on openstack around 2014 as full time ..  and i think around early 2015 used OSA .. and got hooked into it .. ..  for a specific company my job was to setup every known openstack platforms and certify/test our products/solutions on top of it, so I have an idea of all setups and deployments .. whenever there was a custom request, i always22:33
admin1found that it could be done with OSA and not with anything else.. OSA is poweful to deploy with almost zero changes .. i most of the time only work on the variables and setup file and that is it .. 2 files and you can pretty much get a very good openstack .. but also if you want, you can dive deep and change anything and do it your own way22:33
admin1another is the level of support .. if you go into any other deployment channels /lists and ask a non default question and there is total silence .. as no one knows .. but with OSA , because of the flexibility, you find a lot of experience in this channel 22:34
admin1here you an ask any kind of deployment scenario and chances are people here have done it 22:35
admin1with others you mentioned, its like the juju demostration  .. run it, it works and then done .. if something breaks of if you want something out of the non-defaults to suit your needs, you get stuck as there is no knowledge on it 22:36
admin1also upgrades  :) 22:37
admin1the way i present OSA now a days to others is OSA is a framework to build openstack the way you need .. while others, I consider them just tools . they work in specific way and not as flexible as osa22:40
moha7> "f you want something out of the non-defaults to suit your needs, you get stuck, total silence", 22:43
moha7Ah, good point. I had not thought about it22:43

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!