Tuesday, 2020-02-25

*** gfidente has quit IRC00:14
*** icarusfactor has joined #openstack-kolla00:24
*** factor has quit IRC00:27
*** sean-k-mooney has quit IRC00:35
*** sean-k-mooney has joined #openstack-kolla00:37
*** stingrayza has joined #openstack-kolla00:39
*** sean-k-mooney has quit IRC01:59
*** sean-k-mooney has joined #openstack-kolla02:01
*** iniazi_ has joined #openstack-kolla03:49
*** timburke has quit IRC03:50
*** bersace4 has joined #openstack-kolla03:50
*** Reepicheep_ has joined #openstack-kolla03:51
*** Reepicheep has quit IRC03:52
*** iniazi has quit IRC03:52
*** bersace has quit IRC03:52
*** bersace4 is now known as bersace03:52
*** timburke has joined #openstack-kolla03:53
*** skramaja has joined #openstack-kolla04:06
*** dking_desktop has quit IRC04:20
*** evrardjp has quit IRC05:34
*** evrardjp has joined #openstack-kolla05:35
*** kozhukalov has quit IRC05:38
*** kozhukalov has joined #openstack-kolla05:39
*** numans has quit IRC06:15
*** strigazi has quit IRC06:16
*** strigazi has joined #openstack-kolla06:18
*** kozhukalov has quit IRC06:18
*** Tony31 has joined #openstack-kolla06:22
openstackgerritzhangmeng proposed openstack/kolla-ansible master: Add support for encrypting cinder api.  https://review.opendev.org/70966306:26
Tony31good morning all06:29
Tony31To install openstack stein with kayobe, I take it that I need kayobe config stein. But looks like stein is not available https://tarballs.opendev.org/openstack/ironic-python-agent/dib/files/06:31
Tony31https://pastebin.com/9QqiaErr06:32
Tony31while running service deploy, it tries to fetch the stein image from the url I posted but the stein image is not present06:32
Tony3140406:32
Tony31may also affect kolla06:43
*** numans has joined #openstack-kolla07:11
mnasiadkaTony31: ironic moved to centos7 based ipa in train - before that they used coreos - are you sure you are using stein version of kayobe?07:16
Tony31Hello :) stein version of kayobe? I'm just doing `pip install` as per the docs, but I am getting `kayobe-config` using `git pull -b stable/stein` - Am I on the right track? Because I am unsure now I read your message....07:17
yoctozeptoTony31: you are on the wrong track then07:18
yoctozeptokayobe was already release for Train07:19
yoctozeptoreleased*07:19
yoctozeptoso pypi version is for train07:19
Tony31ah okay - so I'd need matching `kayobe` - thank you07:19
yoctozeptoyw07:19
yoctozeptoI find pypi more confusing than just using it all from git07:19
yoctozeptowe care for stability of the stable branches07:20
Tony31ok yoctozepto - taking notes.07:20
yoctozeptomgoddard, mnasiadka: wonder if we don't want to just point our users at best practice of using git for everything ^07:20
mnasiadkayoctozepto: well, then why do releases at all?07:21
yoctozeptothat said, I can't see dib tarballs for train either07:21
yoctozeptomnasiadka: so that tripleo can package kolla ;-)07:21
yoctozeptoI mean, this is devops world07:21
mnasiadkayoctozepto: it's not tripleo that is packaging :)07:21
yoctozeptowe live in commits07:21
yoctozeptonot releases07:21
yoctozeptomnasiadka: rdo*, sorry07:22
mnasiadkayoctozepto: you're a dev, you live in a different world than most users :)07:22
yoctozeptomnasiadka: could be07:22
yoctozeptobut I'm also an operator07:22
yoctozeptoanyways, docs need some facelift, Chason was recently on it07:23
yoctozeptobut we got stuck again07:23
yoctozeptoas we always od07:23
yoctozeptodo*07:23
yoctozeptoas for dib, I see c7 is ready for train and only c8 is master-only, that makes sense07:23
mnasiadkayoctozepto: docs as always need some updates, but might be we need some plan sometime to focus on k-a docs07:25
openstackgerritMichal Nasiadka proposed openstack/kayobe-config master: Add pip_proxy variable to pip.yml  https://review.opendev.org/70966507:26
Tony31so if I want to go down to `Stein`, can I copy my entire `kayobe-config/etc/kayobe` directory and overwrite the same for Stein ? or should I be manually pulling stuff out and manually inserting into the playbooks that exist in `kayobe-config/etc/kayobe`07:27
openstackgerritMichal Nasiadka proposed openstack/kayobe master: WIP: Allow setting pip_proxy  https://review.opendev.org/70958007:27
mnasiadkaTony31: you need to install kayobe 6.1.007:29
Tony31mnasiadka ok, but what about the ansible playbooks versioning? Can I keep the ones I have been using for Train deployment or do I need to reconfigure the ones which are pulled from kayobe-config git?07:32
mnasiadkakayobe-config doesn't have any playbooks07:33
mnasiadkait's only an inventory and configuration variables07:33
mnasiadkaand yes, you should use the Stein ones - because some vars could be removed or have changed default values from release to release07:33
mnasiadkaTony31: is there a specific reason you want to use Stein?07:33
Tony31great thank you for the information07:34
Tony31Sorry about mis-use of terminology.07:34
Tony31And thanks for the help to understand more07:34
Tony31I have found a bug with Train and I am not sure yet if it's a blocker, so looking for ways forward.07:34
yoctozeptoTony31: would be nice to know the bug :D07:36
Tony31cinder volume type metadata is ignored on glance image during instance create. The default volume type is always selected.07:37
yoctozeptoTony31: is this bug registered?07:38
Tony31After I emailed in to the group yesterday I had a thought to test the same with RDO packstack stein version and the exact same steps there get a different result07:38
Tony31@yoc07:38
yoctozepto@Ton07:38
Tony31yoctozepto - sorry to ask this but how do I do that? At this point I am not sure if the bug is realised (maybe it's lodged already?)07:39
yoctozeptoTony31: look in launchpad/storyboard07:39
yoctozeptoI think all related projects are in launchpad07:39
Tony31yoctozepto I pressed enter to accept the auto-complete of your name and it just sent that message :)07:39
yoctozeptothat is cinder/glance07:39
Tony31ok - will take a look :)07:40
yoctozeptoTony31: yeah, thought so; in a playful mood today07:40
Tony31good :)07:40
yoctozeptocopycat skills grow07:40
yoctozeptomnasiadka: so up to two minutes are required to get ubu/deb instance to run ssh07:42
yoctozeptobut it never gets keypair07:42
yoctozeptoand the delay is due to timeout of cloud-init run07:42
mnasiadkayoctozepto: how come it never gets keypair? neutron-metadata-agent is b0rken?07:42
yoctozeptomnasiadka: mhm07:42
yoctozeptomnasiadka: did not read my comments, did you?07:43
mnasiadkaso unb0rk it :)07:43
mnasiadkanot yet in full detail07:43
mnasiadkatrying to wake up07:43
yoctozeptoubu/deb source problem in:07:43
yoctozepto{"Payload":"Feb 24 14:50:33 haproxy[29]: 192.0.2.10:35240 [24/Feb/2020:14:50:33.182] nova_metadata/1: SSL handshake failure","log_level":"info","Hostname":"primary","programname":"haproxy"}07:43
yoctozeptopresumably neutron-metadata-agent tries ssl to nova-metadata (nova-api)... but why?07:43
yoctozeptothat is nice summary ^07:43
yoctozeptowhy neutron-metadata-agent tries ssl on plain http07:43
yoctozeptois beyond me07:44
yoctozepto:D07:44
*** sm806 has quit IRC07:44
yoctozeptoah07:45
yoctozepto      tls_enabled: true07:45
yoctozeptoin ubu/deb07:45
*** sorin-mihai has joined #openstack-kolla07:45
yoctozeptoso it's tls b0rken07:45
*** sm806 has joined #openstack-kolla07:45
yoctozeptow8, w8, we ain't running cert generation, yet enable ssl?07:46
yoctozeptoda hack are we trying to accomplish there07:46
yoctozeptoah, it's upgrade that would be b0rken by that07:47
yoctozeptoI forgot that tls07:47
yoctozeptoso metadata is simply misconfigured07:47
*** cah_link1 has joined #openstack-kolla07:48
*** cah_link has quit IRC07:49
*** cah_link1 is now known as cah_link07:49
yoctozeptohttps://bugs.launchpad.net/kolla-ansible/+bug/186461507:55
openstackLaunchpad bug 1864615 in kolla-ansible ussuri "TLS misconfigured for neutron metadata agent" [High,Triaged] - Assigned to Radosław Piliszek (yoctozepto)07:55
*** sorin-mihai has quit IRC07:58
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Allow setting pip_proxy  https://review.opendev.org/70958007:59
mnasiadkayoctozepto: see? you don't need me :)07:59
yoctozeptomnasiadka: yeah, you are sacked now; collect your things and go08:00
*** tonythomas has joined #openstack-kolla08:00
yoctozeptomnasiadka: kidding obviously, I highly value your input ;-)08:01
mnasiadkayoctozepto: don't worry, my first language is sarcasm - I don't feel easily offended :)08:02
yoctozeptomnasiadka: I want to be clear in the channel in case someone runs AI on contents :D08:02
yoctozeptomnasiadka: tbh, I had some bad experience with sarcasm so I am now much more careful in general08:03
yoctozeptoeveryone can have a worse day08:03
mnasiadkatrue :)08:03
*** bengates has joined #openstack-kolla08:10
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Cinder - remove glance_api_version and disable Cinder v2 API  https://review.opendev.org/70942208:10
*** JangwonLee has joined #openstack-kolla08:16
*** Tengu has quit IRC08:30
*** Tengu has joined #openstack-kolla08:32
*** cah_link1 has joined #openstack-kolla08:35
*** cah_link has quit IRC08:36
*** cah_link1 is now known as cah_link08:36
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: CI: Test floating ip allocation and connectivity to the instance  https://review.opendev.org/70936908:41
*** dougsz has quit IRC08:52
*** gfidente has joined #openstack-kolla08:52
*** oyrogerg has quit IRC08:53
yoctozeptomnasiadka: https://review.opendev.org/701414 so it never went through my hands, good, cannot be blamed :D08:55
patchbotpatch 701414 - kolla-ansible - CI: Add TLS tests (MERGED) - 12 patch sets08:55
*** abdysn has joined #openstack-kolla08:56
mnasiadkayoctozepto: mine too ;)08:56
yoctozeptomnasiadka: hence we could not be aware08:56
mnasiadkayoctozepto: but if we would have some simple vm connectivity tests back then - it would fail :)08:57
yoctozeptomnasiadka: indeed08:57
yoctozeptomnasiadka: working on a fix, worry not08:57
*** priteau has joined #openstack-kolla09:00
yoctozeptomnasiadka: I'd love some hint as to how to approach linuxbridge failure due to docker setting drop on the forward chain09:05
yoctozeptomnasiadka: it is the remaining blocker that I did not come up with a solution for yet09:06
mnasiadkayoctozepto: well, I think we have no other solution than: https://docs.docker.com/network/bridge/#enable-forwarding-from-docker-containers-to-the-outside-world09:06
yoctozeptomnasiadka: yeah, but we lack persistent iptables support09:07
yoctozeptomnasiadka: unless you are telling me to dirtypatch this for CI :P09:07
*** zhanglong has joined #openstack-kolla09:08
mnasiadkayoctozepto: well, just fix it in CI and write some docs warning around linuxbridge in neutron reference docs?09:08
yoctozeptomnasiadka: makes sense for now, especially since something sets ACCEPT in my deploy for me09:08
yoctozeptomnasiadka: so it could be an issue only for aio anyway09:09
yoctozeptoweird09:09
mnasiadkawe can add later some functionality to baremetal role - to set iptables: no in daemon.json09:09
openstackgerritMerged openstack/kolla-ansible master: Allow to override external network params in init-runonce  https://review.opendev.org/70936109:14
*** dougsz has joined #openstack-kolla09:15
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/train: Allow to override external network params in init-runonce  https://review.opendev.org/70967109:16
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/train: Allow to override external network params in init-runonce  https://review.opendev.org/70967109:17
Tony31Could I ask for some help on this one? I am really struggling here. It's not kolla or kayobe :( . Basically I have 2 hosts. Each host has its own cinder backend. I want to be able to link the backends to the host that the metal is physically tied to. How is this achieved within a region?09:19
*** k_mouza has joined #openstack-kolla09:20
*** jopdorp has joined #openstack-kolla09:20
Tony31I think the bug which I had raised for Train volume type issue is impacting this also but I'm new to it so I just dont know at this point. I'll try and spin up more packstacks to figure it out09:24
*** Tony31 has left #openstack-kolla09:24
openstackgerritRadosław Piliszek proposed openstack/kayobe master: Remove ceph block device support  https://review.opendev.org/70937609:26
yoctozeptomnasiadka: getting there: 2020-02-25 09:18:46.117 725 ERROR neutron.agent.metadata.agent OpenSSL.SSL.Error: [('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')]09:27
mnasiadkaCA missing?09:28
yoctozeptoone fix at a time xD09:28
yoctozeptomnasiadka: yeah, it's neutron lacking docs, let me dive in code09:28
yoctozeptoat least it know to use https eh09:29
jopdorpgood morning all! :)09:32
*** JangwonLee has quit IRC09:33
*** JangwonLee has joined #openstack-kolla09:33
jopdorpI'm happy to report that the code changes in https://bugs.launchpad.net/kolla-ansible/+bug/1861679 helped me change my cloudkitty.conf in such a way that the rating service works now09:34
openstackLaunchpad bug 1861679 in kolla-ansible "kolla/ubuntu-source-cloudkitty-processor:train won't start" [Undecided,In progress] - Assigned to Christopher Wellie (well100)09:34
*** ktibi has joined #openstack-kolla09:37
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: CI: Test floating ip allocation and connectivity to the instance  https://review.opendev.org/70936909:43
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: CI: Test floating ip allocation and connectivity to the instance  https://review.opendev.org/70936909:44
openstackgerritMerged openstack/kolla master: Deprecate MongoDB  https://review.opendev.org/70850909:44
yoctozeptojopdorp: great, it's really helpful to get such feedback,  I added that to review09:49
*** JangwonLee has quit IRC09:51
*** JangwonLee has joined #openstack-kolla09:52
jopdorpgreat!09:54
openstackgerritMark Goddard proposed openstack/kolla stable/train: DNM: CentOS 8: testing fixups  https://review.opendev.org/70968210:01
yoctozeptomgoddard, mnasiadka: fwiw, when we did not try testing connectivity, the instance did not have enough time to get to dhcp and cloud-init calling for metadata, before we shut it down ;D10:18
mgoddardyoctozepto: yeah, not surprised10:19
mgoddarddoesn't matter as we didn't check it10:19
yoctozeptoyeah, we only wait for ACTIVE in that job10:19
yoctozeptosince no cinder is enabled10:19
yoctozeptoand then we shut it off10:19
openstackgerritMark Goddard proposed openstack/kolla-ansible master: CI: Use upper constraints when installing clients  https://review.opendev.org/70968610:23
cosmicsoundgood day10:24
cosmicsoundi see some tls ssl issues10:24
cosmicsoundis this connected to last bug also reported?10:24
mgoddardweird error on centos8 train deploy jobs https://zuul.opendev.org/t/openstack/build/ad9665089fb54ef99a2cad7d5ca79c3610:26
mgoddardfail after 20 seconds10:26
* mgoddard speaks to infra10:26
yoctozeptomgoddard: yeah, it looks zuul-low-level10:27
yoctozeptocosmicsound: which issues? which bug?10:27
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Add framework to deploy user-defined containers on seed  https://review.opendev.org/70968910:31
*** Tony31 has joined #openstack-kolla10:42
mnasiadkayoctozepto, mgoddard: So I guess we'll have more problems like cinder v2 disablement - we need to remove cinder v2 endpoints on upgrade, I see two options - 1) cinder-specific upgrade task 2) reworking service-ks-register to compare in-catalog to should-be entries and remove when required10:42
mnasiadkawhat's your opinion?10:42
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Add framework to deploy user-defined containers on seed  https://review.opendev.org/70968910:42
yoctozeptomnasiadka: 2 but for service in question I guess10:43
mnasiadkayeah10:43
yoctozeptoit's really fragile as one might have already disabled that stuff10:43
yoctozeptoor added something else to that catalog (however unlikely)10:43
mnasiadkawell, if he wants to add something else - he can set it in service-specific vars to get something additional10:44
mnasiadkaso we don't remove it on upgrade/redeploy/reconfigure/whatever10:44
openstackgerritMark Goddard proposed openstack/kolla stable/train: DNM: CentOS 8: testing fixups  https://review.opendev.org/70968210:44
mgoddardit's not unlikely to be adding things to catalogue - think multi-regions10:46
mgoddardbut you can put arbitrary things in there10:46
mgoddardI'd probably suggest adding a 'state' field to service-ks-register, and use it for specific endpoints on upgrade10:47
mnasiadkaOk, will investigate - for now I'll W-1 on the cinder v2 disabling change10:49
*** priteau has quit IRC10:52
mnasiadkamgoddard: multi-region case destroys the idea of just removing anything else that is not defined in config :) Seems state: or operation: variable is needed to know if something needs to be removed or added, and proper handling of disabling cinder v2 in upgrade.yml10:53
cosmicsoundyoctozepto , when I use interal VIP and external VIP there is no way for me to access the horizon either via internal nor via external10:56
cosmicsoundyet it passes all prechecks10:56
*** Tony31 has quit IRC10:56
*** tony31 has joined #openstack-kolla10:57
cosmicsoundhttps://bugs.launchpad.net/kolla-ansible/+bug/1863811 this one10:57
openstackLaunchpad bug 1863811 in kolla-ansible "[TLS/SSL] unable to add custom SSL" [Undecided,New]10:57
cosmicsoundThis is same even if I add the TLS or not, when using them both is not working10:57
cosmicsoundNow I made a completely new deployment from scratch and is same issue10:58
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: CentOS 8: Add deploy jobs in CI  https://review.opendev.org/70953611:01
openstackgerritMark Goddard proposed openstack/kolla-ansible master: CI: Use upper constraints when installing clients  https://review.opendev.org/70968611:14
mgoddardyoctozepto: good thinking ^11:15
hrwanyone for kibana? https://review.opendev.org/#/c/70778711:16
patchbotpatch 707787 - kolla - kibana: enable for non-x86 on Debian/Ubuntu - 1 patch set11:16
openstackgerritMark Goddard proposed openstack/kolla-ansible master: CI: Use upper constraints when installing clients  https://review.opendev.org/70968611:21
*** zhanglong has quit IRC11:26
*** zhanglong has joined #openstack-kolla11:26
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: CentOS 8: Add deploy jobs in CI  https://review.opendev.org/70953611:28
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Add python3-dev[el] to bindep.txt  https://review.opendev.org/70969411:28
*** ivve has joined #openstack-kolla11:30
*** Luzi has joined #openstack-kolla11:36
*** zhanglong has quit IRC11:37
*** zhanglong has joined #openstack-kolla11:39
*** rgogunskiy has joined #openstack-kolla11:41
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Allow setting pip_proxy  https://review.opendev.org/70958011:45
*** zhanglong has quit IRC11:46
*** zhanglong has joined #openstack-kolla11:48
yoctozeptomgoddard: thanks11:50
yoctozeptocosmicsound: nah, we were thinking different issue11:50
cosmicsoundright :D11:52
cosmicsoundany idea why magnum API would not appear in horizon dashboard?11:52
cosmicsoundIs this normal behaviour?11:52
*** zhanglong has quit IRC11:53
hrwcosmicsound: no magnum-dashboard plugin maybe?11:53
yoctozeptocosmicsound: https://bugs.launchpad.net/kolla-ansible/+bug/1863811 replied11:54
openstackLaunchpad bug 1863811 in kolla-ansible "[TLS/SSL] unable to add custom SSL" [Undecided,Incomplete]11:54
tony31cosmicsound the magnum dashboard didnt appear for me because I deployed with a TLS cert issue. Once I Resolved the issue, the dashboard is working fine. But I did notice my deployment magnum was using the external API for the internal request and because my TLS was working, but requires to trust the private CA cert; I was seeing cert validation11:54
tony31fail and magnum was not working. So I removed tls for now.11:54
*** zhanglong has joined #openstack-kolla11:54
cosmicsoundI am not on TLS enabled yet11:56
cosmicsoundAnd it was not working since i was on local ip only without hostname nor tls11:56
cosmicsoundThis is fresh deployment11:57
cosmicsoundand no TLS at all11:57
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Allow setting pip_proxy  https://review.opendev.org/70958011:57
tony31😬11:57
cosmicsoundyet still...11:57
cosmicsoundat first magnnum could not reach heat11:57
cosmicsoundnot gave me ERROR: HEAT-E99001 Service nova is not available for resource type11:57
cosmicsoundso its worse and worse11:57
cosmicsoundyes i can make instances11:57
cosmicsoundmanually11:58
cosmicsoundi wonder if octavia is a requirement for magnum11:58
cosmicsoundyet i was not using lb11:58
tony31I feel your pain. But usually it's a config issue on my side 🙈11:59
openstackgerrityatin proposed openstack/kolla master: Build collectd image for CentOS8  https://review.opendev.org/70970111:59
tony31I dont have octavia enabled and magnum is working12:00
yoctozeptomgoddard, mnasiadka: https://review.opendev.org/709369 yay, connectivity testing passing all over the board; now need to clean up and split out fixes12:00
patchbotpatch 709369 - kolla-ansible - CI: Test floating ip allocation and connectivity t... - 8 patch sets12:00
mgoddardwoop12:01
yoctozeptoyeah, champagne showers12:04
yoctozeptomnasiadka: https://59ce1cdd1cb70e8b8524-54a30f9e4df167ae2747c6c3ff2739ca.ssl.cf5.rackcdn.com/709369/8/check/kolla-ansible-centos8-source-ceph-ansible/81c2417/primary/logs/kolla/mariadb/mariadb.txt12:05
mnasiadkayeah, fernet12:05
*** abdysn has quit IRC12:05
mnasiadkain my queue12:05
yoctozeptoso it did not heat PT3S but still was sad about something after PT1.5S12:05
mnasiadkayoctozepto: ah, it was mariadb?12:05
yoctozeptoxD12:05
mnasiadkamariadb, the root of all evil ;)12:05
yoctozeptoyeah, connectivity broke12:05
yoctozeptowhy did you ask about fernet?12:05
mnasiadkaI just saw keystone12:06
yoctozeptodid you notice something else?12:06
yoctozeptoah12:06
mnasiadkaand defaulted to fernet :D12:06
yoctozeptoxD12:06
*** dave-mccowan has quit IRC12:06
yoctozeptoso assuming these issues are temp we could try raising all the timeouts but meh12:07
yoctozeptosome jobs just fail from time to time because of networking quality12:07
mnasiadkawell, those jobs live in a hostile environment :)12:08
yoctozeptomnasiadka: how hostile?12:09
mnasiadkayoctozepto: OVH, very hostile12:10
yoctozeptomnasiadka: ah12:10
yoctozeptomnasiadka: I had a delayed laugh when I finally deciphered ovh as "openly very hostile" ;D12:21
mnasiadkalol12:21
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Add framework to deploy user-defined containers on seed  https://review.opendev.org/70968912:22
*** kplant has joined #openstack-kolla12:25
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Python 3: Use distro_python_version for monasca agent CA file  https://review.opendev.org/70971112:29
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Remove unused python path calculation from vmtp  https://review.opendev.org/70971212:30
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Python 3: Use distro_python_version for WSGI python_path  https://review.opendev.org/70971312:32
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Use local python interpreter for keystone cron generator  https://review.opendev.org/70971412:33
*** jbadiapa has joined #openstack-kolla12:40
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Support python 3 in kolla-ansible script  https://review.opendev.org/70971612:44
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: CI: Move ansible installation & configuration to Ansible  https://review.opendev.org/70971712:44
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: CI: Use python 3 for local kolla-ansible execution  https://review.opendev.org/70971812:44
*** kplant has quit IRC12:51
*** kplant has joined #openstack-kolla12:54
openstackgerritRafael Weingärtner proposed openstack/kolla-ansible master: Add feature to support managing dynamic pollsters  https://review.opendev.org/67999912:55
openstackgerritMerged openstack/kolla master: Remove start-ovsdb-server script from openvswitch-db-server  https://review.opendev.org/70871113:10
openstackgerritMerged openstack/kolla-ansible master: Add missing release note for Glance multi store move.  https://review.opendev.org/70958613:10
*** kplant has quit IRC13:21
*** cah_link has quit IRC13:28
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Fix fernet bootstrap and key distribution - follow up  https://review.opendev.org/70708013:28
cosmicsoundtony31 , check this  https://mdb.uhlhost.net/uploads/7585d5c109d82dbb/image.png13:34
cosmicsoundvery nice when all passes, and in the end is not there13:34
yoctozeptogreen ok13:34
yoctozeptoall fine13:34
yoctozeptomust be in catalog13:34
*** cah_link has joined #openstack-kolla13:35
openstackgerritMark Goddard proposed openstack/kolla stable/train: DNM: CentOS 8: testing fixups  https://review.opendev.org/70968213:40
*** kozhukalov has joined #openstack-kolla13:50
*** priteau has joined #openstack-kolla14:00
*** sean-k-mooney has quit IRC14:02
openstackgerritMark Goddard proposed openstack/kayobe master: CI: Test SSH connectivity to deployed instances  https://review.opendev.org/70760414:12
openstackgerrityatin proposed openstack/kolla master: Build collectd image for CentOS8  https://review.opendev.org/70970114:18
openstackgerritMark Goddard proposed openstack/kolla-ansible master: DNM: Test swift s3api  https://review.opendev.org/70973014:23
*** jopdorp has quit IRC14:23
*** priteau has quit IRC14:27
*** ktibi has quit IRC14:36
*** ktibi has joined #openstack-kolla14:37
openstackgerritRafael Weingärtner proposed openstack/kolla-ansible master: Add feature to support managing dynamic pollsters  https://review.opendev.org/67999914:41
*** TrevorV has joined #openstack-kolla14:41
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Allow setting pip_proxy  https://review.opendev.org/70958014:43
*** lile has joined #openstack-kolla14:47
*** dave-mccowan has joined #openstack-kolla14:52
*** zhanglong has quit IRC15:01
*** Luzi has quit IRC15:04
openstackgerritMerged openstack/kolla-ansible master: CI: Use upper constraints when installing clients  https://review.opendev.org/70968615:07
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: CI: Use upper constraints when installing clients  https://review.opendev.org/70975115:09
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Add framework to deploy user-defined containers on seed  https://review.opendev.org/70968915:10
*** kplant has joined #openstack-kolla15:11
openstackgerritMark Goddard proposed openstack/kayobe master: DNM: Test bridgeless networking  https://review.opendev.org/70975215:11
mnasiadkamgoddard: sounds like a good marketing name, bridgeless networking15:12
mgoddardpacketless15:12
kplantudp!15:14
hrwuou!15:18
hrwudp over udp15:18
kplantand mpls over that15:19
*** skramaja has quit IRC15:21
*** ktibi has quit IRC15:25
*** jonaspaulo has quit IRC15:25
*** ktibi has joined #openstack-kolla15:25
*** cah_link has quit IRC15:26
*** cah_link has joined #openstack-kolla15:26
*** jonaspaulo has joined #openstack-kolla15:26
*** rgogunskiy has quit IRC15:27
*** jcmdln has quit IRC15:27
*** irclogbot_1 has quit IRC15:27
*** irclogbot_0 has joined #openstack-kolla15:28
*** pescobar has joined #openstack-kolla15:29
openstackgerritMark Goddard proposed openstack/kolla stable/train: Switch to python3 in bindep.txt  https://review.opendev.org/70975715:37
openstackgerritChristian Berendt proposed openstack/kolla master: Add a generic header  https://review.opendev.org/70875815:54
openstackgerritMerged openstack/kolla-ansible master: Swift: remove meta field from rsync command  https://review.opendev.org/70630315:55
cosmicsoundanyone using netplan to setup networking with kolla?15:55
cosmicsoundor everyone uninstalls it and relly in ifconfig15:56
*** Trevor_V has joined #openstack-kolla16:03
openstackgerritChristian Berendt proposed openstack/kolla master: Add block labels to all Dockerfiles  https://review.opendev.org/70875816:04
ktibiHey, anyone use mitogen for kolla ? https://mitogen.networkgenomics.com/ansible_detailed.html16:04
*** TrevorV has quit IRC16:07
osmanlicilegicosmicsound: I use netplan. ktibi: I use mitogen.16:21
osmanlicilegibtw, wish you all a happy day/evening.16:21
ktibiosmanlicilegi, do you see better performance for deploiement ?16:21
cosmicsoundosmanlicilegi , same there, maybe next time will share some of your netplan bits16:23
osmanlicilegiktibi: mitogen makes kolla faster, I love it. I'm using it with ansible 2.8 for few months without problems.16:26
osmanlicilegicosmicsound: are you on ubuntu world?16:27
openstackgerritDoug Szumski proposed openstack/kolla master: Install Fluentd Prometheus plugin out of the box  https://review.opendev.org/70604216:29
*** bengates has quit IRC16:30
*** bengates has joined #openstack-kolla16:31
openstackgerritJason Anderson proposed openstack/kolla-ansible master: [elasticsearch] Update config for 6.x  https://review.opendev.org/70962416:33
openstackgerritJason Anderson proposed openstack/kolla-ansible master: [elasticsearch] Add migration for Kibana 6.x index  https://review.opendev.org/70962516:33
*** bengates has quit IRC16:35
cosmicsoundosmanlicilegi , yes so it seems with 18.04 here16:38
cosmicsoundalto i am heavilty thinking of addopting centos 8 when its on fully with k-a16:38
cosmicsoundmaybe this mitogen would be a nice adition to overall kolla, since this fits were we all want faster deployments.16:39
osmanlicilegicosmicsound: you might think using maas on ubuntu world, makes life easier. or let kayobe take over all :)16:40
openstackgerritJason Anderson proposed openstack/kolla-ansible master: [elasticsearch] Update config for 6.x  https://review.opendev.org/70962416:42
openstackgerritJason Anderson proposed openstack/kolla-ansible master: [elasticsearch] Add migration for Kibana 6.x index  https://review.opendev.org/70962516:43
cosmicsoundhmm16:46
cosmicsoundwonder what kayobe can do better than kolla does :D16:48
openstackgerritMark Goddard proposed openstack/kayobe master: CentOS 8: Use ansible_playbook_python for localhost dependencies  https://review.opendev.org/70892116:51
openstackgerritMark Goddard proposed openstack/kayobe master: Make Kayobe code compatible with Python 3  https://review.opendev.org/63558616:51
openstackgerritMark Goddard proposed openstack/kayobe master: Bump Ansible version range to 2.8 - 2.9  https://review.opendev.org/70892216:51
openstackgerritMark Goddard proposed openstack/kayobe master: WIP: CentOS 8  https://review.opendev.org/70769016:51
openstackgerritMark Goddard proposed openstack/kayobe master: CentOS 8: Disable ntpd, enable chrony container  https://review.opendev.org/70978516:51
openstackgerritMark Goddard proposed openstack/kayobe master: CentOS 8: Bump MichaelRigart.interfaces to 1.4.0  https://review.opendev.org/70978616:51
openstackgerritMark Goddard proposed openstack/kayobe master: CentOS 8: Add overcloud CI job  https://review.opendev.org/70978716:51
*** k_mouza has quit IRC17:01
openstackgerritMark Goddard proposed openstack/kolla stable/train: CentOS 8: base and openstack-base images  https://review.opendev.org/70953717:13
openstackgerritMark Goddard proposed openstack/kolla stable/train: CentOS 8: base image fixes for RabbitMQ, fluentd & InfluxDB  https://review.opendev.org/70920117:13
openstackgerritMark Goddard proposed openstack/kolla stable/train: CentOS 8: disable repo_gpgcheck for grafana image  https://review.opendev.org/70920617:13
openstackgerritMark Goddard proposed openstack/kolla stable/train: CentOS 8: Update packages in images  https://review.opendev.org/70920217:13
openstackgerritMark Goddard proposed openstack/kolla stable/train: CentOS 8: Remove shellinabox from ironic-conductor  https://review.opendev.org/70920317:13
openstackgerritMark Goddard proposed openstack/kolla stable/train: CentOS 8: Use upstream Ceph/master  https://review.opendev.org/70920417:13
openstackgerritMark Goddard proposed openstack/kolla stable/train: CentOS 8: Allow SSH access to keystone_ssh and nova_ssh  https://review.opendev.org/70920517:13
openstackgerritMark Goddard proposed openstack/kolla stable/train: CentOS 8: Relax ironic iPXE EFI bootloader location  https://review.opendev.org/70920717:13
openstackgerritMark Goddard proposed openstack/kolla stable/train: Switch to python3 in bindep.txt  https://review.opendev.org/70975717:13
openstackgerritMark Goddard proposed openstack/kolla stable/train: CentOS 8: Add deploy jobs in CI  https://review.opendev.org/70953817:13
ktibicentos 8 is coming !17:13
mgoddardyoctozepto, mnasiadka, hrw, osmanlicilegi: lots of centos 8 patches on stable/train now17:14
mgoddardI have added RP+1 to some17:15
mgoddardif you need any help in working out the best order let me know17:15
mgoddardbut let's try to get these merged soon17:15
hrwok17:16
hrwmgoddard: will look tomorrow - zuul will take care during night17:17
mgoddardIt would be good to get these three going: https://review.opendev.org/#/c/709718/ https://review.opendev.org/#/c/709717/ https://review.opendev.org/#/c/709716/17:19
patchbotpatch 709718 - kolla-ansible (stable/train) - CI: Use python 3 for local kolla-ansible execution - 1 patch set17:19
patchbotpatch 709717 - kolla-ansible (stable/train) - CI: Move ansible installation & configuration to A... - 1 patch set17:19
patchbotpatch 709716 - kolla-ansible (stable/train) - Support python 3 in kolla-ansible script - 1 patch set17:19
mgoddardand https://review.opendev.org/#/c/709714/17:20
patchbotpatch 709714 - kolla-ansible (stable/train) - Use local python interpreter for keystone cron gen... - 1 patch set17:20
noxoidktibi, thanks for reminding me about mitogen. a reconfigure --tags nova job was reduced by 2.5 minutes with it17:20
mgoddardnoxoid: what was the total runtime?17:21
noxoid7 minutes dead without mitogen, 4m24 with17:22
noxoid3 controllers, 4 compute17:22
ktibinoxoid, yes so good for CI !17:23
noxoid373.54user 25.03system 4:24.21elapsed 150%CPU (0avgtext+0avgdata 138324maxresident)k 0inputs+5576outputs (0major+4599242minor)pagefaults 0swaps17:24
noxoidmitogen adds that nice perf info17:25
noxoidwell, uses the system time instead of bash "time"17:25
ktibimgoddard, I try to add a CA file for private registry. But kayobe search in venvs dir and role dir. Where I need to add the CA in kayobe structure ?17:26
mgoddardnoxoid: that's a good improvement17:26
ktibiI use docker_registry_ca for that.17:26
mgoddardktibi: full path?17:27
ktibior maybe I need to use the absolute path :)17:27
mgoddardor reference {{ kayobe_config_path }} if you want to keep it in config17:27
ktibiok thx ;)17:27
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Allow setting pip_proxy  https://review.opendev.org/70958017:28
*** diurnalist has joined #openstack-kolla17:37
*** evrardjp has quit IRC17:39
*** evrardjp has joined #openstack-kolla17:39
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Add framework to deploy user-defined containers on seed  https://review.opendev.org/70968917:40
openstackgerritMark Goddard proposed openstack/kayobe master: DNM: Test bridgeless networking  https://review.opendev.org/70975217:41
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: CI: Use python 3 for local kolla-ansible execution  https://review.opendev.org/70971817:43
*** ktibi has quit IRC17:46
*** ivve has quit IRC17:47
openstackgerritMerged openstack/kayobe master: Switch from shade to openstacksdk  https://review.opendev.org/70768918:01
*** dougsz has quit IRC18:07
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: CI: Fix TLS upgrade test  https://review.opendev.org/70980818:09
*** igordc has joined #openstack-kolla18:10
openstackgerritMerged openstack/kayobe master: Remove activate-virtualenv and deactivate-virtualenv roles  https://review.opendev.org/70807218:11
*** tonythomas has quit IRC18:15
*** spiette has quit IRC18:17
cosmicsound /help18:18
*** spiette has joined #openstack-kolla18:22
yoctozepto<delayed help>18:31
yoctozeptomgoddard: serverless, bridgeless, what's coming next?18:38
kplantbrainless18:44
*** sean-k-mooney has joined #openstack-kolla18:47
yoctozeptokplant: +1, we already have this in schools18:50
kplantsame here in the US18:50
yoctozeptofolks, I restarted the CI errors whiteboard https://etherpad.openstack.org/p/kolla-ci-errors18:50
yoctozeptomgoddard, mnasiadka, hrw, osmanlicilegi: ^^18:50
yoctozeptowe mostly got rid of many of those by fixing mariadb and some are pending with keystone fernet18:51
yoctozeptowhich is alredy much better anyway18:51
yoctozeptoI saw that timeout a few times18:54
yoctozeptoso it's repeatable18:54
*** diurnalist has quit IRC19:05
osmanlicilegiyoctozepto: good job, as usual19:06
yoctozeptoosmanlicilegi: thanks19:10
*** igordc has quit IRC19:17
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: DNM: Test swift s3api  https://review.opendev.org/70973019:22
*** diurnalist has joined #openstack-kolla19:32
*** diurnalist has quit IRC19:37
*** diurnalist has joined #openstack-kolla19:43
*** igordc has joined #openstack-kolla19:49
*** kozhukalov has quit IRC19:51
openstackgerritMerged openstack/kolla-ansible master: Bifrost: Stop stopping RabbitMQ  https://review.opendev.org/70918920:02
openstackgerritMerged openstack/kolla master: Drop weird swift rootwrap config (xenapi with placeholder values)  https://review.opendev.org/70873320:13
*** well100 has joined #openstack-kolla20:24
well100Hellp20:24
well100hello20:25
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Fix client TLS in neutron-metadata-agent  https://review.opendev.org/70982920:33
*** tony31 has quit IRC20:34
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Fix neutron-metadata-agent to use provided CA for Nova metadata  https://review.opendev.org/70983020:36
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: CI: Test floating ip allocation and connectivity to the instance  https://review.opendev.org/70936920:38
openstackgerritMerged openstack/kolla-ansible master: Construct service configuration urls using kolla_internal_fqdn  https://review.opendev.org/70662720:44
*** sean-k-mooney has quit IRC20:46
*** kplant has quit IRC20:48
*** Trevor_V has quit IRC21:00
*** factor__ has joined #openstack-kolla21:01
*** icarusfactor has quit IRC21:04
*** igordc has quit IRC21:08
*** igordc has joined #openstack-kolla21:16
cosmicsoundhi well10021:18
*** igordc has quit IRC21:18
*** igordc has joined #openstack-kolla21:18
well100hi cosmicsound21:18
well100all good21:18
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Construct service REST API urls using configured protocol  https://review.opendev.org/70723321:21
*** igordc has quit IRC21:26
*** diurnalist has quit IRC21:32
*** ggolin has quit IRC21:59
*** factor__ has quit IRC22:11
*** factor has joined #openstack-kolla22:12
*** dave-mccowan has quit IRC22:21
openstackgerritMerged openstack/kolla-ansible master: Use more permissive regex to remove the offending 127.0.1.1  https://review.opendev.org/70736422:27
*** dave-mccowan has joined #openstack-kolla22:27
*** icarusfactor has joined #openstack-kolla22:41
*** factor has quit IRC22:42
*** factor has joined #openstack-kolla22:49
*** icarusfactor has quit IRC22:49
*** k_mouza has joined #openstack-kolla22:52
*** k_mouza has quit IRC22:56
*** factor has quit IRC23:06
*** factor has joined #openstack-kolla23:06
*** k_mouza has joined #openstack-kolla23:11
*** sm806 has quit IRC23:23
*** sm806 has joined #openstack-kolla23:24
cosmicsoundyes well100 all good23:26
cosmicsoundgetting ready to call it a day23:26
*** k_mouza has quit IRC23:27
*** cah_link1 has joined #openstack-kolla23:47
*** cah_link has quit IRC23:49
*** cah_link1 is now known as cah_link23:49
*** sm806 has quit IRC23:50
*** sm806 has joined #openstack-kolla23:50
*** diurnalist has joined #openstack-kolla23:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!