Thursday, 2020-04-09

*** cshen has joined #openstack-ansible00:02
*** cshen has quit IRC00:06
jamesdentonyes, journalctl is the way for most of them00:11
thuydangThanks! The cinder container pipe journalctl to "more". Very hard to navigate :-)00:17
*** thuydang has quit IRC00:57
*** cshen has joined #openstack-ansible02:03
*** cshen has quit IRC02:07
*** rh-jelabarre has quit IRC03:12
*** cshen has joined #openstack-ansible04:03
*** cshen has quit IRC04:08
*** ababolcai has joined #openstack-ansible04:21
*** evrardjp has quit IRC04:37
*** evrardjp has joined #openstack-ansible04:37
*** udesale has joined #openstack-ansible04:40
*** logan- has quit IRC04:45
*** logan_ has joined #openstack-ansible04:47
*** logan_ is now known as logan-04:48
*** cshen has joined #openstack-ansible05:01
*** cshen has quit IRC05:05
*** jbadiapa has quit IRC05:20
*** kleini has joined #openstack-ansible05:36
*** miloa has joined #openstack-ansible06:11
*** cshen has joined #openstack-ansible06:12
*** this10nly has joined #openstack-ansible06:35
*** sshnaidm|afk is now known as sshnaidm06:55
*** rpittau|afk is now known as rpittau07:18
*** this10nly has quit IRC07:35
*** this10nly has joined #openstack-ansible07:36
*** tosky has joined #openstack-ansible07:42
*** zbr has quit IRC07:46
*** ygk_12345 has joined #openstack-ansible07:46
ygk_12345hi all07:46
*** zbr has joined #openstack-ansible07:46
ygk_12345when I use designate zone as resource in heat in train, it is showing this error07:47
ygk_12345http://paste.openstack.org/show/791845/07:47
ygk_12345is this a bug in heat designate ?07:47
ygk_12345this is openstack ansible train setup07:48
*** ygk_12345 has quit IRC07:59
*** threestrands has quit IRC08:00
*** DanyC has joined #openstack-ansible08:27
*** krah has joined #openstack-ansible08:35
*** gokhani has joined #openstack-ansible08:46
gokhanihi folks, I am trying to install ironic on Train version and I have troubles. I allocate 2 compute nodes for virtual machines and 1 compute node for baremetal. In My openstack_user_config.yml file I defined ironic hosts/containers like that: http://paste.openstack.org/show/791850/. when I run ironic playbook, it gives error. It can't install multipath-tools package in ironic compute lxc container. Logs are http://paste.openstack.org/show/791854/08:59
gokhani. I also wonder why openstack-ansible deafult install ironic-compute in container ? I also wonder that what is role of ironic-server hosts in environment file > https://github.com/openstack/openstack-ansible/blob/master/inventory/env.d/ironic.yml#L24 . may be I am making wrong things. can you help me please ?08:59
*** lkoranda has joined #openstack-ansible08:59
*** kleini has quit IRC09:00
*** kleini has joined #openstack-ansible09:01
*** kleini has quit IRC09:04
*** kleini has joined #openstack-ansible09:18
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_designate stable/train: Use ansible openstack collection  https://review.opendev.org/71862409:18
jrosserargh wrong branch09:19
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_designate master: Use ansible openstack collection  https://review.opendev.org/71862509:19
*** thuydang has joined #openstack-ansible09:22
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_gnocchi master: Use ansible openstack collection  https://review.opendev.org/71862609:22
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_keystone master: Use ansible openstack collection.  https://review.opendev.org/71863209:29
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_magnum master: Use ansible openstack collection  https://review.opendev.org/71863309:30
*** udesale_ has joined #openstack-ansible09:34
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_octavia master: Use ansible openstack collection  https://review.opendev.org/71863509:35
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_swift master: Use ansible openstack collection  https://review.opendev.org/71863809:36
*** udesale has quit IRC09:38
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Use ansible openstack collection  https://review.opendev.org/71863909:39
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_trove master: Use ansible openstack collection  https://review.opendev.org/71864109:41
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_keystone master: Use ansible openstack collection.  https://review.opendev.org/71863209:42
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible openstack collection  https://review.opendev.org/71864409:52
*** d34dh0r53 has quit IRC10:02
*** d34dh0r53 has joined #openstack-ansible10:03
*** cshen has quit IRC10:04
*** cshen has joined #openstack-ansible10:07
*** lkoranda has quit IRC10:11
*** rpittau is now known as rpittau|bbl10:13
*** jeev4 has joined #openstack-ansible10:16
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_designate master: Use ansible openstack collection  https://review.opendev.org/71862510:48
*** thuydang has quit IRC10:49
kleiniAre there any guides, how to upgrade a Ceph cluster deployed along with OSA, when upgrading S->T?10:53
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_octavia master: Use ansible openstack collection  https://review.opendev.org/71863510:58
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Use ansible openstack collection  https://review.opendev.org/71863911:16
jrosserkleini: OSA really just leverages ceph-ansible11:17
kleiniyes, found some text in the release notes for Train, telling, that the upgrade automatically takes place. yesterday it broke for me, but let's test again.11:19
jrosserkleini: it is good you are testing this11:22
jrosserif you find anything wrong please let us know11:22
*** cshen has quit IRC11:24
*** cshen has joined #openstack-ansible11:26
kleinihttp://paste.openstack.org/show/791866/ <- not sure, what this should tell me. there seems to be some new ceph.conf but ceph tools are not able to use it and checking the ceph status fails then in setup-infrastructure.yml11:26
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_swift master: Use ansible openstack collection  https://review.opendev.org/71863811:27
jrosserthats becasue config file has been updated to the new messaging format (v2) but the client tools have not11:32
jrossermaybe that the ordering is somehow wrong11:32
*** jamesdenton_wfh has quit IRC11:36
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_trove master: Use ansible openstack collection  https://review.opendev.org/71864111:38
*** rh-jelabarre has joined #openstack-ansible11:41
kleinihttp://paste.openstack.org/show/791871/ <- this is output from setup-infrastructure.yml. it tries to verify the status of the Ceph cluster and fails due to maybe wrong client11:42
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_octavia master: Use ansible openstack collection  https://review.opendev.org/71863511:44
*** jamesdenton_wfh has joined #openstack-ansible11:46
*** DanyC has quit IRC11:46
jamesdenton_wfhmornin11:48
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_designate master: Use ansible openstack collection  https://review.opendev.org/71862511:50
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: Revert "Revert "Update fallocate_reserve to work with py3""  https://review.opendev.org/71840011:52
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: Fix replicator services  https://review.opendev.org/71852411:54
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: Fix replicator services  https://review.opendev.org/71852411:54
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: Fix replicator services  https://review.opendev.org/71852411:55
noonedeadpunktimburke: does that make more sense? ^11:56
noonedeadpunkthanks for helping here11:56
*** rpittau|bbl is now known as rpittau11:57
*** DanyC has joined #openstack-ansible11:58
*** jamesdenton_wfh has quit IRC11:59
openstackgerritGeorgina Shippey proposed openstack/openstack-ansible-os_horizon stable/train: Config options around federation URLs  https://review.opendev.org/71868212:00
jrossernoonedeadpunk: i found this in the swift role too https://opendev.org/openstack/openstack-ansible-os_swift/src/branch/master/tasks/swift_proxy_hosts.yml#L3112:02
jrosserthats not good as its data set by the OSA 'keystone' module which we are trying to get rid of12:02
jrosserand are not actually using at all in the swift role any more now that everything uses the common service_setup stuff12:03
*** thuydang has joined #openstack-ansible12:04
noonedeadpunkhuh inded it's totally broken now...12:05
jrosserthuydang: you were having trouble with log stuff yesterday12:05
jrosseryou can use the -u flag to journalctl to filter for a specific service12:06
openstackgerritMerged openstack/openstack-ansible master: [doc] Add line to distribute nova keys  https://review.opendev.org/71851512:08
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_trove master: Use ansible openstack collection  https://review.opendev.org/71864112:09
*** ierdem has joined #openstack-ansible12:31
*** jamesdenton_wfh has joined #openstack-ansible12:37
*** thuydang has quit IRC12:39
*** ababolcai has quit IRC12:43
*** fghaas has joined #openstack-ansible12:51
*** jamesden_ has joined #openstack-ansible12:55
*** jamesdenton has quit IRC12:57
*** jamesde__ has joined #openstack-ansible12:58
*** jamesdenton_wfh has quit IRC12:58
openstackgerritSorin Sbarnea proposed openstack/openstack-ansible master: DNM - POC - Collect logs  https://review.opendev.org/70267613:07
*** Berthe01 has joined #openstack-ansible13:10
kleinijrosser: I got past the test, that the cluster is up an running by placing temporarily a ceph.conf to /etc/ceph with old mon host format. Now it is missing the client.bootstrap-rbd-mirror keyring. All the necessary parts of the rolling upgrade of Ceph from Mimic to Nautilus do not seem to be executed, when I run setup-infrastructure.yml. There must be something essential missing.13:14
*** thuydang has joined #openstack-ansible13:21
kleiniIs the rolling upgrade of Ceph from Mimic to Nautilus as part of OSA upgrade from S->T tested somewhere? It does not work at all for me or I am doing something terribly wrong.13:21
*** vblando has joined #openstack-ansible13:24
kleiniSo, I am stumbling over bug #186077213:27
openstackbug 1860772 in openstack-ansible "Ceph OSD restart failure while upgrading from Stein to Train" [Undecided,New] https://launchpad.net/bugs/186077213:27
jrosserebbex: did you do ceph upgrades as part of your testing?13:46
jrosserkleini: someone else was working on upgrades, see this https://review.opendev.org/#/c/713784/13:47
kleiniWill try including that changes.13:50
kleiniNext question: When creating a totally new inventory my cinder volume containers get a proper connection to the storage network for connections to Ceph. But the underlying controller host does not get this connection to the storage network. It is missing there and I need to add that manually, otherwise the MACVLAN setup for nspawn containers fails. Is this a known issue?13:56
jrosseri think you are probably the only deployment using nspawn13:57
jrosserwhen things are using LXC you would put an IP on br-storage on the host, thats how the controller host would see the storage network13:58
kleiniOkay, so using nspawn containers is not a good idea in terms of getting something working for production use?13:59
*** Berthe01 has quit IRC14:01
*** Berthe01 has joined #openstack-ansible14:01
jrosserwe don't have anyone actively working on further developing the nspawn containers, and they are not involved in the CI jobs we currently run14:02
jrosserkleini: this is an open source project - in particular openstack-ansible is developed by openstack operators for openstack operators14:05
*** this10nly has quit IRC14:05
jrossercontributions are always welcome and if nspawn is particularly important to you then it wouldbe great if you could put effort toward that14:06
kleiniI would like to do so but I am a total Ansible newbie and it is extremly hard for me to even understand, what is going on where and how...14:07
*** d34dh0r53 has quit IRC14:08
kleiniIs Open vSwitch instead of Linux Bridge tested in CI jobs?14:11
jamesde__there are some ovs jobs14:13
*** jamesde__ is now known as jamesdenton_wfh14:13
*** gokhani has quit IRC14:16
*** gokhani has joined #openstack-ansible14:16
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_designate master: Use ansible openstack collection  https://review.opendev.org/71862514:17
openstackgerritSorin Sbarnea proposed openstack/openstack-ansible master: DNM - POC - Collect logs using artcl  https://review.opendev.org/70267614:18
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_octavia master: Use ansible openstack collection  https://review.opendev.org/71863514:20
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_swift master: Use ansible openstack collection  https://review.opendev.org/71863814:21
*** Jeffrey4l has quit IRC14:22
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Use ansible openstack collection  https://review.opendev.org/71863914:22
*** Jeffrey4l has joined #openstack-ansible14:23
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_trove master: Use ansible openstack collection  https://review.opendev.org/71864114:26
fridtjof[m]looking at the train requirements, i see en_US.UTF-8 as a requirement. Is it enough to have the locale installed/generated? or should I set it as default?14:27
jrosserkleini: i would recommend you stick as close as you can to the default config which would be linuxbridge with LXC14:27
jrosserother things are possible, like no containers (bare metal) or OVS14:27
jrosserbut for OVS thats generally just for the neutron networks, not may using OSA also use it for the controller management networks14:29
jrosser*not many14:29
kleiniand we're used to use nspawn container and OVS for our handcrafted deployment. I have to decide at some point.14:38
jrossernoonedeadpunk: more keystone vs rabbitmq trouble https://zuul.opendev.org/t/openstack/build/372c4cb75b984f1e87472344bd60c014/log/logs/host/keystone-wsgi-public.service.journal-10-50-33.log.txt#447214:43
noonedeadpunkI think I saw that earlier and it's smth floating problem isn't it?14:44
noonedeadpunkSo was thinking about if we have available resources...14:44
jrosserfloating problem?14:44
noonedeadpunklike not permanent:)14:45
jrosserah right, yes, it's intermittend14:45
jrosserintermittent14:45
* noonedeadpunk just don't know such word :(14:45
jrosserseems like it hits quite a few of my collections patches today14:45
noonedeadpunkthis task has failed in pretty random place I'd say14:46
jrosserthis happens on adding the service user in keystone14:49
jrosserbut it seems to hit different services but always the same task for that service14:49
*** gokhani has quit IRC14:53
noonedeadpunkoh, indeed. missed the previous failure.14:56
noonedeadpunkwondering why neutron actually. like it's ok for placement, glance, cinder...14:57
noonedeadpunkmaybe its oom thing?14:57
jrosserperhaps - it's further toward the end of the setup15:03
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible openstack collection  https://review.opendev.org/71864415:04
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_keystone master: Use ansible openstack collection  https://review.opendev.org/71863215:04
*** gyee has joined #openstack-ansible15:05
*** rh-jelabarre has quit IRC15:06
jrossernoonedeadpunk: maybe you a right about resources, look at this(!) https://review.opendev.org/#/c/718633/115:10
jrosserthat looks like a good place to start for a local build15:11
noonedeadpunkI always do 16gb sandboxes for sandbox...15:13
noonedeadpunk* flavors15:13
*** rh-jelabarre has joined #openstack-ansible15:21
*** ierdem has quit IRC15:24
*** DanyC has quit IRC15:31
*** rpittau is now known as rpittau|afk15:59
*** fghaas has quit IRC16:08
*** udesale_ has quit IRC16:35
*** evrardjp has quit IRC16:37
*** evrardjp has joined #openstack-ansible16:37
jrosserbrilliant W: Failed to fetch https://packages.erlang-solutions.com/ubuntu/dists/bionic/Release.gpg  The following signatures were invalid: BADSIG D208507CA14F4FCA Erlang Solutions Ltd.16:45
*** thuydang has quit IRC16:55
*** oligau has quit IRC17:11
*** sshnaidm is now known as sshnaidm|afk17:12
*** oligau has joined #openstack-ansible17:18
prometheanfireaddress on bridge or address on port that attaches to bridge17:50
*** cshen has quit IRC17:53
*** sshnaidm|afk is now known as sshnaidm|off18:02
*** cshen has joined #openstack-ansible18:12
*** cshen has quit IRC18:31
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-rabbitmq_server stable/stein: Configure better ciphers for rabbitmq  https://review.opendev.org/71877018:33
mgariepyis rocky still open  for patches ? ie, can i submit a patch for rocky as well  for the rabbitmq cyphers ?18:37
mgariepyi don't really care if the there is a point rel cutted.18:38
mgariepyjrosser, i had this issue earlier also. but it seems to be fixed now.18:44
jrossermgariepy: they break that often, sometimes I tweet them and they fix it if it lasts a long time18:46
jrossermust have very bad repo update process18:46
mgariepyindeed.18:47
mgariepyis rocky blocked for ever or i still can submit a patch ?18:47
*** fghaas has joined #openstack-ansible18:54
*** fghaas has left #openstack-ansible18:55
jrossermgariepy: we can still merge things18:59
noonedeadpunkmgariepy: we can merge but acan't tag19:02
noonedeadpunkso you can only use smth licke stable/rocky only19:02
mgariepyperfect :D19:02
noonedeadpunkbtw, I was thinking about merging batck to bump things to stable/rocky to get rid of bumps even by request19:03
noonedeadpunk*merging patch19:04
*** spsurya_ has quit IRC19:08
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-rabbitmq_server stable/rocky: Configure better ciphers for rabbitmq  https://review.opendev.org/71877419:09
mgariepyerm.19:12
mgariepythe check config is a bit not ok. ;) haha changing templates/rabbitmq.config.j2 only trigger the dock build19:13
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/rocky: Drop bumps for stable/rocky  https://review.opendev.org/71878619:52
*** thuydang has joined #openstack-ansible20:01
mgariepynoonedeadpunk, can you depend-on my patch on rabbitmq for this one ?20:02
noonedeadpunkare you sure this is required? like once 718774 will be merged, your rabbitmq patch will be used anyway?20:03
mgariepyis the merge check test rabbitmq ? since the check only tested doc.20:04
mgariepyanmyway have a nice weekend.20:10
*** mgariepy has quit IRC20:16
noonedeadpunkYeah, it doesn't test, agree20:18
noonedeadpunkBut not sure that depends-on will work though...20:18
noonedeadpunkbtw mine failed super quick20:19
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/rocky: Drop bumps for stable/rocky  https://review.opendev.org/71878620:23
*** owalsh is now known as owalsh_afk20:43
openstackgerritSean McGinnis proposed openstack/ansible-config_template master: Use constraints for installing doc requirements  https://review.opendev.org/71879320:53
*** mgariepy has joined #openstack-ansible21:09
*** jamesdenton_wfh has quit IRC21:12
*** jeev4 has quit IRC22:15
*** jamesdenton_wfh has joined #openstack-ansible22:40
*** tosky has quit IRC23:08
*** thuydang has quit IRC23:21
*** jamesdenton_wfh has quit IRC23:35

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!