| *** hwoarang has joined #openstack-ansible | 00:01 | |
| openstackgerrit | Shannon Mitchell proposed openstack/openstack-ansible master: Dynamic inventory backup corruption fix https://review.openstack.org/637441 | 00:04 |
|---|---|---|
| *** shananigans has quit IRC | 00:30 | |
| *** markvoelker has joined #openstack-ansible | 00:33 | |
| *** markvoelker has quit IRC | 01:07 | |
| *** dave-mccowan has joined #openstack-ansible | 01:21 | |
| guilhermesp | any core to push this up? :) https://review.openstack.org/#/c/637352/ | 01:38 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added dependency of os_tempest role https://review.openstack.org/632726 | 01:52 |
| *** sdake has joined #openstack-ansible | 02:00 | |
| *** markvoelker has joined #openstack-ansible | 02:04 | |
| *** sdake has quit IRC | 02:18 | |
| *** sdake has joined #openstack-ansible | 02:20 | |
| *** Soopaman has quit IRC | 02:32 | |
| *** markvoelker has quit IRC | 02:38 | |
| *** sdake has quit IRC | 02:44 | |
| *** hwoarang has quit IRC | 02:49 | |
| *** hwoarang has joined #openstack-ansible | 02:51 | |
| *** hwoarang has quit IRC | 02:56 | |
| *** hwoarang has joined #openstack-ansible | 03:00 | |
| *** hwoarang has quit IRC | 03:05 | |
| *** hwoarang has joined #openstack-ansible | 03:06 | |
| *** markvoelker has joined #openstack-ansible | 03:34 | |
| *** udesale has joined #openstack-ansible | 03:44 | |
| *** markvoelker has quit IRC | 04:06 | |
| *** dave-mccowan has quit IRC | 04:07 | |
| *** hwoarang has quit IRC | 04:15 | |
| *** hwoarang has joined #openstack-ansible | 04:17 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/monitorstack master: add default pickle cache version https://review.openstack.org/637451 | 04:30 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Add nova_user_pip_packages variable https://review.openstack.org/635579 | 04:30 |
| *** hwoarang has quit IRC | 04:46 | |
| *** hwoarang has joined #openstack-ansible | 04:47 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/monitorstack master: add default pickle cache version https://review.openstack.org/637451 | 04:56 |
| *** markvoelker has joined #openstack-ansible | 05:03 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add monitorstack data collection into ES https://review.openstack.org/637455 | 05:11 |
| openstackgerrit | Merged openstack/monitorstack master: add default pickle cache version https://review.openstack.org/637451 | 05:18 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Remove save directory creation https://review.openstack.org/637352 | 05:29 |
| *** shyamb has joined #openstack-ansible | 05:32 | |
| *** markvoelker has quit IRC | 05:37 | |
| *** jbadiapa has joined #openstack-ansible | 06:02 | |
| *** shyamb has quit IRC | 06:04 | |
| *** shyamb has joined #openstack-ansible | 06:04 | |
| *** chandankumar is now known as chkumar|ruck | 06:17 | |
| *** hwoarang has quit IRC | 06:23 | |
| *** shyamb has quit IRC | 06:23 | |
| *** shyamb has joined #openstack-ansible | 06:26 | |
| *** hwoarang has joined #openstack-ansible | 06:29 | |
| *** markvoelker has joined #openstack-ansible | 06:34 | |
| *** sdake has joined #openstack-ansible | 06:38 | |
| *** hamzaachi has joined #openstack-ansible | 06:48 | |
| *** phasespace has quit IRC | 07:01 | |
| *** markvoelker has quit IRC | 07:06 | |
| *** hwoarang has quit IRC | 07:12 | |
| *** hwoarang has joined #openstack-ansible | 07:16 | |
| *** rgogunskiy has joined #openstack-ansible | 07:23 | |
| *** shyamb has quit IRC | 07:24 | |
| *** shyamb has joined #openstack-ansible | 07:27 | |
| *** sdake has quit IRC | 07:30 | |
| *** DanyC has quit IRC | 07:33 | |
| *** rgogunskiy has quit IRC | 07:38 | |
| *** shyamb has quit IRC | 07:42 | |
| *** pcaruana has joined #openstack-ansible | 07:43 | |
| *** shyamb has joined #openstack-ansible | 07:59 | |
| *** rgogunskiy has joined #openstack-ansible | 08:03 | |
| *** markvoelker has joined #openstack-ansible | 08:03 | |
| *** DanyC has joined #openstack-ansible | 08:04 | |
| *** kopecmartin|off is now known as kopecmartin | 08:04 | |
| *** gkadam has joined #openstack-ansible | 08:06 | |
| *** gkadam has quit IRC | 08:09 | |
| *** iurygregory has joined #openstack-ansible | 08:14 | |
| *** tosky has joined #openstack-ansible | 08:33 | |
| *** shyamb has quit IRC | 08:34 | |
| *** markvoelker has quit IRC | 08:37 | |
| *** ArchiFleKs has quit IRC | 08:41 | |
| *** rgogunskiy has quit IRC | 08:42 | |
| *** phasespace has joined #openstack-ansible | 08:51 | |
| *** ArchiFleKs has joined #openstack-ansible | 09:00 | |
| *** pcaruana|afk| has joined #openstack-ansible | 09:01 | |
| *** noonedeadpunk[h] is now known as noonedeadpunk | 09:02 | |
| *** pcaruana has quit IRC | 09:02 | |
| *** shyamb has joined #openstack-ansible | 09:04 | |
| openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible-plugins stable/rocky: Remove whitespace before comments https://review.openstack.org/637495 | 09:07 |
| *** fnpanic has joined #openstack-ansible | 09:13 | |
| *** sdake has joined #openstack-ansible | 09:16 | |
| fnpanic | mornig | 09:17 |
| *** rgogunskiy has joined #openstack-ansible | 09:25 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Add a known issue release note regarding inotify watch limits https://review.openstack.org/637498 | 09:25 |
| *** markvoelker has joined #openstack-ansible | 09:34 | |
| *** trident has joined #openstack-ansible | 09:38 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Ensure stackviz wheel build is isolated https://review.openstack.org/637503 | 09:40 |
| *** mbi has quit IRC | 09:40 | |
| *** electrofelix has joined #openstack-ansible | 09:42 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/rocky: Update deprecated option for pci passthrough https://review.openstack.org/636390 | 09:55 |
| *** hamzaachi has quit IRC | 10:00 | |
| *** hamzaachi has joined #openstack-ansible | 10:01 | |
| *** pcaruana|afk| has quit IRC | 10:01 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Revert "Avoid distro installing unused services" https://review.openstack.org/637393 | 10:04 |
| *** pcaruana has joined #openstack-ansible | 10:07 | |
| *** markvoelker has quit IRC | 10:07 | |
| *** hamzaachi has quit IRC | 10:13 | |
| *** hamzaachi has joined #openstack-ansible | 10:15 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Revert "Avoid distro installing unused services" https://review.openstack.org/637392 | 10:15 |
| *** shyamb has quit IRC | 10:18 | |
| *** hamzaachi has quit IRC | 10:21 | |
| *** hamzaachi has joined #openstack-ansible | 10:22 | |
| *** rgogunskiy has quit IRC | 10:24 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/queens: Update deprecated option for pci passthrough https://review.openstack.org/636396 | 10:25 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Update role for new source build process https://review.openstack.org/620340 | 10:28 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added dependency of os_tempest role https://review.openstack.org/632726 | 10:42 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added dependency of os_tempest role https://review.openstack.org/632726 | 10:42 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder stable/queens: Add missing CLI_OPTIONS when setting up qos volume types https://review.openstack.org/637281 | 10:43 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder stable/rocky: Add missing CLI_OPTIONS when setting up qos volume types https://review.openstack.org/637279 | 10:43 |
| CeeMac | morning | 10:55 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added dependency of os_tempest role https://review.openstack.org/632726 | 11:03 |
| *** markvoelker has joined #openstack-ansible | 11:04 | |
| *** sdake has quit IRC | 11:16 | |
| *** sdake has joined #openstack-ansible | 11:21 | |
| *** udesale has quit IRC | 11:33 | |
| *** udesale has joined #openstack-ansible | 11:34 | |
| *** markvoelker has quit IRC | 11:37 | |
| *** shyamb has joined #openstack-ansible | 11:37 | |
| *** sdake has quit IRC | 12:12 | |
| *** sdake has joined #openstack-ansible | 12:14 | |
| *** shyamb has quit IRC | 12:24 | |
| *** kaiokmo has joined #openstack-ansible | 12:24 | |
| chkumar|ruck | odyssey4me: hello | 12:26 |
| chkumar|ruck | odyssey4me: is it possible to use https://github.com/openstack/openstack-ansible/blob/master/scripts/gate-check-commit.sh locally by passing scenario deploy and install_method locally? | 12:26 |
| chkumar|ruck | or is it just used in CI? | 12:26 |
| odyssey4me | chkumar|ruck CI just runs gate-check-commit: https://github.com/openstack/openstack-ansible/blob/master/zuul.d/playbooks/run.yml | 12:27 |
| odyssey4me | chkumar|ruck so you can do the same | 12:27 |
| chkumar|ruck | odyssey4me: adn what is the system requirements for these scenarios 8 GB is fine? | 12:28 |
| odyssey4me | chkumar|ruck same as openstack infra - 8vcpu/8ram & ~ 80GB HDD | 12:28 |
| chkumar|ruck | ok | 12:28 |
| *** gillesMo has joined #openstack-ansible | 12:29 | |
| odyssey4me | chkumar|ruck there is also a vagrantfile - so vagrant can also be used | 12:30 |
| *** mhayden has quit IRC | 13:05 | |
| chkumar|ruck | arxcruz: kopecmartin please have a look at this failure http://logs.openstack.org/26/632726/11/check/openstack-ansible-functional-tempestconf-centos-7/789fce5/logs/ara-report/result/9d6cff3b-c643-40dc-93b5-a9ae084d8997/when free | 13:06 |
| *** mhayden has joined #openstack-ansible | 13:06 | |
| *** mhayden has quit IRC | 13:13 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible master: wip: upgrade jobs https://review.openstack.org/627782 | 13:16 |
| arxcruz | chkumar|ruck: Details: {u'message': u'Only volume-backed servers are allowed for flavors with zero disk.', u'code': 403} | 13:25 |
| *** priteau has joined #openstack-ansible | 13:26 | |
| *** mhayden has joined #openstack-ansible | 13:27 | |
| *** sdake has quit IRC | 13:28 | |
| *** hamzaachi_ has joined #openstack-ansible | 13:28 | |
| *** hamzaachi_ has quit IRC | 13:29 | |
| *** hamzaachi_ has joined #openstack-ansible | 13:29 | |
| *** hamzaachi has quit IRC | 13:29 | |
| *** priteau has quit IRC | 13:45 | |
| *** sdake has joined #openstack-ansible | 13:55 | |
| *** sum12 has quit IRC | 13:56 | |
| *** priteau has joined #openstack-ansible | 14:02 | |
| *** sum12 has joined #openstack-ansible | 14:04 | |
| *** jroll has quit IRC | 14:13 | |
| *** jroll has joined #openstack-ansible | 14:14 | |
| *** hamzaachi__ has joined #openstack-ansible | 14:15 | |
| *** hamzaachi_ has quit IRC | 14:18 | |
| *** chkumar|ruck is now known as chandankumar | 14:28 | |
| guilhermesp | how's the best way to submit a test PR? Like adding in the title something like [test] something? | 14:28 |
| *** ansmith has joined #openstack-ansible | 14:31 | |
| *** tacco has joined #openstack-ansible | 14:35 | |
| tacco | hi there.. is there any prefered way to redeploy a compute node? Would like to clean up a old compute and just redeploy the same host from scratch. is there anything to take care of before redeploy? or can i just redeploy as i would deploy a new one? Hostname and IP will stay the same.. and the node is already disabled as "compute host" | 14:37 |
| *** priteau has quit IRC | 14:47 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add monitorstack data collection into ES https://review.openstack.org/637455 | 14:47 |
| cloudnull | mornings | 14:48 |
| cloudnull | tacco you can just redeploy it. I'd say make sure that all of the workloads have been evacuated from the node and mark the node as disabled before rekicking it | 14:49 |
| cloudnull | however, there's nothing from the OSA side you have to do to simply rekick it, especially if the hostname and IP will remain the same . | 14:49 |
| *** sdake has quit IRC | 14:58 | |
| *** dave-mccowan has joined #openstack-ansible | 14:59 | |
| *** priteau has joined #openstack-ansible | 14:59 | |
| odyssey4me | guilhermesp use [TEST] or [DNM] | 15:01 |
| guilhermesp | thanks odyssey4me ! | 15:01 |
| odyssey4me | tacco just wipe out the gathered facts for the node to make sure you get some fresh ones | 15:01 |
| *** dave-mccowan has quit IRC | 15:03 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Cleanup files and templates using smart sources https://review.openstack.org/588959 | 15:06 |
| *** shananigans has joined #openstack-ansible | 15:09 | |
| tacco | odyssey4me: thanks will do so. host is already evacuated.. and nothing is on it anymore.. so will make sure the facts are fresh.. then i will redeploy. :D thanks mate | 15:12 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: Iterate over list of values of PPC packages dict https://review.openstack.org/637275 | 15:14 |
| CeeMac | odyssey4me hi | 15:15 |
| CeeMac | i've had a bit of an oddity during minor upgrade | 15:15 |
| CeeMac | 2 of the nodes lost network connectivity during setup-hosts, the others were fine | 15:16 |
| CeeMac | network config and hardware is mostly the same across all of the nodes | 15:16 |
| CeeMac | seen anything like that before? | 15:16 |
| jrosser | CeeMac: do you mean the nodes themselves, or the containers? | 15:18 |
| *** priteau has quit IRC | 15:18 | |
| CeeMac | physical node | 15:18 |
| jrosser | hmm, i've seen containers do that at upgrade but never nodes | 15:19 |
| CeeMac | i had to hard reset the switch ports under the bond to bring it back up | 15:19 |
| CeeMac | just scouring the logs now to try work out if its a physical config issue or not | 15:19 |
| CeeMac | just after in install apt task | 15:19 |
| jrosser | so it may depend how your host is set up | 15:20 |
| jrosser | but afaik the host setup and OSA are supposed to be independant | 15:20 |
| CeeMac | i need to double double check, but it could be the bond | 15:20 |
| jrosser | give or take a bit of systemd-networkd :) | 15:20 |
| CeeMac | its the networkd stuff that its falling over at i think | 15:20 |
| CeeMac | ansible-apt gets invoked to install some packages | 15:21 |
| * jrosser scurries back to the safety of ifupdown | 15:21 | |
| CeeMac | then systemd stops and waits for network to be configured | 15:21 |
| CeeMac | at which point the network connectivity is lost | 15:22 |
| CeeMac | don't know if its netplan getting upset because ansible is installing ifupdown or what | 15:22 |
| CeeMac | i'm highly tempted to revert to ifupdown....... | 15:22 |
| CeeMac | just need to check of the other hosts that werent affected have bonded nics or not | 15:23 |
| CeeMac | "kernel: [272496.554626] br-mgmt: port 1(bond0.211) entered disabled state" would probably be the bit | 15:24 |
| CeeMac | hmm | 15:26 |
| CeeMac | i'm going to blame the network setup and worry about it later | 15:26 |
| jrosser | it would be very useful if you could identify the point/thing which made systemd_networkd restart | 15:26 |
| CeeMac | wouldn't it | 15:28 |
| * CeeMac isn't sure where to begin | 15:29 | |
| CeeMac | i was asuming there was task in the playbook that did it | 15:29 |
| *** phasespace has quit IRC | 15:31 | |
| *** kmadac has joined #openstack-ansible | 15:37 | |
| *** udesale has quit IRC | 15:41 | |
| *** sdake has joined #openstack-ansible | 15:45 | |
| CeeMac | hmmm | 15:49 |
| CeeMac | think i've worked out the issue on 2 of the nodes, but not the 1st one that failed. Still trying to track down the task that restarted systemd-networkd | 15:50 |
| *** mathlin has quit IRC | 15:50 | |
| CeeMac | for the record, ubuntu bionic doesn't seem to like native vlan tags on cisco blade switch ports | 15:51 |
| CeeMac | i'd already taken it off the primary port when I built the blades but forgot to take it off the second | 15:51 |
| CeeMac | looks like port 0 is bounced first, then network is lost because of the native vlan issue and doesn't come back until the port 1 is bounced physically | 15:52 |
| CeeMac | still digging | 15:52 |
| CeeMac | jrosser | 15:55 |
| CeeMac | TASK [lxc_hosts : Remove conflicting packages] completed successfully | 15:55 |
| CeeMac | then TASK [lxc_hosts : Install apt packages] timed out | 15:55 |
| CeeMac | so the network went down in between those 2 tasks | 15:55 |
| CeeMac | or during the latter | 15:56 |
| CeeMac | and thats where i get lost in the rabbit hole trying to decypher ansible | 16:00 |
| CeeMac | i get as far as lxc_install_apt.yml, which has the names tasks | 16:01 |
| CeeMac | but i don't know where to look for apt: pkg: "{{ lxc_hosts_remove_distro_packages }}" | 16:01 |
| *** pcaruana has quit IRC | 16:10 | |
| CeeMac | would the systemd upgrade cause systemd-networkd to restart? the timings seem to coincide | 16:13 |
| *** phasespace has joined #openstack-ansible | 16:27 | |
| CeeMac | heading out shortly, will keep digging in the morning | 16:38 |
| *** ppetit has joined #openstack-ansible | 16:50 | |
| *** ppetit has quit IRC | 16:53 | |
| *** dswebb has joined #openstack-ansible | 16:54 | |
| *** ostackz has joined #openstack-ansible | 16:55 | |
| *** sdake has quit IRC | 17:00 | |
| *** DanyC has quit IRC | 17:00 | |
| *** DanyC has joined #openstack-ansible | 17:01 | |
| *** DanyC has quit IRC | 17:03 | |
| *** ppetit has joined #openstack-ansible | 17:03 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Correct formatting in README.rst https://review.openstack.org/637117 | 17:03 |
| *** sdake has joined #openstack-ansible | 17:05 | |
| *** ppetit_ has joined #openstack-ansible | 17:06 | |
| *** DanyC has joined #openstack-ansible | 17:12 | |
| *** ppetit_ has quit IRC | 17:14 | |
| openstackgerrit | Maciej Kucia proposed openstack/ansible-hardening master: setup.cfg: Define data files https://review.openstack.org/637595 | 17:40 |
| bgmccollum | The Rocky AIO doesn't appear to be setting up the cinder-volume loop / VG, preventing the service from starting. Anyone seen this? | 17:41 |
| bgmccollum | Although, might be due to a restart, so something with the loop-cinder.service unit. | 17:43 |
| *** DanyC has quit IRC | 17:44 | |
| *** DanyC has joined #openstack-ansible | 17:44 | |
| bgmccollum | restarting loop-cinder.service and cinder-volume.service allows cinder-volume to properly come up... | 17:45 |
| *** hwoarang has quit IRC | 17:47 | |
| *** hwoarang has joined #openstack-ansible | 17:47 | |
| *** DanyC has quit IRC | 17:49 | |
| *** ppetit has quit IRC | 17:50 | |
| *** DanyC has joined #openstack-ansible | 17:51 | |
| *** cmart has joined #openstack-ansible | 17:51 | |
| *** idlemind has quit IRC | 17:52 | |
| *** priteau has joined #openstack-ansible | 17:53 | |
| *** DanyC has joined #openstack-ansible | 17:54 | |
| *** kopecmartin is now known as kopecmartin|off | 17:56 | |
| *** phasespace has quit IRC | 17:57 | |
| *** hamzaachi__ has quit IRC | 17:59 | |
| cloudnull | bgmccollum is that unit enabled? | 18:02 |
| bgmccollum | let me check | 18:02 |
| cloudnull | also could be a wait condition | 18:02 |
| cloudnull | but if its not enabled that would make sense | 18:02 |
| bgmccollum | yes its enabled | 18:02 |
| cloudnull | if its not coming up after a reboot I'd be curious what the failure was | 18:03 |
| bgmccollum | ill reboot the host and verify thats the case | 18:03 |
| cloudnull | if its something not existing or a timing issue we can adjust the units to have additional conditions to try and resolve that | 18:04 |
| *** kmadac has quit IRC | 18:05 | |
| dswebb | bgmccollum I'm facing a somewhat similar issue now with the ceph backend for Rocky AIO (installed via ansible-ops mnaio). I don't even have a cinder-volume.service | 18:06 |
| dswebb | I managed to get it started by hand after installing some of the rados / rbd python modules, but am having further complications now | 18:07 |
| dswebb | root@infra1-cinder-api-container-b195e794:~# systemctl list-unit-files|grep cind | 18:08 |
| dswebb | cinder-api.service enabled | 18:08 |
| dswebb | cinder-scheduler.service enabled | 18:08 |
| dswebb | cinder-volume-usage-audit.service disabled | 18:08 |
| dswebb | cinder-volume-usage-audit.timer disabled | 18:08 |
| bgmccollum | cloudnull reboot shows the loop and cinder-volume came up...ill try a few more reboots to see if its transient... | 18:10 |
| *** gillesMo has quit IRC | 18:26 | |
| *** ansmith_ has joined #openstack-ansible | 18:28 | |
| *** sdake_ has joined #openstack-ansible | 18:29 | |
| *** sdake has quit IRC | 18:29 | |
| *** ansmith has quit IRC | 18:30 | |
| cloudnull | interesting | 18:32 |
| cloudnull | could be a terrible race condition | 18:32 |
| bgmccollum | 1st reboot worked, 2nd and 3rd reboots did not work | 18:34 |
| bgmccollum | http://paste.openstack.org/show/745277/ | 18:35 |
| bgmccollum | cloudnull appears to race with the "/openstack" mount | 18:37 |
| bgmccollum | "losetup: /openstack/cinder.img: failed to set up loop device: No such file or directory" | 18:37 |
| cloudnull | hum . /openstack is a mount? | 18:38 |
| cloudnull | is that on baremetal ? | 18:38 |
| bgmccollum | data device | 18:38 |
| bgmccollum | for AIO | 18:38 |
| cloudnull | oh! | 18:39 |
| cloudnull | so we likley need to add an after clause in the loop devices ? | 18:40 |
| cloudnull | we could probably add something like ConditionPathIsMountPoint or ConditionPathExists to the loop device units | 18:41 |
| bgmccollum | Yes, but only if a data device has been defined... | 18:41 |
| bgmccollum | right | 18:41 |
| bgmccollum | also, swift keeps its loop images in /srv which isn't affect by this | 18:41 |
| bgmccollum | but isn't honoring the data device technically | 18:42 |
| bgmccollum | oh nevermind | 18:42 |
| bgmccollum | thats the mount point | 18:42 |
| cloudnull | I guess we could generally add a ConditionPathExists=/path/to/loop/file which should do whats required | 18:42 |
| bgmccollum | ok, ill try adding that, and do some reboots | 18:42 |
| bgmccollum | does that go under [Unit]? | 18:44 |
| cloudnull | yes | 18:44 |
| bgmccollum | ok, about to fire it off | 18:44 |
| * cloudnull crosses fingers waiting in suspense | 18:45 | |
| *** hamzaachi__ has joined #openstack-ansible | 18:46 | |
| mnaser | hey so i guess our gates are broken | 18:47 |
| mnaser | arxcruz: mentioned this a bit ago | 18:47 |
| mnaser | http://lists.openstack.org/pipermail/openstack-discuss/2019-February/002842.html | 18:47 |
| *** ansmith_ has quit IRC | 18:50 | |
| *** ansmith_ has joined #openstack-ansible | 18:51 | |
| bgmccollum | cloudnull -- http://paste.openstack.org/show/745278/ | 19:00 |
| cloudnull | mnaser RUTRHO! | 19:02 |
| mnaser | cloudnull: i broke it ;( | 19:02 |
| mnaser | but i fixed it | 19:02 |
| cloudnull | bgmccollum did the service not eventually start? | 19:02 |
| mnaser | but i fixed it by breaking it | 19:02 |
| cloudnull | mnaser nice ! | 19:03 |
| cloudnull | break fixing is the best | 19:03 |
| bgmccollum | cloudnull it did not start | 19:03 |
| cloudnull | hum. maybe we need to figure out an After=... when a data disk is being used | 19:06 |
| bgmccollum | After=openstack.mount ? | 19:07 |
| bgmccollum | and only template that when a data device is being used | 19:07 |
| bgmccollum | testing | 19:07 |
| chandankumar | guilhermesp: i think we need to revert this patch https://review.openstack.org/#/c/633549/ as on moving temepst workspace the directory is empty we need to do tempest init again | 19:08 |
| chandankumar | guilhermesp: http://logs.openstack.org/82/627782/7/check/openstack-ansible-upgrade-aio_lxc-ubuntu-bionic/7a5a7b4/logs/ara-report/result/5d5f132f-0e5e-4bc6-904b-35488f1da75d/ | 19:08 |
| *** electrofelix has quit IRC | 19:15 | |
| *** dswebb has quit IRC | 19:18 | |
| *** DanyC has quit IRC | 19:20 | |
| *** DanyC has joined #openstack-ansible | 19:20 | |
| *** DanyC_ has joined #openstack-ansible | 19:22 | |
| *** DanyC has quit IRC | 19:25 | |
| *** priteau has quit IRC | 19:25 | |
| *** DanyC_ has quit IRC | 19:26 | |
| bgmccollum | cloudnull adding `After = openstack.mount` did not work (in fact, none of the swift mounts loaded either). Instead, I replaced `After = systemd-udev-settle.service` with `After = openstack.mount`, and that seems to have worked. | 19:28 |
| cloudnull | ah. and that would work regardless, data disk or not | 19:29 |
| cloudnull | maybe we add that to the systemd_mounts role as a general rule ? | 19:30 |
| bgmccollum | is that used the by the bootstrap-aio role? | 19:30 |
| bgmccollum | looking | 19:31 |
| bgmccollum | ok, it does appear to use it | 19:32 |
| *** ansmith has joined #openstack-ansible | 19:34 | |
| cloudnull | bgmccollum we could probably just add that to https://github.com/openstack/ansible-role-systemd_mount/blob/master/templates/systemd-mount.j2 | 19:35 |
| *** ansmith_ has quit IRC | 19:35 | |
| cloudnull | which would add that option as a general rule | 19:35 |
| bgmccollum | but loop-cinder is a service not a mount haha | 19:39 |
| *** DanyC has joined #openstack-ansible | 19:40 | |
| bgmccollum | probably because it does more than just setup a mount | 19:40 |
| bgmccollum | pvscan so lvm picks it up | 19:40 |
| cloudnull | ah... | 19:43 |
| cloudnull | so then maybe it just needs to go into the service definition | 19:43 |
| bgmccollum | either way, its still not reliable...just had a reboot where it didnt work... | 19:44 |
| bgmccollum | its racing with something non-obvious to my eyes | 19:44 |
| *** DanyC has quit IRC | 19:44 | |
| cloudnull | maybe `fter = openstack.mount` and `After = systemd-udev-settle.service`? | 19:45 |
| bgmccollum | i tried with both, and it didn't seem to make a difference | 19:45 |
| bgmccollum | ill keep banging on it | 19:46 |
| bgmccollum | i think something more systemic is at play, because sometimes SSH doesn't even start... :/ | 19:46 |
| bgmccollum | might need to do the cinder mount like the swift mount, then have another service that does the pvscan after that | 19:47 |
| bgmccollum | wait...that wont work. we just need the loop device setup and mount units wouldn't be able to do that. | 19:50 |
| *** sdake_ has quit IRC | 19:54 | |
| *** hamzaachi__ has quit IRC | 20:26 | |
| *** hamzaachi has joined #openstack-ansible | 20:27 | |
| *** hamzaachi has quit IRC | 20:28 | |
| *** hamzaachi has joined #openstack-ansible | 20:31 | |
| *** hamzaachi has quit IRC | 20:31 | |
| *** hamzaachi has joined #openstack-ansible | 20:32 | |
| *** cmart has quit IRC | 20:37 | |
| *** hamzaachi has quit IRC | 20:37 | |
| *** cmart has joined #openstack-ansible | 20:38 | |
| *** hamzaachi has joined #openstack-ansible | 20:38 | |
| *** hamzaachi has quit IRC | 20:39 | |
| *** hamzaachi has joined #openstack-ansible | 20:39 | |
| *** hamzaachi has quit IRC | 20:51 | |
| guilhermesp | yes chandankumar I was about to test something but I didn't have the opportunity | 21:32 |
| guilhermesp | I noticed that the tempest move command wasn't moving the workspace in fact, that's why the upgrade jobs stills fails | 21:33 |
| guilhermesp | I was thinking of moving manually the content to the new workspace, but you think adding a tempest init could solve the problem? | 21:33 |
| guilhermesp | I still have the hold on that job, but is quite messy in there. I think I will ask ppl of openstack-infra to remove it and ask a brand new one in case of failures again | 21:34 |
| *** DanyC has joined #openstack-ansible | 21:51 | |
| cmart | Hi folks. Is there any information out there about some of the largest single OpenStack deployments that are managed by OpenStack-Ansible? On the scale of 10^3 compute nodes? | 21:56 |
| *** DanyC has quit IRC | 21:57 | |
| cmart | I know other things would tend to bottleneck before your deployment tooling, but just curious to learn how well it works from an ops perspective. | 21:58 |
| *** ansmith has quit IRC | 22:05 | |
| *** dave-mccowan has joined #openstack-ansible | 22:17 | |
| *** dave-mccowan has quit IRC | 22:21 | |
| *** sdake has joined #openstack-ansible | 22:25 | |
| *** sdake has quit IRC | 22:27 | |
| *** sdake has joined #openstack-ansible | 22:33 | |
| *** shananigans has quit IRC | 22:36 | |
| *** cmart has quit IRC | 22:41 | |
| *** sdake has quit IRC | 22:46 | |
| *** sdake has joined #openstack-ansible | 22:49 | |
| *** dhellmann has left #openstack-ansible | 22:55 | |
| *** cmart has joined #openstack-ansible | 22:58 | |
| *** ArchiFleKs has quit IRC | 23:04 | |
| *** aedc has quit IRC | 23:06 | |
| *** DanyC has joined #openstack-ansible | 23:13 | |
| *** DanyC has joined #openstack-ansible | 23:15 | |
| *** DanyC has quit IRC | 23:22 | |
| *** DanyC_ has joined #openstack-ansible | 23:22 | |
| *** sdake has quit IRC | 23:24 | |
| *** sdake has joined #openstack-ansible | 23:25 | |
| *** ArchiFleKs has joined #openstack-ansible | 23:25 | |
| *** sdake has quit IRC | 23:32 | |
| *** aedc has joined #openstack-ansible | 23:44 | |
| *** cmart has quit IRC | 23:48 | |
| *** cmart has joined #openstack-ansible | 23:48 | |
| *** spsurya has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!