| *** TxGirlGeek has quit IRC | 00:07 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: [DNM] Demonstrate the use of Mitogen with OSA https://review.openstack.org/591236 | 00:08 |
|---|---|---|
| broken_one | has anyone looked into why the OVN centos7 build is failing this? https://review.openstack.org/#/c/630374/2 | 00:13 |
| cloudnull | jamesdenton ^ | 00:14 |
| jamesdenton | i can check that out | 00:14 |
| jamesdenton | http://logs.openstack.org/74/630374/2/check/openstack-ansible-ovn-centos-7/63c7a8e/logs/openstack/server1/neutron-server.service.journal.log.txt.gz | 00:15 |
| jamesdenton | well there may be more. i will have to see in a bit | 00:16 |
| broken_one | interestig | 00:19 |
| *** macza_ has quit IRC | 00:19 | |
| jamesdenton | https://github.com/svinota/pyroute2/blob/master/pyroute2/netlink/rtnl/tcmsg/sched_netem.py#L60 | 00:22 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: [DNM] Demonstrate the use of Mitogen with OSA https://review.openstack.org/591236 | 00:23 |
| jamesdenton | not sure what it's looking for | 00:23 |
| jamesdenton | broken_one do you know if it consistently failed this? maybe we just recheck | 00:26 |
| *** tosky has quit IRC | 00:27 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: [DNM] Demonstrate the use of Mitogen with OSA https://review.openstack.org/591236 | 00:28 |
| *** sdake has quit IRC | 00:32 | |
| *** sdake has joined #openstack-ansible | 00:34 | |
| *** sdake has quit IRC | 00:36 | |
| *** hwoarang has quit IRC | 00:38 | |
| *** eumel8 has quit IRC | 00:39 | |
| *** hwoarang has joined #openstack-ansible | 00:40 | |
| *** nurdie has joined #openstack-ansible | 00:41 | |
| *** Pbing has quit IRC | 00:50 | |
| *** sdake has joined #openstack-ansible | 00:53 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: [DNM] Demonstrate the use of Mitogen with OSA https://review.openstack.org/591236 | 00:53 |
| *** hwoarang has quit IRC | 00:54 | |
| *** hwoarang has joined #openstack-ansible | 00:54 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: [DNM] Demonstrate the use of Mitogen with OSA https://review.openstack.org/591236 | 01:00 |
| *** nurdie_ has joined #openstack-ansible | 01:04 | |
| *** nurdie has quit IRC | 01:05 | |
| *** sdake has quit IRC | 01:08 | |
| *** cmart has quit IRC | 01:15 | |
| *** cmart has joined #openstack-ansible | 01:15 | |
| broken_one | jamesdenton: not sure if it was consistent fail or not | 01:21 |
| jamesdenton | it's been a week. i triggered a recheck | 01:21 |
| jamesdenton | we'll know by tomorrow! | 01:22 |
| broken_one | but i think something is not being configured on an interface | 01:22 |
| jamesdenton | nothing in the patch seemed responsible | 01:22 |
| broken_one | yup crossing fingers | 01:22 |
| jamesdenton | Those patches for os_glance re: NFS couldn't be more timely. I tried it for the first time today and ran into issues. glad it's not me | 01:24 |
| broken_one | interesting | 01:25 |
| broken_one | i know that ceph is still working | 01:25 |
| *** jbadiapa has quit IRC | 01:26 | |
| *** jbadiapa has joined #openstack-ansible | 01:31 | |
| *** cmart has quit IRC | 01:33 | |
| *** sdake has joined #openstack-ansible | 01:34 | |
| *** sdake has quit IRC | 01:49 | |
| *** DanyC has quit IRC | 02:08 | |
| *** markvoelker has joined #openstack-ansible | 02:10 | |
| *** markvoelker has quit IRC | 02:14 | |
| cloudnull | jamesdenton broken_one issues with glance + NFS ? | 02:20 |
| cloudnull | something that still needs fixing ? | 02:20 |
| jamesdenton | I saw this come thru: https://review.openstack.org/#/c/634110/ | 02:20 |
| cloudnull | ah i see :) | 02:21 |
| * cloudnull tests locally | 02:21 | |
| jamesdenton | for whatever reason, i am having issues with the remount | 02:21 |
| cloudnull | I use glance w/ nfs | 02:21 |
| *** sdake has joined #openstack-ansible | 02:22 | |
| jamesdenton | i can mount the volume, but when it hits the remount i get permission denied. so i'm not sure if there's something unique to my environment causing that | 02:22 |
| cloudnull | was it failing on the remount | 02:22 |
| cloudnull | ohic | 02:22 |
| jamesdenton | https://pasted.tech/pastes/342ea5b2888f29dee7cf2e39e1827cd2650c0adb | 02:23 |
| * cloudnull running that same command on my glance container | 02:31 | |
| jamesdenton | working OK for you? | 02:32 |
| jamesdenton | i'll admit, i'm a total n00b when it comes to NFS. And i'm working with a Synology device, so not sure how much control i ultimately have | 02:32 |
| *** sdake has quit IRC | 02:33 | |
| cloudnull | https://pasted.tech/pastes/d0d791cb16a92040c1150a74d181b728a744d305 - it worked for me, however maybe there's a difference in config/mount options? | 02:33 |
| jamesdenton | can you run exportfs -v from your nfs server? | 02:34 |
| cloudnull | one sec | 02:35 |
| *** sdake has joined #openstack-ansible | 02:35 | |
| cloudnull | https://pasted.tech/pastes/589075eab21ddc37112711fd75ec2a33a57fe1e9 | 02:36 |
| *** sdake has quit IRC | 02:37 | |
| *** sdake has joined #openstack-ansible | 02:41 | |
| *** sdake has quit IRC | 02:42 | |
| jamesdenton | looks pretty close | 02:43 |
| jamesdenton | i don't have much available in terms of logging, unfortunately. | 02:43 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use the Mitogen connection method in OSA https://review.openstack.org/591236 | 02:43 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use the Mitogen connection method in OSA https://review.openstack.org/591236 | 02:46 |
| *** nurdie has joined #openstack-ansible | 02:46 | |
| *** nurdie_ has quit IRC | 02:50 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use the Mitogen connection method in OSA https://review.openstack.org/591236 | 02:51 |
| *** shyamb has joined #openstack-ansible | 02:52 | |
| cloudnull | jamesdenton if you set the ownership does it work ? | 02:53 |
| cloudnull | like in that pr | 02:53 |
| jamesdenton | the initial mount works OK, and i can actually write to it no problem | 02:53 |
| cloudnull | just the reload isn't working? | 02:53 |
| cloudnull | can you unmount then mount again ? | 02:54 |
| jamesdenton | yes | 02:54 |
| cloudnull | like stop / start | 02:54 |
| jamesdenton | just the remount isn't working | 02:54 |
| cloudnull | can you run the command `systemctl reload-or-restart $(systemd-escape -p --suffix="mount" "/var/lib/glance/images")` | 02:54 |
| cloudnull | and is there anything in the journal that would shed some light on the issue? | 02:55 |
| jamesdenton | > mount.nfs: access denied by server while mounting 192.168.2.5:/volume1/images | 02:55 |
| cloudnull | like `journalctl -f &` then run `systemctl reload-or-restart $(systemd-escape -p --suffix="mount" "/var/lib/glance/images")` | 02:55 |
| cloudnull | how about on the host ? | 02:55 |
| cloudnull | anything in dmesg or messages? | 02:55 |
| cloudnull | maybe this is an lxc apparmor issue ? | 02:56 |
| cloudnull | my environment is running nspawn so that could be the difference ? | 02:56 |
| jamesdenton | i thought maybe, but i saw in lxc-openstack the nfs piece was there | 02:56 |
| jamesdenton | is there anything special regarding uid/gid i need to be aware of? | 02:57 |
| cloudnull | if you have multiple systems writing to the nfs mount you should make sure the uid / gid's are in sync | 02:57 |
| *** sdake has joined #openstack-ansible | 02:58 | |
| jamesdenton | ok. not the case here, but i did make sure to set my glance user uid/gid to match that of the NAS | 02:58 |
| cloudnull | in the export you can set "anonuid=$UID,anongid=$GID" | 02:59 |
| cloudnull | which would force it | 02:59 |
| jamesdenton | that squashes? is that right? | 03:00 |
| cloudnull | if you have "all_squash" | 03:01 |
| jamesdenton | k | 03:01 |
| *** shyamb has quit IRC | 03:10 | |
| cloudnull | jrosser - just got done upgrading my home lab to the head of master using https://review.openstack.org/#/c/591236 - nicely done! | 03:10 |
| *** markvoelker has joined #openstack-ansible | 03:11 | |
| cloudnull | 1 infra, 2 virtual infra, 2 compute, 1 storage, 3 virtual logging - deployed from my workstation running the WSL. | 03:11 |
| cloudnull | what a time to be a alive! | 03:11 |
| cloudnull | jamesdenton that crucial P1 has been awesome btw! | 03:12 |
| jamesdenton | glad to hear! | 03:12 |
| jamesdenton | i like to Go Fast™ | 03:12 |
| cloudnull | ++ | 03:12 |
| cloudnull | ive been hammering it and it's quite the performance boot | 03:12 |
| cloudnull | **boost | 03:13 |
| jamesdenton | that's great | 03:13 |
| jamesdenton | think of the time saved.. | 03:13 |
| jamesdenton | that's how i justify it :D | 03:13 |
| * cloudnull just emulating my idols - you. | 03:13 | |
| jamesdenton | lol | 03:13 |
| jamesdenton | +2 for you | 03:13 |
| *** sdake has quit IRC | 03:17 | |
| *** nurdie has quit IRC | 03:17 | |
| *** nurdie has joined #openstack-ansible | 03:18 | |
| *** sdake has joined #openstack-ansible | 03:18 | |
| *** sdake has quit IRC | 03:19 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Fix the subprocess invocation of neutron-l3-agent https://review.openstack.org/630374 | 03:21 |
| jamesdenton | broken_one ^^^ | 03:21 |
| *** sdake has joined #openstack-ansible | 03:22 | |
| *** nurdie has quit IRC | 03:22 | |
| *** sdake has quit IRC | 03:22 | |
| jamesdenton | cloudnull now there could be something lxc-specific here going on. a mount/remount from the baremetal infra works fine | 03:26 |
| jamesdenton | crap, i must have missed this: Feb 1 03:27:15 infra1 kernel: [133411.553367] audit: type=1400 audit(1548991635.760:579): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-openstack" name="/var/lib/glance/images/" pid=26208 comm="mount.nfs" flags="rw, remount" | 03:27 |
| jamesdenton | so, turns out adding 'mount options=(rw,remount),' to lxc-openstack resolved it | 03:33 |
| broken_one | jamesdenton: nice | 03:33 |
| *** ArchiFleKs has quit IRC | 03:35 | |
| *** gkadam has joined #openstack-ansible | 03:36 | |
| broken_one | so after we get AD integration with keystone working, we think we found a issues with Heat and Tempest in Rocky. | 03:37 |
| broken_one | during the initial deploy for sure | 03:38 |
| broken_one | we have to delete all the ansible facts on the deployer and then run the heat install playbook for it to complete..i have done functional testing after | 03:38 |
| broken_one | will update when we start digging in further | 03:39 |
| cloudnull | jamesdenton ah that makes some sense | 03:42 |
| jamesdenton | profile lxc-openstack flags=(attach_disconnected,mediate_deleted) { | 03:42 |
| jamesdenton | sorry >> https://bugs.launchpad.net/openstack-ansible/+bug/1814200 | 03:43 |
| openstack | Launchpad bug 1814200 in openstack-ansible "Unable to remount NFS volume in Glance container" [Undecided,New] | 03:43 |
| *** ArchiFleKs has joined #openstack-ansible | 03:44 | |
| *** sdake has joined #openstack-ansible | 03:44 | |
| *** markvoelker has quit IRC | 03:44 | |
| *** ArchiFleKs has quit IRC | 03:49 | |
| jamesdenton | cloudnull so this must be tied to the systemd_mount role? Maybe the remount didn't happen in previous versions (prior to Rocky)? | 03:50 |
| *** ArchiFleKs has joined #openstack-ansible | 03:51 | |
| cloudnull | jamesdenton https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/templates/lxc-openstack.apparmor.j2 | 03:51 |
| cloudnull | its being limited there | 03:51 |
| jamesdenton | right, thats where i put it | 03:51 |
| cloudnull | sounds like we just need to put the new directive into the aa profile and we'd be good? | 03:52 |
| jamesdenton | remount was never allowed there, which makes me wonder if that action never happened prior to systemd_mount stuffs | 03:52 |
| jamesdenton | probably, yes? | 03:53 |
| jamesdenton | just not sure if there's more to it than >> mount options=(rw,remount), | 03:53 |
| prometheanfire | nfs is a pain | 03:56 |
| prometheanfire | v4 makes it a little better | 03:56 |
| jamesdenton | seems a little... antiquated.. in its modeling. | 03:57 |
| prometheanfire | ya | 03:57 |
| jamesdenton | been around a long time. makes sense. lol | 03:58 |
| prometheanfire | true, but really it's the best option for simple client/server stuff | 03:58 |
| prometheanfire | though honestly the new windows filesharing has some neat features | 03:59 |
| prometheanfire | supported by samba of course | 03:59 |
| jamesdenton | i'm bowing out. hope to be around tomorrow, though. thanks for the assist, cloudnull | 04:01 |
| jamesdenton | see ya, prometheanfire | 04:01 |
| prometheanfire | nn | 04:01 |
| prometheanfire | gates are finally working again, so I'm on recheck watch | 04:01 |
| cloudnull | later! | 04:01 |
| prometheanfire | cloudnull: you in tomorrow (to share that image)? | 04:02 |
| cloudnull | yup | 04:02 |
| *** udesale has joined #openstack-ansible | 04:02 | |
| prometheanfire | I mean, you could make the image yourself, but I can give it too :P | 04:02 |
| jamesdenton | cloudnull likes to suffer | 04:03 |
| prometheanfire | jamesdenton: but does he want it | 04:03 |
| * cloudnull will drive for gentoo | 04:03 | |
| prometheanfire | lol | 04:03 |
| prometheanfire | let me make a new image with the right systemd | 04:03 |
| prometheanfire | you don't need cloud-init do you? | 04:04 |
| prometheanfire | you mentioned that before but infra doesn't use it (and I don't either) | 04:04 |
| openstackgerrit | Merged openstack/openstack-ansible-nspawn_container_create master: Add path variable for different distros https://review.openstack.org/634282 | 04:07 |
| openstackgerrit | Merged openstack/openstack-ansible-nspawn_hosts master: Add path variable for different distros https://review.openstack.org/634281 | 04:22 |
| *** hwoarang_ has joined #openstack-ansible | 04:24 | |
| *** hwoarang has quit IRC | 04:25 | |
| *** nurdie has joined #openstack-ansible | 04:37 | |
| *** sdake has quit IRC | 04:39 | |
| *** nurdie has quit IRC | 04:39 | |
| *** nurdie has joined #openstack-ansible | 04:40 | |
| *** markvoelker has joined #openstack-ansible | 04:41 | |
| *** nurdie has quit IRC | 04:44 | |
| cloudnull | i dont need cloud-init | 04:45 |
| cloudnull | but it would be nice :) | 04:45 |
| *** spsurya has joined #openstack-ansible | 04:45 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use the Mitogen connection method in OSA https://review.openstack.org/591236 | 04:47 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use the Mitogen connection method in OSA https://review.openstack.org/591236 | 04:49 |
| *** sm806 has quit IRC | 04:56 | |
| *** sm806 has joined #openstack-ansible | 04:56 | |
| *** invincible has quit IRC | 04:58 | |
| *** chandan_kumar has joined #openstack-ansible | 04:59 | |
| *** chandan_kumar is now known as chkumar|ruck | 04:59 | |
| prometheanfire | 2019-02-01 05:01:14.771 | >>> Emerging (18 of 20) sys-apps/systemd-241_rc2::gentoo | 05:03 |
| *** hwoarang_ has quit IRC | 05:07 | |
| *** cmart has joined #openstack-ansible | 05:07 | |
| *** hwoarang has joined #openstack-ansible | 05:13 | |
| *** nurdie has joined #openstack-ansible | 05:14 | |
| *** markvoelker has quit IRC | 05:14 | |
| *** shyamb has joined #openstack-ansible | 05:22 | |
| *** shyamb has quit IRC | 05:24 | |
| *** shyamb has joined #openstack-ansible | 05:24 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Ping router once it is created https://review.openstack.org/633883 | 05:52 |
| *** gyee has quit IRC | 05:54 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Use the Mitogen connection method in OSA https://review.openstack.org/591236 | 05:57 |
| *** macza has joined #openstack-ansible | 05:58 | |
| *** macza has quit IRC | 06:02 | |
| *** markvoelker has joined #openstack-ansible | 06:12 | |
| *** hamzaachi has joined #openstack-ansible | 06:15 | |
| *** ThiagoCMC has quit IRC | 06:15 | |
| *** radeks_ has joined #openstack-ansible | 06:17 | |
| *** radeks_ has quit IRC | 06:20 | |
| *** shyamb has quit IRC | 06:24 | |
| *** DanyC has joined #openstack-ansible | 06:25 | |
| *** DanyC has quit IRC | 06:29 | |
| *** macza has joined #openstack-ansible | 06:39 | |
| *** dave-mccowan has quit IRC | 06:41 | |
| *** markvoelker has quit IRC | 06:44 | |
| *** shyamb has joined #openstack-ansible | 06:57 | |
| *** cmart has quit IRC | 07:15 | |
| *** kopecmartin|off is now known as kopecmartin | 07:18 | |
| *** pcaruana has joined #openstack-ansible | 07:19 | |
| *** hamzaachi has quit IRC | 07:20 | |
| *** DanyC has joined #openstack-ansible | 07:32 | |
| *** fnpanic has joined #openstack-ansible | 07:37 | |
| *** markvoelker has joined #openstack-ansible | 07:41 | |
| *** pbing19 has joined #openstack-ansible | 07:41 | |
| *** macza has quit IRC | 07:44 | |
| *** hamzaachi has joined #openstack-ansible | 07:48 | |
| *** slaweq has joined #openstack-ansible | 08:06 | |
| openstackgerrit | Chandan Kumar proposed openstack/ansible-role-python_venv_build master: Add tripleo-ci-centos-7-standalone-os-tempest job https://review.openstack.org/634377 | 08:08 |
| *** markvoelker has quit IRC | 08:14 | |
| *** DanyC has quit IRC | 08:15 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added tempest.conf for heat_plugin https://review.openstack.org/632021 | 08:24 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_heat master: [DNM] heat tempest tests finding https://review.openstack.org/630694 | 08:25 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_heat master: [DNM] heat tempest tests finding https://review.openstack.org/630694 | 08:26 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_heat master: [DNM] heat tempest tests finding https://review.openstack.org/630694 | 08:30 |
| *** tosky has joined #openstack-ansible | 08:36 | |
| openstackgerrit | Martin Kopec proposed openstack/openstack-ansible-os_tempest master: Improve overview subpage https://review.openstack.org/633934 | 08:41 |
| *** shyamb has quit IRC | 08:47 | |
| *** shyamb has joined #openstack-ansible | 08:48 | |
| *** mkuf_ has quit IRC | 08:48 | |
| *** hamzaachi has quit IRC | 08:55 | |
| *** shyamb has quit IRC | 09:10 | |
| *** shyamb has joined #openstack-ansible | 09:11 | |
| *** markvoelker has joined #openstack-ansible | 09:12 | |
| *** DanyC has joined #openstack-ansible | 09:12 | |
| *** mkuf_ has joined #openstack-ansible | 09:17 | |
| *** DanyC has quit IRC | 09:17 | |
| *** nurdie has quit IRC | 09:20 | |
| *** nurdie has joined #openstack-ansible | 09:20 | |
| *** DanyC has joined #openstack-ansible | 09:22 | |
| *** nurdie has quit IRC | 09:24 | |
| *** sdake has joined #openstack-ansible | 09:27 | |
| *** pcaruana has quit IRC | 09:30 | |
| *** shyamb has quit IRC | 09:31 | |
| *** rgogunskiy has quit IRC | 09:32 | |
| *** hamzaachi has joined #openstack-ansible | 09:33 | |
| *** pcaruana has joined #openstack-ansible | 09:42 | |
| *** shyamb has joined #openstack-ansible | 09:44 | |
| *** markvoelker has quit IRC | 09:44 | |
| *** aedc has joined #openstack-ansible | 09:46 | |
| *** mkuf_ has quit IRC | 09:48 | |
| *** aedc has quit IRC | 09:53 | |
| *** hamzaachi has quit IRC | 09:55 | |
| *** mkuf_ has joined #openstack-ansible | 09:58 | |
| *** gillesMo has joined #openstack-ansible | 10:18 | |
| *** shyamb has quit IRC | 10:18 | |
| *** shyamb has joined #openstack-ansible | 10:19 | |
| gillesMo | Hello ! Anyone is using VPNaaS on Queens ? I see the release note saying it's moving from a vpn_agent to l3_agent, but can't find a precise doc on how to configure it (official doc is configuraing a vpn_agent that is not existing anymore : a bug is filled N°1751069 | 10:19 |
| *** hamzaachi has joined #openstack-ansible | 10:27 | |
| *** electrofelix has joined #openstack-ansible | 10:38 | |
| *** markvoelker has joined #openstack-ansible | 10:42 | |
| *** sdake has quit IRC | 10:51 | |
| *** sdake has joined #openstack-ansible | 10:51 | |
| chkumar|ruck | odyssey4me: jrosser please have a look at these two patches https://review.openstack.org/633931 and https://review.openstack.org/634377 | 11:05 |
| *** shyamb has quit IRC | 11:10 | |
| *** markvoelker has quit IRC | 11:15 | |
| *** udesale has quit IRC | 11:23 | |
| *** hamzaachi has quit IRC | 11:45 | |
| *** shyamb has joined #openstack-ansible | 11:48 | |
| *** pcaruana has quit IRC | 12:05 | |
| *** markvoelker has joined #openstack-ansible | 12:11 | |
| *** pcaruana has joined #openstack-ansible | 12:19 | |
| *** pcaruana|afk| has joined #openstack-ansible | 12:25 | |
| *** pcaruana has quit IRC | 12:26 | |
| *** pcaruana|afk| is now known as pcaruana | 12:27 | |
| jamesdenton | gillesMo I don't know the state of VPNaaS in OSA at the moment. It used to be that with VPNaaS, a modified neutron-l3-agent was run that included the VPN bits, but that has been consolidated AFAIK. The guide here calls out VPNaaS config with OSA: https://docs.openstack.org/openstack-ansible-os_neutron/queens/configure-network-services.html#virtual-private-network-service-optional | 12:40 |
| jamesdenton | Good luck | 12:40 |
| *** markvoelker has quit IRC | 12:45 | |
| *** gkadam has quit IRC | 12:52 | |
| *** shardy has joined #openstack-ansible | 12:53 | |
| *** sdake has quit IRC | 12:55 | |
| *** aedc has joined #openstack-ansible | 13:03 | |
| *** pbing19 has quit IRC | 13:04 | |
| gillesMo | jamesdenton: Thanks, that'what I read, but it doesn't seems to work. And there is no integration in Horizon. I saw in the latest os_horizon role doc a variable addition : horizon_enable_neutron_vpnaas, not present in Queens and Rocky releases | 13:07 |
| jamesdenton | k | 13:07 |
| jamesdenton | When it doesn't work, do you mean VPN-related API calls don't work? | 13:08 |
| jamesdenton | where do things break down? | 13:08 |
| *** strattao has joined #openstack-ansible | 13:13 | |
| *** pcaruana has quit IRC | 13:13 | |
| noonedeadpunk | hi folks, | 13:15 |
| noonedeadpunk | can you please check this patch https://review.openstack.org/#/c/630747/ ? | 13:16 |
| *** pcaruana has joined #openstack-ansible | 13:20 | |
| *** shyamb has quit IRC | 13:25 | |
| *** hamzaachi has joined #openstack-ansible | 13:33 | |
| *** dave-mccowan has joined #openstack-ansible | 13:34 | |
| gillesMo | jamesdenton: I don't master theses VPN things, so I would have tried with Horizon. Perhaps API calls are working. At least "openstack vpn service list" respond nothing, but without error. Is that means all is working except Horison dashboard integration ? | 13:38 |
| *** sdake has joined #openstack-ansible | 13:41 | |
| jamesdenton | it's possible, yes. You can plumb it by hand if you'd like to try. Inside the Horizon containers, there is a file at /etc/horizon/local_settings.py that needs to be modified. You can see 'enable_vpn' in the OPENSTACK_NEUTRON_NETWORK block. Set from False to True and restart apache2 | 13:41 |
| *** markvoelker has joined #openstack-ansible | 13:42 | |
| jamesdenton | But, it's also possible that some other bits aren't installed, like neutron-vpnaas-dashboard, that would mean the panels aren't there | 13:43 |
| mnaser | morning friends | 13:43 |
| jamesdenton | hi mnaser | 13:43 |
| mnaser | hey jamesdenton -- how's it goin | 13:43 |
| mnaser | man y'all are all getting the cool labs | 13:44 |
| mnaser | i'm getting a little fomo | 13:44 |
| jamesdenton | is that what the kids are saying these days? lol | 13:44 |
| jamesdenton | homelabs, homie | 13:44 |
| * mnaser goes into dc and pulls server out | 13:44 | |
| jamesdenton | gillesMo I would probably say for Queens, there would be no support horizon integration if it's not already there | 13:45 |
| *** hamzaachi has quit IRC | 13:46 | |
| *** hamzaachi has joined #openstack-ansible | 13:46 | |
| gillesMo | jamesdenton: I plan to migrate soon to Rocky. But I don't see real noews in the corresponding code between Queens and Rocky, at least in the openstack-ansible os_horizon role | 13:47 |
| jamesdenton | mnaser have you seen a retry_limit in the gate for jobs? Can you check zuul 634110 | 13:47 |
| mnaser | lemme see jamesdenton | 13:47 |
| mnaser | oh interesting | 13:48 |
| jamesdenton | gillesMo it's true that the vpnaas dashboard doesn't exist in OSA Rocky, too | 13:48 |
| mnaser | might be an infra issue | 13:48 |
| mnaser | nothing in here https://wiki.openstack.org/wiki/Infrastructure_Status | 13:48 |
| mnaser | jamesdenton: is it happening on the recheck too? | 13:48 |
| jamesdenton | This particular job has silently failed a couple of times since yesterday. -1 but no status. | 13:49 |
| jamesdenton | yes | 13:49 |
| jamesdenton | hmm | 13:49 |
| jamesdenton | http://paste.openstack.org/show/744391/ - Line 12 | 13:50 |
| mnaser | oh hm | 13:58 |
| jamesdenton | glance_nfs_client by default is an empty list | 13:58 |
| mnaser | that feels like a bug in zuul | 13:58 |
| jamesdenton | guessing it doesn't like that? i dunno | 13:58 |
| mnaser | jamesdenton: taking this to #openstack-infra | 13:59 |
| jamesdenton | kk | 13:59 |
| *** hamzaachi has quit IRC | 14:06 | |
| *** hamzaachi has joined #openstack-ansible | 14:06 | |
| *** sdake has quit IRC | 14:06 | |
| *** hamzaachi has quit IRC | 14:08 | |
| *** hamzaachi has joined #openstack-ansible | 14:09 | |
| *** hamzaachi has quit IRC | 14:10 | |
| *** hamzaachi has joined #openstack-ansible | 14:10 | |
| *** hamzaachi has quit IRC | 14:11 | |
| *** hamzaachi has joined #openstack-ansible | 14:11 | |
| *** hamzaachi has quit IRC | 14:13 | |
| *** hamzaachi has joined #openstack-ansible | 14:13 | |
| *** markvoelker has quit IRC | 14:14 | |
| *** aedc has quit IRC | 14:17 | |
| *** sdake has joined #openstack-ansible | 14:17 | |
| *** aedc has joined #openstack-ansible | 14:17 | |
| openstackgerrit | James Denton proposed openstack/openstack-ansible-os_glance master: Fix Glance NFS mount point ownership https://review.openstack.org/634110 | 14:19 |
| *** stuartgr has quit IRC | 14:20 | |
| *** stuartgr has joined #openstack-ansible | 14:24 | |
| mattheca | distance selling rights | 14:33 |
| *** gillesMo has quit IRC | 14:40 | |
| *** jwitko__ has joined #openstack-ansible | 14:44 | |
| *** cmart has joined #openstack-ansible | 14:46 | |
| *** jwitko_ has quit IRC | 14:48 | |
| *** markvoelker has joined #openstack-ansible | 15:11 | |
| jamesdenton | mnaser turns out the jinja in the commit message was causing zuul to bail | 15:16 |
| openstackgerrit | Dmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Cleanup files and templates using smart sources https://review.openstack.org/634431 | 15:17 |
| *** DanyC has quit IRC | 15:19 | |
| *** DanyC has joined #openstack-ansible | 15:19 | |
| mnaser | jamesdenton: ~ the more you know ~ | 15:31 |
| mnaser | thanks for following up on the rest of that convo | 15:31 |
| *** nurdie has joined #openstack-ansible | 15:32 | |
| jamesdenton | sure thing | 15:32 |
| jamesdenton | jobs passed, just needs reviews | 15:33 |
| *** nurdie has quit IRC | 15:37 | |
| jamesdenton | On the topic of Glance, have you seen this issue in any of your recent builds? https://bugs.launchpad.net/openstack-ansible/+bug/1814127 | 15:37 |
| openstack | Launchpad bug 1814127 in openstack-ansible "Jinja formatting issues in glance-api.conf" [Undecided,New] | 15:37 |
| *** nurdie has joined #openstack-ansible | 15:39 | |
| mnaser | i wonder how that isnt caught in ci? | 15:42 |
| *** markvoelker has quit IRC | 15:44 | |
| jamesdenton | not sure | 15:45 |
| jamesdenton | You can see it in the logs here, too: http://logs.openstack.org/10/634110/2/check/openstack-ansible-functional-ubuntu-bionic/0466f98/logs/openstack/openstack1/glance/glance-api.log.txt.gz | 15:48 |
| *** pbing19 has joined #openstack-ansible | 15:48 | |
| jamesdenton | But it must not have an immediate impact | 15:48 |
| *** hamzaachi has quit IRC | 15:50 | |
| *** hamzaachi has joined #openstack-ansible | 15:50 | |
| *** hamzaachi has quit IRC | 15:52 | |
| *** hamzaachi has joined #openstack-ansible | 15:52 | |
| cloudnull | mornings | 15:53 |
| jamesdenton | howdy | 15:53 |
| nowster | jamesdenton: I solved the IP routing problem. For v6 it's useful to have a site-local network for internal routing, then the instances can use global networks transparently. | 15:55 |
| nowster | whereas for v4 your floating IPs are on the outside. | 15:56 |
| nowster | and then there's allowing route advertisements from the "internal" networks to reach the kernel on the router node | 15:58 |
| *** pcaruana has quit IRC | 15:59 | |
| nowster | In other news, OpenVSwitch doesn't like it when it can't talk to neutron because the IP addresses are mismatched elsewhere. | 15:59 |
| nowster | ones network turns into a notwork | 15:59 |
| *** hamzaachi has quit IRC | 16:01 | |
| *** hamzaachi has joined #openstack-ansible | 16:01 | |
| *** pbing19 has quit IRC | 16:07 | |
| *** hamzaachi has quit IRC | 16:13 | |
| *** hamzaachi has joined #openstack-ansible | 16:13 | |
| *** hamzaachi has quit IRC | 16:17 | |
| *** hamzaachi has joined #openstack-ansible | 16:17 | |
| *** hamzaachi has quit IRC | 16:18 | |
| *** hamzaachi has joined #openstack-ansible | 16:18 | |
| *** hamzaachi has quit IRC | 16:20 | |
| *** hamzaachi has joined #openstack-ansible | 16:20 | |
| *** hamzaachi has quit IRC | 16:21 | |
| *** hamzaachi has joined #openstack-ansible | 16:21 | |
| jamesdenton | nowster any docs you have on that would be good, if you don't mind. If you think it would be useful | 16:27 |
| nowster | jamesdenton: I'm going to try to write it up somewhere | 16:29 |
| nowster | also calling the "flat" network something other than "flat" is helpful for demystifying things | 16:30 |
| *** sdake has quit IRC | 16:32 | |
| *** macza has joined #openstack-ansible | 16:34 | |
| *** kopecmartin is now known as kopecmartin|off | 16:37 | |
| *** sdake has joined #openstack-ansible | 16:39 | |
| *** markvoelker has joined #openstack-ansible | 16:41 | |
| mnaser | jrosser: what's up with the work on the mitogen patch, i see its failing with some odd base64 error | 16:52 |
| jrosser | mnaser: i've taken out my hacks - seems dw is doing a lot of work on mitogen now so it's time to fix it once and for all - see this https://github.com/dw/mitogen/issues/510 | 16:52 |
| *** pbing19 has joined #openstack-ansible | 16:52 | |
| mnaser | oh sweet | 16:53 |
| mnaser | i'm trying to figure out nspawn for once and for all.. | 16:53 |
| CeeMac | hi, anyone around able to help with a console issue (rocky on bionic using spice proxy)? | 16:59 |
| openstackgerrit | Dmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Cleanup files and templates using smart sources https://review.openstack.org/634431 | 17:11 |
| guilhermesp | does anyone has noticed these metal jobs failing https://review.openstack.org/#/c/634032/ ? | 17:11 |
| *** markvoelker has quit IRC | 17:15 | |
| noonedeadpunk | CeeMac: just my small recomendation to use vnc instead of SPICE. | 17:16 |
| CeeMac | noonedeadpunk, you've had issues with spice? or just personal pref? | 17:16 |
| CeeMac | OSA configures spice by default ( i think?) | 17:17 |
| noonedeadpunk | CeeMac: I had issues with graphic speed on Windows machines and there no default ctrl+alt+del on spice - I had to inject int manually. | 17:17 |
| CeeMac | oh,yeah, i wouldn't want that either | 17:18 |
| noonedeadpunk | Yep, it's default in OSA, you you're not required to use it, and it's pretty simple to switch to novnc | 17:18 |
| CeeMac | you have any config snips you can share? | 17:18 |
| CeeMac | and is there a user_variable override for that? | 17:19 |
| noonedeadpunk | Yep, sure there's a variable - just set nova_console_type: novnc in user_variables.yml | 17:19 |
| noonedeadpunk | and launch os-nova-install.yml after that | 17:20 |
| CeeMac | noonedeadpunk, sweet, thanks I'll give that a go | 17:22 |
| *** cmart has quit IRC | 17:22 | |
| noonedeadpunk | and if you wish to stay with SPICE - here's kinda patch for ctrl+alt+del button http://paste.openstack.org/show/744412/ | 17:22 |
| *** pitchOli has joined #openstack-ansible | 17:23 | |
| CeeMac | I'll keep the URL, I'll need to get spice working first before worrying about ctrl-alt-del | 17:23 |
| CeeMac | how are you finding Windows on OS in general? | 17:23 |
| noonedeadpunk | it's ok, but I'm running not on hyperv, but inside KVM. The only problem, that you have to built virtio drivers inside iso image before installation (and even for templating) | 17:25 |
| noonedeadpunk | or you'll have to disable virtio fully for computing node. as far as I know it's not possible to accomplish this per-vm basis | 17:26 |
| CeeMac | yeah, i'm testing with the cloudbase.it cloud-init windows 2012R2 image currently, will visit image/template building once the platform is working | 17:27 |
| CeeMac | KVM backend also | 17:27 |
| noonedeadpunk | yeah, cloudbase works well on 2016 as well - but you'll have to build an image. | 17:27 |
| noonedeadpunk | And it also support nova get-password | 17:28 |
| CeeMac | good to know | 17:28 |
| CeeMac | had a few issues getting this far, finally managed to launch an instance, would be good to be able to console to it to test/configure network for internet access etc | 17:29 |
| *** DanyC has quit IRC | 17:39 | |
| CeeMac | noonedeadpunk, I got me a console :D thanks for the tip! | 17:50 |
| CeeMac | just need to work out why the instance didn't pick up its DHCP address from the port, thats a monday job though | 17:51 |
| mnaser | cloudnull: is the mv-container meant to be the equiv of br-mgmt ? | 17:57 |
| *** pitchOli has quit IRC | 18:01 | |
| *** DanyC has joined #openstack-ansible | 18:02 | |
| openstackgerrit | Dmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Cleanup files and templates using smart sources https://review.openstack.org/634431 | 18:05 |
| *** DanyC has quit IRC | 18:06 | |
| *** sdake has quit IRC | 18:08 | |
| *** hamzaachi has quit IRC | 18:09 | |
| *** hamzaachi has joined #openstack-ansible | 18:09 | |
| *** sdake has joined #openstack-ansible | 18:10 | |
| *** markvoelker has joined #openstack-ansible | 18:11 | |
| nsmeds | has guys, we're on the last step of https://docs.openstack.org/openstack-ansible/rocky/admin/upgrades/major-upgrades.html | 18:13 |
| nsmeds | has anyone run into ``Error attempting to run volume_service_uuids_online_data_migration` while running setup-openstack.yml ? | 18:13 |
| *** cmart has joined #openstack-ansible | 18:13 | |
| nsmeds | it occurs for `Perform online database migrations` in `os-cinder-install.yml` | 18:14 |
| *** electrofelix has quit IRC | 18:14 | |
| cloudnull | mnaser yes those are similar | 18:14 |
| mnaser | Ok cool, I’m iterating aio nspawn and just caught something | 18:14 |
| *** hamzaachi has quit IRC | 18:14 | |
| mnaser | We’re not setting an IP in container extra networks so it can’t reach containers (for mv-container) | 18:14 |
| mnaser | Seems like it got past it.. so onto the next | 18:14 |
| *** gyee has joined #openstack-ansible | 18:15 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible master: nspawn: add container_network config https://review.openstack.org/634466 | 18:19 |
| mnaser | cloudnull: ^ fyi | 18:19 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Use the Mitogen connection method in OSA https://review.openstack.org/591236 | 18:20 |
| cloudnull | mnaser awesome! | 18:21 |
| * cloudnull relocating back home but will be back online in just a few if you need help or want to work on nspawn :) | 18:21 | |
| mnaser | cloudnull: awesome. i really want to get this going as the release cycle is coming closer and closer to end and we've got a bunch of things ahead of us | 18:22 |
| mnaser | esp if we want to hit the goals we discussed at https://etherpad.openstack.org/p/osa-stein-ptg | 18:22 |
| mnaser | one of the goals was -- Stein: Remove nspawn experimental 'status' + remove LXC from deploy guide | 18:23 |
| mnaser | cloudnull: for when you relocate, do you know if we can move towards more application containers with nspawn, further stripping down our containers to eliminate a base the concept of a base os? | 18:27 |
| mnaser | i'm increasingly concerned at the volume of things that need to be managed when you have 3 controllers x 15 containers = possibly 45 'systems' to kee updated | 18:27 |
| noonedeadpunk | CeeMac that's great! Hope you'll get it working:) | 18:33 |
| *** fdegir has quit IRC | 18:38 | |
| *** fdegir has joined #openstack-ansible | 18:39 | |
| *** sdake has quit IRC | 18:39 | |
| *** sdake has joined #openstack-ansible | 18:40 | |
| *** hamzaachi has joined #openstack-ansible | 18:42 | |
| *** markvoelker has quit IRC | 18:45 | |
| *** aedc has quit IRC | 19:07 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Only init a workspace if doesn't exists https://review.openstack.org/633549 | 19:26 |
| *** sdake has quit IRC | 19:28 | |
| *** sdake has joined #openstack-ansible | 19:29 | |
| *** sdake has quit IRC | 19:31 | |
| openstackgerrit | Martin Kopec proposed openstack/openstack-ansible-os_tempest master: Improve overview subpage https://review.openstack.org/633934 | 19:34 |
| *** markvoelker has joined #openstack-ansible | 19:42 | |
| openstackgerrit | Jacob Wagner proposed openstack/openstack-ansible-ops master: Add ability to deploy Designate (DNSaaS) https://review.openstack.org/633801 | 19:42 |
| openstackgerrit | Jacob Wagner proposed openstack/openstack-ansible-ops master: Add ability to deploy Designate (DNSaaS) https://review.openstack.org/633801 | 19:43 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible master: nspawn: fix restart-service.yml service list filtering https://review.openstack.org/634485 | 19:58 |
| *** hamzaachi has quit IRC | 19:59 | |
| *** hamzaachi has joined #openstack-ansible | 20:00 | |
| *** ArchiFleKs has quit IRC | 20:03 | |
| *** DanyC has joined #openstack-ansible | 20:14 | |
| *** markvoelker has quit IRC | 20:15 | |
| *** ArchiFleKs has joined #openstack-ansible | 20:21 | |
| *** hamzaachi has quit IRC | 20:23 | |
| *** hamzaachi has joined #openstack-ansible | 20:24 | |
| *** hamzaachi has quit IRC | 20:25 | |
| *** hamzaachi has joined #openstack-ansible | 20:25 | |
| *** DanyC has quit IRC | 20:27 | |
| *** ArchiFleKs has quit IRC | 20:27 | |
| *** ArchiFleKs has joined #openstack-ansible | 20:29 | |
| *** rholloway has joined #openstack-ansible | 20:30 | |
| *** sdake has joined #openstack-ansible | 20:41 | |
| *** strattao has quit IRC | 20:45 | |
| mnaser | cloudnull (maybe jrosser?): in your nspawn deployment, do you have a bridge for your flat/public network? | 21:00 |
| *** hamzaachi has quit IRC | 21:00 | |
| mnaser | the problem right now is that we are defaulting to 'eth0' which means neutron-linuxbridge-agent tries to build a bridge using eth0 and kill internet connectivity | 21:01 |
| *** hamzaachi has joined #openstack-ansible | 21:01 | |
| mnaser | i.e. what is the equiv of br-vlan from the usual aio | 21:01 |
| *** hamzaachi has quit IRC | 21:02 | |
| *** hamzaachi has joined #openstack-ansible | 21:02 | |
| *** sdake has quit IRC | 21:03 | |
| *** hamzaachi has quit IRC | 21:03 | |
| *** hamzaachi has joined #openstack-ansible | 21:04 | |
| cloudnull | mnaser this is the network config I used on my hosts | 21:08 |
| cloudnull | https://gist.github.com/cloudnull/f4d2dc796fa72871134ab88b2aeac0ae | 21:08 |
| cloudnull | and the active devices | 21:09 |
| cloudnull | https://pasted.tech/pastes/df2868a7b5a631476cccd5cf8a0a1993cd1ef992 | 21:09 |
| mnaser | cloudnull: mind a brctl show ? | 21:09 |
| jrosser | mnaser: i a soooooo far from considering an nspawn deployment :/ | 21:10 |
| jrosser | i am... | 21:10 |
| mnaser | jrosser: ah i thought you were dabbling with it, i'm just trying to get it to work right now, i think im so close | 21:10 |
| mnaser | i believe `brq080e971c-60` is the interface that neutron-linuxbridge-agent created and i'm guessing its probably tied to bond0.13 or bond0.14 (which have no ips) | 21:11 |
| mnaser | we don't have an interface that we use to simulate br-vlan in nspawn deployment, so neutron bridges eth0 and kills the vm | 21:11 |
| cloudnull | mnaser this is my actual config https://gist.github.com/cloudnull/eab22ba500843343470a7fd1e3f55d1c | 21:11 |
| *** markvoelker has joined #openstack-ansible | 21:11 | |
| cloudnull | mnaser https://pasted.tech/pastes/97e8bcfa7bb92c05f14da117666e5bab92337fbf | 21:12 |
| mnaser | ok yeah, so you dont care if bond0.10 has no ips because you dont run anything on it | 21:12 |
| mnaser | in aio, neutron adds eth0 to the bridge and kills the connectivity | 21:12 |
| mnaser | with nspawn that is | 21:12 |
| mnaser | with lxc it just uses the existing br-vlan we wire | 21:12 |
| mnaser | so i'm thinking we need a systemd-networkd task to create some arbitrary interface that it can bridge on | 21:13 |
| mnaser | that way it doesn't destroy ips | 21:13 |
| cloudnull | hum. we could set neutron to use mv-vlan ? | 21:13 |
| jrosser | is this eth12 in the "old world"? | 21:13 |
| mnaser | im not sure, not going to lie, i dont build aio's often | 21:14 |
| cloudnull | kinda | 21:14 |
| mnaser | cloudnull: i mean, if it works, why not i guess, can you bridge a macvlan into a bridge? | 21:14 |
| cloudnull | yes you can | 21:14 |
| mnaser | ok, so the ideal solution is that we can add host_bind_override or whatever to mv-vlan | 21:15 |
| mnaser | and that.. should fix it | 21:15 |
| mnaser | i believe | 21:15 |
| mnaser | does that make sense? | 21:15 |
| mnaser | `host_bind_override: "eth12"` in the lxc config | 21:15 |
| mnaser | so that would be a yes jrosser | 21:16 |
| mnaser | ok, so ill update the nspawn config to have `host_bind_override: "mv-flat"` | 21:16 |
| jrosser | in the lxc world that is eth12 -> veth -> br-vlan | 21:16 |
| mnaser | now mv-flat will just be sucked up by n-lxb-agent and it'll create a bridge and attach it to it | 21:17 |
| mnaser | hopefully | 21:17 |
| cloudnull | https://pasted.tech/pastes/d0049aa77d29d5ac5ebd6e3256d8cd0f4ebdeeb2 - just making sure | 21:17 |
| mnaser | sweet | 21:18 |
| mnaser | btw, on things to fix... | 21:18 |
| mnaser | we don't set enabled: true on the containers | 21:18 |
| mnaser | or whatever... all containers are down on a reboot | 21:19 |
| *** sdake has joined #openstack-ansible | 21:22 | |
| *** slaweq has quit IRC | 21:28 | |
| cloudnull | mnaser i wonder if that's an artifact of the systemd-service config? | 21:30 |
| *** hamzaachi has quit IRC | 21:30 | |
| mnaser | cloudnull: maybe.. i dont know yet, so far i got https://review.openstack.org/#/c/634466/ and https://review.openstack.org/#/c/634485/1 | 21:31 |
| mnaser | the second one is interesting | 21:31 |
| mnaser | lol | 21:31 |
| cloudnull | if you run `systemd enable systemd-nspawn@$(systemd-escape ${CONTAINER_NAME})` does it worl? | 21:31 |
| *** hamzaachi has joined #openstack-ansible | 21:31 | |
| mnaser | cloudnull: i reran the playbooks and it worked so i guess yeah | 21:33 |
| cloudnull | ok. | 21:34 |
| cloudnull | ive seen race conditions locally with nspawn container starts, however, i've not chased it down. | 21:35 |
| cloudnull | so that could be related | 21:35 |
| mnaser | cloudnull: ok, just restarted again (because the router got created again and it killed me) | 21:35 |
| mnaser | i dont see any mv ports | 21:35 |
| mnaser | yeah, none of the ports are there | 21:37 |
| mnaser | even when i do a systemctl start systemd-networkd | 21:37 |
| mnaser | they're not going up | 21:37 |
| cloudnull | this is on restart ? | 21:38 |
| mnaser | yeah | 21:38 |
| mnaser | i added https://github.com/cloudnull.keys to the machien im working on .. centos@199.204.45.115 | 21:38 |
| cloudnull | `systemctl start nspawn-macvlan.service` | 21:38 |
| * cloudnull logging in | 21:39 | |
| mnaser | ok | 21:39 |
| mnaser | that did it | 21:39 |
| mnaser | Feb 01 21:33:59 aio1 systemd[1]: Job nspawn-macvlan.service/start deleted to break ordering cycle starting with systemd-networkd.service/start | 21:39 |
| cloudnull | > centos@199.204.45.115: Permission denied (publickey). | 21:40 |
| mnaser | that can explain why the containers might have not gone up | 21:40 |
| mnaser | ah damn | 21:40 |
| mnaser | i added them to root | 21:40 |
| mnaser | just login as root i guess, its a temp test machine | 21:40 |
| cloudnull | in | 21:40 |
| mnaser | so that's the error that caused systemd-networkd not to go up | 21:41 |
| mnaser | err i mean nspawn-macvlan | 21:41 |
| mnaser | and that MIGHT be why the containers are also not going up? cause it depends on it | 21:41 |
| cloudnull | `for i in $(machinectl list-images | grep "$(hostname -s)" | awk '{print $1}'); do systemctl start systemd-nspawn@$(systemd-escape $i); done` - looks like the containers are starting now | 21:41 |
| *** pbing19 has quit IRC | 21:43 | |
| mnaser | im not sure why it didnt go up in the first place | 21:43 |
| mnaser | maybe it had to do with that ordering cycle | 21:43 |
| cloudnull | ++ likely | 21:44 |
| *** markvoelker has quit IRC | 21:45 | |
| cloudnull | and they're able to get out over the gateway | 21:46 |
| cloudnull | so it looks like it might be happy ? | 21:46 |
| mnaser | cloudnull: the bridge just went up and it didn't die yet, ill rerun tempest and see what happens | 21:46 |
| mnaser | haproxy had to be brought up cause i guess it couldnt list things | 21:47 |
| mnaser | Aborted connection 88 to db: 'nova_api' user: 'nova_api' host: 'aio1.openstack.local' (Got an error reading communication packets) | 21:49 |
| mnaser | weird | 21:49 |
| mnaser | there we go | 21:50 |
| *** cmart has quit IRC | 22:07 | |
| *** nurdie has quit IRC | 22:12 | |
| *** nurdie has joined #openstack-ansible | 22:13 | |
| *** nurdie has quit IRC | 22:17 | |
| cloudnull | was afk, sorry, mnaser did you make it go? | 22:20 |
| *** cmart has joined #openstack-ansible | 22:23 | |
| *** hamzaachi has quit IRC | 22:26 | |
| *** hamzaachi has joined #openstack-ansible | 22:27 | |
| *** hamzaachi has quit IRC | 22:28 | |
| *** hamzaachi has joined #openstack-ansible | 22:28 | |
| *** hamzaachi has quit IRC | 22:29 | |
| mnaser | cloudnull: failed randomly at rabbitmq needed to get a rekick, watching tempest now seeing if it hands or not | 22:29 |
| mnaser | s/hands/hangs/ | 22:30 |
| mnaser | and if it passes or not more importantly | 22:30 |
| *** hamzaachi has joined #openstack-ansible | 22:30 | |
| *** jwitko__ has quit IRC | 22:31 | |
| *** hamzaachi has quit IRC | 22:31 | |
| *** hamzaachi has joined #openstack-ansible | 22:32 | |
| *** hamzaachi has quit IRC | 22:33 | |
| *** hamzaachi has joined #openstack-ansible | 22:34 | |
| *** sep has quit IRC | 22:38 | |
| *** sep has joined #openstack-ansible | 22:38 | |
| *** dave-mccowan has quit IRC | 22:40 | |
| *** KeithMnemonic has quit IRC | 22:40 | |
| *** markvoelker has joined #openstack-ansible | 22:42 | |
| *** cmart has quit IRC | 22:42 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible master: nspawn: use mv-flat for host_bind_overrides https://review.openstack.org/634506 | 22:52 |
| *** cmart has joined #openstack-ansible | 22:54 | |
| *** DanyC has joined #openstack-ansible | 23:12 | |
| *** markvoelker has quit IRC | 23:14 | |
| *** nurdie has joined #openstack-ansible | 23:15 | |
| *** nurdie has quit IRC | 23:20 | |
| openstackgerrit | Merged openstack/openstack-ansible master: nspawn: add container_network config https://review.openstack.org/634466 | 23:33 |
| *** macza has quit IRC | 23:43 | |
| *** hamzaachi has quit IRC | 23:51 | |
| *** hamzaachi has joined #openstack-ansible | 23:52 | |
| *** errr has joined #openstack-ansible | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!