*** rromans is now known as rromans_pto | 00:00 | |
*** darrenc_ has joined #openstack-ansible | 00:00 | |
*** vnogin has joined #openstack-ansible | 00:01 | |
*** javeriak has joined #openstack-ansible | 00:01 | |
*** vnogin has quit IRC | 00:01 | |
*** schwicht has joined #openstack-ansible | 00:05 | |
*** weezS has quit IRC | 00:05 | |
*** jamielennox|away is now known as jamielennox | 00:08 | |
*** darrenc_ has quit IRC | 00:12 | |
*** smatzek__ has quit IRC | 00:14 | |
*** askb has joined #openstack-ansible | 00:14 | |
*** darrenc_ has joined #openstack-ansible | 00:15 | |
*** schwicht has quit IRC | 00:15 | |
*** dxiri has quit IRC | 00:15 | |
*** hw_wutianwei has joined #openstack-ansible | 00:20 | |
*** galstrom_zzz is now known as galstrom | 00:21 | |
*** schwicht has joined #openstack-ansible | 00:24 | |
*** ggillies has quit IRC | 00:25 | |
*** ggillies has joined #openstack-ansible | 00:25 | |
*** dxiri has joined #openstack-ansible | 00:26 | |
*** schwicht has quit IRC | 00:28 | |
*** adrian_otto has joined #openstack-ansible | 00:29 | |
*** pmannidi has quit IRC | 00:29 | |
*** Guest12949 is now known as ioni | 00:30 | |
*** ioni is now known as Guest38923 | 00:31 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added Cinder storage pools data https://review.openstack.org/408863 | 00:33 |
---|---|---|
*** dxiri has quit IRC | 00:36 | |
*** maeker has quit IRC | 00:37 | |
*** adrian_otto has quit IRC | 00:37 | |
*** pmannidi has joined #openstack-ansible | 00:38 | |
*** maeker has joined #openstack-ansible | 00:38 | |
*** whiteveil has quit IRC | 00:41 | |
*** adrian_otto has joined #openstack-ansible | 00:41 | |
*** darrenc_ has quit IRC | 00:46 | |
deadnull | cloudnull logan- thx for the suggestions earlier - using user_variables instead has the same result as before - /etc/cinder/cinder.conf for cinder-volume writes "shares=[{u'ip': u'nfs.server.ip', u'share': u'/data/cinder'}]" and doesnt create nfs_shares file | 00:49 |
*** galstrom is now known as galstrom_zzz | 00:50 | |
*** darrenc_ has joined #openstack-ansible | 00:52 | |
*** dxiri has joined #openstack-ansible | 00:53 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added interface speed plugin to telegraf https://review.openstack.org/408868 | 00:56 |
*** dxiri has quit IRC | 00:57 | |
*** woodard has quit IRC | 00:57 | |
*** woodard has joined #openstack-ansible | 00:58 | |
cloudnull | sorry deadnull, just a sec | 00:58 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added interface speed plugin to telegraf https://review.openstack.org/408868 | 00:58 |
deadnull | no rush at all man | 00:58 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added Cinder storage pools data https://review.openstack.org/408863 | 01:00 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added kvm_virsh to telegraf plugins https://review.openstack.org/408844 | 01:01 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added interface speed plugin to telegraf https://review.openstack.org/408868 | 01:02 |
*** jamielennox is now known as jamielennox|away | 01:04 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added kapacitor scripts https://review.openstack.org/379138 | 01:08 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added kvm_virsh to telegraf plugins https://review.openstack.org/408844 | 01:11 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added nova quota plugin https://review.openstack.org/408839 | 01:11 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Add ironic to the metric collection plugins https://review.openstack.org/405061 | 01:11 |
*** chris_hultin|AWA is now known as chris_hultin | 01:12 | |
*** adrian_otto has quit IRC | 01:15 | |
*** chris_hultin is now known as chris_hultin|AWA | 01:18 | |
*** weezS has joined #openstack-ansible | 01:19 | |
*** jamielennox|away is now known as jamielennox | 01:20 | |
*** weezS has quit IRC | 01:20 | |
*** markvoelker has quit IRC | 01:22 | |
*** markvoelker has joined #openstack-ansible | 01:27 | |
*** michaelgugino has quit IRC | 01:28 | |
*** dxiri has joined #openstack-ansible | 01:31 | |
*** Guest38923 is now known as ioni | 01:31 | |
*** ioni is now known as Guest84816 | 01:31 | |
*** dxiri has quit IRC | 01:35 | |
*** retreved has joined #openstack-ansible | 01:39 | |
*** jamesdenton has quit IRC | 01:39 | |
*** retreved has quit IRC | 01:41 | |
*** sacharya has joined #openstack-ansible | 01:43 | |
*** darrenc_ has quit IRC | 01:44 | |
logan- | anyone seeing weird stuff on trusty builds this afternoon? | 01:45 |
logan- | i have been failing builds all afternoon on trusty with various service restart handlers failing like this http://cdn.pasteraw.com/3nmna1lncpum9vfojt6u7lj2wkrt3hm | 01:46 |
*** sacharya has quit IRC | 01:47 | |
deadnull | cloudnull logan- so I was collapsing my cinder_backends and cinder_nfs_client into one block in yaml | 01:48 |
deadnull | breaking them into two sections worked like a charm | 01:48 |
logan- | awesome deadnull :) | 01:49 |
*** cathrichardson has quit IRC | 01:55 | |
*** cathrichardson has joined #openstack-ansible | 01:55 | |
cloudnull | deadnull: nice! | 01:56 |
cloudnull | logan-: I've not, however I've only been playing with xenial as of late. | 01:56 |
logan- | seemsm like ansible broke | 01:57 |
logan- | http://cdn.pasteraw.com/2lg8m72276f1x8r88itr8zu5538w2dk | 01:57 |
logan- | ansible_service_mgr == systemd.... ok | 01:57 |
cloudnull | hum... | 01:59 |
cloudnull | the service module is missing ... | 01:59 |
cloudnull | i've seen that before when the submodule for the core modules fails to do it's magic | 01:59 |
logan- | but it is trusty. why is it trying to restart a systemd unit :( | 01:59 |
*** cmart has quit IRC | 02:00 | |
cloudnull | there are some systemd bits in trusty, maybe a recent change in ansible is picking up on some systemd thing ? | 02:03 |
cloudnull | or vise versa, recent change in trusty doing some systemd thing it shouldn't ? | 02:04 |
logan- | yeah I'm thinking some trusty change or ansible dep has broken it. this is on a newton build so ansible is pinned at 2.1.1.0 | 02:05 |
logan- | going to do some more digging on this vm and see what packages got updated before the build died | 02:06 |
cloudnull | are the containers by chance running xenial ? | 02:06 |
cloudnull | the failure was in aio1_unbound_container | 02:06 |
cloudnull | maybe something internally is pointing at 16.04 as the container build source? | 02:07 |
logan- | negative: $ sudo lxc-attach -n aio1_unbound_container-bf5686a6 -- lsb_release -c | 02:09 |
logan- | Codename:trusty | 02:09 |
logan- | Ubuntu 14.04.5 LTS | 02:10 |
*** smatzek__ has joined #openstack-ansible | 02:12 | |
logan- | http://cdn.pasteraw.com/c8ajufdx6fo3d8kyiaf76rh19h02cxo systemd update :/ | 02:15 |
logan- | ansible bug https://github.com/ansible/ansible/issues/19030 | 02:24 |
*** Guest84816 is now known as ioni | 02:32 | |
*** ioni is now known as Guest3299 | 02:32 | |
logan- | the systemd update breaks ansible because /run/systemd/system begins to exist | 02:35 |
logan- | so... don't update systemd if you still have the misfortune of running trusty :) | 02:35 |
*** schwicht has joined #openstack-ansible | 02:46 | |
*** PramodJayathirth has quit IRC | 02:50 | |
cloudnull | logan-: curious if you refactor that method like so http://cdn.pasteraw.com/ni3msc2hhs93gypn3qrm0iezwmxxlbk | 02:53 |
cloudnull | if that issue is fixed? | 02:53 |
logan- | I suspect yes but will test once im back at my desk in a bit | 03:01 |
*** cycloptivity has left #openstack-ansible | 03:01 | |
logan- | https://launchpad.net/ubuntu/+source/systemd/204-5ubuntu20.20 | 03:01 |
*** schwicht has quit IRC | 03:07 | |
*** thorst_ has joined #openstack-ansible | 03:09 | |
cloudnull | logan-: https://github.com/ansible/ansible-modules-core/pull/5865 | 03:20 |
*** woodard has quit IRC | 03:21 | |
*** woodard has joined #openstack-ansible | 03:21 | |
cloudnull | hopfully in the next year or so they'll get it merged. | 03:22 |
logan- | cloudnull: yeah :/ and adding to that we still have other problems even if service module works. ansible_service_mgr is still reporting systemd so that breaks all of the os_* roles | 03:24 |
cloudnull | hum ,, thats in fact gathering last i recall. | 03:25 |
*** maeker has quit IRC | 03:25 | |
logan- | right | 03:25 |
logan- | https://github.com/ansible/ansible/blob/devel/lib/ansible/module_utils/facts.py#L506 | 03:28 |
cloudnull | bah... | 03:28 |
cloudnull | yea, just saw that. | 03:28 |
*** smatzek__ has quit IRC | 03:28 | |
cloudnull | they're doing the same canary check | 03:28 |
logan- | yup | 03:29 |
logan- | grepping thru it looks like some modules use Facts(module).is_systemd_managed(), so that's nice | 03:29 |
logan- | less to fix that way | 03:29 |
*** whiteveil has joined #openstack-ansible | 03:29 | |
logan- | i don't see any other stuff that will break osa aside from those 2 spots | 03:30 |
winggundamth | good morning all | 03:32 |
*** Guest3299 is now known as ioni | 03:33 | |
*** ioni is now known as Guest32619 | 03:33 | |
*** woodard has quit IRC | 03:33 | |
*** woodard has joined #openstack-ansible | 03:33 | |
openstackgerrit | Merged openstack/openstack-ansible: Remove irrelevant cinder_backends in glance configuration https://review.openstack.org/407480 | 03:34 |
logan- | hey winggundamth | 03:35 |
winggundamth | hi logan- | 03:35 |
cloudnull | o/ winggundamth | 03:35 |
winggundamth | been sick for 3 days :( | 03:36 |
winggundamth | https://review.openstack.org/#/c/403822/2 I'm not sure I can do recheck for retrying Jenkins Gate test again? | 03:36 |
winggundamth | hi cloudnull :) | 03:38 |
cloudnull | https://github.com/ansible/ansible/pull/19034 | 03:38 |
openstackgerrit | Uros Orozel proposed openstack/openstack-ansible-os_ironic: Fixes issues with special characters in password. https://review.openstack.org/408935 | 03:39 |
logan- | thanks cloudnull | 03:39 |
*** furlongm has joined #openstack-ansible | 03:40 | |
cloudnull | we'll see if it goes anywhere. | 03:40 |
* cloudnull holding my breath | 03:41 | |
winggundamth | I'm seeing ansible-modules-core repo has been locked and they trying to merge to ansible repo. do this will affect us? | 03:43 |
winggundamth | I mean affect to OSA when installing ansible | 03:43 |
palendae | Probably | 03:43 |
*** fguillot has joined #openstack-ansible | 03:44 | |
*** sacharya has joined #openstack-ansible | 03:44 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added nova quota plugin https://review.openstack.org/408839 | 03:46 |
palendae | Actually looks like maybe not https://github.com/openstack/openstack-ansible/blob/master/scripts/bootstrap-ansible.sh#L116 | 03:46 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added kvm_virsh to telegraf plugins https://review.openstack.org/408844 | 03:47 |
palendae | But I don't know for sure, worth investigating deeper, winggundamth | 03:47 |
winggundamth | @cloudnull nice. I love telegraf and using it in our production right now :P | 03:47 |
cloudnull | winggundamth: me too :) | 03:48 |
cloudnull | I have it running here: https://cloud1.osic.org/grafana/ | 03:48 |
cloudnull | 03:48 | |
cloudnull | well i have it being visualized there. | 03:48 |
*** sacharya has quit IRC | 03:48 | |
winggundamth | what db do you use? influxdb or graphite? | 03:48 |
cloudnull | we're using influxdb | 03:49 |
winggundamth | @cloudnull can you help me doing jenkins gate recheck here https://review.openstack.org/#/c/403822/2 | 03:49 |
cloudnull | telegrad > influxdb > grafana | 03:49 |
cloudnull | sure. | 03:49 |
cloudnull | done. | 03:50 |
openstackgerrit | Merged openstack/openstack-ansible-security: Search for unlabeled device files [+Docs] https://review.openstack.org/407108 | 03:51 |
openstackgerrit | Merged openstack/openstack-ansible-security: Check for ocsp_on in PKCS config [+Docs] https://review.openstack.org/407650 | 03:51 |
openstackgerrit | Merged openstack/openstack-ansible-security: Check for cackey/coolkey values [+Docs] https://review.openstack.org/407654 | 03:51 |
openstackgerrit | Merged openstack/openstack-ansible-security: Check for pam_lastlogin [+Docs] https://review.openstack.org/407691 | 03:51 |
openstackgerrit | Merged openstack/openstack-ansible-security: Remove .shosts/shosts.equiv files [+Docs] https://review.openstack.org/407695 | 03:51 |
winggundamth | cloudnull: do you have telegraf configuration open somewhere? | 03:52 |
cloudnull | I do | 03:52 |
cloudnull | https://github.com/openstack/openstack-ansible-ops/tree/master/cluster_metrics | 03:52 |
winggundamth | cloudnull: and grafana json dashboard too :P | 03:52 |
winggundamth | I can see everything in there | 03:52 |
winggundamth | lol | 03:52 |
cloudnull | the dashboards are in that repo however if you go to https://cloud1.osic.org/grafana/ you can export the dashboards which are more up-to-date | 03:53 |
cloudnull | I'd like to setup graf-yaml | 03:53 |
cloudnull | but i've not done it quite yet. | 03:53 |
winggundamth | cloudnull: I see. thanks. this is great I really love it :) | 03:54 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added kvm_virsh to telegraf plugins https://review.openstack.org/408844 | 03:55 |
*** agrebennikov_ has joined #openstack-ansible | 03:58 | |
*** maeker has joined #openstack-ansible | 04:01 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added Cinder storage pools data https://review.openstack.org/408863 | 04:04 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops: Added Cinder storage pools data https://review.openstack.org/408863 | 04:07 |
*** drifterza has joined #openstack-ansible | 04:13 | |
*** fguillot has quit IRC | 04:15 | |
*** schwicht has joined #openstack-ansible | 04:19 | |
*** askb has quit IRC | 04:21 | |
*** schwicht has quit IRC | 04:23 | |
*** sacharya has joined #openstack-ansible | 04:24 | |
*** maeker has quit IRC | 04:26 | |
*** whiteveil has quit IRC | 04:28 | |
*** Jack_Iv has joined #openstack-ansible | 04:30 | |
*** Guest32619 is now known as ioni | 04:33 | |
*** ioni is now known as Guest79805 | 04:34 | |
*** Jack_Iv has quit IRC | 04:34 | |
openstackgerrit | Merged openstack/openstack-ansible: [DOCS] Remove hacking H303 https://review.openstack.org/408787 | 04:54 |
openstackgerrit | Merged openstack/openstack-ansible-os_neutron: Ensure correct VPNaaS package is installed https://review.openstack.org/403822 | 04:56 |
cloudnull | logan-: just to confirm due to that bug, we're at a standstill with trusty. | 05:05 |
cloudnull | I just kicked a mess of nodes using updated trusty kicked from isoo | 05:06 |
drifterza | cloudnull! | 05:06 |
drifterza | What the Hell dude | 05:06 |
cloudnull | ohai :) | 05:06 |
drifterza | did you pull an all nighter ? | 05:06 |
cloudnull | no, just farting around. | 05:06 |
cloudnull | How you been ? | 05:07 |
drifterza | having fun with ipv6 | 05:07 |
*** chhavi has joined #openstack-ansible | 05:08 | |
cloudnull | Nice. Did you get your old crusty subnet humming along ;) | 05:08 |
drifterza | want to get designate to give dns records for ipv6 | 05:08 |
drifterza | I'm still in testing phase, want to get prefix delegation working properly | 05:08 |
drifterza | using dhcpv6 stateless I think | 05:08 |
drifterza | just really need the dns records | 05:09 |
cloudnull | I remember you saying that the cidr you had the netsec people were skeptical if it'd even work | 05:09 |
drifterza | yeah I'm going to show them how to do it | 05:09 |
drifterza | then they can suck it | 05:09 |
cloudnull | Haha. | 05:09 |
cloudnull | That's the way to do it ;) | 05:10 |
drifterza | But I'm thinking provider network and not l3 agents | 05:10 |
drifterza | dont see the point of floating addresses if you have lbassv2 | 05:10 |
cloudnull | ++ we dual stack with both. | 05:10 |
drifterza | dual stack is really only for the metadata service right ? | 05:11 |
cloudnull | V6 provider net , w/ random rfc1918 which is plugged into a neutron router. | 05:11 |
*** askb has joined #openstack-ansible | 05:11 | |
cloudnull | Yes. Just for metadata | 05:11 |
drifterza | I don't want dedicated network nodes, thats what I'm trying to avoid | 05:11 |
cloudnull | However we do have a proper gateway on the router which is to allow egress v4 | 05:11 |
*** sc68cal has quit IRC | 05:12 | |
drifterza | for now I'll do configdrive and user_data to get around the metadata requirements | 05:12 |
cloudnull | But if you plumb a v4 provider net on the back end you should be able to do the same thing. | 05:13 |
cloudnull | Both subnets can be on the same vlan | 05:13 |
cloudnull | That said. Force config drive and your home free. | 05:14 |
drifterza | I'm thinking no l3 agents so having ipv4 private just for metadata seems overkill | 05:14 |
*** dxiri has joined #openstack-ansible | 05:14 | |
drifterza | Is there anything special I'm going to miss out on if I go with provider networks | 05:15 |
cloudnull | That should work fine. Side effect being that no l3 means no tenant networks. | 05:15 |
drifterza | yeah but I mean if its ipv6 only do tenant networks really mean anything ? | 05:15 |
cloudnull | Nope. | 05:16 |
drifterza | Yeah thats what I figured | 05:16 |
cloudnull | Unless they want an isolated v4 network. | 05:16 |
drifterza | forcing them to use v6 is beneficial for everyone | 05:16 |
cloudnull | But if you force v6 only its kinda mute | 05:16 |
cloudnull | ++ | 05:17 |
cloudnull | Welcome to the future. :) | 05:17 |
drifterza | v6 is more efficient in any case | 05:17 |
cloudnull | Crusty network nerds, suckit | 05:17 |
drifterza | if we can get prefix delegation and bgp working right, jeeze its a match made in heaven | 05:17 |
cloudnull | I've not played w/ prefix delegation. | 05:18 |
drifterza | dude its like zero touch | 05:18 |
cloudnull | It should, at least on paper, work in Newton. | 05:18 |
drifterza | define your network and let the upstream routers delegate prefixes, and then they do the bgp advertising too | 05:18 |
drifterza | I'm doing a lab to test this all | 05:19 |
drifterza | but the theory sounds perfect | 05:19 |
cloudnull | Ah. Perfect. In general so long as things don't touch neutron they work. :p | 05:19 |
drifterza | yeah radvd forwards NS to upstream routers | 05:20 |
*** javeriak has quit IRC | 05:20 | |
drifterza | from neutron | 05:20 |
*** dxiri has quit IRC | 05:20 | |
drifterza | as I said, still need to test everything | 05:20 |
*** furlongm has quit IRC | 05:20 | |
cloudnull | I just got my home running on native v6. I'm still dual stacked by native v6 is working like a champ. | 05:21 |
drifterza | its so simple really | 05:21 |
drifterza | people are just scared of change | 05:21 |
cloudnull | ++ | 05:21 |
*** dxiri has joined #openstack-ansible | 05:22 | |
cloudnull | Well , my provider doesn't offer gear to make it go. | 05:22 |
drifterza | so you do 6to4 ? | 05:22 |
drifterza | GRE tunnel ? | 05:22 |
cloudnull | No it's dumb. They have v6 and they used to enable it on their modems however the cheap crap they provide has a v6 bug so the turned it all off on their gear. | 05:23 |
cloudnull | But if you provide your own gear it works fine. | 05:23 |
drifterza | ah fail | 05:23 |
cloudnull | So I have my own devices | 05:24 |
*** sc68cal has joined #openstack-ansible | 05:24 | |
drifterza | oh you doing reverse ptr on cloudnull.io | 05:24 |
drifterza | i see | 05:24 |
*** sdake has quit IRC | 05:24 | |
drifterza | you are a hax0r | 05:25 |
cloudnull | Hahaha | 05:25 |
cloudnull | V6 all the things. | 05:26 |
drifterza | UE64 | 05:26 |
drifterza | eui-64 I mean | 05:27 |
drifterza | that was a neat trick they did | 05:28 |
cloudnull | It was. Mac == simple win | 05:29 |
drifterza | yeah and the extra bits always help | 05:29 |
cloudnull | Ok gonna run. | 05:29 |
cloudnull | Laptop is dying. | 05:30 |
*** schwicht has joined #openstack-ansible | 05:30 | |
drifterza | cool | 05:30 |
drifterza | cheers dude. | 05:30 |
cloudnull | And I don't want to go upstairs to plug it in. | 05:30 |
cloudnull | Have a good one. | 05:30 |
drifterza | you too | 05:30 |
drifterza | chat later | 05:30 |
cloudnull | ++ | 05:30 |
*** schwicht has quit IRC | 05:34 | |
*** Guest79805 is now known as ioni | 05:34 | |
*** ioni is now known as Guest1517 | 05:35 | |
*** thorst_ has quit IRC | 05:45 | |
*** thorst_ has joined #openstack-ansible | 05:46 | |
*** Jack_Iv has joined #openstack-ansible | 05:51 | |
*** thorst_ has quit IRC | 05:54 | |
*** woodard has quit IRC | 05:56 | |
*** schwicht has joined #openstack-ansible | 06:02 | |
*** Jack_Iv has quit IRC | 06:05 | |
*** schwicht has quit IRC | 06:07 | |
*** Jack_Iv has joined #openstack-ansible | 06:08 | |
*** dxiri has quit IRC | 06:09 | |
*** maeker has joined #openstack-ansible | 06:26 | |
*** sdake has joined #openstack-ansible | 06:29 | |
*** Jack_Iv has quit IRC | 06:30 | |
*** Jack_Iv has joined #openstack-ansible | 06:31 | |
*** maeker has quit IRC | 06:33 | |
*** vnogin has joined #openstack-ansible | 06:33 | |
*** Guest1517 is now known as ioni | 06:35 | |
*** ioni is now known as Guest30812 | 06:36 | |
*** messy has quit IRC | 06:37 | |
*** messy has joined #openstack-ansible | 06:38 | |
*** vnogin has quit IRC | 06:38 | |
*** oanson has joined #openstack-ansible | 06:45 | |
*** agrebennikov_ has quit IRC | 06:50 | |
*** thorst_ has joined #openstack-ansible | 06:53 | |
*** sdake has quit IRC | 06:59 | |
*** thorst_ has quit IRC | 06:59 | |
*** fxpester has joined #openstack-ansible | 07:01 | |
*** schwicht has joined #openstack-ansible | 07:03 | |
*** vnogin has joined #openstack-ansible | 07:05 | |
*** rgogunskiy has joined #openstack-ansible | 07:06 | |
*** sacharya has quit IRC | 07:07 | |
*** schwicht has quit IRC | 07:07 | |
*** sacharya has joined #openstack-ansible | 07:08 | |
*** sacharya has quit IRC | 07:13 | |
*** hachi has quit IRC | 07:17 | |
*** vnogin has quit IRC | 07:27 | |
*** janki has joined #openstack-ansible | 07:27 | |
*** Jack_Iv_ has joined #openstack-ansible | 07:30 | |
*** oanson has quit IRC | 07:33 | |
*** Jack_Iv_ has quit IRC | 07:36 | |
*** Guest30812 is now known as ioni | 07:36 | |
*** ioni is now known as Guest76441 | 07:36 | |
*** vnogin has joined #openstack-ansible | 07:55 | |
*** h5t4 has joined #openstack-ansible | 07:56 | |
*** thorst_ has joined #openstack-ansible | 07:57 | |
*** sacharya has joined #openstack-ansible | 08:00 | |
*** thorst_ has quit IRC | 08:05 | |
*** sacharya has quit IRC | 08:05 | |
*** hachi has joined #openstack-ansible | 08:07 | |
*** chhavi has quit IRC | 08:10 | |
*** pcaruana has joined #openstack-ansible | 08:16 | |
*** chhavi has joined #openstack-ansible | 08:24 | |
*** vnogin has quit IRC | 08:33 | |
*** sdake has joined #openstack-ansible | 08:34 | |
*** Guest76441 is now known as ioni | 08:37 | |
*** ioni is now known as Guest6068 | 08:37 | |
*** Jeffrey4l has quit IRC | 08:38 | |
*** janki has quit IRC | 08:47 | |
*** janki has joined #openstack-ansible | 08:53 | |
drifterza | chhavi, you there ? | 09:01 |
*** thorst_ has joined #openstack-ansible | 09:02 | |
*** schwicht has joined #openstack-ansible | 09:05 | |
*** schwicht has quit IRC | 09:09 | |
evrardjp | good morning | 09:10 |
*** thorst_ has quit IRC | 09:10 | |
drifterza | hi evrardjp | 09:10 |
drifterza | how you ? | 09:10 |
*** sdake_ has joined #openstack-ansible | 09:10 | |
*** sdake_ has quit IRC | 09:10 | |
*** sdake_ has joined #openstack-ansible | 09:10 | |
evrardjp | I'm fine what about you? I see you were up at 4 hours ago, isn't that a little early to start to work? | 09:11 |
drifterza | yeah came in at 6 am | 09:11 |
evrardjp | that's early :p | 09:12 |
drifterza | I knoW :( | 09:12 |
evrardjp | what happened? | 09:12 |
drifterza | had a meeting | 09:12 |
evrardjp | :( | 09:12 |
drifterza | thank God its Friday at least. | 09:12 |
*** sdake has quit IRC | 09:13 | |
*** chhavi has quit IRC | 09:15 | |
andymccr | mornin' | 09:17 |
drifterza | o/ | 09:17 |
*** yolanda has quit IRC | 09:22 | |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-security: Set permissions on sshd host keys [+Docs] https://review.openstack.org/407724 | 09:27 |
*** fabg has joined #openstack-ansible | 09:27 | |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-security: Check for default SNMP comm strings [+Docs] https://review.openstack.org/407717 | 09:29 |
*** vnogin has joined #openstack-ansible | 09:29 | |
*** vnogin has quit IRC | 09:31 | |
*** vnogin has joined #openstack-ansible | 09:32 | |
*** Jack_Iv_ has joined #openstack-ansible | 09:33 | |
*** Jack_Iv_ has quit IRC | 09:37 | |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-security: Check for promiscuous interfaces [+Docs] https://review.openstack.org/407698 | 09:37 |
*** Guest6068 is now known as ioni | 09:37 | |
*** ioni is now known as Guest30289 | 09:38 | |
openstackgerrit | Kevin Lefevre proposed openstack/openstack-ansible-os_magnum: Add /etc/environment to systemd unit https://review.openstack.org/408688 | 09:41 |
*** askb has quit IRC | 09:58 | |
openstackgerrit | Merged openstack/openstack-ansible-security: Check for promiscuous interfaces [+Docs] https://review.openstack.org/407698 | 09:59 |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-security: Set TMOUT variable for all sessions [+Docs] https://review.openstack.org/407684 | 10:04 |
*** thorst_ has joined #openstack-ansible | 10:09 | |
*** thorst_ has quit IRC | 10:15 | |
*** karimb has joined #openstack-ansible | 10:20 | |
openstackgerrit | Merged openstack/openstack-ansible-os_nova: resolve config deprecations https://review.openstack.org/395029 | 10:21 |
neith | guys, I cant upload large image using glance | 10:24 |
neith | is there a size cap by default? | 10:24 |
drifterza | usually keystone token timeout | 10:24 |
openstackgerrit | Merged openstack/openstack-ansible-security: Set TMOUT variable for all sessions [+Docs] https://review.openstack.org/407684 | 10:25 |
neith | drifterza: so whats the best workaround? | 10:25 |
drifterza | increasing the timeout on keystone | 10:25 |
drifterza | I can find the option for you | 10:25 |
*** vnogin has quit IRC | 10:26 | |
odyssey4me | o/ | 10:27 |
*** pjm6 has quit IRC | 10:27 | |
*** vnogin has joined #openstack-ansible | 10:28 | |
drifterza | maybe adjusting this : https://github.com/openstack/keystone/blob/e54c32399b2e80ed729e906154c50cc11cd923c2/etc/keystone.conf.sample#L1474 | 10:28 |
drifterza | I could be off, but thats usually the cause | 10:28 |
neith | drifterza: token are set to 3600 | 10:31 |
neith | so thats not the issue | 10:31 |
odyssey4me | neith are you uploading via the client, or via horizon? | 10:32 |
neith | odyssey4me: cli | 10:32 |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-security: Enable chrony [+Docs] https://review.openstack.org/407687 | 10:32 |
odyssey4me | ok, and how large is large - and what's the glance store you're uploading to? | 10:32 |
neith | odyssey4me: 25GB! glance store? | 10:33 |
odyssey4me | neith yeah, what's the back-end that glance is using for the store? | 10:33 |
odyssey4me | swift/file/ceph? | 10:33 |
odyssey4me | nfs? | 10:33 |
odyssey4me | and do you see any errors when enabling debug for the glance api service? | 10:34 |
*** Jack_Iv_ has joined #openstack-ansible | 10:34 | |
odyssey4me | or even without debug? | 10:34 |
neith | odyssey4me: File | 10:37 |
neith | odyssey4me: shame on me | 10:37 |
neith | odyssey4me: no space left | 10:37 |
odyssey4me | neith ok, so can the file system you're storing it on cater for that sized file? | 10:38 |
odyssey4me | or that :p | 10:38 |
drifterza | haha | 10:38 |
drifterza | ;p | 10:38 |
*** Jack_Iv_ has quit IRC | 10:38 | |
odyssey4me | noddy badge for neith today :) | 10:38 |
*** Guest30289 is now known as ioni | 10:38 | |
neith | hahahaha | 10:38 |
* neith is going back home to sleep | 10:39 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron: Ensure correct VPNaaS package is installed https://review.openstack.org/409073 | 10:39 |
*** ioni is now known as Guest84636 | 10:39 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Remove irrelevant cinder_backends in glance configuration https://review.openstack.org/409075 | 10:40 |
deadnull | morning all | 10:40 |
openstackgerrit | Merged openstack/openstack-ansible: Retry the git clone in role fetcher https://review.openstack.org/408798 | 10:42 |
winggundamth | good evening :) | 10:44 |
*** schwicht has joined #openstack-ansible | 10:45 | |
*** Jeffrey4l has joined #openstack-ansible | 10:47 | |
*** janki has quit IRC | 10:47 | |
*** schwicht has quit IRC | 10:50 | |
*** karimb has quit IRC | 10:52 | |
openstackgerrit | Merged openstack/openstack-ansible-security: Enable chrony [+Docs] https://review.openstack.org/407687 | 10:52 |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-security: Restrict mail relaying [+Docs] https://review.openstack.org/407701 | 10:53 |
*** janki has joined #openstack-ansible | 10:58 | |
*** fabg has quit IRC | 10:59 | |
*** vnogin has quit IRC | 11:00 | |
*** Jack_Iv_ has joined #openstack-ansible | 11:04 | |
*** karimb has joined #openstack-ansible | 11:07 | |
openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi: Add CentOS support for os_gnocchi role https://review.openstack.org/407071 | 11:07 |
*** deadnull has quit IRC | 11:10 | |
openstackgerrit | Merged openstack/openstack-ansible-os_aodh: Add CentOS support for os_aodh role https://review.openstack.org/407171 | 11:11 |
openstackgerrit | Merged openstack/openstack-ansible: Fix cinder_volumes is_metal override example https://review.openstack.org/408724 | 11:12 |
*** thorst_ has joined #openstack-ansible | 11:13 | |
openstackgerrit | Merged openstack/openstack-ansible-security: Restrict mail relaying [+Docs] https://review.openstack.org/407701 | 11:14 |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-security: Check for TFTP secure mode [+Docs] https://review.openstack.org/407709 | 11:15 |
*** schwicht has joined #openstack-ansible | 11:15 | |
*** vnogin has joined #openstack-ansible | 11:16 | |
openstackgerrit | Merged openstack/openstack-ansible-os_neutron: Neutron upgrade testing. https://review.openstack.org/400180 | 11:17 |
openstackgerrit | Merged openstack/openstack-ansible-os_swift: Set copy as a middleware for Swift https://review.openstack.org/408139 | 11:19 |
*** chhavi has joined #openstack-ansible | 11:20 | |
*** thorst_ has quit IRC | 11:20 | |
*** schwicht has quit IRC | 11:20 | |
openstackgerrit | Merged openstack/openstack-ansible-os_swift: Remove Trusty support from os_swift role https://review.openstack.org/408576 | 11:25 |
openstackgerrit | Merged openstack/openstack-ansible-os_nova: Nova upgrade testing. https://review.openstack.org/400178 | 11:26 |
*** schwicht has joined #openstack-ansible | 11:26 | |
openstackgerrit | Merged openstack/openstack-ansible-security: Extend get_users module to get groups https://review.openstack.org/406288 | 11:28 |
openstackgerrit | Merged openstack/openstack-ansible-security: Check for groups that don't exist [+Docs] https://review.openstack.org/406289 | 11:29 |
openstackgerrit | Merged openstack/openstack-ansible-security: Verify password age limits [+Docs] https://review.openstack.org/406353 | 11:29 |
openstackgerrit | Merged openstack/openstack-ansible-os_sahara: Execute tempest using updated method https://review.openstack.org/408738 | 11:30 |
*** maeker has joined #openstack-ansible | 11:30 | |
openstackgerrit | Merged openstack/openstack-ansible-os_ironic: Add support for neutron network names for cleaning/provisioning https://review.openstack.org/408594 | 11:30 |
*** schwicht has quit IRC | 11:31 | |
openstackgerrit | Merged openstack/openstack-ansible-os_magnum: Execute tempest using updated method https://review.openstack.org/408734 | 11:34 |
*** stuartgr has joined #openstack-ansible | 11:34 | |
*** david-lyle_ has joined #openstack-ansible | 11:35 | |
*** maeker has quit IRC | 11:35 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Fix cinder_volumes is_metal override example https://review.openstack.org/409103 | 11:37 |
*** david-lyle has quit IRC | 11:37 | |
*** Guest84636 is now known as ioni | 11:39 | |
*** ioni is now known as Guest44433 | 11:40 | |
*** deadnull has joined #openstack-ansible | 11:45 | |
*** deadnull has quit IRC | 11:45 | |
openstackgerrit | Merged openstack/openstack-ansible-os_magnum: Expose magnum_cert_manager_type and set default https://review.openstack.org/408627 | 11:45 |
*** deadnull has joined #openstack-ansible | 11:47 | |
*** schwicht has joined #openstack-ansible | 11:53 | |
*** drifterza has quit IRC | 11:54 | |
*** smatzek__ has joined #openstack-ansible | 11:57 | |
*** schwicht has quit IRC | 11:58 | |
*** smatzek__ has quit IRC | 11:58 | |
*** smatzek has joined #openstack-ansible | 11:59 | |
openstackgerrit | Merged openstack/openstack-ansible-security: Check for TFTP secure mode [+Docs] https://review.openstack.org/407709 | 12:00 |
*** schwicht has joined #openstack-ansible | 12:01 | |
*** williamc_ has quit IRC | 12:05 | |
*** williamcaban has joined #openstack-ansible | 12:05 | |
*** Jack_Iv_ has quit IRC | 12:06 | |
*** schwicht has quit IRC | 12:06 | |
*** fabg has joined #openstack-ansible | 12:07 | |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-security: Check for default SNMP comm strings [+Docs] https://review.openstack.org/407717 | 12:09 |
*** hw_wutianwei has quit IRC | 12:10 | |
*** oanson has joined #openstack-ansible | 12:13 | |
*** thorst_ has joined #openstack-ansible | 12:18 | |
*** thorst_ has quit IRC | 12:24 | |
*** chhavi has quit IRC | 12:25 | |
openstackgerrit | Merged openstack/openstack-ansible-security: Check for default SNMP comm strings [+Docs] https://review.openstack.org/407717 | 12:26 |
*** fabg has quit IRC | 12:26 | |
*** pjm6 has joined #openstack-ansible | 12:30 | |
*** chhavi has joined #openstack-ansible | 12:32 | |
*** jamielennox is now known as jamielennox|away | 12:33 | |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-security: Set home dir mode/owner/group owner [+Docs] https://review.openstack.org/406329 | 12:33 |
*** Disova has quit IRC | 12:39 | |
*** Disova has joined #openstack-ansible | 12:39 | |
*** Guest44433 is now known as ioni | 12:40 | |
*** ioni is now known as Guest92249 | 12:40 | |
*** schwicht has joined #openstack-ansible | 12:41 | |
*** paulfantom has quit IRC | 12:54 | |
*** johnmilton has joined #openstack-ansible | 12:58 | |
*** vnogin has quit IRC | 12:59 | |
*** deadnull is now known as _deadnull | 13:02 | |
*** _deadnull is now known as deadnull | 13:02 | |
*** pcaruana has quit IRC | 13:05 | |
*** vnogin has joined #openstack-ansible | 13:05 | |
*** pcaruana has joined #openstack-ansible | 13:08 | |
*** thorst_ has joined #openstack-ansible | 13:08 | |
openstackgerrit | Marc Gariépy proposed openstack/openstack-ansible-os_nova: nova-gate test centos https://review.openstack.org/408815 | 13:10 |
mgariepy | morning everyone | 13:12 |
*** asettle has quit IRC | 13:18 | |
*** asettle has joined #openstack-ansible | 13:19 | |
neith | odyssey4me: So I fixed the space issue and the cli give this error: | 13:22 |
neith | Error finding address for http://192.168.201.10:9292/v2/images/aa0dea24-9432-49d5-bdab-78789078f11c/file: Unable to establish connection to http://192.168.201.10:9292/v2/images/aa0dea24-9432-49d5-bdab-78789078f11c/file | 13:22 |
sigmavirus | neith: so that's a getaddrinfo issue it sounds like trying to onnect to 192.168.201.10 which is odd but weirder things have happened with getaddrinf | 13:23 |
odyssey4me | neith do you have a common back-end (ie shared storage), assuming you have more than one controller? | 13:23 |
neith | odyssey4me: its a poc setup so only one infra node | 13:23 |
*** kjw3 has joined #openstack-ansible | 13:24 | |
sigmavirus | neith: can you put all the console output (including what command you ran) into paste.openstack.org? | 13:24 |
odyssey4me | neith hmm, then I dunno - check the glance-api logs, maybe there's a clue there | 13:24 |
odyssey4me | or use the --debug for the cli | 13:24 |
sigmavirus | odyssey4me: that looks like it literally can't open a connection to that IP address, but using --debug should let us know if that error is coming ultimately from glance or from the cli neith is using | 13:25 |
*** kylek3h_away has joined #openstack-ansible | 13:26 | |
odyssey4me | ah :) | 13:26 |
neith | trying with --debug | 13:27 |
*** fxpester has quit IRC | 13:27 | |
neith | sigmavirus: http://paste.openstack.org/show/591937/ | 13:31 |
*** rgogunskiy has quit IRC | 13:32 | |
sigmavirus | neith: what version of glanceclient are you using? | 13:35 |
neith | sigmavirus: 2.5.0 | 13:35 |
neith | sigmavirus: I'm currently trying from the utility container | 13:36 |
neith | retrying on my laptop | 13:36 |
sigmavirus | So I'm on a rabbit hole expedition neith to figure out the chain of events leading to your error | 13:37 |
*** jcannava has joined #openstack-ansible | 13:37 | |
*** jcannava has quit IRC | 13:37 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-security: Ensure separate filesystems exist [+Docs] https://review.openstack.org/407199 | 13:38 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-security: Enable FIPS [+Docs] https://review.openstack.org/407218 | 13:39 |
erhudy | logan-: 7 or 9 OSDs depending on hardware model | 13:39 |
neith | sigmavirus: I previously uploaded images around 5GB without any problems | 13:41 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-security: Find world-writable dirs with bad group owners https://review.openstack.org/407157 | 13:41 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-security: Set cron.allow owner/group owner [+Docs] https://review.openstack.org/407178 | 13:41 |
*** Guest92249 is now known as ioni | 13:41 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-security: Set user/group/modes on user init files [+Docs] https://review.openstack.org/408736 | 13:41 |
*** ioni is now known as Guest65939 | 13:41 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-security: Add checks for remote syslog [+Docs] https://review.openstack.org/407593 | 13:42 |
*** fabg has joined #openstack-ansible | 13:42 | |
*** jcannava has joined #openstack-ansible | 13:43 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-security: Set permissions on sshd host keys [+Docs] https://review.openstack.org/407724 | 13:44 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-security: Set permissions on sshd host keys [+Docs] https://review.openstack.org/407724 | 13:44 |
sigmavirus | neith: so yeah, that error you're seeing is coming from a ConnectionRefused error from keystoneclient which comes from the underlying HTTP transport raising a ConnectionError | 13:44 |
neith | sigmavirus: well , it means the glance api is overloaded? | 13:46 |
sigmavirus | neith: well are you talking directly to glance or to a lb? | 13:46 |
*** retreved has joined #openstack-ansible | 13:46 | |
sigmavirus | And a ConnectionError can be caused by a number of things | 13:46 |
* sigmavirus maintains the underlying http transport library | 13:46 | |
*** retreved has quit IRC | 13:46 | |
*** retreved has joined #openstack-ansible | 13:47 | |
sigmavirus | neith: can you telnet to 192.168.201.10 9292? | 13:48 |
neith | sigmavirus: sure | 13:48 |
neith | sigmavirus: works like a charm | 13:48 |
*** karimb has quit IRC | 13:50 | |
neith | sigmavirus: I'm starting to doubt the reliability of lxc network | 13:51 |
neith | I'm facing random issues connecting to various endpoints | 13:51 |
sigmavirus | neith: is that the lb address or the container address? | 13:52 |
neith | thats the LB address | 13:52 |
*** chhavi has quit IRC | 13:52 | |
neith | sigmavirus: How can I bypass the glance config to use directly the glance endpoint avoiding haproxy? | 13:53 |
neith | sigmavirus: for testing purpose I mean | 13:53 |
sigmavirus | neith: so I wonder if haproxy isn't just upset with you uploading a Windows Image | 13:53 |
sigmavirus | (not because it's Windows, but because those images tend to be ... large) | 13:54 |
neith | sigmavirus: LOL | 13:54 |
sigmavirus | neith: what backend are you using for glance? file or swift or something else? | 13:54 |
neith | sigmavirus: file | 13:54 |
*** fabg has quit IRC | 13:56 | |
*** fguillot has joined #openstack-ansible | 13:57 | |
sigmavirus | odyssey4me: you still around? | 13:57 |
*** janki has quit IRC | 13:59 | |
sigmavirus | odyssey4me: andymccr trying to remember if osa is smart about mounting the file location to the host | 13:59 |
sigmavirus | neith: I think by default the lxc disk size is small and so if you don't have the on disk location pointing to a mount to the host, you might be causing the container space to fill up | 14:00 |
neith | sigmavirus: i'm not an lxc expert but when ssh in the glance container, I have 5TB of free space | 14:01 |
sigmavirus | neith: ah, then forget that :) | 14:01 |
sigmavirus | I'm probably remembering a much older version of OSA :) | 14:01 |
neith | https://www.irccloud.com/pastebin/2UPE7a0j/ | 14:01 |
neith | sigmavirus: thats was for u | 14:01 |
*** lunarlamp is now known as mariusv | 14:02 | |
neith | sigmavirus: if it helps, while pushing the image I monitor the /var/lib/glance/images directory and I can see a new directory growing, when reaching around 12GB it disappears and a few seconds later, the uploading command fails | 14:04 |
sigmavirus | how long does it take to get to 12GB? | 14:05 |
andymccr | ahh ok | 14:05 |
andymccr | thats the glance container | 14:05 |
andymccr | we set it to 12g | 14:05 |
sigmavirus | neith: ^ | 14:05 |
andymccr | will find hte relevant line now :) gimme 2 secs | 14:06 |
neith | alright | 14:06 |
andymccr | https://github.com/openstack/openstack-ansible/blob/master/playbooks/inventory/env.d/glance.yml#L35 | 14:06 |
neith | guys, I should say I will never use the file backend in production | 14:06 |
sigmavirus | neith: it's generally a good idea to mount to the host with large images like that or use something like swift or ceph to back glance :) | 14:06 |
sigmavirus | neith: okay | 14:06 |
sigmavirus | good :) | 14:06 |
*** Jack_Iv_ has joined #openstack-ansible | 14:07 | |
andymccr | neith: yeah i think we went with that because file storage backend is kinda suck with a 3 now glance cluster :) | 14:07 |
neith | but other departmenst are evaluating Openstack, as if we could be wrong using it lol | 14:07 |
andymccr | but for testing it is that i guess | 14:07 |
*** jamesdenton has joined #openstack-ansible | 14:07 | |
neith | andymccr: wich playbook should I replay? should I destroy the glance container? | 14:09 |
*** schwicht has quit IRC | 14:09 | |
andymccr | neith: i think you will have to destroy the container then recreate and run glance - mainly because it will create the filesystem based on that size specified. I can double check, but i'd imagine that wont happen if it already exists :) | 14:09 |
andymccr | so that is a bit of a sucky one. sorry :( | 14:10 |
*** Jack_Iv_ has quit IRC | 14:11 | |
*** agrebennikov_ has joined #openstack-ansible | 14:12 | |
*** xavierr has left #openstack-ansible | 14:12 | |
*** deadnull has quit IRC | 14:17 | |
*** ioni_ has joined #openstack-ansible | 14:19 | |
mhayden | odyssey4me: i tried various incantations like the one you suggested in https://review.openstack.org/408722 with no luck ? | 14:22 |
mhayden | s/?/./ | 14:22 |
mhayden | ansible's version_compare() is a filter, not a test (which are two different things in jinjaland | 14:23 |
mhayden | odyssey4me: FWIW, you can add some feedback here if you like: https://github.com/pallets/jinja/pull/624 | 14:23 |
*** vnogin has quit IRC | 14:28 | |
*** sliver has joined #openstack-ansible | 14:30 | |
odyssey4me | mhayden ah ok, I figured as much | 14:30 |
mhayden | yeah, that was a damned head scratcher | 14:30 |
*** vnogin has joined #openstack-ansible | 14:31 | |
*** mcrafty has quit IRC | 14:32 | |
*** smatzek has quit IRC | 14:32 | |
*** ioni_ has quit IRC | 14:33 | |
*** schwicht has joined #openstack-ansible | 14:33 | |
erhudy | anyone have luck with setting up a multi-node VM environment for testing OSA stuff? casting around to find out what people do now for testing, whether they go from AIO to hardware, hardware only, etc | 14:37 |
logan- | erhudy: have a look at https://github.com/openstack/openstack-ansible-ops/tree/master/multi-node-aio | 14:37 |
erhudy | on our existing deployment stuff we have a pretty big Vagrantfile that sets up multiple VMs with multiple interfaces and multiple block devices and all sorts of stuff, maybe i can adapt that for building a more realistic env | 14:37 |
logan- | that stuff will take a host and break it up into multiple vms to create an OSA multi-node install on a single metal host | 14:39 |
erhudy | cool, maybe i can get it running at home | 14:40 |
erhudy | should be able to fit it all into 32GB of memory on my home linux desktop | 14:40 |
odyssey4me | erhudy note that it basically takes over the host, so don't just run it on something you're not prepared to rebuild | 14:41 |
erhudy | that machine specifically exists for testing OSA, it can be sacrificed without mercy | 14:41 |
odyssey4me | haha, fair enough :) | 14:41 |
*** fxpester has joined #openstack-ansible | 14:41 | |
*** schwicht has quit IRC | 14:42 | |
*** Guest65939 is now known as ioni | 14:42 | |
*** maeker has joined #openstack-ansible | 14:42 | |
erhudy | i would love to buy some NUCs and an L3 switch and make a little army of physical machines | 14:42 |
*** ioni is now known as Guest25043 | 14:42 | |
*** pcaruana has quit IRC | 14:42 | |
*** izaakk has quit IRC | 14:43 | |
*** izaakk has joined #openstack-ansible | 14:43 | |
*** maeker has quit IRC | 14:43 | |
*** karimb has joined #openstack-ansible | 14:45 | |
evrardjp | erhudy: I'd love it myself too | 14:45 |
*** schwicht has joined #openstack-ansible | 14:45 | |
evrardjp | with a proper switch, configurable with ansible :D | 14:45 |
*** maeker has joined #openstack-ansible | 14:45 | |
jrosser_ | speaking of multi-node-aio we got it pretty much running xenial-on-xenial today | 14:46 |
logan- | I luckily had a pile of old E3-1270v1 machines racked and unused when I started w/ OSA/ceph work, really helped | 14:46 |
erhudy | that's good, that's where i want to go with it | 14:46 |
logan- | jrosser_: just in time since trusty is busted now :P | 14:47 |
jrosser_ | we're replaced most of the bash with ansible | 14:47 |
erhudy | i have enough hardware here to set everything up, but it's a restricted network environment, so doing builds of anything that likes to have internet access is really challenging | 14:47 |
erhudy | want to get it working and understand the bootstrap process without http proxies in the way | 14:47 |
evrardjp | there is docs for that erhudy | 14:48 |
erhudy | yeah, i know, i'm just trying to start at the simplest possible use case before i begin expanding into disconnected builds | 14:48 |
logan- | ++ thats the way to go | 14:49 |
logan- | i have a similar offline env but i wouldn't recommend starting there from step 1 | 14:49 |
jrosser_ | we did ours behind proxy | 14:49 |
*** schwicht has quit IRC | 14:50 | |
jrosser_ | mostly fixed, remainder is actual openstack config rather than OSA | 14:50 |
*** maeker has quit IRC | 14:50 | |
*** schwicht has joined #openstack-ansible | 14:51 | |
*** raddaoui has quit IRC | 14:53 | |
*** raddaoui has joined #openstack-ansible | 14:53 | |
*** smatzek has joined #openstack-ansible | 14:56 | |
*** pcaruana has joined #openstack-ansible | 14:56 | |
*** galstrom_zzz is now known as galstrom | 15:00 | |
*** flaviodsr has quit IRC | 15:00 | |
*** flaviodsr has joined #openstack-ansible | 15:01 | |
*** sdake_ has quit IRC | 15:01 | |
*** Mudpuppy has joined #openstack-ansible | 15:02 | |
*** gouthamr has joined #openstack-ansible | 15:04 | |
*** schwicht has quit IRC | 15:09 | |
*** kjw3 has quit IRC | 15:09 | |
neith | andymccr: ok | 15:12 |
*** qwang has quit IRC | 15:16 | |
*** qwang has joined #openstack-ansible | 15:16 | |
*** NostawRm has joined #openstack-ansible | 15:21 | |
*** clsacramento has quit IRC | 15:24 | |
*** dxiri has joined #openstack-ansible | 15:30 | |
*** chris_hultin|AWA is now known as chris_hultin | 15:33 | |
*** weezS has joined #openstack-ansible | 15:36 | |
neith | andymccr: is there a way to check container_fs_size: once the container rebuilt? | 15:39 |
*** michaelgugino has joined #openstack-ansible | 15:40 | |
*** Guest25043 is now known as ioni | 15:43 | |
*** chris_hultin is now known as chris_hultin|AWA | 15:43 | |
*** ioni is now known as Guest2615 | 15:43 | |
*** spotz_zzz is now known as spotz | 15:44 | |
*** Jack_Iv_ has joined #openstack-ansible | 15:45 | |
odyssey4me | neith sure, just access the container and do fdisk -l | 15:45 |
odyssey4me | or df -h | 15:46 |
*** galstrom is now known as galstrom_zzz | 15:46 | |
neith | odyssey4me: no it returns the size of the host | 15:47 |
*** chris_hultin|AWA is now known as chris_hultin | 15:47 | |
neith | I don't know how to check the fs_size | 15:47 |
neith | :( | 15:47 |
odyssey4me | hmm, ok then off-hand I'm not sure | 15:47 |
odyssey4me | neith I think the glance container has it's data bind mounted to the host - but not the cache I don't think | 15:48 |
odyssey4me | you may either want to disable caching, or setup your own bind mount for it | 15:48 |
neith | odyssey4me: checking the hard way with dd lol | 15:51 |
*** woodard has joined #openstack-ansible | 15:51 | |
odyssey4me | neith with the bind mount in place, that probably won't work either | 15:51 |
odyssey4me | you need to ensure that you only check the root device - no other devices | 15:52 |
*** Disova has quit IRC | 15:52 | |
erhudy | anyone have a handy script for checking out all the OSA role repos from github in one go :v | 15:52 |
neith | so I cant dump >15GB in the container | 15:53 |
neith | so its not a space problem anymore | 15:53 |
odyssey4me | erhudy not all of them - but the ansible bootstrap script can be set to do a git checkout | 15:53 |
neith | I can | 15:53 |
odyssey4me | erhudy you can probably use the same playbook to check them out to another location | 15:54 |
*** vnogin has quit IRC | 15:54 | |
*** dxiri has quit IRC | 15:55 | |
logan- | erhudy: https://github.com/openstack/openstack-ansible/blob/master/tests/get-ansible-role-requirements.yml may be helpful? | 15:56 |
*** dxiri has joined #openstack-ansible | 15:56 | |
*** galstrom_zzz is now known as galstrom | 15:56 | |
logan- | if you specifically want to fetch from github instead of git.openstack.org you can provide a path to an overridden ansible-role-requirements file using the "role_file" var | 15:57 |
erhudy | i am having a quick chat with the github API to get them, this is just so i can get everything in one place and start reading the playbooks without having to jump all over | 15:58 |
logan- | gotcha. that playbook will fetch all of the roles to /etc/ansible/roles | 15:59 |
erhudy | yeah, i usually work on a mac and the OSA bootstrap scripts don't really play nice there | 15:59 |
logan- | you could "ansible-playbook -e role_path_default=/home/erhudy/osaroles get-ansible-role-requirements.yml" | 16:00 |
*** cmart has joined #openstack-ansible | 16:02 | |
openstackgerrit | Merged openstack/openstack-ansible: Fix default IPv6 BGP peer for BIRD https://review.openstack.org/408822 | 16:03 |
openstackgerrit | Merged openstack/openstack-ansible: Remove irrelevant cinder_backends in glance configuration https://review.openstack.org/409075 | 16:03 |
openstackgerrit | Logan V proposed openstack/openstack-ansible: Fix default IPv6 BGP peer for BIRD https://review.openstack.org/409206 | 16:03 |
neith | there is still something preventing me to upload images larger than 12GB | 16:04 |
erhudy | i can probably get that working, though it does rather aggressively want to try to put stuff in /etc/ansible | 16:04 |
erhudy | oh | 16:04 |
erhudy | i can't type | 16:04 |
*** woodard has quit IRC | 16:07 | |
odyssey4me | neith there might be a setting for glance that gives a max image size? | 16:08 |
odyssey4me | it might be a default, or it might be something in the config file - not sure | 16:08 |
neith | Don't worry I'll check Monday it's beer time | 16:10 |
odyssey4me | neith agreed :) | 16:11 |
*** sdake has joined #openstack-ansible | 16:13 | |
*** Jack_Iv_ has quit IRC | 16:14 | |
*** thorst__ has joined #openstack-ansible | 16:15 | |
*** thorst_ has quit IRC | 16:17 | |
*** Jack_Iv has quit IRC | 16:20 | |
*** pegmanm_ has joined #openstack-ansible | 16:23 | |
*** whiteveil has joined #openstack-ansible | 16:24 | |
*** pegmanm_ has quit IRC | 16:24 | |
*** swente has joined #openstack-ansible | 16:25 | |
*** Jack_Iv has joined #openstack-ansible | 16:25 | |
*** adrian_otto has joined #openstack-ansible | 16:27 | |
*** vnogin has joined #openstack-ansible | 16:27 | |
*** vnogin has quit IRC | 16:27 | |
*** karimb has quit IRC | 16:29 | |
*** jproulx has joined #openstack-ansible | 16:31 | |
mgariepy | have a nice weekend everyone | 16:33 |
jproulx | walking through first attempt at OSA using stable/newton on xenial. Seems /etc/network/interafaces in containers is missing the "source /etc/network/interfaces.d/*.cfg" line needed to reach the eth1.cfg ... scratching my head trying to figure out how that could be | 16:35 |
logan- | interesting jproulx. looking at how that gets there.. lxc_hosts role generates that file when it builds the base container template on each host. https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/vars/ubuntu-16.04.yml#L70 and https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/vars/ubuntu-16.04.yml#L94-L102 | 16:40 |
jproulx | and of course that includes the magic line... | 16:41 |
*** Jack_Iv_ has joined #openstack-ansible | 16:42 | |
erhudy | this lxc_hosts host thing has me a bit confused, along with how inventory is managed in general, but i will stagger through it | 16:42 |
jproulx | as does mine on the deploy host | 16:43 |
*** Guest2615 is now known as ioni | 16:43 | |
*** ioni is now known as Guest56248 | 16:44 | |
*** Jack_Iv_ has quit IRC | 16:46 | |
*** chhavi has joined #openstack-ansible | 16:49 | |
logan- | jproulx: re-running the lxc-hosts-setup role will regenerate the container template, you could try that. the template is stored in /var/cache/lxc on your controller hosts. you can extract it to verify it has the correct template deployed to /etc/network/interfaces, or you could just destroy and recreate some containers after the template is rebuilt | 16:50 |
*** electrofelix has quit IRC | 16:50 | |
jproulx | logan- thanks for the pointer, maybe just too much cruft build up during iterative fixes to this point. Trying a hard flush | 16:51 |
mattt | logan-: just hit the trusty systemd issue, saw your bug | 16:53 |
*** galstrom is now known as galstrom_zzz | 16:54 | |
logan- | mattt: :/ | 16:54 |
logan- | mattt: i've not checked to see if this happens on mitaka's 1.9.4 ansible yet. do you know if it is affecting mitaka too? | 16:56 |
*** schwicht has joined #openstack-ansible | 16:56 | |
logan- | I only confirmed it on newton/2.1.1.0 | 16:56 |
*** galstrom_zzz is now known as galstrom | 16:58 | |
mattt | logan-: i have a liberty and mitaka build that succeeded, so hopefully it's just limited to 2.1.1.0 | 16:58 |
*** maeker has joined #openstack-ansible | 16:59 | |
mattt | logan-: so it must be a new package that got released right? | 16:59 |
logan- | yep | 16:59 |
logan- | ansible looks for /run/systemd/system to check for systemd vs upstart. if that dir exists, you're not an upstart system according to ansible. and trusty released a new systemd package yesterday that creates this dir | 17:00 |
*** Oku_OS is now known as Oku_OS-away | 17:01 | |
*** lorid has joined #openstack-ansible | 17:02 | |
*** asettle has quit IRC | 17:02 | |
mattt | logan-: i'm on an instance deployed on the 7th and all systemd-packages are the same | 17:02 |
*** fabg has joined #openstack-ansible | 17:02 | |
*** asettle has joined #openstack-ansible | 17:03 | |
*** pcaruana has quit IRC | 17:03 | |
*** h5t4 has quit IRC | 17:04 | |
jrosser_ | cloudnull: you there? | 17:04 |
logan- | systemd = 204-5ubuntu20.20? | 17:04 |
*** asettle__ has joined #openstack-ansible | 17:05 | |
mattt | logan-: ah crap, my bad | 17:05 |
mattt | logan-: i was looking on the host, and not the container | 17:05 |
logan- | gotcha | 17:05 |
mattt | logan-: i just booted the host but i guess packages weren't upgraded, so yeah host and container are not in sync | 17:05 |
logan- | yeah I think during the base container build you might end up with a dist-upgrade or something that pulls in the upgraded systemd package. I didn't look at where osa pulls it in just yet. Figured we'd see how much traction the bug/fix gets first and then look at patching up OSA if ansible drags their feet | 17:07 |
mattt | logan-: uninstalling systemd puts that shim package in place | 17:07 |
mattt | logan-: but is this an ansible bug? feels like a trusty issue tbh :( | 17:07 |
logan- | yeah I think both | 17:07 |
*** asettle has quit IRC | 17:07 | |
logan- | i think ansible's way of checking for systemd dirs instead of /proc/1/comm is probably less reliable and worth a fix | 17:08 |
logan- | but maybe its worth raising with ubuntu too | 17:09 |
mattt | that'll take an eternity to be addressed tho :-/ | 17:09 |
*** asettle__ has quit IRC | 17:09 | |
logan- | p much | 17:10 |
odyssey4me | do we have alternative options? | 17:10 |
odyssey4me | maybe we have to implement a task-based workaround instead of relying on the facts... ie reverting the patches we recently merged :/ | 17:10 |
logan- | odyssey4me: we will have to revert all of the ansible_system_mgr tasks to use /proc/1/comm again | 17:10 |
logan- | that works around the fact issue | 17:10 |
logan- | but the service module is still broken | 17:10 |
odyssey4me | argh | 17:10 |
cloudnull | jrosser_: i am | 17:11 |
*** Cooper has joined #openstack-ansible | 17:11 | |
odyssey4me | so I think we need to collectively raise a stink to push the visibility of cloudnull's PR to ansible | 17:11 |
odyssey4me | ie we need to work together to raise the visibility of the issue | 17:12 |
mattt | could we get the base container to uninstall systemd? | 17:12 |
evrardjp | what's the issue? | 17:12 |
logan- | yeah it is a pretty big deal well beyond OSA i'd think. either ubuntu or ansible should consider it fairly urgent | 17:12 |
odyssey4me | this is obviously going to hit a lot of people | 17:12 |
mattt | removing systemd puts systemd-shim in place | 17:12 |
mattt | which looks like my working build | 17:12 |
evrardjp | oh I read the thing | 17:12 |
odyssey4me | maybe it's worth pushing a post to the ansible group for it | 17:12 |
evrardjp | ubuntu added a package that makes a lts branch not really stable | 17:13 |
evrardjp | well yes it's gonna probably get attention | 17:13 |
odyssey4me | I mean, this is pretty much going to render all Newton builds from the point of using an updated Ubuntu Trusty useless | 17:13 |
evrardjp | did you speak in #ansible and ansible-dev ? | 17:13 |
evrardjp | devel* | 17:13 |
logan- | yep odyssey4me. newton+trusty is dead in the water right now | 17:13 |
logan- | im glad to hear it may not be affecting 1.9 though | 17:14 |
odyssey4me | the blame is squarely in Ubuntu's court, sure - but we have a PR to improve the detection in Ansible that solves it | 17:14 |
odyssey4me | logan- 1.9 did not have that fact | 17:14 |
odyssey4me | well, so I'm told | 17:14 |
evrardjp | well we need a bug | 17:14 |
cloudnull | these pr's should "fix" ansible https://github.com/ansible/ansible/pull/19034 https://github.com/ansible/ansible-modules-core/pull/5865 | 17:14 |
logan- | odyssey4me: the service module and the package_mgr fact use the same method to detect systemd | 17:14 |
evrardjp | in osa | 17:14 |
logan- | so we don't use the fact, but service restarts may be broken on 1.9 | 17:15 |
mattt | logan-: we have 1.9 jobs passing, but i'm wondering if they're using an old mirror that doesn't have that package or something | 17:15 |
mattt | i'll need to dig in to be sure | 17:15 |
logan- | mattt: let me kick off a mitaka check on my end to see as well | 17:16 |
odyssey4me | cloudnull https://github.com/ansible/ansible-modules-core/pull/5865 is failing tests | 17:16 |
*** Jack_Iv_ has joined #openstack-ansible | 17:16 | |
jrosser_ | cloudnull: we got 90% of multinode aio working on xenial host with xenial vm | 17:17 |
*** Jack_Iv_ has quit IRC | 17:17 | |
jrosser_ | had to do huge work so the original bash based stuff is unrecognisable | 17:18 |
odyssey4me | logan- evrardjp mattt ok, so to get the workaround into Ansible we need to raise awareness - who's going to post to the Ansible group or register the bug for it? | 17:18 |
*** schwicht has quit IRC | 17:18 | |
*** sdake_ has joined #openstack-ansible | 17:18 | |
odyssey4me | once that's done we can ping jimic on twitter and raise awareness via IRC and all that | 17:18 |
evrardjp | Let's register the bug in OSA, this way we can point ubuntu and ansible there | 17:18 |
mattt | odyssey4me: there's a bug already | 17:19 |
logan- | odyssey4me: I registered a bug last night when I found it | 17:19 |
odyssey4me | ah awesome :) link? | 17:19 |
logan- | https://github.com/ansible/ansible/issues/19030 | 17:19 |
odyssey4me | duh, it's references in the PR's :p | 17:19 |
mattt | i found that when troubleshooting alextricity25's sha bump failure :) | 17:19 |
evrardjp | fun stuff | 17:20 |
mattt | does noone have any contacts at ansible? | 17:20 |
evrardjp | thanks ansible for writing code that once again doesn't makes sense | 17:21 |
Cooper | hello. I was wondering if anyone had time to look over my openstack_user_config.yml file to ensure it looks ok. I'll be starting my second attempt at installing Newton so wanted to get a thumbs up first. thanks in advance. http://paste.openstack.org/show/591966/ | 17:21 |
*** sdake has quit IRC | 17:21 | |
odyssey4me | ok, I've pinged jimic in the bug - time to post in the group | 17:22 |
*** chhavi__ has joined #openstack-ansible | 17:23 | |
logan- | thanks odyssey4me | 17:23 |
logan- | I think we're OK on 1.9 https://github.com/ansible/ansible-modules-core/blob/746d51d1ff7a7bb3c2c71a2d8239cba93b6dea96/system/service.py#L408-L425 | 17:25 |
evrardjp | I tried the blind approach in #ansible-devel | 17:25 |
evrardjp | let's see | 17:25 |
*** chhavi has quit IRC | 17:25 | |
cloudnull | odyssey4me: looks like the failure there is that the shippable bits are missing | 17:26 |
cloudnull | "failed to find shippable yml file" | 17:26 |
cloudnull | https://app.shippable.com/runs/584a22cbc42d210f009d95fb/1/console | 17:26 |
cloudnull | idk if that's a me thing or a them thing | 17:27 |
odyssey4me | https://groups.google.com/forum/#!topic/ansible-devel/dCEYP4Ojs2Q | 17:27 |
*** whiteveil has quit IRC | 17:28 | |
odyssey4me | logan- if we action any reverts, I suggest that the commit message references the bug so that it shows up in the issue history | 17:29 |
odyssey4me | it will increase the activity on the issue, which shows the impact | 17:29 |
evrardjp | why not having a task that removes systemd on trusty? | 17:30 |
odyssey4me | evrardjp mattt is busy trying that | 17:31 |
odyssey4me | but as far as I recall, systemd is there for quite a few things | 17:31 |
*** schwicht has joined #openstack-ansible | 17:31 | |
odyssey4me | so removing it is not really an option - the key is what's managing the init | 17:31 |
mattt | brb | 17:32 |
logan- | yeah def will reference the bug if any reverts come up. really want to avoid that and look for other workarounds though | 17:33 |
cloudnull | https://twitter.com/cloudnull/status/807277106057056256 | 17:34 |
jrosser_ | how should we approach contributing our work on the multinode aio? | 17:34 |
cloudnull | We sent up the bat signal :) | 17:34 |
jrosser_ | reason i ask is that it's been massively invasive on the one for trusty | 17:34 |
jrosser_ | and to an extent is like starting again, rather than nice small incremental patches | 17:34 |
cloudnull | jrosser_: Good to know that its close | 17:34 |
jrosser_ | so a whole new dir in the -ops repo is an option | 17:35 |
cloudnull | jrosser_: I'd pull it in as a new directory | 17:35 |
cloudnull | in the ops repo | 17:35 |
odyssey4me | #FridayLove | 17:35 |
logan- | odyssey4me: reason i'm against reverting the fact stuff is it gains us no ground w/ the root problem. builds still won't succeed due to the broken service module | 17:35 |
cloudnull | ++ | 17:35 |
logan- | so we'll have to find another fix | 17:35 |
odyssey4me | logan- yeah, agreed - we'd have to device a workaround for the service problem too | 17:35 |
odyssey4me | and who knows what regressions that may bring | 17:35 |
cloudnull | we can patch ansible and install from that. | 17:35 |
evrardjp | cloudnull: retweeted | 17:35 |
cloudnull | :) | 17:36 |
*** schwicht has quit IRC | 17:36 | |
evrardjp | ahah probably better, we'll eventuall fork it and make it great if that continues cloudnull | 17:36 |
logan- | lol | 17:36 |
cloudnull | make ansible great again | 17:36 |
cloudnull | logan-: do we have the recent ubuntu commit that caused the new files to get dropped ? | 17:37 |
*** karimb has joined #openstack-ansible | 17:38 | |
*** fxpester has quit IRC | 17:38 | |
logan- | should be in the bug cloudnull | 17:39 |
logan- | systemd: | 17:39 |
logan- | Installed: 204-5ubuntu20.20 | 17:39 |
logan- | could be in one of the associated packages that was updated at the same time http://cdn.pasteraw.com/p6zhahlfsncviz41gxhl5n0e2blklij -- but something in that group | 17:40 |
cloudnull | ok, cool . thanks | 17:42 |
cloudnull | jrosser_: I think a new dir is the best way forward. | 17:42 |
cloudnull | and then we can rename the old one that way folks know old == trusty, new == xenial | 17:43 |
jrosser_ | yeah just talking about it with stuartgr | 17:43 |
cloudnull | cool | 17:43 |
jrosser_ | we've ripped out cobbler, use stock dhcpd and tftpd instead | 17:44 |
jrosser_ | very simple no fuss | 17:44 |
*** Guest56248 is now known as ioni | 17:44 | |
jrosser_ | half the bash is now ansible, need to do that to the rest | 17:44 |
*** boxrick1 has joined #openstack-ansible | 17:45 | |
odyssey4me | sounds good :) | 17:45 |
*** ioni is now known as Guest69805 | 17:45 | |
*** Jeffrey4l has quit IRC | 17:45 | |
*** h5t4 has joined #openstack-ansible | 17:45 | |
cloudnull | jrosser_: ++ win! | 17:47 |
*** chris_hultin is now known as chris_hultin|AWA | 17:47 | |
cloudnull | evrardjp: any traction in #ansible #ansible-devel | 17:47 |
cloudnull | ? | 17:47 |
*** sdake_ has quit IRC | 17:51 | |
evrardjp | not really | 17:52 |
evrardjp | didn't try #ansible | 17:52 |
evrardjp | it's usually a not really helpful channel | 17:53 |
evrardjp | :/ | 17:53 |
cloudnull | fired off a message. | 17:53 |
cloudnull | just in case. | 17:53 |
*** schwicht has joined #openstack-ansible | 17:57 | |
cloudnull | in the meantime we can simply remove /run/systemd/system | 18:03 |
cloudnull | on a proactive basis | 18:03 |
cloudnull | and then revert said thing once upstream is fixed. | 18:03 |
*** stuartgr has left #openstack-ansible | 18:04 | |
odyssey4me | would this be hosts only, or hosts, containers, everywhere? | 18:04 |
cloudnull | everywhere | 18:05 |
*** TxGirlGeek has joined #openstack-ansible | 18:05 | |
*** schwicht has quit IRC | 18:08 | |
logan- | i'm looking at some stuff on trusty right now. when i boot up trusty it doesn't have systemd installed, instead systemd-shim is there. something pulls in systemd and replaces the -shim it seems. pulling some apt logs of what is doing all of that | 18:08 |
mattt | logan-: so it's not an apt-get update that does it ? | 18:11 |
mattt | logan-: my containers that were provisioned but not deployed don't have systemd-shim in them | 18:12 |
mattt | so i don't think it's the result of installing something | 18:12 |
*** maeker has quit IRC | 18:13 | |
logan- | http://cdn.pasteraw.com/bngisygxhc0a1m9bswl78o2wnie84lf | 18:14 |
logan- | not getting pulled in there | 18:14 |
logan- | now to check my broken newton env from last night and see what pulled it in | 18:14 |
cloudnull | I too have a broken trusty env online | 18:15 |
cloudnull | which was simply kicked using the latest 14.04 iso | 18:15 |
logan- | http://cdn.pasteraw.com/9ehss6d3h026po8v2me2xo87r705dhx | 18:16 |
*** maeker has joined #openstack-ansible | 18:16 | |
logan- | that's what pulled it in to my broken container | 18:17 |
*** h5t4 has quit IRC | 18:17 | |
mattt | logan-: if i unarchive rootfs.tar.xz, it has it in it already | 18:17 |
mattt | logan-: could that be an artifact from the creation of the image? | 18:18 |
logan- | yep that cmdline is the list of packages here https://github.com/openstack/openstack-ansible-lxc_hosts/blob/stable/newton/vars/ubuntu-14.04.yml#L89-L141 | 18:18 |
logan- | systemd is not being explicitly installed but it is pulled in by that list of packages | 18:19 |
*** h5t4 has joined #openstack-ansible | 18:19 | |
logan- | and that package list is the base container template packages | 18:19 |
mattt | logan-: makes sense | 18:19 |
logan- | lvm2 | 18:20 |
cloudnull | :\ | 18:20 |
logan- | no | 18:20 |
mattt | libdbus ? | 18:20 |
logan- | nevermind, that was apt-cache rdepends, my bad | 18:20 |
cloudnull | I was going to pack up and go home if it was lvm2 | 18:21 |
cloudnull | :) | 18:21 |
mattt | hahaha | 18:21 |
cloudnull | so it's not just the containers. | 18:21 |
cloudnull | hosts deployed by the latest 14.04 iso have this issue too | 18:22 |
logan- | none of the packages in that list directly depend on systemd. now i have to figure out how to pull a dependency graph | 18:22 |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-security: Ensure separate filesystems exist [+Docs] https://review.openstack.org/407199 | 18:22 |
cloudnull | example https://snag.gy/my4F7f.jpg | 18:23 |
cloudnull | ^ which tells me this is mhayden's fault. | 18:23 |
logan- | so apt-cache rdepends --installed systemd may help track this down | 18:23 |
*** asettle has joined #openstack-ansible | 18:24 | |
mhayden | uh oh, what did i break today | 18:24 |
cloudnull | ubuntu 14.04 | 18:24 |
cloudnull | :) | 18:24 |
logan- | dbus depends on libsystemd-login0 | 18:25 |
cloudnull | http://cdn.pasteraw.com/d55qaq81g8sq8iyd7in7yi3ydefg4gj | 18:25 |
kysse | and systend depends on dbus | 18:25 |
kysse | its fun fun fun | 18:25 |
*** asettle has quit IRC | 18:26 | |
*** asettle has joined #openstack-ansible | 18:26 | |
mattt | logan-: also doesn't liblxc have some dependency on it there | 18:26 |
mattt | meaning this would be a problem on hosts | 18:27 |
*** schwicht has joined #openstack-ansible | 18:29 | |
*** fabg has quit IRC | 18:31 | |
*** whiteveil has joined #openstack-ansible | 18:32 | |
logan- | still digging mattt. on my blank vm that package list didn't pull in systemd the same way it did in the container. http://cdn.pasteraw.com/1hyoqbfh5pdblvsdlbrfpg0izp4ukmm | 18:33 |
*** schwicht has quit IRC | 18:35 | |
cloudnull | logan-: this is from a new vm which has had the host-setup playbook run on it. http://cdn.pasteraw.com/jhlphx80oh80ib34tnq3mocydpj0nzz | 18:37 |
logan- | gotcha. apt-cache policy systemd shows not installed right? | 18:37 |
logan- | looks like the shim is updated there but no systemd install | 18:37 |
cloudnull | http://cdn.pasteraw.com/gqd2rwwjgtzwp5r2ifmankxl1iy79uh | 18:38 |
logan- | confirmed i'm not seeing systemd on my hosts, only containers | 18:41 |
logan- | I wonder if the lxc caches are shipping with it | 18:41 |
mattt | logan-: yeah | 18:41 |
mattt | that's what i thought | 18:41 |
mattt | i chroot'd to the image and it was there | 18:41 |
mattt | but i too saw it getting pulled in in the apt logs | 18:42 |
mattt | so a bit confused tbh | 18:42 |
cloudnull | that said, the issue is still present even on new hosts. | 18:42 |
cloudnull | with a new deployment using hosts kicked by iso ansible it's still exploding | 18:43 |
*** chhavi__ has quit IRC | 18:44 | |
*** chhavi__ has joined #openstack-ansible | 18:44 | |
*** Guest69805 is now known as ioni | 18:45 | |
* odyssey4me goes to get a drink | 18:45 | |
*** ioni is now known as Guest21974 | 18:45 | |
*** PramodJayathirth has joined #openstack-ansible | 18:46 | |
*** javeriak has joined #openstack-ansible | 18:46 | |
*** javeriak has quit IRC | 18:46 | |
*** javeriak has joined #openstack-ansible | 18:47 | |
mattt | cloudnull: yeah, we could simply uninstall from the containers but that doesn't solve the host piece | 18:47 |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-os_magnum: Use common heat test playbook and vars https://review.openstack.org/409304 | 18:48 |
cloudnull | also IDK if uninstalling it would cause other breakage. | 18:48 |
*** vnogin has joined #openstack-ansible | 18:48 | |
odyssey4me | uninstalling systemd is like removing your heart | 18:49 |
cloudnull | yea i think that may be the case. | 18:49 |
*** fabg has joined #openstack-ansible | 18:49 | |
logan- | i'm not seeing it on my hosts :/ | 18:50 |
logan- | can you pastebin the /var/log/apt/history.log from the host where systemd is getting pulled in | 18:50 |
*** pramodrj07 has joined #openstack-ansible | 18:51 | |
odyssey4me | https://www.youtube.com/watch?v=Trhg8g_tRKc | 18:51 |
odyssey4me | oh wow, talk about a wormhole.... https://www.youtube.com/watch?v=2YxPFw7lfY0 | 18:52 |
logan- | http://cdn.pasteraw.com/5ak7cdymce5l4idaicku09uhdhq64m so it doesn't seem to be coming from the upstream template | 18:58 |
odyssey4me | no, the upstream template is very bare | 18:59 |
odyssey4me | are you sure that it's the 'systemd' package that brings that file in | 19:00 |
cloudnull | logan-: http://cdn.pasteraw.com/fehcec87n39kdyzehi94o5w8fjmy98p | 19:01 |
cloudnull | sorry | 19:01 |
cloudnull | was not watching | 19:01 |
odyssey4me | just for fun, also remember that on the hosts we add the backports repo | 19:01 |
*** poopcat has joined #openstack-ansible | 19:02 | |
*** javeriak has quit IRC | 19:04 | |
logan- | so installing systemd, systemd-services, and libsystemd-journal0 did not break this trusty vm even after a reboot (/run/systemd/system still does not exist.) | 19:08 |
logan- | conversely, if i take a broken container and install systemd-shim with no other changes, /run/systemd/system is gone | 19:09 |
*** schwicht has joined #openstack-ansible | 19:09 | |
odyssey4me | weird | 19:10 |
*** poopcat has quit IRC | 19:11 | |
NostawRm | dumb question time. in regards to centos, if I'm not wanting the master branch, is there some benefit to getting openstack from git the way openstack-ansible does instead of from the repo? | 19:11 |
NostawRm | if its detailed in the docs, I may have over looked it | 19:12 |
*** fabg has quit IRC | 19:12 | |
*** david-lyle_ is now known as david-lyle | 19:13 | |
odyssey4me | NostawRm you get patches when they merge, not several months down the line when packagers release... also, once a release is EOL, you can patch it yourself. | 19:14 |
*** asettle has quit IRC | 19:16 | |
*** asettle has joined #openstack-ansible | 19:16 | |
odyssey4me | anyway, I'm out all - have a great w/end | 19:17 |
*** weezS_ has joined #openstack-ansible | 19:18 | |
*** Jack_Iv_ has joined #openstack-ansible | 19:18 | |
*** weezS has quit IRC | 19:20 | |
*** weezS_ is now known as weezS | 19:20 | |
*** asettle has quit IRC | 19:21 | |
*** Jack_Iv_ has quit IRC | 19:22 | |
errr | hello, starting in newton are any of the serivce accounts still using v2 auth or has everything been moved to v3? | 19:22 |
*** poopcat has joined #openstack-ansible | 19:23 | |
*** woodard has joined #openstack-ansible | 19:26 | |
openstackgerrit | Logan V proposed openstack/openstack-ansible-lxc_hosts: Resolve systemd trusty issue https://review.openstack.org/409312 | 19:30 |
logan- | cloudnull: ^ | 19:31 |
*** javeriak has joined #openstack-ansible | 19:34 | |
mattt | logan-: that works does it? | 19:34 |
mattt | logan-: so wait, is master not affected? | 19:35 |
logan- | 14.04 is deprecated in master | 19:35 |
mattt | ah true | 19:35 |
*** galstrom is now known as galstrom_zzz | 19:37 | |
*** chris_hultin|AWA is now known as chris_hultin | 19:37 | |
*** galstrom_zzz is now known as galstrom | 19:37 | |
*** woodard has quit IRC | 19:40 | |
erhudy | logan-: is there a fun trick to getting your pip_install install-offline playbook to use proxies | 19:41 |
*** galstrom is now known as galstrom_zzz | 19:41 | |
*** schwicht has quit IRC | 19:41 | |
logan- | if you have proxy envvars set on the box you're running ansible on I think it will use them. I have not tried though | 19:42 |
erhudy | ah, i tried setting them on the ansible-playbook command but it defies me | 19:42 |
logan- | pip_install_offline=yes makes it funnel the pip wheels thru your ansible host instead of fetching them directly to the target | 19:42 |
erhudy | ah, it still assumes the ansible host has unproxied internet access | 19:43 |
*** openstack has joined #openstack-ansible | 19:47 | |
evrardjp | erhudy: I'm pretty sure everything is documented for offline | 19:50 |
*** Jack_Iv_ has joined #openstack-ansible | 19:50 | |
evrardjp | if not we have a bug | 19:51 |
*** Jack_Iv_ has quit IRC | 19:51 | |
*** schwicht has quit IRC | 19:52 | |
*** lorid has quit IRC | 19:54 | |
*** dxiri_ has joined #openstack-ansible | 19:54 | |
*** sdake has joined #openstack-ansible | 19:57 | |
*** dxiri has quit IRC | 19:57 | |
*** johnmilton has quit IRC | 19:59 | |
evrardjp | I read the log, ubuntu really messed up big time | 19:59 |
*** zz_pwnall1337 is now known as pwnall1337 | 19:59 | |
*** weezS has quit IRC | 19:59 | |
*** schwicht has joined #openstack-ansible | 20:00 | |
*** Jack_Iv has quit IRC | 20:00 | |
evrardjp | logan-: any idea why systemd-shim wasn't installed? | 20:01 |
evrardjp | on my systems it gets automatically pulled in | 20:01 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-rabbitmq_server: Add repo installation method https://review.openstack.org/408015 | 20:04 |
*** Jack_Iv has joined #openstack-ansible | 20:05 | |
logan- | heh evrardjp.. http://cdn.pasteraw.com/576tspbup5pwuh114uc28febskgc63m shows which package is pulling it into the base container | 20:06 |
logan- | cgmanager-utils | 20:06 |
*** chhavi__ has quit IRC | 20:06 | |
evrardjp | ok let me have a look if I have cgmanager | 20:07 |
logan- | the other thing is systemd-shim might satisfy the systemd requirement | 20:08 |
logan- | so remove systemd-shim (the containers don't have it by default) | 20:08 |
evrardjp | so I don't have cgmanager-utils on a test instance | 20:08 |
logan- | and then install cgmanager-utils | 20:08 |
evrardjp | I have cgmanager | 20:08 |
evrardjp | and when I recently updated, apt-get update auto pulled systemd-shim | 20:09 |
evrardjp | update/upgrade | 20:09 |
evrardjp | interesting | 20:09 |
evrardjp | you are right about the cgmanager-utils working with systemd-shim | 20:10 |
evrardjp | I'm surprised | 20:10 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts: Resolve systemd trusty issue https://review.openstack.org/409312 | 20:10 |
mattt | logan-: that works for me, my build is now crusing | 20:11 |
mattt | *cruising | 20:11 |
logan- | awesome mattt | 20:11 |
evrardjp | mattt: yes I've tested it and it worked | 20:11 |
evrardjp | the workaround works but I'm surprised we had to force this | 20:11 |
evrardjp | I want to understand a little more | 20:11 |
evrardjp | :D | 20:11 |
logan- | yeah :/ | 20:11 |
logan- | can we force sha bump the lxc_hosts role in the integrated repo? | 20:12 |
*** Mudpuppy has quit IRC | 20:12 | |
evrardjp | we can have a commit to bump it | 20:13 |
evrardjp | if you do it I can vote | 20:13 |
openstackgerrit | Logan V proposed openstack/openstack-ansible: Bump lxc_hosts SHA to include trusty/systemd fix https://review.openstack.org/409320 | 20:13 |
NostawRm | I'm going to have to revist openstack-ansible once centos is less WIP for it :( I love so many of the concepts in in the more I look at it | 20:15 |
NostawRm | venvs is what made me say that atm lol | 20:16 |
*** thorst__ has quit IRC | 20:18 | |
*** hwoarang has quit IRC | 20:18 | |
*** thorst has joined #openstack-ansible | 20:19 | |
evrardjp | NostawRm: don't hesitate to submit patches/bug if you want to accelerate the centos 7 adoption :) | 20:19 |
NostawRm | haha, don't tempt me, I'm already dying to waste time at work on digging into it to understand it better | 20:23 |
NostawRm | there's a lot of it I don't know | 20:23 |
*** hwoarang has joined #openstack-ansible | 20:24 | |
*** Jack_Iv_ has joined #openstack-ansible | 20:25 | |
evrardjp | I think we have good docs NostawRm :D | 20:26 |
*** thorst has quit IRC | 20:27 | |
NostawRm | welp, that gives me less of an excuse then | 20:27 |
*** schwicht has quit IRC | 20:28 | |
*** darrenc_ has joined #openstack-ansible | 20:30 | |
*** woodard has quit IRC | 20:31 | |
*** Jack_Iv_ has quit IRC | 20:32 | |
*** TxGirlGeek has quit IRC | 20:33 | |
*** TxGirlGeek has joined #openstack-ansible | 20:33 | |
*** kstev has joined #openstack-ansible | 20:34 | |
*** fabg has quit IRC | 20:40 | |
*** TxGirlGeek has quit IRC | 20:41 | |
*** TxGirlGeek has joined #openstack-ansible | 20:42 | |
*** thorst has joined #openstack-ansible | 20:44 | |
*** TxGirlGeek has quit IRC | 20:45 | |
*** TxGirlGeek has joined #openstack-ansible | 20:45 | |
*** Guest30026 is now known as ioni | 20:47 | |
*** thorst has quit IRC | 20:47 | |
*** ioni is now known as Guest37147 | 20:47 | |
*** kstev has quit IRC | 20:49 | |
*** darrenc_ has quit IRC | 20:50 | |
*** TxGirlGeek has quit IRC | 20:51 | |
*** woodard has joined #openstack-ansible | 20:51 | |
*** TxGirlGeek has joined #openstack-ansible | 20:51 | |
*** Jack_Iv_ has joined #openstack-ansible | 20:55 | |
*** TxGirlGeek has quit IRC | 20:56 | |
*** jamielennox|away is now known as jamielennox | 20:58 | |
*** TxGirlGeek has joined #openstack-ansible | 20:58 | |
*** schwicht has joined #openstack-ansible | 21:01 | |
*** TxGirlGeek has quit IRC | 21:03 | |
*** woodard has quit IRC | 21:03 | |
*** woodard has joined #openstack-ansible | 21:04 | |
*** pwnall1337 is now known as zz_pwnall1337 | 21:07 | |
*** maeker has quit IRC | 21:08 | |
*** adrian_otto has quit IRC | 21:08 | |
*** maeker has joined #openstack-ansible | 21:08 | |
openstackgerrit | Michael Gugino proposed openstack/openstack-ansible-ceph_client: Properly distribute extra ceph client keys https://review.openstack.org/409335 | 21:13 |
*** dxiri_ has quit IRC | 21:13 | |
*** dxiri has joined #openstack-ansible | 21:14 | |
*** TxGirlGeek has joined #openstack-ansible | 21:14 | |
*** javeriak has quit IRC | 21:14 | |
*** thorst_ has joined #openstack-ansible | 21:14 | |
*** woodard has quit IRC | 21:18 | |
*** woodard has joined #openstack-ansible | 21:24 | |
*** maeker has quit IRC | 21:27 | |
*** fabg has joined #openstack-ansible | 21:32 | |
*** smatzek has quit IRC | 21:33 | |
bgmccollum | where are all the places that inventory hosts might be cached? i got /etc/openstack/{openstack_hostnames_ips.yml,openstack_inventory.json,ansible_facts} | 21:33 |
bgmccollum | i delete those, and run setup-infra and its it know about all the containers, when it shouldn't | 21:34 |
bgmccollum | i guess i should say, it tries to run `setup` against the containers, which dont exist, because ive destroyed them, but it somehow knows about them, which it shouldn't | 21:36 |
palendae | Only other thing I can think of is the hosts file | 21:37 |
bgmccollum | yeah killed that too | 21:37 |
palendae | Hrm | 21:37 |
bgmccollum | isn't there some memcache option too? was that ever enabled? | 21:37 |
*** adrian_otto has joined #openstack-ansible | 21:37 | |
openstackgerrit | Michael Gugino proposed openstack/openstack-ansible-ceph_client: Properly distribute extra ceph client keys https://review.openstack.org/409335 | 21:38 |
palendae | Not that I'm aware of | 21:38 |
bgmccollum | ok, | 21:39 |
bgmccollum | ill just take a hammer to this rack. it must be posessed. | 21:39 |
*** retreved has quit IRC | 21:43 | |
*** Guest37147 is now known as ioni | 21:48 | |
*** ioni is now known as Guest19157 | 21:48 | |
erhudy | maybe strace ansible to see every path it opens | 21:50 |
erhudy | drink from the firehose | 21:50 |
bgmccollum | no, its possessed. it must be cleansed. | 21:53 |
erhudy | by fire be purged | 21:53 |
bgmccollum | i prefer water, so it will never rise again. | 21:54 |
bgmccollum | full on submerge | 21:54 |
*** kylek3h_away has quit IRC | 21:59 | |
*** thorst_ has quit IRC | 22:04 | |
*** jamielennox is now known as jamielennox|away | 22:04 | |
*** thorst_ has joined #openstack-ansible | 22:04 | |
palendae | What is dead may never die | 22:05 |
*** jamielennox|away is now known as jamielennox | 22:11 | |
*** thorst_ has quit IRC | 22:13 | |
*** Jack_Iv_ has quit IRC | 22:16 | |
*** asettle has joined #openstack-ansible | 22:19 | |
openstackgerrit | Michael Gugino proposed openstack/openstack-ansible-os_nova: Allow libvirt rbd params to be independent of cinder https://review.openstack.org/409353 | 22:22 |
*** gouthamr has quit IRC | 22:23 | |
*** fguillot has quit IRC | 22:23 | |
*** asettle has quit IRC | 22:24 | |
*** Jack_Iv has quit IRC | 22:24 | |
*** jamesdenton has quit IRC | 22:28 | |
*** fabg has quit IRC | 22:30 | |
*** poopcat has quit IRC | 22:35 | |
*** spotz is now known as spotz_zzz | 22:38 | |
*** Mudpuppy has joined #openstack-ansible | 22:38 | |
*** kylek3h_away has joined #openstack-ansible | 22:41 | |
*** retreved has joined #openstack-ansible | 22:41 | |
*** poopcat has joined #openstack-ansible | 22:48 | |
*** Guest19157 is now known as ioni | 22:48 | |
*** ioni is now known as Guest62151 | 22:49 | |
*** chris_hultin is now known as chris_hultin|AWA | 22:55 | |
*** poopcat has quit IRC | 22:55 | |
openstackgerrit | Merged openstack/openstack-ansible-security: Ensure separate filesystems exist [+Docs] https://review.openstack.org/407199 | 22:55 |
*** poopcat has joined #openstack-ansible | 22:56 | |
*** TxGirlGeek has quit IRC | 22:56 | |
*** sdake has quit IRC | 22:59 | |
*** aludwar has quit IRC | 23:00 | |
*** sdake has joined #openstack-ansible | 23:01 | |
*** aludwar has joined #openstack-ansible | 23:04 | |
*** thorst has joined #openstack-ansible | 23:11 | |
*** schwicht has quit IRC | 23:13 | |
*** rstarmer has joined #openstack-ansible | 23:14 | |
*** dxiri has quit IRC | 23:15 | |
*** thorst has quit IRC | 23:18 | |
*** agrebennikov_ has quit IRC | 23:21 | |
*** javeriak has joined #openstack-ansible | 23:24 | |
*** javeriak has quit IRC | 23:29 | |
*** schwicht has joined #openstack-ansible | 23:31 | |
*** adrian_otto has quit IRC | 23:33 | |
*** karimb has quit IRC | 23:39 | |
*** whiteveil has quit IRC | 23:47 | |
*** whiteveil has joined #openstack-ansible | 23:47 | |
*** whiteveil has quit IRC | 23:48 | |
*** woodard has quit IRC | 23:49 | |
*** Guest62151 is now known as ioni | 23:49 | |
*** ioni is now known as Guest1381 | 23:50 | |
*** javeriak has joined #openstack-ansible | 23:51 | |
openstackgerrit | Merged openstack/openstack-ansible: Fix cinder_volumes is_metal override example https://review.openstack.org/409103 | 23:53 |
*** schwicht has quit IRC | 23:56 | |
*** michaelgugino has quit IRC | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!