Sunday, 2016-12-11

mordredkfox1111: it's a local caching dns resolver that we put in to mitigate dns resolution differences across clouds00:03
*** asettle has joined #openstack-infra00:03
kfox1111its causing issues with kuberntees I think.00:03
kfox1111kubernetes is able to resolve internaly but when it goes to resolve externally, it reads 127.0.0.1 out of the local resolv.conf and then cant talk to the caching server. :/00:03
*** baoli has joined #openstack-infra00:04
kfox1111as the 127.0.0.1 in the container is different then the system one. :/00:04
kfox1111is there an easy way to disable it?00:04
kfox1111or alternately, if I could rebind it to the network address that would work too?00:05
mordredthat might be a better choice00:05
mordred(also, fascinating :) )00:05
kfox1111not sure how to update resolv.conf to have it not use 127.0.0.1 though.00:06
kfox1111I could just overwrite it, but not sure if a dhcp renew would overwrite it.00:06
kfox1111the job only can ever run for an hour though, so if renew is always longer then that, we're probably safe.00:07
mordredwe write those ourselves, so if dhcp were replacing them it would screw the gate pretty epically00:07
*** asettle has quit IRC00:08
mordredso - yeah - you could totally overwrite the file00:08
*** lindycoder has quit IRC00:08
kfox1111ok. cool. so then I just need to update unbound to listen to all ip's, and poke in eth0's ip into the resolv.conf.00:09
kfox1111thanks. :)00:09
mordredyup! good luck!00:09
*** rcernin has quit IRC00:10
kfox1111oh. one more quick thing.00:12
kfox1111is there an easy way to get the local machine's private ip address?00:12
mordredwell....00:12
*** askb has joined #openstack-infra00:12
*** baoli has quit IRC00:13
mordredthere is not necessarily a private ip00:13
mordredsome machines have a private, some do not00:13
kfox1111some ip I guess. doesn't really matter which, so long as it uniqueliy identifies the machine.00:14
kfox1111from somethign running on a bridge on the same machine.00:14
mordredyes. that we write to a file - one sec00:14
mordredkfox1111: /etc/nodepool/primary_node00:15
mordredif it has a public and a private, the private will be in /etc/nodepool/primary_node_private00:15
kfox1111k. just a text file with the ip?00:15
mordred(and if it doesn't, the public will be in /etc/nodepool/primary_node_private)00:15
mordredyah00:15
mordredmordred@ubuntu-xenial-ovh-bhs1-6097774:~$ cat /etc/nodepool/primary_node_private00:15
mordred158.69.88.15600:15
kfox1111cool. thanks.00:15
mordredfor instance00:15
mordredsure nuff!00:15
kfox1111sudo sed -i "s/127\.0\.0\.1/$(cat /etc/nodepool/primary_node)/" /etc/resolv.conf :)00:16
mordrednice00:16
*** thorst has joined #openstack-infra00:16
kfox1111lets see if it works...00:16
kfox1111zuul's nice and empty so things are going really fast right now. :)00:16
mordredkfox1111: fwiw, I just tried that on the machine I'd grabbed and it hangs00:17
kfox1111hmm...00:18
kfox1111did you update the interface and access control list of unbound?00:18
mordredI did not00:18
kfox1111https://review.openstack.org/#/c/408263/36/tools/setup_gate.sh00:18
clarkbso a better way to solve that eould be to forward tcp and udp 53 to the host00:19
clarkbbecause we put that there for a reason and circumventing it means you likely have jobs fail00:20
kfox1111sudo cat /etc/resolv.conf00:20
kfox11112016-12-11 00:18:56.398342 | nameserver 2001:4800:1ae1:18:f816:3eff:fe53:2e1c00:20
kfox1111hmm...00:20
kfox1111not quite. :/00:20
kfox1111clarkb: I can't easy control that.00:20
clarkbyou should not make it resolv on public interfaves00:20
clarkbthats how ddos happens00:20
kfox1111kubernetes reads /etc/resolv.conf itself. :/00:20
mordredyah - also - the thing in primary_node will be the floating ip if the machien has a floating up00:20
kfox1111clarkb: the firewall shoudl still block it though.00:21
kfox1111I slid in particular rules to allow docker to  access services.00:21
clarkbwhich woukd prevent your containers from using it00:21
kfox1111but the standard firewall should still be there.00:21
kfox1111I need a v4 address...00:22
clarkbyou need to open stuff up and I am saying thats nit a great idea. also that seems like a major kubernetes issue if this is their dns setup00:22
openstackgerritDan Prince proposed openstack-infra/tripleo-ci: Disable the ceilo swift pipeline for multinode  https://review.openstack.org/40948300:22
clarkball yhe major distros setup a local resolver last I checked00:22
*** thorst has quit IRC00:22
kfox1111clarkb: they do not assume your doing something weird like putting a dns server of your own on 127.0.0.1. :/00:22
kfox1111but it would be good if they did provide a way to override it instead of assuming /etc/resolv.conf will work for container. :/00:22
clarkbthats exactly ehat eg ubuntu do though00:22
mordredkfox1111: it's not that weird - my laptop has 127.0.0.1 in resolv.conf00:22
kfox1111that may be more of a docker issue though.00:23
clarkbmordred: yes exactly00:23
kfox1111mordred: much more common on desktops then servers.00:23
mordredkfox1111: but yes - they shoudl allow it to be overridden00:23
kfox1111at any rate, I don't control docker, kubernetes, or kubeadm.00:23
kfox1111so there are 3 layers to fix. :/00:23
mordredkfox1111: literally all of our servers have 127.0.0.1 in their /etc/resolv.conf :)00:23
clarkbdocker does let you do nat though00:23
kfox1111so... plan b...00:23
clarkbwhich us how I would fix this00:23
kfox1111maybe I just setup a bridge, and put an ip on it.00:24
clarkbnat container localhost 53 to host 53 tcp and udp00:24
kfox1111clarkb: I don't control iptables in the containers.00:24
kfox1111no way to hook in there.00:24
* mordred goes back to preparing alcohol00:24
clarkbdocker dies though right?00:24
clarkber does00:24
kfox1111within a docker container that isn't net=host,00:24
clarkblast time I used docker I definitely did this00:24
clarkbfor http00:24
kfox1111hostname kubernetes works00:25
kfox1111hostname google.com doesnt00:25
clarkbwait are you net=host?00:25
kfox1111its complicated. :/00:25
clarkbif so then it should just work00:25
kfox1111clarkb: for somet things.00:25
kfox1111those things work.00:25
kfox1111the non net=host ones fail.00:25
clarkbok good because thats ehat I would expect with net=host00:25
kfox1111maybe I'll just grab the ipv4 address of of the first interface found thats not lo.00:26
*** benj_ has quit IRC00:27
kfox1111ip a | grep '^[0-9]' | awk '{print $2}' | sed 's/://' | grep -v lo | head -n 100:28
*** tphummel has quit IRC00:28
clarkbfor the things that are not net = host can you nat 53?00:28
kfox1111how nat?00:28
kfox1111the resolve points to 127.0.0.100:28
kfox1111so you would need a rewrite rule, in the container itself, to point to a address on the host00:28
kfox1111that isnt 127.0.0.1.00:28
*** spzala has joined #openstack-infra00:29
*** tphummel has joined #openstack-infra00:29
kfox1111which is much harder then just changing /etc/resolv.conf to have that address.00:29
*** spzala has quit IRC00:30
*** spzala has joined #openstack-infra00:30
mordredyah - the general problem is that docker bind-mounts /etc/resolv.conf from the host into the container00:31
clarkbthe problem with ^ is that wedont actually garuntee an ipv4 addr00:31
clarkbso yes you cando that and it will work today00:31
kfox1111hmm....00:31
kfox1111k.00:31
clarkbthen 3 months frkm now it stops00:31
kfox1111then I'll have to force one.00:31
*** benj_ has joined #openstack-infra00:32
*** spzala has quit IRC00:32
*** spzala has joined #openstack-infra00:33
kfox1111adding a linux bridge and stickign an ip on it shoudl be easy enough.00:33
*** knangia has quit IRC00:34
*** EricGonczer_ has quit IRC00:35
clarkbya so attaching an ip yourself if otherwise not present would deal with that00:35
clarkbreading docker docs they actually host their own resolver that resolves docker names and uaes host resolver for other names00:36
clarkbodd that it would run relative to the container in that case if they want to use the hosts resolver00:36
kfox1111kubernetes also has its own resolver. as they do service discovery.00:37
kfox1111so not sure if it reuses that part or not.00:37
clarkbwhich is fine,its the second part of assuming host resolver is fine when resolved against not relativeto host00:37
kfox1111they seem to be able to detect that and work around it,00:38
kfox1111but for some reason, they don't with unbound.00:38
clarkbkfox1111: due to the way linux treats 127.0.0.0/8 I wonder if you could just tell it the dns server is 127.0.1.100:42
clarkbor anything else in the /8 (probably depends o  whether or not unbound is that discerning)00:42
clarkb--dns=127.1.1.100:43
clarkbactually unbou d would ha e to bind that nevermind00:43
kfox1111hmm... that might work.00:44
clarkbso maybe we put unbound on weirder 127.0.0.0/8 addresstoo or something00:44
kfox1111though lo has the /800:45
kfox1111so would have to shrink it maybe.00:45
kfox1111and not sure I can do that inside the containers.00:45
kfox1111otherwise the container would see the address and route it to lo in the container. which woudl go nowhere.00:45
clarkbya00:45
kfox1111the bridge idea seems to be going now...00:46
kfox1111408263,39 in zuul. ubuntu entry.00:46
kfox1111I don't have v6 support so can't watch it.00:46
kfox1111will konw for sure in about 10 min I think.00:48
kfox1111hmm...00:49
clarkbon further reading docker docs say the localhost nameserver entries willbe removed00:50
kfox1111still failed. :/00:50
clarkbif there are no more nameservers after filtering then google will be used00:50
kfox1111http://logs.openstack.org/63/408263/39/check/gate-kolla-kubernetes-deploy-ubuntu-binary-ceph-nv/bc3fd78/logs/pods/default-test-dns-ubuntu-xenial-osic-cloud1-s3500-6098094-fbuql-main.txt00:50
*** Sukhdev has joined #openstack-infra00:50
clarkband if you need to use a local resolver you must modify your resolver to listen on not localhost00:51
clarkbso I would expect this to work by hitting google00:51
clarkbreading that I think wr can have our unbound servers listen on * and have firewall rules that allow "local" packets. but that wont ensure there is non lo ipv400:54
kfox1111clarkb: here's what I got so far: https://review.openstack.org/#/c/408263/40/tools/setup_gate.sh00:55
clarkb(also glean does unset the local resolver in some cases iirc. wee dns)00:57
*** hurgleburgler has quit IRC00:59
*** sdake_ has joined #openstack-infra01:06
*** ricardoas has quit IRC01:06
*** mrtenio has quit IRC01:07
*** clenimar has quit IRC01:07
kfox1111looks like we have a winner. :)01:09
kfox1111408263,41 ubuntu job.01:09
*** sdake has quit IRC01:09
mordredwoot!01:12
kfox1111passed. thanks for the help. :)01:12
*** vaidy has quit IRC01:13
*** isviridov_away has quit IRC01:13
*** yamamoto has joined #openstack-infra01:14
*** watanabe_isao has joined #openstack-infra01:14
*** watanabe_isao has quit IRC01:14
*** thorst has joined #openstack-infra01:19
*** thorst has quit IRC01:27
*** jeblair has joined #openstack-infra01:31
*** sdake_ has quit IRC01:37
*** nadya has joined #openstack-infra01:46
*** nadya has quit IRC01:51
*** emerson has quit IRC01:59
*** emerson has joined #openstack-infra01:59
*** winggundamth_ has joined #openstack-infra02:04
*** thorst has joined #openstack-infra02:05
*** thorst has quit IRC02:06
*** thorst has joined #openstack-infra02:07
*** claudiub|2 has quit IRC02:09
*** amotoki has joined #openstack-infra02:10
*** mountpoint has joined #openstack-infra02:11
*** jeckersb_gone is now known as jeckersb02:11
*** M-docaedo_vector has joined #openstack-infra02:14
*** mountpoint has quit IRC02:15
*** thorst has quit IRC02:15
*** spzala has quit IRC02:18
*** spzala has joined #openstack-infra02:19
*** mountpoint has joined #openstack-infra02:19
*** Julien-zte has quit IRC02:31
*** Julien-z_ has joined #openstack-infra02:31
*** Jeffrey4l_ has quit IRC02:33
*** mountpoint has quit IRC02:34
*** vaidy has joined #openstack-infra02:36
*** mountpoint has joined #openstack-infra02:37
*** isviridov_away has joined #openstack-infra02:37
*** gouthamr has joined #openstack-infra02:42
*** Julien-z_ has quit IRC02:45
*** Julien-zte has joined #openstack-infra02:50
*** lVathan[m] has joined #openstack-infra02:54
*** mountpoint has quit IRC02:55
*** mountpoint has joined #openstack-infra02:57
*** mountpoint has quit IRC02:57
*** Jeffrey4l has joined #openstack-infra03:01
*** Jeffrey4l has quit IRC03:09
*** thorst has joined #openstack-infra03:13
*** kzaitsev_mb has joined #openstack-infra03:17
*** thorst has quit IRC03:19
*** thorst has joined #openstack-infra03:19
*** spzala has quit IRC03:19
*** amotoki has quit IRC03:20
*** spzala has joined #openstack-infra03:20
*** thorst has quit IRC03:21
*** sdake has joined #openstack-infra03:29
*** gouthamr has quit IRC03:29
*** gmann_ has joined #openstack-infra03:29
*** sambetts|pto has quit IRC03:34
*** liusheng has quit IRC03:35
*** sambetts_ has joined #openstack-infra03:35
*** liusheng has joined #openstack-infra03:36
*** gouthamr_ has joined #openstack-infra03:47
*** nadya has joined #openstack-infra03:47
*** nadya has quit IRC03:52
*** kzaitsev_mb has quit IRC03:53
*** Goneri has joined #openstack-infra03:58
*** hurgleburgler has joined #openstack-infra04:07
*** rbuzatu has joined #openstack-infra04:08
*** dave-mccowan has joined #openstack-infra04:09
*** dave-mcc_ has joined #openstack-infra04:12
*** rbuzatu has quit IRC04:13
*** dave-mccowan has quit IRC04:15
*** amotoki has joined #openstack-infra04:20
*** thorst has joined #openstack-infra04:21
*** Goneri has quit IRC04:21
*** spzala has quit IRC04:22
*** spzala has joined #openstack-infra04:23
*** amotoki has quit IRC04:26
*** lindycoder has joined #openstack-infra04:27
*** thorst has quit IRC04:30
*** dave-mcc_ has quit IRC04:36
*** lindycoder has quit IRC04:39
*** sdake has quit IRC04:45
*** nadya has joined #openstack-infra04:47
*** gouthamr_ has quit IRC04:49
*** Sukhdev has quit IRC05:01
*** nicolasbock has joined #openstack-infra05:02
*** sambetts_ has quit IRC05:09
*** nicolasbock has quit IRC05:09
*** sambetts_ has joined #openstack-infra05:10
openstackgerritSteve Martinelli proposed openstack-infra/project-config: remove cueclient from osc check script  https://review.openstack.org/40949705:14
*** ijw has joined #openstack-infra05:15
*** nadya has quit IRC05:19
*** ijw_ has joined #openstack-infra05:20
*** ijw has quit IRC05:23
*** spzala has quit IRC05:23
*** spzala has joined #openstack-infra05:24
*** spzala has joined #openstack-infra05:24
*** thorst has joined #openstack-infra05:28
*** thorst has quit IRC05:36
*** kzaitsev_mb has joined #openstack-infra05:36
*** ijw_ has quit IRC05:40
*** ijw has joined #openstack-infra05:41
*** gmann_ has quit IRC05:44
*** Julien-zte has quit IRC05:49
*** yuval has joined #openstack-infra05:49
*** ramishra has quit IRC05:50
*** ramishra has joined #openstack-infra05:52
*** spzala has quit IRC06:25
*** spzala has joined #openstack-infra06:25
*** spzala has joined #openstack-infra06:26
*** amotoki has joined #openstack-infra06:31
*** thorst has joined #openstack-infra06:33
*** ramishra has quit IRC06:35
*** isaacb has joined #openstack-infra06:38
*** thorst has quit IRC06:41
*** abregman has joined #openstack-infra06:47
*** oanson has joined #openstack-infra06:48
*** isaacb has quit IRC06:51
*** bhavik has joined #openstack-infra06:59
*** bhavik has quit IRC07:00
*** rbuzatu has joined #openstack-infra07:00
*** ramishra has joined #openstack-infra07:00
*** rbuzatu has quit IRC07:00
*** rbuzatu has joined #openstack-infra07:00
*** amotoki has quit IRC07:04
*** rbuzatu has quit IRC07:04
*** yamahata has joined #openstack-infra07:10
*** ijw has quit IRC07:11
*** hurgleburgler has quit IRC07:14
*** netsinn is now known as netsin07:14
*** spzala has quit IRC07:26
*** spzala has joined #openstack-infra07:27
*** spzala has joined #openstack-infra07:27
*** ijw has joined #openstack-infra07:39
*** thorst has joined #openstack-infra07:40
*** markvoelker has joined #openstack-infra07:45
*** thorst has quit IRC07:46
*** esikachev has joined #openstack-infra07:48
*** markvoelker has quit IRC07:50
*** rcernin has joined #openstack-infra07:52
*** esikachev has quit IRC08:10
*** esikachev has joined #openstack-infra08:19
*** esikachev has quit IRC08:24
*** askb has quit IRC08:26
*** spzala has quit IRC08:28
*** spzala has joined #openstack-infra08:28
*** spzala has quit IRC08:29
*** spzala has joined #openstack-infra08:29
*** vaidy has quit IRC08:33
*** isviridov_away has quit IRC08:34
*** CrashOverride has joined #openstack-infra08:37
*** baoli has joined #openstack-infra08:43
*** thorst has joined #openstack-infra08:43
*** markvoelker has joined #openstack-infra08:46
*** Julien-zte has joined #openstack-infra08:47
*** baoli has quit IRC08:48
*** kzaitsev_mb has quit IRC08:48
*** rcernin has quit IRC08:48
*** rbuzatu has joined #openstack-infra08:49
*** thorst has quit IRC08:51
*** markvoelker has quit IRC08:51
*** rbuzatu has quit IRC08:52
*** rbuzatu has joined #openstack-infra08:53
*** sdake has joined #openstack-infra08:53
*** vaidy has joined #openstack-infra08:56
*** yamahata has quit IRC08:56
*** isviridov_away has joined #openstack-infra08:57
*** sdake has quit IRC08:59
*** zzzeek has quit IRC09:00
*** zzzeek has joined #openstack-infra09:00
*** sdake has joined #openstack-infra09:00
*** yamahata has joined #openstack-infra09:01
*** amotoki has joined #openstack-infra09:04
*** Hal has joined #openstack-infra09:08
*** Hal is now known as Guest8662009:08
*** amotoki has quit IRC09:09
*** kzaitsev_mb has joined #openstack-infra09:11
*** yamahata has quit IRC09:14
*** esikachev has joined #openstack-infra09:20
*** spzala has quit IRC09:29
*** spzala has joined #openstack-infra09:30
*** esikachev has quit IRC09:32
*** nmagnezi has joined #openstack-infra09:32
*** sdake_ has joined #openstack-infra09:33
*** sdake has quit IRC09:34
*** CrashOverride has quit IRC09:38
*** sdake_ has quit IRC09:41
*** Julien-zte has quit IRC09:41
*** sdake has joined #openstack-infra09:44
*** markvoelker has joined #openstack-infra09:47
*** thorst has joined #openstack-infra09:49
*** markvoelker has quit IRC09:52
*** esikachev has joined #openstack-infra09:53
*** thorst has quit IRC09:56
*** bhavik has joined #openstack-infra10:02
*** jascott1_ has quit IRC10:07
*** sdake has quit IRC10:09
*** rbuzatu has quit IRC10:23
*** rbuzatu has joined #openstack-infra10:24
*** eranrom has quit IRC10:26
*** eranrom_ has joined #openstack-infra10:26
*** rbuzatu has quit IRC10:29
*** ihrachys has joined #openstack-infra10:30
*** ihrachys has quit IRC10:30
*** spzala has quit IRC10:30
*** claudiub|2 has joined #openstack-infra10:30
*** spzala has joined #openstack-infra10:31
*** ihrachys has joined #openstack-infra10:32
*** winggundamth_ has quit IRC10:33
*** rbuzatu has joined #openstack-infra10:42
*** ihrachys has quit IRC10:47
*** markvoelker has joined #openstack-infra10:48
*** markvoelker has quit IRC10:53
*** ihrachys has joined #openstack-infra10:53
*** thorst has joined #openstack-infra10:54
*** gluytium_ has joined #openstack-infra11:00
*** thorst has quit IRC11:01
*** Guest86620 has quit IRC11:03
*** gluytium has quit IRC11:03
*** asettle has joined #openstack-infra11:04
*** asettle has quit IRC11:05
*** asettle has joined #openstack-infra11:05
*** jascott1_ has joined #openstack-infra11:08
*** asettle has quit IRC11:09
*** jascott1_ has quit IRC11:12
*** yamamoto has quit IRC11:16
*** dizquierdo has joined #openstack-infra11:28
*** spzala has quit IRC11:31
*** spzala has joined #openstack-infra11:33
*** dizquierdo has quit IRC11:33
*** kzaitsev_mb has quit IRC11:42
*** markvoelker has joined #openstack-infra11:49
*** markvoelker has quit IRC11:53
*** claudiub|2 has quit IRC11:54
*** thorst has joined #openstack-infra11:59
*** nicolasbock has joined #openstack-infra12:00
*** thorst has quit IRC12:06
*** amotoki has joined #openstack-infra12:07
*** bhavik has quit IRC12:09
*** amotoki has quit IRC12:12
*** yamamoto has joined #openstack-infra12:13
*** baoli has joined #openstack-infra12:19
*** esikachev has quit IRC12:23
*** caowei_ has joined #openstack-infra12:24
*** jascott1_ has joined #openstack-infra12:31
*** saibarspeis has joined #openstack-infra12:32
*** spzala has quit IRC12:33
*** spzala has joined #openstack-infra12:34
*** spzala has quit IRC12:34
*** spzala has joined #openstack-infra12:34
*** wolverineav has joined #openstack-infra12:37
*** jascott1_ has quit IRC12:37
*** nadya has joined #openstack-infra12:39
*** wolverineav has quit IRC12:41
*** caowei_ has quit IRC12:50
*** caowei_ has joined #openstack-infra12:51
*** hashar has joined #openstack-infra12:53
*** thorst has joined #openstack-infra13:06
*** thorst has quit IRC13:11
*** rbuzatu has quit IRC13:14
*** yamamoto has quit IRC13:17
*** yamamoto has joined #openstack-infra13:17
*** yamamoto has quit IRC13:22
*** yamamoto has joined #openstack-infra13:24
*** rbuzatu has joined #openstack-infra13:25
*** rbuzatu_ has joined #openstack-infra13:26
*** SpamapS has quit IRC13:27
*** SpamapS has joined #openstack-infra13:27
*** yamamoto has quit IRC13:29
*** ihrachys_ has joined #openstack-infra13:29
*** rbuzatu has quit IRC13:30
*** SpamapS has quit IRC13:30
*** SpamapS has joined #openstack-infra13:31
*** ihrachys has quit IRC13:31
*** SpamapS has quit IRC13:31
*** SpamapS has joined #openstack-infra13:31
*** nadya has quit IRC13:34
*** jascott1_ has joined #openstack-infra13:34
*** ihrachys_ has quit IRC13:34
*** spzala has quit IRC13:34
*** spzala has joined #openstack-infra13:35
*** spzala has quit IRC13:35
*** spzala has joined #openstack-infra13:35
*** jascott1_ has quit IRC13:38
*** ihrachys has joined #openstack-infra13:41
*** markvoelker has joined #openstack-infra13:50
*** ihrachys has quit IRC13:52
*** markvoelker has quit IRC13:55
*** caowei_ has quit IRC13:59
*** jeckersb is now known as jeckersb_gone14:02
*** nadya has joined #openstack-infra14:03
*** thorst has joined #openstack-infra14:07
*** ihrachys has joined #openstack-infra14:15
*** thorst has quit IRC14:16
*** nadya has quit IRC14:21
*** caowei_ has joined #openstack-infra14:22
*** yamamoto has joined #openstack-infra14:24
*** yamamoto has quit IRC14:24
*** yamamoto has joined #openstack-infra14:25
*** yamamoto has quit IRC14:25
*** yamamoto has joined #openstack-infra14:25
*** baoli has quit IRC14:26
*** hashar is now known as hasharAway14:26
*** yamamoto has quit IRC14:30
*** spzala has quit IRC14:35
*** spzala has joined #openstack-infra14:36
*** spzala_ has joined #openstack-infra14:36
*** spzala has quit IRC14:37
*** claudiub|2 has joined #openstack-infra14:46
*** thorst has joined #openstack-infra14:49
*** markvoelker has joined #openstack-infra14:51
*** thorst has quit IRC14:52
*** thorst has joined #openstack-infra14:54
*** claudiub|2 has quit IRC14:54
*** markvoelker has quit IRC14:56
*** hasharAway has quit IRC15:01
*** thorst has quit IRC15:01
*** claudiub|2 has joined #openstack-infra15:02
*** baoli has joined #openstack-infra15:03
*** caowei_ has quit IRC15:05
*** baoli has quit IRC15:07
*** sdake has joined #openstack-infra15:10
*** anthonyper has quit IRC15:16
*** anthonyper has joined #openstack-infra15:17
*** eranrom_ has quit IRC15:17
*** eranrom has joined #openstack-infra15:18
*** claudiub|2 has quit IRC15:27
*** yamamoto has joined #openstack-infra15:29
*** nmagnezi has quit IRC15:30
*** eranrom has quit IRC15:30
*** eranrom has joined #openstack-infra15:30
*** yamamoto has quit IRC15:35
*** jascott1_ has joined #openstack-infra15:35
*** rbuzatu_ has quit IRC15:36
*** eranrom has quit IRC15:36
*** eranrom_ has joined #openstack-infra15:36
*** rbuzatu has joined #openstack-infra15:36
openstackgerritAlvaro Aleman proposed openstack-infra/shade: Fix _neutron_available_floating_ips filtering  https://review.openstack.org/40953215:37
*** HeOS has quit IRC15:37
*** erlon-airlong has quit IRC15:40
*** jascott1_ has quit IRC15:40
*** rbuzatu has quit IRC15:40
*** eranrom_ has quit IRC15:42
*** eranrom has joined #openstack-infra15:42
*** eranrom has quit IRC15:46
*** eranrom_ has joined #openstack-infra15:46
*** eranrom_ has quit IRC15:51
*** eranrom has joined #openstack-infra15:51
*** rbuzatu has joined #openstack-infra15:57
*** hurgleburgler has joined #openstack-infra15:57
*** esikachev has joined #openstack-infra15:57
*** thorst has joined #openstack-infra16:00
*** eranrom has quit IRC16:00
*** eranrom has joined #openstack-infra16:01
*** rbuzatu has quit IRC16:01
*** vaidy has quit IRC16:04
*** isviridov_away has quit IRC16:04
*** eranrom has quit IRC16:05
*** eranrom_ has joined #openstack-infra16:05
*** thorst has quit IRC16:06
*** eranrom_ has quit IRC16:06
*** eranrom has joined #openstack-infra16:07
*** rbuzatu has joined #openstack-infra16:07
*** sdake has quit IRC16:07
*** amotoki has joined #openstack-infra16:09
*** rbuzatu has quit IRC16:12
*** amotoki has quit IRC16:13
*** vaidy has joined #openstack-infra16:15
*** amotoki has joined #openstack-infra16:15
*** isviridov_away has joined #openstack-infra16:16
*** spzala_ has quit IRC16:17
*** spzala has joined #openstack-infra16:17
*** spzala has joined #openstack-infra16:17
*** rbuzatu has joined #openstack-infra16:18
*** sdake has joined #openstack-infra16:20
*** rbuzatu has quit IRC16:22
*** abregman has quit IRC16:26
*** rbuzatu has joined #openstack-infra16:28
*** yuval has quit IRC16:31
*** oanson has quit IRC16:31
*** baoli has joined #openstack-infra16:32
*** rbuzatu has quit IRC16:33
*** jeckersb_gone is now known as jeckersb16:33
*** nicolasbock has quit IRC16:37
*** jascott1_ has joined #openstack-infra16:37
*** kamtamtun has joined #openstack-infra16:38
*** rbuzatu has joined #openstack-infra16:38
*** jascott1_ has quit IRC16:41
*** nicolasbock has joined #openstack-infra16:43
*** rbuzatu has quit IRC16:44
*** rbuzatu has joined #openstack-infra16:44
*** kamtamtun has quit IRC16:46
*** spzala has quit IRC16:47
*** spzala has joined #openstack-infra16:48
openstackgerritAlvaro Aleman proposed openstack-infra/shade: Fix _neutron_available_floating_ips filtering  https://review.openstack.org/40953216:51
*** adrian_otto has joined #openstack-infra16:57
*** thorst has joined #openstack-infra17:05
*** Hal has joined #openstack-infra17:07
*** Hal is now known as Guest141317:07
*** rbuzatu_ has joined #openstack-infra17:08
*** rbuzatu has quit IRC17:11
*** thorst has quit IRC17:11
*** baoli has quit IRC17:17
*** spzala has quit IRC17:19
*** spzala has joined #openstack-infra17:19
*** armax has joined #openstack-infra17:19
*** spzala has joined #openstack-infra17:19
*** adrian_otto has quit IRC17:30
*** esikachev has quit IRC17:38
*** sdake has quit IRC17:41
*** baoli has joined #openstack-infra17:45
*** hogepodge has joined #openstack-infra17:50
*** jooni has quit IRC17:50
*** spzala has quit IRC17:50
*** spzala has joined #openstack-infra17:51
*** jooni has joined #openstack-infra17:55
*** jooni has quit IRC17:55
*** itisha has joined #openstack-infra17:57
*** armax has quit IRC17:59
*** hongbin has joined #openstack-infra18:00
*** armax has joined #openstack-infra18:03
*** thorst has joined #openstack-infra18:08
*** asettle has joined #openstack-infra18:13
*** rbuzatu_ has quit IRC18:15
*** rbuzatu has joined #openstack-infra18:15
*** thorst has quit IRC18:16
*** baoli has quit IRC18:17
*** kzaitsev_mb has joined #openstack-infra18:18
*** rbuzatu has quit IRC18:20
*** rbuzatu has joined #openstack-infra18:20
*** sdake has joined #openstack-infra18:21
*** spzala has quit IRC18:22
*** spzala has joined #openstack-infra18:22
*** spzala has quit IRC18:22
*** spzala has joined #openstack-infra18:22
*** asettle has quit IRC18:23
*** gomarivera has joined #openstack-infra18:25
*** armax has quit IRC18:27
*** gomarivera has quit IRC18:30
*** ihrachys has quit IRC18:35
*** amotoki has quit IRC18:43
*** ihrachys has joined #openstack-infra18:45
*** baoli has joined #openstack-infra18:45
*** ihrachys has quit IRC18:45
*** ihrachys has joined #openstack-infra18:47
*** ihrachys has quit IRC18:51
*** amotoki has joined #openstack-infra18:52
*** spzala has quit IRC18:52
*** spzala has joined #openstack-infra18:53
*** spzala has quit IRC18:53
*** spzala has joined #openstack-infra18:53
*** markvoelker has joined #openstack-infra18:54
*** esikachev has joined #openstack-infra18:57
*** eliqiao has quit IRC18:57
*** alex_xu has quit IRC18:58
*** markvoelker has quit IRC18:59
*** rcernin has joined #openstack-infra18:59
*** Goneri has joined #openstack-infra18:59
*** gomarivera has joined #openstack-infra19:02
*** armax has joined #openstack-infra19:05
*** amotoki has quit IRC19:07
*** Goneri has quit IRC19:09
*** hongbin has quit IRC19:10
*** gomarivera has quit IRC19:13
*** eliqiao has joined #openstack-infra19:15
*** alex_xu has joined #openstack-infra19:15
*** thorst has joined #openstack-infra19:15
*** HeOS has joined #openstack-infra19:15
*** nicolasbock has quit IRC19:16
*** baoli has quit IRC19:18
*** thorst has quit IRC19:20
*** saibarspeis has quit IRC19:26
*** ccamacho1 has quit IRC19:38
*** jascott1_ has joined #openstack-infra19:39
*** jascott1_ has quit IRC19:44
*** baoli has joined #openstack-infra19:45
*** kzaitsev_mb has quit IRC19:48
*** markvoelker has joined #openstack-infra19:55
*** baoli has quit IRC19:58
*** baoli has joined #openstack-infra19:58
*** markvoelker has quit IRC19:59
*** hashar has joined #openstack-infra20:01
*** jascott1_ has joined #openstack-infra20:02
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Handle cinder driverfixes branch (part1)  https://review.openstack.org/40946120:04
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Handle cinder driverfixes branch (part2)  https://review.openstack.org/40946320:04
*** kzaitsev_mb has joined #openstack-infra20:05
*** jascott1_ has quit IRC20:07
*** spzala has quit IRC20:17
*** thorst has joined #openstack-infra20:17
*** thorst has quit IRC20:22
*** thorst has joined #openstack-infra20:22
*** rkukura has quit IRC20:25
*** amotoki has joined #openstack-infra20:26
*** thorst has quit IRC20:31
*** baoli has quit IRC20:39
*** amotoki has quit IRC20:41
*** esikachev has quit IRC20:41
*** nicolasbock has joined #openstack-infra20:45
*** nicolasbock has quit IRC20:46
*** nicolasbock has joined #openstack-infra20:46
*** yamahata has joined #openstack-infra20:49
*** hashar has quit IRC21:08
*** jascott1_ has joined #openstack-infra21:13
*** nicolasbock has quit IRC21:14
*** spzala has joined #openstack-infra21:17
*** kzaitsev_mb has quit IRC21:18
*** alex_xu has quit IRC21:19
*** alex_xu has joined #openstack-infra21:19
*** yee379 has quit IRC21:23
*** yee379 has joined #openstack-infra21:23
*** askb has joined #openstack-infra21:25
*** thorst has joined #openstack-infra21:29
*** spzala has quit IRC21:29
*** yamahata has quit IRC21:32
*** Guest55197 is now known as dansmith21:33
*** thorst has quit IRC21:36
*** dave-mccowan has joined #openstack-infra21:37
*** esikachev has joined #openstack-infra21:38
*** esikachev has quit IRC21:42
*** rcernin has quit IRC21:43
*** dave-mccowan has quit IRC21:49
*** rbuzatu has quit IRC21:51
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483121:51
*** itisha has quit IRC21:52
*** markvoelker has joined #openstack-infra21:56
*** gomarivera has joined #openstack-infra21:57
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483121:59
*** markvoelker has quit IRC22:01
*** docaedo4 has quit IRC22:03
*** docaedo4 has joined #openstack-infra22:04
*** yamamoto has joined #openstack-infra22:11
*** timello has quit IRC22:14
*** aeng has joined #openstack-infra22:16
*** claudiub|2 has joined #openstack-infra22:17
*** timello has joined #openstack-infra22:20
*** sdake_ has joined #openstack-infra22:20
*** sdake has quit IRC22:24
*** esikachev has joined #openstack-infra22:31
openstackgerritAdam Spiers proposed openstack-infra/irc-meetings: move HA meeting to Wednesday 0900 UTC  https://review.openstack.org/40955122:31
*** dave-mccowan has joined #openstack-infra22:32
*** esikachev has quit IRC22:35
*** thorst has joined #openstack-infra22:38
*** dave-mccowan has quit IRC22:39
openstackgerritAdam Spiers proposed openstack-infra/irc-meetings: move HA meeting to Wednesday 0900 UTC  https://review.openstack.org/40955122:39
*** tphummel has quit IRC22:43
*** thorst has quit IRC22:46
*** tphummel has joined #openstack-infra22:48
*** rbuzatu has joined #openstack-infra22:50
*** rbuzatu has quit IRC22:57
*** markvoelker has joined #openstack-infra22:57
*** rbuzatu has joined #openstack-infra22:59
*** Cibo has quit IRC23:01
*** markvoelker has quit IRC23:02
*** adriant has joined #openstack-infra23:04
*** thorst has joined #openstack-infra23:05
*** camunoz has joined #openstack-infra23:08
*** asettle has joined #openstack-infra23:10
*** alex_xu has quit IRC23:13
*** alex_xu has joined #openstack-infra23:14
*** Cibo has joined #openstack-infra23:15
*** asettle has quit IRC23:18
*** armax has quit IRC23:20
*** ijw has quit IRC23:22
*** hoolio_ is now known as hoolio23:27
openstackgerritMerged openstack-infra/zuul: Re-enable requirement status tests  https://review.openstack.org/40106223:30
*** spzala has joined #openstack-infra23:30
*** esikachev has joined #openstack-infra23:31
*** esikachev has quit IRC23:36
*** spzala has quit IRC23:36
*** thorst has quit IRC23:36
*** esikachev has joined #openstack-infra23:37
*** thorst has joined #openstack-infra23:37
*** s-shiono has joined #openstack-infra23:40
*** esikachev has quit IRC23:41
*** claudiub|2 has quit IRC23:43
*** dingyichen has joined #openstack-infra23:45
*** thorst has quit IRC23:46
openstackgerritfumihiko kakuma proposed openstack-infra/project-config: Add scenario test for neutron-dynamic-routing  https://review.openstack.org/40777823:47
*** Cibo has quit IRC23:52
*** gomarivera has quit IRC23:55
*** markvoelker has joined #openstack-infra23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!