Tuesday, 2017-11-21

*** salv-orlando has quit IRC00:09
*** salv-orlando has joined #openstack-kuryr00:09
*** salv-orlando has quit IRC00:14
*** hongbin has quit IRC00:14
*** wangbo has joined #openstack-kuryr00:34
*** yamamoto has quit IRC00:42
*** aojea has joined #openstack-kuryr00:50
*** aojea has quit IRC00:55
openstackgerritMerged openstack/kuryr-kubernetes master: Prevent pyroute2.IPDB threads leaking  https://review.openstack.org/51740600:58
*** salv-orlando has joined #openstack-kuryr01:11
openstackgerritAntoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: add openshift support  https://review.openstack.org/49793301:25
*** salv-orlando has quit IRC01:26
*** c00281451 has quit IRC01:33
*** c00281451 has joined #openstack-kuryr01:33
*** yamamoto has joined #openstack-kuryr01:42
*** gouthamr has quit IRC01:48
*** yamamoto has quit IRC01:49
*** yamamoto has joined #openstack-kuryr01:51
*** salv-orlando has joined #openstack-kuryr02:22
*** salv-orlando has quit IRC02:27
*** gouthamr has joined #openstack-kuryr02:34
*** aojea has joined #openstack-kuryr02:51
*** hongbin has joined #openstack-kuryr02:52
*** aojea has quit IRC02:55
*** salv-orlando has joined #openstack-kuryr03:23
*** salv-orlando has quit IRC03:28
*** wangbo has quit IRC03:54
*** janonymous has joined #openstack-kuryr04:03
*** gouthamr has quit IRC04:05
*** yamamoto has quit IRC04:11
*** hongbin has quit IRC04:15
*** hongbin has joined #openstack-kuryr04:15
*** wangbo has joined #openstack-kuryr04:19
*** salv-orlando has joined #openstack-kuryr04:24
*** salv-orlando has quit IRC04:29
*** wangbo has quit IRC04:32
*** hongbin has quit IRC04:48
*** yamamoto has joined #openstack-kuryr04:48
*** aojea has joined #openstack-kuryr04:51
*** aojea has quit IRC04:56
*** wangbo has joined #openstack-kuryr05:04
*** janki has joined #openstack-kuryr05:13
*** salv-orlando has joined #openstack-kuryr05:25
*** salv-orlando has quit IRC05:29
*** yamamoto has quit IRC05:32
*** yamamoto has joined #openstack-kuryr05:34
*** caowei has joined #openstack-kuryr05:36
*** pcaruana has joined #openstack-kuryr05:39
*** yamamoto_ has joined #openstack-kuryr05:40
*** yamamoto has quit IRC05:43
*** yamamoto_ has quit IRC05:56
*** yboaron__ has joined #openstack-kuryr05:59
*** wangbo has quit IRC06:12
*** pcaruana has quit IRC06:13
*** wangbo has joined #openstack-kuryr06:18
*** janki has quit IRC06:23
*** janki has joined #openstack-kuryr06:23
*** salv-orlando has joined #openstack-kuryr06:24
*** aojea has joined #openstack-kuryr06:29
*** aojea has quit IRC06:33
*** aojea has joined #openstack-kuryr07:03
*** yamamoto has joined #openstack-kuryr07:10
*** yamamoto_ has joined #openstack-kuryr07:10
*** aojea has quit IRC07:11
*** yamamoto has quit IRC07:14
*** pcaruana has joined #openstack-kuryr07:30
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: CNI split - introducing CNI daemon  https://review.openstack.org/51518607:52
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Support kuryr-daemon when running containerized  https://review.openstack.org/51802407:52
dulekapuimedo: Thanks, I've fixed the issue. ^07:54
*** salv-orlando has quit IRC08:18
*** salv-orlando has joined #openstack-kuryr08:18
*** salv-orlando has quit IRC08:22
*** yamamoto_ has quit IRC08:29
*** salv-orlando has joined #openstack-kuryr08:31
*** yboaron__ has quit IRC08:33
*** wangbo has quit IRC08:46
dulekapuimedo, dmellado: Yesterday's release of kubernetes pip package broke our CI.08:47
dulekHere's the release: https://pypi.python.org/pypi/kubernetes/4.0.008:47
*** wangbo has joined #openstack-kuryr08:51
dmelladodulek: ouch!08:53
dmelladoI'll have a look and worst case cap the req on our side08:53
dulekdmellado: I think we can fix this up in tempest plugin. I'm already analyzing this.08:53
dmelladodulek: totally08:53
dmelladoif this release is stable we should move to that08:53
dmelladothe calls shouldn't be that much different at all08:53
dulekdmellado: It's just parameter validation issue. They've switched to "name" arg being required in the V1Container constructor.08:56
dmelladothen it should be fairly simple08:56
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Support kuryr-daemon when running containerized  https://review.openstack.org/51802408:58
*** yamamoto has joined #openstack-kuryr08:58
dulekdmellado: Yup, I'll post a patch in a moment.08:59
dmelladodulek: awesome, thanks for your quickness08:59
dmelladoI only wish that our 'official' QA eng would be as quick as you xD08:59
dulekdmellado: They have never debugged multinode grenade gates in Cinder. After that no gate failure scares me. :D09:01
dmelladolol09:01
dmelladoIn CInder what scared me was the 'contrib' api09:01
dmelladothat was a dark, frozen black hole09:01
openstackgerritMichał Dulko proposed openstack/kuryr-tempest-plugin master: Fix `create_pod` for 4.0 kubernetes client  https://review.openstack.org/52176209:02
dulekdmellado: Let's see how gate reacts, that might not be the only issue.09:02
dulekdmellado: I never understood why someone thought that this contrib dir was a good idea. I mean - even backups are an extension. You never know what you're going to get on your cloud.09:03
dulekdmellado: Oh, there's no kuryr-kubernetes gate in kuryr-tempest-plugin?09:04
dmelladonope, the idea is that it'd be tested on the kuryr-kubernetes repo09:05
dmelladodulek: what you can do is submit a 'foo' patch09:05
dmelladoand make it depends on the previous one09:05
dulekdmellado: Yup, doing that.09:05
dmelladocross-project dependency09:05
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Do Not Merge: Running tempest tests with a fix  https://review.openstack.org/52176309:07
*** aojea has joined #openstack-kuryr09:16
*** aojea has quit IRC09:21
*** yboaron__ has joined #openstack-kuryr09:28
openstackgerritMichał Dulko proposed openstack/kuryr-tempest-plugin master: Fix `create_pod` for 4.0 kubernetes client  https://review.openstack.org/52176209:38
irenabapuimedo, what are the node requirements to run devstack with openShift?09:56
*** yamamoto has quit IRC09:57
*** yamamoto has joined #openstack-kuryr10:00
*** salv-orlando has quit IRC10:00
*** salv-orlando has joined #openstack-kuryr10:01
apuimedoirenab: mmm10:01
apuimedoI don't know actually xD10:01
*** yamamoto has quit IRC10:02
irenabI want to run to verify10:02
apuimedoI would guess 8GiB would be enough10:02
*** yamamoto has joined #openstack-kuryr10:02
*** janki has quit IRC10:02
*** janki has joined #openstack-kuryr10:02
irenabalso I posted a comment a while ago regarding install documentation, would be good to include any node requirements there10:02
irenabas a follow up10:03
*** salv-orlando has quit IRC10:05
apuimedoirenab: right10:06
apuimedo!10:06
apuimedogood idea10:06
apuimedoI shall10:06
openstackgerritMichał Dulko proposed openstack/kuryr-tempest-plugin master: Fix `create_pod` for 4.0 kubernetes client  https://review.openstack.org/52176210:12
dulekdmellado, apuimedo: Zuul says that ^ is fixing tempest gate, so I'd appreciate reviews.10:12
dmelladoa-ha10:12
dmelladoreview incoming10:12
dulekdmellado, apuimedo: Here's the successful run: http://logs.openstack.org/63/521763/1/check/tempest-kuryr-kubernetes-lbaasv2/e801a79/10:12
dulek(with last patchset I've just added Closes-Bug that irenab requested)10:12
apuimedoaha!10:15
apuimedoSo it was dmellado's fault!10:15
apuimedoxD10:15
dmelladoloool10:17
dmelladoapuimedo: I'll assign you to write a stable library for this so it won't break us10:17
dulekapuimedo: It was more of kubernetes team fault, they've changed argument validation without any warning or release note.10:18
dmelladodulek: well, the library was alpha, so kinda expected10:18
dulekdmellado: 3.0 is alpha?10:19
dmelladohmmm 3.0 I'm not so sure10:19
dulekdmellado: They call it "stable release": https://github.com/kubernetes-incubator/client-python/releases10:19
dulekdmellado: But it's in incubator, so some lack of stability may be expected.10:20
dmelladoyep10:20
dmelladodulek: left you a nit comment10:20
dulekdmellado: The link to the run will be invalid in ~a week, you want me to put it into the commit message?10:21
dulekdmellado: I mean - if this will be it: http://logs.openstack.org/63/521763/1/check/tempest-kuryr-kubernetes-lbaasv2/e801a79/10:21
dmelladodulek: just the review link10:22
dmelladonot the log, whicih will be erased10:22
dmelladoI think it'd come in handy just for the record10:22
apuimedodmellado: I already did10:22
apuimedobut it is python3 only10:22
dmelladooh, you did?10:22
dmelladoI might need another coffee?10:22
dmelladodulek: where? xD10:23
apuimedothe original python3 kuryr-kubernetes had a handmade https client that I did10:23
apuimedoit was nice to use10:23
*** caowei has quit IRC10:23
apuimedosorry, http10:23
apuimedonot https10:23
dmelladoapuimedo: hmmm, we'll have a talk about that10:23
apuimedodmellado: why?10:24
openstackgerritMichał Dulko proposed openstack/kuryr-tempest-plugin master: Fix `create_pod` for 4.0 kubernetes client  https://review.openstack.org/52176210:24
apuimedoit was mostly just for nicer watching10:24
* apuimedo misses asyncio10:24
dmelladoapuimedo: actually if we take that code and somehow integrate with tempest/lib10:24
dmelladowe might be able to avoid dependency breakages on that10:24
apuimedodmellado: forget about it10:24
apuimedocan't work on python210:25
* dmellado goes back to the superfluidity meeting10:25
dmelladoapuimedo: argh, nvm then10:25
*** wangbo has quit IRC10:25
*** yamamoto has quit IRC10:41
*** yamamoto has joined #openstack-kuryr10:41
dulekeor@4eor10:45
dulekWhoops, that's not my VM… :P10:45
apuimedoxD10:45
dulekI've once heard of a rule in a company that if you're using IRC, any passwords you create should start with "/".10:47
apuimedodulek: that's a very very good policy!10:47
apuimedoI should remember it10:48
*** salv-orlando has joined #openstack-kuryr11:01
*** salv-orlando has quit IRC11:06
*** wangbo has joined #openstack-kuryr11:07
*** aojea has joined #openstack-kuryr11:17
dulekdmellado, apuimedo: https://review.openstack.org/#/c/521763 just finished with my latest kuryr-tempest-plugin fix.11:21
*** aojea has quit IRC11:22
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Do not merge: Running OpenShift on gates  https://review.openstack.org/52107711:25
irenabapuimedo, ping11:28
irenabapuimedo, I have a question regarding openshift patch verification11:34
irenabapuimedo, when exposed deployment with LB service type, it lists 2 external addresses. Only one responds to the query (kuryr-demo901)11:39
irenabI ran devstack with HAProxy11:39
apuimedoirenab: tell me11:40
apuimedoirenab: can you give me a paste?11:41
irenabapuimedo, so 2 adresses for the service, not sure where it comes from11:41
apuimedosounds odd11:42
apuimedodmellado: merge this https://review.openstack.org/#/c/521763/1 !11:42
*** irena has joined #openstack-kuryr11:43
irenaapuimedo, http://paste.ubuntu.com/26011704/11:43
apuimedoirena: can you describe the service?11:44
irenabapuimedo, what should I verify in addition?11:44
irenahttp://paste.ubuntu.com/26011713/11:45
dmelladoapuimedo: replied11:45
dmellado-111:45
apuimedooops, I got confused11:46
apuimedo:P11:46
irenabapuimedo, so the one that answers curl is LB ingress adress11:46
apuimedothat's the one I meant xd11:46
apuimedoirenab: you were trying the loadbalancer service type!11:47
irenabI ran the expose command with LB type11:47
irenakubectl expose deploy/kuryr-demo901 --port 80 --target-port 8080 --type=LoadBalancer11:48
irenaapuimedo, given the local.conf from your patch11:48
apuimedoirena: I really wonder where the hell it got the externalIP from11:48
apuimedoyboaron__: can you please check into that with irena ?11:49
apuimedoirena: you lost the trailing 'b'11:49
irenaI connected from another computer :-)11:49
yboaron__ irena , so all OK ?11:50
irenayboaron__, not sure if its ok. I wanted to verify openshift devstack patch, so deployed demo901 deployment with 2 pods and then exposed it with LB service type11:51
openstackgerritMerged openstack/kuryr-tempest-plugin master: Fix `create_pod` for 4.0 kubernetes client  https://review.openstack.org/52176211:51
irenayou can see the output of the service http://paste.ubuntu.com/26011713/11:51
yboaron__irena, checking it11:51
irenait seems not right, since the External IP does not come from the neutron public subnet11:52
irenathe LB Ingress. And actually this address answers  CURL request11:53
yboaron__irena, youv'e deployed loadbalancer type service , right ?11:53
irenayes11:53
irena kubectl expose deploy/kuryr-demo901 --port 80 --target-port 8080 --type=LoadBalancer11:53
irenashall I run openshift management commands instead?11:54
yboaron__I don't think so , for the native k8s resources you cna use k8s commands11:54
yboaron__can11:54
*** aojea has joined #openstack-kuryr11:55
irenathen it does not look right, but I am not sure what is expected11:55
yboaron__we should expect for same result as in k8s , service should be access vi load_balancer IP11:56
yboaron__via11:56
irenaapuimedo, please let me know the bare minimum to feel safe to merge the patch11:56
yboaron__but , you can curl via LB IP , right ?11:57
irenayes11:57
yboaron__irena, could you please open a bug for the incorrect/unexpected  value of external IP ?11:58
yboaron__or if you don't have time, I can do it11:58
irenasure, just checking what happens in non openshift environment11:58
irenayboaron__, I will add11:59
irenastill not sure if this is openshift specific11:59
yboaron__I didn't check LB service type at the openshift environment yet ...11:59
irenayboaron__, this is for non openshift deployment http://paste.ubuntu.com/26011782/12:00
irenalooks to be without external ip12:01
yboaron__Yep,12:01
*** salv-orlando has joined #openstack-kuryr12:01
yboaron__seems like LB services , need to be polished in openshift environment12:02
irenaapuimedo, anyway I do not think it should hold you devstack patch. Just let me know if there is more to verify. Otherwise I think we can merge your patch with your promise to provide documentation and open bug for LB type with OpenShift12:02
irenayboaron__, will ping you with the bug number12:02
yboaron__irena, 10x12:03
*** aojea has quit IRC12:05
irenayboaron__, https://bugs.launchpad.net/kuryr-kubernetes/+bug/173357612:08
openstackLaunchpad bug 1733576 in kuryr-kubernetes "LoadBalancer service Type in OpenShift deployment has confusing detailes" [Undecided,New]12:08
yboaron__irena, thanks a lot12:09
irenayboaron__, please check if there are some missing details (before I destroy the deployment)12:09
yboaron__irena, all good , I've got all the information - assigned it to myself12:10
irenayboaron__, thanks!12:11
*** irena has quit IRC12:11
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Do not merge: Running OpenShift on gates  https://review.openstack.org/52107712:47
*** aojea has joined #openstack-kuryr12:48
*** aojea_ has joined #openstack-kuryr12:50
*** aojea has quit IRC12:50
irenabapuimedo, another question for openshift devstack13:16
irenabwhat services should be present ?13:16
irenabdulek, maybe you know?13:16
dulekirenab: openshift-master and openshift-node should be enough.13:17
dulekirenab: But I'm not too experienced with it.13:17
irenabso if I see kubernetes-api, scheduler and controller, this is not good?13:17
*** janonymous has quit IRC13:17
*** gcheresh has joined #openstack-kuryr13:18
dulekirenab: It is not… :D13:19
irenabactually maybe it is leftovers after unstack the previous environment13:19
dulekirenab: Oh yes, service files aren't deleted.13:19
dulekSo if they're not running, you should be fine.13:19
dulekirenab: Not sure what OS you're using, but on CentOS there's this bug: https://bugs.launchpad.net/devstack/+bug/173127513:20
openstackLaunchpad bug 1731275 in devstack "DevStack kills services non-gracefully with systemd 219" [Undecided,In progress] - Assigned to Michal Dulko (michal-dulko-f)13:20
dulekirenab: It may leave some processes hanging after unstack.13:20
irenabI am on Xenial13:20
irenabThey are not running, so all good :-)13:21
dulek:)13:22
*** wangbo has quit IRC13:22
dmelladogcheresh: o/ welcome!13:22
dmelladonow if we could only get juriarte around here I wouldn't be happier13:23
gchereshdmellado: I'll tell him to join13:23
*** juriarte has joined #openstack-kuryr13:23
dmelladothanks!13:23
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Support kuryr-daemon when running containerized  https://review.openstack.org/51802413:49
*** salv-orlando has quit IRC13:51
*** salv-orlando has joined #openstack-kuryr13:52
*** vikasc has quit IRC13:52
*** aojea_ has quit IRC13:53
*** salv-orlando has quit IRC13:55
*** salv-orlando has joined #openstack-kuryr13:56
apuimedoirenab: did you file a bug about this openshift weirdness you reported to yboaron__ ?14:02
yboaron__apuimedo, #link https://bugs.launchpad.net/kuryr-kubernetes/+bug/173357614:03
openstackLaunchpad bug 1733576 in kuryr-kubernetes "LoadBalancer service Type in OpenShift deployment has confusing detailes" [Medium,New] - Assigned to yossib (yossi-boaron-1234)14:03
apuimedothanks yboaron__ !14:04
yboaron__apuimedo, you're welcome14:07
*** vikasc has joined #openstack-kuryr14:10
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Fix kubelet retries issues  https://review.openstack.org/51840414:22
gchereshltomasbo: dmellado the playbook run and failed after several minutes, I get all workers unreachable and there is a failure on maser as well after hundreeds of changes, am I missing anything else on the configuration?14:25
gchereshI saved the log for ansible run on the master machine if it can help14:26
yboaron__Hi guys ,14:51
yboaron__I'm getting exception ('Operation cannot be fulfilled ... the object has been modified') from k8s client when trying to change field value at annotation,14:51
yboaron__BTW , tested it on openshift devstack,14:51
yboaron__You cna find full details at : https://pastebin.com/S5Zuc1K414:52
ltomasbogcheresh, can you share your parameters.yaml as well as the output of the ansible playbook?14:52
yboaron__Any idea what's wrong ?14:52
*** aojea has joined #openstack-kuryr14:53
*** aojea has quit IRC14:58
*** yamamoto has quit IRC15:03
*** janki has quit IRC15:07
gchereshltomasbo: is it possible that you connect instead of copying paste?15:16
ltomasboI'm stuck in an integration meeting the whole day today and tomorrow15:16
gchereshok, I'll send you on mail15:17
ltomasboso, if you want it before that...15:17
ltomasboyou can just use pastebin15:17
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: devstack: add openshift support  https://review.openstack.org/49793315:21
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: devstack: add openshift support  https://review.openstack.org/49793315:37
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Do not merge: Running OpenShift on gates  https://review.openstack.org/52107715:37
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Do not merge: Running OpenShift on gates  https://review.openstack.org/52107715:40
*** gcheresh has quit IRC15:44
*** gouthamr has joined #openstack-kuryr15:44
*** garyloug has joined #openstack-kuryr15:48
*** aojea has joined #openstack-kuryr15:54
*** jistr is now known as jistr|mtg15:59
*** aojea has quit IRC16:00
*** yamamoto has joined #openstack-kuryr16:03
*** janki has joined #openstack-kuryr16:06
*** yamamoto has quit IRC16:09
*** jistr|mtg is now known as jistr16:16
*** yboaron__ has quit IRC16:35
*** salv-orlando has quit IRC16:45
*** salv-orlando has joined #openstack-kuryr16:46
*** salv-orlando has quit IRC16:50
*** juriarte has quit IRC16:52
*** salv-orlando has joined #openstack-kuryr17:02
*** yamamoto has joined #openstack-kuryr17:06
*** yamamoto has quit IRC17:12
*** janki has quit IRC17:22
*** aojea has joined #openstack-kuryr17:36
*** dougbtv_ has joined #openstack-kuryr17:39
*** aojea has quit IRC17:41
*** gcheresh has joined #openstack-kuryr17:48
*** pcaruana has quit IRC17:48
*** hongbin has joined #openstack-kuryr17:58
*** garyloug has quit IRC18:00
*** jistr is now known as jistr|off|trng18:04
*** yamamoto has joined #openstack-kuryr18:08
*** yamamoto has quit IRC18:12
*** gcheresh has quit IRC18:16
*** gcheresh has joined #openstack-kuryr18:53
*** yboaron__ has joined #openstack-kuryr19:05
*** dougbtv_ has quit IRC19:05
*** yamamoto has joined #openstack-kuryr19:09
*** yamamoto has quit IRC19:13
*** aojea has joined #openstack-kuryr19:17
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Do not merge: Running OpenShift on gates  https://review.openstack.org/52107719:41
*** yamamoto has joined #openstack-kuryr20:10
*** yamamoto has quit IRC20:14
*** salv-orlando has quit IRC20:15
*** salv-orlando has joined #openstack-kuryr20:16
*** salv-orlando has quit IRC20:20
*** gcheresh has quit IRC20:22
*** aojea has quit IRC20:29
*** aojea has joined #openstack-kuryr20:29
*** aojea has quit IRC20:34
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Do not merge: Running OpenShift on gates  https://review.openstack.org/52107720:35
*** salv-orlando has joined #openstack-kuryr20:37
*** gcheresh has joined #openstack-kuryr20:59
*** salv-orlando has quit IRC21:11
*** yamamoto has joined #openstack-kuryr21:11
*** salv-orlando has joined #openstack-kuryr21:11
*** yamamoto has quit IRC21:15
*** salv-orlando has quit IRC21:16
*** salv-orlando has joined #openstack-kuryr21:41
*** threestrands has joined #openstack-kuryr21:48
*** gcheresh has quit IRC21:48
*** yboaron__ has quit IRC22:07
*** yamamoto has joined #openstack-kuryr22:12
*** yamamoto has quit IRC22:17
*** aojea has joined #openstack-kuryr22:22
*** pmannidi has quit IRC22:27
*** pmannidi has joined #openstack-kuryr23:04
*** aojea has quit IRC23:06
*** yamamoto has joined #openstack-kuryr23:14
*** yamamoto has quit IRC23:18
*** salv-orlando has quit IRC23:59
*** salv-orlando has joined #openstack-kuryr23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!