Thursday, 2015-10-15

*** harshs has joined #openstack-containers00:00
*** Tango has quit IRC00:02
*** zz_dimtruck is now known as dimtruck00:09
*** Marga_ has quit IRC00:11
*** shaohe_robot has joined #openstack-containers00:11
*** apuimedo has quit IRC00:14
*** Marga_ has joined #openstack-containers00:14
*** eghobo_ has joined #openstack-containers00:16
*** eghobo has quit IRC00:20
*** achanda has quit IRC00:21
openstackgerritVilobh Meshram proposed openstack/magnum: Create BayModel with provided(VM/BM) server type  https://review.openstack.org/23502800:25
*** achanda has joined #openstack-containers00:25
*** eliqiao has joined #openstack-containers00:26
*** apuimedo has joined #openstack-containers00:26
*** shaohe_robot is now known as shaohe00:27
*** Marga_ has quit IRC00:28
openstackgerritMotohiro/Yuanying Otsuka proposed openstack/magnum: Fix registration failure caused by TLS support  https://review.openstack.org/23503000:28
openstackgerritVilobh Meshram proposed openstack/magnum: Create BayModel with provided(VM/BM) server type  https://review.openstack.org/23502800:28
*** adrian_otto has joined #openstack-containers00:29
*** adrian_otto has quit IRC00:30
*** vilobhmm11 has quit IRC00:31
*** suro-patz has quit IRC00:32
*** Tango has joined #openstack-containers00:34
*** eliqiao has quit IRC00:43
*** dimtruck is now known as zz_dimtruck00:43
*** tbh_ has joined #openstack-containers00:44
*** vimal has joined #openstack-containers00:45
*** julim has quit IRC00:45
*** adrian_otto has joined #openstack-containers00:48
*** sthillma has quit IRC00:48
*** eliqiao has joined #openstack-containers00:50
*** suro-patz has joined #openstack-containers00:51
*** adrian_otto has quit IRC00:52
*** suro-patz1 has joined #openstack-containers00:52
*** suro-patz has quit IRC00:55
*** eghobo_ has quit IRC00:59
openstackgerritMerged openstack/magnum: Document how to enable barbican in devstack  https://review.openstack.org/23264801:01
*** shaohe_robot1 has joined #openstack-containers01:07
*** shaohe has quit IRC01:08
*** suro-patz has joined #openstack-containers01:09
*** adrian_otto has joined #openstack-containers01:11
*** suro-patz1 has quit IRC01:11
*** suro-patz has quit IRC01:11
*** adrian_otto has quit IRC01:12
*** zhenguo has joined #openstack-containers01:14
*** apuimedo has quit IRC01:16
*** gangil has quit IRC01:24
*** shuquan has joined #openstack-containers01:25
*** eghobo has joined #openstack-containers01:47
*** zz_dimtruck is now known as dimtruck01:58
*** unicell has quit IRC02:00
*** tbh_ has quit IRC02:02
*** EricGonczer_ has joined #openstack-containers02:05
*** Shijia has joined #openstack-containers02:05
*** eghobo_ has joined #openstack-containers02:07
*** Shijia has quit IRC02:07
*** Shijia has joined #openstack-containers02:08
*** yunpengli has joined #openstack-containers02:09
*** yunpengli has quit IRC02:09
*** eghobo has quit IRC02:11
*** adrian_otto has joined #openstack-containers02:11
*** adrian_otto has quit IRC02:14
*** adrian_otto has joined #openstack-containers02:14
Shijiahi, i have found a problem with the bay-create command. Following the dev-quickstart.rst, if i set node-count=1, it can create successfully. BUT, if i set node-count=2, the bay-create will be failed, the reason is: Resource CREATE failed: MessagingTimeout: resources.kube_masters: Timed out waiting for a reply to message ID a6be235248d4671b6579aeb40602:14
*** Shijia_ has joined #openstack-containers02:17
*** Shijia has quit IRC02:17
*** sdake has joined #openstack-containers02:17
eghobo_Shijia: could you check heat or nova erros02:17
*** kan_ has joined #openstack-containers02:18
*** adrian_otto has quit IRC02:18
eghobo_it should work, you maybe out of resources at your devstack because it 3 vm + 15G storage02:18
Shijia_I tested this on a server, it had 256G memory.02:20
*** EricGonczer_ has quit IRC02:21
eghobo_it's cinder storage (LVM backend)02:21
*** adrian_otto has joined #openstack-containers02:21
Shijia_wait a moment, let me hava a try again.02:21
eliqiaocinder requires a 5G volume.02:22
*** Drago has quit IRC02:22
*** adrian_otto has quit IRC02:23
eghobo_--docker-volume-size 5 \02:23
*** Shijia has joined #openstack-containers02:24
*** Shijia_ has quit IRC02:24
eghobo_eg I have VOLUME_BACKING_FILE_SIZE=22G02:25
eghobo_in my local config02:25
ShijiaI have VOLUME_BACKING_FILE_SIZE=20G, it should be enough?02:26
eghobo_yes for 302:27
*** gangil has joined #openstack-containers02:30
*** gangil has quit IRC02:30
*** gangil has joined #openstack-containers02:30
*** Shijia_ has joined #openstack-containers02:32
*** Shijia has quit IRC02:32
Shijia_Oh, understand. Another question: If a node with docker_volume_size=5 created failed, did it still hold the volume space?02:33
*** harshs has quit IRC02:33
eghobo_honestly I don't know how cinder lvm driver works02:34
Shijia_ok, thanks all the same :)02:35
eliqiaoShijia_:  you'd better to check 'cinder list'02:36
eliqiaoeghobo_:  hi02:36
Shijia_ok02:36
eghobo_eliqiao: hi, how are you?02:37
eliqiaoeghobo_: as well :) I'd like to find you for have tested swarm with fedora-21-atomic-5-d181 ?02:37
eliqiaowith tls_enabled mode?02:37
eghobo_i did both02:38
eliqiaoeghobo_:  hmm , with tls_enabled, I can not start a bay.02:39
eliqiaochecking cloud-init output I get these: equests.exceptions.ConnectionError: HTTPConnectionPool(host='127.0.0.1', port=9511): Max retries exceeded with url: /v1/certificates/621e5690-74e0-48b5-ad0c-9627201781ea (Caused by <class 'socket.error'>: [Errno 111] Connection refused)02:39
eliqiaohmm... seems my public url not working ?? http://169.254.169.254/latest/meta-data/public-ipv402:40
eghobo_"/v1/certificates/621e5690-74e0-48b5-ad0c-9627201781ea" is it magnum or barbican?02:40
eghobo_check neutron metadata server02:41
eliqiaodef write_ca_cert(config):02:41
eliqiao    bay_cert_url = '%s/certificates/%s' % (config['MAGNUM_URL'],02:41
eliqiao                                           config['BAY_UUID'])02:41
eliqiaoMAGNUM_URL="http://127.0.0.1:9511/v1"02:42
eliqiaoit's a local service02:42
eliqiaoHTTPConnectionPool(host='127.0.0.1', port=9511)02:42
eliqiaowhat does the service do?02:42
eghobo_i believe it will return you certificate, http://docs.openstack.org/developer/magnum/dev/dev-tls.html02:45
eghobo_magnum ca-show --bay secure-k8sbay > ca.crt02:45
*** eghobo has joined #openstack-containers02:48
*** eghobo_ has quit IRC02:51
eliqiaoeghobo: thx, I will debug it more.02:52
eghobosure, it's hard to tell02:52
eliqiaoeghobo: could you tell what's service on your swarm-master use port=9511?02:54
eliqiaoI don02:54
eliqiaoI don't think this issue is due to devstack service issue. that service should be inside of swarm-master02:55
eghobowe shouldn't have anything magum related at master after provisionig02:56
eghoboyou can do docker ps and see all swarm images and ports/etc02:57
eliqiaoeghobo: docker service is not running.02:58
eliqiaoah... I know the root cause.02:59
eliqiaothe heat parameter is MAGNUM_URL="http://127.0.0.1:9511/v1"02:59
eliqiaoit should be my devstack's local ip02:59
eliqiaobut I set it to 127.0.0.1 to avoid service failur when host ip change02:59
eliqiaoeghobo: I will dig if we can improve this when passing heat_parameter03:00
*** madhuri has joined #openstack-containers03:03
madhuriyuanying: Hi03:04
yuanyinghi madhuri03:04
madhuriabout https://review.openstack.org/#/c/235030/1/magnum/templates/heat-kubernetes/fragments/kube-register.yaml03:04
madhuriI think KUBE_API_PORT is not initialised?03:05
yuanyingThat is initialized at /etc/sysconfig/heat-params03:05
madhuriOk got it. Thanks :)03:06
yuanyingnp :)03:06
*** sdake has quit IRC03:07
*** dimtruck is now known as zz_dimtruck03:11
*** shu has joined #openstack-containers03:12
openstackgerritMerged openstack/magnum: Fix registration failure caused by TLS support  https://review.openstack.org/23503003:13
*** dims_ has quit IRC03:18
*** dave-mcc_ has joined #openstack-containers03:20
*** Shijia has joined #openstack-containers03:21
*** Shijia_ has quit IRC03:21
*** dave-mccowan has quit IRC03:23
*** dave-mcc_ has quit IRC03:25
*** puranamr has joined #openstack-containers03:26
*** eghobo has quit IRC03:29
*** eghobo has joined #openstack-containers03:32
*** rpothier has joined #openstack-containers03:35
*** suro-patz has joined #openstack-containers03:40
*** hblixt has joined #openstack-containers03:40
*** suro-patz has quit IRC03:43
*** VikasC_ has joined #openstack-containers03:43
*** rpothier has quit IRC03:49
*** suro-patz has joined #openstack-containers03:54
*** shuquan has quit IRC03:54
*** shuquan has joined #openstack-containers03:55
*** puranamr has quit IRC03:58
*** puranamr has joined #openstack-containers03:58
*** puranamr has quit IRC04:00
*** puranamr has joined #openstack-containers04:02
*** adrian_otto has joined #openstack-containers04:03
*** puranamr has quit IRC04:05
*** shuquan has quit IRC04:05
*** puranamr has joined #openstack-containers04:06
*** shuquan has joined #openstack-containers04:06
*** puranamr has quit IRC04:08
*** shuquan has quit IRC04:08
*** tbh has joined #openstack-containers04:09
*** puranamr has joined #openstack-containers04:12
*** sthillma has joined #openstack-containers04:13
*** sthillma_ has joined #openstack-containers04:17
*** puranamr has quit IRC04:18
*** dims has joined #openstack-containers04:18
*** puranamr has joined #openstack-containers04:19
*** sthillma has quit IRC04:20
*** sthillma_ is now known as sthillma04:20
*** deepthi has joined #openstack-containers04:20
*** shuquan has joined #openstack-containers04:20
*** puranamr has quit IRC04:22
*** puranamr has joined #openstack-containers04:23
*** dims has quit IRC04:24
*** puranamr has quit IRC04:30
*** puranamr has joined #openstack-containers04:32
*** achanda has quit IRC04:32
openstackgerritbharaththiruveedula proposed openstack/magnum: [WIP]Monitor driver for k8s bay type  https://review.openstack.org/23481704:33
*** puranamr has quit IRC04:34
*** puranamr_ has joined #openstack-containers04:34
*** adrian_otto has quit IRC04:34
*** adrian_otto has joined #openstack-containers04:39
*** puranamr_ has quit IRC04:39
*** puranamr has joined #openstack-containers04:41
*** Kennan has quit IRC04:41
*** adrian_otto has quit IRC04:42
*** adrian_otto has joined #openstack-containers04:42
*** Kennan has joined #openstack-containers04:42
*** adrian_otto has quit IRC04:46
*** suro-patz has quit IRC04:54
*** puranamr has quit IRC05:16
*** jwcroppe has joined #openstack-containers05:16
*** harshs has joined #openstack-containers05:20
*** dims has joined #openstack-containers05:21
*** Marga_ has joined #openstack-containers05:24
*** Marga_ has joined #openstack-containers05:25
*** achanda has joined #openstack-containers05:25
*** dims has quit IRC05:26
*** sthillma has quit IRC05:29
*** Shijia has quit IRC05:30
*** adrian_otto has joined #openstack-containers05:32
*** Marga_ has quit IRC05:38
*** eghobo_ has joined #openstack-containers05:40
*** harshs_ has joined #openstack-containers05:41
*** harshs has quit IRC05:43
*** harshs_ is now known as harshs05:43
*** eghobo has quit IRC05:44
*** puranamr has joined #openstack-containers05:48
*** puranamr has quit IRC05:49
*** adrian_otto has quit IRC05:50
*** puranamr has joined #openstack-containers05:51
wenchmaeghobo_ : tried fedora-21-atomic-5-d181, the swarm-agent , swarm-manager, docker services  all failed to start05:51
eghobo_what is the error?05:51
wenchmaeghobo_ : Dependency failed for Swarm Manager.05:52
wenchmaDependency failed for Swarm Agent.05:53
wenchmaUnit swarm-agent.service has failed05:53
eghobo_can you run systemctl status swarm-agent05:54
wenchmayes05:54
wenchma$ sudo systemctl status swarm-agent05:55
wenchma● swarm-agent.service - Swarm Agent05:55
wenchma   Loaded: loaded (/etc/systemd/system/swarm-agent.service; enabled)05:55
wenchma   Active: inactive (dead)05:55
wenchmaOct 15 03:07:57 swarmbay-d181-ogkqhbzvj3kk-swarm-master-n7j4hxrnppgu.novalocal systemd[1]: Dependency failed for Swarm Agent.05:55
wenchmaOct 15 03:07:57 swarmbay-d181-ogkqhbzvj3kk-swarm-master-n7j4hxrnppgu.novalocal systemd[1]: Triggering OnFailure= dependencies of swarm-agent.service.05:55
eghobo_run cat /etc/systemd/system/swarm-agent.service05:56
*** harshs has quit IRC05:59
*** harshs has joined #openstack-containers06:00
*** eghobo has joined #openstack-containers06:04
*** eghobo_ has quit IRC06:04
*** diga has joined #openstack-containers06:09
*** vilobhmm11 has joined #openstack-containers06:12
wenchma$ cat /etc/systemd/system/swarm-agent.service06:13
wenchma[Unit]06:13
wenchmaDescription=Swarm Agent06:13
wenchmaAfter=docker.service06:13
wenchmaRequires=docker.service06:13
wenchmaOnFailure=swarm-agent-failure.service06:13
wenchma[Service]06:14
wenchmaTimeoutStartSec=006:14
wenchmaExecStartPre=-/usr/bin/docker kill swarm-agent06:14
wenchmaExecStartPre=-/usr/bin/docker rm swarm-agent06:14
wenchmaExecStartPre=-/usr/bin/docker pull swarm:0.2.006:14
wenchma#TODO: roll-back from swarm:0.2.0 to swarm if atomic image can work with latest swarm image06:14
wenchmaExecStart=/usr/bin/docker run -e http_proxy= -e https_proxy= -e no_proxy=  --name swarm-agent swarm:0.2.0 join --addr 10.0.0.3:2375 token://d9475e211e10df1b90b2f6068eb0dadc06:14
wenchmaExecStop=/usr/bin/docker stop swarm-agent06:14
wenchmaExecStartPost=/usr/bin/curl -sf -X PUT -H 'Content-Type: application/json' \06:14
wenchma  --data-binary '{"Status": "SUCCESS", "Reason": "Setup complete", "Data": "OK", "UniqueId": "00000"}' \06:14
wenchma  "http://9.5.124.160:8000/v1/waitcondition/arn%3Aopenstack%3Aheat%3A%3A25d3e023cd544577ae3a0c40ad12a368%3Astacks%2Fswarmbay-d181-ogkqhbzvj3kk%2F964c7309-2a98-4769-b2fe-6c218aab4236%2Fresources%2Fagent_wait_handle?Timestamp=2015-10-15T02%3A58%3A46Z&SignatureMethod=HmacSHA256&AWSAccessKeyId=be669fa02f694e5bbc762a35b74db36e&SignatureVersion=2&Signature=5MScxGoSlFdIEpSF9PrguKjUN%2F6QaE0tuU6PwvfIOAM%3D"06:14
wenchma[Install]06:14
wenchmaWantedBy=multi-user.target06:14
wenchma@ehgobo_06:14
*** Marga_ has joined #openstack-containers06:14
wenchmastill swarm:0.2.006:15
*** unicell has joined #openstack-containers06:16
*** apuimedo has joined #openstack-containers06:18
*** Marga_ has quit IRC06:21
eghobohttps://github.com/openstack/magnum/blob/master/magnum/templates/docker-swarm/fragments/write-swarm-agent-service.yaml06:21
eghoboyou need to update your setup06:21
*** dims has joined #openstack-containers06:22
*** shuquan has quit IRC06:25
*** puranamr has quit IRC06:26
*** dims has quit IRC06:27
*** eghobo has quit IRC06:36
*** apuimedo has quit IRC06:36
wenchmaeghobo : do you mean  I can directly update setup inside swarm master node ?06:36
eliqiaowenchma: you need to upgrade your magnum code06:39
wenchmagot it06:40
wenchmathx06:40
eliqiaonp06:40
*** suro-patz has joined #openstack-containers06:46
openstackgerritMotohiro/Yuanying Otsuka proposed openstack/magnum: Fix bay-create failure without "name"  https://review.openstack.org/23511406:52
*** chandankumar has joined #openstack-containers06:53
*** dona has joined #openstack-containers06:55
donaHi, I am not able to run any command in the master node.. gives me an error Get http://localhost:8080/api: dial tcp 127.0.0.1:8080: connection refused. has anybody got the same issue and resolved?06:59
*** belmoreira has joined #openstack-containers07:10
*** harshs has quit IRC07:15
*** Tango has quit IRC07:17
*** j___ has joined #openstack-containers07:19
*** achanda has quit IRC07:27
eliqiaodona: k8s master ?07:29
*** achanda has joined #openstack-containers07:36
*** achanda has quit IRC07:37
*** suro-patz has quit IRC07:37
*** achanda has joined #openstack-containers07:39
*** Shijia has joined #openstack-containers07:50
*** alex_klimov has joined #openstack-containers07:59
*** achanda has quit IRC08:03
*** alex_klimov has quit IRC08:09
*** achanda has joined #openstack-containers08:12
*** madhuri has quit IRC08:19
*** dims has joined #openstack-containers08:25
*** jwcroppe has quit IRC08:27
*** jwcroppe has joined #openstack-containers08:28
*** dims has quit IRC08:30
*** jwcroppe has quit IRC08:32
*** brendenblanco has quit IRC08:36
*** brendenblanco has joined #openstack-containers08:38
*** shuquan has joined #openstack-containers08:46
robcresswelladrian_otto: Working with Brad Jones to flesh out the Magnum UI APIs and adding tests/ test data. Just wanted to say hi :)08:53
*** mbound has joined #openstack-containers08:55
*** exploreshaifali has joined #openstack-containers08:59
*** vilobhmm11 has quit IRC09:11
*** shuquan has quit IRC09:13
*** shuquan has joined #openstack-containers09:14
*** diga has quit IRC09:15
*** achanda has quit IRC09:15
*** chandankumar has quit IRC09:20
*** chandankumar has joined #openstack-containers09:24
*** dims has joined #openstack-containers09:27
donaeliqiao: yes, k8s master09:29
*** dims has quit IRC09:32
*** purple has joined #openstack-containers09:34
*** shuquan has quit IRC09:34
*** achanda has joined #openstack-containers09:34
*** chandankumar is now known as charlie09:35
*** shuquan has joined #openstack-containers09:36
purpleHi, I am able to create a k8s bay, but when trying to create a swarm bay it gives me the error: ERROR: Timed out waiting for a reply to message ID 530758672d034697baea5548a4a4b9df (HTTP 500. Can someone help09:38
*** shuquan has quit IRC09:40
*** shuquan has joined #openstack-containers09:41
*** exploreshaifali has quit IRC09:48
KennanHi purple:09:48
KennanI found this issue was related with discovery_url = requests.get(discovery_endpoint).text09:49
Kennanit seems etcd url has some issue09:49
KennanI am asking this question in #etcd channel09:49
*** exploreshaifali has joined #openstack-containers09:51
*** dims has joined #openstack-containers09:51
*** achanda has quit IRC09:55
*** shuquan has quit IRC10:05
*** jwcroppe has joined #openstack-containers10:05
*** jwcroppe has quit IRC10:06
*** jwcroppe has joined #openstack-containers10:06
openstackgerritRico Lin proposed openstack/python-magnumclient: improve readme contents  https://review.openstack.org/23521710:08
Kennanpurple: I hit that in k8s bay10:08
KennanI did not try swarm bay10:09
*** zhenguo has quit IRC10:09
eliqiaodona: you need to check kube-apiserver status10:10
eliqiaoand also etcd's status10:10
eliqiaoplease note etcd would like to access internet.10:10
*** jwcroppe has quit IRC10:11
eliqiaodona:  make sure you are not facing network issue.10:11
purpleKennan: oh ok.. I tried without giving the discovery_url parameter and I got k8s bay created but not swarm bay10:11
donaeliqiao: etcd is active but kube-apiserver is failed.. trying to restart it is not helping either10:12
Kennanpurple: I tried simeple as dev-quickguide10:12
KennanI did not input discovery url10:13
Kennanthe default url is like this10:14
Kennandefault='https://discovery.etcd.io/new?size=%(size)d10:14
Kennanif you not customize10:14
purpleKennan: ok so with swarm bay were u able to create a bay without giving the discovery url?10:15
KennanI did not try it now. maybe let me try10:15
purpleKennan: ok10:16
*** jwcroppe has joined #openstack-containers10:18
Kennanhi purple10:18
Kennani kicked one command10:18
eliqiaodona: please check etcd's detail information.10:18
Kennanthe bay is creating in progress10:18
eliqiaodona:  use systemctl status etcd.service -l10:19
*** charlie has quit IRC10:20
purpleKennan: oh, for me the error hits as soon I hit the command for swarm bay :(10:21
*** chandankumar has joined #openstack-containers10:21
Kennanseems it is ok for me10:21
*** jwcroppe has quit IRC10:21
donaeliqiao: ● etcd.service - Etcd Server    Loaded: loaded (/usr/lib/systemd/system/etcd.service; enabled)    Active: active (running) since Mon 2015-10-12 11:05:14 UTC; 2 days ago  Main PID: 794 (etcd)    CGroup: /system.slice/etcd.service            └─794 /usr/bin/etcd10:22
*** jwcroppe has joined #openstack-containers10:22
*** chandankumar has quit IRC10:24
*** chandankumar has joined #openstack-containers10:25
*** jwcroppe has quit IRC10:26
*** i316653 has joined #openstack-containers10:27
Kennanpurple: my swarm bay start ok10:30
Kennandid you use latest code from github ?10:31
Kennanpurple: ?10:31
purpleKennan: I cloned the magnum code 2 weeks back..10:33
Kennanpruple: i used latest code10:34
Kennanpurple:10:34
*** alex_klimov has joined #openstack-containers10:34
*** dave-mccowan has joined #openstack-containers10:36
eliqiaodona: not sure, are you using tls_enabled mode?10:36
eliqiaodona: by default , it is tls_enabled mode.10:37
*** vimal has quit IRC10:37
eliqiaodona: if you are using tls_enabled mode, not sure if you can connect it directory, check this doc http://docs.openstack.org/developer/magnum/dev/dev-tls.html#10:38
eliqiaodona: of if possible, can you please test if tls_disabled mode works fine?10:38
eliqiaodona: I tested in my ENV(with tls_enabled), kubectl get pods works fine10:42
eliqiaodona: I hit your problem before, and fixed by set proxy for etcd service since etcd will try to connect https://discovery.etcd.io10:43
donaeliqiao: Sorry but am new to container sysytem, could you tell me how to check tls_enabled mode10:47
eliqiaoyeah, you can "ps aux | grep kube"10:50
*** weihan has joined #openstack-containers10:51
eliqiaocheck if /usr/bin/kube-apiserver has ca_file in the parameter line.10:51
eliqiaodona:  sorry , I should leave now..10:52
donaeliqiao: oh ok10:52
eliqiaodona:  it works for me in both tls_enabled tls_disabled mode.10:52
donawill try working it out with what u have said10:52
eliqiaodona: so your issue maybe due to etcd not health10:52
eliqiaodona: c u.10:53
openstackgerritBradley Jones proposed openstack/magnum-ui: Fix select all button in table view  https://review.openstack.org/23526010:59
openstackgerritBradley Jones proposed openstack/magnum-ui: Fix select all button in table view  https://review.openstack.org/23526011:00
*** zz_dimtruck is now known as dimtruck11:02
openstackgerritBradley Jones proposed openstack/magnum-ui: Fix select all button in table view  https://review.openstack.org/23526011:02
*** liangbo has joined #openstack-containers11:11
*** slotty has joined #openstack-containers11:29
*** deepthi has quit IRC11:31
*** weihan_ has joined #openstack-containers11:55
*** weihan has quit IRC11:56
*** EricGonczer_ has joined #openstack-containers12:04
*** slotty has quit IRC12:04
*** _hanhart has joined #openstack-containers12:13
*** bradjones has joined #openstack-containers12:16
*** bradjones has quit IRC12:16
*** bradjones has joined #openstack-containers12:16
*** _hanhart has quit IRC12:21
*** eliqiao has quit IRC12:23
*** dimtruck is now known as zz_dimtruck12:23
*** zz_dimtruck is now known as dimtruck12:31
*** puranamr has joined #openstack-containers12:33
*** pradk has joined #openstack-containers12:35
*** _hanhart has joined #openstack-containers12:38
*** VikasC_ has quit IRC12:42
*** puranamr has quit IRC12:43
*** puranamr has joined #openstack-containers12:45
*** _hanhart has quit IRC12:46
*** dimtruck is now known as zz_dimtruck12:53
*** Tango has joined #openstack-containers13:00
*** rlrossit has joined #openstack-containers13:05
*** julim has joined #openstack-containers13:10
openstackgerritRob Cresswell proposed openstack/magnum-ui: Add API for container create, delete, list, show  https://review.openstack.org/23532713:13
*** EricGonczer_ has quit IRC13:17
*** j___ has quit IRC13:18
*** weihan_ has quit IRC13:23
*** jwcroppe has joined #openstack-containers13:27
*** puranamr has quit IRC13:27
*** puranamr has joined #openstack-containers13:32
*** julim has quit IRC13:35
*** daneyon_ has quit IRC13:37
*** dane_leblanc has joined #openstack-containers13:41
*** Shijia has quit IRC13:42
*** Shijia has joined #openstack-containers13:42
*** diga has joined #openstack-containers13:43
*** Shijia_ has joined #openstack-containers13:51
*** j___ has joined #openstack-containers13:52
*** i316653_ has joined #openstack-containers13:52
*** hongbin has joined #openstack-containers13:53
*** Shijia has quit IRC13:54
*** zz_dimtruck is now known as dimtruck13:57
*** kan_ has quit IRC14:00
*** tbh has quit IRC14:00
*** dimtruck is now known as zz_dimtruck14:01
*** Shijia_ has quit IRC14:01
*** zz_dimtruck is now known as dimtruck14:02
*** annegentle has joined #openstack-containers14:06
openstackgerritbharaththiruveedula proposed openstack/magnum: [WIP]Monitor driver for k8s bay type  https://review.openstack.org/23481714:08
*** coolsvap has quit IRC14:12
*** coolsvap has joined #openstack-containers14:14
*** _navneet has joined #openstack-containers14:16
*** muralia1 has joined #openstack-containers14:16
*** adrian_otto has joined #openstack-containers14:16
*** muralia has quit IRC14:18
*** exploreshaifali has quit IRC14:20
*** adrian_otto has quit IRC14:21
*** puranamr has quit IRC14:21
*** chandankumar has quit IRC14:22
*** suro-patz has joined #openstack-containers14:29
*** annegentle has quit IRC14:34
openstackgerritBradley Jones proposed openstack/magnum-ui: Fix select all button in table view  https://review.openstack.org/23526014:35
*** _navneet_ has joined #openstack-containers14:36
*** adrian_otto has joined #openstack-containers14:36
openstackgerritBradley Jones proposed openstack/magnum-ui: Bay REST API  https://review.openstack.org/23444014:37
openstackgerritBradley Jones proposed openstack/magnum-ui: Add table view for Bay  https://review.openstack.org/22255114:37
*** adrian_otto has quit IRC14:37
*** _navneet has quit IRC14:39
openstackgerritBradley Jones proposed openstack/magnum-ui: Fix select all button in table view  https://review.openstack.org/23526014:40
*** dims has quit IRC14:41
*** dims has joined #openstack-containers14:42
*** suro-patz has quit IRC14:45
*** manjeets has joined #openstack-containers14:45
*** dims_ has joined #openstack-containers14:45
*** dims has quit IRC14:48
*** hblixt has quit IRC14:57
openstackgerritHongbin Lu proposed openstack/magnum: Open port 6443 in security group for k8s bay  https://review.openstack.org/23501015:03
*** adrian_otto has joined #openstack-containers15:03
openstackgerritBradley Jones proposed openstack/magnum-ui: Bay REST API  https://review.openstack.org/23444015:18
openstackgerritBradley Jones proposed openstack/magnum-ui: Add table view for Bay  https://review.openstack.org/22255115:18
*** deepthi has joined #openstack-containers15:19
manjeetsHenryG15:22
manjeetsping15:22
*** puranamr has joined #openstack-containers15:22
*** puranamr has quit IRC15:27
*** sdake has joined #openstack-containers15:27
*** suro-patz has joined #openstack-containers15:27
*** belmoreira has quit IRC15:28
*** Drago has joined #openstack-containers15:31
*** openstackgerrit has quit IRC15:31
*** Drago has quit IRC15:31
*** openstackgerrit has joined #openstack-containers15:31
*** Drago has joined #openstack-containers15:31
*** daneyon has joined #openstack-containers15:33
*** chandankumar has joined #openstack-containers15:34
*** slotty has joined #openstack-containers15:43
*** sdake has quit IRC15:48
*** tbh has joined #openstack-containers15:50
*** tbh_ has joined #openstack-containers15:50
*** tbh has quit IRC15:50
*** hblixt has joined #openstack-containers15:54
*** Tango has quit IRC15:57
*** suro-patz has quit IRC15:57
*** i316653_ has quit IRC15:59
*** i316653 has quit IRC15:59
*** eghobo has joined #openstack-containers16:00
*** puranamr has joined #openstack-containers16:02
*** eghobo_ has joined #openstack-containers16:03
*** eghobo has quit IRC16:06
openstackgerritTom Cammann proposed openstack/magnum: Split test_bay_conductor tests  https://review.openstack.org/23546616:10
*** puranamr has quit IRC16:10
*** puranamr has joined #openstack-containers16:11
*** slotty has quit IRC16:11
*** liangbo has quit IRC16:13
*** puranamr has quit IRC16:18
*** puranamr has joined #openstack-containers16:19
*** puranamr has quit IRC16:21
*** puranamr has joined #openstack-containers16:25
*** chandankumar has quit IRC16:26
*** alex_klimov has quit IRC16:27
*** puranamr has quit IRC16:27
*** mbound has quit IRC16:28
*** puranamr has joined #openstack-containers16:28
*** BertrandN has quit IRC16:29
*** deepthi has quit IRC16:33
*** sdake has joined #openstack-containers16:35
*** unicell has quit IRC16:36
*** annegentle has joined #openstack-containers16:36
*** suro-patz has joined #openstack-containers16:42
*** annegentle has quit IRC16:45
*** puranamr has quit IRC16:50
*** puranamr has joined #openstack-containers16:53
*** Marga_ has joined #openstack-containers16:54
*** puranamr has quit IRC16:55
*** Marga_ has quit IRC16:56
*** Marga_ has joined #openstack-containers16:56
*** jwcroppe has quit IRC16:57
*** gangil has quit IRC17:02
*** puranamr has joined #openstack-containers17:02
*** puranamr has quit IRC17:04
*** puranamr has joined #openstack-containers17:05
*** dimtruck is now known as zz_dimtruck17:06
*** Tango has joined #openstack-containers17:07
*** chandankumar has joined #openstack-containers17:07
*** unicell has joined #openstack-containers17:07
*** puranamr has quit IRC17:10
*** harshs has joined #openstack-containers17:13
*** bitblt has joined #openstack-containers17:13
*** Marga_ has quit IRC17:14
*** Marga_ has joined #openstack-containers17:15
*** achanda has joined #openstack-containers17:18
*** vilobhmm11 has joined #openstack-containers17:20
*** diga has quit IRC17:27
*** Tango has quit IRC17:30
*** Marga_ has quit IRC17:33
*** jwcroppe has joined #openstack-containers17:34
openstackgerritMerged openstack/magnum: Fix bay-create failure without "name"  https://review.openstack.org/23511417:34
*** gangil has joined #openstack-containers17:36
*** gangil has quit IRC17:36
*** gangil has joined #openstack-containers17:36
*** rlrossit has quit IRC17:42
*** manjeets has quit IRC17:43
*** adrian_otto has quit IRC17:43
*** rlrossit has joined #openstack-containers17:44
openstackgerritHongbin Lu proposed openstack/magnum: Open port 6443 in security group for k8s bay  https://review.openstack.org/23501017:49
openstackgerritHongbin Lu proposed openstack/magnum: WIP: Test TLS enabled bay in functional gate  https://review.openstack.org/23551217:49
*** sthillma has joined #openstack-containers17:55
*** adrian_otto has joined #openstack-containers18:01
*** david-lyle has quit IRC18:01
*** david-lyle has joined #openstack-containers18:02
*** suro-patz has quit IRC18:03
*** suro-patz has joined #openstack-containers18:03
*** suro-patz has quit IRC18:06
*** julim has joined #openstack-containers18:07
tbh_vilobhmm11: Hi, are list_namespaced_pod, list_pod  different?18:11
*** exploreshaifali has joined #openstack-containers18:13
*** alejandrito has joined #openstack-containers18:14
*** zz_dimtruck is now known as dimtruck18:16
*** bitblt has quit IRC18:16
*** Tango has joined #openstack-containers18:17
*** gangil has quit IRC18:17
vilobhmm11tbh : wanted to understand the reasoning why you choose one over another18:18
vilobhmm11adrian_otto, hongbin : https://review.openstack.org/#/q/status:open+project:openstack/magnum+branch:master+topic:bp/objects-from-bay,n,z the object from bay patches need review…I have address tom and kennan's comment on restructuring the code and the need for place holder code…please check whenever you are free18:21
adrian_ottovilobhmm11: ok, I will free up later today, and will be sure I make it through those18:23
*** suro-patz has joined #openstack-containers18:23
vilobhmm11adrian_otto : thanks!18:24
hongbinvilobhmm11: I am giving priority to the must-have fixes in etherpad. Will get back to your patches later.18:29
adrian_ottothanks!18:31
vilobhmm11hongbin : thanks!18:33
*** pradk has quit IRC18:35
*** achanda has quit IRC18:36
*** manjeets has joined #openstack-containers18:36
*** pradk has joined #openstack-containers18:36
*** gangil has joined #openstack-containers18:37
*** gangil has quit IRC18:37
*** gangil has joined #openstack-containers18:37
openstackgerritVilobh Meshram proposed openstack/magnum: Create BayModel with provided(VM/BM) server type  https://review.openstack.org/23502818:39
*** dims has joined #openstack-containers18:43
*** achanda has joined #openstack-containers18:44
*** dims_ has quit IRC18:45
*** achanda has quit IRC18:46
*** dims has quit IRC18:47
*** suro-patz1 has joined #openstack-containers18:49
*** suro-patz has quit IRC18:49
*** klindgren_ has joined #openstack-containers18:54
*** subscope has joined #openstack-containers18:56
*** klindgren has quit IRC18:57
*** chandankumar has quit IRC18:57
*** rlrossit has quit IRC19:02
*** rlrossit has joined #openstack-containers19:07
*** tbh_ has quit IRC19:10
*** dims has joined #openstack-containers19:11
*** manjeets has quit IRC19:12
*** adrian_otto has quit IRC19:20
*** suro-patz1 has quit IRC19:29
*** suro-patz has joined #openstack-containers19:30
*** dims has quit IRC19:30
*** achanda has joined #openstack-containers19:32
*** EricGonczer_ has joined #openstack-containers19:34
*** alex_klimov has joined #openstack-containers19:34
*** manjeets has joined #openstack-containers19:35
*** suro-patz has quit IRC19:39
*** suro-patz has joined #openstack-containers19:39
*** gangil has quit IRC19:42
*** Marga_ has joined #openstack-containers19:52
*** achanda has quit IRC19:58
*** Marga_ has quit IRC20:02
*** Marga_ has joined #openstack-containers20:03
*** dane_leblanc_ has joined #openstack-containers20:04
*** dane_leblanc has quit IRC20:07
*** Marga_ has quit IRC20:08
*** achanda has joined #openstack-containers20:19
*** subscope has quit IRC20:25
*** eggshell has quit IRC20:26
*** achanda has quit IRC20:28
*** eggshell has joined #openstack-containers20:28
*** sthillma has quit IRC20:29
*** Guest71541 has joined #openstack-containers20:32
*** julim has quit IRC20:35
*** eghobo_ has quit IRC20:37
*** Guest71541 is now known as dims_20:46
*** hblixt_ has joined #openstack-containers20:48
*** hblixt has quit IRC20:52
*** _navneet_ has quit IRC20:56
*** achanda has joined #openstack-containers20:56
*** j___ has quit IRC21:02
*** suro-patz has quit IRC21:02
*** rlrossit has left #openstack-containers21:04
*** harshs has quit IRC21:06
*** vilobhmm111 has joined #openstack-containers21:08
*** vilobhmm11 has quit IRC21:09
*** suro-patz has joined #openstack-containers21:11
*** eghobo has joined #openstack-containers21:26
*** achanda has quit IRC21:32
*** Marga_ has joined #openstack-containers21:33
*** _hblixt_ has joined #openstack-containers21:40
*** gangil has joined #openstack-containers21:43
*** gangil has quit IRC21:43
*** gangil has joined #openstack-containers21:43
*** hblixt_ has quit IRC21:43
*** suro-patz has quit IRC21:44
*** suro-patz has joined #openstack-containers21:46
*** suro-patz has quit IRC21:46
*** suro-patz has joined #openstack-containers21:46
*** vilobhmm111 has quit IRC21:46
*** suro-patz1 has joined #openstack-containers21:47
*** vilobhmm11 has joined #openstack-containers21:47
*** vilobhmm11 has quit IRC21:47
*** vilobhmm11 has joined #openstack-containers21:47
*** dimtruck is now known as zz_dimtruck21:49
*** suro-patz2 has joined #openstack-containers21:50
*** suro-patz1 has quit IRC21:50
*** suro-patz has quit IRC21:50
daneyonhongbin are you there?21:51
hongbindaneyon: sup21:51
daneyonyou know quite a bit about the atomic image, correct?21:52
daneyonhongbin ^21:52
hongbindaneyon: not too much. What is the question?21:53
daneyontake a look at this: https://github.com/kubernetes/kubernetes/blob/master/pkg/kubelet/network/exec/exec.go#L1821:53
daneyonhongbin: that directory does not exist and Atomic does not allow me to create it.21:53
daneyonhongbin: I am wondering if maybe a newer version of kubelet creates the directory.21:54
hongbinnot sure. sdake, do you have any idea?21:55
*** suro-patz2 has quit IRC21:57
*** eghobo_ has joined #openstack-containers21:58
*** suro-patz has joined #openstack-containers21:58
*** suro-patz has quit IRC21:58
*** suro-patz has joined #openstack-containers21:58
*** eghobo has quit IRC22:01
*** suro-patz has quit IRC22:05
*** suro-patz has joined #openstack-containers22:07
*** manjeets has quit IRC22:07
*** Marga_ has quit IRC22:10
*** achanda has joined #openstack-containers22:12
*** harshs has joined #openstack-containers22:12
*** achanda has quit IRC22:13
*** achanda has joined #openstack-containers22:14
*** manjeets has joined #openstack-containers22:19
*** manjeets has quit IRC22:28
*** kebray has joined #openstack-containers22:29
*** _hblixt_ has quit IRC22:30
Tangodaneyon: Looks like this directory is set up when you install a package through atomic rpm-ostree.22:31
Tangodaneyon: I would guess the plugin has to be packaged as an RPM22:31
daneyonTango: If I need to add the DIR, should I follow: https://github.com/openstack/magnum/blob/master/doc/source/dev/dev-build-atomic-image.rst#update-an-existing-fedora-atomic-server22:31
Tangodaneyon: That's how atomic does it, but it's per package22:32
Tangodaneyon: i.e. the package has to be in the rpm-ostree repo22:32
Tangodaneyon: Are you thinking of an existing plugin, or something new to be created?22:34
daneyonTango what's weird is that kubelet v1.0 and later should be creating this DIR: https://github.com/kubernetes/kubernetes/blob/master/pkg/kubelet/network/exec/exec.go#L1822:34
*** manjeets has joined #openstack-containers22:36
Tangodaneyon: I can try building with their latest to see it it creates this directory22:36
daneyonTango that would be awesome!!!!22:36
Tangodaneyon: So they have a number of plugins as part of their installation?22:37
daneyonTango: vendors simply copy their plugin bin to that DIR, add the plugin name to the kubelet.conf and restart kubelet to use the plugin.22:38
daneyonTango: Unfortunately, the kubelet plugin DIR is not configurable.22:38
Tangodaneyon: Yeah, atomic wants to snapshot the state of the full OS so they lock down many of the system directories22:39
Tangodaneyon: but I think you can create them in cloud-init22:39
*** suro-patz has quit IRC22:40
daneyonTango: Another potential issue is loading kernel modules. For example, if we want to add ovs as a kubelet plugin, ovs needs to load a kernel module. Can this be done with the atomic image? Can you modprobe openvswitch?22:40
Tangodaneyon: We might consider moving to maybe a Ubuntu based image to make it easier to prototype22:42
daneyonTango: That would be a nice option to have.22:42
*** kebray has quit IRC22:43
daneyonTango: Then we can go back to the mico-os distro's and let them know the gaps that we need their help to address.22:43
Tangodaneyon: We can use diskimagebuilder, like hongbin did for mesos.  There are probably some elements already created that can be reused to build Kubernetes.22:44
Tangodaneyon: Looks like the Murano folks are looking into this22:46
Tangodaneyon: https://blueprints.launchpad.net/murano-apps/+spec/update-k8-to-v1-dib-elements22:46
*** exploreshaifali has quit IRC22:49
openstackgerritHongbin Lu proposed openstack/magnum: Fix a 409 failure on bay-update  https://review.openstack.org/23331922:53
*** daneyon has quit IRC22:55
*** daneyon has joined #openstack-containers23:03
*** suro-patz has joined #openstack-containers23:05
openstackgerritHongbin Lu proposed openstack/magnum: Fix a 409 failure on bay-update  https://review.openstack.org/23331923:06
daneyonTango: https://blueprints.launchpad.net/murano-apps/+spec/update-k8-to-v1-dib-elements uses an older version of k8s than we do.23:07
*** david-lyle has quit IRC23:09
*** david-lyle has joined #openstack-containers23:09
Tangodaneyon: Looks like the patch brings k8s to version 1.0.6.  We are at 1.0.4 at this time23:13
*** hongbin has quit IRC23:14
daneyonTango: OK23:14
Tangodaneyon: I think I will give it a try when I have time.  This will give us more options in the image.23:15
*** wshao has joined #openstack-containers23:17
daneyonTango: According to this: https://github.com/openstack/magnum/blob/master/doc/source/dev/dev-build-atomic-image.rst#update-an-existing-fedora-atomic-server I should be able to update our existing atomic-6 image23:18
daneyonTango: However, I do not see this file: /etc/ostree/remotes.d/fedora-atomic.conf when I login to the Nova VM that uses the atomic-6 image.23:19
Tangodaneyon: Yes, but you need to build your rpm-ostree repo and then run rpm-ostree upgrade from there.23:19
daneyonTango: OK, so I still need to follow these steps first: https://github.com/openstack/magnum/blob/master/doc/source/dev/dev-build-atomic-image.rst#build-and-host-rpm-ostree-repo23:20
*** hblixt has joined #openstack-containers23:20
Tangodaneyon: Right.23:21
*** sdake has quit IRC23:22
daneyonTango: Do we need to build pkg's if pkg's already exist? For example: https://kojipkgs.fedoraproject.org/packages/kubernetes/1.1.0/0.5.gite44c8e6.fc21/x86_64/23:23
yuanyingbradjones: around?23:24
bradjonesyuanying: hi23:24
yuanyingbradjones: hi23:24
yuanyingbradjones: my collegue want to contribute magnum-ui23:25
yuanyingbradjones: Can I assign hime to bay-create bp?23:25
Tangodaneyon: Well, we are kind of repeating some work in this process here, but the reason is we are using the copr tool to host the repo23:25
Tangodaneyon: and copr builds everything from source23:25
daneyonTango: OK23:26
bradjonesyuanying: sounds good to me23:26
yuanyingbradjones: thanks a lot!23:27
*** dane_leblanc_ has quit IRC23:27
*** wznoinsk1 has joined #openstack-containers23:27
bradjonesyuanying: no problem, tell him to reach out to me if there are any questions23:27
bradjonesyuanying: and with regard to the create form I suggest he looks here https://review.openstack.org/#/c/222297/23:28
yuanyingbradjones: ok, Japan is early morning now, so he is not here23:28
yuanyingbradjones: ok thanks23:28
*** adrian_otto has joined #openstack-containers23:29
openstackgerritOpenStack Proposal Bot proposed openstack/magnum: Updated from global requirements  https://review.openstack.org/23056623:30
*** achanda_ has joined #openstack-containers23:30
*** manjeets has quit IRC23:30
*** EricGonc_ has joined #openstack-containers23:31
*** Marga_ has joined #openstack-containers23:31
*** achanda has quit IRC23:32
*** wznoinsk has quit IRC23:32
*** Drago has quit IRC23:33
*** Drago1 has joined #openstack-containers23:33
*** ekhugen has quit IRC23:33
*** EricGonczer_ has quit IRC23:34
*** hogepodge has quit IRC23:34
*** bapalm has quit IRC23:34
*** gangil1 has joined #openstack-containers23:35
*** gangil has quit IRC23:36
*** bapalm has joined #openstack-containers23:39
*** ekhugen has joined #openstack-containers23:39
*** jwcroppe has quit IRC23:54
*** coolsvap has quit IRC23:54
*** Drago1 has quit IRC23:54
*** wshao has quit IRC23:54
*** bradjones has quit IRC23:54
*** robcresswell has quit IRC23:54
*** suro-patz has quit IRC23:54
*** vilobhmm11 has quit IRC23:54
*** dims_ has quit IRC23:54
*** alex_klimov has quit IRC23:54
*** klindgren_ has quit IRC23:54
*** unicell has quit IRC23:54
*** serverascode has quit IRC23:54
*** xek has quit IRC23:54
*** ArchiFleKs has quit IRC23:54
*** tonyb has quit IRC23:54
*** preilly has quit IRC23:54
*** gus has quit IRC23:54
*** rsFF has quit IRC23:54
*** pradk has quit IRC23:54
*** briancurtin has quit IRC23:54
*** wenchma has quit IRC23:54
*** Babyface has quit IRC23:54
*** chmouel has quit IRC23:54
*** mikal has quit IRC23:54
*** ioni has quit IRC23:54
*** ramishra has quit IRC23:54
*** Daviey has quit IRC23:54
*** shakamunyi has quit IRC23:54
*** sirushti has quit IRC23:54
*** Marga_ has quit IRC23:54
*** shaohe_robot1 has quit IRC23:54
*** ryanpetrello has quit IRC23:54
*** kbyrne has quit IRC23:54
*** zz_dimtruck has quit IRC23:54
*** bapalm has quit IRC23:54
*** eghobo_ has quit IRC23:54
*** brendenblanco has quit IRC23:54
*** thomasem_ has quit IRC23:54
*** tristanC has quit IRC23:55
*** jlvillal has quit IRC23:55
*** ekhugen has quit IRC23:55
*** EricGonc_ has quit IRC23:55
*** david-lyle has quit IRC23:55
*** harshs has quit IRC23:55
*** eggshell has quit IRC23:55
*** logan2 has quit IRC23:55
*** yuanying has quit IRC23:55
*** achanda_ has quit IRC23:55
*** hblixt has quit IRC23:55
*** alejandrito has quit IRC23:55
*** openstackgerrit has quit IRC23:55
*** amit213 has quit IRC23:55
*** rods has quit IRC23:55
*** apmelton has quit IRC23:55
*** daneyon has quit IRC23:55
*** sgordon has quit IRC23:55
*** slagle has quit IRC23:55
*** agireud has quit IRC23:55
*** mfalatic has quit IRC23:55
*** zul has quit IRC23:55
*** tcammann_ has quit IRC23:55
*** adrian_otto has quit IRC23:55
*** Tango has quit IRC23:55
*** nihilifer has quit IRC23:55
*** filler has quit IRC23:55
*** dave-mccowan has quit IRC23:55
*** jasondotstar has quit IRC23:55
*** gangil1 has quit IRC23:55
*** wznoinsk1 has quit IRC23:55
*** tcammann has quit IRC23:55
*** harlowja has quit IRC23:55
*** jwang_ has quit IRC23:55
*** redrobot has quit IRC23:55
*** coreyob has quit IRC23:55
*** raginbajin has quit IRC23:55
*** purple has quit IRC23:55
*** dona has quit IRC23:55
*** shu has quit IRC23:55
*** muralia1 has quit IRC23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!