Saturday, 2018-12-15

*** hongbin has quit IRC00:24
*** jento has joined #openstack-containers00:35
*** PagliaccisCloud has quit IRC00:38
*** ramishra has quit IRC03:31
*** ykarel|away has joined #openstack-containers03:34
*** ykarel|away has quit IRC03:50
*** ykarel has joined #openstack-containers03:52
*** ykarel has quit IRC04:07
*** ykarel has joined #openstack-containers04:13
*** Bhujay has joined #openstack-containers04:52
*** Bhujay has quit IRC04:53
*** Bhujay has joined #openstack-containers04:53
*** Bhujay has quit IRC04:54
*** Bhujay has joined #openstack-containers04:55
*** Bhujay has quit IRC04:56
*** Bhujay has joined #openstack-containers04:56
*** ykarel has quit IRC05:08
*** lpetrut has joined #openstack-containers05:38
*** ramishra has joined #openstack-containers05:39
*** PagliaccisCloud has joined #openstack-containers05:48
*** ykarel has joined #openstack-containers06:02
*** PagliaccisCloud has quit IRC06:12
*** ykarel has quit IRC06:13
*** lpetrut has quit IRC06:20
*** ykarel has joined #openstack-containers06:30
*** ykarel has quit IRC06:34
*** Bhujay has quit IRC06:41
*** lpetrut has joined #openstack-containers07:00
*** lpetrut has quit IRC07:04
*** ramishra has quit IRC07:17
openstackgerritmelissaml proposed openstack/magnum-ui master: Change openstack-dev to openstack-discuss  https://review.openstack.org/62538307:31
*** pcaruana has joined #openstack-containers08:00
*** Bhujay has joined #openstack-containers09:00
*** ramishra has joined #openstack-containers09:26
*** ivve has joined #openstack-containers10:14
*** ivve has quit IRC10:43
*** Bhujay has quit IRC11:01
openstackgerritLingxian Kong proposed openstack/magnum master: [k8s] Cluster creation speedup  https://review.openstack.org/62372412:00
*** PagliaccisCloud has joined #openstack-containers12:02
*** Bhujay has joined #openstack-containers12:39
*** ykarel has joined #openstack-containers12:41
*** ykarel has quit IRC13:06
*** PagliaccisCloud has quit IRC13:40
*** ivve has joined #openstack-containers13:46
*** PagliaccisCloud has joined #openstack-containers13:48
*** Bhujay has quit IRC13:59
*** Bhujay has joined #openstack-containers13:59
*** Bhujay has quit IRC14:00
*** Bhujay has joined #openstack-containers14:01
*** Bhujay has quit IRC14:02
*** Bhujay has joined #openstack-containers14:02
*** Bhujay has quit IRC14:03
*** Bhujay has joined #openstack-containers14:04
*** Bhujay has quit IRC14:05
*** Bhujay has joined #openstack-containers14:05
*** ykarel has joined #openstack-containers15:00
*** zufar has joined #openstack-containers15:12
*** Bhujay has quit IRC15:13
*** ignaziocassano1 has joined #openstack-containers15:17
ignaziocassano1hello everybody15:17
ignaziocassano1Anyone used successfully magnum on queens ?15:17
zufarHi all, I am running kubernetes cluster now, but I get stuck on kube_masters in heat process. http://paste.opensuse.org/view//8558944815:18
zufarI try ssh to k8s master node and run troubleshooting command, but got nothing. http://paste.opensuse.org/view//1238819015:19
zufaranyone know what is happen?15:19
ignaziocassano1OK , you are not alone15:20
ignaziocassano1are you using queens ?15:20
zufarignaziocassano1: I am. only running magnum service, but failed when creating cluster15:20
zufaralways stuck on `kube_masters` heat. k8s or swarm cluster.15:20
ignaziocassano1I successfully run a swarm mode cluster15:21
zufaryes. I am using queens.15:21
ignaziocassano1kubernets doe not work15:21
ignaziocassano1It cannot create the docker volume due to insufficent space15:21
ignaziocassano1I create the template with the docke volume size but hest seems to fail passing this value15:22
ignaziocassano1what appears in your kubernetes master node in /var/log/cloud-init log ?15:23
zufaroh yes, by the way my openstack is not running cinder for volume. It is possible to run magnum?15:23
zufarwait i will check.15:23
ignaziocassano1Zufar we talked via email on yessterday15:24
ignaziocassano1I am ignaziocassano@gmailcom15:24
ignaziocassano1I am not sure if you can use magnum without cinder15:25
ignaziocassano1Terorically yes+15:25
ignaziocassano1But the only cluster I created in swarm mode is using cinder to attach a volume15:25
zufarits curl to http://127.0.0.1:8080/healthz and no response.15:26
ignaziocassano1OK15:26
ignaziocassano1this is the last message15:26
ignaziocassano1go back15:27
ignaziocassano1you should see a message like insufficient space15:27
ignaziocassano1the file should be  the cloud-init-output.log or similar name.....I am not connected to my server farm now15:28
zufarI try to grep, ERROR: There is not enough free space in volume group atomicos to create data volume of size MIN_DATA_SIZE=2G.15:28
ignaziocassano1OK15:28
ignaziocassano1this is the issue15:28
ignaziocassano1the same I am facing15:28
ignaziocassano1if we do not solve it, the cluster will never running15:29
ignaziocassano1I think this is a bug15:29
ignaziocassano1another person wrote aboit it15:29
ignaziocassano1see https://ask.openstack.org/en/question/116465/magnum-kubernetes-cluster-stucks-in-create-in-progress-state-exactly-on-kube-master/15:30
ignaziocassano1There is no answer yet15:32
ignaziocassano1Do you think you problem is the same ?15:32
ignaziocassano1OK15:33
ignaziocassano1on you master node try to see a file under /etc/sysconfig15:34
ignaziocassano1its name should be heat-params15:34
zufarignaziocassano1: yes i think.15:34
zufari have free space in kubernetes instance15:34
ignaziocassano1in that file de dockr volume size variable is always 0 also if you specify a value in the template cluser15:35
ignaziocassano1Yes15:35
zufarwhen provisioning swarm, i get same error, stuck in swarm_masters15:36
ignaziocassano1you have free space but it need space to allocate a logical volume in the volume group ande the volum group is full becouse another logical volume allocate all space15:36
ignaziocassano1Try with swarm-mode and no swarm15:36
ignaziocassano1it should work15:37
ignaziocassano1I think heat templates gerated by magnum under queens are not correctly written15:37
ignaziocassano1I think heat templates generated by magnum under queens are not correctly written15:37
zufarignaziocassano1: how to do that (try with swarm-mode)? I am new in swarm15:39
ignaziocassano1We can wrote together to the emailing list ..... I tried but any help. Many people suggest to use rocky15:39
ignaziocassano1I am new to swarm too15:40
ignaziocassano1How do you write you template ?15:40
zufarlike the example from the documentation15:40
ignaziocassano1ok15:40
zufaropenstack coe cluster template create swarm-cluster-template --image fedora-atomic-latest --external-network external --dns-nameserver 8.8.8.8 --master-flavor amphora --flavor amphora --coe swarm15:40
ignaziocassano1instead of swarm  coe type, write swrm-mode15:41
ignaziocassano1instead of swarm  coe type, write swarm-mode15:41
zufarokey i will try.15:41
ignaziocassano1sorry for may bad english15:41
zufarno problem.15:42
zufaranyone have problem like us?15:42
ignaziocassano1If wrote an email to te mailing liste about kubernetes, I will confirm the same problem. Probably if someone will see two people with the same problem .....15:43
ignaziocassano1Yes, see the link I sent15:43
ignaziocassano1https://ask.openstack.org/en/question/116465/magnum-kubernetes-cluster-stucks-in-create-in-progress-state-exactly-on-kube-master/15:43
ignaziocassano1ERROR: There is not enough free space in volume group atomicos to create data volume of size MIN_DATA_SIZE=2G.15:44
zufaryes maybe in this mailinglist15:44
ignaziocassano1the same we have15:44
zufarhave you ever tried to scale up the flavor?15:44
ignaziocassano1ho yes15:44
ignaziocassano1I tried15:44
ignaziocassano1bu when the master instance starts, the entire disk is allocated with a logical volume15:45
ignaziocassano1but when the master instance starts, the entire disk is allocated with a logical volume15:45
ignaziocassano1In swarm-mode a strange things happens a new volume is created, ad the swarm logical volume is allocated in the new disk and it works15:46
ignaziocassano1But it is a cinder volume :-(15:46
ignaziocassano1I think you need cinder anycase15:47
zufarI will try first for swarm-mode. I have not created cinder playbook for multi controller openstack.15:49
ignaziocassano1I need cinder because I use a lot of instances and I need starage persisency15:51
ignaziocassano1I need cinder because I use a lot of instances and I need storage persisency15:51
ignaziocassano1I need to backup volumes15:52
ignaziocassano1Zufar, sometimes when you create magnum cluster, heat give you deadlock problems ?15:54
zufari havent check log from heat.15:55
zufarignaziocassano1: do you have check volume limit from your openstack user?15:55
zufari get same thing when bootstraping swarm with swarm-mode.15:55
zufarERROR: There is not enough free space in volume group atomicos to create data volume of size MIN_DATA_SIZE=2G.15:55
ignaziocassano1Yes, But I increased them15:55
zufari will try magnum with packstack. maybe get different result.15:56
ignaziocassano1OK, this happens because you do not have cinder. I have cinder and when I create a swrm moode cluster the master instance got a volume attached ...I think your not, right ?15:57
zufaryes I think.15:58
ignaziocassano1And this is very strange, because teorically swarm does not need cinder like kubernets15:58
ignaziocassano1I would like to try under rocky release but my openstack is in production and I cannot risk to stop my customers job16:00
zufarI am in my labolatory. wait i have install openstack with packstack.16:00
ignaziocassano1OK16:00
ignaziocassano1If you can try with rocky.....16:01
ignaziocassano1Could you ?16:01
ignaziocassano1keep in touch, please. If you have news my email is ignaziocassano@gmail.com16:03
ignaziocassano1Another thing: in documentation the wrote you mast contact swrm on port 2376 but it is 237516:06
ignaziocassano1Another thing: in documentation they wrote you mast contact swrm on port 2376 but it is 237516:06
*** ramishra has quit IRC16:09
zufarignaziocassano1: okey16:15
ignaziocassano1I added my comment in https://ask.openstack.org/en/question/116465/magnum-kubernetes-cluster-stucks-in-create-in-progress-state-exactly-on-kube-master/16:21
ignaziocassano1If you want add yours it is welcome to get help16:21
*** ignaziocassano1 has quit IRC16:27
*** ignaziocassano1 has joined #openstack-containers16:28
*** ykarel has quit IRC16:34
*** PagliaccisCloud has quit IRC16:47
zufarHi I am creating a swarm cluster, but its stack on swarm_primary_master heat with CREATE_IN_PROGRESS. I try to login into swarm VM and see the log.17:57
zufarrequests.exceptions.ConnectionError: HTTPConnectionPool(host='10.60.60.10', port=5000): Max retries exceeded with url: /v3/auth/tokens (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f02f57321d0>: Failed to establish a new connection: [Errno 110] Connection timed out',))17:57
zufarSwarm Instance try to open connection to 10.60.60.10 which is my management ip address on OpenStack.  But it cannot (by design it cannot, I try to curl manual to 10.60.60.10 and error). When curl to 10.61.61.10 which is my floating IP and external IP for OpenStack cluster, it works.17:57
zufarAnyone know how to change the cloud-init to curl into 10.61.61.10?17:57
openstackgerritSpyros Trigazis proposed openstack/magnum master: Do not log the login command  https://review.openstack.org/62535118:02
*** PagliaccisCloud has joined #openstack-containers18:18
openstackgerritSpyros Trigazis proposed openstack/magnum master: Don not log the login command  https://review.openstack.org/62535118:20
openstackgerritSpyros Trigazis proposed openstack/magnum master: Changes in container builder  https://review.openstack.org/62535118:42
openstackgerritSpyros Trigazis proposed openstack/magnum master: Changes in container builder  https://review.openstack.org/62535119:01
*** ricolin has joined #openstack-containers19:09
openstackgerritSpyros Trigazis proposed openstack/magnum master: Changes in container builder  https://review.openstack.org/62535119:16
*** ricolin has quit IRC19:23
*** lbragstad has joined #openstack-containers19:33
openstackgerritSpyros Trigazis proposed openstack/magnum master: Changes in container builder  https://review.openstack.org/62535119:38
*** hongbin has joined #openstack-containers19:55
yankcrimezufar: sounds like it's trying to notify heat (the orchestration service) that it's finished a particular step19:59
yankcrimezufar: you probably want to configure heat's heat_waitcondition_server_url to be your internally facing loadbalancer or IP or whatever19:59
yankcrimeor configure your network so that openstack clients can hit that other IP20:00
openstackgerritSpyros Trigazis proposed openstack/magnum master: Changes in container builder  https://review.openstack.org/62535120:07
openstackgerritSpyros Trigazis proposed openstack/magnum master: Changes in container builder  https://review.openstack.org/62535120:21
openstackgerritSpyros Trigazis proposed openstack/magnum master: Changes in container builder  https://review.openstack.org/62535120:42
openstackgerritSpyros Trigazis proposed openstack/magnum master: Changes in container builder  https://review.openstack.org/62535120:48
openstackgerritMerged openstack/magnum stable/rocky: Cleaned up devstack logging  https://review.openstack.org/61702620:48
openstackgerritSpyros Trigazis proposed openstack/magnum master: Changes in container builder  https://review.openstack.org/62535120:55
openstackgerritSpyros Trigazis proposed openstack/magnum master: Changes in container builder  https://review.openstack.org/62535121:08
openstackgerritSpyros Trigazis proposed openstack/magnum master: Changes in container builder  https://review.openstack.org/62535121:29
*** lbragstad has quit IRC21:58
openstackgerritMerged openstack/magnum master: Changes in container builder  https://review.openstack.org/62535123:06
openstackgerritSpyros Trigazis proposed openstack/magnum master: Fix use of magnum_repository in container-publish  https://review.openstack.org/62540823:22
openstackgerritMerged openstack/magnum stable/rocky: functional: use vexxhost-specific nodes with nested virt  https://review.openstack.org/62472923:27
openstackgerritMerged openstack/magnum stable/rocky: functional: add body for delete_namespaced_service in k8s  https://review.openstack.org/62517023:33
openstackgerritMerged openstack/magnum stable/rocky: functional: use default admission_control_list values  https://review.openstack.org/62517123:33

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!