*** logan- has quit IRC | 06:29 | |
*** logan- has joined #openstack-containers | 06:32 | |
*** sapd1 has joined #openstack-containers | 08:39 | |
*** sapd1 has quit IRC | 08:57 | |
*** ramishra has joined #openstack-containers | 09:04 | |
*** ramishra has quit IRC | 09:04 | |
*** ramishra has joined #openstack-containers | 09:04 | |
*** sapd1 has joined #openstack-containers | 09:09 | |
*** mgoddard has quit IRC | 10:13 | |
*** tbarron has joined #openstack-containers | 10:34 | |
*** ramishra has quit IRC | 11:19 | |
*** sapd1_x has joined #openstack-containers | 12:12 | |
*** sapd1 has quit IRC | 12:15 | |
*** sapd1_x has quit IRC | 14:28 | |
*** mgoddard has joined #openstack-containers | 14:50 | |
*** ricolin has joined #openstack-containers | 15:05 | |
*** ricolin has quit IRC | 15:40 | |
*** mgoddard has quit IRC | 15:50 | |
*** ricolin has joined #openstack-containers | 16:04 | |
*** elenalindq has joined #openstack-containers | 17:01 | |
*** vesper11 has quit IRC | 17:11 | |
*** kgz has quit IRC | 17:11 | |
*** mnasiadka has quit IRC | 17:11 | |
*** flwang has quit IRC | 17:11 | |
*** vesper11 has joined #openstack-containers | 17:12 | |
*** kgz has joined #openstack-containers | 17:12 | |
*** mnasiadka has joined #openstack-containers | 17:12 | |
*** flwang has joined #openstack-containers | 17:12 | |
*** kgz has quit IRC | 17:12 | |
*** ricolin has quit IRC | 17:47 | |
*** dave-mccowan has joined #openstack-containers | 18:11 | |
*** kgz has joined #openstack-containers | 18:18 | |
*** dave-mccowan has quit IRC | 19:56 | |
*** dave-mccowan has joined #openstack-containers | 20:30 | |
*** dave-mccowan has quit IRC | 20:53 | |
cosmicsound | Hi, does someone happend to know what could cause such errors on cloud-init | 21:01 |
---|---|---|
cosmicsound | [ 316.423247] cloud-init[1186]: 2019-12-01 20:47:56,988 - util.py[WARNING]: Running module scripts-user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python3.5/site-packages/cloudinit/config/cc_scripts_user.py'>) failed | 21:01 |
cosmicsound | util.py[WARNING]: Failed running /var/lib/cloud/instance/scripts/part-013 [7] | 21:01 |
cosmicsound | cc_scripts_user.py[WARNING]: Failed to run module scripts-user (scripts in /var/lib/cloud/instance/scripts) | 21:01 |
flwang | just manually run the script part-013 and see what's the root cause | 21:07 |
flwang | seems you're using rocky? | 21:07 |
flwang | cosmicsound: ^ | 21:07 |
cosmicsound | Stein | 21:11 |
cosmicsound | flwang using Stein and fedora 29 latest | 21:11 |
cosmicsound | With Magnum latest | 21:11 |
cosmicsound | I also got a weird timeout on port 8004 | 21:11 |
cosmicsound | That would be HEAT | 21:11 |
cosmicsound | Is there a way to see some logs in real time of the cluster deployment in Magnum via openstack cli? | 21:12 |
flwang | you can't see logs from openstack cli | 21:12 |
cosmicsound | righ | 21:12 |
flwang | you have to ssh into the master node to understand why | 21:12 |
flwang | as for your above issue, as i said, login and re-run the script manually, then you will be able to see the issue | 21:13 |
cosmicsound | how do i rerun manually those script parts | 21:13 |
cosmicsound | from the master locally | 21:13 |
cosmicsound | will try this see what it makes | 21:14 |
flwang | /var/lib/cloud/instance/scripts/part-013 | 21:15 |
cosmicsound | Now I see this | 21:16 |
cosmicsound | ReturnTuple(return_code=1, stdout=b'', stderr=b'time="2019-12-01T20:45:34Z" level=warning msg="\'--tls-verify\' is deprecated, please set this on the specific subcommand" \nDEPRECATED: skopeo layers is deprecated in favor of skopeo copy\ntime="2019-12-01T20:45:39Z" level=fatal msg="write layers-302929704/dir-put-blob047846042: no space left on | 21:16 |
cosmicsound | device" \n') | 21:16 |
cosmicsound | 40GB Space | 21:18 |
cosmicsound | Makes no sense | 21:18 |
cosmicsound | Docker Image is 10 GB | 21:18 |
flwang | :) | 21:20 |
flwang | cosmicsound: are you trying to build a magnum env on prod or just testing? | 21:20 |
cosmicsound | This is testing or pre prod testing | 21:23 |
cosmicsound | we want to go with magnum | 21:23 |
cosmicsound | and we test it ofcourse | 21:23 |
flwang | cool, may I know which company are you working for? | 21:28 |
cosmicsound | UHL-Services | 21:30 |
cosmicsound | Were new in the game | 21:30 |
cosmicsound | :D | 21:30 |
cosmicsound | And started to like it more and more | 21:31 |
cosmicsound | Keeps me awake | 21:31 |
flwang | if you're building your magnum env, then it's better to use latest version, say stable/train here | 21:49 |
cosmicsound | We had no chance to use that one | 21:49 |
flwang | which is the latest stable branch | 21:50 |
flwang | why? | 21:50 |
cosmicsound | It failed in our deployment | 21:50 |
cosmicsound | With kolla-ansible | 21:50 |
cosmicsound | Several times | 21:50 |
flwang | ok | 21:50 |
cosmicsound | So we stayed on Stein | 21:50 |
flwang | i believe it's a kolla-ansible issue | 21:50 |
cosmicsound | Once we stabilite it here well try upgrade | 21:50 |
cosmicsound | surely can be | 21:50 |
flwang | ok, fair enough | 21:50 |
cosmicsound | btw thanks for the info | 21:50 |
cosmicsound | I managed to login to the master | 21:50 |
cosmicsound | yet since im using a ssh key now i need to dig the default passwords :D | 21:51 |
flwang | there is no default passwords :) | 21:51 |
flwang | at least afaik | 21:52 |
cosmicsound | It asks me | 21:52 |
cosmicsound | When I do on this fedora 29 atomic | 21:52 |
cosmicsound | passwd asks me old pass | 21:52 |
cosmicsound | bit weird ofc | 21:52 |
cosmicsound | yet... | 21:52 |
cosmicsound | We had a working deployment, just for some unsaved settings now all our cluster fail | 21:55 |
cosmicsound | for various reasons and last one maybe will need to check more if is not a bug or our mistake | 21:55 |
cosmicsound | CREATE_FAILED CREATE aborted (Task create from ResourceGroup "kube_minions" Stack "kubernetes-4hp2ilbqtpil" [ebbef67d-f246-4479-af86-3fd401a98eb8] Timed out) | 21:55 |
cosmicsound | 2019-12-01 21:40:52Z [kubernetes-4hp2ilbqtpil.kube_cluster_deploy]: CREATE_FAILED CREATE aborted (Task create from SoftwareDeployment "kube_cluster_deploy" Stack "kubernetes-4hp2ilbqtpil" [ebbef67d-f246-4479-af86-3fd401a98eb8] Timed out) | 21:55 |
cosmicsound | these 2 time out on and on | 21:55 |
*** elenalindq has quit IRC | 22:02 | |
flwang | ok, for time out issue | 22:05 |
flwang | it's similar debug process | 22:06 |
flwang | firstly, check if the node has been created | 22:06 |
flwang | then login the node to understand which script failed | 22:06 |
flwang | re run the script and check the root cause | 22:06 |
*** jakeyip has quit IRC | 22:12 | |
*** dave-mccowan has joined #openstack-containers | 22:32 | |
cosmicsound | Well it is weird | 22:35 |
cosmicsound | Because both master and nodes are created | 22:35 |
cosmicsound | Just they somehow do not communicate back the message that they are done created | 22:36 |
cosmicsound | I managed to ssh both machines perfectly | 22:36 |
cosmicsound | found now a new model and following it, seems a bit newer documentation | 22:36 |
flwang | just check the log of cloud-init and heat-container-agent | 22:42 |
flwang | journalctl -u heat-container-agent | 22:42 |
flwang | vi /var/log/cloud-init-output.log | 22:42 |
cosmicsound | what would one choose for openstack | 23:03 |
cosmicsound | ubuntu or centos | 23:03 |
cosmicsound | to be honest i like the way centos moves | 23:03 |
*** dave-mccowan has quit IRC | 23:32 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!