| openstackgerrit | Lingxian Kong proposed openstack/trove-dashboard stable/wallaby: Change the configuration group panel name https://review.opendev.org/c/openstack/trove-dashboard/+/786963 | 00:51 |
|---|---|---|
| openstackgerrit | Merged openstack/trove-dashboard master: Change the configuration group panel name https://review.opendev.org/c/openstack/trove-dashboard/+/786817 | 01:01 |
| openstackgerrit | Merged openstack/trove-dashboard stable/wallaby: Change the configuration group panel name https://review.opendev.org/c/openstack/trove-dashboard/+/786963 | 01:46 |
| *** sapd1_y has quit IRC | 02:05 | |
| *** sapd1_y has joined #openstack-trove | 02:05 | |
| *** rcernin has quit IRC | 02:58 | |
| *** rcernin has joined #openstack-trove | 03:13 | |
| *** rcernin has quit IRC | 03:27 | |
| openstackgerrit | zhangboye proposed openstack/trove-dashboard master: Use py3 as the default runtime for tox https://review.opendev.org/c/openstack/trove-dashboard/+/787062 | 03:29 |
| openstackgerrit | zhangboye proposed openstack/trove-tempest-plugin master: Use py3 as the default runtime for tox https://review.opendev.org/c/openstack/trove-tempest-plugin/+/787063 | 03:32 |
| openstackgerrit | zhangboye proposed openstack/trove master: Use py3 as the default runtime for tox https://review.opendev.org/c/openstack/trove/+/787064 | 03:33 |
| *** rcernin has joined #openstack-trove | 03:36 | |
| *** rcernin has quit IRC | 03:39 | |
| *** rcernin has joined #openstack-trove | 03:39 | |
| *** sapd1 has joined #openstack-trove | 03:55 | |
| __ministry | @lxkong, I was reply your comment in story. You can take look. | 04:43 |
| *** sapd1_y has quit IRC | 04:48 | |
| *** sapd1_x has joined #openstack-trove | 04:48 | |
| *** sapd1 has quit IRC | 05:04 | |
| *** e0ne has joined #openstack-trove | 06:02 | |
| *** rcernin has quit IRC | 07:15 | |
| openstackgerrit | zhangboye proposed openstack/python-troveclient master: Use py3 as the default runtime for tox https://review.opendev.org/c/openstack/python-troveclient/+/787129 | 07:23 |
| *** tosky has joined #openstack-trove | 07:45 | |
| *** rcernin has joined #openstack-trove | 08:17 | |
| *** rcernin has quit IRC | 08:39 | |
| *** rcernin has joined #openstack-trove | 10:10 | |
| *** rcernin has quit IRC | 10:17 | |
| *** rcernin has joined #openstack-trove | 10:24 | |
| *** rcernin has quit IRC | 10:58 | |
| *** rcernin has joined #openstack-trove | 11:23 | |
| *** rcernin has quit IRC | 11:55 | |
| *** rcernin has joined #openstack-trove | 12:42 | |
| *** rcernin has quit IRC | 12:46 | |
| *** sapd1 has joined #openstack-trove | 14:39 | |
| *** rcernin has joined #openstack-trove | 14:42 | |
| *** rcernin has quit IRC | 14:48 | |
| *** sapd1 has quit IRC | 14:49 | |
| *** sapd1 has joined #openstack-trove | 15:04 | |
| *** rcernin has joined #openstack-trove | 15:50 | |
| *** rcernin has quit IRC | 15:55 | |
| andrewbogott | Am I correct in my understanding that all VMs managed by trove will belong to the Trove service tenant rather than to the individual tenants that created the databases? And if so, should I set sky-high quotas for the trove client and trust Trove to enforce per-tenant quotas nonetheless? | 16:26 |
| *** e0ne has quit IRC | 16:38 | |
| *** e0ne has joined #openstack-trove | 16:39 | |
| *** e0ne has quit IRC | 16:40 | |
| *** rcernin has joined #openstack-trove | 17:51 | |
| *** rcernin has quit IRC | 17:56 | |
| *** e0ne has joined #openstack-trove | 18:14 | |
| andrewbogott | And... while I'm asking questions of the void: I seem to have a race condition on guest startup. dumpe2fs fails and the guest agent despairs but if I go in and re-check the formatting after the fact everything looks fine. Known issue? | 18:15 |
| andrewbogott | lxkong, if/when you are around I'd enjoy a bit of coaching. I've got everything up to Victoria now and I'm using the Ubuntu test image. | 18:16 |
| *** e0ne has quit IRC | 18:21 | |
| *** rcernin has joined #openstack-trove | 19:45 | |
| *** rcernin has quit IRC | 20:48 | |
| lxkong | andrewbogott: yes, trove instance belongs to normal user, but the nova VM is created in the service tenant user. | 21:00 |
| lxkong | btw, trove PTG begins, please join https://www.openstack.org/ptg/rooms/cactus if anyone is interested. | 21:01 |
| lxkong | andrewbogott: you can set a high quota for trove service tenant based on your cloud capacity | 21:02 |
| lxkong | > while I'm asking questions of the void: I seem to have a race condition on guest startup. dumpe2fs fails and the guest agent despairs but if I go in and re-check the formatting after the fact everything looks fine. Known issue? | 21:02 |
| lxkong | any log? | 21:03 |
| andrewbogott | https://www.irccloud.com/pastebin/xZzHK9ZA/ | 21:08 |
| andrewbogott | lxkong: ^ that's all I have at the moment | 21:08 |
| lxkong | andrewbogott: you can ignore that error, trove guest agent is checking if the block device has been formatted or not, the check command will fail for the first time | 21:14 |
| andrewbogott | oh! ok, then let me dig deeper to see what is actually broken :) | 21:15 |
| andrewbogott | It eventually lands in 'error' state | 21:15 |
| andrewbogott | maybe because of this? | 21:15 |
| andrewbogott | Failed to get container database: docker.errors.NotFound: 404 Client Error: Not Found ("No such container: database") | 21:15 |
| andrewbogott | (pretty sure guest<->host communication is working properly) | 21:15 |
| lxkong | what's the output of `sudo systemctl status guest-agent.service`? | 21:16 |
| lxkong | is there a docker container named `database`? Can you check its log? | 21:16 |
| andrewbogott | https://www.irccloud.com/pastebin/XpWGmaAd/ | 21:17 |
| lxkong | i would also check the the bottom of the log file /var/log/trove/trove-guestagent.log | 21:17 |
| andrewbogott | where should I look for my docker container/log? | 21:18 |
| andrewbogott | re: trove-guestagent,log, I don't have one of those only /var/log/trove/logfile.txt | 21:18 |
| lxkong | In my /var/log/trove/trove-guestagent.log, when instance is created successfully, the log is https://www.irccloud.com/pastebin/WVQGjSuN/ | 21:19 |
| andrewbogott | Hm... so do you think I'm running a bad container build then? | 21:20 |
| lxkong | > re: trove-guestagent,log, I don't have one of those only /var/log/trove/logfile.txt | 21:20 |
| lxkong | where did you get the trove guest image? | 21:20 |
| andrewbogott | https://tarballs.opendev.org/openstack/trove/images/trove-train-mysql-ubuntu-xenial-dev.qcow2 | 21:20 |
| lxkong | that's for Train | 21:20 |
| andrewbogott | yeah, I pasted the wrong thing, hang on... | 21:21 |
| andrewbogott | ok, here, it's trove-victoria-guest-ubuntu-bionic.qcow2 | 21:21 |
| lxkong | `grep log /etc/trove/conf.d/trove-guestagent.conf`? | 21:23 |
| lxkong | inside the instance | 21:23 |
| andrewbogott | https://www.irccloud.com/pastebin/wQ5Kh2HO/ | 21:24 |
| lxkong | ah, ok, you have changed the default config file, that's infe | 21:24 |
| lxkong | ah, ok, you have changed the default config file, that's fine | 21:24 |
| lxkong | so you can take a look at bottom lines of logfile.txt | 21:24 |
| andrewbogott | I wonder if I have obsolete config leftover from when I set this up with T... | 21:25 |
| andrewbogott | the logfile just says | 21:25 |
| andrewbogott | 2021-04-20 21:21:38.501 892 INFO trove.guestagent.datastore.manager [-] Database service is not installed, skip status check | 21:25 |
| andrewbogott | a bunch of times | 21:25 |
| lxkong | run `docker images` and `docker ps` | 21:26 |
| andrewbogott | https://www.irccloud.com/pastebin/72AkuKvi/ | 21:26 |
| andrewbogott | looks right-ish | 21:26 |
| lxkong | seems the database container keeps restarting | 21:27 |
| lxkong | docker logs database | 21:27 |
| andrewbogott | ooh | 21:28 |
| andrewbogott | /var/lib/mysql-files' (Error 2 - No such file or directory) | 21:28 |
| andrewbogott | that seems straightforward | 21:28 |
| andrewbogott | is that created during cloud-init? | 21:28 |
| lxkong | I guess you have changed some default values in /etc/trove/conf.d/trove-guestagent.conf, please recheck to make sure it's still valid. | 21:29 |
| andrewbogott | yeah | 21:29 |
| andrewbogott | I actually need to run in a minute but I will start by reverting that file to the victoria version and then figure out what changes I need. | 21:30 |
| *** rcernin has joined #openstack-trove | 21:30 | |
| andrewbogott | Thank you for the time! you've already given me a lot more debugging tools than I had; will ping tomorrow if I'm still stuck. | 21:30 |
| andrewbogott | sorry to vanish mid-debug. Thanks again. | 21:31 |
| * andrewbogott -> out | 21:31 | |
| *** rcernin has quit IRC | 21:38 | |
| *** rcernin has joined #openstack-trove | 22:21 | |
| *** rcernin has quit IRC | 22:26 | |
| *** rcernin has joined #openstack-trove | 22:39 | |
| *** rcernin has quit IRC | 22:44 | |
| *** rcernin has joined #openstack-trove | 22:46 | |
| *** rcernin has quit IRC | 22:53 | |
| *** rcernin has joined #openstack-trove | 22:53 | |
| *** tosky has quit IRC | 23:17 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!