| *** gkadam has joined #openstack-kayobe | 06:48 | |
| *** openstackgerrit has joined #openstack-kayobe | 08:06 | |
| openstackgerrit | Will Miller proposed openstack/kayobe master: Add Open vSwitch as a supported switch type https://review.openstack.org/592313 | 08:06 |
|---|---|---|
| *** jovial[m] has quit IRC | 08:11 | |
| *** dougsz_ has joined #openstack-kayobe | 08:40 | |
| *** ktibi has joined #openstack-kayobe | 09:05 | |
| *** mgoddard has joined #openstack-kayobe | 10:20 | |
| ktibi | mgoddard, if I try to upgrade, kayobe run kolla pull before ? (I use dockerhub kolla image | 10:22 |
| mgoddard | ktibi: no you have to pull separately | 10:25 |
| mgoddard | kayobe overcloud container image pull | 10:25 |
| ktibi | ok then upgrade after | 10:28 |
| mgoddard | yes | 10:29 |
| *** ktibi has quit IRC | 11:51 | |
| *** ktibi has joined #openstack-kayobe | 11:51 | |
| ktibi | mgoddard, ok so my first upgrade fail | 11:52 |
| ktibi | I re-run the upgrade and new fail | 11:52 |
| ktibi | http://paste.openstack.org/show/728189/ | 11:52 |
| mgoddard | ktibi: haven't seen the mariadb error before | 12:00 |
| mgoddard | rabbitmq I think is probably due to /etc/hosts | 12:00 |
| mgoddard | you should be able to run rabbitmqctl status in the container | 12:00 |
| mgoddard | https://github.com/stackhpc/kayobe/issues/14 | 12:01 |
| mgoddard | that's the bug | 12:01 |
| mgoddard | did you run https://kayobe.readthedocs.io/en/latest/upgrading.html#upgrading-host-services? | 12:02 |
| ktibi | nop need host upgrade for upgrade service ? | 12:05 |
| mgoddard | yes. It's a badly named command, but performs a workaround for rabbitmq | 12:06 |
| ktibi | my /etc/hosts is good I think | 12:06 |
| mgoddard | https://github.com/openstack/kayobe/blob/master/ansible/overcloud-etc-hosts-fixup.yml | 12:06 |
| mgoddard | can you run rabbitmqctl status? | 12:06 |
| ktibi | I'll try | 12:06 |
| mgoddard | that kayobe bug has the same error message | 12:07 |
| ktibi | mgoddard, ok I have old entry in /etc/hosts very strange. host configure add in the end of the file. Maybe need to purge the file before configure | 12:14 |
| ktibi | Because I change the subnet of mgnt network with a host configure | 12:15 |
| mgoddard | ah, that could be it | 12:15 |
| mgoddard | what does the hosts file look like? | 12:16 |
| ktibi | mgoddard, like http://paste.openstack.org/show/728191/ | 12:17 |
| ktibi | ok same error after clean /etc/hosts. I'll try manual command | 12:19 |
| mgoddard | looks like the first 3 ctrl02 entries are confusing it | 12:20 |
| ktibi | ok need to restart all rabbitmq node. | 12:20 |
| mgoddard | it should rewrite the /etc/hosts in the container too | 12:30 |
| ktibi | mgoddard, hooooo | 13:10 |
| ktibi | Thu 15, 3:30pm - 3:40pm I'll be here | 13:10 |
| mgoddard | ktibi: hehe, nice | 13:11 |
| ktibi | I'll come with my ewok hat !! | 13:11 |
| ktibi | mgoddard, ok fail for heat now http://paste.openstack.org/show/728195/ | 13:14 |
| mgoddard | this is a pike -> queens upgrate? | 13:15 |
| mgoddard | I haven't tried that yet | 13:16 |
| mgoddard | anything in the heat api log? | 13:17 |
| ktibi | no queens ==> queens | 13:18 |
| ktibi | heat tell me error for contact keystone, I'll check API | 13:18 |
| mgoddard | hmm | 13:19 |
| ktibi | yep keystone have issue | 13:21 |
| ktibi | ArgsAlreadyParsedError: arguments already parsed: cannot register CLI option in /var/lib/docker/volumes/kolla_logs/_data/keystone/keystone-apache-admin-error.log | 13:21 |
| ktibi | ok I update to fernet so maybe not good ^^ | 13:22 |
| mgoddard | did you change to fernet before the upgrade? | 13:25 |
| ktibi | yes | 13:26 |
| ktibi | I change to fernet, deploy, pull, upgrade | 13:26 |
| ktibi | etc/keystone/fernet-keys/ does not contain keys, use keystone-manage fernet_setup to create Fernet keys. | 13:26 |
| ktibi | mgoddard, ok need to clean all keystone and redeploy. Upgrade success ;) great :D | 14:16 |
| ktibi | uuid==>fernet not very easy :/ | 14:17 |
| mgoddard | that's odd - we deployed fernet without problems | 14:18 |
| ktibi | mgoddard, yes me too. First time I try migrate uuid=> fernet on a platform used | 14:20 |
| mgoddard | ours was in use | 14:20 |
| mgoddard | so you removed the keystone containers? | 14:21 |
| ktibi | yes | 14:21 |
| mgoddard | ouch | 14:21 |
| ktibi | my fernet directory was empty so need to boostrap | 14:21 |
| ktibi | we use docker for that no ? all data is in DB :D | 14:22 |
| mgoddard | true, although downtime... | 14:22 |
| ktibi | yes, I have a maintenance period | 14:23 |
| ktibi | mgoddard, limitation of kolla, we need to remove for run bootstrap flow :/ | 14:24 |
| mgoddard | always, or just when changing to fernet? | 14:29 |
| mgoddard | I'm sure we didn't remove last time | 14:29 |
| *** mgoddard has quit IRC | 15:06 | |
| *** verdurin has quit IRC | 15:36 | |
| *** verdurin has joined #openstack-kayobe | 15:38 | |
| *** ktibi has quit IRC | 15:47 | |
| *** ktibi has joined #openstack-kayobe | 15:56 | |
| *** ktibi has quit IRC | 16:03 | |
| *** ktibi has joined #openstack-kayobe | 16:08 | |
| *** ktibi has quit IRC | 16:15 | |
| *** openstackgerrit has quit IRC | 16:49 | |
| *** dougsz_ has quit IRC | 17:01 | |
| *** gkadam has quit IRC | 17:03 | |
| *** gkadam has joined #openstack-kayobe | 17:29 | |
| *** gkadam_ has joined #openstack-kayobe | 18:38 | |
| *** gkadam has quit IRC | 18:42 | |
| *** gkadam_ has quit IRC | 19:00 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!