| *** rstarmer has quit IRC | 00:01 | |
| mnaser | just got put notes as i go but it seems the following is the issue | 00:02 |
|---|---|---|
| mnaser | https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L128-L135 | 00:02 |
| mnaser | compute_node.local_gb is set to 0 for some reason | 00:02 |
| * mnaser debugs more | 00:02 | |
| mnaser | hm, but that shouldn't happen because of the `compute_node.local_gb > 0` | 00:02 |
| mnaser | and technically this should mean that the following would never happen | 00:04 |
| mnaser | https://github.com/openstack/nova/commit/3c217acb9c55d647ca362320d697e80d7cfa5ceb | 00:04 |
| *** rstarmer has joined #puppet-openstack | 00:08 | |
| mnaser | unless compute_node.local_gb is reporting a decimal | 00:09 |
| mnaser | and its being converted from float to int | 00:09 |
| mnaser | 'local_gb': fields.IntegerField(), | 00:11 |
| * mnaser sighs | 00:11 | |
| mnaser | interestingly enough both failing scenarios have nova with rbd so maybe https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L5344 is the culprit | 00:15 |
| EmilienM | ok so nova is broken lol | 00:16 |
| mnaser | i think its nova+rbd in ubuntu for whatever reason ends up in that state | 00:17 |
| *** rstarmer has quit IRC | 00:18 | |
| mnaser | EmilienM ceph 12.2.0 is deployed in xenial | 00:18 |
| mnaser | and 10.2.7 in centos 7 | 00:19 |
| mnaser | im willing to bet that the ceph driver is reporting things differently which is causing that | 00:19 |
| mnaser | oh | 00:21 |
| mnaser | http://logs.openstack.org/95/500195/1/check/gate-puppet-openstack-integration-4-scenario001-tempest-ubuntu-xenial/ba25431/logs/ceph/ceph.txt.gz | 00:21 |
| mnaser | ceph isn't even starting up | 00:21 |
| mnaser | we need to add ceph-mgr | 00:21 |
| mnaser | it's a new required service | 00:21 |
| mnaser | "Since the 12.x (luminous) Ceph release, the ceph-mgr daemon is required for normal operations. The ceph-mgr daemon is an optional component in the 11.x (kraken) Ceph release." | 00:22 |
| mnaser | fun little weekend project hah | 00:22 |
| EmilienM | I confirm scenario001, 002 and 004 are broken | 00:27 |
| EmilienM | on ubuntu | 00:28 |
| *** vnogin has quit IRC | 00:33 | |
| *** rstarmer has joined #puppet-openstack | 00:39 | |
| *** rstarmer has quit IRC | 00:50 | |
| openstackgerrit | David Moreau Simard proposed openstack/puppet-openstack-integration stable/pike: Test CentOS 7.4 CR https://review.openstack.org/500232 | 00:51 |
| *** rstarmer has joined #puppet-openstack | 00:58 | |
| openstackgerrit | David Moreau Simard proposed openstack/puppet-openstack-integration stable/pike: Test CentOS 7.4 CR https://review.openstack.org/500232 | 00:58 |
| *** rstarmer has quit IRC | 01:04 | |
| *** rstarmer has joined #puppet-openstack | 01:19 | |
| *** rstarmer has quit IRC | 01:27 | |
| *** markvoelker has joined #puppet-openstack | 01:37 | |
| *** ilbot3 has quit IRC | 01:45 | |
| *** ilbot3 has joined #puppet-openstack | 01:52 | |
| *** markvoelker has quit IRC | 02:11 | |
| *** ykarel has joined #puppet-openstack | 02:42 | |
| *** ykarel has quit IRC | 03:05 | |
| *** markvoelker has joined #puppet-openstack | 03:09 | |
| *** ykarel has joined #puppet-openstack | 03:16 | |
| *** owalsh_ has joined #puppet-openstack | 03:28 | |
| *** owalsh has quit IRC | 03:31 | |
| *** ykarel has quit IRC | 03:40 | |
| *** markvoelker has quit IRC | 03:42 | |
| *** ykarel has joined #puppet-openstack | 03:56 | |
| *** ykarel has quit IRC | 04:18 | |
| *** jpena|off has quit IRC | 04:37 | |
| *** jpena|off has joined #puppet-openstack | 04:39 | |
| *** markvoelker has joined #puppet-openstack | 04:39 | |
| *** llua has quit IRC | 04:58 | |
| *** ykarel has joined #puppet-openstack | 05:01 | |
| *** llua has joined #puppet-openstack | 05:01 | |
| *** markvoelker has quit IRC | 05:11 | |
| *** rstarmer has joined #puppet-openstack | 06:17 | |
| *** xarses_ has joined #puppet-openstack | 06:35 | |
| *** rcernin has joined #puppet-openstack | 06:56 | |
| *** markvoelker has joined #puppet-openstack | 07:09 | |
| *** indistylo has joined #puppet-openstack | 07:11 | |
| *** markvoelker has quit IRC | 07:42 | |
| *** shardy has quit IRC | 08:13 | |
| *** jtomasek has joined #puppet-openstack | 08:28 | |
| *** markvoelker has joined #puppet-openstack | 08:39 | |
| *** rstarmer has quit IRC | 09:04 | |
| *** rstarmer has joined #puppet-openstack | 09:06 | |
| *** rstarmer has quit IRC | 09:06 | |
| *** rstarmer has joined #puppet-openstack | 09:07 | |
| *** rstarmer has quit IRC | 09:07 | |
| *** rstarmer has joined #puppet-openstack | 09:07 | |
| *** rstarmer has quit IRC | 09:07 | |
| *** rstarmer has joined #puppet-openstack | 09:08 | |
| *** rstarmer has quit IRC | 09:08 | |
| *** rstarmer has joined #puppet-openstack | 09:10 | |
| *** rstarmer has quit IRC | 09:10 | |
| *** rstarmer has joined #puppet-openstack | 09:11 | |
| *** rstarmer has joined #puppet-openstack | 09:11 | |
| *** rstarmer has quit IRC | 09:11 | |
| *** markvoelker has quit IRC | 09:12 | |
| *** ykarel has quit IRC | 09:32 | |
| *** markvoelker has joined #puppet-openstack | 10:09 | |
| *** karthiks_afk has quit IRC | 10:26 | |
| *** karthiks_afk has joined #puppet-openstack | 10:28 | |
| *** vnogin has joined #puppet-openstack | 10:32 | |
| *** markvoelker has quit IRC | 10:43 | |
| *** rcernin has quit IRC | 10:46 | |
| *** rcernin has joined #puppet-openstack | 10:52 | |
| *** vnogin has quit IRC | 10:58 | |
| *** vnogin has joined #puppet-openstack | 11:00 | |
| *** vnogin has quit IRC | 11:05 | |
| *** ykarel has joined #puppet-openstack | 11:18 | |
| *** ansmith has joined #puppet-openstack | 12:26 | |
| *** ykarel has quit IRC | 12:34 | |
| *** markvoelker has joined #puppet-openstack | 12:41 | |
| *** ansmith has quit IRC | 12:55 | |
| *** ansmith has joined #puppet-openstack | 13:04 | |
| *** ansmith has quit IRC | 13:09 | |
| *** markvoelker has quit IRC | 13:13 | |
| *** vnogin has joined #puppet-openstack | 14:26 | |
| *** vnogin has quit IRC | 14:31 | |
| *** markvoelker has joined #puppet-openstack | 15:10 | |
| *** markvoelker has quit IRC | 15:44 | |
| *** rcernin has quit IRC | 16:12 | |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-ceph master: wip: add ceph-mgr https://review.openstack.org/500317 | 16:28 |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-ceph master: wip: add ceph-mgr https://review.openstack.org/500317 | 16:35 |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-openstack-integration master: wip: add ceph-mgr https://review.openstack.org/500318 | 16:36 |
| EmilienM | mnaser: thanks! | 16:41 |
| mnaser | EmilienM np :) might wanna update the topic tho | 16:41 |
| *** markvoelker has joined #puppet-openstack | 16:41 | |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-ceph master: wip: add ceph-mgr https://review.openstack.org/500317 | 16:42 |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-ceph master: wip: add ceph-mgr https://review.openstack.org/500317 | 16:51 |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-ceph master: wip: add ceph-mgr https://review.openstack.org/500317 | 17:09 |
| *** markvoelker has quit IRC | 17:13 | |
| *** vnogin has joined #puppet-openstack | 17:14 | |
| *** ykarel has joined #puppet-openstack | 17:16 | |
| *** vnogin has quit IRC | 17:18 | |
| *** ykarel has quit IRC | 17:26 | |
| *** ykarel has joined #puppet-openstack | 17:27 | |
| *** simon-AS559 has joined #puppet-openstack | 17:36 | |
| *** simon-AS5591 has joined #puppet-openstack | 17:40 | |
| *** simon-AS559 has quit IRC | 17:40 | |
| *** simon-AS5591 has quit IRC | 17:44 | |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-ceph master: wip: add ceph-mgr https://review.openstack.org/500317 | 17:44 |
| *** ykarel has quit IRC | 17:54 | |
| *** ansmith has joined #puppet-openstack | 17:59 | |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-openstack-integration master: wip: add ceph-mgr https://review.openstack.org/500318 | 18:34 |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-ceph master: wip: add ceph-mgr https://review.openstack.org/500317 | 18:36 |
| *** markvoelker has joined #puppet-openstack | 19:11 | |
| *** vnogin has joined #puppet-openstack | 19:15 | |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-ceph master: Add ceph-mgr support https://review.openstack.org/500317 | 19:21 |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-ceph master: Add ceph-mgr support https://review.openstack.org/500317 | 19:23 |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-ceph master: Add ceph-mgr support https://review.openstack.org/500317 | 19:23 |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-openstack-integration master: Add ceph-mgr to Ubuntu Xenial jobs https://review.openstack.org/500318 | 19:27 |
| *** markvoelker has quit IRC | 19:44 | |
| *** vnogin has quit IRC | 19:45 | |
| *** indistylo has quit IRC | 20:20 | |
| mnaser | https://review.openstack.org/#/q/topic:add-ceph-mgr | 20:36 |
| mnaser | scenario2 is broken for some other reason that i'll check out later | 20:36 |
| mnaser | but most important is the puppet-ceph patch to land when possible and then i'll figure out the scenario 2 failure | 20:36 |
| *** markvoelker has joined #puppet-openstack | 20:41 | |
| *** jtomasek has quit IRC | 20:58 | |
| *** vnogin has joined #puppet-openstack | 21:04 | |
| *** markvoelker has quit IRC | 21:14 | |
| *** andreww has joined #puppet-openstack | 21:52 | |
| *** xarses_ has quit IRC | 21:55 | |
| *** vnogin has quit IRC | 22:24 | |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-cinder master: Install thin-provisioning-tools for Debian based systems https://review.openstack.org/500335 | 23:11 |
| openstackgerrit | Mohammed Naser proposed openstack/puppet-openstack-integration master: Add ceph-mgr to Ubuntu Xenial jobs https://review.openstack.org/500318 | 23:12 |
| *** markvoelker has joined #puppet-openstack | 23:12 | |
| *** markvoelker has quit IRC | 23:44 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!