*** vkmc has quit IRC | 00:54 | |
*** vkmc_ is now known as vkmc | 00:54 | |
*** lseki has quit IRC | 00:54 | |
*** gouthamr_ has quit IRC | 00:59 | |
*** fzzf2 has joined #openstack-manila | 01:04 | |
*** gouthamr_ has joined #openstack-manila | 01:05 | |
*** gouthamr_ has quit IRC | 01:25 | |
*** gouthamr_ has joined #openstack-manila | 01:37 | |
*** gouthamr_ has quit IRC | 02:52 | |
*** gouthamr_ has joined #openstack-manila | 02:56 | |
*** jmlowe has quit IRC | 03:01 | |
*** gouthamr_ has quit IRC | 03:26 | |
*** gouthamr_ has joined #openstack-manila | 03:32 | |
*** fzzf1 has joined #openstack-manila | 03:37 | |
*** fzzf2 has quit IRC | 03:39 | |
*** fzzf2 has joined #openstack-manila | 03:43 | |
*** fzzf1 has quit IRC | 03:47 | |
*** gouthamr_ has quit IRC | 04:00 | |
*** gouthamr_ has joined #openstack-manila | 04:11 | |
*** gouthamr_ has quit IRC | 04:29 | |
*** gouthamr_ has joined #openstack-manila | 04:30 | |
*** gouthamr_ has quit IRC | 04:35 | |
*** gouthamr_ has joined #openstack-manila | 04:40 | |
*** vhari has quit IRC | 06:45 | |
*** gouthamr_ has quit IRC | 06:50 | |
*** gouthamr_ has joined #openstack-manila | 06:52 | |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-manila master: Use relative name for class inclusion https://review.opendev.org/740169 | 07:00 |
---|---|---|
*** gouthamr_ has quit IRC | 07:04 | |
*** gouthamr_ has joined #openstack-manila | 07:05 | |
*** gouthamr_ has quit IRC | 07:15 | |
*** gouthamr_ has joined #openstack-manila | 07:22 | |
*** gouthamr_ has quit IRC | 07:46 | |
*** gouthamr_ has joined #openstack-manila | 07:52 | |
*** gouthamr_ has quit IRC | 07:57 | |
*** gmann has quit IRC | 08:03 | |
*** vkmc has quit IRC | 08:04 | |
*** gmann has joined #openstack-manila | 08:06 | |
*** vkmc has joined #openstack-manila | 08:07 | |
*** gouthamr_ has joined #openstack-manila | 08:09 | |
*** vhari has joined #openstack-manila | 09:04 | |
*** tosky has joined #openstack-manila | 09:10 | |
*** jmlowe has joined #openstack-manila | 10:03 | |
*** jmlowe has quit IRC | 10:24 | |
*** jmlowe has joined #openstack-manila | 10:25 | |
openstackgerrit | Tom Barron proposed openstack/manila master: Enforce policy checks getting share-type by name https://review.opendev.org/738941 | 10:45 |
*** tkajinam has quit IRC | 11:02 | |
*** raildo has joined #openstack-manila | 12:23 | |
*** andrebeltrami has joined #openstack-manila | 12:40 | |
openstackgerrit | Tom Barron proposed openstack/manila master: DNM - debugging https://review.opendev.org/740265 | 12:44 |
*** raildo has quit IRC | 12:47 | |
*** raildo has joined #openstack-manila | 12:50 | |
*** lseki has joined #openstack-manila | 12:51 | |
*** danielarthurt has joined #openstack-manila | 15:00 | |
*** dviroel has joined #openstack-manila | 15:02 | |
*** fzzf2 has quit IRC | 15:12 | |
*** ganso has quit IRC | 15:13 | |
*** dviroel has quit IRC | 15:15 | |
*** dviroel_ is now known as dviroel | 15:15 | |
*** ganso has joined #openstack-manila | 15:17 | |
openstackgerrit | Tom Barron proposed openstack/manila master: DNM - debugging https://review.opendev.org/740265 | 15:34 |
*** vhari has quit IRC | 15:59 | |
*** vhari has joined #openstack-manila | 16:00 | |
*** vhari has quit IRC | 16:04 | |
*** vhari has joined #openstack-manila | 16:20 | |
*** patrickeast_ has joined #openstack-manila | 16:47 | |
*** andreaf has quit IRC | 16:48 | |
*** patrickeast has quit IRC | 16:55 | |
*** carloss has quit IRC | 16:55 | |
*** patrickeast_ is now known as patrickeast | 16:55 | |
*** carloss has joined #openstack-manila | 16:58 | |
*** felipe_rodrigues has joined #openstack-manila | 17:01 | |
openstackgerrit | Goutham Pacha Ravi proposed openstack/manila-tempest-plugin master: DNM: Testing the LVM job - disable ipv6 tests https://review.opendev.org/739775 | 17:20 |
gouthamr | tbarron's debug patch worked on rax-dfw with the legacy job; let's try the same with the zuulv3 one ^ | 17:21 |
*** andrebeltrami has quit IRC | 18:00 | |
gouthamr | this is the bug tracker: https://bugs.launchpad.net/manila/+bug/1886988 | 18:17 |
openstack | Launchpad bug 1886988 in OpenStack Shared File Systems Service (Manila) "[ci] lvm jobs failing because of a reboot" [Critical,New] | 18:17 |
tbarron | gouthamr: it rebooted :( | 18:40 |
gouthamr | oh boy :( | 18:40 |
gouthamr | i wonder if ext4 filesystem corruption is a cause here... | 19:04 |
tbarron | I think the 'mounted file system with ordered data mode' msg is normal | 19:15 |
tbarron | it's the default way of processing the journal | 19:15 |
tbarron | but we don't see 'recovery complete' on every mount of a dm- based filesystem i guess | 19:16 |
tbarron | oh and we see it for /opt on the host itself after reboot | 19:19 |
tbarron | https://zuul.opendev.org/t/openstack/build/40408236d1d04162bce2d2f2e8ca6f65/log/controller/logs/syslog.txt#8811 | 19:19 |
*** tosky has quit IRC | 19:26 | |
tbarron | gouthamr: not directly relevant but yesterday my conjecture that the backing file and its usage was filling the root filesystem was specious since all that lvm stuff is in /opt on its own partition | 19:32 |
tbarron | /opts/stack/data/manila/... | 19:33 |
gouthamr | didn't get you, tbarron | 19:35 |
tbarron | gouthamr: oh, yesterday I speculated that we were filling the root filesystem, which is 40G on rax and 80G on vexxhost | 19:36 |
tbarron | gouthamr: but that backing file for lvm doesn't go to the root filesystem anyways, it goes to /opt on /dev/xvde2, which is 70G on rax | 19:37 |
tbarron | gouthamr: so my speculation made no sense | 19:37 |
gouthamr | tbarron: oh, cool | 19:39 |
gouthamr | used a similar setup and ran the same tests a few times - didn't see any failures - so still scratching my head | 19:41 |
tbarron | gouthamr: i'm thinking of following up on your earlier convo on #opendev to ask for tips to better instrument the job, wdyt? | 20:40 |
gouthamr | tbarron: yes, good idea, we can mail openstack-discuss too - we have some more findings since my interaction | 20:44 |
*** raildo has quit IRC | 21:22 | |
*** eharney has quit IRC | 21:42 | |
*** tkajinam has joined #openstack-manila | 23:00 | |
openstackgerrit | Goutham Pacha Ravi proposed openstack/manila-tempest-plugin master: DNM: Testing the LVM job without IPv6 https://review.opendev.org/739775 | 23:41 |
openstackgerrit | Goutham Pacha Ravi proposed openstack/manila-tempest-plugin master: DNM: Testing the LVM job without scenario tests https://review.opendev.org/740109 | 23:44 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!