ianw | ok, what does losetup show /dev/loop2 connected to inside docker? | 00:00 |
---|---|---|
pabelanger | I created my own loop | 00:02 |
pabelanger | but | 00:02 |
pabelanger | # losetup /dev/loop3 --show | 00:02 |
pabelanger | /dev/loop3: [002d]:832 (/disk.img) | 00:02 |
pabelanger | I can do it from DIB too | 00:02 |
pabelanger | strace http://paste.openstack.org/show/594790/ | 00:02 |
ianw | hmmm | 00:07 |
ianw | that's a file-system layer rejection? | 00:07 |
pabelanger | not sure | 00:08 |
pabelanger | / is aufs | 00:08 |
pabelanger | inside docker | 00:08 |
pabelanger | but loop3 is ext4 | 00:08 |
ianw | i strongly suspect that is getting in the way somehow | 00:09 |
pabelanger | and likely the reason why people don't run fstrim in docker :) | 00:10 |
ianw | damn it what has the kernel done with the fs ioctl path ... | 00:12 |
ianw | yay, goes through a whole big compatability layer thing | 00:14 |
openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Easy diskimage-builder development environment setup https://review.openstack.org/419655 | 00:22 |
pabelanger | ianw: ya, have no idea how to proceed here | 00:24 |
pabelanger | I could try a different file system | 00:25 |
pabelanger | overlayfs | 00:26 |
pabelanger | but, don't think my kernel supports it | 00:26 |
ianw | can i log in to poke, or is this a local system? | 00:26 |
pabelanger | you should have credentials, this is infracloud-vanilla | 00:28 |
pabelanger | ianw: ssh 15.184.65.183 | 00:29 |
pabelanger | ianw: https://review.openstack.org/#/c/415927/2 | 00:31 |
pabelanger | check out the comments | 00:31 |
pabelanger | I'm going to build a xenial system tomorrow and try again | 00:31 |
pabelanger | then, maybe just update our docs | 00:31 |
ianw | how do i get into the docker container? | 00:32 |
ianw | "sudo docker run --privileged=true --cap-add=ALL -t -i nodepool-builder /bin/bash" as you? is that the one failed? | 00:33 |
pabelanger | sudo docker run --privileged=true --cap-add=ALL -t -i nodepool-builder /bin/bash | 00:33 |
pabelanger | will create a new container for you | 00:33 |
pabelanger | /opt/venv/diskimage-builder is the virtualenv in the container | 00:34 |
pabelanger | with a wrapper script at /usr/local/bin/disk-image-create | 00:34 |
ianw | ok cool, right i got that failure | 00:36 |
pabelanger | I'm building a xenial container now | 00:37 |
ianw | pabelanger: http://paste.openstack.org/show/594792/ this suggests strongly to me that apparmor is getting involved here | 00:55 |
pabelanger | Hmm | 00:58 |
pabelanger | ianw: we can quickly disable apparmor | 00:59 |
pabelanger | and try again | 00:59 |
ianw | i think i did, or put it in complain mode | 00:59 |
ianw | let me see | 00:59 |
pabelanger | just import ubuntu-xenial container now | 01:00 |
ianw | root@pabelanger-test:/tmp# fstrim ./mnt | 01:09 |
ianw | fstrim: ./mnt: FITRIM ioctl failed: Operation not supported | 01:09 |
ianw | this is from *outside* the docker container | 01:09 |
pabelanger | Hmm | 01:09 |
pabelanger | I've just build a xenial node now | 01:09 |
pabelanger | okay, command running | 01:10 |
pabelanger | ianw: I am not sure why it is failing, i have built qcow2 images on that server | 01:10 |
ianw | this is trying to use the loopback mount in the docker outside it | 01:11 |
pabelanger | oh | 01:11 |
ianw | http://paste.openstack.org/show/594793/ | 01:12 |
ianw | that's the trace when it works | 01:12 |
pabelanger | ianw: how did you get it to graph like that? | 01:13 |
ianw | trace-cmd, uses ftrace | 01:13 |
pabelanger | k | 01:13 |
ianw | if (!blk_queue_discard(q)) | 01:14 |
ianw | return -EOPNOTSUPP; | 01:14 |
ianw | which is the error we see | 01:14 |
ianw | i wonder what that means | 01:14 |
pabelanger | ianw: okay, just got it working under ubuntu-xenial | 01:14 |
pabelanger | /dev/loop0: [64769]:4735612 (/var/lib/docker/aufs/diff/e3060103e9f402e9084b42da67d1fb9c4e5b32ae05a18873a5181617af328850/tmp/dib_image.X45D7ssy/image.raw) | 01:14 |
ianw | if the device does not support discard | 01:15 |
ianw | that is so weird because both here are I think loopback devices to a ext4 image in tmpfs | 01:15 |
ianw | pabelanger: wait, so under xenial you don't see this problem at all with fstrim? | 01:16 |
pabelanger | ianw: correct | 01:16 |
pabelanger | ianw: ssh 15.184.67.159 | 01:16 |
pabelanger | sudo docker run --privileged=true --cap-add=ALL -t -i diskimage-builder /bin/bash | 01:16 |
pabelanger | disk-image-create --no-tmpfs -n -o ubuntu-minimal ubuntu-minimal | 01:17 |
pabelanger | works as expected | 01:17 |
pabelanger | so, i wonder if the kernel I am running in trusty, has problems | 01:17 |
ianw | i think it's quite likely that something has happened between the kernel, aufs, the block layers and who knows what | 01:18 |
pabelanger | i would agree | 01:19 |
pabelanger | so, for now, I can abandon my patch | 01:19 |
pabelanger | maybe add something to docs about know issues | 01:19 |
pabelanger | I was planning on switching to xenial anyways :) | 01:19 |
pabelanger | k, going to drop for the night. | 01:22 |
pabelanger | ianw: thanks for yak shaving with me | 01:22 |
ianw | hmm, yeah, i'll shave a bit more, but otherwise i think it's probably not worth chasing down too far | 01:22 |
ianw | certainly the xenial behavior, being able to trim the loopback from within docker, is what i would *expect* to see | 01:23 |
ianw | cheers | 01:23 |
openstackgerrit | Leehom Li proposed openstack/diskimage-builder: Fix problem unable disable iptables service https://review.openstack.org/419703 | 01:35 |
ianw | ok, i think i get it now. i'll drop a comment | 01:46 |
*** aparnav has joined #openstack-dib | 03:37 | |
*** aparnav has quit IRC | 03:39 | |
*** sudipto has joined #openstack-dib | 05:18 | |
*** sudipto_ has joined #openstack-dib | 05:18 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Also check bin/ for tabs https://review.openstack.org/419770 | 06:01 |
openstackgerrit | Merged openstack/diskimage-builder: Make DHCP timeout configurable https://review.openstack.org/416675 | 06:19 |
*** aparnav has joined #openstack-dib | 06:40 | |
*** TheJulia has quit IRC | 07:29 | |
*** TheJulia has joined #openstack-dib | 07:34 | |
*** yolanda has quit IRC | 08:18 | |
*** yolanda has joined #openstack-dib | 08:19 | |
*** hashar has joined #openstack-dib | 09:44 | |
*** openstackgerrit has quit IRC | 10:18 | |
*** yolanda has quit IRC | 10:23 | |
*** yolanda has joined #openstack-dib | 10:24 | |
*** yolanda has quit IRC | 10:26 | |
*** yolanda has joined #openstack-dib | 10:27 | |
*** yolanda has quit IRC | 10:39 | |
*** yolanda has joined #openstack-dib | 10:41 | |
*** yolanda has quit IRC | 10:46 | |
*** yolanda has joined #openstack-dib | 10:49 | |
*** yolanda has quit IRC | 10:49 | |
*** yolanda has joined #openstack-dib | 10:49 | |
*** sudipto_ has quit IRC | 11:05 | |
*** sudipto has quit IRC | 11:05 | |
*** owalsh has joined #openstack-dib | 11:11 | |
*** appu103 has joined #openstack-dib | 11:14 | |
*** aparnav has quit IRC | 11:17 | |
*** appu103 has quit IRC | 12:08 | |
*** sudipto_ has joined #openstack-dib | 13:19 | |
*** sudipto has joined #openstack-dib | 13:19 | |
*** hashar has quit IRC | 13:35 | |
*** tommylikehu has quit IRC | 14:33 | |
*** tommylikehu has joined #openstack-dib | 14:34 | |
*** yolanda has quit IRC | 14:50 | |
*** yolanda has joined #openstack-dib | 14:50 | |
*** yolanda has quit IRC | 14:54 | |
*** yolanda has joined #openstack-dib | 14:54 | |
*** yolanda has quit IRC | 14:55 | |
*** yolanda has joined #openstack-dib | 14:56 | |
*** yolanda has quit IRC | 14:57 | |
*** yolanda_ has joined #openstack-dib | 14:59 | |
*** yolanda_ has quit IRC | 14:59 | |
*** yolanda_ has joined #openstack-dib | 14:59 | |
*** yolanda__ has joined #openstack-dib | 15:00 | |
*** yolanda_ has quit IRC | 15:01 | |
*** yolanda__ is now known as yolanda | 15:01 | |
*** yolanda has quit IRC | 16:35 | |
*** yolanda has joined #openstack-dib | 16:42 | |
*** yolanda has quit IRC | 16:51 | |
*** yolanda has joined #openstack-dib | 16:59 | |
*** sudipto has quit IRC | 17:01 | |
*** sudipto_ has quit IRC | 17:01 | |
*** yolanda has quit IRC | 17:04 | |
*** yolanda has joined #openstack-dib | 17:08 | |
*** openstackgerrit has joined #openstack-dib | 18:01 | |
openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Easy diskimage-builder development environment setup https://review.openstack.org/419655 | 18:01 |
openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Move evaluation of init system to chroot phases https://review.openstack.org/414179 | 18:09 |
*** owalsh has quit IRC | 18:28 | |
*** owalsh has joined #openstack-dib | 18:29 | |
openstackgerrit | Merged openstack/diskimage-builder: Also check bin/ for tabs https://review.openstack.org/419770 | 18:33 |
*** openstack has joined #openstack-dib | 18:58 | |
*** jamielennox is now known as jamielennox|away | 19:12 | |
*** openstack has joined #openstack-dib | 19:58 | |
openstackgerrit | Merged openstack/diskimage-builder: Handle failure of carrier check in dhcp-all-interfaces.sh https://review.openstack.org/419527 | 20:11 |
*** openstack has joined #openstack-dib | 20:28 | |
*** ashestakov has joined #openstack-dib | 21:11 | |
openstackgerrit | Andrey Shestakov proposed openstack/diskimage-builder: Fix dhcp-all-interfaces for ubuntu-minimal xenial https://review.openstack.org/407725 | 21:12 |
openstackgerrit | Andrey Shestakov proposed openstack/diskimage-builder: Add DIB_IPA_COMPRESS_CMD option https://review.openstack.org/416593 | 21:13 |
*** jamielennox|away is now known as jamielennox | 21:59 | |
openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: Bump fedora release to 25 https://review.openstack.org/419559 | 22:34 |
*** pmannidi has quit IRC | 22:57 | |
openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: Start with an empty environment for chroot https://review.openstack.org/413868 | 23:41 |
*** tommylikehu has quit IRC | 23:46 | |
*** tommylikehu has joined #openstack-dib | 23:46 | |
*** ashestakov has quit IRC | 23:51 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!