Monday, 2017-03-20

*** jamielennox is now known as jamielennox|away00:38
*** pmannidi has quit IRC01:44
*** pmannidi has joined #openstack-dib01:49
*** jamielennox|away is now known as jamielennox03:22
*** aparnav has joined #openstack-dib03:58
ianwyolanda: i had a look at the dracut one.  not totally opposed ... i wonder though if we're better served with a config file of some sort, rather that more or more elements07:07
ianwthe existing dracut elements look like they are full of cruft, and i can't see they're used?07:07
yolandahi ianw, so my dracut element has a different purpose than the existing ones. The current ones are for generating initramfs images07:23
yolandathe one i created is to regenerate dracut on the existing ones07:23
yolandai had a conversation with greghaynes and we discussed several options, seemed that using different elements was simpler. Because it was not only needing to add the list of modules in the dracut command, but to add the depending packages07:24
ianwyolanda: yeah ... i noticed they had module install stuff.  was just a thought really, maybe a yaml type config like the block stuff would work07:30
yolandawe need a way to specify the module itself, and the package that brings with him07:34
yolandaa yaml with module:[packages] list can make sense07:34
*** zhugaoxiao has quit IRC07:57
*** zhugaoxiao has joined #openstack-dib07:58
*** brault has joined #openstack-dib08:01
ianwi guess it's just if this is going to grow into many more elements all basically the same08:02
yolandain my case i just needed the lvm and crypt, but i guess people can need some others, if we offer the possibility to enable modules on boot. Now this needs to be done post-deploy, but is useful to have it on the imaage, to avoid extra reboots08:18
*** hashar has joined #openstack-dib08:31
*** andreas-f has quit IRC08:42
*** pmannidi has quit IRC08:49
*** andreas-f has joined #openstack-dib08:54
*** andreas-f has quit IRC08:55
*** openstackgerrit has quit IRC09:02
*** owalsh_ is now known as owalsh09:33
*** openstackgerrit has joined #openstack-dib10:14
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add dracut-regenerate elements  https://review.openstack.org/44704710:14
*** hashar is now known as hasharLunch10:44
*** aparnav has quit IRC12:06
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add dracut-regenerate elements  https://review.openstack.org/44704712:52
*** hasharLunch is now known as hashar14:05
openstackgerritCorey O'Brien proposed openstack/diskimage-builder master: Don't unmount missing paths  https://review.openstack.org/44662114:58
*** jamielennox has quit IRC15:17
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add dracut-regenerate elements  https://review.openstack.org/44704715:50
*** hirewj has joined #openstack-dib15:51
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Always execute autorelabel  https://review.openstack.org/44707615:53
hirewjhi! i would like to build image for ironic with dib and after a lot of tries to build it with grub component (or better to say package, since this one fails when installing inside OS itself), i don't get out anything other then error that grub cannot be installed - it doesn't depend on which distro i try ubuntu, fedora, ... i'm building image with commands suggested in official guide and everything i get error that grub or depe15:54
hirewjlike described here16:00
hirewjhttps://docs.openstack.org/developer/openstack-ansible-os_ironic/configure-ironic.html16:00
greghaynesianw: yolanda I agree that a ton of tiny elements isnt great, although I think all we should provide is the default setup (which does maybe lvm and a couple others) and additional dracut modules we can just say need to live out of tree?16:02
greghaynessince its fine if users end up making a bunch of elements imo16:03
greghaynesI'm not super in to the idea though, if theres something else that will allow users to ask for additional modules with additional package dependencies im all for it16:04
yolandagreghaynes, i refactored that to use a yaml, take a look and see if that fits. it's not too complicated16:04
yolandajust a yaml with a list of modules and packages16:04
greghaynesok16:05
hirewjgreghaynes: any idea why ubuntu image with grub can't be build? ^16:09
hirewj*built16:10
*** jamielennox has joined #openstack-dib16:19
*** jamielennox is now known as jamielennox|away16:21
hirewjdpkg: error processing package grub-efi-amd64 (--configure):16:42
hirewjsubprocess installed post-installation script returned error exit status 116:42
hirewjdpkg: dependency problems prevent configuration of grub-efi-amd64-signed:16:43
hirewjPackage grub-efi-amd64 is not configured yet.16:43
hirewjNo DKMS packages installed: not changing Secure Boot validation state.16:43
hirewjErrors were encountered while processing:  grub-efi-amd64  grub-efi-amd64-signed E: Sub-process /usr/bin/dpkg returned an error code (1)16:43
*** hashar is now known as hasharAway16:59
hirewjcan somebody help17:01
hirewjdoes anyone know how to create ramdisk and user image for ironic with disk-image-create so that it works?17:05
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Apply setfiles on all mountpoints  https://review.openstack.org/44707617:22
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add dracut-regenerate elements  https://review.openstack.org/44704717:29
openstackgerritCorey O'Brien proposed openstack/diskimage-builder master: Ignore missing path in unmount_dir  https://review.openstack.org/44662117:39
hirewjdisk-image-create ubuntu baremetal localboot local-config dhcp-all-interfaces grub2 -o ubuntu-xenial18:01
hirewjErrors were encountered while processing:  grub-efi-amd64  grub-efi-amd64-signed  linux-image-4.4.0-66-generic  linux-image-extra-4.4.0-66-generic  linux-image-generic  linux-image-generic-lts-xenial18:01
hirewjany idea what to do for successful image building?18:01
hirewjianw: ^18:01
hirewjyolanda: ^18:01
hirewjhttp://i.imgur.com/t2Xigoh.png18:03
*** jamielennox|away is now known as jamielennox18:24
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Apply setfiles on all mountpoints  https://review.openstack.org/44707618:39
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Apply setfiles on all mountpoints  https://review.openstack.org/44707618:42
*** andreas-f has joined #openstack-dib19:12
*** hasharAway is now known as hashar19:22
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Apply setfiles on all mountpoints  https://review.openstack.org/44707619:41
*** hirewj has quit IRC19:45
*** pleia2_ has joined #openstack-dib20:18
*** andyjones2001 has joined #openstack-dib20:22
*** radez` has joined #openstack-dib20:25
*** andyjone1 has quit IRC20:29
*** pleia2 has quit IRC20:29
*** radez has quit IRC20:29
ianwhirewj: hmm, really need some more logs before that20:35
ianwwith -x20:36
ianwoh, they're gone20:36
*** pmannidi has joined #openstack-dib20:43
*** owalsh has quit IRC20:50
*** owalsh has joined #openstack-dib20:50
*** hashar has quit IRC22:01
*** mmedvede has joined #openstack-dib22:48
mmedvedeianw: andreas-f: continuing from #openstack-infra, about  http://lists.openstack.org/pipermail/openstack-dev/2017-March/114263.html22:52
mmedvedeI have setup a test job on ppc64, here is one of results http://dal05.objectstorage.softlayer.net/v1/AUTH_3d8e6ecb-f597-448c-8ec2-164e9f710dd6/pkvmci/diskimage-builder/86/444586/4/check-silent/dib-dsvm-functests-devstack-xenial/0449bca/22:52
mmedvedeif you ctrl-f 'the chosen partition is not a PReP partition', you'll see an error I was talking about in the email22:53
mmedvedeianw: andreas-f: so if you let me, I would like to enable reporting of our CI on diskimage-builder22:54
ianwmmedvede: ok, i'd be fine with that22:55
ianware you setting this up to build ppc images though, or does that just happen magically because it's on that host?22:55
ianw./run_functests.sh doesn't know anything about architectures22:55
mmedvedeianw: it just happens magically. Well, I guess there is logic in diskimage-builder to make it happen22:56
mmedvedee.g. it gets correct arch cloud image22:56
ianwhmm, i'm not sure how intentional it is :)22:56
ianwso debian-minimal passed?22:58
mmedvedeianw: debian-minimal/stable-build-succeeds passed, but it failed at debian-minimal/stable-vm22:59
ianwyeah, ok22:59
ianwmmedvede: what platforms are you interested in?23:00
mmedvedeianw: there are a bunch of other tests that I am not sure would pass after, but debian-minimal/stable-vm fails with the same error that I saw building Xenial image on Xenial23:00
mmedvedeianw: primarily, interested in ppc64 :)23:00
ianwsure, but i mean debian, ubuntu, fedora, centos, suse, gentoo ... all of them?23:01
mmedvedeianw: or are you asking, which OS platforms? Ubuntu / Debian. But I do not mind testing more23:01
ianwthe only thing with the functional tests is they are not booting tests23:01
mmedvedecentos/gentoo straight up refuses to run with "only supported on x86" message23:01
ianwthe nodepool tests are, however23:02
ianwdoes ppc use grub?23:02
ianw(i haven't had linux+ppc since a white iBook that I used to run linux on, so I'm out of date :)23:03
mmedvedeianw: judging from the code in dib element that sets grub up, yes23:04
mmedvedegood question, maybe it installs wrong grub (ppc uses grub-ieee1275 package)23:05
mmedvedeianw: so can I consider your ok an official permission to report on diskimage-builder?23:06
ianwmmedvede: well yes I don't mind at least getting a comment with logs ... but honestly we're going to have to do some work here to get the results to be useful I think23:07
ianwat least making sure we're running suitable func tests, not all of them23:08
ianwotherwise the job will just never pass23:08
ianwso if it's just constantly failing, people are trained to ignore it23:08
ianwcan we just have it comment and not vote at this point?23:08
mmedvedeianw: definitely. I already removed tests that I know would fail (centos/gentoo)23:08
mmedvedeianw: when you mentioned nodepool boot test, did you mean e.g. gate-dsvm-nodepool-debian-src-nv?23:09
mmedvedeyeah, non-voting is fine23:09
ianwyes, those two nodepool tests actually build an image, and use nodepool to upload it into devstack where it gets booted and registered23:10
ianwit might be interesting, but obviously this is also a tacit test of the entire devstack + nodepool infrastructure too :)23:11
mmedvedenice. I'll consider adding that job too. functional passing seems to be prerequisite for nodepool one passing though23:11
ianwyes ... if we can't build the image we can't boot it :)23:13
ianwmmedvede: and we are sure this worked before right?  i think you said it did in your mail.  was it completely booting?23:14
mmedvedeianw: yes, it was working before and building, I did put snippet from good build in the bug https://bugs.launchpad.net/diskimage-builder/+bug/167440223:16
openstackLaunchpad bug 1674402 in diskimage-builder "bootloader element fails to install grub on ppc64 platform" [Undecided,New]23:16
mmedvedeianw: and it was booting - we use the images built with dib in our CI23:16
ianwmmedvede: can you attach the full log of the prior working run?23:17
ianwi guess clearly the difference is in the trying to install in loop0 v loop0p1 ... presumably p1 is a /boot partition23:18
ianwjust wondering if we actually create it23:18
mmedvedeianw: that is the first thing I've noticed, but there could be something else going on, e.g. why would grub try using loop0p1 while it is told explicitly to use loop0p23:19
mmedvedes/grub/install-grub/23:19
ianwsurely that --modules=part_msdos is at least unnecessary, maybe even wrong ...23:20
ianwwe're running grub-install on IMAGE_BLOCK_DEVICE_WITHOUT_PART23:22
ianwok, elements/vm/block-device.d/10-partition does have all this ppc setup23:28
ianwin 1.2823:29
mmedvedesanitizing good log a bit, would upload shortly23:29
mmedvedeianw: I'll push a test patch removing part_msdos option, so would also test if reporting is working ok23:30
ianwmmedvede: yeah, that's not it23:30
mmedvedeno need to try?23:30
ianwi don't think so, that bit hasn't changed23:30
ianwi do think we've regressed here in diskimage_builder/block_device/level1/partitioning.py23:31
*** jamielennox is now known as jamielennox|away23:36
*** jamielennox|away is now known as jamielennox23:40
ianwmmedvede: ok, commented in the bug, i think i'm starting to piece together this.23:42
ianwmmedvede: are you ok on 1.28.0 for the time being?23:42
mmedvedeianw: thanks. Yeah, I can build on 1.28.0 for now. Although it is not a smooth experience any more :)23:43
mmedvedeianw: trying to wrap my head around partitioning.py patch https://review.openstack.org/#/c/375261/. It is one big patch23:44
ianwmmedvede: yes, it was a big change, that's why we bumped to 2.0.0 :)  but it lays the foundation for us to do fancy things like lvm and crypt partitions etc etc23:46
mmedvedeThanks for the help. There should be reports from IBM PowerKVM CI on diskimage-builder starting now23:50

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!