Thursday, 2018-12-20

*** tosky has quit IRC00:43
*** jamesmcarthur has joined #openstack-trove00:53
*** jamesmcarthur has quit IRC00:58
*** itlinux has quit IRC01:02
*** jamesmcarthur has joined #openstack-trove01:17
*** jamesmcarthur has quit IRC01:22
*** jamesmcarthur has joined #openstack-trove02:15
*** jamesmcarthur has quit IRC02:17
*** jamesmcarthur has joined #openstack-trove02:17
*** rcernin has quit IRC02:31
*** Bhujay has joined #openstack-trove02:40
*** Bhujay has quit IRC02:47
*** Bhujay has joined #openstack-trove02:47
*** Bhujay has quit IRC02:48
*** Bhujay has joined #openstack-trove02:49
*** Bhujay has quit IRC02:50
*** Bhujay has joined #openstack-trove02:50
*** Bhujay has quit IRC02:51
*** Bhujay has joined #openstack-trove02:52
*** Bhujay has quit IRC02:53
*** Bhujay has joined #openstack-trove02:53
*** Bhujay has quit IRC02:54
*** Bhujay has joined #openstack-trove02:55
*** rcernin has joined #openstack-trove02:55
*** Bhujay has quit IRC02:56
*** Bhujay has joined #openstack-trove02:56
*** Bhujay has quit IRC02:57
*** Bhujay has joined #openstack-trove02:58
*** Bhujay has quit IRC02:59
*** Bhujay has joined #openstack-trove02:59
*** Bhujay has quit IRC03:00
*** Bhujay has joined #openstack-trove03:01
*** Bhujay has quit IRC03:02
*** Bhujay has joined #openstack-trove03:02
*** Bhujay has quit IRC03:03
*** Bhujay has joined #openstack-trove03:04
*** Bhujay has quit IRC03:05
*** Bhujay has joined #openstack-trove03:05
*** Bhujay has quit IRC03:06
*** Bhujay has joined #openstack-trove03:07
*** Bhujay has quit IRC03:08
*** jamesmcarthur has quit IRC03:08
*** Bhujay has joined #openstack-trove03:08
*** Bhujay has quit IRC03:09
*** Bhujay has joined #openstack-trove03:10
*** Bhujay has quit IRC03:15
*** zhangfei has joined #openstack-trove03:27
*** jamesmcarthur has joined #openstack-trove03:34
*** Bhujay has joined #openstack-trove03:41
*** Bhujay has quit IRC03:46
*** rcernin has quit IRC04:05
*** rcernin has joined #openstack-trove04:12
*** jamesmcarthur has quit IRC04:29
*** Bhujay has joined #openstack-trove05:02
*** jamesmcarthur has joined #openstack-trove06:30
*** jamesmcarthur has quit IRC06:34
*** rcernin has quit IRC06:56
*** dkehn has quit IRC07:02
*** dkehn has joined #openstack-trove07:04
*** Bhujay has quit IRC07:13
*** Bhujay has joined #openstack-trove07:23
*** Bhujay has quit IRC07:24
*** Bhujay has joined #openstack-trove07:24
*** pcaruana has joined #openstack-trove07:25
*** Bhujay has quit IRC07:26
*** Bhujay has joined #openstack-trove07:26
*** Bhujay has quit IRC07:27
*** Bhujay has joined #openstack-trove07:27
*** maciejjozefczyk has joined #openstack-trove07:28
*** Bhujay has quit IRC07:29
*** Bhujay has joined #openstack-trove07:29
*** Bhujay has quit IRC07:30
*** Bhujay has joined #openstack-trove07:30
*** jamesmcarthur has joined #openstack-trove07:31
*** Bhujay has quit IRC07:32
*** Bhujay has joined #openstack-trove07:32
*** Bhujay has quit IRC07:33
*** Bhujay has joined #openstack-trove07:33
*** Bhujay has quit IRC07:35
*** jamesmcarthur has quit IRC07:35
*** Bhujay has joined #openstack-trove07:35
*** Bhujay has quit IRC07:36
*** Bhujay has joined #openstack-trove07:36
*** Bhujay has quit IRC07:38
*** Bhujay has joined #openstack-trove07:38
*** Bhujay has quit IRC07:39
*** Bhujay has joined #openstack-trove07:39
*** Bhujay has quit IRC07:41
*** Bhujay has joined #openstack-trove07:41
*** Bhujay has quit IRC07:42
*** Bhujay has joined #openstack-trove07:42
*** Bhujay has quit IRC07:44
*** Bhujay has joined #openstack-trove07:44
*** Bhujay has quit IRC07:45
*** Bhujay has joined #openstack-trove07:45
*** Bhujay has quit IRC07:47
*** Bhujay has joined #openstack-trove07:47
*** Bhujay has quit IRC07:48
*** Bhujay has joined #openstack-trove07:48
*** Bhujay has quit IRC07:50
*** Bhujay has joined #openstack-trove07:50
*** Bhujay has quit IRC07:51
*** Bhujay has joined #openstack-trove07:51
*** Bhujay has quit IRC07:53
*** Bhujay has joined #openstack-trove07:53
*** Bhujay has quit IRC07:54
*** Bhujay has joined #openstack-trove07:54
*** Bhujay has quit IRC07:56
*** Bhujay has joined #openstack-trove07:56
*** Bhujay has quit IRC07:57
*** Bhujay has joined #openstack-trove07:57
*** Bhujay has quit IRC07:59
*** Bhujay has joined #openstack-trove07:59
*** Bhujay has quit IRC08:00
*** Bhujay has joined #openstack-trove08:00
*** Bhujay has quit IRC08:02
*** Bhujay has joined #openstack-trove08:02
*** Bhujay has quit IRC08:03
*** Bhujay has joined #openstack-trove08:03
*** Bhujay has quit IRC08:05
*** Bhujay has joined #openstack-trove08:05
*** Bhujay has quit IRC08:06
*** Bhujay has joined #openstack-trove08:07
*** zhangfei has quit IRC08:12
*** tosky has joined #openstack-trove08:24
*** zhangfei has joined #openstack-trove08:24
*** Bhujay has quit IRC08:46
cezary_zukowskitomtom001: maybe try to build some other image (simpler one) first with DIB and check if it bootable with nova, then proceed with trove?09:17
*** bzurkowski has joined #openstack-trove09:19
cezary_zukowskitomtom001: https://docs.openstack.org/diskimage-builder/latest/09:20
*** Bhujay has joined #openstack-trove10:23
*** zhangfei has quit IRC11:08
*** Bhujay has quit IRC13:31
*** maciejjozefczyk has quit IRC13:47
*** maciejjozefczyk has joined #openstack-trove13:53
*** maciejjozefczyk has quit IRC14:05
*** maciejjozefczyk has joined #openstack-trove14:05
*** maciejjozefczyk has quit IRC14:11
*** maciejjozefczyk has joined #openstack-trove14:42
*** maciejjozefczyk has quit IRC14:46
*** maciejjozefczyk has joined #openstack-trove14:48
*** maciejjozefczyk has quit IRC14:50
*** maciejjozefczyk has joined #openstack-trove14:51
tomtom001cezary_zukowski: yes these images are bootable with nova if you launch an instance directly from the image.  But if the instances are created from the trove process they are not bootable.14:57
*** jackivanov has joined #openstack-trove14:58
cezary_zukowskitomtom001: ok, how you add image to Glance? https://pastebin.com/zxkMPxeF <-- maybe try with --disk-format qcow215:00
tomtom001cezary_zukowski: the image is built with the qcow2 extension so I thought it was by default - is that not the case?15:02
cezary_zukowskitomtom001: good question, then we would need to check what's the default value15:02
tomtom001cezary_zukowski: I'm also already using --disk-format qcow2 because of the extension, but if it's really a raw image that could be part of the problem.15:04
*** dkehn has quit IRC15:05
cezary_zukowskitomtom001: could be... hmm, in fact in the log of trovestack, there is a command that converts a raw image into qcow2 format:  qemu-img convert -c -f raw -O qcow2 -o compat=1.1 /tmp/dib_image.1teKZr00/image0.raw /opt/stack/images/ubuntu_mysql/ubuntu_mysql.qcow2-new15:12
*** dkehn has joined #openstack-trove15:13
cezary_zukowskitomtom001: although, disk-image-create help says that the default setting is qcow2 format (https://pastebin.com/hqnc8HpC)15:23
tomtom001cezary_zukowski: yeah and it boots if I just use nova to boot it.15:33
*** maciejjozefczyk has quit IRC15:34
tomtom001cezary_zukowski: also, is there a specific use case for creating the volume first then attaching the nova instance to it?  Can trove just launch the instance from Nova and let nova create the volume etc... for usage?15:38
*** maciejjozefczyk has joined #openstack-trove15:38
cezary_zukowskitomtom001: what do you want to achieve? I think bzurkowski yesterday draw how Trove creates a new instance by pointing to a code snippest15:40
cezary_zukowskitomtom001: try to run "trove --debug create ...", i.e. with --debug flag to get more information15:41
cezary_zukowskitomtom001: just having information it's "15:41
cezary_zukowskiit's "not bootable" does not even explain where the root cause may be15:42
tomtom001true, ok15:42
*** maciejjozefczyk has quit IRC15:44
*** maciejjozefczyk has joined #openstack-trove15:44
*** maciejjozefczyk has quit IRC15:59
tomtom001cezary_zukowski: is there a way to create the instance in trove without ephemeral storage?16:33
cezary_zukowskitomtom001: why are you asking? in fact never considered this16:37
tomtom001I am researching the issue, and I'm trying to figure out ways where the creation of an instance differs from the nova version to the trove version of it.16:46
tomtom001cezary_zukowski^^17:04
cezary_zukowskitomtom001: you use DIB to build both, have you found the source of "no bootable"? what OS component yields that error? Nova/Cinder? Have you found if trove --debug produces anything interesting?17:05
tomtom001cezary_zukowski: So the image I'm using is the same: The difference is whether I launch using nova or trove.  The console of the vm says that it has no bootable device, which is a function of nova starting the instance up.  --debug doesn't show anything interesting, it just shows that all the calls are made by trove to create the volume and instance, but there aren't any errors that I can see.17:11
cezary_zukowskitomtom001: it's a bit like looking for an needle in haystack, what about https://stackoverflow.com/questions/51862811/openstack-instance-no-bootable-device ?17:15
*** jamesmcarthur has joined #openstack-trove17:21
*** jamesmcarthur has quit IRC17:27
tomtom001cezary_zukowski: that's what I'm saying is that the image is qcow2, but the format chosen for the volume on launch is raw.17:28
cezary_zukowskitomtom001: Could you paste the entire log file?17:34
cezary_zukowskii.e. this with no bootable device error message17:35
tomtom001cezary_zukowski: http://paste.openstack.org/show/737797/   This is the nova log, but it doesn't show "no bootable device" because that error message comes from the VM console when you try to boot.18:28
cezary_zukowskitomtom001: seems as know bug: https://bugs.launchpad.net/nova/+bug/1486204, https://bugs.launchpad.net/nova/+bug/152887718:46
openstackLaunchpad bug 1486204 in OpenStack Compute (nova) "libvirt: user specified volume device names are not ignored" [Medium,In progress] - Assigned to Maxim Nestratov (mnestratov)18:46
openstackLaunchpad bug 1486204 in OpenStack Compute (nova) "duplicate for #1528877 libvirt: user specified volume device names are not ignored" [Medium,In progress] - Assigned to Maxim Nestratov (mnestratov)18:46
cezary_zukowskitomtom001: by the way, /dev/vdb is where datastore is mounted, e.g. /var/lib/cassandra/ (/var/lib/cassandra/data)18:52
cezary_zukowskitomtom001: also here https://lists.launchpad.net/yahoo-eng-team/msg48469.html18:54
tomtom001cezary_zukowski: so i didn't see any bugs that related to my issue in the bugs.  Also, so what do the images from DIB do then?  I thought they created the entire operating system plus the datastore?? The issue isn't whether or not the image is working correctly but rather how trove is being used to create the image and the volume.  I suspect that the image is qcow2 and trove is creating it as18:56
tomtom001raw and then attaching to an nova instance which I think is breaking the launch.  When I launch the same image from nova, I believe nova is detecting the image type and launching appropriately.18:57
*** jamesmcarthur has joined #openstack-trove19:31
*** jackivanov has quit IRC19:54
*** jackivanov has joined #openstack-trove19:54
*** pcaruana has quit IRC19:57
*** jackivanov has quit IRC19:59
cezary_zukowskitomtom001: I have: 1) created an instance "trove create ..." 2) remembered Trove instance ID 3) grep over /var/log searching for occurence of ID 4) found: https://pastebin.com/tyv76XWf (Devstack deployment)20:04
cezary_zukowskitomtom001: you may do the same and compare what nova is receiving, e.g. root_device_name='/dev/vda', image_disk_format='qcow2', etc.20:05
*** jackivanov has joined #openstack-trove20:06
*** jackivanov has quit IRC20:09
*** jackivanov has joined #openstack-trove20:09
*** jackivanov has quit IRC20:14
*** jackivanov has joined #openstack-trove20:22
*** jackivanov has quit IRC20:23
*** jamesmcarthur has quit IRC20:24
*** jackivanov has joined #openstack-trove20:24
*** jamesmcarthur has joined #openstack-trove20:24
*** jackivanov has quit IRC20:26
*** jackivanov has joined #openstack-trove20:27
*** jackivanov has quit IRC20:31
*** jamesmcarthur has quit IRC21:04
*** jamesmcarthur has joined #openstack-trove21:04
cezary_zukowskitomtom001: also, here: https://pastebin.com/nfmNExrq21:20
cezary_zukowskitomtom001: I also have "Booting with blank volume at /dev/vdb", so maybe this is not in fact what causes the issue ("2018-12-20 20:38:42.692 INFO nova.virt.block_device [req-0e64f20e-67db-4960-b084-283223928000 admin admin] [instance: 52be6bc1-e18d-4c3f-9531-891fd39e9649] Booting with blank volume at /dev/vdb")21:22
cezary_zukowskitomtom001: I mean, it may be false alarm, and error is somewhere else...21:23
*** jamesmcarthur has quit IRC22:00
*** jamesmcarthur has joined #openstack-trove22:01
*** jamesmcarthur has quit IRC22:04
*** itlinux has joined #openstack-trove22:04
*** rcernin has joined #openstack-trove22:50
*** itlinux has quit IRC23:11

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!