Thursday, 2019-01-24

*** mjturek has quit IRC00:36
ianwcgoncalves / johnsom : so i think https://bugzilla.redhat.com/show_bug.cgi?id=1668982 is probably it04:56
openstackbugzilla.redhat.com bug 1668982 in systemd "Boot speed regression with 219-62.el7_6.2 -- hotplug memory rules suspected" [Unspecified,New] - Assigned to systemd-maint04:56
*** hwoarang has quit IRC06:08
*** hwoarang has joined #openstack-dib06:09
cgoncalvesianw, nice! subscribing to the rhbz :)07:47
cgoncalvesianw, I'm running into another DIB-related issue. so now we install python3-setuptools in fedora but I still get ModuleNotFoundError07:49
cgoncalveshttp://logs.openstack.org/81/600381/12/check/octavia-v2-dsvm-scenario-fedora-latest/669f9ca/controller/logs/dib-build/amphora-x64-haproxy.qcow2_log.txt.gz#_2019-01-23_08_23_03_09207:49
cgoncalvesin pre-install.d, the pip element does some voodoo magic installing and deleting setuptools07:50
cgoncalvesbut that is pre-install.d. the error I'm pointing is in clean which is outside chroot07:51
ianwcgoncalves: yeah, just got marked as a dup.  but that's the problem :)  at least it's been root caused07:51
cgoncalvesright. last update from last Friday07:52
ianwcgoncalves: wouldn't that be the problem with the missing dependencies, and setuptools not on the host?07:53
cgoncalvesianw, precisely. the DIB patch got merged and I rechecked my octavia patch07:53
cgoncalveshttp://logs.openstack.org/81/600381/12/check/octavia-v2-dsvm-scenario-fedora-latest/669f9ca/controller/logs/rpm-qa.txt.gz07:54
cgoncalvespython{2,3}-setuptools are installed07:54
ianwhrm ... i wonder if this is a dib image specific thing :/  we put setuptools on hold i think, so it comes from pip during the build07:58
cgoncalvesianw, yes but that in inside the chroot, no?07:59
cgoncalveswhereas semanage (depends on setools that depends on setuptools) runs outside chroot07:59
ianwno packages were pulled @ in http://logs.openstack.org/81/600381/12/check/octavia-v2-dsvm-scenario-fedora-latest/669f9ca/controller/logs/devstacklog.txt.gz#_2019-01-23_08_15_32_21608:00
ianwyeah i'm referring to the actual nodes that this is running on08:00
cgoncalvesianw, yeah I checked that. that is okay08:00
cgoncalvesbecause bindep is ran with -b which only installs missing packages08:00
cgoncalvesat least that is my understanding08:01
ianwhrm08:03
ianwi can replicate this http://paste.openstack.org/show/743209/08:09
ianwit runs with #! /usr/bin/python3 -Es08:09
ianwhttp://paste.openstack.org/show/743210/08:11
ianw"-Es" gives ['', '/usr/lib64/python37.zip', '/usr/lib64/python3.7', '/usr/lib64/python3.7/lib-dynload', '/usr/lib64/python3.7/site-packages', '/usr/lib/python3.7/site-packages']08:13
ianw"-E" gives ['', '/usr/lib64/python37.zip', '/usr/lib64/python3.7', '/usr/lib64/python3.7/lib-dynload', '/usr/local/lib/python3.7/site-packages', '/usr/lib64/python3.7/site-packages', '/usr/lib/python3.7/site-packages']08:13
ianwohhhh i think i see what's going on08:14
ianwduring the image build, we install the latest upstream versions of pip, setuptools, etc with pip08:15
ianwwe put python3-setuptools (the package) on hold so we don't overwrite what we installed from pip08:15
ianwsemanage is ignoring the pip installed versions08:16
ianwcgoncalves: sorry, i'm going to have to think about this.  it's a problem with the underlying CI image we're providing :/08:16
cgoncalvesianw, I'm a bit confused. the part where setuptools is put on hold isn't that inside the chroot while semanage runs outside?08:17
cgoncalvessure. no problem!08:18
ianwcgoncalves: no this is during the dib build of the actual fedora images we run in CI08:19
ianwwe had constant problems with pip bugs, etc, so we always wanted the latest on our CI hosts08:19
cgoncalvesfedora upstream images are being fetched from fedoraproject.org, which occasionally results in network issues like http://logs.openstack.org/81/600381/13/check/octavia-v2-dsvm-scenario-fedora-28/22c0bde/controller/logs/dib-build/amphora-x64-haproxy.qcow2_log.txt.gz#_2019-01-23_14_17_53_20908:20
ianwthe problem was, we'd pip install setuptools, then if somebody "yum install python-setuptools" it would overwrite it back to an old version08:20
cgoncalvesI see08:20
ianwso we install the packaged version, clear it out, and install from pip.  but i think more recent fedoras have broken this model08:20
ianwbecause they separate pip installs better08:21
ianwyeah i'll have to play with this more tomorrow, i'm not seeing the immediate solution08:24
cgoncalvesmuch appreciated. let me know if I can help somehow08:25
cgoncalvesanyway, thumbs up to your bindep related patches. work great!08:25
*** jesusaur has quit IRC12:48
*** hwoarang has quit IRC13:18
*** hwoarang has joined #openstack-dib13:19
*** mjturek has joined #openstack-dib14:27
*** mjturek has quit IRC14:42
*** mjturek has joined #openstack-dib15:02
*** mjturek has quit IRC15:04
*** hwoarang has quit IRC15:07
*** mjturek has joined #openstack-dib15:08
*** hwoarang has joined #openstack-dib15:08
*** mjturek has quit IRC15:41
*** mjturek has joined #openstack-dib15:47
*** mjturek has quit IRC15:51
*** mjturek has joined #openstack-dib16:02
*** mjturek has quit IRC19:30
*** mjturek has joined #openstack-dib19:31
*** jesusaur has joined #openstack-dib21:45
*** mjturek has quit IRC22:03

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!