Monday, 2014-01-06

*** yamahata__ has quit IRC00:20
*** yamahata_ has joined #tripleo00:42
*** rongze has joined #tripleo00:44
*** rongze has quit IRC00:49
*** nosnos has joined #tripleo01:06
*** amrit has joined #tripleo01:11
*** amrit has quit IRC01:19
*** amrit has joined #tripleo01:20
*** AaronGr_Zzz is now known as AaronGr01:54
*** rongze has joined #tripleo02:00
*** amrit has quit IRC02:14
*** xuhanp has joined #tripleo02:32
*** xuhanp has quit IRC02:36
*** xuhanp has joined #tripleo02:37
*** sdake_ has quit IRC02:39
*** sdake has joined #tripleo02:39
*** sdake has joined #tripleo02:39
*** CaptTofu has quit IRC03:24
*** CaptTofu has joined #tripleo03:24
*** noslzzp has quit IRC03:34
*** CaptTofu has quit IRC03:55
*** CaptTofu has joined #tripleo03:56
*** rongze has quit IRC04:40
*** rushiagr has joined #tripleo05:31
*** nosnos_ has joined #tripleo05:34
*** tzumainn has joined #tripleo05:35
*** nosnos__ has joined #tripleo05:36
*** nosnos_ has quit IRC05:37
*** nosnos has quit IRC05:38
*** tzumainn has quit IRC05:51
*** boris-42 has joined #tripleo06:03
*** rongze has joined #tripleo06:18
*** rongze_ has joined #tripleo06:21
*** rongze has quit IRC06:25
*** jcoufal has joined #tripleo06:39
*** mrunge has joined #tripleo06:45
*** rlandy has joined #tripleo06:53
*** nosnos__ has quit IRC07:06
*** nosnos has joined #tripleo07:06
*** rha has joined #tripleo07:29
*** rha has quit IRC07:30
*** rha has joined #tripleo07:30
*** jprovazn has joined #tripleo07:35
*** rha has quit IRC07:38
*** rha has joined #tripleo07:38
*** jtomasek has joined #tripleo07:45
*** ifarkas has joined #tripleo07:46
*** briancline has joined #tripleo07:48
*** ifarkas has quit IRC07:49
*** rushiagr is now known as rushiagr_away07:52
*** john-n-seattle has joined #tripleo07:53
*** ifarkas has joined #tripleo07:58
*** bauzas has joined #tripleo08:09
*** rushiagr_away is now known as rushiagr08:10
*** pblaho has joined #tripleo08:19
*** lsmola_ has joined #tripleo08:26
*** jistr has joined #tripleo08:49
*** lynxman has quit IRC08:58
*** lynxman has joined #tripleo08:59
*** pblaho has quit IRC09:05
*** derekh has joined #tripleo09:10
*** rongze_ has quit IRC09:23
*** pblaho has joined #tripleo09:23
*** rongze has joined #tripleo09:43
*** athomas has joined #tripleo09:56
openstackgerritJan Provaznik proposed a change to openstack/diskimage-builder: Make sure a loop device exists before kpartx is called  https://review.openstack.org/6505609:59
*** martyntaylor has joined #tripleo10:07
*** akrivoka has joined #tripleo10:10
*** martyntaylor has quit IRC10:11
*** xuhanp has quit IRC10:12
*** erwan_ta- is now known as erwan_taf10:15
openstackgerritJan Provaznik proposed a change to openstack/diskimage-builder: Make sure a loop device exists before kpartx is called  https://review.openstack.org/6505610:25
*** rdopieralski has joined #tripleo10:28
*** martyntaylor has joined #tripleo10:32
openstackgerritJan Provaznik proposed a change to openstack/diskimage-builder: Make sure a loop device exists before kpartx is called  https://review.openstack.org/6505610:37
*** akrivoka has quit IRC10:43
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Update installation instructions  https://review.openstack.org/6465710:44
*** athomas has quit IRC10:45
*** akrivoka has joined #tripleo10:45
*** rdopieralski has quit IRC10:53
*** rushiagr2 has joined #tripleo10:57
*** rushiagr has quit IRC11:00
*** lucasagomes has joined #tripleo11:03
*** rongze has quit IRC11:04
*** rongze has joined #tripleo11:05
*** lucasagomes has quit IRC11:07
*** rongze has quit IRC11:09
*** lucasagomes has joined #tripleo11:16
*** lucasagomes has quit IRC11:25
*** lucasagomes has joined #tripleo11:26
*** lucasagomes has quit IRC11:27
*** lucasagomes has joined #tripleo11:27
mariosr11:35
*** rongze has joined #tripleo11:35
*** rongze has quit IRC11:40
*** rushiagr2 is now known as rushiagr_away11:43
*** athomas has joined #tripleo11:46
*** rushiagr_away is now known as rushiagr211:47
*** CaptTofu has quit IRC11:52
*** CaptTofu has joined #tripleo11:52
*** athomas has quit IRC11:57
*** athomas has joined #tripleo12:11
*** rongze has joined #tripleo12:35
*** nosnos has quit IRC12:36
*** rongze has quit IRC12:39
*** funzo has joined #tripleo12:43
*** slagle_ has quit IRC12:44
*** slagle has joined #tripleo12:45
openstackgerritA change was merged to openstack/diskimage-builder: Make sure a loop device exists before kpartx is called  https://review.openstack.org/6505612:49
*** jdob has joined #tripleo12:49
*** rushiagr2 has quit IRC13:08
*** juice has quit IRC13:17
*** juice has joined #tripleo13:18
*** jtomasek has quit IRC13:24
*** rongze has joined #tripleo13:25
*** jtomasek has joined #tripleo13:25
*** CaptTofu has quit IRC13:29
*** CaptTofu has joined #tripleo13:29
*** jtomasek has quit IRC13:29
*** jtomasek has joined #tripleo13:30
*** bauzas has quit IRC13:40
*** morazi has joined #tripleo13:42
*** jdob has quit IRC13:45
*** jtomasek has quit IRC13:47
*** jdob has joined #tripleo13:48
*** CaptTofu has quit IRC13:49
*** CaptTofu has joined #tripleo13:50
*** jtomasek has joined #tripleo13:51
*** morazi has quit IRC13:58
*** tzumainn has joined #tripleo14:03
*** lblanchard has joined #tripleo14:06
*** lucasagomes is now known as lucas-hungry14:15
*** morazi has joined #tripleo14:16
*** dprince has joined #tripleo14:18
jprovaznanyone successfully ran overcloud-control instance with the new /mnt/state stuff?14:23
jprovaznon fedora14:24
jprovaznmysql seems to be broken for me: http://paste.openstack.org/show/60430/14:24
* derekh hasn't tried it14:25
*** rushiagr2 has joined #tripleo14:27
derekhjprovazn: trying t out now14:30
openstackgerritA change was merged to openstack/tuskar-ui: Update installation instructions  https://review.openstack.org/6465714:30
jprovaznderekh: thanks14:30
*** blamar has joined #tripleo14:33
*** openstack has joined #tripleo14:34
*** martyntaylor has quit IRC14:35
*** julim has joined #tripleo14:38
*** lucas-hungry is now known as lucasagomes14:42
*** matty_dubs|gone is now known as matty_dubs14:43
*** martyntaylor has joined #tripleo14:53
*** mrunge has quit IRC14:53
*** beekneemech is now known as bnemec14:54
jprovaznanother issue seems to be with /opt/stack/os-config-refresh/post-configure.d/50-mysql-users - it seems it doesn't read /etc/mysql/my.cnf where is proper path to socket set14:57
jprovaznhttp://paste.openstack.org/show/60438/14:57
*** rongze has quit IRC14:58
*** rongze has joined #tripleo14:59
*** CaptTofu has quit IRC15:00
jprovazn# Root should have a my.cnf setup15:00
jprovaznconn = MySQLdb.Connect(read_default_file=os.path.expanduser('~/.my.cnf'))15:00
jprovazn^ this is apparently wrong15:00
jprovazn(from file /opt/stack/os-config-refresh/post-configure.d/50-mysql-users)15:01
*** panda has joined #tripleo15:01
*** morazi has quit IRC15:03
*** rongze has quit IRC15:03
*** Guest97522 has quit IRC15:11
*** jog0 has joined #tripleo15:12
*** rwsu has joined #tripleo15:12
*** morazi has joined #tripleo15:17
*** CaptTofu has joined #tripleo15:20
*** rongze has joined #tripleo15:20
*** rushiagr2 is now known as rushiagr_away15:21
*** spzala has joined #tripleo15:36
*** rushiagr_away is now known as rushiagr215:38
*** ifarkas has quit IRC15:39
*** funzo has quit IRC15:40
*** funzo has joined #tripleo15:40
*** martyntaylor has quit IRC15:42
*** martyntaylor has joined #tripleo15:42
openstackgerritPetr Blaho proposed a change to openstack/python-tuskarclient: [WIP] Adds help for subcommands  https://review.openstack.org/5625715:43
*** jrist has joined #tripleo15:52
*** rushiagr2 is now known as rushiagr16:01
*** UtahDave has joined #tripleo16:03
*** jprovazn has quit IRC16:05
*** rongze has quit IRC16:16
*** rongze has joined #tripleo16:17
openstackgerritPetr Blaho proposed a change to openstack/python-tuskarclient: [WIP] Adds help for subcommands  https://review.openstack.org/5625716:17
*** rongze has quit IRC16:17
*** rongze has joined #tripleo16:19
*** rongze has quit IRC16:19
*** rongze has joined #tripleo16:20
*** rongze has quit IRC16:20
*** rongze has joined #tripleo16:20
*** rongze has quit IRC16:21
*** noslzzp has joined #tripleo16:21
*** rongze has joined #tripleo16:21
*** rongze has quit IRC16:22
*** rongze has joined #tripleo16:22
*** rongze has quit IRC16:23
*** rongze has joined #tripleo16:23
*** rongze has quit IRC16:24
*** rongze has joined #tripleo16:24
*** rongze has quit IRC16:25
*** rongze has joined #tripleo16:26
*** rongze has quit IRC16:26
*** rongze has joined #tripleo16:27
*** rongze has quit IRC16:27
*** rongze has joined #tripleo16:27
*** rongze has quit IRC16:28
*** rongze has joined #tripleo16:28
*** rongze has quit IRC16:29
*** rongze has joined #tripleo16:29
*** rongze has quit IRC16:29
*** rongze has joined #tripleo16:30
*** rongze has quit IRC16:30
*** rongze has joined #tripleo16:30
*** rongze has quit IRC16:30
*** rongze has joined #tripleo16:31
*** ifarkas has joined #tripleo16:37
*** lblanchard has quit IRC16:37
*** ifarkas has quit IRC16:41
*** ifarkas has joined #tripleo16:41
*** mrunge has joined #tripleo16:42
openstackgerritTzu-Mainn Chen proposed a change to openstack/tuskar-ui: Add mock api calls to the UI  https://review.openstack.org/6255417:08
Nghas anyone run into https://bugs.launchpad.net/devstack/+bug/1255128 recently?17:16
Ngjust running a fresh seed image build and hit it17:16
*** pblaho has quit IRC17:17
Ngmordred: about?17:17
*** jistr has quit IRC17:21
*** lblanchard has joined #tripleo17:21
slaglehmm, the pip installs of diskimage-builder and t-i-e aren't super useful b/c all the element hook scripts aren't installed +x17:25
slaglei can't seem to find an obvious way to fix that17:25
Ngmordred: (running into something that looks a lot like bug #1203340 which is fixed and assigned to you, curious how you fixed it)17:29
*** mrunge has quit IRC17:29
Ngfudged around it by installing warlock with pip, rather than letting it end up being installed by easy_install17:35
Ngbut hitting the same thing with cliff now17:35
NgI do not understand why pip ends up using easy_install to install dependencies, but I care for it not one little bit17:35
*** cody-somerville has joined #tripleo17:36
cody-somervilleHey everybody! Happy New Years!17:37
*** rushiagr is now known as rushiagr_away17:37
*** rushiagr_away is now known as rushiagr17:38
* SpamapS returns from taking kids to school17:39
SpamapScody-somerville: howdy!17:39
NgSpamapS: hey, have you run a full tripleo build recently?17:44
NgI'm over in Galway with some HP folk showing them our wonderful stuff and running into all sorts of sucky pip/easy_install issues17:44
NgI haven't done a full run at home since before xmas, but it was all working fine then :/17:44
SpamapSNg: Oh I thought you and I were going to be in Galway next month. Interesting.17:45
NgSpamapS: nup, today and tomorrow17:45
SpamapSNg: I did a build around the 28th.17:45
Ngaha, the run I just did at home has failed in exactly the same way17:45
SpamapSNg: using the mysql patches that have landed since.17:45
Ngor at least in the first of the exact same ways that it died here17:45
*** rongze has quit IRC17:48
*** rongze has joined #tripleo17:50
*** rongze has quit IRC17:51
*** rongze has joined #tripleo17:51
SpamapSNg: how is it dying?17:51
*** rongze has quit IRC17:52
*** rongze has joined #tripleo17:52
SpamapSslagle: can you raise a bug about the pip installs? I'm sure it is fixable.17:52
*** rongze has quit IRC17:53
*** rongze has joined #tripleo17:53
*** derekh has quit IRC17:53
*** rongze has quit IRC17:54
*** rongze has joined #tripleo17:54
*** rongze has quit IRC17:54
*** rongze has joined #tripleo17:55
*** rongze has quit IRC17:55
slagleSpamapS: yea, i will. if i can't figure it out shortly :)17:55
*** rongze has joined #tripleo17:56
slaglei'm still looking at it17:56
*** rongze has quit IRC17:56
*** rongze has joined #tripleo17:56
*** rongze has quit IRC17:57
*** rongze has joined #tripleo17:57
*** rongze has quit IRC17:58
NgSpamapS: so the first error is that netaddr won't install because pip can't satisfy the dependencies, even though it should be able to17:58
*** rongze has joined #tripleo17:58
*** rongze has quit IRC17:58
Ngjprovazn filed a bug about that and listed a workaround that makes it use http to install that package, and that "works"17:59
*** rongze has joined #tripleo17:59
Ngbut then we've been hitting errors installing python-*client with things like warlock/cliff being installed as dependencies, using easy_install, but they seem to be too new to be compatible with easy_install17:59
*** rongze has quit IRC17:59
Ngso I've worked around those by just manually installing them with pip before the *client packages get pip installed18:00
Ngmost recent run died with an https timeout to pypi ;)18:00
NgSpamapS: I'm sort of tempted to ask you if you fancy having a go at a full run, but I know you're super busy on the persistent stuff18:00
*** rongze has joined #tripleo18:01
*** rongze has quit IRC18:01
*** rongze has joined #tripleo18:02
*** rongze has quit IRC18:02
*** rongze_ has joined #tripleo18:05
*** rongze_ has quit IRC18:05
*** rongze has joined #tripleo18:05
*** rongze has quit IRC18:06
*** rongze has joined #tripleo18:06
*** rongze has quit IRC18:06
*** rongze has joined #tripleo18:09
*** rongze_ has joined #tripleo18:10
*** rongze_ has quit IRC18:10
*** lsmola_ has quit IRC18:11
Ngrongze: your IRC connection is not very stable :)18:11
*** rongze_ has joined #tripleo18:11
*** rongze_ has quit IRC18:11
*** marun has joined #tripleo18:13
*** rongze has quit IRC18:14
*** rongze has joined #tripleo18:14
*** gothicmindfood has joined #tripleo18:16
*** gothicmindfood has left #tripleo18:16
Ng(bug #1265807 is the bug that jan found)18:18
*** rongze has quit IRC18:19
openstackgerritRyan Brady proposed a change to openstack/tripleo-heat-templates: made copy of old file to diff from, added new target to makefile for including an additional cinder block storage node on the overcloud  https://review.openstack.org/6512418:20
openstackgerritRyan Brady proposed a change to openstack/tripleo-heat-templates: removed block-storage elements out of overcloud-source, added make target to build an overcloud heat template that includes block storage, and modified blcok-storage template to include minimum necessary parameters and resources needed.  https://review.openstack.org/6512518:20
openstackgerritRyan Brady proposed a change to openstack/tripleo-heat-templates: Add metadata to add cinder storage node to overcloud  https://review.openstack.org/6512618:20
SpamapSNg: so basically sounds like pip 1.5 is just screwing us over even worse than the gate.18:31
*** newell has joined #tripleo18:31
*** athomas has quit IRC18:42
*** rongze has joined #tripleo18:45
*** rushiagr has quit IRC18:45
*** rongze has quit IRC18:45
SpamapSI feel like pip using https is a bazillion times more complex than pip using gpg signed tarballs would have been18:45
*** rongze has joined #tripleo18:46
*** rongze has quit IRC18:46
*** rongze has joined #tripleo18:47
*** rongze has quit IRC18:47
*** rongze has joined #tripleo18:47
*** rongze has quit IRC18:48
*** rongze has joined #tripleo18:48
*** rcarrillocruz has joined #tripleo18:49
*** rongze has quit IRC18:49
*** rongze has joined #tripleo18:49
*** rongze has quit IRC18:50
*** rongze has joined #tripleo18:50
*** rongze has quit IRC18:51
*** rongze_ has joined #tripleo18:51
*** rongze_ has quit IRC18:52
*** rongze has joined #tripleo18:52
*** bcrochet has joined #tripleo18:52
*** rongze has quit IRC18:52
*** rongze has joined #tripleo18:53
*** rongze has quit IRC18:53
*** rongze has joined #tripleo18:54
*** rongze has quit IRC18:54
*** rongze has joined #tripleo18:55
SpamapSNg: try building with pypi-openstack18:55
SpamapSNg: that may solve the whole thing.18:55
SpamapSNg: since that eliminates the need for the exceptions on netaddr and netifaces (which.. wtf.. why aren't those secure? DOH)18:56
*** rongze has quit IRC18:56
*** rongze has joined #tripleo18:56
*** rongze has quit IRC18:57
*** rongze has joined #tripleo18:57
*** rongze has quit IRC18:57
*** rongze has joined #tripleo18:58
*** rongze has quit IRC18:58
*** rongze has joined #tripleo18:59
*** rongze has quit IRC18:59
*** rongze has joined #tripleo19:00
*** rongze has quit IRC19:00
*** rongze has joined #tripleo19:00
*** rongze has quit IRC19:01
*** rongze has joined #tripleo19:01
*** rongze has quit IRC19:02
*** rongze has joined #tripleo19:02
*** rongze has quit IRC19:03
*** rongze has joined #tripleo19:03
*** rongze has quit IRC19:04
*** rongze has joined #tripleo19:04
*** rongze has quit IRC19:05
*** rongze has joined #tripleo19:06
*** rongze has quit IRC19:06
*** rongze has joined #tripleo19:07
*** rongze has quit IRC19:07
*** rongze has joined #tripleo19:08
*** rongze has quit IRC19:08
*** rongze has joined #tripleo19:09
*** panda has quit IRC19:09
*** rongze has quit IRC19:09
*** rongze has joined #tripleo19:10
*** rongze has quit IRC19:10
*** rongze has joined #tripleo19:11
*** rongze has quit IRC19:11
*** rongze has joined #tripleo19:11
*** rongze has quit IRC19:12
*** rongze has joined #tripleo19:12
*** rongze has quit IRC19:13
*** rongze has joined #tripleo19:13
*** rongze has quit IRC19:14
*** rongze has joined #tripleo19:17
*** rongze has quit IRC19:17
*** rongze has joined #tripleo19:18
*** rongze has quit IRC19:18
*** rongze has joined #tripleo19:18
*** rongze has quit IRC19:18
*** rongze has joined #tripleo19:20
*** rongze has quit IRC19:20
*** rongze_ has joined #tripleo19:23
*** rongze_ has quit IRC19:23
*** panda has joined #tripleo19:23
*** rongze_ has joined #tripleo19:25
*** rongze_ has quit IRC19:25
SpamapSWriting /tmp/easy_install-5lqzPc/warlock-1.1.0/setup.cfg19:25
SpamapSRunning warlock-1.1.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-5lqzPc/warlock-1.1.0/egg-dist-tmp-bzXq7119:25
SpamapS/usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'install_requires' warnings.warn(msg)19:25
*** rongze has joined #tripleo19:26
*** rongze has quit IRC19:26
*** rongze has joined #tripleo19:27
*** rongze has quit IRC19:27
*** rongze has joined #tripleo19:27
*** rongze has quit IRC19:28
*** rongze has joined #tripleo19:28
*** rongze has quit IRC19:28
*** rongze has joined #tripleo19:29
*** rongze has quit IRC19:30
*** rongze_ has joined #tripleo19:31
*** rongze_ has quit IRC19:31
*** rongze has joined #tripleo19:33
*** rongze has quit IRC19:33
*** rongze_ has joined #tripleo19:34
*** sballe has joined #tripleo19:35
*** rongze_ has quit IRC19:35
*** panda___ has joined #tripleo19:35
*** rongze_ has joined #tripleo19:35
*** rongze_ has quit IRC19:35
*** panda has quit IRC19:37
*** rongze has joined #tripleo19:38
*** rongze has quit IRC19:39
*** rongze has joined #tripleo19:39
*** rongze has quit IRC19:39
*** rongze has joined #tripleo19:40
*** rongze has quit IRC19:40
*** rongze has joined #tripleo19:40
*** rongze has quit IRC19:41
*** rongze has joined #tripleo19:41
*** rongze has quit IRC19:41
*** rongze has joined #tripleo19:42
*** rongze has quit IRC19:42
*** rongze has joined #tripleo19:42
*** rongze has quit IRC19:42
*** rongze has joined #tripleo19:45
*** rongze has quit IRC19:46
*** rongze has joined #tripleo19:46
*** rongze has quit IRC19:46
*** rongze has joined #tripleo19:48
*** rongze has quit IRC19:48
*** rongze has joined #tripleo19:49
*** rongze has quit IRC19:50
*** rongze_ has joined #tripleo19:52
*** rongze_ has quit IRC19:52
*** rongze has joined #tripleo19:53
*** rongze has quit IRC19:53
*** fungi has joined #tripleo19:53
*** ChanServ sets mode: +v fungi19:53
*** rongze has joined #tripleo19:53
*** rongze has quit IRC19:53
*** ChanServ sets mode: +o fungi19:53
*** rongze has joined #tripleo19:54
*** fungi sets mode: +b *!~rongze@*19:54
*** rongze has quit IRC19:54
SpamapSfungi: thanks19:54
*** fungi sets mode: -o fungi19:54
fungiyw19:54
*** ifarkas has quit IRC19:55
*** lucasagomes has quit IRC19:55
*** rcarrillocruz has quit IRC19:59
*** julim has quit IRC20:00
*** SpamapS changes topic to "FIREDRILL: seed builds failing on bug#1255128 | tripleo-cd running preserve-ephemeral WIP patches | Using OpenStack to deploy OpenStack;meetings Tuesday 1900 UTC in #openstack-meeting-alt"20:00
SpamapSNg: ^^ confirmed bug 1255128 hit locally20:00
*** julim has joined #tripleo20:02
*** amrit has joined #tripleo20:02
*** amrit has quit IRC20:02
openstackgerritBen Nemec proposed a change to openstack/tripleo-incubator: Add pypi-openstack and pip-cache to common elements  https://review.openstack.org/6514120:03
*** amrit has joined #tripleo20:03
SpamapSwaaaait20:05
SpamapSwhy are we doing this20:05
SpamapS    python setup.py develop --script-dir /usr/local/bin20:05
SpamapSthat makes.. _zero_ sense.20:05
* SpamapS tries with pip install .20:14
*** panda___ has quit IRC20:15
*** amrit has quit IRC20:18
openstackgerritRyan Brady proposed a change to openstack/tripleo-heat-templates: Add optional cinder storage node to overcloud  https://review.openstack.org/6273520:22
*** panda___ has joined #tripleo20:29
*** jpeeler1 has quit IRC20:29
*** AaronGr is now known as AaronGr_Lunch20:30
*** epim has joined #tripleo20:31
*** panda has joined #tripleo20:32
*** panda___ has quit IRC20:36
*** panda___ has joined #tripleo20:39
*** panda has quit IRC20:42
SpamapSmmmm my squid.conf is so damn modern20:43
SpamapSrefresh_pattern ^gopher:    1440    0%  144020:43
*** AaronGr_Lunch is now known as AaronGr_Zzz20:46
*** martyntaylor has quit IRC20:48
SpamapS1389040984.676 102678 192.168.122.1 TCP_MISS/200 25813426 GET http://archive.ubuntu.com/ubuntu/pool/main/l/linux-firmware/linux-firmware_1.116_all.deb - HIER_DIRECT/91.189.91.13 application/x-debian-package20:49
SpamapS1389041131.382 146706 192.168.122.1 TCP_MISS/200 33640568 GET http://archive.ubuntu.com/ubuntu/pool/main/l/linux/linux-image-extra-3.11.0-15-generic_3.11.0-15.23_i386.deb - HIER_DIRECT/91.189.91.13 application/x-debian-package20:49
SpamapSWhy oh why won't it cache those two?20:49
SpamapSah maximum_object_size specified too low doh20:53
NgSpamapS: oh interesting, I'd not spotted pypi-openstack. I left a seed build with pip-cache running in a loop overnight, so if that hasn't managed to fetch everything we need, I'll chuck pypi-openstack in20:54
SpamapSNg: thats working for me20:56
SpamapSNg: now failing because of the call to setup.py develop in openstack-clients20:56
SpamapSnot sure why we did that insetad of install20:56
SpamapSalso yay I think I just finally cached linux-firmware20:56
*** jpeeler has joined #tripleo20:59
*** jpeeler has joined #tripleo20:59
matty_dubsSpamapS: Have you seen http_replicator? I haven't actually worked with it, but I brushed up against talk about it the other day. It seems like it's meant to be like squid, but specifically for longer-term mirroring of content.21:01
matty_dubsSo I'm in no way recommending it, just curious ;)21:02
SpamapSmatty_dubs: sounds like approx but maybe less apt-centric21:02
SpamapSmatty_dubs: squid has been doing a great job.... I just configured it wrong entirely :)21:02
matty_dubsHeh, the 'configure it wrong entirely' bit is exactly my experience trying to set up a local proxy for yum, too ;)21:03
SpamapSmatty_dubs: seems like with the fedora mirros doing client-side load balancing that one needs a smarter yum cacher anyway21:04
matty_dubsWell the situation is more bizarre. You can pick a mirror or use a name that's supposed to direct you based on network proximity or something of the sort, but I ended up with a mirror giving me 50kb/sec a while back, which is precisely what led to me setting up a proxy ;)21:05
SpamapSyeah21:05
SpamapSUbuntu just comes out of a giant flame-thrower-like pipe in London that is usually able to keep my 50Mbit downstream at least a bit happy.21:06
Ngthere are several pipes and they are fairly chunky21:06
Ngusually at least two 10Gb circuits running, with 2-3 times that for release periods21:07
SpamapSyeah one of them sucks though21:07
SpamapSand when routes from London <-> Los Angeles get bad21:07
SpamapSarchive.ubuntu.com becomes 50kB or less21:07
SpamapScrap still don't seem to be caching those.. argh21:07
SpamapSmatty_dubs: ok your tool has made my "next time I'm angry" list :)21:07
matty_dubsHaha, I'm yet to set it up myself, but I might do that on one of my home machines soon.21:08
SpamapSwe've threatened for a while to just have an on-demand-mirror-generator for TripleO kind of like the openstack pypi mirror21:08
matty_dubsI found squid's config really bewildering, and wished it could do a conditional get for all content even if it had an expired TTL21:09
slaglematty_dubs: some fedora mirrors seem to aggressively throttle as well21:09
matty_dubsIt's really remarkable how such a basic problem doesn't have seem to have a fantastic solution, at least not cross-distro21:09
SpamapSmatty_dubs: that is "refresh_all_ims on"21:10
matty_dubsSpamapS: Ooh, nice!21:10
SpamapSmatty_dubs: which I have on, because otherwise, yeah.. it gets confusing21:10
SpamapSoooo I may have a working patch21:11
SpamapShm... maybe not21:12
SpamapSshebang is /usr/bin/python instead of the virtualenv21:12
matty_dubsslagle: Ignoring the myriad reasons it would never fly, I think it would be slick if systems could distribute updates over BitTorrent, versus a handful of sometimes-broken mirrors.21:12
SpamapSmatty_dubs: interestingly enough, bittorrent came from an idea to distribute games that way..21:14
SpamapSah shebang works because pip installed into system .. hrm21:16
matty_dubsAnd with Linux, you figure that a lot of the machines are always-on servers on huge pipes.21:16
SpamapSmatty_dubs: so tripleO is going to eventually leverage some scatter-gather for image based software updates.21:16
SpamapSbut that will be for a single datacenter21:17
matty_dubsWithin the DC?21:19
SpamapSoh hmm..21:19
SpamapSnova change may have made nova-manage install now..21:19
SpamapSmatty_dubs: right21:19
lifelessmorning21:20
*** AaronGr_Zzz is now known as AaronGr21:25
*** jcoufal has quit IRC21:26
*** Guest796 is now known as jeblair21:29
*** jeblair is now known as Guest4513221:30
*** vipul is now known as vipul-away21:31
*** vipul-away is now known as vipul21:31
*** Guest45132 is now known as corvus21:32
*** dprince has quit IRC21:36
*** ubuntu1 is now known as anteaya21:41
SpamapSweird21:42
SpamapSeverything in the seed ended up installed into /usr/local/bin21:43
SpamapSinstead of the per-project venvs21:43
* SpamapS debugs21:43
*** jdob has quit IRC21:45
*** CaptTofu has quit IRC21:48
*** CaptTofu has joined #tripleo21:49
*** CaptTofu has quit IRC21:51
*** CaptTofu has joined #tripleo21:51
*** matty_dubs is now known as matty_dubs|gone22:04
*** rlandy has quit IRC22:09
*** lblanchard has quit IRC22:11
SpamapSugh22:16
SpamapS    virtualenv --system-site-packages /opt/stack/venvs/$repo22:16
* SpamapS wonders how much of a problem that is22:16
SpamapStrying to figure out why openstack-clients does things entirely different from os-svc-install22:17
lifelessSpamapS: future refactoring in part22:17
lifelessSpamapS: also clients don't need either mysql nor libvirt which were the system packaes we needed22:18
SpamapSwell it isn't completely different22:18
*** asalkeld_ has left #tripleo22:18
SpamapSbut something really wonky is going on22:18
SpamapSlifeless: oh and hi :)22:18
SpamapSIs this just maybe a pip 1.5 problem too?22:19
SpamapSI see all of the scripts going into /usr/local/bin instead of the activated virtualenv22:20
lifelessSpamapS: ugh22:20
SpamapSroot@ubuntu:~# source /opt/stack/venvs/nova/bin/activate22:22
SpamapS(nova)root@ubuntu:~# which pip22:22
SpamapS/usr/bin/pip22:22
SpamapSwell there's yer problem22:22
SpamapSno pip in the virtualenv22:22
SpamapSPerhaps because of --system-site-packages ?22:23
SpamapSwhich we use for nova because of libvirt22:23
SpamapSok yeah the ones that don't have --system-site-packages worked fine22:25
lifelessadd a test after we make a venv that it  has pip in it?22:25
SpamapSlifeless: we definitely don't have pip in --system-site-packages venvs .. seems like maybe new virtualenv is broken22:27
lifelessSpamapS: quite possibly; just saying perhaps we should add a check to the tree as the first thing, to cause errors ;)22:30
Nghey lifeless22:35
*** SpamapS changes topic to "FIREDRILL: seed builds failing on bug#1266513 | tripleo-cd running preserve-ephemeral WIP patches | Using OpenStack to deploy OpenStack;meetings Tuesday 1900 UTC in #openstack-meeting-alt"22:37
SpamapSOk so the pip bug exposes the other bug which only shows up because of system setuptools suckage22:37
lifelessNg: Hey ng22:37
SpamapSrather the virtualenv pip bug exposes.. bah22:37
lifelessNg: right beoffore the holiday shutdown you were speculating about what you should be focusing on22:38
* SpamapS waits patiently for build with virtualenv pinned to 1.10.1 to run22:38
lifelessNg: did you figure out an answer?22:38
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Pin virtualenv to 1.10.1 to work around pip bug  https://review.openstack.org/6516622:38
SpamapSuntested22:38
Nglifeless: well today and tomorrow I'm in Galway helping some folk bring up tripleo. After that I should help out getting the persistent business moved along22:39
lifelesssounds cool to me22:40
Ngtoday was pretty unproductive though22:40
lifelessbecause Galway?22:40
Nglifeless: no, because of multiple different failures/bugs trying to even build a seed image22:40
lifelessNg: ah, the stuff client is hammering on now?22:41
lifelesss/client/clint22:41
Nglifeless: also bug 1255128 and lots of pypi hell22:41
Ngwe figured out some dumb workarounds for those bugs, then either an hp corp proxy or pypi were giving us timeouts22:42
lifelessyay22:42
Ngone thing this trip has been super useful for, for me, is showing how impossibly crazymaking our bringup is for folk who can't just run devtest and hope for the best22:42
*** julim has quit IRC22:43
Ngand even if they can just do devtest, it's still likely to explode ;)22:43
lifelessthats why I've been pushing the toci stuff to be devtest, not a reimpl of22:43
lifelessso we have a common flexible automation that is also documented in detail22:43
SpamapSI thought devtest is "developer tool" and toci is "automated test tool" ?22:44
lifelessok brekkie time22:44
SpamapS(note that I wish they were the same)22:44
lifelessSpamapS: toci /today/ as stuff it shouldn't in it. Conceptually toci is the CI glue we need22:44
lifelessSpamapS: devstacke vs devstacke-gate22:44
* SpamapS adds Perth to dash clock22:45
Nglifeless: I've said something similar before, but I'm more convinced than ever that we have the structure of the devtest scripts all wrong22:46
*** akrivoka has quit IRC22:46
SpamapSNg: oh?22:47
Ngimo we should frontload all of the static environment, then have separate pieces for building and launching each stage22:47
Ngboot-seed-vm is the wrongest of the wrong, imo22:48
SpamapSNg: isn't that what pleia2 was working on? Running with existing images?22:48
Ngif you just want to build a seed image, stripping out the relevant bits from devtest.sh, devtest_seed.sh and boot-seed-vm is a ton of faff22:48
SpamapSOh I see what you're saying22:48
SpamapSbuild ... deploy .. test ... rather than "seed" "under" "over" for structure?22:49
slaglesounds like some of my motiviation for having the prebuilt vm images22:50
NgSpamapS: so atm I'm thinking that devtest.sh would do, roughly: 1) source scripts/setup-environment-variables, 2) run scripts/prepare-build-environment, 3) run scripts/build-seed-image, 4) run scripts/launch-seed-image and then repeat steps 3 and 4 for undercloud/overcloud22:50
slagleif you just want to do a deployment, getting hung up on building images can really sidetrack you22:50
Ngso if you want to just build one part, you just need to source variables, idempotently prepare your build env and run a build-blah-image script22:51
NgConnectionError: HTTPConnectionPool(host='pypi.openstack.org', port=80): Max retries exceeded with url: /openstack/repoze.lru/ (Caused by <class 'httplib.BadStatusLine'>: '')22:53
Nga horse, a horse, my kingdom for a horse22:53
SpamapShrm... my version pin did not work22:56
NgI was trying a run for giggles without the --system-site-packages, but it blew up because pypi is suck22:56
Ngbut this is part of the deep conern I have from today's work. Our users are going to hate us if builds are randomly flaky because pypi changes all the tiem22:57
NgI vaguely hope that unicorns will save us with global openstack requirements.txt with super-specific version numbers, but.... unicorns22:57
slaglei agree with the flaky builds.  that's why i proposed offering known good images for download22:59
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Pin virtualenv to 1.10.1 to work around pip bug  https://review.openstack.org/6516622:59
slagleplus, building can be expensive22:59
SpamapSbrain fart22:59
slagleseems strange to have to reproduce that on every workstation22:59
SpamapSNg: the --system-site-packages is not the problem. 1.11 is broken22:59
Ngslagle: I don't necessarily disagree with providing images, but it does have the problem that if people need to even vary one detail of the build, they are back to being on their own22:59
NgSpamapS: fair enough, I'll snag your fix and give it a run23:00
SpamapShttps://github.com/pypa/virtualenv/commit/a6ca6f423:00
SpamapSsounds like release is pending23:00
SpamapShttps://github.com/pypa/virtualenv/issues/52123:00
SpamapShttps://github.com/pypa/virtualenv/issues/52123:00
SpamapSdoh23:01
slagleNg: true, but almost all of what might need to be changed ought to be configurable23:01
slagleoh, unless you mean using a different version of component, say nova.23:01
SpamapSlifeless: hey, squid man. Why am I not caching linux-firmware packages in my squid? http://paste.openstack.org/show/6051723:02
Ngslagle: or even just needing to add some element for a network driver23:02
SpamapSthey're 25MB23:02
SpamapSwell below (I think) my maximum_object_size of 10485760023:03
Ngslagle: I'm thinking more about the people who have a few real servers in a lab and want to spin up their first tripleo23:03
SpamapS1389049351.780 135821 192.168.122.1 TCP_MISS/200 25813426 GET http://archive.ubuntu.com/ubuntu/pool/main/l/linux-firmware/linux-firmware_1.116_all.deb - HIER_DIRECT/91.189.91.15 application/x-debian-package23:03
Ngslagle: (since that's what I'm trying to shepherd on this trip ;)23:03
slagleNg: yea, true. i'm thinking mostly from the developer standpoint of just getting something stood up23:04
*** ccrouch1 has quit IRC23:04
Ngslagle: right, that is definitely a valuable use case too23:04
*** marios has quit IRC23:08
*** UtahDave has quit IRC23:11
*** CaptTofu has quit IRC23:13
*** CaptTofu has joined #tripleo23:13
*** UtahDave has joined #tripleo23:13
NgSpamapS: you win some unicorn shavings, seed image just built23:17
SpamapSNg: yaaaaaaaaay23:18
SpamapSNg: thanks, I've been sitting here waiting for linux-firmware to download over and over23:19
SpamapSstill fan't figure out how to make squid cache it23:19
SpamapShave raised maximum_object_size to 1G now :-P23:19
Ngouch23:19
*** ccrouch has joined #tripleo23:20
SpamapSbut looks like my seed just built and didn't screw up the virtualenv pip too :)23:20
Ngwoot, undercloud image built too23:31
*** rwsu has quit IRC23:35
SpamapSwell thanks virtualenv 1.10 for wasting a whole day :-P23:39
SpamapSerr23:39
SpamapS1.1123:39
SpamapSthanks 1.10 for making it _ONLY_ one day23:39
NgSpamapS: did you hack in Jan's --fuck-security patch into os-svc-install to get your builds going?23:40
Ngafaict that bug is universally reproducible atm, in that I have seen it on three different systems/networks today23:40
SpamapSNg: no what's that?23:42
NgSpamapS: https://bugs.launchpad.net/tripleo/+bug/126580723:42
Ng"  Some externally hosted files were ignored (use --allow-external to allow).23:43
Ng"23:43
SpamapSOh that is bug 126651323:43
NgI dislike errors like that. Tell me which urls!23:43
SpamapShm uvirtbot is MIA23:43
SpamapSNg: that bug is mitigated by using pypi-openstack23:44
SpamapSNg: because pypi-openstack has netaddr23:44
Nghmm23:45
NgI am using both, but I didn't specifically test pypi-openstack without the --lol-https patch, so I'll do a run tomorrow without that23:45
SpamapSyeah shouldn't you be sleeping?23:45
SpamapSor drinking?23:46
Ng(and yes, I wish this was all http+gpg, it would also make proxy traversal *so* much easier)23:46
SpamapSor both?23:46
SpamapSNg: even if they had just made the central pypi upload mirror auto-sign... better than https. :-P23:46
NgSpamapS: the drinking is done, I should indeed sleep, but I want to see if I can shepherd this devtest run through on my home workstation, so tomorrow I can at least show the guys here a working system, even if we fail to bring their hardware up23:46
NgSpamapS: indeed23:46
*** vipul is now known as vipul-away23:47
*** rwsu has joined #tripleo23:50
*** vipul-away is now known as vipul23:50

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!