| *** sdake has quit IRC | 00:00 | |
| *** wolverineav has quit IRC | 00:00 | |
| jeblair | pabelanger: https://review.openstack.org/378985 this? | 00:00 |
|---|---|---|
| *** rbrndt has quit IRC | 00:01 | |
| *** asettle has quit IRC | 00:01 | |
| clarkb | console log shows that sshd claims to have started | 00:01 |
| clarkb | [[0;32m OK [0m] Started OpenBSD Secure Shell server. | 00:02 |
| jeblair | clarkb: it won't try to read the keys till it gets a connection. so it can start with missing keys. | 00:02 |
| clarkb | ah | 00:02 |
| *** mmandel has quit IRC | 00:02 | |
| clarkb | jeblair: I am going to loopback mount the image on nodepool.o.o and see if anything obvious broken about ssh keys shows up in the image at rest | 00:02 |
| jeblair | ++ | 00:03 |
| jeblair | (though that may not tell us much if there's a problem in the boot-time generation) | 00:04 |
| clarkb | making a copy first so I don't inadverdently change the image and copying is slow :/ | 00:06 |
| clarkb | yay for large images | 00:06 |
| *** wolverineav has joined #openstack-infra | 00:06 | |
| greghaynes | clarkb: yes there was a pretty sizeable dib release | 00:06 |
| *** sdake has joined #openstack-infra | 00:06 | |
| clarkb | greghaynes: I think its broken ;) | 00:06 |
| clarkb | greghaynes: if its related to dhcp/glean chances are it can reproduce on a fiarly small simple image | 00:07 |
| clarkb | vm ubuntu simple-init devuser package_install_ssh_however_you_want_to_do_that | 00:07 |
| clarkb | jeblair: mounted at nodepool:/opt/test_images/osic-fail-boot/mnt if you want to look too | 00:08 |
| greghaynes | does it look like potentially hostkey issues again? | 00:08 |
| clarkb | greghaynes: there are hostkeys here | 00:09 |
| *** sdake_ has quit IRC | 00:09 | |
| clarkb | greghaynes: so maybe? | 00:09 |
| fungi | security is hard | 00:09 |
| clarkb | (they should be removed by dib if using simple-init iirc) | 00:09 |
| clarkb | oh wait | 00:09 |
| clarkb | sorry | 00:09 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Revise ACLs for networking-[onos|l2gw] projects https://review.openstack.org/399798 | 00:09 |
| clarkb | sshd no such file or directory | 00:09 |
| clarkb | thats the issue (I first cd'd into /etc/sshd which does exist on build host :) ) | 00:09 |
| fungi | huhwhatnow? | 00:10 |
| greghaynes | https://review.openstack.org/#/c/378985/ merged | 00:10 |
| clarkb | so ya I think dib is removing /etc/sshd and we lose | 00:10 |
| greghaynes | eek | 00:10 |
| greghaynes | that dir seem important | 00:10 |
| clarkb | now to see if thats lgged in the build log | 00:10 |
| fungi | rather than just removing the keys within it? | 00:10 |
| *** yee379 has quit IRC | 00:10 | |
| *** yee379 has joined #openstack-infra | 00:10 | |
| *** wolverineav has quit IRC | 00:11 | |
| clarkb | bah I suck at computers must be firday | 00:11 |
| clarkb | its /etc/ssh | 00:11 |
| clarkb | not /etc/sshd | 00:11 |
| fungi | phew | 00:11 |
| clarkb | and it looks ok | 00:12 |
| clarkb | no hostkeys there which should signal glean to make them | 00:12 |
| greghaynes | ok, so I bet its the patch I linked | 00:13 |
| fungi | so maybe greghaynes is on the money with 378985 | 00:13 |
| fungi | yeah, that | 00:13 |
| *** mmandel has joined #openstack-infra | 00:13 | |
| fungi | guess is ssh-keygen.service isn't working as designed | 00:13 |
| fungi | or something's wrong with the runtime-ssh-host-keys.sh script | 00:14 |
| fungi | looks like you could just run that one as root to test it | 00:14 |
| clarkb | ya I am not seeing such things logged in the consolel og | 00:14 |
| *** mmandel has quit IRC | 00:14 | |
| clarkb | (though maybe thats beacuse they write elsewhere) | 00:14 |
| *** rkukura has joined #openstack-infra | 00:15 | |
| fungi | clarkb: xenial image? | 00:15 |
| *** mmandel has joined #openstack-infra | 00:15 | |
| clarkb | fungi: yes | 00:15 |
| greghaynes | hrm, the unit file change seems pretty straightforward | 00:15 |
| clarkb | fungi: clarkb-test-1 is the instance in osic, and nodepool:/opt/test_images/osic-fail-boot/mnt is where image is moubted | 00:15 |
| *** yamamoto_ has quit IRC | 00:16 | |
| openstackgerrit | Louis Fourie proposed openstack-infra/project-config: Add periodic-networking-sfc-py35-with-neutron-lib-master job https://review.openstack.org/399800 | 00:16 |
| clarkb | keygen is installed on the image | 00:18 |
| cloudnull | clarkb: ohai | 00:18 |
| *** Goneri has quit IRC | 00:18 | |
| fungi | script seems to be in the right place, no obvious typos in paths or invalid assumptions about commands available | 00:18 |
| clarkb | cloudnull: hello, I think we narrwoed it down to broken image builds. Sorry for interrupting any friday evening partying | 00:18 |
| cloudnull | no-interuptions at all | 00:19 |
| cloudnull | if I can help let me know | 00:19 |
| clarkb | fungi: maybe its bailing early on not supporting one of the key formats? | 00:19 |
| clarkb | nodepool.o.o itself supports all of them according to the files written on it though | 00:19 |
| fungi | clarkb: try running that script as root while chrooted in /opt/test_images/osic-fail-boot/mnt | 00:20 |
| *** mmandel has quit IRC | 00:20 | |
| clarkb | fungi: after what happened last time we did that on nodepool.o.o I am scared :P | 00:20 |
| fungi | it only seems to do file operations and call ssh-keygen | 00:20 |
| fungi | oh, fair point | 00:20 |
| greghaynes | WCPGW | 00:20 |
| fungi | backup /etc/ssh on nodepool.o.o and leave a second session logged in just in case? | 00:21 |
| greghaynes | im going to start baking an image and boot it, could take a few though | 00:21 |
| fungi | clarkb: could also temporarily set a root pw and log in through rackspace's oob console | 00:22 |
| fungi | if extra worried | 00:22 |
| clarkb | fungi: or just wait for greghaynes to get an image ready. I hear he has super duper fast ssds | 00:23 |
| fungi | so be it | 00:23 |
| *** mmandel has joined #openstack-infra | 00:23 | |
| greghaynes | My old dev boxes are currently in the garage waiting to be re-plugged in :( | 00:24 |
| clarkb | I am going to run tests locally too | 00:24 |
| greghaynes | so its going to have to wait for the laptop | 00:24 |
| clarkb | greghaynes: fail | 00:24 |
| greghaynes | it is an ssd though | 00:24 |
| fungi | i'm going to go plug into a weekend. this pot has plenty of cooks already | 00:24 |
| greghaynes | enjoy! | 00:24 |
| fungi | thanks! | 00:24 |
| *** wolverineav has joined #openstack-infra | 00:26 | |
| clarkb | aha! | 00:28 |
| clarkb | greghaynes: it only generates the dsa key then exits 141 | 00:28 |
| clarkb | due to pipefail maybe? | 00:28 |
| clarkb | guessing keygen does that for some raisin | 00:29 |
| greghaynes | ah, fun | 00:29 |
| clarkb | so uh let me grab a beer and poke at this a bit more (but you do it too bceause as I already proved I ahve turned into a derp on friday evening) | 00:29 |
| greghaynes | yea, if you can run the actual keygen and see | 00:29 |
| cloudnull | beer does help with the derps | 00:30 |
| greghaynes | Yep, thats what happens when you get low on vitamin B | 00:30 |
| cloudnull | ^ truth | 00:30 |
| *** wolverineav has quit IRC | 00:31 | |
| clarkb | greghaynes: looks like its the yes returning non zero | 00:33 |
| clarkb | if I do the keygen alone its fine | 00:33 |
| *** spzala has joined #openstack-infra | 00:33 | |
| greghaynes | yep, it gets a sigpipe I think | 00:34 |
| clarkb | greghaynes: is the yes even necessary since we have the [ -f $FILE ] check before hand | 00:34 |
| clarkb | greghaynes: ya | 00:34 |
| *** sdake has quit IRC | 00:34 | |
| greghaynes | just made a little test script and get the same | 00:34 |
| clarkb | I think the yes n is there to say don't overwrite the file but we shouldn't even try to overwrite the file because its not there | 00:34 |
| * clarkb tests more | 00:34 | |
| clarkb | ya I thik thats the fix | 00:36 |
| greghaynes | clarkb: I think ssh-keygen will still expect input | 00:36 |
| greghaynes | so you have to send it something | 00:36 |
| clarkb | greghaynes: not with my testing | 00:36 |
| greghaynes | oh? | 00:36 |
| greghaynes | with mine it did.. | 00:36 |
| clarkb | it wants to know the file path, the passphrase, and the format all of which are set on command line in the script | 00:36 |
| greghaynes | OH, if the key is already there it will expect input | 00:36 |
| greghaynes | right | 00:36 |
| clarkb | ya | 00:36 |
| greghaynes | and I had just run mine | 00:36 |
| clarkb | let me push a patch | 00:37 |
| greghaynes | ++ | 00:37 |
| *** baoli has quit IRC | 00:38 | |
| *** spzala has quit IRC | 00:38 | |
| clarkb | oh wait I seem to recall that its that way because you can race on rhel | 00:39 |
| clarkb | ugh | 00:39 |
| greghaynes | huh? | 00:39 |
| clarkb | greghaynes: redhat distros do the right thing and generate ssh host keys on startup | 00:39 |
| clarkb | I want to say that the reason the yes si there is beacuse the two things can race each other? but maybe they can't | 00:40 |
| *** mmandel has quit IRC | 00:40 | |
| clarkb | let me see if we can just set that on the command line too | 00:40 |
| greghaynes | theres another fix if so - set +o pipefaul around that | 00:40 |
| *** mmandel has joined #openstack-infra | 00:40 | |
| greghaynes | I couldnt find an arg for it | 00:41 |
| greghaynes | (to turn of waiting on stdin) | 00:41 |
| clarkb | ya why don't we do that | 00:41 |
| *** wolverineav has joined #openstack-infra | 00:42 | |
| greghaynes | theres only that one pipe in the script so we can just remove the set pipefail at the top | 00:42 |
| openstackgerrit | Clark Boylan proposed openstack/diskimage-builder: Fix runtime ssh host keys script https://review.openstack.org/399805 | 00:43 |
| clarkb | yup | 00:43 |
| clarkb | and hopefully explained it in the commit message well enough | 00:43 |
| clarkb | I have not tested that in the context of a full boot | 00:43 |
| greghaynes | ianw: if youre around ^ | 00:43 |
| clarkb | only within context of throwaway VM and running that script manually | 00:44 |
| greghaynes | I made a little test script and confirmed thats a bug | 00:44 |
| *** adrian_otto has quit IRC | 00:45 | |
| *** mmandel has quit IRC | 00:45 | |
| *** rajinir has quit IRC | 00:46 | |
| *** wolverineav has quit IRC | 00:47 | |
| *** nherciu has quit IRC | 00:49 | |
| *** wolverineav has joined #openstack-infra | 00:54 | |
| *** baoli has joined #openstack-infra | 00:58 | |
| *** wolverineav has quit IRC | 00:58 | |
| *** jklare has quit IRC | 00:59 | |
| *** jklare has joined #openstack-infra | 01:00 | |
| *** dkehn has quit IRC | 01:02 | |
| *** dkehn has joined #openstack-infra | 01:02 | |
| *** Apoorva has quit IRC | 01:04 | |
| zaro | fungi: RE https://review.openstack.org/399795, it fails when run with older tox? | 01:09 |
| clarkb | greghaynes: ianw would be good if we can get reviews on that chagne and maybe a subsequent release | 01:09 |
| clarkb | (release on weekend is sort of meh so depends on if thats the only change that has merged since last releasea0 | 01:10 |
| *** knangia has joined #openstack-infra | 01:12 | |
| greghaynes | Yep, I may push it through if no one sees it by tomorrow | 01:12 |
| greghaynes | Then we can do a bigfix release | 01:12 |
| *** yamamoto has joined #openstack-infra | 01:16 | |
| *** masber has joined #openstack-infra | 01:22 | |
| *** yamamoto has quit IRC | 01:23 | |
| *** wolverineav has joined #openstack-infra | 01:23 | |
| *** spzala has joined #openstack-infra | 01:25 | |
| *** _ody has quit IRC | 01:28 | |
| *** wolverineav has quit IRC | 01:28 | |
| *** _ody has joined #openstack-infra | 01:31 | |
| *** wolverineav has joined #openstack-infra | 01:43 | |
| *** csomerville has quit IRC | 01:43 | |
| *** rkukura has quit IRC | 01:45 | |
| *** wolverineav has quit IRC | 01:48 | |
| *** cody-somerville has joined #openstack-infra | 01:52 | |
| *** cody-somerville has joined #openstack-infra | 01:52 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Update bouncy castle libs for Gerrit 2.13 https://review.openstack.org/399809 | 01:52 |
| *** wolverineav has joined #openstack-infra | 01:53 | |
| *** wolverineav has quit IRC | 01:58 | |
| *** spzala has quit IRC | 01:58 | |
| *** spzala has joined #openstack-infra | 01:59 | |
| *** wolverineav has joined #openstack-infra | 02:03 | |
| *** spzala has quit IRC | 02:03 | |
| *** EricGonczer_ has quit IRC | 02:03 | |
| *** armax has quit IRC | 02:06 | |
| *** wolverineav has quit IRC | 02:07 | |
| *** cody-somerville has quit IRC | 02:08 | |
| openstackgerrit | amrith proposed openstack-infra/project-config: Get rid of the trove-image-builder repository https://review.openstack.org/398689 | 02:11 |
| *** wolverineav has joined #openstack-infra | 02:13 | |
| *** jesusaur has quit IRC | 02:15 | |
| *** jesusaur has joined #openstack-infra | 02:16 | |
| *** wolverineav has quit IRC | 02:18 | |
| *** sree has joined #openstack-infra | 02:18 | |
| *** tqtran has quit IRC | 02:19 | |
| *** wolverineav has joined #openstack-infra | 02:23 | |
| *** sree has quit IRC | 02:23 | |
| *** wolverineav has quit IRC | 02:27 | |
| *** tiswanso has joined #openstack-infra | 02:27 | |
| *** mriedem has quit IRC | 02:29 | |
| *** wolverineav has joined #openstack-infra | 02:32 | |
| *** wolverineav has quit IRC | 02:37 | |
| *** waynr has joined #openstack-infra | 02:39 | |
| *** spzala has joined #openstack-infra | 02:39 | |
| *** Sukhdev has quit IRC | 02:40 | |
| *** wolverineav has joined #openstack-infra | 02:42 | |
| *** rhallisey has quit IRC | 02:42 | |
| *** wolverineav has quit IRC | 02:47 | |
| *** spzala has quit IRC | 02:49 | |
| *** spzala has joined #openstack-infra | 02:49 | |
| *** mmandel has joined #openstack-infra | 02:54 | |
| *** spzala has quit IRC | 02:54 | |
| *** wolverineav has joined #openstack-infra | 02:57 | |
| *** ijw has quit IRC | 02:58 | |
| *** mmandel has quit IRC | 02:58 | |
| *** thorst has joined #openstack-infra | 03:02 | |
| *** wolverineav has quit IRC | 03:02 | |
| *** jeckersb_gone is now known as jeckersb | 03:05 | |
| *** thorst has quit IRC | 03:06 | |
| *** thorst has joined #openstack-infra | 03:07 | |
| *** hurgleburgler has joined #openstack-infra | 03:11 | |
| *** newmember has quit IRC | 03:18 | |
| *** ijw has joined #openstack-infra | 03:18 | |
| *** esikachev has joined #openstack-infra | 03:20 | |
| *** knangia has quit IRC | 03:23 | |
| *** esikachev has quit IRC | 03:24 | |
| *** ijw has quit IRC | 03:25 | |
| *** thorst_ has joined #openstack-infra | 03:30 | |
| *** baoli has quit IRC | 03:32 | |
| *** thorst has quit IRC | 03:33 | |
| *** baoli has joined #openstack-infra | 03:33 | |
| *** vikrant has joined #openstack-infra | 03:34 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: Test timeout https://review.openstack.org/393415 | 03:36 |
| *** yamahata has quit IRC | 03:38 | |
| *** bhunter71 has quit IRC | 03:38 | |
| *** baoli has quit IRC | 03:39 | |
| Jeffrey4l | any guys can review this https://review.openstack.org/399694 ? | 03:42 |
| *** thorst_ has quit IRC | 03:43 | |
| *** thorst has joined #openstack-infra | 03:44 | |
| *** baoli has joined #openstack-infra | 03:46 | |
| *** thorst_ has joined #openstack-infra | 03:48 | |
| *** thorst has quit IRC | 03:48 | |
| *** ijw has joined #openstack-infra | 03:52 | |
| *** thorst_ has quit IRC | 03:53 | |
| *** jerryz has quit IRC | 03:54 | |
| *** ijw has quit IRC | 03:59 | |
| *** yamamoto has joined #openstack-infra | 03:59 | |
| *** yamamoto has quit IRC | 04:00 | |
| *** larainema has quit IRC | 04:05 | |
| *** armax has joined #openstack-infra | 04:05 | |
| *** armax has quit IRC | 04:07 | |
| *** psachin has joined #openstack-infra | 04:24 | |
| *** yamamoto has joined #openstack-infra | 04:27 | |
| *** sdake has joined #openstack-infra | 04:28 | |
| *** yamamoto has quit IRC | 04:33 | |
| *** psachin has quit IRC | 04:34 | |
| *** yamamoto has joined #openstack-infra | 04:36 | |
| *** yamamoto has quit IRC | 04:41 | |
| *** adrian_otto has joined #openstack-infra | 04:42 | |
| *** spzala has joined #openstack-infra | 04:50 | |
| *** thorst has joined #openstack-infra | 04:50 | |
| *** nicolasbock has quit IRC | 04:51 | |
| *** yamamoto has joined #openstack-infra | 04:51 | |
| *** sdake has quit IRC | 04:53 | |
| *** spzala has quit IRC | 04:55 | |
| *** yamamoto has quit IRC | 04:56 | |
| *** thorst has quit IRC | 04:58 | |
| *** mmandel has joined #openstack-infra | 04:59 | |
| *** mmandel has quit IRC | 05:03 | |
| *** yamamoto has joined #openstack-infra | 05:05 | |
| *** yamamoto has quit IRC | 05:05 | |
| *** _ari_ has quit IRC | 05:07 | |
| *** wolverineav has joined #openstack-infra | 05:09 | |
| *** aneliubin has joined #openstack-infra | 05:09 | |
| *** _ari_ has joined #openstack-infra | 05:12 | |
| *** wolverineav has quit IRC | 05:13 | |
| *** saibarspeis has quit IRC | 05:14 | |
| *** saibarspeis has joined #openstack-infra | 05:16 | |
| *** yamamoto has joined #openstack-infra | 05:17 | |
| *** baoli has quit IRC | 05:18 | |
| *** esikachev has joined #openstack-infra | 05:20 | |
| *** yamamoto has quit IRC | 05:22 | |
| *** esikachev has quit IRC | 05:25 | |
| *** wolverineav has joined #openstack-infra | 05:29 | |
| *** wolverineav has quit IRC | 05:33 | |
| *** saibarspeis has quit IRC | 05:34 | |
| *** tphummel has quit IRC | 05:37 | |
| *** _ody has quit IRC | 05:37 | |
| *** _ody has joined #openstack-infra | 05:38 | |
| *** ijw has joined #openstack-infra | 05:40 | |
| *** saibarspeis has joined #openstack-infra | 05:41 | |
| *** senk has joined #openstack-infra | 05:45 | |
| *** psachin has joined #openstack-infra | 05:46 | |
| *** ijw has quit IRC | 05:47 | |
| *** wolverineav has joined #openstack-infra | 05:48 | |
| *** rbuzatu_ has joined #openstack-infra | 05:52 | |
| *** wolverineav has quit IRC | 05:53 | |
| *** yamamoto has joined #openstack-infra | 05:54 | |
| *** yamamoto has quit IRC | 05:54 | |
| *** thorst has joined #openstack-infra | 05:56 | |
| *** wolverineav has joined #openstack-infra | 05:58 | |
| *** rbuzatu_ has quit IRC | 05:58 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Add puppet to setup known_hosts file https://review.openstack.org/399821 | 05:59 |
| *** wolverineav has quit IRC | 06:03 | |
| *** thorst has quit IRC | 06:03 | |
| *** wolverineav has joined #openstack-infra | 06:08 | |
| *** hurgleburgler has quit IRC | 06:09 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Setup known_hosts file on gerrit servers https://review.openstack.org/399822 | 06:09 |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Setup a known_hosts file https://review.openstack.org/399821 | 06:11 |
| *** rbuzatu has joined #openstack-infra | 06:11 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Setup a known_hosts file https://review.openstack.org/399821 | 06:11 |
| *** wolverineav has quit IRC | 06:13 | |
| *** wolverineav has joined #openstack-infra | 06:18 | |
| *** psachin has quit IRC | 06:18 | |
| *** baoli has joined #openstack-infra | 06:18 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Setup known_hosts file on gerrit servers https://review.openstack.org/399822 | 06:19 |
| *** wolverineav has quit IRC | 06:22 | |
| *** baoli has quit IRC | 06:23 | |
| *** adrian_otto has quit IRC | 06:25 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Add puppet manifest to setup known_hosts file https://review.openstack.org/399821 | 06:38 |
| *** esikachev has joined #openstack-infra | 06:39 | |
| *** yamamoto has joined #openstack-infra | 06:40 | |
| *** psachin has joined #openstack-infra | 06:44 | |
| *** yamamoto has quit IRC | 06:45 | |
| *** wolverineav has joined #openstack-infra | 06:47 | |
| *** newmember has joined #openstack-infra | 06:51 | |
| *** wolverineav has quit IRC | 06:52 | |
| *** senk has quit IRC | 06:53 | |
| *** senk has joined #openstack-infra | 06:54 | |
| *** senk has quit IRC | 06:54 | |
| *** Madasi has quit IRC | 06:58 | |
| *** Julien-zte has joined #openstack-infra | 07:00 | |
| *** thorst has joined #openstack-infra | 07:00 | |
| *** psachin has quit IRC | 07:02 | |
| *** Madasi has joined #openstack-infra | 07:03 | |
| *** wolverineav has joined #openstack-infra | 07:07 | |
| *** thorst has quit IRC | 07:08 | |
| *** saibarspeis has quit IRC | 07:09 | |
| *** tjones has quit IRC | 07:09 | |
| *** saibarspeis has joined #openstack-infra | 07:11 | |
| *** saibarspeis has quit IRC | 07:12 | |
| *** wolverineav has quit IRC | 07:12 | |
| *** wolverineav has joined #openstack-infra | 07:17 | |
| *** Julien-zte has quit IRC | 07:19 | |
| *** wolverineav has quit IRC | 07:22 | |
| *** saibarspeis has joined #openstack-infra | 07:24 | |
| *** ijw has joined #openstack-infra | 07:28 | |
| *** larainema has joined #openstack-infra | 07:33 | |
| *** Jeffrey4l has quit IRC | 07:33 | |
| *** esikachev has quit IRC | 07:34 | |
| *** rbuzatu has quit IRC | 07:34 | |
| *** rbuzatu has joined #openstack-infra | 07:34 | |
| *** ijw has quit IRC | 07:35 | |
| *** tlian has quit IRC | 07:44 | |
| *** yamamoto has joined #openstack-infra | 07:46 | |
| *** yamamoto has quit IRC | 07:47 | |
| *** yamamoto has joined #openstack-infra | 07:47 | |
| *** Julien-zte has joined #openstack-infra | 07:48 | |
| *** spzala has joined #openstack-infra | 07:50 | |
| *** spzala has quit IRC | 07:54 | |
| *** chandankumar has joined #openstack-infra | 07:54 | |
| *** Jeffrey4l has joined #openstack-infra | 07:57 | |
| *** yamamoto has quit IRC | 07:58 | |
| *** Jeffrey4l has quit IRC | 08:03 | |
| *** Jeffrey4l has joined #openstack-infra | 08:03 | |
| *** Jeffrey4l has quit IRC | 08:04 | |
| *** Jeffrey4l has joined #openstack-infra | 08:05 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/399838 | 08:05 |
| *** nherciu has joined #openstack-infra | 08:08 | |
| *** thorst has joined #openstack-infra | 08:08 | |
| *** flwang1 has quit IRC | 08:08 | |
| *** thorst has quit IRC | 08:13 | |
| *** baoli has joined #openstack-infra | 08:20 | |
| *** baoli has quit IRC | 08:25 | |
| *** nherciu has quit IRC | 08:28 | |
| *** nherciu has joined #openstack-infra | 08:31 | |
| *** sai has quit IRC | 08:38 | |
| *** jerryz has joined #openstack-infra | 08:41 | |
| *** yamamoto has joined #openstack-infra | 08:46 | |
| *** yamamoto has quit IRC | 08:51 | |
| *** huanxie has joined #openstack-infra | 08:51 | |
| *** zzzeek has quit IRC | 09:00 | |
| *** zzzeek has joined #openstack-infra | 09:00 | |
| *** jerryz has quit IRC | 09:00 | |
| *** yamamoto has joined #openstack-infra | 09:01 | |
| *** yamamoto has quit IRC | 09:06 | |
| *** jerryz has joined #openstack-infra | 09:07 | |
| *** thorst has joined #openstack-infra | 09:10 | |
| *** esikachev has joined #openstack-infra | 09:11 | |
| *** yamahata has joined #openstack-infra | 09:12 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/399838 | 09:14 |
| *** ijw has joined #openstack-infra | 09:16 | |
| *** yamamoto has joined #openstack-infra | 09:16 | |
| *** thorst has quit IRC | 09:18 | |
| *** saibarspeis has quit IRC | 09:18 | |
| *** yamamoto has quit IRC | 09:21 | |
| *** nherciu_ has joined #openstack-infra | 09:22 | |
| *** ijw has quit IRC | 09:23 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/tripleo-ci: Enable consuming packages for a feature branch https://review.openstack.org/399562 | 09:23 |
| *** nherciu has quit IRC | 09:23 | |
| *** wolverineav has joined #openstack-infra | 09:29 | |
| *** wolverineav has quit IRC | 09:29 | |
| *** wolverineav has joined #openstack-infra | 09:30 | |
| openstackgerrit | Merged openstack-infra/project-config: Add periodic-networking-sfc-py35-with-neutron-lib-master job https://review.openstack.org/399800 | 09:33 |
| openstackgerrit | Merged openstack-infra/project-config: Have run-tox-with-oslo-master not upgrade to many things https://review.openstack.org/399223 | 09:34 |
| openstackgerrit | Merged openstack-infra/project-config: [rally-jobs] turn off telemetry services by default https://review.openstack.org/399212 | 09:34 |
| *** yamamoto has joined #openstack-infra | 09:39 | |
| *** nherciu has joined #openstack-infra | 09:41 | |
| *** nherciu_ has quit IRC | 09:43 | |
| *** baoli has joined #openstack-infra | 09:53 | |
| *** Kevin_Zheng has quit IRC | 09:55 | |
| *** Kevin_Zheng has joined #openstack-infra | 09:56 | |
| *** baoli has quit IRC | 09:57 | |
| *** wolverineav has quit IRC | 10:00 | |
| *** mmandel has joined #openstack-infra | 10:00 | |
| *** mmandel has quit IRC | 10:04 | |
| *** Julien-zte has quit IRC | 10:06 | |
| *** wolverineav has joined #openstack-infra | 10:09 | |
| *** nherciu_ has joined #openstack-infra | 10:12 | |
| *** nherciu has quit IRC | 10:15 | |
| *** thorst has joined #openstack-infra | 10:15 | |
| *** tqtran has joined #openstack-infra | 10:19 | |
| *** wolverineav has quit IRC | 10:21 | |
| *** nherciu_ has quit IRC | 10:22 | |
| *** thorst has quit IRC | 10:23 | |
| *** tqtran has quit IRC | 10:23 | |
| onovy | hi, this change: https://review.openstack.org/#/c/399765/ didn't fix gate. http://logs.openstack.org/31/399531/1/gate/gate-swift-tox-xfs-tmp-py27-ubuntu-xenial/0efc1df/console.html /tmp/06-9dd3dda710d24211bd404fe9a714b35c.sh: line 3: exit: /usr/local/jenkins/slave_scripts/run-tox.sh: numeric argument required | 10:24 |
| onovy | notmyname: ^ | 10:24 |
| onovy | fungi: ^ | 10:25 |
| onovy | exit needs number as argument, not shell script :) | 10:25 |
| *** wolverineav has joined #openstack-infra | 10:28 | |
| *** senk has joined #openstack-infra | 10:31 | |
| *** wolverineav has quit IRC | 10:32 | |
| *** pilgrimstack has joined #openstack-infra | 10:37 | |
| *** jerryz has quit IRC | 10:40 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:40 | |
| *** esikachev has quit IRC | 10:43 | |
| *** ihrachys has joined #openstack-infra | 10:45 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: Test timeout https://review.openstack.org/393415 | 10:48 |
| *** ihrachys has quit IRC | 10:55 | |
| *** jerryz has joined #openstack-infra | 10:56 | |
| *** pilgrimstack has quit IRC | 10:57 | |
| *** wolverineav has joined #openstack-infra | 10:58 | |
| *** wolverineav has quit IRC | 11:00 | |
| *** wolverineav has joined #openstack-infra | 11:01 | |
| *** ihrachys has joined #openstack-infra | 11:03 | |
| *** ijw has joined #openstack-infra | 11:05 | |
| *** senk has quit IRC | 11:05 | |
| *** wolverineav has quit IRC | 11:05 | |
| *** pilgrimstack has joined #openstack-infra | 11:07 | |
| *** ijw has quit IRC | 11:11 | |
| *** baoli has joined #openstack-infra | 11:14 | |
| *** jerryz has quit IRC | 11:16 | |
| *** yamamoto has quit IRC | 11:17 | |
| *** baoli has quit IRC | 11:19 | |
| *** yamamoto has joined #openstack-infra | 11:19 | |
| *** thorst has joined #openstack-infra | 11:20 | |
| *** makowals has joined #openstack-infra | 11:21 | |
| *** wolverineav has joined #openstack-infra | 11:23 | |
| *** yamahata has quit IRC | 11:23 | |
| *** wolverineav has quit IRC | 11:27 | |
| *** thorst has quit IRC | 11:28 | |
| *** ihrachys has quit IRC | 11:35 | |
| *** jkilpatr has joined #openstack-infra | 11:36 | |
| *** jkilpatr has quit IRC | 11:38 | |
| *** jkilpatr has joined #openstack-infra | 11:42 | |
| AJaeger | onovy: can you send a patch? | 11:43 |
| *** psachin has joined #openstack-infra | 11:43 | |
| onovy | AJaeger: to be honest, i don't know what is happening here and what they want to change/fix | 11:44 |
| onovy | i just wanted to point out that fix doesn't fix it :] | 11:44 |
| AJaeger | then you've lost your chance that I can review and approve ;) I'll try fixing it myself ... | 11:45 |
| onovy | :) np, thanks | 11:45 |
| *** makowals has quit IRC | 11:46 | |
| *** jkilpatr has quit IRC | 11:47 | |
| *** ihrachys has joined #openstack-infra | 11:47 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix tox-with-tmpdir-passed-in https://review.openstack.org/399853 | 11:47 |
| AJaeger | onovy: proposed fix, reviews welcome ^ | 11:47 |
| *** flepied has quit IRC | 11:47 | |
| *** spzala has joined #openstack-infra | 11:51 | |
| *** rbuzatu_ has joined #openstack-infra | 11:52 | |
| *** rbuzatu_ has quit IRC | 11:52 | |
| *** rbuzatu_ has joined #openstack-infra | 11:53 | |
| onovy | AJaeger: what about set -e? | 11:54 |
| onovy | is't it simpler? | 11:54 |
| onovy | but nevermind, looks correct | 11:54 |
| *** rbuzatu has quit IRC | 11:55 | |
| *** spzala has quit IRC | 11:55 | |
| AJaeger | onovy: that was the alternative I had in mind ;) | 11:55 |
| AJaeger | fungi, could you review the above if you have some time today, please? ^ | 11:56 |
| onovy | thanks for fix, i will check gate after merge | 11:57 |
| *** rbuzatu_ has quit IRC | 11:57 | |
| openstackgerrit | Ezra Buehler proposed openstack-infra/git-review: Add support for download to custom branch https://review.openstack.org/399854 | 11:59 |
| *** tiswanso has quit IRC | 12:03 | |
| *** wolverineav has joined #openstack-infra | 12:03 | |
| *** psachin has quit IRC | 12:03 | |
| *** wolverineav has quit IRC | 12:07 | |
| *** psachin has joined #openstack-infra | 12:08 | |
| *** kzaitsev_mb has quit IRC | 12:09 | |
| *** wolverineav has joined #openstack-infra | 12:10 | |
| *** wolverineav has quit IRC | 12:14 | |
| *** psachin has quit IRC | 12:20 | |
| *** yamamoto has quit IRC | 12:21 | |
| *** wolverineav has joined #openstack-infra | 12:22 | |
| *** thorst has joined #openstack-infra | 12:25 | |
| *** wolverineav has quit IRC | 12:27 | |
| andreykurilin | hi folks! Does anyone know anything about such failure - http://logs.openstack.org/83/394583/18/check/gate-rally-dsvm-rally-cinder/dfa5bc1/logs/devstacklog.txt.gz#_2016-11-19_12_20_39_061 ? | 12:28 |
| *** rbuzatu has joined #openstack-infra | 12:30 | |
| *** vikrant has quit IRC | 12:31 | |
| *** jkilpatr has joined #openstack-infra | 12:32 | |
| *** thorst has quit IRC | 12:33 | |
| *** psachin has joined #openstack-infra | 12:33 | |
| *** ihrachys has quit IRC | 12:34 | |
| *** rbuzatu has quit IRC | 12:35 | |
| *** bhunter71 has joined #openstack-infra | 12:45 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: Test timeout https://review.openstack.org/393415 | 12:48 |
| *** yamamoto has joined #openstack-infra | 12:51 | |
| *** ijw has joined #openstack-infra | 12:53 | |
| *** yamamoto has quit IRC | 12:57 | |
| *** thorst has joined #openstack-infra | 12:59 | |
| *** sdake has joined #openstack-infra | 12:59 | |
| *** ijw has quit IRC | 12:59 | |
| *** tiswanso has joined #openstack-infra | 13:03 | |
| *** psachin has quit IRC | 13:04 | |
| *** tiswanso has quit IRC | 13:08 | |
| *** thorst has quit IRC | 13:09 | |
| *** thorst has joined #openstack-infra | 13:10 | |
| *** baoli has joined #openstack-infra | 13:15 | |
| *** sdake has quit IRC | 13:17 | |
| *** sdake has joined #openstack-infra | 13:17 | |
| *** thorst has quit IRC | 13:18 | |
| *** ihrachys has joined #openstack-infra | 13:19 | |
| *** baoli has quit IRC | 13:20 | |
| *** nicolasbock has joined #openstack-infra | 13:23 | |
| *** ihrachys has quit IRC | 13:29 | |
| *** rbuzatu has joined #openstack-infra | 13:32 | |
| *** ssbarnea has quit IRC | 13:36 | |
| *** sdake has quit IRC | 13:47 | |
| *** Jeffrey4l has quit IRC | 13:50 | |
| *** sdake has joined #openstack-infra | 13:51 | |
| *** jtomasek has quit IRC | 13:52 | |
| *** yamamoto has joined #openstack-infra | 13:56 | |
| *** jamesdenton has joined #openstack-infra | 13:56 | |
| fungi | zaro: 399795 shouldn't fail on older tox, no. i was originally wrong about which behavior change in 2.5.0 was biting us there | 14:00 |
| *** mmandel has joined #openstack-infra | 14:01 | |
| *** yamamoto has quit IRC | 14:01 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Fix tox-with-tmpdir-passed-in https://review.openstack.org/399853 | 14:04 |
| *** mmandel has quit IRC | 14:05 | |
| *** rbuzatu has quit IRC | 14:06 | |
| *** HeOS has quit IRC | 14:15 | |
| *** EricGonczer_ has joined #openstack-infra | 14:17 | |
| *** larainema has quit IRC | 14:17 | |
| *** esikachev has joined #openstack-infra | 14:18 | |
| *** larainema has joined #openstack-infra | 14:18 | |
| *** Kevin_Zheng has quit IRC | 14:18 | |
| dmsimard | Is the gate healthy right now? Looks like some jobs are queued for no good reason ? | 14:18 |
| *** Kevin_Zheng has joined #openstack-infra | 14:19 | |
| *** dave-mccowan has joined #openstack-infra | 14:20 | |
| dmsimard | Looks like "Error node launch attempts" is spiking | 14:21 |
| dmsimard | Affecting mostly xenial boxes? I don't know, just reading the graphs here. | 14:22 |
| *** annegentle has joined #openstack-infra | 14:22 | |
| fungi | dmsimard: there were problems identified last night with ssh host key generation after yesterday's dib release, but not sure if those broken images have been rolled back (or need to be rolled back again?) | 14:22 |
| fungi | clarkb and greghaynes were investigating when i went to bed | 14:23 |
| *** dave-mccowan has quit IRC | 14:23 | |
| *** tiswanso has joined #openstack-infra | 14:25 | |
| *** esikachev has quit IRC | 14:26 | |
| dmsimard | hmm, https://review.openstack.org/#/c/399805/ is -v though | 14:28 |
| dmsimard | not sure if it's a legit failure | 14:28 |
| dmsimard | maybe ianw can help if he's around ^ | 14:29 |
| *** annegentle has quit IRC | 14:31 | |
| *** tiswanso has quit IRC | 14:32 | |
| *** rtheis has joined #openstack-infra | 14:33 | |
| *** rtheis has quit IRC | 14:34 | |
| *** rtheis has joined #openstack-infra | 14:35 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix tox-with-tmpdir-passed-in https://review.openstack.org/399853 | 14:35 |
| *** rtheis has quit IRC | 14:35 | |
| *** wolverineav has joined #openstack-infra | 14:38 | |
| *** pradk has quit IRC | 14:40 | |
| *** ijw has joined #openstack-infra | 14:41 | |
| *** wolverineav has quit IRC | 14:43 | |
| *** Goneri has joined #openstack-infra | 14:44 | |
| *** pilgrimstack has quit IRC | 14:44 | |
| *** ijw has quit IRC | 14:47 | |
| *** spzala has joined #openstack-infra | 14:50 | |
| *** dave-mccowan has joined #openstack-infra | 14:54 | |
| *** spzala has quit IRC | 14:55 | |
| *** jamesdenton has quit IRC | 14:58 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/gerritlib: Specify testenv command for tox>=2.5 https://review.openstack.org/399795 | 14:59 |
| *** ijw has joined #openstack-infra | 14:59 | |
| *** sdake_ has joined #openstack-infra | 14:59 | |
| *** Jeffrey4l has joined #openstack-infra | 15:00 | |
| *** sdake has quit IRC | 15:02 | |
| *** rbuzatu has joined #openstack-infra | 15:03 | |
| *** ijw has quit IRC | 15:06 | |
| openstackgerrit | Ken Giusti proposed openstack-infra/project-config: Run tests for oslo.messaging AMQP 1.0 driver on ubuntu https://review.openstack.org/399863 | 15:10 |
| *** Jeffrey4l has quit IRC | 15:11 | |
| *** hurgleburgler has joined #openstack-infra | 15:11 | |
| *** Jeffrey4l has joined #openstack-infra | 15:12 | |
| *** baoli has joined #openstack-infra | 15:17 | |
| *** hashar has joined #openstack-infra | 15:19 | |
| *** baoli has quit IRC | 15:22 | |
| *** tjones has joined #openstack-infra | 15:23 | |
| *** baoli has joined #openstack-infra | 15:26 | |
| *** Jeffrey4l has quit IRC | 15:30 | |
| *** Jeffrey4l has joined #openstack-infra | 15:30 | |
| *** baoli has quit IRC | 15:31 | |
| *** fguillot has joined #openstack-infra | 15:31 | |
| *** Jeffrey4l has quit IRC | 15:31 | |
| *** baoli has joined #openstack-infra | 15:32 | |
| *** Jeffrey4l has joined #openstack-infra | 15:32 | |
| pabelanger | jeblair: clarkb: I'm going to look into why the nodepool-dsvm job didn't detect that as a breaking change | 15:33 |
| *** fguillot has quit IRC | 15:33 | |
| *** rbuzatu has quit IRC | 15:36 | |
| *** baoli has quit IRC | 15:37 | |
| fungi | pabelanger: i think it only manifested on xenial guests because of systemd...? no idea whether nodepool-dsvm is building and booting xenial guests | 15:37 |
| *** senk has joined #openstack-infra | 15:38 | |
| Jeffrey4l | fungi, please review this https://review.openstack.org/399694 thansk. | 15:41 |
| *** Qiming has quit IRC | 15:44 | |
| clarkb | nodepool-dsvm doesnt use simple init. maybe we should change that but also we dont gate dib on that job | 15:44 |
| clarkb | dmsimard: looks like dibs linting wants pipefail my need to toggle that off in this specific case | 15:45 |
| pabelanger | fungi: clarkb: right, maybe also add a ready-script too, to better flex ssh access | 15:49 |
| *** Qiming has joined #openstack-infra | 15:50 | |
| *** baoli has joined #openstack-infra | 15:51 | |
| *** Qiming has quit IRC | 15:55 | |
| *** senk has quit IRC | 15:55 | |
| clarkb | pabelanger: is the yes n actually required there? can just drop it if not since we have the test -f already | 15:56 |
| *** baoli has quit IRC | 15:56 | |
| *** Qiming has joined #openstack-infra | 15:56 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Build ubuntu-xenial image for devstack testing https://review.openstack.org/399865 | 16:01 |
| clarkb | and fwiw this affects all images not only xenial | 16:01 |
| pabelanger | clarkb: Ya, there is a race condition between the file check and when we run the command. Sadly, it is the only I could disable the overwrite prompt | 16:02 |
| clarkb | pabelanger: but what else is creaking those files. On ubuntu should be nothing. on rhel the sshd startup.does but this is forced to run before that on systemd hosts whoch rhel is now | 16:03 |
| *** Goneri has quit IRC | 16:04 | |
| pabelanger | clarkb: the issue was glean, it was creating the keys too. But, we since removed it from glean | 16:05 |
| pabelanger | so, we could revert that change | 16:05 |
| pabelanger | since we've haven't had a break with the original logic in months | 16:05 |
| pabelanger | the problem occurs if something else has created a key when we also run ssh-keygen, then there is a possible prompt we need to interact with | 16:06 |
| pabelanger | https://github.com/openstack-infra/glean/commit/2e6ba9f2aa16f580c5862f4aaa404d65ae28b1b9 | 16:06 |
| pabelanger | that removes it from glean | 16:06 |
| pabelanger | which was the problem code | 16:06 |
| *** rbuzatu has joined #openstack-infra | 16:10 | |
| *** wolverineav has joined #openstack-infra | 16:10 | |
| *** rbuzatu has joined #openstack-infra | 16:11 | |
| onovy | http://logs.openstack.org/33/399533/1/check/gate-swift-tox-xfs-tmp-py34-ubuntu-xenial/807736d/console.html ERROR: InterpreterNotFound: python3.4 | 16:11 |
| onovy | AJaeger: so only half-success :] | 16:11 |
| *** rbuzatu has quit IRC | 16:11 | |
| clarkb | ok so choices are remove yes or make pep8 job happy with no pipefail | 16:11 |
| clarkb | onovy: there is no python3.4 on xenial... | 16:11 |
| *** rbuzatu has joined #openstack-infra | 16:12 | |
| onovy | https://review.openstack.org/#/c/399533/ so why is swift running it? :] | 16:12 |
| *** rbuzatu has joined #openstack-infra | 16:12 | |
| pabelanger | clarkb: I think we should keep the yes, otherwise, there is a chance the init script will have to interact with the prompt. | 16:13 |
| *** rbuzatu has quit IRC | 16:13 | |
| pabelanger | have to run, family errands. Should be back in a few hours | 16:13 |
| *** rbuzatu has joined #openstack-infra | 16:13 | |
| *** saibarspeis has joined #openstack-infra | 16:14 | |
| *** makowals has joined #openstack-infra | 16:14 | |
| *** rbuzatu_ has joined #openstack-infra | 16:14 | |
| *** rbuzatu_ has quit IRC | 16:15 | |
| openstackgerrit | Ondřej Nový proposed openstack-infra/project-config: Python 3.4 is not in Ubuntu Xenial, use Python 3.5 https://review.openstack.org/399866 | 16:15 |
| onovy | ^ "maybe" this will fix | 16:15 |
| onovy | don't know how to test it | 16:15 |
| *** rbuzatu_ has joined #openstack-infra | 16:15 | |
| *** makowals has quit IRC | 16:15 | |
| *** dave-mccowan has quit IRC | 16:16 | |
| *** rbuzatu has quit IRC | 16:17 | |
| *** sdake_ has quit IRC | 16:18 | |
| *** ramishra has quit IRC | 16:19 | |
| clarkb | onovy: python35 tests should run on xenial and 3.4 on trusty | 16:20 |
| onovy | clarkb: yep: zuul/layout.yaml | 16:20 |
| *** rbuzatu__ has joined #openstack-infra | 16:20 | |
| onovy | sry: https://review.openstack.org/#/c/399866/ | 16:20 |
| *** ramishra has joined #openstack-infra | 16:21 | |
| *** tqtran has joined #openstack-infra | 16:21 | |
| *** rbuzatu_ has quit IRC | 16:22 | |
| *** wolverineav has quit IRC | 16:22 | |
| *** ihrachys has joined #openstack-infra | 16:23 | |
| *** hashar has quit IRC | 16:24 | |
| *** rbuzatu__ has quit IRC | 16:24 | |
| *** ihrachys has quit IRC | 16:24 | |
| *** rbuzatu has joined #openstack-infra | 16:25 | |
| *** ihrachys has joined #openstack-infra | 16:25 | |
| *** tqtran has quit IRC | 16:25 | |
| *** makowals has joined #openstack-infra | 16:26 | |
| *** spzala has joined #openstack-infra | 16:27 | |
| *** ihrachys has quit IRC | 16:29 | |
| *** ihrachys has joined #openstack-infra | 16:30 | |
| *** tiswanso has joined #openstack-infra | 16:30 | |
| *** rkukura has joined #openstack-infra | 16:32 | |
| *** makowals has quit IRC | 16:34 | |
| *** e0ne has joined #openstack-infra | 16:34 | |
| *** tiswanso has quit IRC | 16:34 | |
| *** rbuzatu_ has joined #openstack-infra | 16:35 | |
| *** makowals has joined #openstack-infra | 16:36 | |
| *** makowals has quit IRC | 16:36 | |
| *** rbuzatu has quit IRC | 16:38 | |
| *** saibarspeis has quit IRC | 16:39 | |
| *** rbuzatu_ has quit IRC | 16:39 | |
| *** rbuzatu has joined #openstack-infra | 16:41 | |
| *** wolverineav has joined #openstack-infra | 16:43 | |
| *** wolverin_ has joined #openstack-infra | 16:44 | |
| *** senk has joined #openstack-infra | 16:44 | |
| *** saibarspeis has joined #openstack-infra | 16:46 | |
| *** wolverineav has quit IRC | 16:48 | |
| *** drifterza has joined #openstack-infra | 16:48 | |
| openstackgerrit | Rob Cresswell proposed openstack-infra/project-config: Update Horizons selenium-headless test https://review.openstack.org/399868 | 16:53 |
| *** thorst has joined #openstack-infra | 16:59 | |
| *** adrian_otto has joined #openstack-infra | 16:59 | |
| *** pilgrimstack has joined #openstack-infra | 17:00 | |
| *** senk has quit IRC | 17:05 | |
| *** drifterza has quit IRC | 17:09 | |
| *** baoli has joined #openstack-infra | 17:10 | |
| *** flwang1 has joined #openstack-infra | 17:13 | |
| *** baoli has quit IRC | 17:14 | |
| *** spzala has quit IRC | 17:16 | |
| *** spzala has joined #openstack-infra | 17:17 | |
| *** spzala has quit IRC | 17:17 | |
| *** hashar has joined #openstack-infra | 17:17 | |
| *** spzala has joined #openstack-infra | 17:18 | |
| *** spzala has joined #openstack-infra | 17:18 | |
| *** spzala has quit IRC | 17:18 | |
| *** spzala has joined #openstack-infra | 17:19 | |
| *** 7IZAAHWBQ has joined #openstack-infra | 17:20 | |
| *** spzala has joined #openstack-infra | 17:21 | |
| *** spzala has joined #openstack-infra | 17:22 | |
| *** pilgrimstack has quit IRC | 17:22 | |
| *** spzala has quit IRC | 17:22 | |
| *** spzala has joined #openstack-infra | 17:23 | |
| *** spzala has quit IRC | 17:23 | |
| *** spzala has joined #openstack-infra | 17:23 | |
| *** spzala has joined #openstack-infra | 17:24 | |
| *** spzala has quit IRC | 17:24 | |
| *** spzala has joined #openstack-infra | 17:25 | |
| *** spzala has joined #openstack-infra | 17:26 | |
| *** spzala has joined #openstack-infra | 17:27 | |
| *** spzala has joined #openstack-infra | 17:28 | |
| *** spzala has joined #openstack-infra | 17:28 | |
| *** Sotonator has joined #openstack-infra | 17:29 | |
| *** spzala has quit IRC | 17:29 | |
| *** thorst_ has joined #openstack-infra | 17:29 | |
| *** spzala has joined #openstack-infra | 17:29 | |
| *** spzala has quit IRC | 17:29 | |
| *** spzala has joined #openstack-infra | 17:30 | |
| *** spzala has quit IRC | 17:30 | |
| *** thorst has quit IRC | 17:30 | |
| *** spzala has joined #openstack-infra | 17:31 | |
| *** spzala has joined #openstack-infra | 17:31 | |
| *** spzala_ has joined #openstack-infra | 17:32 | |
| *** spzala_ has quit IRC | 17:33 | |
| *** spzala has joined #openstack-infra | 17:33 | |
| *** spzala has joined #openstack-infra | 17:34 | |
| *** spzala has quit IRC | 17:34 | |
| *** spzala has joined #openstack-infra | 17:35 | |
| *** spzala has joined #openstack-infra | 17:36 | |
| *** spzala has quit IRC | 17:36 | |
| *** spzala has joined #openstack-infra | 17:36 | |
| *** spzala has joined #openstack-infra | 17:37 | |
| *** spzala has joined #openstack-infra | 17:38 | |
| *** spzala has joined #openstack-infra | 17:39 | |
| *** spzala has joined #openstack-infra | 17:40 | |
| *** spzala has joined #openstack-infra | 17:40 | |
| *** Sotonator has quit IRC | 17:40 | |
| *** spzala has joined #openstack-infra | 17:41 | |
| *** spzala has quit IRC | 17:41 | |
| *** Sotonator has joined #openstack-infra | 17:41 | |
| *** Sotonator has quit IRC | 17:42 | |
| *** spzala has joined #openstack-infra | 17:42 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul: Fix variants not picking up negative matches. https://review.openstack.org/399871 | 17:43 |
| *** spzala_ has joined #openstack-infra | 17:43 | |
| *** thorst_ has quit IRC | 17:43 | |
| *** rfolco has joined #openstack-infra | 17:43 | |
| *** spzala has joined #openstack-infra | 17:43 | |
| *** thorst has joined #openstack-infra | 17:44 | |
| *** spzala has quit IRC | 17:44 | |
| *** spzala has joined #openstack-infra | 17:44 | |
| *** spzala has quit IRC | 17:44 | |
| *** spzala has joined #openstack-infra | 17:45 | |
| *** spzala has quit IRC | 17:45 | |
| *** spzala has joined #openstack-infra | 17:46 | |
| *** spzala has quit IRC | 17:46 | |
| *** spzala has joined #openstack-infra | 17:47 | |
| *** spzala has joined #openstack-infra | 17:47 | |
| *** spzala has joined #openstack-infra | 17:48 | |
| *** senk has joined #openstack-infra | 17:49 | |
| *** spzala has joined #openstack-infra | 17:49 | |
| *** spzala has joined #openstack-infra | 17:50 | |
| *** spzala has joined #openstack-infra | 17:51 | |
| *** spzala has joined #openstack-infra | 17:51 | |
| *** wolverin_ has quit IRC | 17:52 | |
| *** spzala has joined #openstack-infra | 17:52 | |
| *** spzala has joined #openstack-infra | 17:53 | |
| *** spzala has joined #openstack-infra | 17:54 | |
| *** spzala has quit IRC | 17:55 | |
| *** spzala has joined #openstack-infra | 17:55 | |
| *** spzala has quit IRC | 17:56 | |
| *** wolverineav has joined #openstack-infra | 17:58 | |
| *** ihrachys has quit IRC | 18:02 | |
| *** wolverineav has quit IRC | 18:02 | |
| *** Sukhdev has joined #openstack-infra | 18:04 | |
| *** wolverineav has joined #openstack-infra | 18:06 | |
| *** flepied has joined #openstack-infra | 18:07 | |
| *** rcarrillocruz has joined #openstack-infra | 18:08 | |
| *** sdake has joined #openstack-infra | 18:08 | |
| *** wolverineav has quit IRC | 18:11 | |
| *** senk has quit IRC | 18:11 | |
| *** senk has joined #openstack-infra | 18:11 | |
| *** baoli has joined #openstack-infra | 18:12 | |
| *** thorst_ has joined #openstack-infra | 18:13 | |
| *** thorst has quit IRC | 18:15 | |
| *** senk has quit IRC | 18:21 | |
| *** adrian_otto has quit IRC | 18:23 | |
| *** baoli has quit IRC | 18:25 | |
| *** wolverineav has joined #openstack-infra | 18:26 | |
| *** hongbin has joined #openstack-infra | 18:26 | |
| *** nicolasbock has quit IRC | 18:29 | |
| *** rfolco has quit IRC | 18:31 | |
| *** wolverineav has quit IRC | 18:32 | |
| *** tiswanso has joined #openstack-infra | 18:32 | |
| *** thorst has joined #openstack-infra | 18:35 | |
| *** thorst_ has quit IRC | 18:37 | |
| *** thorst has quit IRC | 18:37 | |
| *** tiswanso has quit IRC | 18:37 | |
| *** thorst has joined #openstack-infra | 18:38 | |
| *** dkehn has quit IRC | 18:41 | |
| *** wolverineav has joined #openstack-infra | 18:47 | |
| *** thorst has quit IRC | 18:47 | |
| *** gouthamr has joined #openstack-infra | 18:48 | |
| *** dkehn has joined #openstack-infra | 18:48 | |
| *** wolverineav has quit IRC | 18:51 | |
| *** gouthamr has quit IRC | 18:54 | |
| *** nunchuck has quit IRC | 18:54 | |
| *** saibarspeis has quit IRC | 18:55 | |
| *** thorst has joined #openstack-infra | 18:56 | |
| *** spzala has joined #openstack-infra | 18:56 | |
| *** spzala has quit IRC | 18:56 | |
| *** spzala has joined #openstack-infra | 18:56 | |
| *** spzala has quit IRC | 18:56 | |
| *** hongbin has quit IRC | 18:57 | |
| *** spzala has joined #openstack-infra | 18:57 | |
| *** spzala has quit IRC | 18:57 | |
| *** spzala has joined #openstack-infra | 18:58 | |
| *** wolverineav has joined #openstack-infra | 18:58 | |
| *** spzala has quit IRC | 18:58 | |
| *** spzala has joined #openstack-infra | 18:59 | |
| *** spzala has quit IRC | 19:00 | |
| *** dave-mccowan has joined #openstack-infra | 19:00 | |
| *** spzala has joined #openstack-infra | 19:00 | |
| *** thorst has quit IRC | 19:00 | |
| *** spzala has joined #openstack-infra | 19:01 | |
| *** spzala has joined #openstack-infra | 19:02 | |
| *** spzala_ has joined #openstack-infra | 19:02 | |
| *** spzala_ has quit IRC | 19:02 | |
| *** spzala has joined #openstack-infra | 19:03 | |
| *** rfolco has joined #openstack-infra | 19:03 | |
| *** spzala has quit IRC | 19:03 | |
| *** gouthamr has joined #openstack-infra | 19:04 | |
| *** spzala has joined #openstack-infra | 19:04 | |
| *** spzala has quit IRC | 19:04 | |
| *** spzala has joined #openstack-infra | 19:05 | |
| *** spzala has joined #openstack-infra | 19:05 | |
| *** wolverin_ has joined #openstack-infra | 19:05 | |
| *** spzala has quit IRC | 19:05 | |
| *** esikachev has joined #openstack-infra | 19:06 | |
| *** spzala has joined #openstack-infra | 19:06 | |
| *** wolverineav has quit IRC | 19:07 | |
| *** spzala has joined #openstack-infra | 19:07 | |
| *** spzala has quit IRC | 19:08 | |
| *** spzala has joined #openstack-infra | 19:08 | |
| *** spzala has quit IRC | 19:08 | |
| *** spzala has joined #openstack-infra | 19:09 | |
| *** spzala_ has joined #openstack-infra | 19:09 | |
| *** spzala_ has quit IRC | 19:09 | |
| *** spzala has joined #openstack-infra | 19:10 | |
| *** rhallisey has joined #openstack-infra | 19:10 | |
| *** spzala has joined #openstack-infra | 19:10 | |
| *** spzala has quit IRC | 19:11 | |
| *** spzala has joined #openstack-infra | 19:11 | |
| *** wolverin_ has quit IRC | 19:11 | |
| *** spzala has joined #openstack-infra | 19:12 | |
| *** spzala has quit IRC | 19:12 | |
| *** yamahata has joined #openstack-infra | 19:12 | |
| *** rfolco has quit IRC | 19:12 | |
| *** spzala has joined #openstack-infra | 19:13 | |
| *** spzala has joined #openstack-infra | 19:13 | |
| *** spzala has quit IRC | 19:14 | |
| *** dave-mccowan has quit IRC | 19:14 | |
| *** spzala has joined #openstack-infra | 19:14 | |
| *** adrian_otto has joined #openstack-infra | 19:15 | |
| *** spzala has joined #openstack-infra | 19:15 | |
| *** spzala has quit IRC | 19:15 | |
| *** stream10 has joined #openstack-infra | 19:16 | |
| *** spzala has joined #openstack-infra | 19:16 | |
| *** spzala has quit IRC | 19:16 | |
| *** spzala has joined #openstack-infra | 19:16 | |
| *** spzala has quit IRC | 19:17 | |
| *** spzala has joined #openstack-infra | 19:17 | |
| *** spzala has quit IRC | 19:17 | |
| *** spzala has joined #openstack-infra | 19:18 | |
| *** spzala has joined #openstack-infra | 19:19 | |
| *** spzala has joined #openstack-infra | 19:20 | |
| *** spzala has joined #openstack-infra | 19:21 | |
| *** spzala has joined #openstack-infra | 19:21 | |
| *** spzala has quit IRC | 19:21 | |
| *** spzala has joined #openstack-infra | 19:22 | |
| *** tqtran has joined #openstack-infra | 19:22 | |
| *** Hal has joined #openstack-infra | 19:23 | |
| *** spzala has joined #openstack-infra | 19:23 | |
| *** Hal is now known as Guest68087 | 19:23 | |
| *** spzala has joined #openstack-infra | 19:24 | |
| *** spzala has joined #openstack-infra | 19:25 | |
| *** spzala has joined #openstack-infra | 19:26 | |
| *** spzala has quit IRC | 19:26 | |
| *** spzala has joined #openstack-infra | 19:27 | |
| *** tqtran has quit IRC | 19:27 | |
| *** spzala has quit IRC | 19:27 | |
| *** spzala has joined #openstack-infra | 19:28 | |
| *** spzala has quit IRC | 19:28 | |
| *** esikachev has quit IRC | 19:28 | |
| *** spzala has joined #openstack-infra | 19:28 | |
| *** wolverineav has joined #openstack-infra | 19:28 | |
| *** spzala has joined #openstack-infra | 19:30 | |
| *** spzala has quit IRC | 19:30 | |
| *** spzala has joined #openstack-infra | 19:30 | |
| *** spzala has joined #openstack-infra | 19:31 | |
| *** esikachev has joined #openstack-infra | 19:31 | |
| *** spzala has quit IRC | 19:31 | |
| *** spzala has joined #openstack-infra | 19:32 | |
| *** spzala has joined #openstack-infra | 19:33 | |
| *** spzala has quit IRC | 19:33 | |
| *** spzala has joined #openstack-infra | 19:34 | |
| *** spzala has quit IRC | 19:34 | |
| *** wolverineav has quit IRC | 19:34 | |
| *** spzala has joined #openstack-infra | 19:35 | |
| *** spzala has quit IRC | 19:35 | |
| *** wolverineav has joined #openstack-infra | 19:35 | |
| *** spzala has joined #openstack-infra | 19:36 | |
| *** spzala has quit IRC | 19:36 | |
| *** yamamoto has joined #openstack-infra | 19:36 | |
| *** spzala has joined #openstack-infra | 19:36 | |
| *** spzala has joined #openstack-infra | 19:37 | |
| *** hashar has quit IRC | 19:37 | |
| *** spzala has quit IRC | 19:37 | |
| *** spzala has joined #openstack-infra | 19:38 | |
| *** spzala has quit IRC | 19:38 | |
| *** spzala has joined #openstack-infra | 19:39 | |
| *** spzala has joined #openstack-infra | 19:39 | |
| *** lVathan[m] has quit IRC | 19:40 | |
| *** spzala has joined #openstack-infra | 19:40 | |
| *** yamamoto has quit IRC | 19:41 | |
| *** spzala has joined #openstack-infra | 19:41 | |
| *** spzala has quit IRC | 19:41 | |
| *** spzala has joined #openstack-infra | 19:42 | |
| *** wolverineav has quit IRC | 19:42 | |
| *** rfolco has joined #openstack-infra | 19:43 | |
| *** spzala has joined #openstack-infra | 19:43 | |
| *** spzala has quit IRC | 19:43 | |
| *** spzala has joined #openstack-infra | 19:44 | |
| *** spzala has quit IRC | 19:44 | |
| *** spzala has joined #openstack-infra | 19:44 | |
| *** spzala has joined #openstack-infra | 19:45 | |
| *** spzala has joined #openstack-infra | 19:46 | |
| *** spzala has quit IRC | 19:46 | |
| *** spzala has joined #openstack-infra | 19:46 | |
| *** coolsvap has quit IRC | 19:47 | |
| *** spzala has quit IRC | 19:47 | |
| *** spzala has joined #openstack-infra | 19:47 | |
| *** spzala has joined #openstack-infra | 19:48 | |
| *** spzala has joined #openstack-infra | 19:49 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Build ubuntu-xenial image for devstack testing https://review.openstack.org/399865 | 19:49 |
| *** spzala has quit IRC | 19:49 | |
| *** mriedem has joined #openstack-infra | 19:49 | |
| *** spzala has joined #openstack-infra | 19:50 | |
| *** spzala has quit IRC | 19:50 | |
| *** spzala has joined #openstack-infra | 19:50 | |
| *** spzala has quit IRC | 19:50 | |
| *** chandankumar has quit IRC | 19:51 | |
| *** spzala has joined #openstack-infra | 19:51 | |
| *** spzala has joined #openstack-infra | 19:52 | |
| *** spzala has joined #openstack-infra | 19:53 | |
| *** saibarspeis has joined #openstack-infra | 19:53 | |
| *** spzala has joined #openstack-infra | 19:54 | |
| *** tiswanso has joined #openstack-infra | 19:54 | |
| *** spzala has quit IRC | 19:54 | |
| *** saibarspeis has quit IRC | 19:54 | |
| *** spzala has joined #openstack-infra | 19:55 | |
| *** spzala has joined #openstack-infra | 19:56 | |
| *** spzala has quit IRC | 19:56 | |
| *** spzala has joined #openstack-infra | 19:56 | |
| *** wolverineav has joined #openstack-infra | 19:57 | |
| *** spzala has joined #openstack-infra | 19:57 | |
| *** spzala has joined #openstack-infra | 19:58 | |
| *** spzala has quit IRC | 19:59 | |
| *** rbuzatu has quit IRC | 19:59 | |
| *** saibarspeis has joined #openstack-infra | 19:59 | |
| *** spzala has joined #openstack-infra | 19:59 | |
| *** rbuzatu has joined #openstack-infra | 20:00 | |
| *** spzala has joined #openstack-infra | 20:00 | |
| *** tiswanso has quit IRC | 20:00 | |
| *** spzala has quit IRC | 20:00 | |
| *** spzala has joined #openstack-infra | 20:01 | |
| *** spzala has joined #openstack-infra | 20:01 | |
| *** rbuzatu_ has joined #openstack-infra | 20:01 | |
| *** spzala has quit IRC | 20:01 | |
| *** rbuzatu_ has joined #openstack-infra | 20:02 | |
| *** wolverineav has quit IRC | 20:02 | |
| *** spzala has joined #openstack-infra | 20:02 | |
| *** spzala has joined #openstack-infra | 20:03 | |
| *** spzala has joined #openstack-infra | 20:04 | |
| *** rbuzatu has quit IRC | 20:04 | |
| *** spzala has joined #openstack-infra | 20:04 | |
| *** spzala has joined #openstack-infra | 20:05 | |
| *** spzala has joined #openstack-infra | 20:06 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: Fix runtime ssh host keys script https://review.openstack.org/399805 | 20:07 |
| pabelanger | clarkb: that should fix pep8^ | 20:07 |
| *** rbuzatu has joined #openstack-infra | 20:11 | |
| *** rbuzatu has quit IRC | 20:12 | |
| *** rbuzatu has joined #openstack-infra | 20:13 | |
| *** Goneri has joined #openstack-infra | 20:13 | |
| *** rbuzatu_ has quit IRC | 20:14 | |
| *** rbuzatu_ has joined #openstack-infra | 20:15 | |
| *** rkukura_ has joined #openstack-infra | 20:15 | |
| *** saibarspeis has quit IRC | 20:17 | |
| *** rbuzatu has quit IRC | 20:18 | |
| *** rkukura has quit IRC | 20:18 | |
| *** rkukura_ is now known as rkukura | 20:18 | |
| *** baoli has joined #openstack-infra | 20:20 | |
| *** spzala has quit IRC | 20:22 | |
| *** saibarspeis has joined #openstack-infra | 20:23 | |
| *** saibarspeis has quit IRC | 20:23 | |
| *** saibarspeis has joined #openstack-infra | 20:24 | |
| *** baoli has quit IRC | 20:25 | |
| *** saibarspeis has joined #openstack-infra | 20:25 | |
| *** saibarspeis has quit IRC | 20:25 | |
| *** saibarspeis has joined #openstack-infra | 20:26 | |
| *** saibarspeis has joined #openstack-infra | 20:27 | |
| *** saibarspeis has joined #openstack-infra | 20:28 | |
| *** sdake_ has joined #openstack-infra | 20:29 | |
| *** sdake has quit IRC | 20:30 | |
| *** wolverineav has joined #openstack-infra | 20:32 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Python 3.4 is not in Ubuntu Xenial, use Python 3.5 https://review.openstack.org/399866 | 20:33 |
| fungi | onovy: ^ close | 20:34 |
| *** sdake_ has quit IRC | 20:35 | |
| pabelanger | okay, swift question. Which setting should I be looking at if I want to increase the 2GB default in devstack for storage? | 20:36 |
| *** wolverineav has quit IRC | 20:37 | |
| *** rbuzatu_ has quit IRC | 20:37 | |
| pabelanger | /dev/loop0 2086912 1738520 348392 84% /opt/stack/data/swift/drives/sdb1 | 20:37 |
| pabelanger | /opt/stack/data/swift/drives/images/swift.img is the image I guess | 20:37 |
| *** rbuzatu has joined #openstack-infra | 20:37 | |
| *** HeOS has joined #openstack-infra | 20:38 | |
| pabelanger | SWIFT_LOOPBACK_DISK_SIZE_DEFAULT=2G looks like | 20:40 |
| *** jtomasek has joined #openstack-infra | 20:41 | |
| *** rbuzatu has quit IRC | 20:42 | |
| *** newmember has quit IRC | 20:43 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Build ubuntu-xenial image for devstack testing https://review.openstack.org/399865 | 20:43 |
| *** esikachev has quit IRC | 20:52 | |
| openstackgerrit | Merged openstack-infra/project-config: Python 3.4 is not in Ubuntu Xenial, use Python 3.5 https://review.openstack.org/399866 | 20:57 |
| *** jtomasek has quit IRC | 21:01 | |
| *** gouthamr has quit IRC | 21:10 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Build ubuntu-xenial image for devstack testing https://review.openstack.org/399865 | 21:10 |
| *** e0ne has quit IRC | 21:15 | |
| *** itisha has joined #openstack-infra | 21:18 | |
| *** wolverineav has joined #openstack-infra | 21:19 | |
| *** aneliubin has quit IRC | 21:20 | |
| *** dkehn has quit IRC | 21:20 | |
| *** dkehn has joined #openstack-infra | 21:20 | |
| *** baoli has joined #openstack-infra | 21:21 | |
| *** e0ne has joined #openstack-infra | 21:25 | |
| *** baoli has quit IRC | 21:26 | |
| *** wolverineav has quit IRC | 21:27 | |
| *** sdake has joined #openstack-infra | 21:28 | |
| *** sdake has quit IRC | 21:33 | |
| *** Jeffrey4l has quit IRC | 21:34 | |
| *** EricGonczer_ has quit IRC | 21:34 | |
| onovy | fungi: more bugs to come :) http://logs.openstack.org/31/399531/1/check/gate-swift-tox-xfs-tmp-func-in-process-fast-post-ubuntu-xenial/0263e9d/console.html | 21:44 |
| onovy | dtto: http://logs.openstack.org/31/399531/1/check/gate-swift-tox-xfs-tmp-func-in-process-encryption-ubuntu-xenial/6ae41e6/console.html | 21:44 |
| *** e0ne has quit IRC | 21:44 | |
| fungi | onovy: i think that one's because the job name is too long so when tox creates a virtualenv the shebang line exceeds the 128-byte limit | 21:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Build ubuntu-xenial image for devstack testing https://review.openstack.org/399865 | 21:48 |
| pabelanger | fungi: clarkb: okay, ^ should highlight the failure with ubuntu-xenial DIB | 21:48 |
| pabelanger | Say, we let that run, confirm the failure then add the job to diskimage-builder | 21:48 |
| pabelanger | then we can validate our runtime-ssh-host-keys patch | 21:49 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Build ubuntu-xenial image for devstack testing https://review.openstack.org/399865 | 21:49 |
| onovy | fungi: /home/jenkins/workspace/gate-swift-tox-xfs-tmp-func-in-process-fast-post-ubun: bad interpreter: No such file or directory | 21:50 |
| onovy | so yep | 21:50 |
| onovy | can we remove "in-process" from name? | 21:51 |
| fungi | is -encryption relevant to the name as well (as in, is there a non-encryption version? can we shorted that to -enc maybe?) | 21:52 |
| fungi | i need to calculate how many characters we need to shave off | 21:53 |
| onovy | fungi: https://github.com/openstack/swift/blob/master/tox.ini#L58 | 21:55 |
| onovy | so i think we can't fix it now without swift core | 21:55 |
| fungi | yeah, looks like removing -in-process shaves 22 characters for us (because it gets repeated in the tox env name), and we only need to free up 11 | 21:56 |
| fungi | "ntu-xenial/" are all that's missing, i _think_ | 21:56 |
| onovy | notmyname: john, we need you! :) ^ | 21:56 |
| fungi | this will need a coordinated change, first to the job name in project-config and then to the tox env name in the swift repo | 21:57 |
| fungi | is that the only job that's failing at this point? | 21:57 |
| *** tiswanso has joined #openstack-infra | 21:57 | |
| onovy | two jobs, same problem | 21:58 |
| onovy | gate-swift-tox-xfs-tmp-func-in-process-fast-post-ubuntu-xenial and | 21:58 |
| onovy | gate-swift-tox-xfs-tmp-func-in-process-encryption-ubuntu-xenial | 21:58 |
| fungi | yep, just found the swift change that the example failed on | 21:58 |
| fungi | so right, if notmyname agrees it's reasonable to remove in-process- from the env names for those in swift's tox.ini, then that should solve it | 22:00 |
| fungi | i'll get the project-config change prepped since that will need to merge first if he's in agreement | 22:00 |
| onovy | ok, thanks | 22:00 |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: Fix runtime ssh host keys script https://review.openstack.org/399805 | 22:01 |
| *** tiswanso has quit IRC | 22:02 | |
| notmyname | who what now? | 22:03 |
| onovy | notmyname: we want change gate-swift-tox-xfs-tmp-func-in-process-fast-post-ubuntu-xenial -> gate-swift-tox-xfs-tmp-func-fast-post-ubuntu-xenial | 22:03 |
| onovy | dtto for gate-swift-tox-xfs-tmp-func-in-process-encryption-ubuntu-xenial | 22:04 |
| onovy | notmyname: which means change tox env name too | 22:04 |
| onovy | reason: it's too long | 22:04 |
| notmyname | lol | 22:04 |
| *** david-lyle has quit IRC | 22:04 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Remove "in-process-" from swift func jobs https://review.openstack.org/399887 | 22:04 |
| fungi | notmyname: onovy: ^ | 22:04 |
| *** rbuzatu has joined #openstack-infra | 22:05 | |
| notmyname | the "in process" part is different than the not in process versions that are the dsvm ones | 22:05 |
| fungi | hrm, well we can shorten them some other way maybe without losing clarity | 22:06 |
| notmyname | just curious, what's truncating them? | 22:06 |
| fungi | we run jobs in workspaces whose path is /home/jenkins/workspace/<job-name>/ and then tox creates a virtualenv and sets shebangs to that plus .tox/<env-name>/bin/python | 22:06 |
| fungi | and if that plus the #! and maybe a string terminator (i can't remember) exceeds 128 bytes then the kernel won't run it | 22:07 |
| onovy | just curious no. 2, why you limit cmdline to 128? | 22:08 |
| fungi | me? i don't have anything to do with that. ask linus | 22:08 |
| onovy | ah, 128 is default? | 22:09 |
| fungi | baked into the kernel, i believe | 22:09 |
| onovy | hmm, strange | 22:09 |
| fungi | https://github.com/pypa/virtualenv/issues/596 | 22:09 |
| notmyname | onovy: fungi: do either of you have the related swift change staged already? | 22:09 |
| onovy | notmyname: no | 22:09 |
| fungi | notmyname: not yet, was waiting to get your opinion | 22:09 |
| onovy | but i can create it | 22:10 |
| onovy | just say what name should be :] | 22:10 |
| notmyname | and I just happened to sit down and wake my computer up. I must have a sense about these things ;-) | 22:10 |
| notmyname | how many characters do we need to shave off? | 22:11 |
| onovy | ~ 6 i guess | 22:12 |
| fungi | yeah, hopefully that's not cutting it too close | 22:12 |
| fungi | i think we also had some ideas about changes to zuul to be able to shorten the base path for job workspaces a lot too, though that's a more involved effort and i don't know if anyone's tackling it yet | 22:13 |
| notmyname | #!/home/jenkins/workspace/gate-swift-tox-xfs-tmp-func-encryption-ubuntu-xenial/.tox/func-in-process-encryption/bin/python | 22:13 |
| notmyname | that's 122 chars | 22:13 |
| notmyname | and I think the longest one | 22:13 |
| fungi | right, i'm not sure what the extra overhead is | 22:14 |
| onovy | notmyname: #!/home/jenkins/workspace/gate-swift-tox-xfs-tmp-func--in-process-encryption-ubuntu-xenial/.tox/func-in-process-encryption/bin/python | 22:15 |
| onovy | which is >128 | 22:15 |
| onovy | sry, double dash | 22:15 |
| pabelanger | maybe use scenario001, scenario002, etc | 22:16 |
| pabelanger | works well for puppet / ansible teams | 22:16 |
| *** rbuzatu_ has joined #openstack-infra | 22:16 | |
| notmyname | ah I got it | 22:16 |
| fungi | if we can get the name to at or under what the previous non-xfs version of this job was named, that should be sufficient | 22:16 |
| onovy | or hack like this: http://stackoverflow.com/questions/10813538/shebang-line-limit-in-bash-and-linux-kernel#answer-10826085 | 22:16 |
| *** rbuzatu has quit IRC | 22:18 | |
| *** Sukhdev has quit IRC | 22:19 | |
| *** rbuzatu has joined #openstack-infra | 22:19 | |
| dmsimard | xenial issue still not fixed? :( | 22:19 |
| fungi | dmsimard: for the image builds? clarkb says it affected all images, so i'm guessing it wasn't a systend-only thing | 22:20 |
| fungi | er, systemd-only | 22:20 |
| dmsimard | oh, ouch | 22:20 |
| pabelanger | working on it now | 22:20 |
| notmyname | fungi: onovy: I'm thinking... | 22:20 |
| pabelanger | should have a nodepool test in place to confirm the fix | 22:20 |
| dmsimard | is there a topic for the changes that address the issue? would like to follow the progress | 22:20 |
| pabelanger | 399805 | 22:21 |
| *** rbuzatu_ has quit IRC | 22:21 | |
| dmsimard | added myself as reviewer ty | 22:21 |
| *** baoli has joined #openstack-infra | 22:22 | |
| pabelanger | telnet://146.20.110.238:19885 | 22:22 |
| pabelanger | if that passes, new nodepool tests work | 22:22 |
| *** spzala has joined #openstack-infra | 22:23 | |
| notmyname | fungi: onovy: yes. drop the "-in-process" part, and that should get things unblocked. I don't love it, but I can't think of a better option, really | 22:23 |
| notmyname | and, worst case, it's something that can be changed back if needed | 22:23 |
| fungi | exactly, can iterate on it easily later | 22:23 |
| fungi | just don't want to suck up a lot of people's time on a weekend | 22:24 |
| notmyname | onovy: fungi: if one of you proposes it to swift, I'll +A | 22:24 |
| onovy | notmyname: working on it | 22:24 |
| fungi | as soon as i get results back on 399887 i'll self-approve it | 22:24 |
| fungi | it'll need to land before the swift change will be able to pass | 22:24 |
| onovy | https://review.openstack.org/#/c/399888/ | 22:25 |
| notmyname | fungi: that swift change looks like the match to you? | 22:25 |
| *** baoli has quit IRC | 22:27 | |
| fungi | notmyname: onovy: 399888 lgtm | 22:27 |
| fungi | pabelanger: do we need to roll back broken images in nodepool again? | 22:27 |
| *** spzala has quit IRC | 22:27 | |
| pabelanger | fungi: maybe, I haven't checked actually | 22:28 |
| fungi | or have the good images already been rotated out of existence in most providers? | 22:28 |
| notmyname | fungi: do we need to wait for any order, or can I go ahead and land the swift one? | 22:28 |
| onovy | notmyname: you can't land swift first | 22:28 |
| onovy | because jenkins will say -1 | 22:28 |
| notmyname | right | 22:28 |
| onovy | we need to land fungi's patch first | 22:28 |
| fungi | notmyname: you can approve the swift change but it won't actually pass until 399887 gets applied to zuul | 22:28 |
| onovy | wait for merge, then recheck | 22:28 |
| notmyname | ok. I'll go ahead and stick the bits on there in case I'm not around to recheck later | 22:29 |
| onovy | ok | 22:29 |
| fungi | it'll be a few minutes after it merges. i'm going to go ahead and enqueue 399887 into the gate since it looks like we're really starved for usable nodes at the moment with the image issue going on. that way it'll get priority | 22:29 |
| *** sdake has joined #openstack-infra | 22:29 | |
| dmsimard | there's no way to put a topic on reviews that have already merged, is there ? | 22:30 |
| *** gmann has quit IRC | 22:30 | |
| fungi | dmsimard: i think gerrit locks topics on closed changes | 22:30 |
| dmsimard | Okay, my fault, it's good :) | 22:30 |
| * dmsimard won't forget next time | 22:30 | |
| pabelanger | fungi: looks like we have no good images to roll back too, expect 1 | 22:30 |
| pabelanger | for osic | 22:30 |
| fungi | dmsimard: if it won't let you edit the topic and the change is in a merged state, then that's probably why | 22:30 |
| pabelanger | but, we should be able to confirm our fix shortly | 22:31 |
| pabelanger | then do a new dib release | 22:31 |
| *** hongbin has joined #openstack-infra | 22:32 | |
| notmyname | done | 22:32 |
| pabelanger | osic-cloud1-s3500 should give us good xenial images | 22:32 |
| onovy | notmyname: fungi: thanks guys | 22:33 |
| fungi | okay, 399887 is in the gate and has workers assigned already, eta to merge is 5 minutes and then i'll check on the config management pulse to see how quickly it hits zuul and the launchers | 22:33 |
| notmyname | fungi: is there something else going on in the gate? (you hinted) I'll be rechecking the stuff that needed xfs on monday. or I was plannign to | 22:33 |
| *** sdake has quit IRC | 22:34 | |
| onovy | notmyname: this should be last one | 22:34 |
| onovy | already fixed few other things :) | 22:34 |
| notmyname | :-) | 22:34 |
| fungi | notmyname: a diskimage-builder release shot our dog^H^H^Himages and now we can't boot nodes in most of our providers | 22:34 |
| notmyname | onovy: since I got you hear... how can we get liberasurecode 1.3.1 (or soon, 1.3.2) in upstream packages? | 22:34 |
| fungi | though they've almost got that nailed down | 22:34 |
| onovy | notmyname: in Debian? Already uploaded 1.3.1 | 22:35 |
| notmyname | here. whatever | 22:35 |
| onovy | notmyname: https://packages.debian.org/sid/liberasurecode1 | 22:35 |
| onovy | jessie backports in few days, waiting for migration | 22:35 |
| notmyname | onovy: cool, thanks. FWIW we'll do 1.3.2 soon to change a warning to something that will actually prevent bad things. | 22:36 |
| onovy | notmyname: cool, i will upload it as soon as possible | 22:36 |
| notmyname | onovy: and push requirements changes to pyeclib and swift to make sure people don't deploy with a bad combo | 22:36 |
| notmyname | onovy: thanks | 22:36 |
| openstackgerrit | Merged openstack-infra/project-config: Remove "in-process-" from swift func jobs https://review.openstack.org/399887 | 22:36 |
| fungi | have a line on a sru getting that imported into ubuntu lts (xenial at least)? | 22:36 |
| onovy | fungi: "sru"? | 22:37 |
| fungi | "stable release update" (a bug requesting for a package update in an lts release) | 22:37 |
| *** wolverineav has joined #openstack-infra | 22:37 | |
| onovy | ah. don't know how this is working in ubuntu | 22:37 |
| *** saibarspeis has joined #openstack-infra | 22:37 | |
| fungi | yeah, me neither. dunno if the upload needs to migrate to testing and then get sucked into ubuntu's dev release before they'll entertain an sru | 22:38 |
| fungi | we _do_ have jessie images we could run swift tests on, but we don't enable jessie-backports by default afaik so you'd need a step in the job to do the apt preferences patching | 22:39 |
| fungi | aha, and looks like the liberasurecode1 package doesn't exist at all in jessie, outside backports | 22:41 |
| onovy | yep | 22:41 |
| *** wolverineav has quit IRC | 22:42 | |
| fungi | xenial apparently has 1.1.0 so convincing them to jump to 1.3.1 or later might be tough unless it goes into xenial-backports instead | 22:42 |
| fungi | though it's not a soname bump, so if swift is the only real consumer of it then maybe they'd be okay with the idea | 22:42 |
| onovy | it's ABI compatible if i remember correctly | 22:42 |
| *** wolverineav has joined #openstack-infra | 22:43 | |
| onovy | func tests is running, yeee | 22:46 |
| fungi | well, the shortened job name likely hasn't applied yet, i'm checking the zuul servers now | 22:46 |
| onovy | fungi: it's applied | 22:47 |
| fungi | oh wow, that was faster than if i had coerced it manually | 22:47 |
| fungi | i agree, seems to have been applied already | 22:47 |
| *** wolverineav has quit IRC | 22:47 | |
| *** stream10 has quit IRC | 22:48 | |
| onovy | success! | 22:48 |
| fungi | yep, lookin good | 22:48 |
| fungi | 399888 may need backporting to one or more stable branches at some point, but as you rarely have changes on those for swift it's likely non-urgent | 22:49 |
| pabelanger | w00t | 22:52 |
| onovy | https://review.openstack.org/#/c/399890/ | 22:53 |
| pabelanger | worked | 22:53 |
| onovy | notmyname: https://review.openstack.org/#/c/399890/ | 22:54 |
| pabelanger | fungi: dmsimard: clarkb: http://logs.openstack.org/05/399805/3/check/gate-dsvm-nodepool-src-diskimage-builder-nv/8be9dfa/console.html#_2016-11-19_22_52_28_407347 | 22:54 |
| pabelanger | https://review.openstack.org/#/c/399805/ and https://review.openstack.org/#/c/399865/ can be +3 now | 22:54 |
| clarkb | pabelanger: why the dependency? | 22:57 |
| clarkb | those arent cross tested so its a noop | 22:57 |
| pabelanger | clarkb: they are | 22:57 |
| pabelanger | gate-dsvm-nodepool-src-diskimage-builder-nv | 22:58 |
| clarkb | they are? wow | 22:58 |
| clarkb | news to me | 22:58 |
| pabelanger | uses the same job as gate-dsvm-nodepool | 22:58 |
| pabelanger | ya, I think ianw did it | 22:58 |
| clarkb | pabelanger: that said I would not do two images, just one | 22:58 |
| fungi | pabelanger: is 399865 passing because dib is fixed now? it seems like the dependency is in the wrong direction for that? | 22:58 |
| *** tiswanso has joined #openstack-infra | 22:59 | |
| clarkb | and also I think this should fail on trusty too | 22:59 |
| fungi | oh, the job is nonvoting | 22:59 |
| fungi | i forgot we wanted to avoid nodepool blocking on devstack in general | 22:59 |
| pabelanger | fungi: ya, it could be reversed, but wanted to confirm 399805 was correct | 23:00 |
| clarkb | huh apparently trusty works for some reason | 23:00 |
| clarkb | more curiouser | 23:00 |
| pabelanger | only affects systemd | 23:00 |
| clarkb | pabelanger: but the change was to upstarttoo | 23:00 |
| pabelanger | checking | 23:00 |
| clarkb | they all run that same scriptIthought | 23:01 |
| pabelanger | ah, right | 23:01 |
| clarkb | but yes I'd prefer that we didnt makr the dib change wait on nodepool | 23:01 |
| pabelanger | not sure then | 23:01 |
| pabelanger | we can remove it, just wanted to confirm it was working without manually building an image | 23:02 |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: Fix runtime ssh host keys script https://review.openstack.org/399805 | 23:02 |
| fungi | now we just need a couple of dib cores to approve that, and then someone to file for a release | 23:03 |
| *** tiswanso has quit IRC | 23:03 | |
| pabelanger | greghaynes: ianw: ^ mind +3 and release? | 23:07 |
| *** saibarspeis has quit IRC | 23:08 | |
| *** sdake has joined #openstack-infra | 23:08 | |
| pabelanger | clarkb: re: 2 images, I don't mind both. It didn't add much to the build time. Also, when we switch to feature/zuulv3 branch, we are only doing 1 image ATM (since we dropped snapshot) | 23:12 |
| openstackgerrit | Ondřej Nový proposed openstack-infra/project-config: Swift: Make Python 3.5 check voting https://review.openstack.org/399892 | 23:13 |
| clarkb | pabelanger: just remember they are serialized and uploads wait for builds tofinish | 23:14 |
| clarkb | so it adds about 10minutes to the job I think | 23:14 |
| clarkb | maybe more | 23:14 |
| *** mriedem has quit IRC | 23:15 | |
| pabelanger | true, but that changes for zuulv3 | 23:15 |
| pabelanger | we could also have dib use a different nodepool.yaml | 23:15 |
| clarkb | no its still serialized there | 23:16 |
| clarkb | since you cant run mulyiple dibs atonce | 23:16 |
| pabelanger | Oh, builds.... ya | 23:16 |
| *** wolverineav has joined #openstack-infra | 23:16 | |
| *** EricGonczer_ has joined #openstack-infra | 23:16 | |
| *** mriedem has joined #openstack-infra | 23:18 | |
| *** hongbin has quit IRC | 23:19 | |
| notmyname | onovy: fungi: oh, we need it on stable branches too because infra has one config? ie it's not tested against a stable/newton branch of infra | 23:20 |
| *** tiswanso has joined #openstack-infra | 23:20 | |
| onovy | i guess so | 23:20 |
| onovy | but i can try it with "recheck" of my patches for stable swift branch | 23:20 |
| *** wolverineav has quit IRC | 23:21 | |
| onovy | notmyname: yep, infra is using config only from master for all builds. you can check directly on 399890 | 23:22 |
| *** baoli has joined #openstack-infra | 23:23 | |
| notmyname | onovy: probably need mitake too, then? | 23:23 |
| onovy | we don't have EC func in mitaka | 23:23 |
| onovy | so i think we need somethink like "dummy" tox target with exit 0 | 23:23 |
| *** tqtran has joined #openstack-infra | 23:24 | |
| clarkb | you can restrict jobs by branch | 23:24 |
| onovy | any example? | 23:25 |
| *** tiswanso has quit IRC | 23:26 | |
| *** baoli has quit IRC | 23:28 | |
| *** tqtran has quit IRC | 23:28 | |
| clarkb | onovy: just look in zuul/layout.yaml and grep for mitaka or liberty or newton | 23:28 |
| onovy | right | 23:28 |
| *** sdake has quit IRC | 23:28 | |
| *** nunchuck has joined #openstack-infra | 23:30 | |
| *** Jeffrey4l has joined #openstack-infra | 23:30 | |
| openstackgerrit | Ondřej Nový proposed openstack-infra/project-config: Skip gate-swift-tox-xfs-tmp-func-encryption-ubuntu-xenial on liberty+mitaka https://review.openstack.org/399893 | 23:33 |
| *** sdake has joined #openstack-infra | 23:33 | |
| notmyname | onovy: so how has the gate been working on those branches without that patch so far? | 23:35 |
| onovy | notmyname: don't know | 23:35 |
| notmyname | onovy: crypto tests weren't there https://review.openstack.org/#/c/389746/ | 23:37 |
| onovy | notmyname: because they wasn't in layout in that time? | 23:37 |
| notmyname | onovy: the crypto tests have been there for a while. that one only landed 2 weeks ago | 23:38 |
| onovy | notmyname: to be honest, don't know at all. but i think there is no need to hurry. think about it, talk with infra, etc. | 23:38 |
| notmyname | the crypto tests were added in July | 23:38 |
| onovy | i prepared few patches, maybe they are correct :] | 23:39 |
| notmyname | yeah. well, I was planning on doing some actual releases on stable branches | 23:39 |
| *** jamielennox is now known as jamielennox|away | 23:40 | |
| onovy | let's wait for "checks" of this: https://review.openstack.org/#/c/399895/ | 23:40 |
| onovy | it should fail with gate-swift-tox-xfs-tmp-func-encryption-ubuntu-xenial | 23:41 |
| *** EricGonczer_ has quit IRC | 23:42 | |
| *** rbuzatu has quit IRC | 23:46 | |
| onovy | -> bed, it's almost 1am. gn | 23:46 |
| *** rbuzatu has joined #openstack-infra | 23:46 | |
| *** rbuzatu has quit IRC | 23:51 | |
| *** sdake has quit IRC | 23:54 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!