| *** openstack has joined #openstack-infra | 00:03 | |
| *** zhurong has quit IRC | 00:03 | |
| *** EricGonc_ has joined #openstack-infra | 00:04 | |
| *** nwkarsten has joined #openstack-infra | 00:04 | |
| *** sdake has quit IRC | 00:06 | |
| *** xarses has quit IRC | 00:07 | |
| *** EricGonczer_ has quit IRC | 00:07 | |
| *** chem`` has quit IRC | 00:07 | |
| *** ffrank has quit IRC | 00:07 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool: Add some tracking for image sizes https://review.openstack.org/289678 | 00:08 |
|---|---|---|
| *** ffrank has joined #openstack-infra | 00:08 | |
| ianw | notmorgan: ^ that should do it (statvfs btw is for the filesystem) | 00:08 |
| *** DevBox has quit IRC | 00:08 | |
| *** sdake has joined #openstack-infra | 00:08 | |
| *** jamesmcarthur has quit IRC | 00:09 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config: Create the ARA project https://review.openstack.org/321226 | 00:09 |
| *** docaedo has quit IRC | 00:09 | |
| notmorgan | ianw: ah | 00:09 |
| notmorgan | ianw: yes. stat was what I was looking for. :) | 00:10 |
| *** zzzeek has quit IRC | 00:10 | |
| *** dingyichen has joined #openstack-infra | 00:10 | |
| *** wirehead_ has joined #openstack-infra | 00:12 | |
| *** sdague has joined #openstack-infra | 00:13 | |
| *** zzzeek has joined #openstack-infra | 00:14 | |
| dmsimard | The puppet apply for debian jessie job passed without a depends-on, it looks like there are problems with that job with a depends-on, it's unable to fetch git.openstack.org over ipv6. | 00:16 |
| dmsimard | For system-config. | 00:17 |
| dmsimard | Oh, it's both ipv4 and ipv6 actually. | 00:17 |
| *** sarob has joined #openstack-infra | 00:18 | |
| *** harlowja has joined #openstack-infra | 00:19 | |
| *** _sarob has joined #openstack-infra | 00:19 | |
| *** jamesmcarthur has joined #openstack-infra | 00:20 | |
| jeblair | dmsimard, clarkb: yes, the fix for "No such file or directory: '/var/lib/zuul/times'" has merged | 00:21 |
| jeblair | oh you got that | 00:21 |
| * dmsimard nods | 00:21 | |
| jeblair | dmsimard, clarkb, fungi: hrm. we are tracking an ongoing network issue from rax-ord that manifests like that connection failure, but that job failed in rax-iad. i don't have any further insight other than to try rechecking it and let's keep an eye out to see if a pattern develops | 00:22 |
| openstackgerrit | Nathan Reller proposed openstack-infra/project-config: Add KMIP Experiment Check to Barbican https://review.openstack.org/307820 | 00:23 |
| *** sarob has quit IRC | 00:23 | |
| dmsimard | jeblair: I removed the depends on as it was not an explicit necessity, just for clearness | 00:23 |
| dmsimard | jeblair: (and it passed) | 00:23 |
| dmsimard | It failed twice. | 00:23 |
| jeblair | dmsimard: what's the change? | 00:23 |
| dmsimard | jeblair: https://review.openstack.org/#/c/321229 | 00:24 |
| dmsimard | one is rax-ord, other is rax-iad | 00:24 |
| *** kushal has quit IRC | 00:24 | |
| dmsimard | and only on debian jessie, so I thought that was an odd coincidence | 00:24 |
| *** Qiming has quit IRC | 00:24 | |
| *** baoli has joined #openstack-infra | 00:25 | |
| *** wirehead_ has left #openstack-infra | 00:25 | |
| *** nwkarsten has quit IRC | 00:25 | |
| *** r-mibu has quit IRC | 00:26 | |
| *** r-mibu has joined #openstack-infra | 00:26 | |
| jeblair | dmsimard: the one that passed was in rax-dfw (same region as git.o.o) | 00:26 |
| jeblair | the depends on should not cause that error | 00:27 |
| *** ddieterly has joined #openstack-infra | 00:27 | |
| dmsimard | Ah, I figured it was related since the stack trace involved zuul cloner. | 00:27 |
| *** sdake_ has joined #openstack-infra | 00:28 | |
| jeblair | dmsimard: if there is something systemic (other than just repeated bad luck), the nexus is something like version of git on jesse, or non-dfw regions, or both. | 00:28 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/system-config: Add #ara to the list of channels https://review.openstack.org/321229 | 00:29 |
| dmsimard | I added the depends-on back in :P | 00:29 |
| *** bpokorny has quit IRC | 00:29 | |
| jeblair | we will find out :) | 00:29 |
| *** bpokorny has joined #openstack-infra | 00:29 | |
| jeblair | dmsimard: if it fails, keep rechecking and let us know (i'll try to check back in on it tomorrow) | 00:30 |
| dmsimard | I love the zuul queues around this time of the day, I should send patches more often after hours | 00:30 |
| *** bpokorny has quit IRC | 00:30 | |
| dmsimard | sure. | 00:30 |
| *** nwkarsten has joined #openstack-infra | 00:30 | |
| jeblair | dmsimard: we run few jobs on jesse, so if there's something systemic, we don't have a lot of data for it | 00:30 |
| *** bpokorny has joined #openstack-infra | 00:30 | |
| *** sdake has quit IRC | 00:30 | |
| jeblair | well, i can wait 30 seconds for the first run at least :) | 00:31 |
| jeblair | success in iad | 00:31 |
| dmsimard | hah, it passed | 00:31 |
| *** ffrank has quit IRC | 00:32 | |
| *** bpokorny has quit IRC | 00:32 | |
| *** _sarob has quit IRC | 00:32 | |
| *** nwkarsten has quit IRC | 00:32 | |
| jeblair | so i think our diagnostics are at "<shrug> it's the internet" at this point | 00:32 |
| *** bpokorny has joined #openstack-infra | 00:32 | |
| *** roxanaghe has quit IRC | 00:32 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update Cucumber Reports plugin https://review.openstack.org/321309 | 00:32 |
| *** thorst_ has joined #openstack-infra | 00:33 | |
| clarkb | russellb: ^ are cucumber reports what you make python pickles out of? | 00:33 |
| *** phschwartz has quit IRC | 00:34 | |
| *** kzaitsev_mb has quit IRC | 00:36 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-openstack_health: Add memcached to api server https://review.openstack.org/321245 | 00:37 |
| openstackgerrit | Jeff Grafton proposed openstack-infra/jenkins-job-builder: Add "every online node" factory to Parameterized Trigger builder https://review.openstack.org/321313 | 00:38 |
| jeblair | jhesketh: where are we on https://review.openstack.org/318979 ? | 00:39 |
| jhesketh | jeblair: yeah, I agree, I don't want to block on it... if we care we can return, but I'm starting to think that we don't | 00:40 |
| jeblair | jhesketh: i mean, i'd like to figure out what's going on with file and how to fix it, but i don't think that's a 5 minute job | 00:41 |
| jeblair | (i already spent 30 minutes on it) | 00:41 |
| jhesketh | sure | 00:41 |
| *** Julien-zte has joined #openstack-infra | 00:42 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: use console.html https://review.openstack.org/321314 | 00:43 |
| *** Julien-zte has quit IRC | 00:43 | |
| jeblair | it looks like if we do that ^ os-loganalyze will continue to linkify the timestamps (even though they are higher precision than jenkins) | 00:44 |
| *** xarses has joined #openstack-infra | 00:44 | |
| *** amitgandhinz has joined #openstack-infra | 00:45 | |
| *** chlong has quit IRC | 00:46 | |
| *** openstackstatus has quit IRC | 00:46 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-meetbot: Add Apache 2.4 syntax https://review.openstack.org/321315 | 00:48 |
| jhesketh | jeblair: cool, will take a look... we can always also tweak the oslog rules | 00:48 |
| *** banix has joined #openstack-infra | 00:48 | |
| pabelanger | will need that for eavesdrop.o.o migration ^ | 00:48 |
| jhesketh | jeblair: how have you gone with spinning up a zuul-ansible node btw? | 00:48 |
| *** amitgandhinz has quit IRC | 00:49 | |
| *** sdake_ has quit IRC | 00:50 | |
| *** openstack has joined #openstack-infra | 00:54 | |
| *** cody-somerville_ has joined #openstack-infra | 00:56 | |
| *** anteaya has quit IRC | 00:59 | |
| *** hichihara has joined #openstack-infra | 01:01 | |
| *** tojuvone_ has joined #openstack-infra | 01:01 | |
| *** zhurong has joined #openstack-infra | 01:04 | |
| *** akscram has joined #openstack-infra | 01:05 | |
| *** tojuvone has quit IRC | 01:06 | |
| *** bpokorny has quit IRC | 01:06 | |
| *** piet has quit IRC | 01:10 | |
| jeblair | jhesketh: zl01 is ready for a sustained production trial; i will put it into production tomorrow | 01:10 |
| jhesketh | that's awesome | 01:11 |
| jhesketh | love your work :-) | 01:11 |
| jeblair | jhesketh: it ran some jobs earlier (you can find the log links in scrollback probably) | 01:11 |
| *** tonytan4ever has joined #openstack-infra | 01:11 | |
| *** ddieterly is now known as ddieterly[away] | 01:11 | |
| *** ddieterly[away] is now known as ddieterly | 01:12 | |
| *** Qiming has joined #openstack-infra | 01:13 | |
| pabelanger | jeblair: is the javascript it place? | 01:14 |
| pabelanger | I'm really excited to see telnet:// | 01:14 |
| *** cody-somerville has quit IRC | 01:15 | |
| *** shashank_hegde has quit IRC | 01:16 | |
| *** kgiusti has left #openstack-infra | 01:16 | |
| *** cody-somerville_ has quit IRC | 01:17 | |
| *** piet has joined #openstack-infra | 01:18 | |
| *** iremizov has quit IRC | 01:19 | |
| russellb | clarkb: not sure if serious or joking ..... | 01:20 |
| russellb | ¯\_(ツ)_/¯ | 01:20 |
| *** iremizov has joined #openstack-infra | 01:20 | |
| *** kien-ha has joined #openstack-infra | 01:20 | |
| *** tlian has joined #openstack-infra | 01:20 | |
| *** hockeynut has quit IRC | 01:21 | |
| *** hockeynut has joined #openstack-infra | 01:21 | |
| *** pvaneck has quit IRC | 01:23 | |
| *** tlian2 has quit IRC | 01:23 | |
| *** warpc has quit IRC | 01:23 | |
| *** warpc has joined #openstack-infra | 01:25 | |
| *** sdake has quit IRC | 01:25 | |
| openstackgerrit | Liu Qing proposed openstack/diskimage-builder: Fix variable unbound error while REPOREF="*" https://review.openstack.org/320859 | 01:28 |
| *** piet has quit IRC | 01:31 | |
| *** Daisy has joined #openstack-infra | 01:32 | |
| *** Daisy has quit IRC | 01:32 | |
| *** yanyanhu has joined #openstack-infra | 01:32 | |
| *** Daisy has joined #openstack-infra | 01:32 | |
| *** ddieterly has quit IRC | 01:33 | |
| *** roxanaghe has joined #openstack-infra | 01:33 | |
| tonyb | How do I track down why $job (gate-grenade-dsvm-multinode) is returning NOT_REGISTERD ? | 01:33 |
| *** zhurong has quit IRC | 01:35 | |
| *** zhurong has joined #openstack-infra | 01:36 | |
| pabelanger | tonyb: recheck should fix it. As for the reason, we restarted zuul this afternoon. Jobs were likely requeue before the job was registered in zuul | 01:37 |
| *** roxanaghe has quit IRC | 01:38 | |
| tonyb | pabelanger: Ahh cool. Thanks. | 01:38 |
| openstackgerrit | Merged openstack-infra/project-config: Remove integrated jobs from neutron-dynamic-routing project config https://review.openstack.org/320777 | 01:38 |
| openstackgerrit | Merged openstack-infra/project-config: Add jobs for Designate gdnsd and djbdns backends https://review.openstack.org/320625 | 01:42 |
| *** Apoorva has quit IRC | 01:43 | |
| *** Daisy has quit IRC | 01:44 | |
| *** Daisy has joined #openstack-infra | 01:44 | |
| *** amitgandhinz has joined #openstack-infra | 01:46 | |
| *** ddieterly has joined #openstack-infra | 01:47 | |
| *** salv-orlando has joined #openstack-infra | 01:48 | |
| *** Daisy has quit IRC | 01:49 | |
| dmsimard | pabelanger: sudo access is not required | 01:49 |
| dmsimard | is there a template for disabling it ? | 01:49 |
| *** openstackgerrit has quit IRC | 01:49 | |
| *** jamesmcarthur has quit IRC | 01:50 | |
| *** yamamot__ has joined #openstack-infra | 01:50 | |
| *** salv-orlando has quit IRC | 01:50 | |
| yanyanhu | hi, guys, very appreciated if anyone can help to review and approve the following patch. We really need it verify our changes, thank you so much. | 01:51 |
| yanyanhu | https://review.openstack.org/318453 | 01:51 |
| *** ddieterly is now known as ddieterly[away] | 01:51 | |
| *** ddieterly[away] is now known as ddieterly | 01:51 | |
| *** amitgandhinz has quit IRC | 01:51 | |
| *** zul has joined #openstack-infra | 01:52 | |
| *** rhallisey has quit IRC | 01:53 | |
| *** cody-somerville has joined #openstack-infra | 01:53 | |
| *** cody-somerville has joined #openstack-infra | 01:53 | |
| *** tonytan4ever has quit IRC | 01:55 | |
| *** Daisy has joined #openstack-infra | 01:57 | |
| *** openstackgerrit has joined #openstack-infra | 01:57 | |
| *** cody-somerville has quit IRC | 01:58 | |
| *** jerryz has quit IRC | 01:58 | |
| *** chlong has joined #openstack-infra | 01:59 | |
| openstackgerrit | Merged openstack/os-testr: Add whitelist file to ostestr docs https://review.openstack.org/314775 | 02:00 |
| *** jamesmcarthur has joined #openstack-infra | 02:02 | |
| *** zqfan has joined #openstack-infra | 02:03 | |
| *** yamamot__ has quit IRC | 02:05 | |
| *** cody-somerville_ has joined #openstack-infra | 02:07 | |
| openstackgerrit | Merged openstack-infra/system-config: Add timestamps to all stages of mirror scripts https://review.openstack.org/318824 | 02:07 |
| *** vhosakot has quit IRC | 02:13 | |
| *** vhosakot has joined #openstack-infra | 02:13 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-openstack_health: Add memcached to api server https://review.openstack.org/321245 | 02:14 |
| *** ddieterly has quit IRC | 02:15 | |
| *** sdague has quit IRC | 02:15 | |
| jhesketh | ianw: how did you manage to go from patchset 4 to 6? https://review.openstack.org/#/c/289678 | 02:16 |
| *** vhosakot has quit IRC | 02:16 | |
| *** vhosakot has joined #openstack-infra | 02:17 | |
| *** Sam-I-Am has quit IRC | 02:17 | |
| *** Sam-I-Am has joined #openstack-infra | 02:17 | |
| *** sdake has joined #openstack-infra | 02:19 | |
| ianw | jhesketh: yeah, the magic missing patchset | 02:23 |
| *** Daisy has quit IRC | 02:23 | |
| ianw | i think i did "git review" right at about 10am sydney time, which is i think when the backups start and everything goes crazy for a few minutes | 02:23 |
| jhesketh | hmm weird | 02:23 |
| jhesketh | well, at least you're a wizard now | 02:23 |
| *** Daisy has joined #openstack-infra | 02:24 | |
| *** asettle has joined #openstack-infra | 02:24 | |
| ianw | if you look behind your ear ... patch set 5. ta-da! | 02:24 |
| jhesketh | haha | 02:24 |
| *** burgerk has joined #openstack-infra | 02:25 | |
| *** kien-ha has quit IRC | 02:28 | |
| openstackgerrit | Merged openstack-infra/system-config: Add #openstack-higgins to statusbot and meetbot https://review.openstack.org/316378 | 02:28 |
| openstackgerrit | Fei Long Wang proposed openstack-infra/project-config: Add api-ref job for Zaqar https://review.openstack.org/321324 | 02:29 |
| *** asettle has quit IRC | 02:29 | |
| openstackgerrit | Merged openstack-infra/system-config: Update docs that JJB is not the cause of CSRF issues https://review.openstack.org/314135 | 02:31 |
| openstackgerrit | Merged openstack-infra/system-config: Add more lvm commands to cinder documentation https://review.openstack.org/306059 | 02:32 |
| *** Daisy_ has joined #openstack-infra | 02:35 | |
| *** sflanigan has quit IRC | 02:37 | |
| *** sflanigan_ has joined #openstack-infra | 02:37 | |
| *** openstack has joined #openstack-infra | 02:39 | |
| *** Daisy has quit IRC | 02:39 | |
| *** burgerk has quit IRC | 02:39 | |
| *** amitgandhinz has joined #openstack-infra | 02:48 | |
| *** Daisy_ has quit IRC | 02:50 | |
| *** yuanying has quit IRC | 02:50 | |
| *** Daisy has joined #openstack-infra | 02:51 | |
| *** thorst_ has quit IRC | 02:51 | |
| *** thorst_ has joined #openstack-infra | 02:52 | |
| *** amitgandhinz has quit IRC | 02:53 | |
| *** tlian has quit IRC | 02:55 | |
| *** Daisy has quit IRC | 02:55 | |
| *** ddieterly has joined #openstack-infra | 02:57 | |
| *** zhurong has quit IRC | 02:59 | |
| *** zhurong has joined #openstack-infra | 03:00 | |
| *** thorst_ has quit IRC | 03:00 | |
| *** sdake_ has joined #openstack-infra | 03:00 | |
| *** cody-somerville_ has quit IRC | 03:01 | |
| *** Daisy has joined #openstack-infra | 03:01 | |
| *** sdake has quit IRC | 03:02 | |
| ianw | pabelanger: here's a new one http://logs.openstack.org/46/318746/5/check/gate-tempest-dsvm-platform-centos7-nv/155511e/ <- completely blank | 03:02 |
| *** rfolco has quit IRC | 03:03 | |
| *** sdake_ is now known as sdake | 03:05 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config: Create the ARA project https://review.openstack.org/321226 | 03:09 |
| dmsimard | pabelanger: ^ updated with your input, thanks. | 03:09 |
| *** kushal has joined #openstack-infra | 03:10 | |
| *** eliqiao has quit IRC | 03:21 | |
| *** eliqiao has joined #openstack-infra | 03:22 | |
| *** julim has joined #openstack-infra | 03:24 | |
| *** ddieterly is now known as ddieterly[away] | 03:25 | |
| *** asettle has joined #openstack-infra | 03:25 | |
| *** ddieterly[away] is now known as ddieterly | 03:25 | |
| *** ddieterly is now known as ddieterly[away] | 03:25 | |
| *** shashank_hegde has joined #openstack-infra | 03:26 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config: Create the ARA project https://review.openstack.org/321226 | 03:26 |
| *** baoli has quit IRC | 03:26 | |
| *** jamesmcarthur has quit IRC | 03:28 | |
| *** asettle has quit IRC | 03:29 | |
| *** julim has quit IRC | 03:30 | |
| *** yuanying has joined #openstack-infra | 03:30 | |
| *** armax has quit IRC | 03:32 | |
| *** jamesmcarthur has joined #openstack-infra | 03:32 | |
| *** links has joined #openstack-infra | 03:34 | |
| *** roxanaghe has joined #openstack-infra | 03:34 | |
| *** sflanigan is now known as sflanigan_afk | 03:38 | |
| *** roxanaghe has quit IRC | 03:39 | |
| *** cody-somerville_ has joined #openstack-infra | 03:40 | |
| *** Douhet has quit IRC | 03:41 | |
| *** fawadkhaliq has joined #openstack-infra | 03:42 | |
| *** mescanef has quit IRC | 03:43 | |
| *** mescanef has joined #openstack-infra | 03:43 | |
| *** banix has quit IRC | 03:44 | |
| *** fbo has quit IRC | 03:44 | |
| *** yuanying has quit IRC | 03:45 | |
| *** dimtruck is now known as zz_dimtruck | 03:45 | |
| *** mhu has quit IRC | 03:45 | |
| *** lewo has quit IRC | 03:45 | |
| *** piet has joined #openstack-infra | 03:46 | |
| *** rfolco has joined #openstack-infra | 03:46 | |
| *** lewo has joined #openstack-infra | 03:47 | |
| *** mhu has joined #openstack-infra | 03:47 | |
| *** Daisy_ has joined #openstack-infra | 03:47 | |
| *** yuanying has joined #openstack-infra | 03:47 | |
| *** zz_dimtruck is now known as dimtruck | 03:48 | |
| *** fbo has joined #openstack-infra | 03:48 | |
| *** amitgandhinz has joined #openstack-infra | 03:49 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config: Remove forked bandersnatch https://review.openstack.org/321338 | 03:49 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config: Revert "Work around bandersnatch not supporting pep503" https://review.openstack.org/321339 | 03:49 |
| *** Douhet has joined #openstack-infra | 03:49 | |
| ianw | jhesketh: ^ it might be worth a manual run of bandersnatch 1.11 in a virtualenv on one of the mirror hosts just to double check it comes up with sane output | 03:50 |
| ianw | although, they probably can't write to the mirror, and probably don't have room to copy it locally ... hmm | 03:51 |
| *** Daisy has quit IRC | 03:51 | |
| *** amitgandhinz has quit IRC | 03:53 | |
| *** jamesmcarthur has quit IRC | 03:54 | |
| jhesketh | ianw: cool, thanks | 03:55 |
| jhesketh | ianw: from memory we were running a patched version of bandersnatch anyway, so I'm not sure if we'll automatically get 1.11... will take a look | 03:56 |
| *** fawadkhaliq has quit IRC | 03:56 | |
| ianw | jhesketh: that should be change 321338 ... puppet-bandersnatch should default to getting from pip | 03:56 |
| jhesketh | yeah just opened that sorry | 03:56 |
| *** kushal has quit IRC | 03:56 | |
| ianw | so i mean it passes the bandersnatch unit testing ... but i would hate for it to go a bit crazy. i'm pretty sure openstack is the only user of that flag (unless others have started using it in the past few days) | 03:57 |
| *** thorst_ has joined #openstack-infra | 03:58 | |
| jhesketh | ianw: see my comment on the patch | 03:58 |
| *** jamesmcarthur has joined #openstack-infra | 03:58 | |
| *** ramishra has quit IRC | 03:59 | |
| *** sflanigan_afk is now known as sflanigan | 03:59 | |
| ianw | yeah, i guess so | 04:00 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config: Revert "Work around bandersnatch not supporting pep503" https://review.openstack.org/321339 | 04:02 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config: Remove forked bandersnatch https://review.openstack.org/321338 | 04:02 |
| *** piet has quit IRC | 04:03 | |
| *** jamesmcarthur has quit IRC | 04:03 | |
| *** thorst_ has quit IRC | 04:05 | |
| *** shashank_hegde has quit IRC | 04:06 | |
| *** jamielennox is now known as jamielennox|away | 04:08 | |
| *** rlandy has quit IRC | 04:10 | |
| *** jamesmcarthur has joined #openstack-infra | 04:13 | |
| *** shashank_hegde has joined #openstack-infra | 04:13 | |
| jhesketh | ianw: so I'm not sure about the best way to test bandersnatch... I don't really want to re-clone all of pypi and it probably wouldn't fit on the local disk so it'd have to go to afs | 04:14 |
| jhesketh | (well I guess I oculd attach a volume) | 04:14 |
| jhesketh | just not sure how expensive it'd be... maybe it'd be okay though | 04:14 |
| *** chlong has quit IRC | 04:15 | |
| ianw | i'd just presumed mirrors were r/o | 04:16 |
| *** rfolco has quit IRC | 04:16 | |
| *** yamahata has joined #openstack-infra | 04:17 | |
| jhesketh | ianw: what do you mean sorry? | 04:18 |
| ianw | jhesketh: oh, that if you logged into a mirror, put a virtualenv with bandersnatch in /tmp and ran it by hand ... would it work? | 04:19 |
| jhesketh | ianw: it should, but I was more concerned about the bandwidth and disk of doing that... it'd re-download all the packages etc | 04:19 |
| ianw | jhesketh: oh, i mean over the old mirror, so it should just be an update | 04:20 |
| jhesketh | I'm not sure how expensive that is though (ie how large pypi is) | 04:20 |
| *** Daisy has joined #openstack-infra | 04:20 | |
| jhesketh | oh right, I see | 04:20 |
| jhesketh | ianw: how would we check for snaity? just by hand? | 04:20 |
| jhesketh | *sanity | 04:20 |
| ianw | even if it screws up, the theory being the next run of the existing code would fix it back to what it was | 04:20 |
| jhesketh | (I had initially imagined you meant to do a diff between the two) | 04:20 |
| ianw | yeah, just diff of an ls before & after would be illustrative i guess | 04:21 |
| jhesketh | ianw: maybe I could just manually apply your puppet patch and see what happens reverting it if we need to | 04:21 |
| jhesketh | although if it screws up it'll have written to afs and synced across the other mirrors... so it depends how well reverting recovers | 04:21 |
| *** smcginnis has quit IRC | 04:22 | |
| *** jamielennox|away is now known as jamielennox | 04:22 | |
| *** smcginnis has joined #openstack-infra | 04:22 | |
| ianw | jhesketh: i guess in theory another run without it would restore sanity. | 04:23 |
| ianw | in theory | 04:23 |
| *** jamesmcarthur has quit IRC | 04:23 | |
| *** Daisy_ has quit IRC | 04:24 | |
| jhesketh | ianw: I'm not very familiar with bandersnatches internals... If we rm a directory will it notice that and recreate it? | 04:24 |
| *** Daisy has quit IRC | 04:24 | |
| *** psachin has joined #openstack-infra | 04:25 | |
| ianw | jhesketh: i *think* so, but i'm not that familiar with running it either | 04:25 |
| ianw | great help, i know :) | 04:25 |
| *** ddieterly[away] has quit IRC | 04:25 | |
| *** asettle has joined #openstack-infra | 04:25 | |
| jhesketh | heh, maybe I'll take a poke beforehand | 04:26 |
| jhesketh | currently poking at cacti though | 04:26 |
| *** jamesmcarthur has joined #openstack-infra | 04:26 | |
| *** baoli has joined #openstack-infra | 04:27 | |
| *** javeriak has joined #openstack-infra | 04:27 | |
| *** asettle has quit IRC | 04:30 | |
| *** shashank_hegde has quit IRC | 04:33 | |
| *** jamesmcarthur has quit IRC | 04:33 | |
| *** chlong has joined #openstack-infra | 04:34 | |
| *** cody-somerville_ has quit IRC | 04:37 | |
| *** yfried has joined #openstack-infra | 04:39 | |
| *** jamesmcarthur has joined #openstack-infra | 04:39 | |
| *** salv-orlando has joined #openstack-infra | 04:41 | |
| prometheanfire | ianw: thanks :D | 04:44 |
| *** roxanaghe has joined #openstack-infra | 04:47 | |
| *** jamesmcarthur has quit IRC | 04:48 | |
| *** salv-orlando has quit IRC | 04:48 | |
| *** amitgandhinz has joined #openstack-infra | 04:49 | |
| *** jamesmcarthur has joined #openstack-infra | 04:52 | |
| *** amitgandhinz has quit IRC | 04:54 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/system-config: Disable default site for cacti https://review.openstack.org/321352 | 04:55 |
| *** asselin has quit IRC | 04:55 | |
| *** fawadkhaliq has joined #openstack-infra | 04:57 | |
| *** flwang1 has quit IRC | 05:01 | |
| *** jamesmcarthur has quit IRC | 05:03 | |
| *** thorst_ has joined #openstack-infra | 05:03 | |
| *** jaosorior has joined #openstack-infra | 05:05 | |
| *** salv-orlando has joined #openstack-infra | 05:05 | |
| jhesketh | ianw: looks like bandersnatch checks for existing files and re-grabs them if you do a sync from scratch which just involves removing its status file | 05:06 |
| *** jamesmcarthur has joined #openstack-infra | 05:06 | |
| openstackgerrit | Ryota MIBU proposed openstack-infra/project-config: cleanup tempest jobs for ceilometer and aodh https://review.openstack.org/320757 | 05:09 |
| *** thorst_ has quit IRC | 05:09 | |
| *** Daisy has joined #openstack-infra | 05:11 | |
| *** javeriak has quit IRC | 05:13 | |
| *** jamesmcarthur has quit IRC | 05:13 | |
| *** mixos has quit IRC | 05:16 | |
| *** savihou has joined #openstack-infra | 05:18 | |
| *** _vs has joined #openstack-infra | 05:19 | |
| *** jamesmcarthur has joined #openstack-infra | 05:21 | |
| *** yamamot__ has joined #openstack-infra | 05:21 | |
| *** jamesmcarthur has quit IRC | 05:22 | |
| *** yolanda_ has quit IRC | 05:23 | |
| *** _vs has quit IRC | 05:25 | |
| *** asettle has joined #openstack-infra | 05:26 | |
| *** _vs has joined #openstack-infra | 05:27 | |
| *** sridhar_ram_ is now known as sridhar_ram_afk | 05:27 | |
| *** roxanaghe has quit IRC | 05:28 | |
| *** ilyashakhat has joined #openstack-infra | 05:28 | |
| *** sridhar_ram_afk is now known as sridhar_ram | 05:28 | |
| *** dimtruck is now known as zz_dimtruck | 05:29 | |
| *** bnemec has quit IRC | 05:30 | |
| *** javeriak has joined #openstack-infra | 05:31 | |
| *** asettle has quit IRC | 05:31 | |
| *** bnemec has joined #openstack-infra | 05:31 | |
| *** vhosakot has quit IRC | 05:32 | |
| *** mikelk has joined #openstack-infra | 05:33 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Add ironic cleaning job https://review.openstack.org/304473 | 05:33 |
| *** jamielennox is now known as jamielennox|away | 05:33 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Increase tempest baremetal deploy/unprovision timeouts https://review.openstack.org/315545 | 05:33 |
| *** nwkarsten has joined #openstack-infra | 05:36 | |
| *** abregman has joined #openstack-infra | 05:39 | |
| *** baoli has quit IRC | 05:39 | |
| *** nwkarsten has quit IRC | 05:41 | |
| *** Daisy has quit IRC | 05:42 | |
| *** Daisy has joined #openstack-infra | 05:42 | |
| *** bnemec has quit IRC | 05:44 | |
| *** javeriak has quit IRC | 05:46 | |
| *** ramishra has joined #openstack-infra | 05:47 | |
| *** chlong has quit IRC | 05:47 | |
| *** Daisy_ has joined #openstack-infra | 05:50 | |
| *** jamielennox|away is now known as jamielennox | 05:50 | |
| *** _vs has quit IRC | 05:51 | |
| *** bnemec has joined #openstack-infra | 05:52 | |
| *** yolanda_ has joined #openstack-infra | 05:52 | |
| *** roxanaghe has joined #openstack-infra | 05:53 | |
| *** roxanaghe has joined #openstack-infra | 05:53 | |
| *** Daisy has quit IRC | 05:54 | |
| *** sdake has quit IRC | 05:54 | |
| *** rcernin has joined #openstack-infra | 05:54 | |
| openstackgerrit | Yanyan Hu proposed openstack-infra/project-config: Add Senlin support to rally-gate https://review.openstack.org/318453 | 05:59 |
| *** chlong has joined #openstack-infra | 05:59 | |
| *** sdake has joined #openstack-infra | 05:59 | |
| *** roxanaghe has quit IRC | 06:01 | |
| *** vikram has quit IRC | 06:02 | |
| *** eliqiao has quit IRC | 06:06 | |
| *** gyee has quit IRC | 06:07 | |
| *** thorst_ has joined #openstack-infra | 06:07 | |
| *** woodster_ has quit IRC | 06:08 | |
| *** eliqiao has joined #openstack-infra | 06:09 | |
| *** Daisy_ has quit IRC | 06:10 | |
| *** oanson has joined #openstack-infra | 06:11 | |
| *** bnemec has quit IRC | 06:12 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add MysqlInternal endpoint to enable-tls https://review.openstack.org/321363 | 06:12 |
| *** bnemec has joined #openstack-infra | 06:14 | |
| *** thorst_ has quit IRC | 06:14 | |
| *** ilyashakhat has quit IRC | 06:19 | |
| *** jamesmcarthur has joined #openstack-infra | 06:22 | |
| *** bnemec has quit IRC | 06:23 | |
| *** asettle has joined #openstack-infra | 06:27 | |
| *** jamesmcarthur has quit IRC | 06:27 | |
| *** abregman has quit IRC | 06:29 | |
| *** yolanda_ has quit IRC | 06:29 | |
| *** sdake has quit IRC | 06:30 | |
| *** yolanda has joined #openstack-infra | 06:31 | |
| *** asettle has quit IRC | 06:32 | |
| *** bnemec has joined #openstack-infra | 06:36 | |
| *** javeriak has joined #openstack-infra | 06:38 | |
| *** aeng has quit IRC | 06:40 | |
| *** aeng has joined #openstack-infra | 06:43 | |
| *** abregman has joined #openstack-infra | 06:44 | |
| openstackgerrit | Merged openstack-infra/system-config: Remove #openstack-tailgate from list of channels https://review.openstack.org/317952 | 06:44 |
| *** Daisy has joined #openstack-infra | 06:45 | |
| *** _vs has joined #openstack-infra | 06:45 | |
| *** bhavik has joined #openstack-infra | 06:46 | |
| *** aeng has quit IRC | 06:47 | |
| *** Daisy has quit IRC | 06:51 | |
| *** amitgandhinz has joined #openstack-infra | 06:51 | |
| *** openstack has joined #openstack-infra | 06:54 | |
| *** sdake has joined #openstack-infra | 06:54 | |
| *** ioni has joined #openstack-infra | 06:55 | |
| ioni | hello guys | 06:56 |
| *** amitgandhinz has quit IRC | 06:56 | |
| ioni | i'm trying to save my contact information in review.openstack.org and I get the following error | 06:56 |
| ioni | Server Error | 06:56 |
| ioni | Cannot store contact information | 06:56 |
| ioni | I did signed previous OpenStack Individual Contributor License Agreement | 06:57 |
| *** dizquierdo has joined #openstack-infra | 06:57 | |
| ioni | maybe that's the problem? | 06:57 |
| *** javeriak has quit IRC | 06:58 | |
| openstackgerrit | Fredrik Medley proposed openstack-infra/zuul: Improve job dependencies using graph instead of tree https://review.openstack.org/231124 | 06:58 |
| *** javeriak has joined #openstack-infra | 06:59 | |
| *** ccamacho|hungry is now known as ccamacho | 06:59 | |
| *** nwkarsten has joined #openstack-infra | 07:04 | |
| *** ilyashakhat has joined #openstack-infra | 07:05 | |
| *** salv-orlando has quit IRC | 07:05 | |
| *** sflanigan has quit IRC | 07:06 | |
| *** cfarquhar has quit IRC | 07:07 | |
| *** greghaynes has quit IRC | 07:08 | |
| *** isaacb has joined #openstack-infra | 07:08 | |
| *** nwkarsten has quit IRC | 07:08 | |
| *** ilyashakhat has quit IRC | 07:08 | |
| *** arxcruz has joined #openstack-infra | 07:08 | |
| *** jlanoux has joined #openstack-infra | 07:09 | |
| *** thorst_ has joined #openstack-infra | 07:12 | |
| openstackgerrit | Noam Bloom proposed openstack-infra/project-config: Vitrage - Added experimental Job https://review.openstack.org/319847 | 07:12 |
| *** camunoz has quit IRC | 07:13 | |
| *** sdake has quit IRC | 07:13 | |
| *** markvoelker has quit IRC | 07:13 | |
| *** mikelk has quit IRC | 07:14 | |
| *** sdake has joined #openstack-infra | 07:16 | |
| *** vincentll has joined #openstack-infra | 07:18 | |
| *** thorst_ has quit IRC | 07:20 | |
| *** jed56 has joined #openstack-infra | 07:20 | |
| *** cfarquhar has joined #openstack-infra | 07:20 | |
| *** cfarquhar has quit IRC | 07:20 | |
| *** cfarquhar has joined #openstack-infra | 07:20 | |
| *** greghaynes has joined #openstack-infra | 07:21 | |
| *** sdake has quit IRC | 07:21 | |
| *** Julien-zte has joined #openstack-infra | 07:21 | |
| kashyap | Is it possible to select a specific chunk conversation snippet in eavesdrop.o.o? I doubt that from my quick fiddling around. | 07:23 |
| *** nbloom has joined #openstack-infra | 07:24 | |
| *** salv-orlando has joined #openstack-infra | 07:24 | |
| *** Julien-zte has quit IRC | 07:27 | |
| *** shashank_hegde has joined #openstack-infra | 07:28 | |
| *** abregman has quit IRC | 07:32 | |
| *** dtantsur|afk is now known as dtantsur | 07:36 | |
| *** jlanoux has quit IRC | 07:38 | |
| *** binbincong has quit IRC | 07:38 | |
| *** Daisy has joined #openstack-infra | 07:39 | |
| *** binbincong has joined #openstack-infra | 07:39 | |
| *** chem`` has joined #openstack-infra | 07:41 | |
| *** ifarkas has joined #openstack-infra | 07:42 | |
| *** sdake has joined #openstack-infra | 07:44 | |
| *** Daisy has quit IRC | 07:44 | |
| *** sdake has quit IRC | 07:49 | |
| *** sdake has joined #openstack-infra | 07:50 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add MysqlInternal endpoint to enable-tls https://review.openstack.org/321363 | 07:50 |
| *** esikachev has joined #openstack-infra | 07:51 | |
| *** jlanoux has joined #openstack-infra | 07:52 | |
| *** amitgandhinz has joined #openstack-infra | 07:52 | |
| *** jordanP has joined #openstack-infra | 07:56 | |
| *** amitgandhinz has quit IRC | 07:57 | |
| *** pahuang has quit IRC | 07:57 | |
| *** zhurong_ has joined #openstack-infra | 07:57 | |
| *** jordanP has quit IRC | 07:58 | |
| *** jordanP has joined #openstack-infra | 07:58 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** hashar has joined #openstack-infra | 08:00 | |
| *** matrohon has joined #openstack-infra | 08:01 | |
| *** zhurong has quit IRC | 08:01 | |
| *** zzzeek has joined #openstack-infra | 08:01 | |
| *** javeriak has quit IRC | 08:02 | |
| *** jlanoux has quit IRC | 08:03 | |
| *** Odd_Bloke has quit IRC | 08:04 | |
| *** salv-orlando has quit IRC | 08:04 | |
| *** asettle has joined #openstack-infra | 08:04 | |
| *** chlong has quit IRC | 08:04 | |
| *** Odd_Bloke has joined #openstack-infra | 08:04 | |
| *** jlanoux has joined #openstack-infra | 08:05 | |
| *** nwkarsten has joined #openstack-infra | 08:05 | |
| *** pilgrimstack has joined #openstack-infra | 08:06 | |
| *** hichihara has quit IRC | 08:07 | |
| *** dtantsur is now known as dtantsur|bbl | 08:07 | |
| *** javeriak has joined #openstack-infra | 08:08 | |
| *** Odd_Bloke has quit IRC | 08:08 | |
| ioni | is there a way to delete a review that i have abandoned? | 08:09 |
| *** nwkarsten has quit IRC | 08:10 | |
| ioni | i failed and submit a broken patch set | 08:10 |
| *** shashank_hegde has quit IRC | 08:10 | |
| *** afazekas is now known as afazekas|sick | 08:12 | |
| *** ihrachys has joined #openstack-infra | 08:12 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Stop jobs for kilo of ofagent https://review.openstack.org/317142 | 08:13 |
| *** tqtran has joined #openstack-infra | 08:17 | |
| *** thorst_ has joined #openstack-infra | 08:17 | |
| *** electrofelix has joined #openstack-infra | 08:18 | |
| *** javeriak has quit IRC | 08:18 | |
| *** javeriak has joined #openstack-infra | 08:19 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/devstack-gate: Use local.conf instead of localrc in devstack configuration https://review.openstack.org/311668 | 08:21 |
| *** lucas-dinner is now known as lucasagmes | 08:22 | |
| *** lucasagmes is now known as lucasagomes | 08:22 | |
| *** dmk0202 has joined #openstack-infra | 08:23 | |
| *** nadya has quit IRC | 08:23 | |
| *** HeOS has joined #openstack-infra | 08:24 | |
| *** HeOS has quit IRC | 08:24 | |
| *** HeOS has joined #openstack-infra | 08:24 | |
| craige | You can abandon a change, ioni | 08:25 |
| *** thorst_ has quit IRC | 08:25 | |
| ioni | craige, did that already | 08:25 |
| ioni | but i so silly that i'm ashamed that i failed so hard :D | 08:25 |
| ioni | i wanna delete it :D | 08:25 |
| craige | Then you're done. Unless you're question is about deleting an abandoned change. | 08:25 |
| craige | Ah yep. I've no answer for you. | 08:26 |
| ioni | alright | 08:26 |
| *** Daisy has joined #openstack-infra | 08:26 | |
| *** tqtran has quit IRC | 08:28 | |
| *** dingyichen has quit IRC | 08:28 | |
| *** yolanda_ has joined #openstack-infra | 08:30 | |
| *** Daisy has quit IRC | 08:30 | |
| *** sshnaidm has quit IRC | 08:34 | |
| *** matrohon has quit IRC | 08:37 | |
| *** dizquierdo has quit IRC | 08:37 | |
| *** Daisy has joined #openstack-infra | 08:37 | |
| *** matrohon has joined #openstack-infra | 08:38 | |
| *** derekh has joined #openstack-infra | 08:39 | |
| *** mandre has joined #openstack-infra | 08:40 | |
| *** tosky has joined #openstack-infra | 08:40 | |
| *** Daisy has quit IRC | 08:42 | |
| *** Daisy has joined #openstack-infra | 08:42 | |
| *** Daisy_ has joined #openstack-infra | 08:43 | |
| *** jaosorior is now known as jaosorior_lunch | 08:45 | |
| *** Odd_Bloke has joined #openstack-infra | 08:46 | |
| *** Daisy has quit IRC | 08:47 | |
| *** pbourke_ has quit IRC | 08:48 | |
| *** pbourke_ has joined #openstack-infra | 08:48 | |
| *** amitgandhinz has joined #openstack-infra | 08:53 | |
| mandre | dirk: hi! regarding your comment on https://review.openstack.org/#/c/321379/ | 08:54 |
| mandre | thanks for pointing me to the new requirements checklist | 08:54 |
| mandre | I'll update the commit message accordingly | 08:54 |
| *** markusry has joined #openstack-infra | 08:56 | |
| *** yolanda_ has quit IRC | 08:56 | |
| *** amitgandhinz has quit IRC | 08:58 | |
| *** daemontool has joined #openstack-infra | 08:58 | |
| *** yolanda_ has joined #openstack-infra | 08:59 | |
| *** markus__ has joined #openstack-infra | 08:59 | |
| *** jtomasek_ has joined #openstack-infra | 09:00 | |
| *** amoralej has joined #openstack-infra | 09:01 | |
| *** markusry has quit IRC | 09:01 | |
| *** jtomasek_ has quit IRC | 09:02 | |
| *** tesseract has joined #openstack-infra | 09:02 | |
| *** jtomasek_ has joined #openstack-infra | 09:02 | |
| *** matrohon has quit IRC | 09:04 | |
| *** ociuhandu has quit IRC | 09:05 | |
| *** matrohon has joined #openstack-infra | 09:05 | |
| *** nijaba has quit IRC | 09:06 | |
| *** nijaba has joined #openstack-infra | 09:07 | |
| *** strigazi has joined #openstack-infra | 09:08 | |
| *** jtomasek_ has quit IRC | 09:08 | |
| electrofelix | is there any support for a triggered job to return 3 different exit states? e.g. 0 => success, 1 => failure, 2 => warning or is it purely success/failure? | 09:08 |
| strigazi | Hi openstack-infra team, I want to add a non-voting job to rally for magnum. please give me some feedback. | 09:10 |
| strigazi | #link https://review.openstack.org/#/c/321026 | 09:10 |
| *** cdent has joined #openstack-infra | 09:13 | |
| *** watanabe_isao has quit IRC | 09:13 | |
| *** markvoelker has joined #openstack-infra | 09:14 | |
| *** eezhova has joined #openstack-infra | 09:14 | |
| *** flwang1 has joined #openstack-infra | 09:16 | |
| *** wznoinsk_ is now known as wznoinsk | 09:17 | |
| dirk | mandre: thanks a lot in advance! | 09:17 |
| *** sambetts|afk is now known as sambetts | 09:18 | |
| *** yolanda_ has quit IRC | 09:19 | |
| *** markvoelker has quit IRC | 09:21 | |
| *** thorst_ has joined #openstack-infra | 09:22 | |
| *** Daisy_ has quit IRC | 09:24 | |
| *** Daisy has joined #openstack-infra | 09:27 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:28 | |
| *** dtantsur|bbl is now known as dtantsur | 09:28 | |
| *** matrohon has quit IRC | 09:28 | |
| *** matrohon has joined #openstack-infra | 09:29 | |
| *** Daisy_ has joined #openstack-infra | 09:30 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Add playbook/role to make swap on nodes https://review.openstack.org/321438 | 09:30 |
| *** sshnaidm has joined #openstack-infra | 09:30 | |
| *** thorst_ has quit IRC | 09:30 | |
| *** nadya has joined #openstack-infra | 09:31 | |
| *** Daisy__ has joined #openstack-infra | 09:31 | |
| *** Daisy has quit IRC | 09:32 | |
| mandre | dirk: actually I realized we need to publish a release of packages on pypi before submitting them as new requirements, which is not yet the case for tripleo-validations | 09:34 |
| mandre | I'll mark the patch as WIP | 09:34 |
| *** Daisy_ has quit IRC | 09:34 | |
| mandre | I was blindly following the doc at http://docs.openstack.org/infra/manual/creators.html#add-project-to-the-requirements-list... | 09:34 |
| *** jaosorior_lunch is now known as jaosorior | 09:35 | |
| *** Daisy__ has quit IRC | 09:36 | |
| *** salv-orlando has joined #openstack-infra | 09:36 | |
| *** Ravikiran_K has joined #openstack-infra | 09:36 | |
| *** matrohon has quit IRC | 09:37 | |
| sshnaidm | please, system-config cores, I'd appreciate your approve here: https://review.openstack.org/#/c/312985/ | 09:38 |
| *** matrohon has joined #openstack-infra | 09:39 | |
| *** kzaitsev_mb has quit IRC | 09:42 | |
| *** tsufiev has joined #openstack-infra | 09:44 | |
| *** yamamot__ has quit IRC | 09:50 | |
| *** sdague has joined #openstack-infra | 09:51 | |
| *** cdent has quit IRC | 09:51 | |
| *** fawadkhaliq has quit IRC | 09:57 | |
| *** fawadkhaliq has joined #openstack-infra | 09:58 | |
| *** javeriak_ has joined #openstack-infra | 09:58 | |
| *** javeriak has quit IRC | 09:58 | |
| *** ilyashakhat has joined #openstack-infra | 10:02 | |
| *** mikelk has joined #openstack-infra | 10:04 | |
| *** nwkarsten has joined #openstack-infra | 10:07 | |
| *** Qiming has quit IRC | 10:08 | |
| *** zhurong_ has quit IRC | 10:08 | |
| *** yanyanhu has quit IRC | 10:09 | |
| *** nwkarsten has quit IRC | 10:11 | |
| *** rhallisey has joined #openstack-infra | 10:16 | |
| *** kushal has joined #openstack-infra | 10:18 | |
| *** _degorenko|afk is now known as degorenko | 10:24 | |
| sdague | could someone review to get unit tests added for os-api-ref - https://review.openstack.org/#/c/321176/ - now that they are working | 10:25 |
| *** thorst_ has joined #openstack-infra | 10:28 | |
| *** thorst_ has quit IRC | 10:35 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Add playbook to launch a new node https://review.openstack.org/320466 | 10:37 |
| *** amitgandhinz has joined #openstack-infra | 10:42 | |
| *** Daisy has joined #openstack-infra | 10:44 | |
| *** amitgandhinz has quit IRC | 10:47 | |
| *** ociuhandu has joined #openstack-infra | 10:48 | |
| *** Daisy has quit IRC | 10:48 | |
| *** rhallisey has quit IRC | 10:49 | |
| sdague | anyone about that could help me figure out a post job issue? | 10:49 |
| sdague | I'd like to get the os-api-ref docs out there for folks | 10:50 |
| *** mariojmdavid has joined #openstack-infra | 10:54 | |
| *** bhavik has quit IRC | 10:55 | |
| mariojmdavid | hi all, my first time here, I have made code contribution, had to make several patches, and 2 days ago jenkins run, but had a failure which I believe was due to some error in the jenkins run, not in the last patch I made | 10:56 |
| mariojmdavid | it has been stuck there, so is there a way to rerun jenkins? | 10:57 |
| mariojmdavid | https://review.openstack.org/#/c/316987/5 | 10:57 |
| *** yolanda has quit IRC | 10:57 | |
| sdague | mariojmdavid: type "check" in the comment box | 10:57 |
| sdague | sorry "recheck" | 10:58 |
| mariojmdavid | thnks, let me do that | 10:58 |
| *** nadya has quit IRC | 10:58 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:58 | |
| *** ilyashakhat has quit IRC | 10:58 | |
| *** Qiming has joined #openstack-infra | 10:59 | |
| mariojmdavid | you meant in the "reply" button, I this view I have no comment box!! | 11:01 |
| nbloom | yes, under "reply" | 11:02 |
| mariojmdavid | ok it's doe, and now wait :D thanks | 11:02 |
| *** yolanda has joined #openstack-infra | 11:04 | |
| *** links has quit IRC | 11:08 | |
| openstackgerrit | Dirk Mueller proposed openstack-infra/project-config: Add check-requirements and publish-to-pypi to renderspec/pymod2pkg https://review.openstack.org/321473 | 11:09 |
| *** YorikSar has quit IRC | 11:10 | |
| *** YorikSar has joined #openstack-infra | 11:12 | |
| *** eezhova has quit IRC | 11:12 | |
| *** _vs has quit IRC | 11:13 | |
| *** e0ne has joined #openstack-infra | 11:16 | |
| *** e0ne has quit IRC | 11:16 | |
| *** markvoelker has joined #openstack-infra | 11:16 | |
| openstackgerrit | Isaac Beckman proposed openstack-infra/nodepool: Add log config option to nodepool cmd https://review.openstack.org/321480 | 11:17 |
| *** ccamacho is now known as ccamacho|lunch | 11:18 | |
| *** e0ne has joined #openstack-infra | 11:18 | |
| *** nwkarsten has joined #openstack-infra | 11:19 | |
| *** raildo-afk is now known as raildo | 11:20 | |
| *** markvoelker has quit IRC | 11:21 | |
| *** eezhova has joined #openstack-infra | 11:21 | |
| *** jamesmcarthur has joined #openstack-infra | 11:28 | |
| *** sheeprine has quit IRC | 11:30 | |
| *** wendar has quit IRC | 11:31 | |
| *** wendar has joined #openstack-infra | 11:31 | |
| *** zz_dimtruck has quit IRC | 11:32 | |
| *** rhallisey has joined #openstack-infra | 11:32 | |
| *** jamesmcarthur has quit IRC | 11:32 | |
| *** julim has joined #openstack-infra | 11:32 | |
| *** docaedo has quit IRC | 11:33 | |
| *** sheeprine has joined #openstack-infra | 11:33 | |
| *** docaedo has joined #openstack-infra | 11:35 | |
| *** zz_dimtruck has joined #openstack-infra | 11:35 | |
| *** YorikSar has quit IRC | 11:35 | |
| *** zz_dimtruck is now known as dimtruck | 11:35 | |
| *** mariojmdavid has quit IRC | 11:37 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Nothing to see here https://review.openstack.org/321113 | 11:37 |
| *** YorikSar has joined #openstack-infra | 11:37 | |
| *** kzaitsev_mb has quit IRC | 11:40 | |
| *** amitgandhinz has joined #openstack-infra | 11:42 | |
| *** nadya has joined #openstack-infra | 11:45 | |
| *** amitgandhinz has quit IRC | 11:48 | |
| *** thorst_ has joined #openstack-infra | 11:49 | |
| *** flepied has joined #openstack-infra | 11:52 | |
| *** Goneri has quit IRC | 11:53 | |
| *** yamamoto has joined #openstack-infra | 11:56 | |
| *** dizquierdo has joined #openstack-infra | 11:57 | |
| *** javeriak_ has quit IRC | 11:57 | |
| *** kgiusti has joined #openstack-infra | 11:59 | |
| *** jaosorior has quit IRC | 12:00 | |
| *** mariojmdavid has joined #openstack-infra | 12:00 | |
| *** jaosorior has joined #openstack-infra | 12:00 | |
| *** julim has quit IRC | 12:03 | |
| *** afred312_ has quit IRC | 12:03 | |
| *** gordc has joined #openstack-infra | 12:05 | |
| *** pradk has joined #openstack-infra | 12:05 | |
| *** markvoelker has joined #openstack-infra | 12:08 | |
| *** anteaya has joined #openstack-infra | 12:08 | |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config: [magnum] Add rally job for magnum https://review.openstack.org/321026 | 12:09 |
| *** javeriak has joined #openstack-infra | 12:10 | |
| *** trown|outtypewww is now known as trown | 12:10 | |
| openstackgerrit | Merged openstack-infra/storyboard: Avoid false positives when filtering projects by subscriber https://review.openstack.org/307756 | 12:11 |
| *** yamahata has quit IRC | 12:12 | |
| *** ddieterly has joined #openstack-infra | 12:13 | |
| *** piet has joined #openstack-infra | 12:14 | |
| *** eezhova has quit IRC | 12:15 | |
| *** dprince has joined #openstack-infra | 12:19 | |
| *** amoralej is now known as amoralej|lunch | 12:19 | |
| *** matrohon has quit IRC | 12:19 | |
| *** matrohon has joined #openstack-infra | 12:21 | |
| *** ddieterly is now known as ddieterly[away] | 12:23 | |
| *** kzaitsev_mb has joined #openstack-infra | 12:23 | |
| *** resker has joined #openstack-infra | 12:24 | |
| *** resker has quit IRC | 12:27 | |
| *** resker has joined #openstack-infra | 12:27 | |
| *** piet has quit IRC | 12:27 | |
| *** esker has quit IRC | 12:28 | |
| *** |-paul-| has joined #openstack-infra | 12:30 | |
| *** yamamoto has quit IRC | 12:30 | |
| *** yamamoto has joined #openstack-infra | 12:30 | |
| *** Daisy has joined #openstack-infra | 12:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Removing #openstack-tailgate IRC channel from list https://review.openstack.org/317954 | 12:33 |
| *** afred312 has joined #openstack-infra | 12:34 | |
| *** rodrigods has quit IRC | 12:34 | |
| *** rodrigods has joined #openstack-infra | 12:34 | |
| anteaya | sdague: I'm not much help on post jobs | 12:37 |
| sdague | anteaya: ok, no problem | 12:37 |
| sdague | apparently they worked today | 12:37 |
| anteaya | electrofelix: well as far as I know, jenkins just understands success or failure | 12:37 |
| sdague | so... *shrug* | 12:37 |
| anteaya | sdague: yay working jobs | 12:37 |
| *** vgridnev has quit IRC | 12:37 | |
| anteaya | electrofelix: now, since we are moving/have moved to zuul 2.5 I don't know what zuul understands or if jeblair is willing to expand what zuul understands | 12:38 |
| *** tlian has joined #openstack-infra | 12:38 | |
| anteaya | electrofelix: but without checking anything I would lean toward the default of success failure | 12:38 |
| *** piet has joined #openstack-infra | 12:39 | |
| anteaya | ioni: there is no way to delete an abandoned patchset, we all fail | 12:39 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Add playbook to launch a new node https://review.openstack.org/320466 | 12:40 |
| anteaya | ioni: my definition of success in open source is the ability to fail in public and continue to get up in the morning and work | 12:40 |
| anteaya | ioni: welcome to the club | 12:40 |
| gema | anteaya: thanks! | 12:41 |
| jroll | sdague: what sort of issue? there was a networking event in rax-iad last night, could be related | 12:41 |
| anteaya | gema: please tell me you are working on some other openstack project | 12:41 |
| gema | anteaya: working with the defcore guys :D | 12:41 |
| anteaya | gema: folks who follow up on things and communicate are sorely needed | 12:41 |
| anteaya | gema: okay great | 12:41 |
| anteaya | I thought defcore had some women on the team? | 12:42 |
| gema | yes, there's a few of us | 12:42 |
| electrofelix | anteaya: thanks, I suspected that but wasn't sure if the infra might have had 'Text-finder' plugin or something similar that would allow downgrading of a job if the output contained a certain string. | 12:42 |
| *** salv-orlando has quit IRC | 12:42 | |
| *** ddieterly[away] is now known as ddieterly | 12:42 | |
| anteaya | kashyap: you can link to the beginning of a conversation, like so: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-05-26.log.html#t2016-05-26T07:23:42 the only way to have just that conversation as far as I know is put it in a paste | 12:43 |
| anteaya | electrofelix: that is a different question and a good one | 12:43 |
| *** amitgandhinz has joined #openstack-infra | 12:43 | |
| anteaya | electrofelix: I don't know the answer to that question | 12:43 |
| anteaya | gema: ah good, glad to hear it | 12:43 |
| kashyap | anteaya: I'm familiar w/ the beginning of it -- just click on the time-stamp. I was looking more like GitHub's code-snippet highlight... | 12:44 |
| anteaya | right, our eavesdrop currently has no such feature | 12:44 |
| *** salv-orlando has joined #openstack-infra | 12:44 | |
| anteaya | the good news is it is open source so you could offer a patch | 12:44 |
| electrofelix | anteaya: I might be able to do it with http://stackoverflow.com/questions/8148122/how-to-mark-a-build-unstable-in-jenkins-when-running-shell-scripts but wary about portability | 12:44 |
| *** Daisy has quit IRC | 12:44 | |
| anteaya | electrofelix: I understand, also for our system we have moved/are moving away from jenkins | 12:45 |
| anteaya | electrofelix: so if the jenkins in the response is your jenkins, it may work | 12:45 |
| *** claudiub has joined #openstack-infra | 12:46 | |
| *** baoli has joined #openstack-infra | 12:46 | |
| electrofelix | anteaya: not the case, this is intended for a job to be added to JJB check/gate | 12:46 |
| *** deadnull_ has joined #openstack-infra | 12:47 | |
| anteaya | electrofelix: okay, hope you find something that works | 12:47 |
| *** amitgandhinz has quit IRC | 12:48 | |
| anteaya | electrofelix: and it looks like we are about to take the first step away from jenkins today: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-05-26.log.html#t2016-05-26T01:10:54 | 12:48 |
| *** rlandy has joined #openstack-infra | 12:48 | |
| *** julim has joined #openstack-infra | 12:49 | |
| *** baoli_ has joined #openstack-infra | 12:49 | |
| *** burgerk has joined #openstack-infra | 12:49 | |
| *** zhurong has joined #openstack-infra | 12:51 | |
| *** burgerk has quit IRC | 12:51 | |
| *** burgerk has joined #openstack-infra | 12:51 | |
| *** baoli has quit IRC | 12:52 | |
| *** matt-borland has joined #openstack-infra | 12:52 | |
| *** yamamoto has quit IRC | 12:52 | |
| electrofelix | anteaya: Is there a pointer to what build statuses are supported by zuul? | 12:52 |
| *** piet has quit IRC | 12:53 | |
| ioni | anteaya, i know how this stuff works :D | 12:53 |
| ioni | thanks for letting me know that i cannot delete it | 12:53 |
| *** yamamoto has joined #openstack-infra | 12:54 | |
| *** rhochmuth has joined #openstack-infra | 12:54 | |
| ioni | i asked because i've read here: https://review.openstack.org/Documentation/cmd-review.html | 12:55 |
| ioni | there was a delete command | 12:55 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Add playbook to launch a new node https://review.openstack.org/320466 | 12:55 |
| anteaya | ioni: oh good, I'm glad you know how this stuff works | 12:56 |
| anteaya | sure gerrit has lots of commands | 12:56 |
| electrofelix | anteaya: it's ok, think I've found them in zuul/scheduler.py. | 12:56 |
| anteaya | not all of them are exposed | 12:56 |
| *** mariojmdavid has quit IRC | 12:56 | |
| anteaya | electrofelix: awesome | 12:56 |
| ioni | anteaya, i failed many times in archlinux community :D | 12:57 |
| anteaya | great | 12:57 |
| *** trown is now known as trown|mtg | 12:59 | |
| *** afred312 has quit IRC | 13:01 | |
| *** ddieterly has quit IRC | 13:01 | |
| *** jamesmcarthur has joined #openstack-infra | 13:02 | |
| rhochmuth | Is anyone available that can add user roland-hochmuth-s (that's me) to the newly created monasca-transform-core ACL at, https://review.openstack.org/#/admin/groups/1350,members ? I just need to get this group primed with a user to start using ut. | 13:03 |
| *** lucasagomes is now known as lucas-hungry | 13:03 | |
| *** pradk has quit IRC | 13:05 | |
| *** eezhova has joined #openstack-infra | 13:06 | |
| *** |-paul-| has quit IRC | 13:07 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Allow testing non-default configs with complex definitions https://review.openstack.org/309734 | 13:07 |
| *** eezhova has quit IRC | 13:08 | |
| *** Julien-zte has joined #openstack-infra | 13:08 | |
| *** eezhova has joined #openstack-infra | 13:08 | |
| *** Daisy has joined #openstack-infra | 13:08 | |
| electrofelix | anteaya: so there are multiple was with jenkins to switch the final job status from SUCCESS to UNSTABLE, using the cli jar, or postbuildscript groovy actions, unfortunately zuul only understands success or failure. | 13:09 |
| *** Goneri has joined #openstack-infra | 13:09 | |
| pabelanger | morning | 13:12 |
| yolanda | rhochmuth, i can | 13:12 |
| yolanda | can you send the link of the project creation change? | 13:12 |
| rhochmuth | hi yolanda | 13:13 |
| rhochmuth | project creation change, i'm not sure i understand what you mean | 13:13 |
| rhochmuth | are you referring to the initial gerrit review for the addition of the project? | 13:14 |
| yolanda | yes | 13:14 |
| rhochmuth | sure, i can do, hold on | 13:14 |
| *** rkukura_ has joined #openstack-infra | 13:14 | |
| rhochmuth | yolanda: Here it is, https://review.openstack.org/#/c/300742/ | 13:14 |
| yolanda | thanks | 13:15 |
| *** EricGonc_ has quit IRC | 13:15 | |
| anteaya | electrofelix: ah I had it backwards, thank you for sharing your findings | 13:16 |
| anteaya | morning pabelanger | 13:16 |
| *** oanson has quit IRC | 13:17 | |
| *** rkukura has quit IRC | 13:17 | |
| *** rkukura_ is now known as rkukura | 13:17 | |
| yolanda | rhochmuth, done | 13:17 |
| rhochmuth | yolanda: thank you | 13:17 |
| yolanda | anytime | 13:18 |
| jeblair | pabelanger, fungi: can you take a look at https://review.openstack.org/321257 ? | 13:18 |
| yolanda | morning pabelanger | 13:18 |
| *** akshai has joined #openstack-infra | 13:18 | |
| *** pradk has joined #openstack-infra | 13:18 | |
| *** jamesmcarthur has quit IRC | 13:18 | |
| *** Na3iL has joined #openstack-infra | 13:19 | |
| *** nwkarsten has quit IRC | 13:19 | |
| fungi | jeblair: the only concern i have is that if project_config_repo is a vcsrepo object set to a branch tip, i _think_ vcsrepo reports a change at every pulse regardless of whether the new branch tip is different from the old. i don't recall whether that's been fixed in the version of vcsrepo we're using | 13:20 |
| *** piet has joined #openstack-infra | 13:20 | |
| jeblair | fungi: oh dear | 13:20 |
| *** edmondsw has joined #openstack-infra | 13:20 | |
| fungi | so something to keep an eye out for | 13:21 |
| jeblair | fungi: for jjb, we copy out of the vcsrepo -- i don't know if that sanitizes thing? | 13:21 |
| fungi | i'm looking now to see whether we have any other execs subscribing to project_config_repo | 13:21 |
| jeblair | why don't i read puppet logs on a jenkins master to see what happens | 13:21 |
| fungi | yeah, i was thinking to hunt down an actual example and double-check it in the wild | 13:22 |
| kgiusti | Hi infra - any chance I can get some infra-lovin' on this modest little review:https://review.openstack.org/#/c/319452/ | 13:22 |
| kgiusti | it's wafer thin.... | 13:22 |
| openstackgerrit | Merged openstack-infra/system-config: Test logstash.o.o on trusty. https://review.openstack.org/321248 | 13:23 |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: create parent directories for SCP https://review.openstack.org/318979 | 13:23 |
| pabelanger | rcarrillocruz: #openstack-sprint :) | 13:23 |
| kgiusti | adv[thanks!]ance | 13:23 |
| *** yamamoto has quit IRC | 13:23 | |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: add -q to rsync ssh command https://review.openstack.org/318982 | 13:24 |
| *** amitgandhinz has joined #openstack-infra | 13:24 | |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: set $HOME https://review.openstack.org/318987 | 13:24 |
| *** amitgandhinz has quit IRC | 13:24 | |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: Append to console log, rather than truncating https://review.openstack.org/319488 | 13:24 |
| fungi | jeblair: if that bug is as i remember it, i don't see any commits addressing it in our (ancient) vcsrepo fork | 13:24 |
| rcarrillocruz | yolanda: #openstack-sprint | 13:24 |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: copy symlinks in publishers https://review.openstack.org/320533 | 13:24 |
| *** jamesmcarthur has joined #openstack-infra | 13:24 | |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: run command in login shell https://review.openstack.org/320534 | 13:24 |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: log reconfiguration complete https://review.openstack.org/321029 | 13:24 |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: install libselinux-python if necessary https://review.openstack.org/321077 | 13:25 |
| *** amitgandhinz has joined #openstack-infra | 13:25 | |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: add option to keep jobdir https://review.openstack.org/321081 | 13:25 |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: log exit code from each builder https://review.openstack.org/321098 | 13:25 |
| jeblair | fungi: the logs on jenkins01 look as i would hope -- nothing about vcsrepo except occasionally | 13:25 |
| *** Douhet has quit IRC | 13:25 | |
| jeblair | fungi: so we must be okay with 'branch tip' | 13:25 |
| *** matrohon has quit IRC | 13:26 | |
| *** javeriak has quit IRC | 13:26 | |
| jeblair | fungi: however, the copying trick does get us one more thing -- it filters out non-jjb related changes (eg, like channel additions) | 13:26 |
| jeblair | fungi: so it might still be worth doing in this context | 13:26 |
| jeblair | fungi: (maybe the continuous updates were if you pin a specific revision or something?) | 13:27 |
| fungi | it may have been that rather than a branch name, yes | 13:27 |
| fungi | ensure some explicit ref | 13:27 |
| *** javeriak has joined #openstack-infra | 13:28 | |
| jeblair | fungi: i think i'll go ahead and switch that to the copy technique to get the filtering | 13:28 |
| *** _ari_ has joined #openstack-infra | 13:29 | |
| *** inc0_ has joined #openstack-infra | 13:29 | |
| *** Daisy has quit IRC | 13:30 | |
| *** banix has joined #openstack-infra | 13:30 | |
| *** yamamoto has joined #openstack-infra | 13:33 | |
| *** akshai_ has joined #openstack-infra | 13:33 | |
| openstackgerrit | Merged openstack-infra/zuul: Simplify logic to ensure absolute path https://review.openstack.org/321254 | 13:33 |
| *** jamesmcarthur has quit IRC | 13:33 | |
| *** lucas-hungry is now known as lucasagomes | 13:36 | |
| *** akshai has quit IRC | 13:37 | |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-zuul: Add support for reloading Zuul launcher https://review.openstack.org/321257 | 13:37 |
| *** yamamoto has quit IRC | 13:37 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Reload zuul launcher on project-config update https://review.openstack.org/321258 | 13:37 |
| jeblair | fungi: ^ that's actually cleaner anyway :) | 13:38 |
| fungi | thanks! looking them back over now | 13:38 |
| openstackgerrit | Lucas Alvares Gomes proposed openstack-infra/project-config: Add virtualbmc from source non-voting test https://review.openstack.org/315646 | 13:38 |
| *** jamesmcarthur has joined #openstack-infra | 13:39 | |
| *** amoralej|lunch is now known as amoralej | 13:39 | |
| *** burgerk has quit IRC | 13:40 | |
| *** yamamoto has joined #openstack-infra | 13:40 | |
| *** nwkarsten has joined #openstack-infra | 13:41 | |
| *** javeriak has quit IRC | 13:41 | |
| *** javeriak has joined #openstack-infra | 13:42 | |
| *** javeriak has quit IRC | 13:46 | |
| *** Douhet has joined #openstack-infra | 13:46 | |
| *** matrohon has joined #openstack-infra | 13:47 | |
| *** ddieterly has joined #openstack-infra | 13:49 | |
| *** yamamoto has quit IRC | 13:50 | |
| *** xyang1 has joined #openstack-infra | 13:50 | |
| *** rbrndt has joined #openstack-infra | 13:51 | |
| *** Julien-zte has quit IRC | 13:54 | |
| *** Guest25813 has quit IRC | 13:56 | |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: add job result to console log https://review.openstack.org/321135 | 13:57 |
| *** rhochmuth has quit IRC | 14:00 | |
| *** eharney has joined #openstack-infra | 14:02 | |
| openstackgerrit | Merged openstack-infra/release-tools: include extra metadata in constraint update https://review.openstack.org/320104 | 14:02 |
| *** afred312 has joined #openstack-infra | 14:02 | |
| openstackgerrit | Merged openstack-infra/release-tools: add script to expire old bug reports https://review.openstack.org/321008 | 14:02 |
| *** haypo has joined #openstack-infra | 14:03 | |
| *** yamamoto has joined #openstack-infra | 14:04 | |
| *** xarses has quit IRC | 14:04 | |
| *** jamesmcarthur has quit IRC | 14:04 | |
| *** rhochmuth has joined #openstack-infra | 14:04 | |
| Shrews | jeblair: you need to not merge https://review.openstack.org/321236 | 14:06 |
| Shrews | jeblair: left comments | 14:06 |
| *** rhochmuth has quit IRC | 14:07 | |
| *** trown|mtg is now known as trown | 14:08 | |
| *** afred312_ has joined #openstack-infra | 14:08 | |
| *** Daisy has joined #openstack-infra | 14:08 | |
| *** afred312 has quit IRC | 14:09 | |
| *** asettle has quit IRC | 14:10 | |
| sdague | jroll: I have no idea, because I don't know how to find post job logs :) | 14:11 |
| *** hongbin has joined #openstack-infra | 14:12 | |
| *** Hal has joined #openstack-infra | 14:12 | |
| jeblair | Shrews: whoops, thx! | 14:12 |
| *** jamesmcarthur has joined #openstack-infra | 14:12 | |
| *** Hal is now known as Guest52155 | 14:13 | |
| haypo | hi. i opened the bug https://storyboard.openstack.org/#!/story/2000593 "Install pip for python3 for the wheel-build-ubuntu-trusty-amd64 job". is it the right place to report such bug? | 14:14 |
| haypo | the goal is to reduce the risk of timeout on gate-trove-python34-db job https://bugs.launchpad.net/trove/+bug/1582257 | 14:15 |
| openstack | Launchpad bug 1582257 in OpenStack DBaaS (Trove) "Random timeout on gate-trove-python34-db" [Undecided,In progress] - Assigned to Victor Stinner (victor-stinner) | 14:15 |
| *** afred312_ has quit IRC | 14:15 | |
| haypo | but also to reduce a lot of the CPU usage of all Python 3 jobs. for example, I expect that Trove jobs will be *7 minutes* faster with this change! | 14:15 |
| *** afred312 has joined #openstack-infra | 14:16 | |
| amrith | fwiw, the trove team is strongly in favor of haypo's work in this area of improvement. | 14:17 |
| haypo | amrith: good to know :) *all* openstack projects now have python3 jobs, so it should reduce the pressure on the overall infra! | 14:18 |
| amrith | unfortunately the only other feasible solution that has been proposed would be to eliminate a particularly costly set of tests that are run as part of the check and gate jobs. | 14:18 |
| amrith | and as haypo continues to make progress on these, I think the benefit will accrue not just to us in Trove but to all projects. | 14:18 |
| amrith | (oh, haypo just said that) | 14:18 |
| amrith | yes, what he said ... | 14:18 |
| haypo | amrith: hello :) | 14:19 |
| amrith | howdy victor! | 14:19 |
| anteaya | sdague: what is the patch url you want post job logs for, I'll see if I can figure it out | 14:19 |
| anteaya | I know it is first 2 characters of the sha/the full sha in the url for the logs | 14:20 |
| anteaya | from logs.openstack.org | 14:20 |
| jeblair | huh, i'm missing an expected update from openstackgerrit ... | 14:20 |
| jroll | sdague: logs.openstack.org/<first two of sha>/sha | 14:20 |
| sdague | anteaya: well, I'd like a pattern to figure it out in general so how about we do - https://review.openstack.org/#/c/321460/ | 14:20 |
| *** zhurong has quit IRC | 14:20 | |
| jeblair | i updated 321236 and uploaded remote: https://review.openstack.org/321569 Ansible launcher: support static workers | 14:20 |
| anteaya | sdague: right there is a pattern | 14:20 |
| sdague | sure | 14:20 |
| sdague | http://logs.openstack.org/60/321460/2/ | 14:20 |
| sdague | I only see gate / check | 14:20 |
| jroll | sdague: http://logs.openstack.org/fc/fccfbb9bafaf7bf868fa83f4c4ed14e3425996e7/ | 14:20 |
| sdague | where do I find post? | 14:21 |
| jroll | it's done by commit sha | 14:21 |
| *** zhurong has joined #openstack-infra | 14:21 | |
| sdague | oh.... not by review by commit sha | 14:21 |
| jroll | right | 14:21 |
| sdague | gotcha | 14:21 |
| jroll | the other catch is, commits with merge commits are on the merge commit sha iirc | 14:21 |
| *** asettle has joined #openstack-infra | 14:21 | |
| *** asettle has quit IRC | 14:21 | |
| anteaya | sdague: right | 14:21 |
| *** EricGonczer_ has joined #openstack-infra | 14:22 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul/layout: optimize puppet jobs https://review.openstack.org/321571 | 14:22 |
| anteaya | sdague: http://logs.openstack.org/fc/fccfbb9bafaf7bf868fa83f4c4ed14e3425996e7/post/os-api-ref-docs/b3c1068/console.html | 14:22 |
| *** esikachev has quit IRC | 14:22 | |
| anteaya | sdague: I just don't have everything memorized like everyone else | 14:22 |
| fungi | haypo: i thought we discussed in here (or was it in a code review) that you don't need to install "pip for python3" you just need to _call_ pip _with_ python3 | 14:22 |
| haypo | fungi: i recall the discussion, but i still don't undestand what you said | 14:23 |
| haypo | fungi: sorry :-/ | 14:23 |
| *** xyang1 has quit IRC | 14:23 | |
| sdague | ok, cool | 14:23 |
| dmsimard | Where is what gets sent to logstash.o.o defined ? For example, there are the jenkins console.html, is there a possibility to have other logs in there ? | 14:23 |
| sdague | that at least lets me figure out issues in the future | 14:23 |
| haypo | fungi: my change to replace "pip3" with "python3 -m pip" was merged | 14:23 |
| *** xyang1 has joined #openstack-infra | 14:23 | |
| haypo | fungi: https://github.com/openstack-infra/project-config/blob/master/jenkins/scripts/wheel-build.sh | 14:24 |
| fungi | haypo: looking at the error you're getting, it's possible that we may need to run the pip bootstrapper twice, once under python3. i think virtualenv works around this by doing that automatically when you specify a particular python interpreter | 14:24 |
| haypo | fungi: but see my bug report, the command fails with "/usr/bin/python3: No module named pip" | 14:24 |
| openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: WIP Proof of Concept Storyboard Updating from Gerrit https://review.openstack.org/302912 | 14:25 |
| haypo | fungi: usually, i always install pip twice: once for py2, once for py3. if you do something special on the infra, please try to investigate | 14:26 |
| *** afred312 has quit IRC | 14:26 | |
| *** afred312 has joined #openstack-infra | 14:26 | |
| *** mixos has joined #openstack-infra | 14:26 | |
| *** xarses has joined #openstack-infra | 14:27 | |
| haypo | fungi: on my PC, pip for python2 is /usr/lib/python2.7/site-packages/pip/ and pip for python3 is /usr/lib/python3.4/site-packages/pip/. building wheel packages for python 3 requires pip for python 3 | 14:27 |
| *** xarses has quit IRC | 14:27 | |
| *** burgerk has joined #openstack-infra | 14:27 | |
| jroll | anteaya: I'm now trying to find a good place to document this | 14:27 |
| *** xarses has joined #openstack-infra | 14:27 | |
| anteaya | dmsimard: some of it is defined in macros, such as the net-info builder: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml#n609 | 14:27 |
| anteaya | jroll: that is a good idea | 14:27 |
| haypo | fungi: do you mean that jenkins/scripts/wheel-build.sh is run in a virtualenv? | 14:28 |
| jroll | anteaya: are there CI system docs other than the infra manual? | 14:28 |
| *** kien-ha has joined #openstack-infra | 14:28 | |
| anteaya | I wouldn't put this in CI system docs | 14:29 |
| anteaya | for me that means third party CI | 14:29 |
| anteaya | which is a whole different thing | 14:29 |
| anteaya | I wonder if an additon to http://docs.openstack.org/infra/manual/developers.html#automated-testing would make sense | 14:29 |
| jroll | well, openstack CI I guess I mean | 14:29 |
| jroll | aha, perfect. thanks. | 14:29 |
| fungi | haypo: there are a few different places where we download and run https://bootstrap.pypa.io/get-pip.py under python, we probably just need to check if `which python3` succeeds and run it a second time under that | 14:29 |
| anteaya | jroll: yeah I don't use CI to mean what we run | 14:30 |
| *** asettle has joined #openstack-infra | 14:30 | |
| anteaya | jroll: but now I understand | 14:30 |
| fungi | haypo: there are very few (if any?) places where we call python3 outside the scope of a virtualenv, which is why this is unlikely to have come up before | 14:30 |
| anteaya | jroll: looks like step 2, examine relevant logs could be expanded | 14:30 |
| openstackgerrit | Thomas Herve proposed openstack-infra/tripleo-ci: DNM: check heat translation patch https://review.openstack.org/321577 | 14:31 |
| *** psachin has quit IRC | 14:31 | |
| *** salv-orlando has quit IRC | 14:31 | |
| *** vhosakot has joined #openstack-infra | 14:32 | |
| haypo | fungi: for openstack-infra, i only know https://github.com/openstack-infra/project-config.git repository and this one doesn't seem to contain any script running get-pip.py (there are only things to download/cache get-pip.py) | 14:32 |
| dmsimard | anteaya: I found https://review.openstack.org/#/c/312985/ which seems to be more along the lines of what I was looking for, thanks | 14:32 |
| haypo | fungi: https://docs.python.org/dev/library/ensurepip.html was added to python 3.4 to make pip available more easily, but i saw that some linux distro removes/breaks this module :-/ | 14:33 |
| haypo | fungi: running get-pip.py on python3 one more time should do the trick, yes :) | 14:34 |
| *** zhurong has quit IRC | 14:34 | |
| dstufft | haypo: woo Debuntu | 14:35 |
| knikolla | is this the right place for devstack plugin questions? | 14:35 |
| openstackgerrit | Jim Rollenhagen proposed openstack-infra/infra-manual: Add info about the location of post job logs https://review.openstack.org/321580 | 14:36 |
| jroll | anteaya: ^^ | 14:36 |
| jroll | knikolla: #openstack-qa is better | 14:36 |
| fungi | haypo: that said, it's got me wondering whether our wheel builder shouldn't be using a virtualenv for this anyway | 14:36 |
| knikolla | jroll: thanks | 14:36 |
| fungi | for better isolation from anything that might already be installed in the system environment | 14:36 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Allow testing non-default configs with complex definitions https://review.openstack.org/309734 | 14:37 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: use console.html https://review.openstack.org/321314 | 14:38 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: support static workers https://review.openstack.org/321569 | 14:38 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: log stdout/stderr one line at a time https://review.openstack.org/321236 | 14:38 |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-zuul: Support static nodes in ansible launcher https://review.openstack.org/321584 | 14:39 |
| haypo | dstufft: fedora does something similar no? i never knows before the first thing that i do when i get a computer is to upgrade pip | 14:40 |
| haypo | dstufft: and upgrading manually pip usually breaks the things installed by the OS :) | 14:40 |
| dstufft | haypo: don't think Fedora does that no | 14:40 |
| dstufft | I know they don't unbundle stuff from inside pip | 14:41 |
| haypo | dstufft: ok. sorry, i cannot check :) | 14:41 |
| *** esikachev has joined #openstack-infra | 14:41 | |
| dstufft | I think 100% of the complaints I get from people with a broken pip that _isnt_ caused by pip itself come from Debuntu | 14:41 |
| haypo | fungi: i have no opinion on how packages should be compled or not :) maybe dstufft knows? :) | 14:41 |
| openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: WIP Proof of Concept Storyboard Updating from Gerrit https://review.openstack.org/302912 | 14:42 |
| anteaya | jroll: thank you, reviewed | 14:42 |
| dstufft | isolation++ | 14:42 |
| jeblair | nibalizer: i have a hiera question when you have a sec | 14:43 |
| anteaya | dmsimard: okay, that is a change that affects logstash configuration but if that gets you what you need, great | 14:43 |
| *** afred312 has quit IRC | 14:43 | |
| EmilienM | anyone familiar with zuul layout & regex please review https://review.openstack.org/#/c/321571/ | 14:44 |
| *** afred312 has joined #openstack-infra | 14:44 | |
| EmilienM | jeblair: shoot question, maybe I can also help | 14:44 |
| openstackgerrit | Jim Rollenhagen proposed openstack-infra/infra-manual: Add info about the location of post job logs https://review.openstack.org/321580 | 14:44 |
| jroll | anteaya: thanks! | 14:44 |
| anteaya | jroll: thank you for the patch | 14:45 |
| anteaya | much appreciated | 14:45 |
| openstackgerrit | Merged openstack-infra/puppet-zuul: Add support for reloading Zuul launcher https://review.openstack.org/321257 | 14:45 |
| jroll | anteaya: welcome :) | 14:45 |
| jeblair | EmilienM: i want to take this data structure: http://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n906 | 14:45 |
| jeblair | EmilienM: and move it into this file: http://git.openstack.org/cgit/openstack-infra/system-config/tree/hiera/common.yaml | 14:45 |
| anteaya | sdague: will this work for you? jroll's doc patch for post log pattern: https://review.openstack.org/#/c/321580/2 | 14:46 |
| jeblair | EmilienM: but as i do that, i note that it has hiera references to things that are not in that file (that are, instead, in our secret file) | 14:46 |
| jeblair | EmilienM: for example, this line: http://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n929 | 14:46 |
| jeblair | EmilienM: so my question is whether there is a way to do that, and/or if our hiera setup in system config has become sophisticated enough to do that, or perhaps there's still more work to do | 14:47 |
| *** jamesmcarthur has quit IRC | 14:48 | |
| *** jlanoux has quit IRC | 14:49 | |
| EmilienM | jeblair: ok I got the question, let me investigate | 14:49 |
| *** matrohon has quit IRC | 14:49 | |
| jeblair | EmilienM: thanks, and no worries -- it's not a blocker (but it is ugly :) | 14:49 |
| openstackgerrit | Merged openstack-infra/project-config: Remove references to the unused ArtifactArchiver https://review.openstack.org/320120 | 14:50 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-log_processor: Fix deprecated warning for suffix https://review.openstack.org/321589 | 14:50 |
| *** matrohon has joined #openstack-infra | 14:51 | |
| EmilienM | jeblair: it actually depends of your hiera.yaml configuration file. If the secret YAML is loaded, you can import parameters from other YAML files, like: openstack_project::zuul_launcher::zuul_ssh_private_key: "%{hiera('jenkins_ssh_private_key_contents')}" for example | 14:52 |
| EmilienM | is the hiera config public? | 14:52 |
| jeblair | EmilienM: i believe so, but i don't know where we put it now... | 14:54 |
| *** salv-orlando has joined #openstack-infra | 14:54 | |
| *** rhochmuth has joined #openstack-infra | 14:54 | |
| jeblair | EmilienM: aha http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/puppet/hiera.yaml | 14:55 |
| jeblair | EmilienM: the secret will end up in one of those first 3 referenced files | 14:55 |
| *** jamesmcarthur has joined #openstack-infra | 14:57 | |
| *** amcguign has joined #openstack-infra | 14:57 | |
| EmilienM | jeblair: I'm sure you can import the parameter then | 14:57 |
| EmilienM | if it's loaded on the node | 14:57 |
| *** deadnull_ has quit IRC | 14:59 | |
| *** armax has joined #openstack-infra | 14:59 | |
| *** ddieterly is now known as ddieterly[away] | 15:00 | |
| *** mixos has quit IRC | 15:00 | |
| *** tonytan4ever has joined #openstack-infra | 15:01 | |
| *** jamesmcarthur has quit IRC | 15:03 | |
| *** dmk0202 has quit IRC | 15:04 | |
| *** jamesmcarthur has joined #openstack-infra | 15:04 | |
| jeblair | EmilienM: oh! and i can probably actually add it to a zuul-mergers public hiera group, so it's not just in the big public one... | 15:05 |
| EmilienM | jeblair: right | 15:05 |
| jeblair | EmilienM: like in this directory: http://git.openstack.org/cgit/openstack-infra/system-config/tree/hiera/group | 15:05 |
| EmilienM | jeblair: decomposition is good | 15:05 |
| EmilienM | jeblair: it makes your puppet deployment flexible & re-usable | 15:05 |
| jeblair | EmilienM: cool, i think i understand, i'll whip up a patch in a few mins :) | 15:06 |
| EmilienM | jeblair: can you add this one to your backlog please ? https://review.openstack.org/#/c/321571/ - not urgent, but need your expertise | 15:06 |
| openstackgerrit | Alfredo Moralejo proposed openstack-infra/system-config: Add packstack installation logs to logstash https://review.openstack.org/321604 | 15:08 |
| *** arxcruz has quit IRC | 15:08 | |
| *** raildo is now known as raildo-afk | 15:08 | |
| *** Daisy has quit IRC | 15:09 | |
| jeblair | EmilienM: i will, though i don't normally review skip-if changes because they make my head hurt. [i reworked that in zuulv3 so you specify "irrelevant files" for a job] | 15:10 |
| sdague | anteaya: looks great | 15:10 |
| EmilienM | jeblair: lol | 15:10 |
| anteaya | sdague: wonderful, thank you for taking a look | 15:10 |
| EmilienM | jeblair: you can -1 it and I'll abandon it if it makes sense | 15:10 |
| *** ddieterly[away] is now known as ddieterly | 15:10 | |
| *** sshnaidm has quit IRC | 15:11 | |
| *** claudiub has quit IRC | 15:13 | |
| *** piet has quit IRC | 15:13 | |
| *** javeriak has joined #openstack-infra | 15:15 | |
| *** mtanino has joined #openstack-infra | 15:16 | |
| *** afred312_ has joined #openstack-infra | 15:16 | |
| fungi | clarkb: cloudnull: so the glut of building nodes in osic... it looks like we're seeing nova boot calls taking up to an hour for the instance to get an ip assignment before nodepool finally gives up. _that_ could also explain how we end up leaking floating ips if they wind up being provisioned after (or while) nodepool is in the process of deleting the instance http://paste.openstack.org/show/505681/ | 15:17 |
| *** lennyb has quit IRC | 15:17 | |
| *** inc0_ has quit IRC | 15:18 | |
| *** jamesmcarthur has quit IRC | 15:18 | |
| *** afred312 has quit IRC | 15:18 | |
| fungi | clarkb: clarkb: er, actually, i need to look closer at what that error message means by "Floating IP 172.99.106.11:7c183f03-daf5-4cf7-bd01-689db45753c0 was created for server ab0d19d0-c1b8-428a-b8a4-ee7f69184e46 but is being deleted due to activation failure." | 15:19 |
| *** rcernin has quit IRC | 15:19 | |
| *** jlanoux has joined #openstack-infra | 15:20 | |
| *** KaiyanSheng has joined #openstack-infra | 15:21 | |
| clarkb | I think thats the new shade logging to log when this exact case happens | 15:21 |
| clarkb | because previously shade didnt log anythign and ips were leaking | 15:22 |
| *** javeriak_ has joined #openstack-infra | 15:22 | |
| fungi | what's the openstaclient incantation to list fips? | 15:22 |
| *** dizquierdo has quit IRC | 15:22 | |
| *** kzaitsev_mb has quit IRC | 15:23 | |
| *** javeriak has quit IRC | 15:23 | |
| clarkb | ip floating list iirc | 15:23 |
| fungi | indeed, thanks! | 15:23 |
| fungi | mainly trying to figure out what the criteria are for an existing fip to be "active" | 15:24 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Refactorize Puppet versions testing matrix https://review.openstack.org/321613 | 15:25 |
| *** yfried has quit IRC | 15:26 | |
| fungi | how do we tell what fip belongs to what nova instance? | 15:26 |
| clarkb | that is the million dollar question | 15:27 |
| *** esikachev has quit IRC | 15:27 | |
| fungi | i don't see anything in ip floating list output that maps to server show output or vice versa | 15:27 |
| *** jamesmcarthur has joined #openstack-infra | 15:27 | |
| openstackgerrit | Merged openstack-infra/project-config: zuul/layout: optimize puppet jobs https://review.openstack.org/321571 | 15:27 |
| clarkb | answering that is the root of all our problems, there should be an instance id column which should always have an instance if valid when using shade's attach method | 15:28 |
| pabelanger | #status log logstash-worker01.openstack.org now running ubuntu-trusty and processing requests | 15:28 |
| openstackstatus | pabelanger: finished logging | 15:28 |
| *** Swami has joined #openstack-infra | 15:28 | |
| fungi | it only seems to have a fip uuid, floating address, fixed address and port in the ip floating list output | 15:29 |
| clarkb | ah fixed address is the indicator then | 15:29 |
| clarkb | that is the ip on the VM instance that NAT maps to | 15:30 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add static zuul launcher https://review.openstack.org/321615 | 15:30 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Move zuul site/node config into hiera https://review.openstack.org/321616 | 15:30 |
| fungi | oh, we map the "private" address of the instance to that column? | 15:30 |
| jeblair | EmilienM, nibalizer: ^ | 15:30 |
| clarkb | fungi: neutron does | 15:30 |
| EmilienM | jeblair: /me looking | 15:30 |
| *** vincentll has quit IRC | 15:31 | |
| EmilienM | jeblair: I like it | 15:31 |
| EmilienM | jeblair: I think it will work fine | 15:31 |
| jeblair | w00t | 15:31 |
| jeblair | EmilienM: thanks again! | 15:31 |
| fungi | clarkb: i mean in the sense of trying to work backward to see where this is falling apart | 15:31 |
| nibalizer | jeblair: that works? | 15:32 |
| nibalizer | i mean it might work | 15:32 |
| nibalizer | jeblair: if that doesn't work we can use the merging stuff https://docs.puppet.com/hiera/3.1/lookup_types.html#hash-merge | 15:33 |
| clarkb | fungi ya we have to do that all ourselves iirc | 15:33 |
| clarkb | fungi: which is why its racy and prone to errors | 15:33 |
| KaiyanSheng | @clarkb Hi Clark! Sorry to interrupt here. Can you take a look at https://review.openstack.org/#/c/316293/ when you get a chance please? This is the review to add tempest tests as non-voting in all the monasca repos. Thank you so much!! | 15:34 |
| *** tesseract has quit IRC | 15:34 | |
| *** piet has joined #openstack-infra | 15:36 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update support for BuildResultTrigger plugin https://review.openstack.org/321619 | 15:36 |
| *** hamzy has quit IRC | 15:37 | |
| *** eezhova has quit IRC | 15:37 | |
| *** eezhova has joined #openstack-infra | 15:38 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Remove ceilometer job from tempest queue https://review.openstack.org/321621 | 15:38 |
| strigazi | Hi openstack-infra team, please have a look at https://review.openstack.org/#/c/321026/ | 15:39 |
| amcguign | Hi all, it's my first visit. I've met a couple of you good folks here&there. I'm looking to get some advice about using AFS for git mirroring, I hear ~pabelanger is full of knowledge! | 15:39 |
| *** hashar is now known as hasharAway | 15:40 | |
| pabelanger | eep! | 15:40 |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: log stdout/stderr one line at a time https://review.openstack.org/321236 | 15:41 |
| pabelanger | amcguign: not just me, a lot of people in -infra have been diving into AFS. Feel free to ask your questions | 15:41 |
| amcguign | you can thank our mutual friend rcarrillocruz :) | 15:41 |
| docaedo | I have a question about tests for things like murano applications or heat templates - is there a way to use an existing environment to check if what I deploy with heat satisfies my test? Or would I have to count on a new devstack instance being spun up just for that test? | 15:42 |
| *** esikachev has joined #openstack-infra | 15:42 | |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: use console.html https://review.openstack.org/321314 | 15:43 |
| *** ccamacho|lunch is now known as ccamacho | 15:43 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update support for BuildResultTrigger plugin https://review.openstack.org/321619 | 15:43 |
| amcguign | So I read http://docs.openstack.org/infra/system-config/afs.html which has been a great guide about the mechanics of setting up AFS but there's a gap in my brain about how I can create read-only git mirrors from a master git-gerrit (my CI environment has its own Gerrit.. ok, yeah I admit to working on HPE/Gozer as some of you likely already know!) | 15:46 |
| *** dizquierdo has joined #openstack-infra | 15:46 | |
| *** mikelk has quit IRC | 15:47 | |
| amcguign | Gerrit can do replication itself (and we still use that in HPE) but is that totally disabled in upstream now? Where is the touch point between live git data and AFS? | 15:48 |
| *** jamesmcarthur has quit IRC | 15:48 | |
| *** kien-ha has quit IRC | 15:49 | |
| clarkb | amcguign: we dont use afs to host git repos at least not yet | 15:49 |
| pabelanger | #status log logstash-worker02.openstack.org now running ubuntu-trusty and processing requests | 15:50 |
| openstackstatus | pabelanger: finished logging | 15:50 |
| amcguign | ah, is there a technical reason for that, or just "not yet" because of time etc? | 15:50 |
| *** mtanino has quit IRC | 15:51 | |
| *** mixos has joined #openstack-infra | 15:51 | |
| *** jamesmcarthur has joined #openstack-infra | 15:51 | |
| clarkb | mostly time | 15:52 |
| *** mtanino has joined #openstack-infra | 15:52 | |
| pabelanger | agreed | 15:52 |
| pabelanger | sure it is on a list some place | 15:52 |
| amcguign | :) | 15:52 |
| pabelanger | don't think it would be too much work to implement | 15:52 |
| amcguign | so what do you use AFS for? | 15:52 |
| *** inc0 has joined #openstack-infra | 15:52 | |
| clarkb | we publish packages repositories via afs | 15:53 |
| clarkb | we have pypi, wheels, ubuntu, and centos package repos | 15:53 |
| pabelanger | http://mirror.dfw.rax.openstack.org/ basically lists the things we have in AFS | 15:53 |
| amcguign | ah, cool! good to know. | 15:53 |
| *** oanson has joined #openstack-infra | 15:53 | |
| *** tonytan4ever has quit IRC | 15:54 | |
| fungi | amcguign: there are a couple of thoughts on how we could use afs as a backing store for our git servers | 15:54 |
| pabelanger | I think we'll be moving our logs to AFS in the near future too | 15:54 |
| anteaya | docaedo: mostly we go with one fresh devstack env per test | 15:55 |
| fungi | amcguign: one possibility is to do "local" replication on the gerrit server to a writeable afs volume though that would need permissions via something like running gerrit under kstart. the other possibility is having gerrit do remote ssh replication to somewhere with the write volume available | 15:55 |
| *** vhosakot has quit IRC | 15:56 | |
| fungi | amcguign: though i'm still not 100% clear on how to authorize the sshd child process for writing | 15:57 |
| docaedo | anteaya: thanks, that's what I understood/expected. We're starting to talk about providing things that could help app developers (like a CI/CD pipeline to test their aps) | 15:57 |
| amcguign | right, so in either case gerrit has still has to be in control of the live git data, and replicate that into some place that AFS can take up the mirroring work? | 15:57 |
| docaedo | anteaya: having to build a fresh devstack env first will add a LOT of time to a simple test | 15:57 |
| anteaya | docaedo: interesting, who is we in the above statement? the apps team? | 15:57 |
| *** dprince has quit IRC | 15:57 | |
| anteaya | docaedo: yes it does | 15:58 |
| fungi | amcguign: also, it's possible the count of object files _could_ overrun afs's per-directory file count limitations, so might need some additional support via an overlay to shard object files into additional subtrees? haven't looked closely at that problem yet | 15:58 |
| anteaya | docaedo: which is why we use nodepool | 15:58 |
| *** dprince has joined #openstack-infra | 15:58 | |
| anteaya | docaedo: the other thing you could look at is using disk image builder | 15:58 |
| anteaya | docaedo: it creates images as you like, including installed packages | 15:58 |
| *** eezhova has quit IRC | 15:59 | |
| *** ddieterly is now known as ddieterly[away] | 15:59 | |
| docaedo | anteaya: yes, apps team and Igor kicked off the discussion here on the ML http://lists.openstack.org/pipermail/openstack-dev/2016-May/095917.html (though it was also a discussion point for app team in Austin | 15:59 |
| anteaya | docaedo: that would cut down on time considerably | 15:59 |
| *** gomarivera has joined #openstack-infra | 15:59 | |
| docaedo | anteaya: this will be a longer conversation to get there for sure - ideally since we're talking about things that run on top of other openstack services (heat, murano, mistral) we start from the assumption that the IaaS layer is good to go | 16:00 |
| *** ddieterly[away] is now known as ddieterly | 16:00 | |
| fungi | clarkb: okay, coming back to this and i see it now. the "addresses" field in the server show output includes the floating ip once it's active | 16:00 |
| *** jlanoux has quit IRC | 16:01 | |
| anteaya | docaedo: fair enough | 16:01 |
| anteaya | docaedo: then you wouldn't be looking for an installation of devstack then? | 16:01 |
| fungi | clarkb: so in the failure example, it indeed does still lack any mention of 172.99.106.11 under the addresses field | 16:01 |
| *** maishsk has joined #openstack-infra | 16:01 | |
| anteaya | docaedo: or you would be looking for a devstack with those services installed | 16:02 |
| docaedo | anteaya: no - but I think that's the only way to get to an environment with Murano installed in the gate | 16:02 |
| anteaya | installed in the gate? | 16:02 |
| fungi | clarkb: i'm guessing shade/nodepool finds out the floating ip address from the fip create call response, and then waits for it to actually get associated with the corresponding instance | 16:02 |
| docaedo | anteaya: devstack with those services would work, but I think the assumption is any devstack env is a one-off that is destroyed after the test | 16:02 |
| *** inc0 has quit IRC | 16:02 | |
| anteaya | docaedo: are you envisioning that apps developers would be using our testing structure? | 16:02 |
| anteaya | docaedo: yes that is the assumption with devstack, single use and disposable | 16:03 |
| *** inc0 has joined #openstack-infra | 16:03 | |
| *** sshnaidm has joined #openstack-infra | 16:03 | |
| clarkb | fungi: amcguign jeblair did look at the file count situation and it should be fine if you pack semi frequently which we do | 16:03 |
| docaedo | anteaya: that's what I'm trying to sort out - we (infra) have a great gate and testing system, would be awesome to be able to use it for something like what Igor is proposing, rather than trying to find a dedicated cloud to run the tests | 16:03 |
| *** yamahata has joined #openstack-infra | 16:04 | |
| anteaya | docaedo: yes I agree | 16:04 |
| clarkb | fungi: ya it does the create and attach in one call | 16:04 |
| anteaya | docaedo: I do wonder if there is any understanding about how big a crowd this represents? | 16:04 |
| docaedo | anteaya: I will definitely circle back and keep in touch with infra on this, in case there's a good path forward :) | 16:04 |
| fungi | anteaya: docaedo: well, our assumption with devstack in our ci is that we can't rely on reusing it because we're applying untrusted patches and potentially running the results with root permission, so we can't trust the machine is even in a usable state after that and have no choice but to delete and replace it with a fresh one | 16:04 |
| clarkb | fungi: you can pass the VMs private port (an l1 construct which is somehow related to NAT because why) | 16:04 |
| clarkb | fungi: and when you do that it creates then attaches to the fip.there | 16:05 |
| docaedo | anteaya: crowd size is unknown TBH, we're trying to create an ecosystem of application developers so really no idea what the response would be like | 16:05 |
| anteaya | docaedo: okay fair enough | 16:05 |
| docaedo | fungi: I totally understand and agree with that approach, it's the only sane way to do it | 16:05 |
| anteaya | docaedo: just something to think about, we are starting to have questions on resource usage, currently we are at about 650 nodes across several providers | 16:05 |
| anteaya | docaedo: when we lose a cloud or two we really feel the pinch | 16:06 |
| anteaya | docaedo: didn't use to be the way, but it is now | 16:06 |
| docaedo | anteaya: but it's "the cloud!" I have seen the tv commercials, the cloud has no limits! </sarcasm> | 16:06 |
| anteaya | docaedo: ah a believer | 16:06 |
| fungi | docaedo: anteaya: in the case of testing an app which doesn't have administrative access to the control plane, it makes sense that you might treat the devstack deployment as a fixture which the app will be unable to "destroy" (as long as you clean up/reset the tenants after each test) | 16:06 |
| *** pradk has quit IRC | 16:07 | |
| fungi | but in those situations, i question the applicability of devstack anyway over, say, an aio install using osad or something | 16:07 |
| docaedo | fungi: that's what I'm thinking - testing things without admin access | 16:07 |
| *** trown is now known as trown|lunch | 16:07 | |
| *** Qiming has quit IRC | 16:08 | |
| fungi | the concern i have there is in fact that devstack is not a reliable way to maintain a long-running deployment of openstack | 16:08 |
| docaedo | fungi: yep - ideally it would just be hitting one of the openstack clouds directly (and using heat/mistral/murano there) | 16:08 |
| anteaya | would it make sense to stand up a cloud for app test usage? | 16:08 |
| docaedo | fungi: no I would never want to have a long running devstack, that's crazytalk | 16:08 |
| *** piet has quit IRC | 16:08 | |
| *** matrohon has quit IRC | 16:08 | |
| docaedo | anteaya: standing up a small cloud for this is the only thing that makes sense to me, but someone needs to donate some hardware for that ;) | 16:09 |
| fungi | trystack? | 16:09 |
| anteaya | would trystack work? | 16:09 |
| *** isaacb has quit IRC | 16:10 | |
| *** gyee has joined #openstack-infra | 16:11 | |
| pabelanger | #status log logstash-worker03.openstack.org now running ubuntu-trusty and processing requests | 16:11 |
| openstackstatus | pabelanger: finished logging | 16:11 |
| *** jaosorior has quit IRC | 16:11 | |
| docaedo | possibly, though I haven't poked at trystack in ages. do you still need to sign in with facebook? If they have murano that would be nice, mistral too, but I doubt it... | 16:11 |
| anteaya | docaedo: if something like trystack would work in concept that would be a model to build on | 16:12 |
| *** savihou has quit IRC | 16:12 | |
| docaedo | fungi anteaya thanks for the chat - I have to step away for a bit but will certainly circle back and stay in touch on this | 16:12 |
| *** afred312_ has quit IRC | 16:12 | |
| anteaya | so as you say sso would be an issues as would knowing the underlying service configuration | 16:12 |
| *** yfried has joined #openstack-infra | 16:13 | |
| anteaya | docaedo: pleasure to talk with you | 16:13 |
| *** jamesmcarthur has quit IRC | 16:13 | |
| lucasagomes | hi all, can I please get some eyes on https://review.openstack.org/#/c/315646/ ? The change has been submitted on may 12 and had no reviews so far, I've been rebasing it since. Thanks in advance | 16:16 |
| *** sambetts is now known as sambetts|afk | 16:16 | |
| *** ifarkas has quit IRC | 16:16 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/release-tools: release_notes: support multiple README formats https://review.openstack.org/321645 | 16:17 |
| *** reed has quit IRC | 16:18 | |
| *** reed has joined #openstack-infra | 16:18 | |
| *** lakshmiS has joined #openstack-infra | 16:18 | |
| *** kzaitsev_mb has joined #openstack-infra | 16:18 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/release-tools: release_notes: support multiple README formats https://review.openstack.org/321645 | 16:19 |
| *** _vsaienko has joined #openstack-infra | 16:20 | |
| *** jamesmcarthur has joined #openstack-infra | 16:21 | |
| *** oanson has quit IRC | 16:21 | |
| *** cody-somerville has joined #openstack-infra | 16:22 | |
| *** oanson has joined #openstack-infra | 16:24 | |
| pabelanger | #status log logstash-worker04.openstack.org now running ubuntu-trusty and processing requests | 16:26 |
| openstackstatus | pabelanger: finished logging | 16:26 |
| *** gomarivera has quit IRC | 16:28 | |
| *** ddieterly is now known as ddieterly[away] | 16:30 | |
| *** ddieterly[away] is now known as ddieterly | 16:31 | |
| *** Apoorva has joined #openstack-infra | 16:32 | |
| *** _vsaienko has quit IRC | 16:32 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Fix gerrit plugin installation https://review.openstack.org/259653 | 16:34 |
| *** vhosakot has joined #openstack-infra | 16:34 | |
| *** dprince has quit IRC | 16:35 | |
| *** dprince has joined #openstack-infra | 16:35 | |
| *** shashank_hegde has joined #openstack-infra | 16:36 | |
| *** inc0 has quit IRC | 16:37 | |
| *** inc0 has joined #openstack-infra | 16:37 | |
| *** ddieterly is now known as ddieterly[away] | 16:38 | |
| *** shashank_hegde has quit IRC | 16:39 | |
| *** ajmiller__ has quit IRC | 16:39 | |
| *** claudiub has joined #openstack-infra | 16:40 | |
| *** pvaneck has joined #openstack-infra | 16:40 | |
| *** lucasagomes is now known as lucas-afk | 16:41 | |
| *** nbloom has quit IRC | 16:41 | |
| *** Na3iL has quit IRC | 16:43 | |
| *** jamesmcarthur has quit IRC | 16:43 | |
| *** pradk has joined #openstack-infra | 16:43 | |
| *** javeriak has joined #openstack-infra | 16:45 | |
| *** kraynevs has joined #openstack-infra | 16:47 | |
| *** ajmiller has joined #openstack-infra | 16:48 | |
| *** markvoelker has quit IRC | 16:48 | |
| *** yfried has quit IRC | 16:48 | |
| *** javeriak_ has quit IRC | 16:48 | |
| *** markvoelker has joined #openstack-infra | 16:49 | |
| *** jamesmcarthur has joined #openstack-infra | 16:50 | |
| *** rfolco has joined #openstack-infra | 16:53 | |
| *** gomarivera has joined #openstack-infra | 16:54 | |
| *** cody-somerville has quit IRC | 16:54 | |
| *** cody-somerville has joined #openstack-infra | 16:55 | |
| *** cody-somerville has quit IRC | 16:55 | |
| *** cody-somerville has joined #openstack-infra | 16:55 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements https://review.openstack.org/321658 | 16:56 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/pbr: Updated from global requirements https://review.openstack.org/321659 | 16:56 |
| *** derekh has quit IRC | 16:56 | |
| *** nwkarsten has quit IRC | 16:56 | |
| openstackgerrit | Merged openstack-infra/system-config: add trusty support for paste.openstack.org https://review.openstack.org/311235 | 16:56 |
| *** flepied has quit IRC | 16:56 | |
| fungi | infra-root: rackspace wants us to migrate ci-backup-rs-ord off their first-gen infrastructure by performing a soft reboot. i figure we should get that out of the way before we upgrade too many more other servers. i'm happy to go ahead and start that now | 16:57 |
| jeblair | fungi: thx | 16:58 |
| *** gomarivera has quit IRC | 16:58 | |
| pabelanger | fungi: ack | 16:58 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add static zuul launcher https://review.openstack.org/321615 | 16:58 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Move zuul site/node config into hiera https://review.openstack.org/321616 | 16:58 |
| *** nwkarsten has joined #openstack-infra | 16:58 | |
| *** amrith is now known as _amrith_ | 16:58 | |
| *** nwkarsten has quit IRC | 16:58 | |
| fungi | or should we just try to upgrade it and delete the old one? | 16:58 |
| *** _amrith_ is now known as amrith | 16:59 | |
| *** jerryz has joined #openstack-infra | 16:59 | |
| *** pilgrimstack has quit IRC | 16:59 | |
| jeblair | fungi: i think we should defer it while we're upgrading other systems (to avoid foot shooting) | 17:00 |
| fungi | yeah, that's my concern as well | 17:00 |
| fungi | i mean, it looks like it shouldn't be _too_ hard since the backups are on cinder anyway | 17:00 |
| pabelanger | #status log logstash-worker05.openstack.org now running ubuntu-trusty and processing requests | 17:00 |
| openstackstatus | pabelanger: finished logging | 17:01 |
| *** HeOS_ has quit IRC | 17:01 | |
| fungi | anyway, i'll do the soft reboot migration for now since they're going to force migrate us in less than two weeks if we don't | 17:02 |
| fungi | and make sure the logical volume stays intact | 17:02 |
| fungi | once it's back up | 17:02 |
| *** jamesmcarthur has quit IRC | 17:03 | |
| *** ajmiller_ has joined #openstack-infra | 17:03 | |
| *** julim_ has joined #openstack-infra | 17:03 | |
| fungi | and also adjust dns i guess (sounds like the ip address will change) | 17:04 |
| *** mixos has quit IRC | 17:04 | |
| *** ddieterly[away] is now known as ddieterly | 17:05 | |
| *** gyee has quit IRC | 17:06 | |
| *** baoli_ has quit IRC | 17:06 | |
| *** baoli has joined #openstack-infra | 17:06 | |
| *** fawadkhaliq has quit IRC | 17:07 | |
| *** julim has quit IRC | 17:07 | |
| *** asettle has quit IRC | 17:07 | |
| *** ajmiller has quit IRC | 17:07 | |
| *** oanson has quit IRC | 17:07 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Add assign-via-gearman to config validator https://review.openstack.org/321753 | 17:07 |
| jeblair | pabelanger, fungi: can you +3 that ^ ? | 17:08 |
| jeblair | (it's blocking the 'enable zuul launcher' patch) | 17:08 |
| *** HeOS has quit IRC | 17:08 | |
| *** jamesmcarthur has joined #openstack-infra | 17:09 | |
| *** ociuhandu has quit IRC | 17:09 | |
| fungi | jeblair: why did you need to drop subnodes: 2 from that test sample? | 17:09 |
| *** shashank_hegde has joined #openstack-infra | 17:09 | |
| fungi | oh, "to correctly validate" | 17:09 |
| fungi | yay commit messages | 17:09 |
| jeblair | fungi: i think that's cruft from before we created the 'labels' construct | 17:10 |
| fungi | yep, just came to the same conclusion | 17:10 |
| anteaya | I reviewed that the commit message matched the code | 17:10 |
| anteaya | and it did | 17:10 |
| *** mixos has joined #openstack-infra | 17:10 | |
| openstackgerrit | Merged openstack-infra/system-config: Reload zuul launcher on project-config update https://review.openstack.org/321258 | 17:10 |
| *** afred312 has joined #openstack-infra | 17:11 | |
| *** esikachev has quit IRC | 17:13 | |
| *** sc68cal_ has quit IRC | 17:13 | |
| *** nwkarsten has joined #openstack-infra | 17:13 | |
| *** nwkarsten has quit IRC | 17:13 | |
| *** nwkarsten has joined #openstack-infra | 17:14 | |
| auggy | hello lovely infra folks! i have a grenade question! | 17:15 |
| *** inc0 has quit IRC | 17:15 | |
| auggy | i'm currently working on adding a test to the multinode grenade job in nova, and i'm trying to figure out how to tell grenade i want a multinode devstack | 17:15 |
| auggy | i'm looking for the devstack config that the multinode grenade job we have uses and i'm having trouble finding it, let me find the exact name of the job | 17:16 |
| auggy | its gate-grenade-dsvm-multinode | 17:16 |
| auggy | i've found the entry for it in jenkins job builder, but i'm trying to figure out how i can spin up a multinode devstack that matches what it spins up | 17:17 |
| *** mtanino has quit IRC | 17:17 | |
| clarkb | KaiyanSheng: reviewed, just one small thing in the zuul layout otherwise this looks good | 17:18 |
| auggy | basically i need to test a particular migration path and i want to make sure i have the target devstack configured correctly for this grenade job | 17:18 |
| clarkb | auggy: your best bet at reproducing the env is to use devstack-gate, it writes out a reproduce.sh in your job logs and you can run that. As for the two instances you will need to write out a few files to /etc/nodepool they are described at http://docs.openstack.org/infra/nodepool/scripts.html#ready-script | 17:19 |
| *** Jeffrey4l has quit IRC | 17:19 | |
| clarkb | auggy: run the reproduce.sh script on the primary node | 17:19 |
| *** shashank_hegde has quit IRC | 17:20 | |
| auggy | ok thanks clarkb | 17:20 |
| *** trown|lunch is now known as trown | 17:20 | |
| *** Daisy has joined #openstack-infra | 17:21 | |
| *** amcguign has quit IRC | 17:21 | |
| *** penguinolog has quit IRC | 17:22 | |
| calebb | does anyone know if it's possible to add metadata to a swift object with shade? | 17:22 |
| mordred | calebb: should be | 17:23 |
| *** degorenko is now known as _degorenko|afk | 17:23 | |
| mordred | calebb: if not, it's a bug | 17:24 |
| mordred | :) | 17:24 |
| calebb | hehe, yeah | 17:24 |
| mordred | dmsimard: btw - thanks for writing ara - it looks cool. I'm looking forward to playing with it when I'm not on vacation | 17:24 |
| dmsimard | mordred: oh hai, thanks. Looking forward to improve it :) | 17:25 |
| greghaynes | mordred: wait, I thought everything in shade was a bug, so if you add it is that also a bug? | 17:25 |
| dmsimard | definitely not feature finished | 17:25 |
| *** isq has quit IRC | 17:25 | |
| openstackgerrit | Kaiyan Sheng proposed openstack-infra/project-config: [Monasca]Add Tempest Jobs as non-voting for monasca repos https://review.openstack.org/316293 | 17:25 |
| greghaynes | :) | 17:25 |
| auggy | alright i found this and i'm going to attempt to follow the instructions - https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/README.rst#n95 | 17:25 |
| *** Daisy has quit IRC | 17:25 | |
| *** mahatic has quit IRC | 17:25 | |
| auggy | wish me luck ;) | 17:25 |
| mordred | greghaynes: yes :) | 17:25 |
| dmsimard | greghaynes: oh, you went there | 17:26 |
| *** isq has joined #openstack-infra | 17:26 | |
| mordred | auggy: good luck! | 17:26 |
| greghaynes | dmsimard: someone had to | 17:26 |
| fungi | auggy: hopefully just doing that on two virtual machines will work, but 1. i haven't followed those instreuctions for a while so they may have rotted some and, 2. i don't think i ever tried following them to do a multi-node setup | 17:26 |
| auggy | fungi: ah, thanks for the warning | 17:27 |
| fungi | definitely keep your skeptic glasses on throughout the exercise | 17:27 |
| auggy | i promise to submit doc patches in exchange for assistance | 17:27 |
| fungi | thanks! | 17:27 |
| *** tqtran has joined #openstack-infra | 17:27 | |
| *** fawadkhaliq has joined #openstack-infra | 17:27 | |
| auggy | for context, i'm setting up a grenade test for nova cellsv2 and we want to test migrating from a non-cells setup to a cells setup | 17:27 |
| *** dprince has quit IRC | 17:28 | |
| *** KaiyanSheng has quit IRC | 17:28 | |
| fungi | auggy: actually, i suspect what you need to do is create two virtual machines, make the /etc/nodepool adjustments clarkb mentioned, then follow the devstack-gate simulating instructions on whichever virtual machine you want to be teh primary node | 17:28 |
| *** mahatic has joined #openstack-infra | 17:28 | |
| fungi | and its ansible plays will set up the networking between them and deploy devstack for you on the subnode | 17:28 |
| *** jamesmcarthur has quit IRC | 17:28 | |
| auggy | oh cool | 17:28 |
| fungi | (i _hope_!) | 17:28 |
| auggy | yeah i have 2 trusty installs awaiting their devstackiness | 17:29 |
| clarkb | they don't need shared l2 even | 17:29 |
| *** baoli_ has joined #openstack-infra | 17:29 | |
| clarkb | you could have a trusty machine in your basement and a trusty machine on an airplane running a cloud! | 17:29 |
| auggy | these are just both in digital ocean | 17:29 |
| *** KaiyanSheng has joined #openstack-infra | 17:30 | |
| *** sc68cal has joined #openstack-infra | 17:30 | |
| openstackgerrit | Merged openstack/diskimage-builder: Add a best-effort sudo safety check https://review.openstack.org/303227 | 17:31 |
| *** ociuhandu has joined #openstack-infra | 17:31 | |
| KaiyanSheng | @clarkb Thank you for catching the problem! | 17:31 |
| *** baoli has quit IRC | 17:32 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/ansible-puppet: Call main() from a conditional https://review.openstack.org/321771 | 17:33 |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-ansible: Pin to ansible 2.0.2.0 https://review.openstack.org/321772 | 17:33 |
| KaiyanSheng | @clarkb Can I add name: check-requirements in template for each monasca repo in that same review? | 17:34 |
| fungi | jeblair: ansible 2.1 troubles, eh? | 17:35 |
| clarkb | KaiyanSheng: I would separate that into a new change since they are accomplishing different things | 17:35 |
| fungi | jeblair: on, nm, i see the discussion on #-sprint now | 17:36 |
| *** jamesmcarthur has joined #openstack-infra | 17:36 | |
| KaiyanSheng | @clarkb sounds good! Thank you soooo much!!! | 17:36 |
| auggy | ok.. so i started reading the devstack-gate readme and i already have a question - https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/README.rst#n95 | 17:36 |
| auggy | the instructions assume you have a "nova provider" | 17:37 |
| auggy | does this mean i need to install a devstack on one of my boxes in order to be a nova provider? | 17:37 |
| auggy | "boxes" "images" | 17:37 |
| *** ddieterly is now known as ddieterly[away] | 17:37 | |
| clarkb | auggy: no, it says that its only easier that way but you can do it locally or wherever you like | 17:37 |
| clarkb | then describes the type of setup to use | 17:38 |
| *** asettle has joined #openstack-infra | 17:38 | |
| clarkb | https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/README.rst#n108 I think those memory requirements are too low now though | 17:38 |
| clarkb | you likely do need at least 4GB ram and maybe even 8 :( | 17:38 |
| auggy | yeah 4GB just for devstack i've found | 17:39 |
| *** e0ne has quit IRC | 17:39 | |
| fungi | since we restrict jobs to 8gb per node, it's reasonable to expect that they'll work at 8 but it's entirely possible they've slipped well past 4 | 17:39 |
| *** yfried has joined #openstack-infra | 17:40 | |
| auggy | i'm still a bit confused about what to do if i don't have a provider, do i need to install something locally (ie, devstack) to be my provider and then set up the options with that info? | 17:40 |
| fungi | anyway, yes the novaclient calls there are intended merely for convenience (i basically derived those instructions from what we've been doing in the vmt to manyally test proposed patches fixing embargoed vulnerabilities) | 17:40 |
| *** SumitNaiksatam has joined #openstack-infra | 17:41 | |
| auggy | ah ok | 17:41 |
| *** electrofelix has quit IRC | 17:41 | |
| auggy | so i can skip the "nova" calls and just do this - https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/README.rst#n160 | 17:41 |
| calebb | mordred: yeah i dont think shade can add metadata to a object, I'll try patch | 17:41 |
| mordred | clarkb: woot! | 17:41 |
| *** hasharAway has quit IRC | 17:41 | |
| fungi | auggy: yep! everything up to that point is "here's how to get you some virtual machines to run this stuff in" | 17:42 |
| auggy | ahh i see | 17:42 |
| *** ociuhandu_ has joined #openstack-infra | 17:42 | |
| auggy | fungi: thanks for the clarification | 17:42 |
| *** dizquierdo has quit IRC | 17:42 | |
| fungi | auggy: if you solve that through another means, then it can be ignored | 17:42 |
| *** sc68cal has quit IRC | 17:42 | |
| auggy | ok cool | 17:43 |
| fungi | we included it mainly because a lot of people developing for openstack have access to openstack-based environments | 17:43 |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-kibana: Configure apache when we use it https://review.openstack.org/321777 | 17:43 |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-logstash: Cleanup apache configuration https://review.openstack.org/321778 | 17:43 |
| clarkb | pabelanger: fungi I think ^ will get us a working logstash.o.o launch, lets see how tests do though | 17:43 |
| *** ociuhandu has quit IRC | 17:44 | |
| fungi | auggy: but it certainly doesn't require an openstack-based environment to run (could even just be local virtualbox or even a couple of converted desktop machines with some network connectivity) | 17:44 |
| *** shashank_hegde has joined #openstack-infra | 17:44 | |
| *** vgridnev has joined #openstack-infra | 17:44 | |
| auggy | fungi: ah that's good to know, i mean assuming your local stuff has the capacity to run it ;) haha | 17:46 |
| auggy | (my poor little thinkpad does not_ | 17:46 |
| fungi | right | 17:46 |
| *** ociuhandu has joined #openstack-infra | 17:46 | |
| auggy | alright i'll go see if i can get this working and i'll probably be back with more questions ;) | 17:47 |
| *** david-lyle has quit IRC | 17:47 | |
| auggy | thanks so much for your help | 17:47 |
| anteaya | zaro: my current understanding of the gerrit storyboard plugin was that you didn't have time to help storyboard devs move in that direction | 17:47 |
| pabelanger | #status log logstash-worker06.openstack.org now running ubuntu-trusty and processing requests | 17:47 |
| openstackstatus | pabelanger: finished logging | 17:47 |
| fungi | auggy: any time! | 17:47 |
| anteaya | zaro: are you still in that frame of mind? | 17:47 |
| *** sarob has joined #openstack-infra | 17:47 | |
| *** david-lyle has joined #openstack-infra | 17:47 | |
| anteaya | zaro: or might you have time to spend looking at that again? | 17:47 |
| *** gomarivera has joined #openstack-infra | 17:47 | |
| *** ociuhandu_ has quit IRC | 17:48 | |
| *** _sarob has joined #openstack-infra | 17:49 | |
| *** devananda has joined #openstack-infra | 17:50 | |
| pabelanger | clarkb: my spidey sense is telling me you might need conditional checks for 321777. Because of our testing setup | 17:50 |
| pabelanger | lets see what zuul finds | 17:50 |
| clarkb | pabelanger: ya probably | 17:51 |
| *** sarob has quit IRC | 17:52 | |
| openstackgerrit | Matthew Thode proposed openstack-infra/project-config: Remove node-devstack from nodepool https://review.openstack.org/318994 | 17:52 |
| *** furlongm has quit IRC | 17:52 | |
| *** furlongm has joined #openstack-infra | 17:53 | |
| clarkb | fungi: my recollection of the way the FIP leak in osic was working was shade would make VM, shade would do the create fip with VM port so that attach happens too, this would timeout after an hour, the shade code to delete the FIP didn't work for some reason and the FIP was leaked at that point | 17:53 |
| *** gomarivera has quit IRC | 17:53 | |
| clarkb | so the cleanup cron isn't actually going to help address the poor utlization of the cloud due to that long timeout before fail | 17:54 |
| clarkb | what it will help with is making sure that we can use a small portion of the cloud | 17:54 |
| *** jamesmcarthur has quit IRC | 17:54 | |
| cloudnull | clarkb: would it be at all possible to use the FIP pool and reuse a FIP if one is already alocated to the tenant. | 17:55 |
| cloudnull | in that way if the fip was leaked another VM would pick up the leaked fip | 17:55 |
| clarkb | cloudnull: we don't currently track enough state to reuse FIPs like that | 17:55 |
| *** sc68cal has joined #openstack-infra | 17:55 | |
| cloudnull | there is a reuse flag in shade. | 17:55 |
| cloudnull | in test it seems to do the right thing | 17:55 |
| *** kzaitsev_ws has quit IRC | 17:56 | |
| clarkb | I would hae to review the code, my understanding of how nova and neutron work is that you need a reliable storage for that state on the client side (and shade doesn't have that iirc) | 17:56 |
| cloudnull | https://github.com/openstack-infra/shade/blob/master/shade/openstackcloud.py#L3847 | 17:56 |
| fungi | cloudnull: have you found anything in the logs to indicate why the fip association never completes? | 17:56 |
| clarkb | beacuse the cloud isn't going to hold your hand and if yo uaren't careful you start either trying to reuse fips or they leak | 17:56 |
| *** asettle has quit IRC | 17:57 | |
| cloudnull | this is the entry point https://github.com/openstack-infra/shade/blob/master/shade/openstackcloud.py#L4140-L4142 | 17:57 |
| mordred | we should not use reuse | 17:57 |
| mordred | if we decide to go that route, it will be a very large amount of work | 17:57 |
| cloudnull | fungi: I've been monitoring the logs and I've got nothing really to report. | 17:58 |
| fungi | mordred: cloudnull: not sure if you saw my example from earlier... http://paste.openstack.org/show/505681/ | 17:58 |
| mordred | if the current rate of use with neutron FIP approach is not acceptable, we can always try reverting to nova fip calls | 17:58 |
| cloudnull | fungi: sadly the agent logs dont have anything note worthy | 17:58 |
| clarkb | pabelanger: I am just going to wrap that in conditionals really quicly and repush | 17:59 |
| mordred | fungi: OpenStackCloudTimeout: Timeout waiting for the floating IP to be attached | 17:59 |
| mordred | fungi: then nothing tries to delete the fip | 17:59 |
| cloudnull | that said, I'm not really here right now. :) | 17:59 |
| fungi | i have to assume it doesn't _actually_ take more than an hour to handle the fip association needed there, and that the call is getting lost somewhere | 17:59 |
| mordred | cloudnull: me neither :) | 17:59 |
| *** jamesmcarthur has joined #openstack-infra | 17:59 | |
| * cloudnull is on holiday | 17:59 | |
| mordred | yes. I believe that is true | 17:59 |
| cloudnull | mordred: so you take time off like i do :) | 17:59 |
| mordred | I think we are polling on something that is invalid for too long | 17:59 |
| cloudnull | ++ | 18:00 |
| pabelanger | clarkb: ack | 18:00 |
| mordred | so we need to fix the poll-for-ready for that - but also, to get actual better behavior we'll have to start tracking fips as actual resources in our local db | 18:00 |
| pabelanger | #status log logstash-worker07.openstack.org now running ubuntu-trusty and processing requests | 18:00 |
| openstackstatus | pabelanger: finished logging | 18:00 |
| cloudnull | maybe give it 60 seconds and die | 18:00 |
| mordred | nodepool does not actually know anything about fips | 18:00 |
| mordred | because fips are an implementation detail that users should not need to know about | 18:01 |
| mordred | that said - given that we have two clouds that have made the decision to force their users to use them | 18:01 |
| fungi | is this something shade's inventory should track instead? | 18:01 |
| mordred | no | 18:01 |
| mordred | shade's inventory is a completely different thing | 18:01 |
| clarkb | the problem is on the cloud side you don't get reliable info | 18:01 |
| mordred | I mean | 18:01 |
| mordred | yah | 18:01 |
| mordred | what clarkb said | 18:01 |
| clarkb | so the only way to have concrete information when reusing is to track it yourself | 18:02 |
| mordred | yup | 18:02 |
| mordred | we'd have to track the creation of fips in the db like we do for servers | 18:02 |
| mordred | since there is no way to actually get valid info from the cloud | 18:02 |
| fungi | apparently even as an _operator_ of said cloud you don't get reliable/sufficient info to be able to see why it doesn't work when it breaks | 18:02 |
| clarkb | because nova/neutron can tell you an FIP is unused that is totally being used | 18:02 |
| mordred | yup | 18:02 |
| mordred | cloudnull: y'all should move to provider network for public and ditch the fip crap | 18:03 |
| mordred | clarkb: but I'm guessing that's a larger fight :) | 18:03 |
| clarkb | or just ipv6 >_> | 18:03 |
| mordred | ipv6 ftw | 18:03 |
| *** jordanP has quit IRC | 18:03 | |
| cloudnull | mordred: +1 i'd tend to agree. | 18:03 |
| mordred | ipv6 addresses on osic would obviate the all the fip stuff | 18:03 |
| fungi | i've heard a rumor that rackspace and intel don't have any ip addresses because they squandered them all on booze | 18:03 |
| mordred | :) | 18:04 |
| anteaya | the forecasted rain has arrived, I wonder how long before the forecasted thunderstorms show up | 18:04 |
| cloudnull | mordred: ++ working on the ipv6 inclusion in OSIC | 18:04 |
| docaedo | can you buy booze with ipv6 addresses? Because I've been hoarding those things! | 18:04 |
| mordred | fungi: to be fair, fips have bumpkiss to do with not having enough ips | 18:04 |
| *** pvaneck has quit IRC | 18:04 | |
| fungi | cloudnull: yep, if you had working ipv6 there we'd use exactly one floating ip (for our mirror server, because it needs working ipv4 to support afs's ancient network stack) | 18:04 |
| cloudnull | fungi: I can no confirm nor deny the rumor | 18:05 |
| mordred | fungi: if your users need public ips, they need public ips. if they don't, they don't. the mechanism by which a user gets a public ip is not related to how many available addresses a cloud has | 18:05 |
| mordred | fungi: ++ | 18:05 |
| fungi | i can only assume cloud providers who force fips on their customers do so because they're worried they'll "accidentally" create instances with interfaces on the public provider network when they don't actually need it | 18:06 |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-kibana: Configure apache when we use it https://review.openstack.org/321777 | 18:06 |
| clarkb | pabelanger: oh I have to do it on both sides? this is going to be tricky | 18:06 |
| mordred | fungi: yah. that's the best I can come up with too | 18:06 |
| clarkb | pabelanger: lets see if that is sufficient and if so roll with it, else we cry, then fix | 18:06 |
| cloudnull | when I get back to "work" v6 will be a thing I'll be pressing on . | 18:06 |
| * mordred hands cloudnull a lemur | 18:07 | |
| fungi | cloudnull: please go rest up and recharge in preparation for that awesome task ;) | 18:07 |
| cloudnull | hahaha. | 18:07 |
| * cloudnull grabs another beer. | 18:07 | |
| clarkb | I think I am switching ISPs (I have option of half gig or gigabit at new place) but if I do that no more native v6 | 18:07 |
| clarkb | gonna have to tunnel | 18:07 |
| cloudnull | ok im off again . | 18:07 |
| cloudnull | have a good one. | 18:07 |
| *** tqtran has quit IRC | 18:07 | |
| *** cdent has joined #openstack-infra | 18:07 | |
| fungi | but yeah, the current fip allocation delays/timeouts we see mean that we get ~25% utilization out of our quota in osic | 18:08 |
| fungi | teh other 75% is tied up waiting for fips which will never go active | 18:08 |
| pabelanger | clarkb: I think 321777 is enough | 18:08 |
| *** cdent has left #openstack-infra | 18:08 | |
| clarkb | pabelanger: it won't be if the other side that defines those things runs after the side where I added the checks | 18:08 |
| clarkb | I think this is a place where puppet's language design and module setup butts heads with roll forward non atomic cross repo dependencies | 18:09 |
| pabelanger | Ya, we'll have to approve them back to back | 18:09 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: tempest: move puppet jobs from exp to check pipeline https://review.openstack.org/321174 | 18:10 |
| *** javeriak has quit IRC | 18:11 | |
| pabelanger | #status log logstash-worker08.openstack.org now running ubuntu-trusty and processing requests | 18:11 |
| openstackstatus | pabelanger: finished logging | 18:11 |
| *** ihrachys has quit IRC | 18:12 | |
| *** xyang1 has quit IRC | 18:14 | |
| *** javeriak has joined #openstack-infra | 18:14 | |
| *** xyang1_ has joined #openstack-infra | 18:15 | |
| *** resker has quit IRC | 18:17 | |
| *** isaacb has joined #openstack-infra | 18:18 | |
| *** nadya has quit IRC | 18:18 | |
| *** gomarivera has joined #openstack-infra | 18:19 | |
| *** esikachev has joined #openstack-infra | 18:20 | |
| *** inc0 has joined #openstack-infra | 18:21 | |
| *** baoli_ has quit IRC | 18:21 | |
| *** baoli has joined #openstack-infra | 18:21 | |
| *** esker has joined #openstack-infra | 18:22 | |
| pabelanger | #status log logstash-worker09.openstack.org now running ubuntu-trusty and processing requests | 18:23 |
| openstackstatus | pabelanger: finished logging | 18:23 |
| *** jamesmcarthur has quit IRC | 18:23 | |
| *** hashar has joined #openstack-infra | 18:23 | |
| *** rossella_s has quit IRC | 18:24 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: Change DLRN promote method https://review.openstack.org/321801 | 18:24 |
| *** rossella_s has joined #openstack-infra | 18:24 | |
| *** markus__ has quit IRC | 18:25 | |
| EmilienM | pabelanger: any chance we can review https://review.openstack.org/#/c/320663/ please? I'm trying to make progress on migrating our jobs to xenial | 18:26 |
| *** nadya has joined #openstack-infra | 18:27 | |
| *** rbrndt has quit IRC | 18:27 | |
| *** chem`` has quit IRC | 18:28 | |
| *** bpokorny has joined #openstack-infra | 18:29 | |
| *** chem`` has joined #openstack-infra | 18:29 | |
| pabelanger | EmilienM: +2 | 18:29 |
| EmilienM | nibalizer: maybe you can +A | 18:30 |
| *** flepied has joined #openstack-infra | 18:30 | |
| *** jamesmcarthur has joined #openstack-infra | 18:32 | |
| *** pvaneck has joined #openstack-infra | 18:33 | |
| *** salv-orlando has quit IRC | 18:33 | |
| *** esker has quit IRC | 18:35 | |
| *** kraynevs has quit IRC | 18:35 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add static zuul launcher https://review.openstack.org/321615 | 18:36 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Move zuul site/node config into hiera https://review.openstack.org/321616 | 18:36 |
| *** Apoorva has quit IRC | 18:36 | |
| pabelanger | #status log logstash-worker10.openstack.org now running ubuntu-trusty and processing requests | 18:36 |
| *** bhavik has joined #openstack-infra | 18:36 | |
| openstackstatus | pabelanger: finished logging | 18:36 |
| *** gyee has joined #openstack-infra | 18:36 | |
| *** ddieterly[away] has quit IRC | 18:38 | |
| *** Apoorva has joined #openstack-infra | 18:40 | |
| *** _vsaienko has joined #openstack-infra | 18:40 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add static zuul launcher https://review.openstack.org/321615 | 18:41 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Move zuul site/node config into hiera https://review.openstack.org/321616 | 18:41 |
| openstackgerrit | Merged openstack-infra/puppet-zuul: Support static nodes in ansible launcher https://review.openstack.org/321584 | 18:41 |
| *** savihou has joined #openstack-infra | 18:44 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add static zuul launcher https://review.openstack.org/321615 | 18:47 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Move zuul site/node config into hiera https://review.openstack.org/321616 | 18:47 |
| *** bhavik has quit IRC | 18:47 | |
| *** lucas-afk has quit IRC | 18:48 | |
| fungi | anybody able to read beakerese around to explain why the ansible pin change is failing this job? http://logs.openstack.org/72/321772/1/check/gate-puppet-ansible-puppet-beaker-rspec-centos-7/78742f0/console.html | 18:48 |
| openstackgerrit | Merged openstack-infra/nodepool: Add assign-via-gearman to config validator https://review.openstack.org/321753 | 18:49 |
| clarkb | fungi: it is applying the same manifest twice and checking that the return code says no changes were made on the second run | 18:50 |
| clarkb | http://logs.openstack.org/72/321772/1/check/gate-puppet-ansible-puppet-beaker-rspec-centos-7/78742f0/console.html#_2016-05-26_17_54_15_289 | 18:50 |
| *** claudiub has quit IRC | 18:50 | |
| *** cloudtrainme has joined #openstack-infra | 18:50 | |
| *** ddieterly has joined #openstack-infra | 18:50 | |
| clarkb | I seem to recall the pip provider isnt good about that | 18:50 |
| *** daemontool has quit IRC | 18:51 | |
| clarkb | we might just want to drop that idempotency test for now | 18:51 |
| _vsaienko | clarkb: good morning | 18:51 |
| clarkb | _vsaienko: hello | 18:52 |
| jeblair | clarkb: what did it change in the second run? | 18:52 |
| clarkb | jeblair: I think the pip provider reports it reinstalled that version of ansible every time it runs | 18:53 |
| _vsaienko | clarkb: I have a few comment about https://review.openstack.org/#/c/304473/. We need to have additional job for cleaning due to several reasons. First is configuration - cleaning use VMs with raw image and the size of disk 1 GB. | 18:53 |
| clarkb | you can see just a bit furthre up it says need to install ansible | 18:53 |
| jeblair | clarkb, fungi: oh, maybe this is the thing you were thinking of earlier? | 18:53 |
| _vsaienko | cleaning is big feature and in future we will add more tests related to it | 18:53 |
| fungi | clarkb: oh, i was thinking the apply at 17:53:52.638 and at 17:54:08.926 together comprised the idempotency test. the latter shows no changes | 18:53 |
| EmilienM | nibalizer: you also might want to look https://review.openstack.org/#/c/321613/ if you can | 18:53 |
| jeblair | fungi: maybe it wasn't git that pulses every time under some circumstances, maybe it was pip? | 18:53 |
| clarkb | http://logs.openstack.org/72/321772/1/check/gate-puppet-ansible-puppet-beaker-rspec-centos-7/78742f0/console.html#_2016-05-26_17_54_14_820 | 18:54 |
| _vsaienko | clarkb: and the most important that previously cleaning was enabled on main jobs, but erasing disks is not stable on slow slaves, that is why it was completely disabled | 18:54 |
| *** lucasagomes has joined #openstack-infra | 18:54 | |
| fungi | jeblair: i think there was a similar problem with vcsrepo but now i don't recall the exact circumstances | 18:54 |
| clarkb | _vsaienko: but you only have to test it with a single test case right? yo udon't need it to be used on every test case | 18:54 |
| fungi | jeblair: but yeah i think if you tell the pip package provider to "upgrade" then it does this on every run even when set to a specific version | 18:55 |
| *** gomarivera has quit IRC | 18:55 | |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-ansible: Pin to ansible 2.0.2.0 https://review.openstack.org/321772 | 18:55 |
| jeblair | clarkb, fungi: ^ assuming spec files use # as comments | 18:55 |
| *** nwkarsten has quit IRC | 18:56 | |
| *** javeriak has quit IRC | 18:57 | |
| _vsaienko | at the moment there is only one test for cleaning, but in future we will add more | 18:57 |
| *** gomarivera has joined #openstack-infra | 18:57 | |
| nibalizer | EmilienM: i can try to get to it, but mostly working internally today | 18:58 |
| _vsaienko | the configuration for cleaning is different from main (default) use-case, disk should be small for cleaning to speed up the job. It requires to use root_hints which is not used by default. | 18:59 |
| EmilienM | nibalizer: thanks | 18:59 |
| *** shamail has joined #openstack-infra | 18:59 | |
| *** nwkarsten has joined #openstack-infra | 19:00 | |
| *** nwkarsten has quit IRC | 19:00 | |
| *** nwkarsten has joined #openstack-infra | 19:00 | |
| *** inc0 has quit IRC | 19:00 | |
| *** inc0_ has joined #openstack-infra | 19:00 | |
| *** baoli has quit IRC | 19:01 | |
| *** gomarivera has quit IRC | 19:01 | |
| clarkb | _vsaienko: so you can't explicitly request your disk is cleaned up as a user? it has to be set by the deployment? | 19:01 |
| clarkb | that seems like a bug in ironic, but if that is the case then a separate job is probably easiest for now | 19:01 |
| *** baoli has joined #openstack-infra | 19:01 | |
| *** esker has joined #openstack-infra | 19:02 | |
| *** madhuvishy has joined #openstack-infra | 19:02 | |
| _vsaienko | clarkb, Right, cleaning may be enabled in ironic.config | 19:05 |
| madhuvishy | Hi! I have an open patch to Jenkins Job builder that I'd love to get merged soon (it was +1-ed but is not merged yet) - https://review.openstack.org/#/c/313196/. I was wondering if someone could help | 19:05 |
| clarkb | _vsaienko: I get that it can be enabled there but can it also be requested by the user via the api? | 19:05 |
| *** vgridnev has quit IRC | 19:05 | |
| clarkb | _vsaienko: if so the easiest thing is just to have a specific test case that exercises that without adding a complete new job | 19:05 |
| _vsaienko | clarkb if it is not enabled in config it can't | 19:07 |
| _vsaienko | clarkb but if it is enabled, cleaning will be performed after instance termination | 19:07 |
| clarkb | ok | 19:08 |
| clarkb | jroll: ^ is that not a bug in the ironic api? | 19:08 |
| mordred | clarkb: don't forget - ironic is an admin api not an end-user api | 19:08 |
| clarkb | mordred: but even admins have use of that | 19:08 |
| *** amoralej is now known as amoralej|off | 19:08 | |
| clarkb | run a service on baremetal for 3 months then go to delete it and realize you need to scrub the disk | 19:08 |
| jroll | clarkb: is what not a bug | 19:08 |
| clarkb | do you redeploy ironic just to do that correctly? no you ask ironic to do it nicely and it does it | 19:09 |
| jroll | there's two modes of cleaning | 19:09 |
| clarkb | jroll: apparently you cannot clean baremetal disks unless you have decided in advance that you need to | 19:09 |
| jroll | automated: happens after every instance delete, always. toggleable via config. | 19:09 |
| jroll | manual: an operator can take a node and manually run a given part of cleaning. always available. | 19:10 |
| clarkb | ok then we can have a special test case for this | 19:10 |
| * clarkb still asserts that that is a better place to start than adding yet another job to ironic | 19:10 | |
| *** vgridnev has joined #openstack-infra | 19:10 | |
| jroll | clarkb: so the current oddness about the extra test case is, our normal test cases are like 10gb vm or something. shred is... not doable in the gate for that much disk | 19:11 |
| clarkb | yes that isn't an issue | 19:11 |
| clarkb | do it in a specific test case with an instance that has the right size disk | 19:11 |
| *** jamesmcarthur has quit IRC | 19:12 | |
| clarkb | (as an aside I am almost 100% sure yo ucould use the tiny disk everywhere and it would be fine) | 19:12 |
| jroll | yeah, I agree with the tiny disk everywhere assertion | 19:12 |
| fungi | or replace shred with a script that just records whether it was called and check that? | 19:12 |
| _vsaienko | jroll in this case we will use root_hints which are not default case | 19:12 |
| clarkb | the reason I ask for this is we have a huge number of combos for ironi tests today and no one understands what they do and I am pretty sure they are largely redundant | 19:12 |
| jroll | clarkb: yeah, it's on our priority list to consolidate these over this cycle | 19:13 |
| *** matrohon has joined #openstack-infra | 19:13 | |
| jroll | many are new jobs replacing other jobs but we wanted to let them be -nv for a while | 19:13 |
| *** e0ne has joined #openstack-infra | 19:13 | |
| jroll | (tinyipa, ipmitool, etc) | 19:13 |
| *** mhickey has joined #openstack-infra | 19:14 | |
| *** inc0_ has quit IRC | 19:14 | |
| *** hashar has quit IRC | 19:15 | |
| JayF | I have a patch up that will be updating today | 19:15 |
| JayF | related to consolidating some of those jobs | 19:15 |
| clarkb | in any case I don't want to stall out testing functionality, my suggestion is to have a specific test case for ti rather than a completely new job. If that is not doable (from what I am hearing it should be) we can add that job | 19:16 |
| *** gomarivera has joined #openstack-infra | 19:16 | |
| *** fawadkhaliq has quit IRC | 19:16 | |
| *** inc0 has joined #openstack-infra | 19:17 | |
| *** xarses has quit IRC | 19:18 | |
| e0ne | fungi: hi. looks like I need your help again | 19:19 |
| fungi | e0ne: same problem or a new one? | 19:20 |
| e0ne | fungi: the new problem with the same job | 19:20 |
| e0ne | fungi: http://logs.openstack.org/68/317668/1/check/gate-brick-cinderclient-ext-dsvm-functional/201e4ca/logs/devstacklog.txt.gz | 19:20 |
| *** gomarivera has quit IRC | 19:20 | |
| e0ne | it can't install python-brick-cinderclient-ext | 19:20 |
| _vsaienko | clarkb, jroll I think that we need to have a new job. change deployment configuration between tests is not good. I didn't was anything similar in tempest. | 19:21 |
| *** matrohon has quit IRC | 19:21 | |
| clarkb | _vsaienko: you odn't have to change config between tests, there is the manual mode | 19:21 |
| jroll | _vsaienko: yeah, I think testing manual cleaning is sufficient | 19:22 |
| _vsaienko | clarkb, automated cleaning is default mode that ironic offers for users | 19:22 |
| jroll | _vsaienko: what we really want to test is that when ironic is told to clean, it does it. whether manual or auto | 19:22 |
| *** baoli has quit IRC | 19:23 | |
| fungi | e0ne: it looks like it never tried to install python-brick-cinderclient-ext in the first place | 19:23 |
| e0ne | fungi: it could be a devstack issue, I'm not sure | 19:23 |
| *** matrohon has joined #openstack-infra | 19:23 | |
| _vsaienko | jroll, ok will rewrite tests than | 19:24 |
| jroll | _vsaienko: sorry, I didn't think of this :( | 19:24 |
| fungi | e0ne: i suspect it either needs to be in the PROJECTS list for the job, or a dependency of something which is? you'll probably get a better answer in #openstack-qa | 19:24 |
| e0ne | fungi: thanks, I'll ask it there | 19:25 |
| fungi | e0ne: i'm looking in the setup logs now | 19:25 |
| *** esker has quit IRC | 19:25 | |
| clarkb | fungi: e0ne I believe that error occurs when a libs from git lib is installed from pypi | 19:25 |
| *** esker has joined #openstack-infra | 19:26 | |
| *** Douhet has quit IRC | 19:26 | |
| _vsaienko | jroll, np there is not so much to change. | 19:26 |
| _vsaienko | clarkb, jroll thanks for your time! | 19:26 |
| fungi | e0ne: clarkb: yeah, it seems to be in the projects list http://logs.openstack.org/68/317668/1/check/gate-brick-cinderclient-ext-dsvm-functional/201e4ca/logs/devstack-gate-setup-workspace-new.txt.gz#_2016-05-25_22_25_31_829 | 19:28 |
| *** hashar has joined #openstack-infra | 19:28 | |
| clarkb | also LIBS_FROM_GIT requires special handling in the case of a plugin I think | 19:28 |
| fungi | e0ne: clarkb: but i don't see it in the pip freeze output http://logs.openstack.org/68/317668/1/check/gate-brick-cinderclient-ext-dsvm-functional/201e4ca/logs/pip2-freeze.txt.gz | 19:28 |
| *** matrohon has quit IRC | 19:28 | |
| fungi | so i still think it's never getting pip installed | 19:28 |
| clarkb | fungi: a | 19:29 |
| clarkb | er ya | 19:29 |
| e0ne | fungi, clarkb: so, is it wrong https://github.com/openstack-infra/project-config/blob/39d2568cecb985429a34b9b226744cf399b69b53/jenkins/jobs/cinder.yaml#L56? | 19:29 |
| clarkb | e0ne: I don't think it is wrong, I just odn't think it is sufficient | 19:29 |
| clarkb | e0ne: all that says is devstack-gate make sure the git repo for this is ready and ask devstack tp intsall it | 19:30 |
| clarkb | if devstack doesn't honor that then you have this error | 19:30 |
| *** esker has quit IRC | 19:30 | |
| *** matrohon has joined #openstack-infra | 19:30 | |
| fungi | yeah, presumably there's extra magic to make sure devstack pip installs it (in this case from the checked-out source tree) | 19:30 |
| calebb | mordred: nevermind, looks like you can add metadata to objects, you just have to pass create_object arguments that look like x-object-meta-bar='foo' and the headers turn them into metadata | 19:30 |
| *** Douhet has joined #openstack-infra | 19:31 | |
| JayF | jroll: I agree manual cleaning is sufficient *if* auto cleaning is still enabled and verified (even if the effective work is skipped) | 19:31 |
| JayF | jroll: i.e. tempest does confirm that the node goes to CLEANING on delete, right? even if CLEANING is pretty much a noop | 19:31 |
| *** zzzeek has quit IRC | 19:31 | |
| calebb | mordred: although perhaps that should be made easier... idk | 19:31 |
| *** ilyashakhat has joined #openstack-infra | 19:32 | |
| mordred | calebb: I am 100% sure that it should be made easier | 19:33 |
| mordred | calebb: like, perhaps a metadata argument that takes a dictionary and produces the x-object-meta headers to the underlying call | 19:34 |
| calebb | yeah | 19:34 |
| calebb | that's what im thinking | 19:34 |
| mordred | calebb: also - is adding metadata to existing objects a thing? | 19:34 |
| *** bpokorny has quit IRC | 19:34 | |
| mordred | Shrews: ^^ | 19:34 |
| openstackgerrit | Merged openstack-infra/puppet-ansible: Pin to ansible 2.0.2.0 https://review.openstack.org/321772 | 19:35 |
| e0ne | clarkb: got it! https://github.com/openstack-dev/devstack/blob/a3715a2e1ac8dfcddf47302e147982a0bb726b76/stackrc#L484 - probably I need something like it | 19:36 |
| e0ne | clarkb: I'll try to make a patch for it | 19:36 |
| fungi | e0ne: looking at the aodh as an exmaple (not sure if it's a _good_ example) it's explicitly installing the project in a devstack plugin script http://git.openstack.org/cgit/openstack/aodh/tree/devstack/plugin.sh#n292 | 19:36 |
| calebb | mordred: that is a thing that swift lets you do, doesnt look like shade has a update_object function or anything that would do it | 19:37 |
| *** gomarivera has joined #openstack-infra | 19:37 | |
| *** pradk has quit IRC | 19:38 | |
| e0ne | clarkb: brb in 15 mins. I'll try to fix it in devtack | 19:38 |
| mordred | calebb: nod. we might also want to write one of those - but not important to do it this pass | 19:39 |
| *** zzzeek has joined #openstack-infra | 19:39 | |
| calebb | ok | 19:40 |
| Shrews | mordred: i want to be called MetaShadePeace from here on out | 19:41 |
| openstackgerrit | Merged openstack-infra/project-config: puppet/experimental: deploy puppet4 https://review.openstack.org/320663 | 19:41 |
| *** gomarivera has quit IRC | 19:41 | |
| *** baoli has joined #openstack-infra | 19:41 | |
| *** xarses has joined #openstack-infra | 19:42 | |
| mordred | Shrews: you know how to accomplish that :) | 19:45 |
| openstackgerrit | lifeless proposed openstack-infra/project-config: Pip now uses 'master' instead of develop. https://review.openstack.org/321822 | 19:45 |
| lifeless | ^- thats urgent, its broken pbr CI | 19:45 |
| lifeless | mordred: fungi: ^ | 19:45 |
| openstackgerrit | Merged openstack-infra/project-config: Refactorize Puppet versions testing matrix https://review.openstack.org/321613 | 19:45 |
| *** Apoorva has quit IRC | 19:45 | |
| lifeless | [picked the last two infra cores to type :)] | 19:45 |
| *** flepied has quit IRC | 19:46 | |
| anteaya | dhellmann: do you happen to have a link to the launchpad page that shows milestones similar to what you said you wanted from storyboard last night? | 19:46 |
| dhellmann | anteaya : no, this is a new thing I'm trying to do for tracking the steps teams need to go through to complete their release. | 19:47 |
| *** gomarivera has joined #openstack-infra | 19:47 | |
| *** bpokorny has joined #openstack-infra | 19:47 | |
| dhellmann | we used a spreadsheet last cycle, but that was sort of a pain | 19:47 |
| anteaya | dhellmann: oh okay | 19:48 |
| anteaya | any chance you have a link to that? | 19:48 |
| anteaya | just to help the storyboard devs get a visual of what would fit your needs? | 19:49 |
| dhellmann | anteaya : https://docs.google.com/spreadsheets/d/1BLUDgediqgOzLZMMe8a3EAPOtyINAg2rpMtSyWjhC4o/edit#gid=0 | 19:49 |
| *** salv-orlando has joined #openstack-infra | 19:49 | |
| *** ilyashakhat has quit IRC | 19:49 | |
| dhellmann | the existing view would work, but I don't want to have to maintain state by hand | 19:49 |
| *** e0ne has quit IRC | 19:49 | |
| *** tphummel has joined #openstack-infra | 19:49 | |
| dhellmann | what I "want" is really vague, so I wouldn't consider this a blocker by any means | 19:49 |
| dhellmann | for newton we're planning to do a lot less tracking, and use the releases.o.o site to tell what versions projects are at and the release request dashboard to tell what pending releases we have | 19:50 |
| dhellmann | the thing that's hard to track is the case where a project knows they are going to need another release candidate, but hasn't asked for it because the patch hasn't landed | 19:51 |
| anteaya | oh my | 19:51 |
| dhellmann | so things that we need them to do but that they haven't submitted a patch for (adopting reno is another example) | 19:51 |
| dhellmann | yeah | 19:51 |
| anteaya | okay this might take a few tries for the storyboard devs to envision | 19:51 |
| dhellmann | yeah, we should probably focus on the basic cases before this one | 19:52 |
| anteaya | as I don't know how familiar they are with the release workflow | 19:52 |
| anteaya | but it is good to know what you are thinking about in terms of workflow | 19:52 |
| anteaya | the more they know the more they can ensure other features aren't created that conflict with it | 19:53 |
| anteaya | dhellmann: you got auto worklists working, correct? | 19:53 |
| dhellmann | I'm not sure what that is, so I don't know | 19:53 |
| anteaya | ah okay great | 19:53 |
| anteaya | join me on the storyboard-dev server | 19:53 |
| lifeless | clarkb: fungi: thanks | 19:53 |
| dhellmann | if it involves anything to do with querying using more than simple keywords I couldn't figure it out | 19:53 |
| anteaya | dhellmann: here is a list I automatically generated of all the tasks assigned to Adam: https://storyboard-dev.openstack.org/#!/worklist/6 | 19:54 |
| anteaya | I only have a few stories on the dev server right now: https://storyboard-dev.openstack.org/#!/story/list | 19:54 |
| *** e0ne has joined #openstack-infra | 19:55 | |
| anteaya | dhellmann: I've just assigned this story to you: https://storyboard-dev.openstack.org/#!/story/5 | 19:55 |
| anteaya | dhellmann: if you sign in and then create a new worklist (top left corner) there is a check box for automatic | 19:55 |
| anteaya | enter your name as a filter for automatically creating a worklist | 19:55 |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: partitioning-parted: extraced and adapted element https://review.openstack.org/313938 | 19:55 |
| anteaya | dhellmann: you should have a list with story 5 in it | 19:56 |
| dhellmann | https://storyboard-dev.openstack.org/?#!/worklist/7 | 19:56 |
| dhellmann | I put "Doug Hellmann" in the filter. | 19:56 |
| dhellmann | empty list | 19:56 |
| *** shamail has quit IRC | 19:56 | |
| dhellmann | is my name something else? | 19:56 |
| anteaya | dhellmann: okay can you add me as a user to your worklist? | 19:56 |
| *** pradk has joined #openstack-infra | 19:56 | |
| anteaya | beside the title there should be a red pencil | 19:56 |
| dhellmann | sure, hang on, let me finish tagging this cinder client so I can pay full attention | 19:56 |
| anteaya | dhellmann: ah sorry | 19:57 |
| anteaya | didn't mean to interrupt your other work | 19:57 |
| *** rbrndt has joined #openstack-infra | 19:57 | |
| dhellmann | done | 19:57 |
| *** ihrachys has joined #openstack-infra | 19:57 | |
| anteaya | great so clicking the red pencil should allow you to edit the worklist, if you add me as a user I can also edit the worklist and see how you have it configured | 19:58 |
| dhellmann | yep, done | 19:58 |
| dhellmann | hmm, ok, somehow it didn't add the filter I thought I entered | 19:58 |
| *** sdake_ has joined #openstack-infra | 19:58 | |
| dhellmann | so there's no filter at all? | 19:58 |
| *** asettle has joined #openstack-infra | 19:59 | |
| *** asettle has quit IRC | 19:59 | |
| anteaya | that would explain why it has no items | 19:59 |
| anteaya | I can't yet edit the worklist, perhaps user is insufficent | 19:59 |
| dhellmann | ok, I added a filter | 19:59 |
| anteaya | maybe I need to be owner or admin? | 19:59 |
| dhellmann | how do I match on something other than name? | 19:59 |
| anteaya | yay there is an item | 19:59 |
| anteaya | you can match on repo | 19:59 |
| anteaya | now I see the red pencil, thank you | 20:00 |
| *** sdake has quit IRC | 20:00 | |
| anteaya | right now only gertty in stackforge and gertty in openstack have stories | 20:00 |
| *** Apoorva has joined #openstack-infra | 20:01 | |
| anteaya | I just populated those two repos | 20:01 |
| anteaya | I checked the production repo stackforge/gertty doesn't exist on the production repo | 20:01 |
| dhellmann | I guess I could file all of the tasks against the releases repo | 20:01 |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: [WIP] Add: lvm element https://review.openstack.org/316529 | 20:01 |
| anteaya | okay, we could try that to see if it can work for you | 20:01 |
| anteaya | you can concatenate filters | 20:02 |
| dhellmann | interesting, all tasks must have a project | 20:02 |
| anteaya | hard to show with only 6 stories | 20:02 |
| anteaya | yes all tasks must have a project | 20:02 |
| dhellmann | I guess I want a separate story for each task for each project so I can track what's done on one screen, unless there's a way to see the "next task" or something in a work view? | 20:03 |
| anteaya | what would you consider to be 'the next task' | 20:04 |
| *** savihou has quit IRC | 20:04 | |
| anteaya | I'm not following what you are visualizing yet | 20:05 |
| clarkb | oh hey APIs are fair use | 20:05 |
| dhellmann | well, there's a sequence of things to be done for the release. so if a "story" is "milestone 1" then there may only be one task ("submit release request") but for the final we might have things like merge translation, rc1, rc2, etc. | 20:05 |
| clarkb | er using APIs is | 20:05 |
| dhellmann | so what I want to see is a view for all projects telling me which things they haven't done, or at least what's "next" if the tasks are in order | 20:05 |
| pabelanger | jeblair: do you have any thoughts why rax-iad seems, on average, 10 nodes away from max servers? http://grafana.openstack.org/dashboard/db/nodepool-rackspace Would that be a result of miss counting sub nodes? | 20:05 |
| pabelanger | looking at data over the last 60days, we always seem ~10 nodes down from rax | 20:06 |
| pabelanger | max8 | 20:06 |
| anteaya | dhellmann: okay so merge translation would be a task, then rc1 would be a task, then rc2 would be a task | 20:06 |
| dhellmann | the work list shows me the stories, but no other details | 20:06 |
| dhellmann | that makes sense | 20:06 |
| anteaya | dhellmann: the story would be the general bit that encompassed all those tasks | 20:06 |
| e0ne | fungi, clarkb: I've missed these steps http://docs.openstack.org/infra/manual/creators.html#updating-devstack :( | 20:07 |
| anteaya | dhellmann: right the work list shows you the stories, not other details, if you click the story you can see the details of that story | 20:07 |
| dhellmann | yeah, how I fit things into the data model is going to depend a lot on what sorts of visualizations I can get. So if a work list only shows stories, I'd have to use those for everything | 20:07 |
| anteaya | dhellmann: but not the details in one view | 20:07 |
| *** ayoung has quit IRC | 20:07 | |
| dhellmann | yeah | 20:07 |
| anteaya | dhellmann: right that makes sense | 20:07 |
| lifeless | how is list administration done? specifically adding topics to openstack-announce | 20:08 |
| dhellmann | lifeless : I know the magic word for that one, what topic do you want added? | 20:08 |
| anteaya | dhellmann: okay let's keep working on this the closer you can get to an explaination of what data you would like displayed the easier it is to break it down into tasks | 20:08 |
| lifeless | dhellmann: [new] | 20:08 |
| e0ne | fungi, clarkb: thanks a lot for the help! I know how all infra team is busy, but you always help | 20:08 |
| dhellmann | lifeless : oh, yeah, let me find the right page | 20:09 |
| anteaya | dhellmann: also if you have any documenation about your release workflow from a perpective of helping the storyboard folks understand and comsume it | 20:09 |
| dhellmann | lifeless : ok, try reloading and see if it shows up properly | 20:09 |
| dhellmann | lifeless : fwiw, there are no other formal topics for that list | 20:09 |
| lifeless | dhellmann: yup, though I suspect the definition may be wrong, from my memory of the regex used on e.g. openstack-devel | 20:10 |
| dhellmann | anteaya : sure. We're evolving that, and I need to write better docs. After PyCon, I think. | 20:10 |
| anteaya | okay thanks | 20:10 |
| dhellmann | lifeless : oh? do I need some [] or something? | 20:11 |
| anteaya | dhellmann: are we fair with saying this will be a work in progress then, it make take some time to figure out? | 20:11 |
| dhellmann | anteaya : oh, definitely. as I said, this should not be considered a blocker for early adoption | 20:11 |
| *** vgridnev has quit IRC | 20:11 | |
| anteaya | dhellmann: okay great thank you | 20:11 |
| anteaya | dhellmann: thanks for having a look at the dev instance | 20:11 |
| anteaya | I appreciate it | 20:11 |
| dhellmann | anteaya : thanks for the walk-through | 20:12 |
| anteaya | anytime | 20:12 |
| anteaya | :) | 20:12 |
| lifeless | dhellmann: look at http://lists.openstack.org/cgi-bin/mailman/options/openstack-dev/you email here/?VARHELP=Cross-project+coordination | 20:13 |
| *** isaacb has quit IRC | 20:13 | |
| lifeless | dhellmann: something like .*\[All\].* | 20:14 |
| lifeless | bah | 20:14 |
| openstackgerrit | Caleb Boylan proposed openstack-infra/shade: Make it easier to give swift objects metadata https://review.openstack.org/321835 | 20:14 |
| lifeless | dhellmann: something like .*\[[nN][eE][wW]\].* | 20:14 |
| anteaya | I'm thinking I may also go for a walk | 20:14 |
| dhellmann | lifeless : ok, I updated it. those emails are automatically generated so they're all lower case all the time | 20:15 |
| *** flwang1 has quit IRC | 20:15 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: move puppet4 jobs into check pipeline https://review.openstack.org/321837 | 20:16 |
| jeblair | pabelanger: re max servers; i don't know | 20:16 |
| jeblair | pabelanger, clarkb, fungi: w00t -- puppet update of project-config triggered zuul launcher job config update: http://paste.openstack.org/show/505735/ | 20:18 |
| pabelanger | jeblair: \o/ | 20:20 |
| *** kgiusti has left #openstack-infra | 20:20 | |
| pabelanger | #status log osic appears down at the moment. Following up with #osic for information | 20:21 |
| openstackstatus | pabelanger: finished logging | 20:21 |
| *** ddieterly is now known as ddieterly[away] | 20:22 | |
| *** e0ne has quit IRC | 20:23 | |
| *** e0ne has joined #openstack-infra | 20:27 | |
| *** e0ne has quit IRC | 20:29 | |
| *** e0ne has joined #openstack-infra | 20:33 | |
| *** tphummel has quit IRC | 20:33 | |
| openstackgerrit | Merged openstack-infra/puppet-kibana: Configure apache when we use it https://review.openstack.org/321777 | 20:33 |
| *** julim_ has quit IRC | 20:33 | |
| openstackgerrit | Merged openstack-infra/puppet-logstash: Cleanup apache configuration https://review.openstack.org/321778 | 20:33 |
| openstackgerrit | Merged openstack-infra/project-config: Start using the Zuul Ansible launcher https://review.openstack.org/321221 | 20:34 |
| clarkb | yay will make a new logstash.o.o in a bit | 20:34 |
| *** gomarivera has quit IRC | 20:35 | |
| jeblair | pabelanger: did you ping cloudnull? | 20:37 |
| pabelanger | jeblair: I have not, but this might be an issue with openstackclient. | 20:37 |
| pabelanger | jeblair: clarkb pointed out to check the SSL cert, and we noticed it was just changed to day on cloud.osic.org | 20:38 |
| jeblair | that would cause 503? | 20:38 |
| pabelanger | jeblair: I PB the debug log in #openstack-sprint showing the error | 20:38 |
| *** ilyashakhat has joined #openstack-infra | 20:39 | |
| openstackgerrit | melanie witt proposed openstack/os-testr: Sort failed tests at the top on HTML result page https://review.openstack.org/321841 | 20:39 |
| *** woodster_ has joined #openstack-infra | 20:40 | |
| *** salv-orl_ has joined #openstack-infra | 20:44 | |
| *** Ravikiran_K has quit IRC | 20:45 | |
| *** tphummel has joined #openstack-infra | 20:45 | |
| *** salv-orlando has quit IRC | 20:47 | |
| *** tphummel has quit IRC | 20:50 | |
| *** ddieterly[away] is now known as ddieterly | 20:50 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Remove kilo-bitrot-jobs from Designate https://review.openstack.org/318080 | 20:51 |
| openstackgerrit | Ivan Kolodyazhny proposed openstack-infra/devstack-gate: Add python-brick-cinderclient-ext workspace setup https://review.openstack.org/321845 | 20:51 |
| *** eharney has quit IRC | 20:51 | |
| *** KaiyanSheng has quit IRC | 20:51 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: include openstack_project for jenkins public key https://review.openstack.org/321850 | 20:53 |
| lifeless | dhellmann: hmm, so what I want to do is -not- receive [new] | 20:53 |
| pabelanger | jeblair: clarkb: that fixes nodepool.o.o and our missing jenkins public key | 20:53 |
| lifeless | dhellmann: I think you need to add one more topic, just so I can click the right options | 20:53 |
| pabelanger | zuul user was created on DIBs, but didn't copy over the public key | 20:53 |
| zaro | anteaya: no, Gerrit storyboard should work. | 20:53 |
| anteaya | zaro: how should it work? | 20:54 |
| zaro | anteaya: it has basic functionality to update comments from gerrit changes to storyboard issues | 20:54 |
| anteaya | zaro: as far as I know my last discussion with the deveopers was they didn't know how it should work and have moved off into the direction of a script | 20:54 |
| lifeless | dhellmann: perhaps [release] release team announcements other than individual project releases | 20:54 |
| zaro | anteaya: sorry i don't remember anybody asking me | 20:55 |
| anteaya | zaro: this is the current status of their direction: https://review.openstack.org/#/c/302912/4 | 20:55 |
| lifeless | dhellmann: then I can subscribe to [release] + 'things that don't match any topics', and leave [new] unselected | 20:55 |
| anteaya | zaro: that is okay I wasn't around at the time and am going by third hand knowledge | 20:55 |
| anteaya | zaro: so if you could help now, that would be great, thank you | 20:55 |
| anteaya | zaro: can you wander by the storyboard channel tomorrow perhaps? the devs are in uk time | 20:56 |
| zaro | anteaya: sure will have a talk with zara | 20:57 |
| anteaya | zaro: awesome thank you | 20:57 |
| *** ddieterly is now known as ddieterly[away] | 20:57 | |
| *** ddieterly[away] is now known as ddieterly | 20:57 | |
| *** cloudtrainme has quit IRC | 21:01 | |
| *** gomarivera has joined #openstack-infra | 21:03 | |
| *** Goneri has quit IRC | 21:03 | |
| *** _ari_ has quit IRC | 21:04 | |
| *** claudiub has joined #openstack-infra | 21:07 | |
| *** katyafervent_awa has quit IRC | 21:07 | |
| openstackgerrit | Merged openstack-infra/project-config: Pip now uses 'master' instead of develop. https://review.openstack.org/321822 | 21:07 |
| *** esikachev has quit IRC | 21:08 | |
| *** nelsnelson has quit IRC | 21:09 | |
| *** thorst_ has quit IRC | 21:10 | |
| *** thorst_ has joined #openstack-infra | 21:10 | |
| *** yamahata has quit IRC | 21:11 | |
| *** trown is now known as trown|outtypewww | 21:11 | |
| *** thorst__ has joined #openstack-infra | 21:12 | |
| *** katyafervent_awa has joined #openstack-infra | 21:13 | |
| *** thorst_ has quit IRC | 21:15 | |
| openstackgerrit | Caleb Boylan proposed openstack-infra/shade: Make it easier to give swift objects metadata https://review.openstack.org/321835 | 21:15 |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: Add api-ref job for keystone https://review.openstack.org/320486 | 21:15 |
| *** aeng has joined #openstack-infra | 21:15 | |
| jroll | JayF: I'm not sure tempest does confirm that | 21:16 |
| *** thorst__ has quit IRC | 21:16 | |
| JayF | jroll: we should probably add that to a list then :/ | 21:16 |
| stevemar | anteaya: pabelanger can one of you kick off https://review.openstack.org/#/c/320486/2 again? it's got 2x +2 and was already approved, just got stuck not gating for some reason | 21:16 |
| *** ilyashakhat has quit IRC | 21:16 | |
| jroll | JayF: ya | 21:17 |
| *** _vsaienko has quit IRC | 21:17 | |
| *** rhallisey has quit IRC | 21:18 | |
| *** nwkarsten has quit IRC | 21:21 | |
| EmilienM | any idea what I'm doing wrong in https://review.openstack.org/#/c/321174 ? | 21:21 |
| *** mhickey has quit IRC | 21:23 | |
| anteaya | stevemar: it isnt' gating because it was never approved | 21:23 |
| *** nwkarsten has joined #openstack-infra | 21:23 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: tempest: move puppet jobs from exp to check pipeline https://review.openstack.org/321174 | 21:23 |
| anteaya | stevemar: oh sorry yes it was, I don't know why that approval didn't show up in the table | 21:24 |
| stevemar | anteaya: it was approved, just got stuck *shrugs*, hasn't budged since 9am | 21:25 |
| stevemar | i assume it's the wonky depends-on | 21:25 |
| anteaya | stevemar: let's see what happens now | 21:25 |
| anteaya | stevemar: well we have been restarting services this week, so it might have gotten caught in a gap | 21:25 |
| stevemar | anteaya: figured it was something, no biggie | 21:26 |
| *** Swami has quit IRC | 21:26 | |
| anteaya | yeah I don't know what let's see what happens | 21:26 |
| *** nwkarsten has quit IRC | 21:28 | |
| *** lakshmiS has quit IRC | 21:28 | |
| *** nadya has quit IRC | 21:31 | |
| zaro | madhuvishy: be patient for the jjb core reviewers :) | 21:32 |
| zaro | madhuvishy: every change requires two +2 votes to be approved | 21:32 |
| *** burgerk has quit IRC | 21:33 | |
| *** dimtruck is now known as zz_dimtruck | 21:33 | |
| *** jerryz has quit IRC | 21:34 | |
| *** ddieterly is now known as ddieterly[away] | 21:34 | |
| jeblair | oh! zl01 has started getting nodes | 21:34 |
| *** gomarivera has quit IRC | 21:35 | |
| *** |-paul-| has joined #openstack-infra | 21:35 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: move puppet4 jobs into check pipeline https://review.openstack.org/321837 | 21:36 |
| *** HeOS has joined #openstack-infra | 21:38 | |
| pabelanger | jeblair: that means zl01 is in production now? | 21:40 |
| jeblair | pabelanger: ya. i want to leave it as the only one for a bit, shake out any other problems, then add more and once they are all in, turn links back on and send an announcement | 21:41 |
| pabelanger | jeblair: awesome! | 21:41 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: remove excess newlines in ansible logs https://review.openstack.org/321866 | 21:42 |
| *** ddieterly[away] is now known as ddieterly | 21:43 | |
| jeblair | #status log zuul launcher zl01.openstack.org is in production (handling load in parallel with jenkins) | 21:43 |
| openstackstatus | jeblair: finished logging | 21:43 |
| *** rfolco has quit IRC | 21:43 | |
| dmsimard | mordred: just come across http://specs.openstack.org/openstack-infra/infra-specs/specs/ansible_puppet_apply.html .. one thing I don't see mentioned there is that you will no longer have access to puppetboard (but maybe ARA can help you there :P) | 21:43 |
| pabelanger | jeblair: looking at http://grafana.openstack.org/dashboard/db/nodepool I think we have some statsd issues | 21:43 |
| dmsimard | mordred: or wait, no, it does mention PuppetDB -- hmm, standalone puppet agent with puppetdb, never done that before. | 21:44 |
| jeblair | pabelanger: more than statsd -- nodepool thinks they are all in ready state | 21:45 |
| pabelanger | jeblair: ya, just confirmed on nodepool.o.o | 21:45 |
| JayF | Is there a reason for constructs like https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml#L690 we export the value to a local variable instead of just referencing {ipxe-enabled} in the if directly/ | 21:46 |
| jeblair | pabelanger: looks like no zmq messages are arriving | 21:46 |
| *** EricGonczer_ has quit IRC | 21:47 | |
| *** nwkarsten has joined #openstack-infra | 21:48 | |
| *** akshai_ has quit IRC | 21:48 | |
| *** claudiub|2 has joined #openstack-infra | 21:49 | |
| calebb | mordred: worth noting that when you store the metadata that way, it still stores it as x-object-meta-foo so when you get the object later your key to get that data is still 'x-object-meta-foo' which could be confusing for someone if you're telling shade its name is "foo" and it's mangling it | 21:50 |
| calebb | mordred: we could look for keys that start with 'x-object-meta-' and create a new dict out of them to add to the object but that seems kinda messy | 21:51 |
| *** rbradfor is now known as rbradfor_not_fou | 21:51 | |
| *** rbradfor_not_fou is now known as rbradf_not_found | 21:52 | |
| *** nwkarsten has quit IRC | 21:52 | |
| calebb | although that's what the command line client seems to do, just grab all the things like that and strip the 'x-object-meta-' and present them as "properties" | 21:52 |
| *** sdake has joined #openstack-infra | 21:53 | |
| *** e0ne has quit IRC | 21:53 | |
| *** claudiub has quit IRC | 21:53 | |
| jeblair | pabelanger: i think we'll need to revert because of the zmq issue (no idea there), but also because apparently the multiprocessing 'manager' process has died with no trace | 21:54 |
| *** sdake_ has quit IRC | 21:54 | |
| pabelanger | jeblair: roger | 21:54 |
| jeblair | pabelanger, clarkb: this has somewhat soured me on the idea of using that for IPC, so we may need to cook something else up for that. i'll try to avoid zookeeper for now ;) | 21:55 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: Do not log long ansible lines https://review.openstack.org/321869 | 21:57 |
| clarkb | jeblair: typically the debug steps are the same for any other message service or broker | 21:57 |
| jeblair | clarkb: yes, but with no output in zmq's case :) | 21:58 |
| clarkb | is there a connection on both sides, make sure that you don't touch the non thread safe bits from multiple threads and so on | 21:58 |
| *** earlephilhower has joined #openstack-infra | 21:58 | |
| jeblair | clarkb: oh, you mean for multiprocessing? | 21:58 |
| jeblair | (or zmq?) | 21:58 |
| clarkb | jeblair: well not all of zmq is thread safe | 21:58 |
| *** matt-borland has quit IRC | 21:58 | |
| clarkb | writes to sockets for example | 21:59 |
| clarkb | so elsewhere I have used dedicated thread for writes that pulls off a Queue.Queue type construct (same hting happens in jenkins plugin and in the logstash client) | 21:59 |
| jeblair | clarkb: yeah, i have a zmq client running. it is outputting nothing. which may mean everything is working and there is no output from my program. or it may mean nothing is working at all. | 21:59 |
| jeblair | clarkb: and yes, i did that in the launcher -- zmq events are passed through the multiprocessing manager to a dedicated zmq thread in the main process | 22:00 |
| clarkb | ok | 22:00 |
| *** flwang1 has joined #openstack-infra | 22:00 | |
| jeblair | (of course, the multiprocessing manager is dead now, which explains why there are no *new* events; but there should have been some before it died, i think) | 22:00 |
| pabelanger | when you have spare cycles jeblair, review 321850 reported 3 failures from zl01, but logs show the jobs were successful. | 22:01 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Revert "Start using the Zuul Ansible launcher" https://review.openstack.org/321871 | 22:01 |
| jeblair | i'm just going to force-merge the revert | 22:01 |
| *** amotoki has joined #openstack-infra | 22:02 | |
| clarkb | I am all for replacing zmq I have become not a huge fan of it through our use of it but I think zk is the wrong type of tool to use there. We want something that can easily handle pub sub with smarter queueing of events when connections flap | 22:02 |
| fungi | mtreinish might suggest mqtt ;) | 22:03 |
| jeblair | clarkb: oh, i was mostly kidding there. i mean to obsolete it in zuul3 by handling things completely differently. i don't think it's a drop in for this. :) | 22:03 |
| clarkb | looks like thats specifically a pub sub system, mqtt may be a good option | 22:03 |
| mtreinish | fungi: heh, well it's working pretty well in my testing since yesterday :) | 22:04 |
| mtreinish | fungi: sdague is the real advocate for it, I just was playing around based on his comment on the ML thread | 22:05 |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Start using the Zuul Ansible launcher" https://review.openstack.org/321871 | 22:05 |
| *** ddieterly is now known as ddieterly[away] | 22:06 | |
| *** ddieterly[away] is now known as ddieterly | 22:06 | |
| mtreinish | clarkb: I'm streaming all of gerrit into mqtt right now for fun: http://lists.openstack.org/pipermail/openstack-infra/2016-May/004350.html | 22:07 |
| mtreinish | s/gerrit/gerrit's event stream | 22:07 |
| * SotK catches up on the backscroll | 22:07 | |
| *** zz_dimtruck is now known as dimtruck | 22:07 | |
| *** xyang1_ has quit IRC | 22:07 | |
| JayF | Does JJB not support the idea of an optional parameter? Meaning if I use {blah} but protect it in the script where it's "OK" for it to be blank. JJB seems to be throwing an exception when I try to do this, not sure if it's not allowed or I'm just doing something else wrong | 22:07 |
| SotK | dhellmann: For the record, you can make automatic/filtered worklists include tasks instead of (or as well as) stories by setting the filters appropriately (see https://storyboard-dev.openstack.org/#!/worklist/8 for example). | 22:08 |
| SotK | You can also create boards, which are collections of worklists, which may be similar to what you're looking for (like this: https://storyboard-dev.openstack.org/#!/board/1). | 22:09 |
| clarkb | JayF: JJB expects all parameters to be defined | 22:09 |
| JayF | https://review.openstack.org/#/c/100020/ appears to be the change I want | 22:09 |
| JayF | somehow it's 2x+2 but 21 months old | 22:10 |
| JayF | lol | 22:10 |
| jeblair | oh, i didn't know about the mqtt thing because lists.openstack.org is blacklisted in spamhaus | 22:10 |
| SotK | However I suspect you'd be best off interacting with the API directly to get the set of tasks you're interested in, since StoryBoard is a little lacking in the "display separate lists of tasks from 50 projects clearly" department at the moment :) | 22:10 |
| SotK | http://docs.openstack.org/infra/storyboard/webapi/v1.html#get--v1-tasks is the API endpoint you'd want to use for that I expect | 22:11 |
| JayF | clarkb: thanks for confirming. Is there any openness to changing that behavior if I patched it in? Basically trying to setup a default-unless-overridden sort of thing based on another var (i.e. you can derive ram based on ramdisk-type OR specify amount of ram explicitly) | 22:11 |
| clarkb | JayF: zaro and waynr are probably the best to ask | 22:12 |
| *** ayoung has joined #openstack-infra | 22:12 | |
| *** armax_ has joined #openstack-infra | 22:12 | |
| *** armax has quit IRC | 22:13 | |
| *** armax_ is now known as armax | 22:13 | |
| jeblair | i have requested delisting | 22:13 |
| *** HeOS has quit IRC | 22:13 | |
| jeblair | okay, nodepool is stopped due to the reconfiguration | 22:15 |
| jeblair | i'm going to set all used and ready nodes to be deleted | 22:15 |
| jeblair | that may be minorly disruptive, but zuul should restart jobs and we'll have full quota | 22:16 |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-kibana: Support Apache 2.4 ACLs https://review.openstack.org/321875 | 22:17 |
| jeblair | #status log zl01 removed from production | 22:17 |
| openstackstatus | jeblair: finished logging | 22:17 |
| fungi | i'm going to go grab dinner, then come back and continue sprinting some | 22:17 |
| *** inc0 has quit IRC | 22:18 | |
| *** cody-somerville has quit IRC | 22:18 | |
| *** mixos has quit IRC | 22:18 | |
| pabelanger | looks like nodepoold is not happy | 22:19 |
| pabelanger | KeyError: 'nodepool.target.zuul.nodes.delete' | 22:19 |
| jeblair | oh forgot to update the provider, will fix | 22:19 |
| pabelanger | there we go | 22:20 |
| pabelanger | the great purge of nodepool | 22:21 |
| pabelanger | http://grafana.openstack.org/dashboard/db/nodepool?from=1464297685787&to=1464301285787 | 22:21 |
| *** Guest52155 has quit IRC | 22:21 | |
| EmilienM | I'm still having issues with JJB, if someone can help https://review.openstack.org/#/c/321174/ | 22:21 |
| pabelanger | EmilienM: commented | 22:22 |
| *** Goneri has joined #openstack-infra | 22:23 | |
| EmilienM | pabelanger: thx! | 22:23 |
| jeblair | pabelanger, EmilienM: i don't think the jobs in that job-group use job-suffix | 22:24 |
| EmilienM | oh I missed the ":" also | 22:24 |
| EmilienM | jeblair: what do you suggest? | 22:24 |
| craige | o/ | 22:24 |
| pabelanger | EmilienM: I think you need job-suffix: '' between lines 6389 and 6390 | 22:25 |
| jeblair | pabelanger: no i'm saying i don't think the jobs actually support that | 22:25 |
| openstackgerrit | Caleb Boylan proposed openstack-infra/shade: [WIP] Add function to update object metadata https://review.openstack.org/321878 | 22:25 |
| pabelanger | jeblair: Ah, you are right | 22:26 |
| EmilienM | jeblair: I tried to put it in the JJB directly but it didn't work either | 22:26 |
| jeblair | EmilienM: so you would need to update {pipeline}-puppet-openstack-integration-{puppet_version}-{scenario}-tempest-{node} to {pipeline}-puppet-openstack-integration-{puppet_version}-{scenario}-tempest-{node}{job-suffix} | 22:26 |
| pabelanger | EmilienM: so, line 6391 is not correct | 22:26 |
| jeblair | in puppet-module-jobs.yaml | 22:26 |
| EmilienM | mhh ok | 22:26 |
| EmilienM | I thought I tried | 22:26 |
| EmilienM | let's do it again | 22:27 |
| jeblair | EmilienM: oh, i missed that, you sure did | 22:27 |
| jeblair | EmilienM: you did in the job group | 22:27 |
| jeblair | EmilienM: but not in the job template | 22:27 |
| jeblair | (which is what the job group references) | 22:27 |
| EmilienM | ah indeed | 22:27 |
| jeblair | EmilienM: summary: 1) add {job-group} to the job template name; 2) add job-suffix: '' after 6389 as pabelanger says 3) add missing colon | 22:28 |
| jeblair | pabelanger, EmilienM: i think that's got it? | 22:28 |
| pabelanger | agreed | 22:28 |
| EmilienM | ok | 22:29 |
| EmilienM | thx guys | 22:29 |
| openstackgerrit | Jay Faulkner proposed openstack-infra/project-config: Use TinyIPA and iPXE for most Ironic jobs https://review.openstack.org/313800 | 22:29 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: tempest: move puppet jobs from exp to check pipeline https://review.openstack.org/321174 | 22:30 |
| *** pahuang has joined #openstack-infra | 22:31 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Python 3 Fixes https://review.openstack.org/321881 | 22:31 |
| *** hashar has quit IRC | 22:31 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: move puppet4 jobs into check pipeline https://review.openstack.org/321837 | 22:32 |
| waynr | JayF: actually that change was merged | 22:35 |
| *** ddieterly has quit IRC | 22:35 | |
| *** aeng has quit IRC | 22:35 | |
| waynr | " Change 100020 - Merged | 22:36 |
| waynr | " | 22:36 |
| pabelanger | notmorgan: time to add python34 job for nodepool | 22:37 |
| notmorgan | pabelanger: have some more fixes for that to become "real" this was just the easy part. can | 22:38 |
| notmorgan | t even run the tests yet :) | 22:38 |
| notmorgan | next will be stringio fixes. i'll spin up a py34 (nv) test shortly as well, hopefully i can get this all py3 happy soonish | 22:39 |
| pabelanger | notmorgan: we could add a non-voting job to start, atleast jenkins would report something | 22:39 |
| pabelanger | ++ | 22:39 |
| pabelanger | exciting | 22:39 |
| JayF | waynr: then apparently it didn't do what I thought it did, and I need to read more carefully :) | 22:39 |
| *** Hal has joined #openstack-infra | 22:39 | |
| pabelanger | need to finish of my RPM package for nodepool too | 22:39 |
| *** Hal is now known as Guest98278 | 22:40 | |
| JayF | waynr: ty for that; although I still think what I want isn't supported right now, but for now I just pulled the feautre out of my project-config pr | 22:40 |
| *** coreyob has quit IRC | 22:41 | |
| flwang | hi can anybody help review https://review.openstack.org/321324 ? adding the api-ref to zaqar, thanks | 22:41 |
| *** gomarivera has joined #openstack-infra | 22:41 | |
| *** edmondsw has quit IRC | 22:42 | |
| *** Goneri has quit IRC | 22:43 | |
| *** vhosakot has quit IRC | 22:44 | |
| *** terryw has joined #openstack-infra | 22:44 | |
| *** otherwiseguy has quit IRC | 22:44 | |
| openstackgerrit | Merged openstack-infra/project-config: Add api-ref job for keystone https://review.openstack.org/320486 | 22:44 |
| flwang | pabelanger: thanks :) | 22:46 |
| flwang | still need another bless | 22:46 |
| *** gomarivera has quit IRC | 22:46 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/project-config: Add Non-voting job for nodepool py34 https://review.openstack.org/321885 | 22:53 |
| notmorgan | pabelanger: ^ having an issue testing/linting locally atm so just pushing it up for first pass on the job. | 22:54 |
| *** darrenc is now known as darrenc_afk | 22:54 | |
| *** salv-orl_ has quit IRC | 22:56 | |
| *** rbrndt has quit IRC | 22:59 | |
| openstackgerrit | Merged openstack-infra/puppet-kibana: Support Apache 2.4 ACLs https://review.openstack.org/321875 | 22:59 |
| *** sdague has quit IRC | 23:00 | |
| *** rfolco has joined #openstack-infra | 23:01 | |
| *** esikachev has joined #openstack-infra | 23:01 | |
| *** asettle has joined #openstack-infra | 23:02 | |
| pabelanger | clarkb: mind +A https://review.openstack.org/#/c/321850/ for tomorrow DIBs | 23:03 |
| *** Daisy has joined #openstack-infra | 23:04 | |
| pabelanger | notmorgan: +2 | 23:05 |
| *** camunoz has joined #openstack-infra | 23:05 | |
| notmorgan | pabelanger: cool yay i got it right 1st try | 23:05 |
| *** esikachev has quit IRC | 23:05 | |
| clarkb | pabelanger: I am not sure I understand that change, havne't we been writing the ssh key on nodepool.o.o for years now? | 23:06 |
| pabelanger | clarkb: we need it now, we are using the devuser element from zuul-worker element | 23:06 |
| pabelanger | over using puppet | 23:06 |
| clarkb | ya but the key is on disk already | 23:06 |
| clarkb | and written there by puppet | 23:07 |
| pabelanger | just the private key is | 23:07 |
| *** ayoung has quit IRC | 23:07 | |
| pabelanger | no public | 23:07 |
| pabelanger | I added the code last week to also include it | 23:07 |
| *** ayoung has joined #openstack-infra | 23:08 | |
| clarkb | so we are no longer using puppet to write the ssh key? | 23:08 |
| pabelanger | Ya, we talked about using DIB to provision zuul-workers | 23:09 |
| pabelanger | in austin | 23:09 |
| pabelanger | So, I wrote a zuul-worker element to handle it | 23:09 |
| jeblair | (we are currently, but this would let us stop doing that) | 23:09 |
| jeblair | (we'll have both during a transition period) | 23:09 |
| *** Daisy has quit IRC | 23:09 | |
| clarkb | I see, approved | 23:09 |
| pabelanger | Right | 23:09 |
| *** asettle has quit IRC | 23:10 | |
| *** aeng has joined #openstack-infra | 23:12 | |
| *** aeng has quit IRC | 23:13 | |
| *** aeng has joined #openstack-infra | 23:13 | |
| *** darrenc_afk is now known as darrenc | 23:16 | |
| *** gomarivera has joined #openstack-infra | 23:17 | |
| *** Daisy has joined #openstack-infra | 23:17 | |
| *** hongbin has quit IRC | 23:18 | |
| openstackgerrit | Merged openstack-infra/system-config: include openstack_project for jenkins public key https://review.openstack.org/321850 | 23:18 |
| openstackgerrit | Rodrigo Duarte proposed openstack-infra/project-config: Make keystone functional tests job voting https://review.openstack.org/321890 | 23:19 |
| clarkb | hrm apache on logstash.o.o should've updated by now | 23:19 |
| *** Daisy has quit IRC | 23:19 | |
| *** ihrachys has quit IRC | 23:20 | |
| *** ihrachys has joined #openstack-infra | 23:21 | |
| *** |-paul-| has quit IRC | 23:21 | |
| *** tosky has quit IRC | 23:22 | |
| *** salv-orlando has joined #openstack-infra | 23:22 | |
| *** asselin_ has quit IRC | 23:23 | |
| *** ihrachys has quit IRC | 23:25 | |
| jhesketh | Morning | 23:26 |
| openstackgerrit | Caleb Boylan proposed openstack-infra/shade: Make it easier to give swift objects metadata https://review.openstack.org/321835 | 23:27 |
| *** rhallisey has joined #openstack-infra | 23:28 | |
| *** markvoelker has quit IRC | 23:29 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Export die() function https://review.openstack.org/321892 | 23:29 |
| *** rhochmuth has quit IRC | 23:29 | |
| anteaya | morning jhesketh | 23:31 |
| *** yamahata has joined #openstack-infra | 23:32 | |
| *** gomarivera has quit IRC | 23:32 | |
| *** nadya has joined #openstack-infra | 23:32 | |
| *** julim has joined #openstack-infra | 23:33 | |
| *** ayoung has quit IRC | 23:34 | |
| *** Qiming has joined #openstack-infra | 23:36 | |
| *** nadya has quit IRC | 23:37 | |
| *** inc0 has joined #openstack-infra | 23:39 | |
| *** zhurong has joined #openstack-infra | 23:41 | |
| *** sflanigan has joined #openstack-infra | 23:46 | |
| *** amitgandhinz has quit IRC | 23:46 | |
| *** dingyichen has joined #openstack-infra | 23:49 | |
| *** ddieterly has joined #openstack-infra | 23:51 | |
| fungi | pabelanger: so on the osic cert thing... just about on schedule? http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-03-04.log.html#t2016-03-04T22:31:11 | 23:53 |
| clarkb | fungi: and you now have the data you were interseted in :) | 23:54 |
| clarkb | does it work? no | 23:54 |
| *** salv-orlando has quit IRC | 23:54 | |
| * fungi is still catching up on some of the days excitement | 23:54 | |
| clarkb | it would be useful to get a larger set of statistics on the number of outages letsencrypt inadverdently was tied to | 23:54 |
| fungi | yep | 23:54 |
| *** vhosakot has joined #openstack-infra | 23:55 | |
| fungi | _this_ is why i've been pushing back every time someone says "oh, we can just switch to letsencrypt. seamless!" | 23:55 |
| *** inc0 has quit IRC | 23:55 | |
| pabelanger | fungi: indeed! | 23:56 |
| *** banix has quit IRC | 23:56 | |
| bkero | I think the update patterns talk about updating the certs every 2 months. So their downtime should only affect things if they're down for a really long time. | 23:57 |
| clarkb | bkero: its not letsencrypt being down, its the act of replacing the cert today took out a cloud | 23:58 |
| bkero | and you need to make sure your services can handle common reloads and changing certs without downtime | 23:58 |
| bkero | yup | 23:58 |
| clarkb | and not for 2 minutes while apache or nginx or haproxy or whatever restarted | 23:58 |
| *** xarses has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!