| *** kzaitsev_mb has quit IRC | 00:00 | |
| pabelanger | jeblair: nice! | 00:01 |
|---|---|---|
| *** heyongli has quit IRC | 00:02 | |
| *** rhochmuth has joined #openstack-infra | 00:03 | |
| *** rhochmuth has quit IRC | 00:03 | |
| *** kzaitsev_mb has joined #openstack-infra | 00:04 | |
| *** heyongli has joined #openstack-infra | 00:04 | |
| *** r-mibu has quit IRC | 00:05 | |
| *** r-mibu has joined #openstack-infra | 00:05 | |
| *** rhochmuth has joined #openstack-infra | 00:06 | |
| *** rvasilets__ has quit IRC | 00:06 | |
| *** asselin has joined #openstack-infra | 00:07 | |
| *** cody-somerville has joined #openstack-infra | 00:11 | |
| *** kzaitsev_mb has quit IRC | 00:12 | |
| *** johnny__ has quit IRC | 00:13 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Force image-type qcow2 for OVH https://review.openstack.org/317782 | 00:13 |
| pabelanger | jeblair: clarkb: ianw: We need to be force nodepool to use qcow2, seem the defaults have changed to using os-client-config if image-type is missing ^ | 00:14 |
| *** salv-orlando has joined #openstack-infra | 00:14 | |
| *** sridhar_ram has quit IRC | 00:15 | |
| *** asselin has quit IRC | 00:17 | |
| pabelanger | jhesketh: ianw: if you have a moment today, I could use a hand landing: https://review.openstack.org/#/c/317747/ | 00:21 |
| *** shashank_hegde has quit IRC | 00:23 | |
| jhesketh | pabelanger: is the RPM-GPG-KEY-EPEL-7 already there? | 00:23 |
| *** kzaitsev_mb has joined #openstack-infra | 00:25 | |
| pabelanger | jhesketh: it is, we install it from epel-release during DIB creation | 00:26 |
| jhesketh | cool, thanks | 00:27 |
| jhesketh | pabelanger: lgtm | 00:27 |
| pabelanger | great! | 00:27 |
| *** piet has quit IRC | 00:27 | |
| *** cloudtra_ has quit IRC | 00:29 | |
| *** vkramskikh_ has quit IRC | 00:29 | |
| *** armax_ has joined #openstack-infra | 00:31 | |
| *** piet has joined #openstack-infra | 00:32 | |
| *** armax has quit IRC | 00:33 | |
| *** armax_ is now known as armax | 00:33 | |
| *** salv-orlando has quit IRC | 00:36 | |
| *** bpokorny has quit IRC | 00:36 | |
| *** kzaitsev_mb has quit IRC | 00:38 | |
| *** Qiming has quit IRC | 00:41 | |
| *** kzaitsev_mb has joined #openstack-infra | 00:42 | |
| *** ffrank has quit IRC | 00:43 | |
| openstackgerrit | Merged openstack-infra/project-config: Add epel support for configure_mirror.sh https://review.openstack.org/317747 | 00:43 |
| *** ffrank has joined #openstack-infra | 00:43 | |
| ianw | pabelanger: https://review.openstack.org/317789 should probably get devstack using it | 00:44 |
| *** bdemers has joined #openstack-infra | 00:44 | |
| *** tqtran has quit IRC | 00:45 | |
| pabelanger | ianw: checking | 00:45 |
| *** baoli has joined #openstack-infra | 00:46 | |
| pabelanger | ianw: Ya, that should work | 00:46 |
| ianw | pabelanger: am i remembering right that it's a ready script? so maybe even that run will pick it up | 00:48 |
| *** kzaitsev_mb has quit IRC | 00:49 | |
| pabelanger | ianw: it is the ready-script, but we need to build images first. Since we only install nodepool-scripts during DIB create | 00:49 |
| ianw | oh yeah, good point | 00:49 |
| *** Jeffrey4l has quit IRC | 00:49 | |
| ianw | didn't make it in todays build | 00:49 |
| pabelanger | Ya, we'll have them for tomorrow | 00:50 |
| ianw | ok, i'll wip that till tomorrow and double check it all works | 00:51 |
| *** akshai has joined #openstack-infra | 00:53 | |
| *** akshai_ has quit IRC | 00:53 | |
| pabelanger | # status log nodepool restarted to pickup clean-floating-ips patch | 00:55 |
| pabelanger | #status log nodepool restarted to pickup clean-floating-ips patch | 00:55 |
| openstackstatus | pabelanger: finished logging | 00:55 |
| openstackgerrit | Merged openstack-infra/project-config: Force image-type qcow2 for OVH https://review.openstack.org/317782 | 00:55 |
| *** piet has quit IRC | 00:55 | |
| *** gildub has quit IRC | 00:56 | |
| ianw | pabelanger: btw, if we want to go ahead with https://review.openstack.org/#/c/296841/ i'll do something quick to monitor the job and make sure wheel builds are working too | 00:56 |
| ianw | speaking of periodic jobs, the devstack plugin proposal job seems to be not working | 00:57 |
| *** dimtruck is now known as zz_dimtruck | 01:00 | |
| *** mtanino has quit IRC | 01:00 | |
| *** banix has quit IRC | 01:02 | |
| pabelanger | ianw: sure | 01:05 |
| *** armax has quit IRC | 01:07 | |
| *** gildub has joined #openstack-infra | 01:12 | |
| *** rhochmuth has quit IRC | 01:13 | |
| melwitt | getting a lot of 502s from gerrit | 01:14 |
| pabelanger | cpu usage is up: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=25&rra_id=all | 01:16 |
| cloudnull | fungi jeblair pabelanger clarkb -- I've been afk these last couple of days and will mostly be afk tomorrow. In testing the osic cloud im still only able to get leaked FIPs/instances without a FIP when using shade. using heat and the CLI tools directly seem to work as expected, even when firing lots of commands concurrenly. | 01:17 |
| cloudnull | however I've still not been able to pinpoint where that leakage is happening | 01:17 |
| *** pvaneck has quit IRC | 01:18 | |
| *** salv-orlando has joined #openstack-infra | 01:18 | |
| cloudnull | idk if armax/Shrews/mordred have made any progress there but i've not. | 01:18 |
| *** gildub has quit IRC | 01:18 | |
| pabelanger | cloudnull: thanks for the update. I think we are on a holding pattern ATM until mordred comes back from vacation. We've added logic into nodepool to attempt to clean them up more aggressively however | 01:18 |
| *** gildub has joined #openstack-infra | 01:19 | |
| *** inc0 has joined #openstack-infra | 01:19 | |
| cloudnull | OK, I hope to work on this some more tomorrow evening and hopefully later in the week but I've been drug in quite a few different directions these last few days so time is the enemy right now | 01:20 |
| *** inc0 has quit IRC | 01:21 | |
| *** inc0 has joined #openstack-infra | 01:21 | |
| *** IlyaG has joined #openstack-infra | 01:22 | |
| *** IlyaG has quit IRC | 01:24 | |
| *** IlyaG has joined #openstack-infra | 01:24 | |
| *** ajmiller has quit IRC | 01:25 | |
| pabelanger | cloudnull: np, thanks for the effort you are putting in | 01:26 |
| pabelanger | #status log ovh-bhs1 has been down for better part of the last 12 hours. See http://paste.openstack.org/show/497434/ for info about the exception | 01:28 |
| openstackstatus | pabelanger: finished logging | 01:28 |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Add meeting_id's for Nova API and HyperV meetings https://review.openstack.org/317793 | 01:28 |
| *** zz_dimtruck is now known as dimtruck | 01:28 | |
| *** ffrank has quit IRC | 01:29 | |
| ianw | gerrit is giving me some 502 errors | 01:31 |
| ianw | oh, see melwitt also noticed | 01:31 |
| pabelanger | ianw: Another infra-root will need to look into it, I don't have the time this evening | 01:32 |
| ianw | cpu usage seems up -> http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=25&rra_id=all | 01:32 |
| *** rhochmuth has joined #openstack-infra | 01:33 | |
| *** jyuso1 has quit IRC | 01:33 | |
| *** jyuso1 has joined #openstack-infra | 01:33 | |
| ianw | memory and io seems about same | 01:34 |
| *** armax has joined #openstack-infra | 01:34 | |
| *** dchen has joined #openstack-infra | 01:34 | |
| *** yamahata has quit IRC | 01:34 | |
| *** sflanigan has quit IRC | 01:35 | |
| *** aeng has quit IRC | 01:35 | |
| *** pahuang has quit IRC | 01:35 | |
| *** salv-orlando has quit IRC | 01:36 | |
| *** banix has joined #openstack-infra | 01:37 | |
| *** Apoorva has quit IRC | 01:37 | |
| jhesketh | pabelanger, ianw: yeah I noticed it was a little slow... just poking now | 01:37 |
| jhesketh | the load is quite high | 01:38 |
| *** kzaitsev_mb has joined #openstack-infra | 01:38 | |
| *** Qiming has joined #openstack-infra | 01:38 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Bump yaml2ical to 0.6.1 https://review.openstack.org/317590 | 01:42 |
| jhesketh | pabelanger: I can't see anything obvious. Any objections to restarting gerrit? (it's been up since 5th of may) | 01:42 |
| *** r-daneel has quit IRC | 01:42 | |
| pabelanger | jhesketh: sure, I'm just about to leave so I won't be able to support you | 01:42 |
| jhesketh | no worries | 01:42 |
| pabelanger | okay, good luck | 01:43 |
| *** kzaitsev_mb has quit IRC | 01:43 | |
| *** sridhar_ram has joined #openstack-infra | 01:44 | |
| jhesketh | #status notice Gerrit is about to be restarted to help with page timeouts | 01:45 |
| openstackstatus | jhesketh: sending notice | 01:45 |
| *** Jeffrey4l has joined #openstack-infra | 01:45 | |
| *** rhochmuth has quit IRC | 01:46 | |
| -openstackstatus- NOTICE: Gerrit is about to be restarted to help with page timeouts | 01:46 | |
| *** weshay has quit IRC | 01:47 | |
| openstackstatus | jhesketh: finished sending notice | 01:48 |
| *** sflanigan has joined #openstack-infra | 01:48 | |
| *** sridhar_ram has quit IRC | 01:48 | |
| *** jerryz has quit IRC | 01:49 | |
| jhesketh | Restart complete | 01:49 |
| jhesketh | things feel a bit better and load looks to be dropping | 01:50 |
| melwitt | jhesketh: thank you! | 01:50 |
| *** pahuang has joined #openstack-infra | 01:52 | |
| *** aeng has joined #openstack-infra | 01:53 | |
| *** Jeffrey4l has quit IRC | 01:55 | |
| openstackgerrit | Chris Hoge proposed openstack-infra/project-config: Add gate checks for json lint and schema https://review.openstack.org/317800 | 02:02 |
| *** claudiub has quit IRC | 02:03 | |
| openstackgerrit | Chris Hoge proposed openstack-infra/project-config: Add gate checks for json lint and schema https://review.openstack.org/317800 | 02:04 |
| *** xarses_ has joined #openstack-infra | 02:04 | |
| hogepodge | If anyone can check my work and the dependent patch, that would be great. I have a bad feeling I'm "not doing it right" | 02:05 |
| openstackgerrit | Chris Hoge proposed openstack-infra/project-config: Add DefCore guideline gate checks for json lint and schema https://review.openstack.org/317800 | 02:05 |
| *** bpokorny has joined #openstack-infra | 02:06 | |
| *** sdake has quit IRC | 02:06 | |
| *** rhochmuth has joined #openstack-infra | 02:08 | |
| *** xarses has quit IRC | 02:08 | |
| *** Jeffrey4l has joined #openstack-infra | 02:08 | |
| *** akshai has quit IRC | 02:11 | |
| *** salv-orlando has joined #openstack-infra | 02:12 | |
| *** sdake has joined #openstack-infra | 02:12 | |
| *** thorst_ has joined #openstack-infra | 02:13 | |
| *** bpokorny_ has joined #openstack-infra | 02:14 | |
| *** zhurong has joined #openstack-infra | 02:16 | |
| *** yuanying has joined #openstack-infra | 02:17 | |
| *** bpokorny has quit IRC | 02:18 | |
| *** bpokorny_ has quit IRC | 02:19 | |
| openstackgerrit | Ethan Lynn proposed openstack-infra/project-config: Add tempest tests for senlin API https://review.openstack.org/316544 | 02:22 |
| *** sdake has quit IRC | 02:22 | |
| *** rossella_s has quit IRC | 02:23 | |
| *** rossella_s has joined #openstack-infra | 02:24 | |
| *** aeng has quit IRC | 02:27 | |
| lifeless | do we have gear connections to jenkins slaves? or just masters + zuul ? | 02:28 |
| jhesketh | lifeless: just masters+zuul.. jenkins manages the slaves its own way | 02:30 |
| pleia2 | all our jenkinses are masters (no slaves) | 02:30 |
| pleia2 | ah | 02:30 |
| lifeless | pleia2: I thought we had ssh connections to slaves? jenkins runs a jar on the slave | 02:31 |
| lifeless | jhesketh: cool; I was pondering whether gear could be attacked by a job | 02:31 |
| pleia2 | lifeless: yeah, I misunderstood | 02:31 |
| lifeless | jhesketh: it may be able to be done via JRMI, but thats kindof a known flaw in our architecture so meh | 02:31 |
| *** salv-orlando has quit IRC | 02:32 | |
| jhesketh | lifeless: yeah it wouldn't be a direct thing | 02:33 |
| jhesketh | we also have acl certs to make things more complicated | 02:34 |
| *** jerryz has joined #openstack-infra | 02:34 | |
| *** thorst_ has quit IRC | 02:36 | |
| *** sflanigan has quit IRC | 02:36 | |
| *** thorst_ has joined #openstack-infra | 02:36 | |
| jhesketh | hogepodge: Reviewed your work. If you need help putting the job together or my comments don't make sense let me know :-) | 02:38 |
| openstackgerrit | Ethan Lynn proposed openstack-infra/project-config: Add tempest tests for senlin API https://review.openstack.org/316544 | 02:39 |
| *** sflanigan has joined #openstack-infra | 02:39 | |
| *** sflanigan has joined #openstack-infra | 02:39 | |
| *** thorst_ has quit IRC | 02:41 | |
| *** aeng has joined #openstack-infra | 02:49 | |
| *** rhochmuth has quit IRC | 02:53 | |
| *** DevBox has joined #openstack-infra | 02:53 | |
| *** baoli has quit IRC | 02:57 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Add helper to find full slots https://review.openstack.org/317809 | 02:57 |
| *** dimtruck is now known as zz_dimtruck | 02:58 | |
| openstackgerrit | Di XiaoLi proposed openstack-infra/project-config: Add a heat job to use devstack plugin https://review.openstack.org/317811 | 03:00 |
| *** rhochmuth has joined #openstack-infra | 03:01 | |
| *** Jeffrey4l has quit IRC | 03:03 | |
| *** binbincong has quit IRC | 03:04 | |
| *** salv-orlando has joined #openstack-infra | 03:05 | |
| *** inc0 has quit IRC | 03:07 | |
| *** dchen has quit IRC | 03:08 | |
| *** sdake has joined #openstack-infra | 03:09 | |
| *** zz_dimtruck is now known as dimtruck | 03:14 | |
| *** dimtruck is now known as zz_dimtruck | 03:16 | |
| *** binbincong has joined #openstack-infra | 03:16 | |
| *** amitgandhinz has quit IRC | 03:18 | |
| *** rhochmuth has quit IRC | 03:18 | |
| *** zz_dimtruck is now known as dimtruck | 03:18 | |
| *** gyee has quit IRC | 03:20 | |
| *** rhochmuth has joined #openstack-infra | 03:22 | |
| *** psachin has joined #openstack-infra | 03:26 | |
| *** links has joined #openstack-infra | 03:26 | |
| *** bhunter71 has quit IRC | 03:27 | |
| *** salv-orlando has quit IRC | 03:28 | |
| mwhahaha | hey infra folks, looks like the centos7 mirrors are out of sync or something, http://logs.openstack.org/39/316439/3/check/gate-puppet-horizon-puppet-syntax-3-centos-7/5603be5/console.html#_2016-05-18_02_51_18_127 | 03:29 |
| *** cody-somerville has quit IRC | 03:30 | |
| *** IlyaG has quit IRC | 03:32 | |
| openstackgerrit | Di XiaoLi proposed openstack-infra/project-config: Switch all heat jobs to use devstack plugin https://review.openstack.org/317817 | 03:33 |
| *** vhosakot has joined #openstack-infra | 03:36 | |
| *** Jeffrey4l has joined #openstack-infra | 03:36 | |
| *** sdake_ has joined #openstack-infra | 03:37 | |
| *** rhochmuth has quit IRC | 03:38 | |
| *** sdake has quit IRC | 03:40 | |
| notmorgan | mwhahaha: ick :( | 03:43 |
| *** shashank_hegde has joined #openstack-infra | 03:45 | |
| *** rhochmuth has joined #openstack-infra | 03:45 | |
| *** akshai has joined #openstack-infra | 03:49 | |
| *** akshai has quit IRC | 03:50 | |
| *** piet has joined #openstack-infra | 03:53 | |
| *** rhochmuth has quit IRC | 03:53 | |
| *** njohnston-- is now known as njohnston__ | 03:54 | |
| *** shashank_hegde has quit IRC | 03:55 | |
| *** njohnston__ has quit IRC | 03:56 | |
| *** shashank_hegde has joined #openstack-infra | 03:56 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/devstack-gate: DO NOT REVIEW: This is for verifying CI with local.conf https://review.openstack.org/243545 | 03:58 |
| *** sdake_ has quit IRC | 03:58 | |
| *** armax has quit IRC | 03:59 | |
| *** gnuoy has quit IRC | 04:00 | |
| *** jamespage has quit IRC | 04:00 | |
| *** gnuoy has joined #openstack-infra | 04:00 | |
| *** jamespage has joined #openstack-infra | 04:01 | |
| *** rhochmuth has joined #openstack-infra | 04:03 | |
| *** psachin has quit IRC | 04:04 | |
| *** salv-orlando has joined #openstack-infra | 04:05 | |
| *** abregman has joined #openstack-infra | 04:09 | |
| *** sdake has joined #openstack-infra | 04:09 | |
| *** rhochmuth has quit IRC | 04:09 | |
| sdake | rax ord seems busted | 04:10 |
| sdake | http://logs.openstack.org/60/315860/27/check/gate-kolla-dsvm-deploy-centos-binary/df967c6/console.html | 04:10 |
| sdake | mirror issues | 04:10 |
| *** rhochmuth has joined #openstack-infra | 04:15 | |
| *** rhochmuth has quit IRC | 04:17 | |
| *** amitgandhinz has joined #openstack-infra | 04:19 | |
| ianw | sdake: hmm pabelanger ^^ | 04:19 |
| *** psachin has joined #openstack-infra | 04:20 | |
| *** amitgandhinz has quit IRC | 04:23 | |
| *** zhurong has quit IRC | 04:23 | |
| *** salv-orlando has quit IRC | 04:25 | |
| *** amotoki has quit IRC | 04:26 | |
| *** amotoki has joined #openstack-infra | 04:26 | |
| *** hamzy has joined #openstack-infra | 04:28 | |
| *** asselin has joined #openstack-infra | 04:28 | |
| *** dimtruck is now known as zz_dimtruck | 04:29 | |
| *** yamamoto has quit IRC | 04:30 | |
| *** lakshmiS has quit IRC | 04:32 | |
| fungi | the network in rackspace's ord network is abysmal. i've had a support ticket open for weeks trying to help them track it down, but they want a preserved specimen exhibiting that issue, so trapping one and holding it before nodepool deletes it is not easy | 04:34 |
| sdake | fungi this looks like a mirror issue fwiw | 04:35 |
| fungi | still working on trying to pin one down for them | 04:35 |
| sdake | as in the mirrors are out of sync or something | 04:35 |
| fungi | sdake: as in not a failure reaching the mirror? | 04:35 |
| sdake | fungi http://logs.openstack.org/60/315860/27/check/gate-kolla-dsvm-deploy-centos-binary/df967c6/console.html#_2016-05-18_03_44_37_612 | 04:36 |
| sdake | 404 error on firefox | 04:36 |
| sdake | not sure why firefox is installed at all tbh :) | 04:36 |
| sdake | rax.ord probably syncing mirrors atm | 04:37 |
| fungi | yeah, not on my usual computer so takes a minute to pull up job logs on this | 04:37 |
| sdake | roger | 04:38 |
| sdake | its pretty late too - time for bed soon :) | 04:38 |
| sdake | hopefully it will fix itself in the morning | 04:38 |
| fungi | yeah, i have a feeling the state of the centos mirror we rsync'd from is inconsistentt | 04:40 |
| *** rhochmuth has joined #openstack-infra | 04:40 | |
| fungi | i guess we don't have any index verification step implemented for that mirror yet | 04:40 |
| sdake | is it accurate that there is now a centos mirror we can use in addition to the ubuntu mirros already in place? | 04:41 |
| sdake | it would speed up our gating / lessen load on infra | 04:41 |
| *** shashank_hegde has quit IRC | 04:41 | |
| *** gtmanfred has quit IRC | 04:42 | |
| fungi | right, though it apparently isn't perfect, as evidenced by it missing a package at the moment | 04:42 |
| *** rhochmuth has quit IRC | 04:43 | |
| *** samueldmq has quit IRC | 04:43 | |
| *** piet has quit IRC | 04:44 | |
| *** jcoufal has joined #openstack-infra | 04:45 | |
| *** gtmanfred has joined #openstack-infra | 04:45 | |
| sdake | cool here is how we use the infra mirrors for ubuntu https://github.com/openstack/kolla/blob/master/tools/setup_gate.sh#L32 | 04:45 |
| sdake | is there a similar file for the mirrors for centos? | 04:45 |
| *** samueldmq has joined #openstack-infra | 04:46 | |
| sdake | or is it installed by default in /etc/yum.repos.d/CentOS* | 04:47 |
| fungi | i assume it's in the usual location for yum configuration (your ubuntu example was simply copying the apt configuration) | 04:48 |
| sdake | right cool i'll try it out once the mirrors are in an operational state | 04:49 |
| fungi | i don't actually know a ton about the centos mirror implementation details, would need to go reread the setup automation. pabelanger can likely explain in great detail when he's awake | 04:50 |
| sdake | fungi ack thanks | 04:53 |
| sdake | fungi i'll submit some jobs and experiment | 04:53 |
| *** Jeffrey4l has quit IRC | 04:53 | |
| *** ldumont has joined #openstack-infra | 04:55 | |
| *** saravana_ has joined #openstack-infra | 04:56 | |
| ldumont | Hey guys, in Neutron networking, is there a way to allow instances to work directly on the management network of my Openstack nodes? | 04:56 |
| ldumont | This is a super small two nodes deployment that I'm just playing around with. | 04:56 |
| saravana_ | @here could someone assist me with zuul installation | 04:56 |
| saravana_ | i am trying to install zuul individually. | 04:56 |
| fungi | SotK: Zara: when next you're awake, the storyboard-dev puppet updates appear to be applied to the server now and shell accounts created | 04:57 |
| *** zhurong has joined #openstack-infra | 04:57 | |
| nibalizer | saravana_: use puppet-openstackci | 04:57 |
| *** fawadkhaliq has joined #openstack-infra | 04:57 | |
| fungi | nibalizer: it looks like some of the puppetry around the ssl cert management on storyboard-dev is incorrect/incomplete: | 04:58 |
| fungi | May 18 04:53:06 storyboard-dev puppet-user[23121]: Could not set 'file' on ensure: Could not find group ssl-cert at 41:/etc/puppet/modules/storyboard/manifests/cert.pp | 04:58 |
| *** salv-orlando has joined #openstack-infra | 04:58 | |
| fungi | there are a bunch of other errors after that one too, mostly about cert handling | 04:58 |
| nibalizer | fungi: i believe this | 04:59 |
| *** javeriak has joined #openstack-infra | 04:59 | |
| *** piet has joined #openstack-infra | 04:59 | |
| nibalizer | since we've never really exercised the snakeoil path | 04:59 |
| fungi | but i've taken it as far as i have time tonight. can look at it more tomorrow if nobody beats me to it | 05:00 |
| *** matrohon has joined #openstack-infra | 05:00 | |
| fungi | g'night, all! | 05:00 |
| saravana_ | nibalizer :- i have first tried through puppet way by following this link http://docs.openstack.org/infra/openstackci/third_party_ci.html | 05:02 |
| *** shashank_hegde has joined #openstack-infra | 05:02 | |
| saravana_ | but there is an error which i am unable to resolve, hence i decided to install zuul separately | 05:02 |
| nibalizer | saravana_: what error did you get with puppet | 05:03 |
| saravana_ | pls let me know your email id, i will send you an error snapshot. | 05:03 |
| sdake | fungi ya it looks like a systemic problem with the mirrors - not just rax.org but also internap | 05:03 |
| sdake | night fungi | 05:03 |
| mwhahaha | i also saw it on ovh (the mirror issue) | 05:03 |
| *** x00350071_ has joined #openstack-infra | 05:04 | |
| *** SlickN1k has joined #openstack-infra | 05:05 | |
| *** markmcd1 has joined #openstack-infra | 05:05 | |
| saravana_ | I am following this doc to setup zuul | 05:05 |
| saravana_ | I got stuck here | 05:06 |
| saravana_ | http://docs.openstack.org/infra/openstackci/third_party_ci.html | 05:06 |
| *** sabari- has joined #openstack-infra | 05:06 | |
| saravana_ | Run masterless Puppet | 05:06 |
| *** mikal_ has joined #openstack-infra | 05:08 | |
| *** megm_ has joined #openstack-infra | 05:08 | |
| saravana_ | while running this command sudo puppet apply --verbose /etc/puppet/manifests/site.pp | 05:08 |
| *** BobBall_ has joined #openstack-infra | 05:08 | |
| *** davidlenwell has quit IRC | 05:09 | |
| saravana_ | Error: Could not run: (<unknown>): could not find expected ':' while scanning a simple key at line 18 column 1 | 05:09 |
| *** jbernard_ has joined #openstack-infra | 05:11 | |
| *** sambetts has joined #openstack-infra | 05:11 | |
| *** manfred has joined #openstack-infra | 05:12 | |
| *** Shalmazar has joined #openstack-infra | 05:12 | |
| *** f1ller- has joined #openstack-infra | 05:12 | |
| *** cgross- has joined #openstack-infra | 05:12 | |
| *** swat30_ has joined #openstack-infra | 05:12 | |
| *** f1ller has quit IRC | 05:12 | |
| *** sambetts|afk has quit IRC | 05:12 | |
| *** piet has quit IRC | 05:12 | |
| *** mikal has quit IRC | 05:12 | |
| *** SlickNik has quit IRC | 05:12 | |
| *** sabari has quit IRC | 05:12 | |
| *** gtmanfred has quit IRC | 05:12 | |
| *** Wei_Liu has quit IRC | 05:12 | |
| *** puiterwijk has quit IRC | 05:12 | |
| *** Kennan has quit IRC | 05:12 | |
| *** jbernard has quit IRC | 05:12 | |
| *** cgross has quit IRC | 05:12 | |
| *** links has quit IRC | 05:12 | |
| *** jerryz has quit IRC | 05:12 | |
| *** dingyichen has quit IRC | 05:12 | |
| *** dmsimard has quit IRC | 05:12 | |
| *** sirushti has quit IRC | 05:12 | |
| *** zul has quit IRC | 05:12 | |
| *** BobBall has quit IRC | 05:12 | |
| *** swat30 has quit IRC | 05:12 | |
| *** Madasi has quit IRC | 05:12 | |
| *** ericksonsantos has quit IRC | 05:12 | |
| *** megm has quit IRC | 05:12 | |
| *** xiangxinyong has quit IRC | 05:12 | |
| *** markmcd has quit IRC | 05:12 | |
| *** manfred is now known as gtmanfred | 05:12 | |
| *** sabari- is now known as sabari | 05:12 | |
| *** Shalmazar is now known as Madasi | 05:12 | |
| *** Kennan has joined #openstack-infra | 05:13 | |
| *** SlickN1k is now known as SlickNik | 05:13 | |
| *** swat30_ is now known as swat30 | 05:13 | |
| *** sirushti has joined #openstack-infra | 05:13 | |
| *** ericksonsantos has joined #openstack-infra | 05:13 | |
| *** yamamoto_ has joined #openstack-infra | 05:13 | |
| *** links has joined #openstack-infra | 05:13 | |
| *** dingyichen has joined #openstack-infra | 05:13 | |
| *** Wei_Liu has joined #openstack-infra | 05:14 | |
| *** puiterwijk has joined #openstack-infra | 05:14 | |
| *** jerryz has joined #openstack-infra | 05:14 | |
| *** zul has joined #openstack-infra | 05:14 | |
| *** banix has quit IRC | 05:15 | |
| *** dmsimard has joined #openstack-infra | 05:16 | |
| *** davidlenwell has joined #openstack-infra | 05:17 | |
| *** salv-orlando has quit IRC | 05:18 | |
| *** salv-orlando has joined #openstack-infra | 05:18 | |
| nibalizer | well | 05:19 |
| nibalizer | that implies to me that you have an error in site.pp at line 18 | 05:19 |
| nibalizer | try trunning 'puppet parser validate /etc/puppet/manifests/site.pp' | 05:19 |
| *** amitgandhinz has joined #openstack-infra | 05:19 | |
| *** dingyichen has quit IRC | 05:21 | |
| *** dingyichen has joined #openstack-infra | 05:22 | |
| *** vhosakot has quit IRC | 05:22 | |
| *** dingyichen has quit IRC | 05:23 | |
| *** dingyichen has joined #openstack-infra | 05:24 | |
| *** amitgandhinz has quit IRC | 05:24 | |
| *** sdake has quit IRC | 05:26 | |
| *** matrohon has quit IRC | 05:29 | |
| *** savihou has joined #openstack-infra | 05:30 | |
| *** javeriak_ has joined #openstack-infra | 05:30 | |
| *** javeriak has quit IRC | 05:32 | |
| *** javeriak has joined #openstack-infra | 05:32 | |
| *** ldumont has quit IRC | 05:33 | |
| *** amrith is now known as _amrith_ | 05:34 | |
| *** javeriak_ has quit IRC | 05:36 | |
| *** xarses has joined #openstack-infra | 05:39 | |
| *** xarses_ has quit IRC | 05:42 | |
| *** javeriak has quit IRC | 05:43 | |
| *** ccamacho has quit IRC | 05:46 | |
| ianw | wow ... mocking context managers == not fun | 05:46 |
| *** rcernin has joined #openstack-infra | 05:47 | |
| *** ccamacho has joined #openstack-infra | 05:47 | |
| saravana_ | nibalizer :- i have executed puppet parser validate /etc/puppet/manifests/site.pp | 05:47 |
| saravana_ | no output | 05:48 |
| saravana_ | hence i ran puppet parser validate --verbose --debug /etc/puppet/manifests/site.pp | 05:48 |
| saravana_ | i got Debug: Runtime environment: puppet_version=3.8.7, ruby_version=1.9.3, run_mode=user, default_encoding=UTF-8 | 05:48 |
| nibalizer | ok can you paste me your site.pp | 05:48 |
| saravana_ | can i attach the file here | 05:49 |
| *** javeriak has joined #openstack-infra | 05:50 | |
| nibalizer | use paste.openstack.org | 05:50 |
| saravana_ | or shall i copy paste the content ? | 05:50 |
| *** sree has joined #openstack-infra | 05:51 | |
| saravana_ | nibalizer #497441 | 05:52 |
| saravana_ | pls check #497441 | 05:52 |
| *** abregman has quit IRC | 05:55 | |
| *** jerryz has quit IRC | 05:56 | |
| *** javeriak has quit IRC | 05:58 | |
| *** david-lyle has quit IRC | 06:05 | |
| *** gongysh has joined #openstack-infra | 06:06 | |
| *** _amrith_ is now known as amrith | 06:09 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add magnum baymodel calls to shade. https://review.openstack.org/308009 | 06:12 |
| *** e0ne has joined #openstack-infra | 06:13 | |
| *** nadya has joined #openstack-infra | 06:15 | |
| *** DevBox has quit IRC | 06:15 | |
| *** nadya has quit IRC | 06:16 | |
| *** amitgandhinz has joined #openstack-infra | 06:20 | |
| openstackgerrit | Alexey Weyl proposed openstack-infra/project-config: Insert Vitrage Tempest https://review.openstack.org/317851 | 06:21 |
| *** Jeffrey4l has joined #openstack-infra | 06:21 | |
| *** amitgandhinz has quit IRC | 06:25 | |
| *** javeriak has joined #openstack-infra | 06:27 | |
| *** x00350071_ is now known as xiangxinyong | 06:28 | |
| *** nadya has joined #openstack-infra | 06:30 | |
| *** salv-orlando has quit IRC | 06:30 | |
| *** vtapia_ is now known as vtapia | 06:31 | |
| *** aeng has quit IRC | 06:31 | |
| *** nadya has quit IRC | 06:35 | |
| *** hichihara has joined #openstack-infra | 06:38 | |
| *** jtomasek has joined #openstack-infra | 06:45 | |
| *** rcernin has quit IRC | 06:47 | |
| *** javeriak has quit IRC | 06:48 | |
| *** andreas_s has joined #openstack-infra | 06:50 | |
| *** Jeffrey4l has quit IRC | 06:50 | |
| *** rcernin has joined #openstack-infra | 06:51 | |
| *** e0ne has quit IRC | 06:54 | |
| *** javeriak has joined #openstack-infra | 06:55 | |
| *** maishsk has quit IRC | 07:01 | |
| *** vincentll has joined #openstack-infra | 07:04 | |
| *** duobei has joined #openstack-infra | 07:06 | |
| *** pahuang has quit IRC | 07:06 | |
| *** shashank_hegde has quit IRC | 07:07 | |
| *** nbloom has joined #openstack-infra | 07:08 | |
| *** zeih has joined #openstack-infra | 07:08 | |
| *** arxcruz has joined #openstack-infra | 07:08 | |
| *** Jeffrey4l has joined #openstack-infra | 07:10 | |
| *** salv-orlando has joined #openstack-infra | 07:11 | |
| *** shashank_hegde has joined #openstack-infra | 07:11 | |
| *** mixos has quit IRC | 07:11 | |
| *** akaszuba has joined #openstack-infra | 07:11 | |
| *** javeriak has quit IRC | 07:12 | |
| *** claudiub has joined #openstack-infra | 07:13 | |
| *** javeriak has joined #openstack-infra | 07:15 | |
| *** dalgaaf has joined #openstack-infra | 07:18 | |
| *** sree has quit IRC | 07:20 | |
| *** sree has joined #openstack-infra | 07:21 | |
| *** amitgandhinz has joined #openstack-infra | 07:21 | |
| *** yaume has joined #openstack-infra | 07:21 | |
| *** matrohon has joined #openstack-infra | 07:22 | |
| *** sree has quit IRC | 07:23 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Start fleshing out ansible-launcher tests https://review.openstack.org/317482 | 07:25 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Clean up results returned from ansible-launcher https://review.openstack.org/317481 | 07:25 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add jjb and zmq to requirements.txt https://review.openstack.org/316752 | 07:25 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Prepare files for testing zuulv25 https://review.openstack.org/316753 | 07:25 |
| *** jlanoux has joined #openstack-infra | 07:26 | |
| *** yaume is now known as yaume[away] | 07:26 | |
| *** amitgandhinz has quit IRC | 07:26 | |
| *** esikachev has joined #openstack-infra | 07:29 | |
| *** _degorenko|afk is now known as degorenko | 07:30 | |
| *** duobei has quit IRC | 07:31 | |
| *** salv-orlando has quit IRC | 07:31 | |
| *** Ravikiran_K has joined #openstack-infra | 07:32 | |
| *** yaume[away] is now known as yaume | 07:34 | |
| *** dmk0202 has joined #openstack-infra | 07:35 | |
| *** salv-orlando has joined #openstack-infra | 07:35 | |
| *** kushal has joined #openstack-infra | 07:37 | |
| *** ihrachys has joined #openstack-infra | 07:38 | |
| *** mikelk has joined #openstack-infra | 07:39 | |
| *** savihou has quit IRC | 07:39 | |
| *** abregman has joined #openstack-infra | 07:41 | |
| *** sree has joined #openstack-infra | 07:42 | |
| *** salv-orl_ has joined #openstack-infra | 07:48 | |
| *** salv-orlando has quit IRC | 07:52 | |
| *** fawadkhaliq has quit IRC | 07:52 | |
| *** fawadkhaliq has joined #openstack-infra | 07:52 | |
| *** abregman is now known as abregman|mtg | 07:52 | |
| *** shardy has joined #openstack-infra | 07:53 | |
| *** jistr has joined #openstack-infra | 07:54 | |
| *** daemontool has joined #openstack-infra | 07:55 | |
| *** duobei has joined #openstack-infra | 07:56 | |
| *** david-lyle has joined #openstack-infra | 07:57 | |
| *** fawadkhaliq has quit IRC | 07:58 | |
| *** fawadkhaliq has joined #openstack-infra | 07:58 | |
| *** fawadkhaliq has quit IRC | 07:58 | |
| *** fawadkhaliq has joined #openstack-infra | 07:59 | |
| *** nbloom has quit IRC | 07:59 | |
| *** savihou has joined #openstack-infra | 07:59 | |
| *** fawadkhaliq has quit IRC | 07:59 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** fawadkhaliq has joined #openstack-infra | 08:00 | |
| *** fawadkhaliq has quit IRC | 08:00 | |
| *** fawadkhaliq has joined #openstack-infra | 08:01 | |
| *** zzzeek has joined #openstack-infra | 08:01 | |
| *** fawadkhaliq has quit IRC | 08:01 | |
| *** fawadkhaliq has joined #openstack-infra | 08:01 | |
| *** fawadkhaliq has quit IRC | 08:02 | |
| *** fawadkhaliq has joined #openstack-infra | 08:02 | |
| *** aarefiev has joined #openstack-infra | 08:02 | |
| *** fawadkhaliq has quit IRC | 08:02 | |
| *** fawadkhaliq has joined #openstack-infra | 08:03 | |
| *** pilgrimstack has joined #openstack-infra | 08:03 | |
| *** fawadkhaliq has quit IRC | 08:03 | |
| *** fawadkhaliq has joined #openstack-infra | 08:04 | |
| *** fawadkhaliq has quit IRC | 08:04 | |
| *** fawadkhaliq has joined #openstack-infra | 08:05 | |
| *** fawadkhaliq has quit IRC | 08:05 | |
| *** fawadkhaliq has joined #openstack-infra | 08:06 | |
| *** fawadkhaliq has quit IRC | 08:06 | |
| *** fawadkhaliq has joined #openstack-infra | 08:06 | |
| *** fawadkhaliq has quit IRC | 08:07 | |
| *** fawadkhaliq has joined #openstack-infra | 08:08 | |
| *** gildub has quit IRC | 08:10 | |
| *** andreas_s has quit IRC | 08:12 | |
| *** rhochmuth has joined #openstack-infra | 08:12 | |
| *** rhochmuth has quit IRC | 08:12 | |
| *** maishsk has joined #openstack-infra | 08:13 | |
| *** maishsk has quit IRC | 08:14 | |
| *** abregman|mtg has quit IRC | 08:15 | |
| *** shashank_hegde has quit IRC | 08:19 | |
| *** amitgandhinz has joined #openstack-infra | 08:23 | |
| *** abregman has joined #openstack-infra | 08:23 | |
| *** javeriak has quit IRC | 08:26 | |
| *** salv-orl_ has quit IRC | 08:27 | |
| *** amitgandhinz has quit IRC | 08:28 | |
| *** dtantsur|afk is now known as dtantsur | 08:29 | |
| *** lucas-dinner is now known as lucasagomes | 08:32 | |
| *** jang has joined #openstack-infra | 08:34 | |
| *** hichihara has quit IRC | 08:36 | |
| *** pblaho has joined #openstack-infra | 08:36 | |
| *** HeOS has quit IRC | 08:36 | |
| *** dingyichen has quit IRC | 08:40 | |
| *** derekh has joined #openstack-infra | 08:42 | |
| *** auggy_ has joined #openstack-infra | 08:42 | |
| *** vipuls has joined #openstack-infra | 08:42 | |
| *** samyewell_ has joined #openstack-infra | 08:42 | |
| *** teran_ has joined #openstack-infra | 08:43 | |
| *** tdurakov_ has joined #openstack-infra | 08:43 | |
| *** ashtokolov_ has joined #openstack-infra | 08:43 | |
| *** wendar_ has joined #openstack-infra | 08:43 | |
| *** kozhukalov_ has joined #openstack-infra | 08:43 | |
| *** electrical_ has joined #openstack-infra | 08:43 | |
| *** dalgaaf_ has joined #openstack-infra | 08:44 | |
| *** monester_ has joined #openstack-infra | 08:44 | |
| *** jraim_ has joined #openstack-infra | 08:44 | |
| *** mcarden_ has joined #openstack-infra | 08:44 | |
| *** matt6434 has joined #openstack-infra | 08:44 | |
| *** flip214_ has joined #openstack-infra | 08:44 | |
| *** eglute_s has joined #openstack-infra | 08:44 | |
| *** bapalm_ has joined #openstack-infra | 08:44 | |
| *** lbragstad_ has joined #openstack-infra | 08:44 | |
| *** shardy_ has joined #openstack-infra | 08:44 | |
| *** jbryce_ has joined #openstack-infra | 08:45 | |
| *** hockeynut_afk has joined #openstack-infra | 08:45 | |
| *** promethe1nfire has joined #openstack-infra | 08:45 | |
| *** lucasagomes_ has joined #openstack-infra | 08:45 | |
| *** roaet- has joined #openstack-infra | 08:45 | |
| *** mhu1 has joined #openstack-infra | 08:45 | |
| *** BobBall has joined #openstack-infra | 08:45 | |
| *** breton_ has joined #openstack-infra | 08:45 | |
| *** Hunner_ has joined #openstack-infra | 08:45 | |
| *** Hunner_ has quit IRC | 08:45 | |
| *** Hunner_ has joined #openstack-infra | 08:45 | |
| *** auggy has quit IRC | 08:45 | |
| *** monester has quit IRC | 08:45 | |
| *** sigmavirus24_awa has quit IRC | 08:45 | |
| *** hockeynut has quit IRC | 08:45 | |
| *** warpc has quit IRC | 08:45 | |
| *** mhu has quit IRC | 08:45 | |
| *** timsim has quit IRC | 08:45 | |
| *** dalgaaf has quit IRC | 08:45 | |
| *** tdurakov has quit IRC | 08:45 | |
| *** ogelbukh has quit IRC | 08:45 | |
| *** iremizov has quit IRC | 08:45 | |
| *** isviridov_away has quit IRC | 08:45 | |
| *** skath has quit IRC | 08:45 | |
| *** roaet_ has quit IRC | 08:45 | |
| *** d34dh0r53 has quit IRC | 08:45 | |
| *** jraim has quit IRC | 08:45 | |
| *** shardy has quit IRC | 08:45 | |
| *** med_ has quit IRC | 08:45 | |
| *** thiagop has quit IRC | 08:45 | |
| *** prometheanfire has quit IRC | 08:45 | |
| *** ameade has quit IRC | 08:45 | |
| *** tpeoples has quit IRC | 08:45 | |
| *** zz_dimtruck has quit IRC | 08:45 | |
| *** vipul- has quit IRC | 08:45 | |
| *** electrical has quit IRC | 08:45 | |
| *** bapalm has quit IRC | 08:45 | |
| *** vtapia has quit IRC | 08:45 | |
| *** petems has quit IRC | 08:45 | |
| *** melwitt has quit IRC | 08:45 | |
| *** cloudnull has quit IRC | 08:45 | |
| *** sbadia has quit IRC | 08:45 | |
| *** binbincong has quit IRC | 08:45 | |
| *** ramishra has quit IRC | 08:45 | |
| *** teran has quit IRC | 08:45 | |
| *** kozhukalov has quit IRC | 08:45 | |
| *** odyssey4me has quit IRC | 08:45 | |
| *** lewo has quit IRC | 08:45 | |
| *** onovy has quit IRC | 08:45 | |
| *** Hunner has quit IRC | 08:45 | |
| *** sbelous has quit IRC | 08:45 | |
| *** peterlisak has quit IRC | 08:45 | |
| *** samyewell has quit IRC | 08:45 | |
| *** briancurtin has quit IRC | 08:45 | |
| *** yarkot1 has quit IRC | 08:45 | |
| *** Adri2000 has quit IRC | 08:45 | |
| *** flip214 has quit IRC | 08:45 | |
| *** jbryce has quit IRC | 08:45 | |
| *** ashtokolov has quit IRC | 08:45 | |
| *** ryanpetrello has quit IRC | 08:45 | |
| *** rbradfor has quit IRC | 08:45 | |
| *** eglute has quit IRC | 08:45 | |
| *** mgagne has quit IRC | 08:45 | |
| *** aarefiev has quit IRC | 08:45 | |
| *** BobBall_ has quit IRC | 08:45 | |
| *** lucasagomes has quit IRC | 08:45 | |
| *** breton has quit IRC | 08:45 | |
| *** GheRivero has quit IRC | 08:45 | |
| *** Nakato has quit IRC | 08:45 | |
| *** lbragstad has quit IRC | 08:45 | |
| *** xnox has quit IRC | 08:45 | |
| *** mattoliverau has quit IRC | 08:45 | |
| *** jamielennox has quit IRC | 08:45 | |
| *** madorn has quit IRC | 08:45 | |
| *** mcarden has quit IRC | 08:45 | |
| *** wendar has quit IRC | 08:45 | |
| *** vkmc has quit IRC | 08:45 | |
| *** melwitt has joined #openstack-infra | 08:45 | |
| *** Nakato has joined #openstack-infra | 08:45 | |
| *** nighttime has quit IRC | 08:45 | |
| *** Adri2000 has joined #openstack-infra | 08:45 | |
| *** skath has joined #openstack-infra | 08:45 | |
| *** vtapia has joined #openstack-infra | 08:45 | |
| *** med_ has joined #openstack-infra | 08:45 | |
| *** d34dh0r53 has joined #openstack-infra | 08:45 | |
| *** mgagne has joined #openstack-infra | 08:45 | |
| *** vkmc has joined #openstack-infra | 08:45 | |
| *** ramishra has joined #openstack-infra | 08:45 | |
| *** ryanpetrello has joined #openstack-infra | 08:45 | |
| *** ramishra has quit IRC | 08:45 | |
| *** mhu1 is now known as mhu | 08:45 | |
| *** jbryce_ is now known as jbryce | 08:45 | |
| *** dimtruckl has joined #openstack-infra | 08:45 | |
| *** Adri2000 has quit IRC | 08:45 | |
| *** Adri2000 has joined #openstack-infra | 08:45 | |
| *** med_ has quit IRC | 08:45 | |
| *** med_ has joined #openstack-infra | 08:45 | |
| *** lewo_ has joined #openstack-infra | 08:45 | |
| *** auggy_ is now known as auggy | 08:45 | |
| *** vkmc has quit IRC | 08:45 | |
| *** vkmc has joined #openstack-infra | 08:45 | |
| *** ramishra has joined #openstack-infra | 08:45 | |
| *** xnox_ has joined #openstack-infra | 08:46 | |
| *** yarkot1 has joined #openstack-infra | 08:46 | |
| *** tdurakov_ is now known as tdurakov | 08:46 | |
| *** samyewell_ is now known as samyewell | 08:46 | |
| *** madorn has joined #openstack-infra | 08:46 | |
| *** lewo_ is now known as lewo | 08:46 | |
| *** melwitt is now known as Guest37264 | 08:46 | |
| *** mgagne is now known as Guest92292 | 08:46 | |
| *** monester_ is now known as monester | 08:46 | |
| *** dimtruckl is now known as dimtruck | 08:46 | |
| *** thiagop has joined #openstack-infra | 08:46 | |
| *** skath has quit IRC | 08:46 | |
| *** skath has joined #openstack-infra | 08:46 | |
| *** sbelous has joined #openstack-infra | 08:46 | |
| *** dalgaaf_ is now known as dalgaaf | 08:46 | |
| *** odyssey4me has joined #openstack-infra | 08:46 | |
| *** sbadia has joined #openstack-infra | 08:46 | |
| *** binbincong has joined #openstack-infra | 08:46 | |
| *** peterlisak has joined #openstack-infra | 08:46 | |
| *** rbradfor has joined #openstack-infra | 08:46 | |
| *** onovy has joined #openstack-infra | 08:46 | |
| *** aarefiev has joined #openstack-infra | 08:46 | |
| *** xnox_ is now known as xnox | 08:47 | |
| *** teran_ is now known as teran | 08:47 | |
| *** jraim_ is now known as jraim | 08:47 | |
| *** isviridov_away has joined #openstack-infra | 08:47 | |
| *** serverascode has quit IRC | 08:47 | |
| *** fkautz has quit IRC | 08:47 | |
| *** ashtokolov_ is now known as ashtokolov | 08:47 | |
| *** cloudkiller has joined #openstack-infra | 08:47 | |
| *** ogelbukh has joined #openstack-infra | 08:47 | |
| *** ramishra has quit IRC | 08:47 | |
| *** timsim has joined #openstack-infra | 08:48 | |
| *** ramishra has joined #openstack-infra | 08:48 | |
| *** kozhukalov_ is now known as kozhukalov | 08:48 | |
| *** jaranovich has quit IRC | 08:48 | |
| *** hrybacki has quit IRC | 08:48 | |
| *** marcusvrn_ has quit IRC | 08:48 | |
| *** dougwig has quit IRC | 08:48 | |
| *** lucasagomes_ is now known as lucasagomes | 08:49 | |
| *** sigmavirus24_awa has joined #openstack-infra | 08:49 | |
| *** e0ne has joined #openstack-infra | 08:49 | |
| *** zxiiro has quit IRC | 08:49 | |
| *** sridhar_ram_ has quit IRC | 08:49 | |
| *** sylwesterB has quit IRC | 08:49 | |
| *** rpodolyaka has quit IRC | 08:49 | |
| *** lindsayk has quit IRC | 08:50 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Update 60-setup-testenvs to match what we use https://review.openstack.org/315290 | 08:51 |
| *** jaosorior has joined #openstack-infra | 08:51 | |
| *** tpeoples has joined #openstack-infra | 08:52 | |
| *** electrical_ is now known as electrical | 08:52 | |
| *** rm_work has quit IRC | 08:53 | |
| *** daytime has joined #openstack-infra | 08:53 | |
| *** rm_work has joined #openstack-infra | 08:54 | |
| *** GheRivero has joined #openstack-infra | 08:54 | |
| *** jamielennox has joined #openstack-infra | 08:55 | |
| *** dtardivel has joined #openstack-infra | 08:55 | |
| *** lindsayk has joined #openstack-infra | 08:55 | |
| *** ameade has joined #openstack-infra | 08:55 | |
| *** warpc has joined #openstack-infra | 08:55 | |
| *** marcusvrn_ has joined #openstack-infra | 08:57 | |
| *** rpodolyaka has joined #openstack-infra | 08:57 | |
| *** iremizov has joined #openstack-infra | 08:57 | |
| *** ccamacho has quit IRC | 08:58 | |
| *** zxiiro has joined #openstack-infra | 08:58 | |
| *** petems has joined #openstack-infra | 08:58 | |
| *** jaranovich has joined #openstack-infra | 08:58 | |
| *** sridhar_ram_ has joined #openstack-infra | 08:58 | |
| *** dougwig has joined #openstack-infra | 08:59 | |
| *** serverascode has joined #openstack-infra | 09:00 | |
| *** hrybacki has joined #openstack-infra | 09:00 | |
| *** sylwesterB has joined #openstack-infra | 09:02 | |
| *** ccamacho has joined #openstack-infra | 09:02 | |
| *** daemontool has quit IRC | 09:03 | |
| *** fkautz has joined #openstack-infra | 09:03 | |
| *** briancurtin has joined #openstack-infra | 09:05 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE Running tests https://review.openstack.org/316436 | 09:05 |
| *** flip214_ is now known as flip214 | 09:05 | |
| *** flip214 has joined #openstack-infra | 09:05 | |
| *** nijaba has quit IRC | 09:05 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Workaround objects having uuid instead of id https://review.openstack.org/317917 | 09:07 |
| mescanef | hello. please review some puppet code in https://review.openstack.org/#/c/303306/ and https://review.openstack.org/#/c/299661/ | 09:08 |
| *** salv-orlando has joined #openstack-infra | 09:09 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Remove the Tuesday 0800 third party meeting. https://review.openstack.org/317444 | 09:09 |
| *** saravana_ has quit IRC | 09:10 | |
| *** rguillebert has quit IRC | 09:11 | |
| *** asettle has joined #openstack-infra | 09:12 | |
| *** nijaba has joined #openstack-infra | 09:12 | |
| *** jtomasek_ has joined #openstack-infra | 09:12 | |
| *** rhochmuth has joined #openstack-infra | 09:13 | |
| *** jyuso1 has quit IRC | 09:14 | |
| *** rguillebert has joined #openstack-infra | 09:15 | |
| *** abregman is now known as abregman|afk | 09:18 | |
| *** daemontool has joined #openstack-infra | 09:18 | |
| *** rhochmuth has quit IRC | 09:18 | |
| *** amitgandhinz has joined #openstack-infra | 09:24 | |
| *** vkramskikh_ has joined #openstack-infra | 09:25 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Add meeting_id's for Nova API and HyperV meetings https://review.openstack.org/317793 | 09:27 |
| *** javeriak has joined #openstack-infra | 09:27 | |
| *** amitgandhinz has quit IRC | 09:28 | |
| Zara | fungi: aw, cert errors... I think I had similar problems trying to set up an instance with puppet manually. I think SotK's puppet-deployed instance did use snakeoil certs, may be wrong. | 09:29 |
| *** nmagnezi has joined #openstack-infra | 09:29 | |
| SotK | it did, I had to manually configure apache though IIRC | 09:29 |
| SotK | I also don't remember seeing the error fungi mentioned | 09:30 |
| *** duobei has quit IRC | 09:30 | |
| *** esikachev has quit IRC | 09:32 | |
| *** jtomasek_ has quit IRC | 09:32 | |
| *** gildub has joined #openstack-infra | 09:33 | |
| *** duobei has joined #openstack-infra | 09:35 | |
| *** slaweq has joined #openstack-infra | 09:35 | |
| *** rhochmuth has joined #openstack-infra | 09:35 | |
| *** gema has joined #openstack-infra | 09:36 | |
| *** zqfan has joined #openstack-infra | 09:36 | |
| *** rhochmuth has quit IRC | 09:39 | |
| *** samyewell has quit IRC | 09:39 | |
| *** puiterwijk|cld has quit IRC | 09:39 | |
| *** vkramskikh_ has quit IRC | 09:40 | |
| *** esikachev has joined #openstack-infra | 09:40 | |
| *** fdegir has quit IRC | 09:40 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added new repo for fuel-plugin-datera-cinder https://review.openstack.org/315651 | 09:40 |
| *** e0ne has quit IRC | 09:40 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add Sahara role to OpenStack-Ansible https://review.openstack.org/317931 | 09:40 |
| *** e0ne has joined #openstack-infra | 09:42 | |
| openstackgerrit | Rabi Mishra proposed openstack-infra/project-config: Run heat api tests after the upgrade https://review.openstack.org/312811 | 09:42 |
| *** Na3iL has joined #openstack-infra | 09:42 | |
| *** samyewell has joined #openstack-infra | 09:43 | |
| *** fdegir has joined #openstack-infra | 09:43 | |
| *** zhurong has quit IRC | 09:43 | |
| *** puiterwijk|cld has joined #openstack-infra | 09:44 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add Sahara role to OpenStack-Ansible https://review.openstack.org/317931 | 09:46 |
| *** cloudkiller is now known as cloudnull | 09:46 | |
| *** esikachev has quit IRC | 09:46 | |
| *** nadya has joined #openstack-infra | 09:47 | |
| *** zhurong has joined #openstack-infra | 09:47 | |
| openstackgerrit | Merged openstack-infra/puppet-nodepool: Added nodepool::mysql class https://review.openstack.org/299661 | 09:47 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Add timeout to get_host_info task https://review.openstack.org/317937 | 09:48 |
| sshnaidm | clarkb, hi | 09:48 |
| *** electrofelix has joined #openstack-infra | 09:49 | |
| *** fawadkhaliq has quit IRC | 09:49 | |
| *** fawadkhaliq has joined #openstack-infra | 09:50 | |
| openstackgerrit | Di XiaoLi proposed openstack-infra/project-config: Add a heat job to use devstack plugin https://review.openstack.org/317811 | 09:50 |
| *** hashar has joined #openstack-infra | 09:52 | |
| *** rhochmuth has joined #openstack-infra | 09:55 | |
| *** rhochmuth has quit IRC | 09:56 | |
| openstackgerrit | Di XiaoLi proposed openstack-infra/project-config: Switch all heat jobs to use devstack plugin https://review.openstack.org/317817 | 09:56 |
| *** markvoelker has joined #openstack-infra | 09:56 | |
| openstackgerrit | Merged openstack-infra/project-config: Build also wheel packages for Python 3 https://review.openstack.org/316890 | 09:56 |
| *** matrohon has quit IRC | 09:59 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Fix and extend the object model documentation https://review.openstack.org/317620 | 09:59 |
| openstackgerrit | Merged openstack-infra/system-config: Enable tcp/8088 on jenkins slaves https://review.openstack.org/317743 | 10:00 |
| *** sdague has joined #openstack-infra | 10:01 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable IPXE for grenade-ironic https://review.openstack.org/317615 | 10:01 |
| *** markvoelker has quit IRC | 10:02 | |
| *** esikachev has joined #openstack-infra | 10:02 | |
| *** gongysh has quit IRC | 10:03 | |
| *** ihrachys has quit IRC | 10:05 | |
| openstackgerrit | Merged openstack-infra/project-config: Add api-ref jobs to Designate https://review.openstack.org/317001 | 10:07 |
| openstackgerrit | Gema Gomez-Solano proposed openstack-infra/system-config: Remove #openstack-tailgate from list of channels https://review.openstack.org/317952 | 10:07 |
| openstackgerrit | Gema Gomez-Solano proposed openstack-infra/project-config: Removing #openstack-tailgate IRC channel from list https://review.openstack.org/317954 | 10:08 |
| *** Qiming has quit IRC | 10:08 | |
| openstackgerrit | Merged openstack-infra/project-config: Set Designate+Tempest on Mitaka jobs as voting https://review.openstack.org/317623 | 10:08 |
| *** abregman|afk is now known as abregman | 10:08 | |
| openstackgerrit | Rabi Mishra proposed openstack-infra/project-config: Only run heat api tests in grenade heat job https://review.openstack.org/312811 | 10:10 |
| d0ugal | dims_: I am here also, if it is easier :) | 10:11 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE Running tests https://review.openstack.org/316436 | 10:12 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add magnum services call to shade https://review.openstack.org/313583 | 10:12 |
| *** asselin has quit IRC | 10:12 | |
| *** nmagnezi has quit IRC | 10:13 | |
| *** salv-orlando has quit IRC | 10:13 | |
| openstackgerrit | Merged openstack-infra/project-config: puppet: implement breaker-jobs-nv on xenial https://review.openstack.org/317449 | 10:16 |
| *** zhurong has quit IRC | 10:17 | |
| *** salv-orlando has joined #openstack-infra | 10:20 | |
| *** rossella_s has quit IRC | 10:23 | |
| *** cdent has joined #openstack-infra | 10:23 | |
| *** rossella_s has joined #openstack-infra | 10:24 | |
| *** amitgandhinz has joined #openstack-infra | 10:24 | |
| *** Jeffrey4l has quit IRC | 10:25 | |
| *** duobei has quit IRC | 10:27 | |
| *** amitgandhinz has quit IRC | 10:29 | |
| *** cdent has left #openstack-infra | 10:34 | |
| *** dimtruck is now known as zz_dimtruck | 10:36 | |
| *** ccamacho is now known as ccamacho|lunch | 10:41 | |
| *** duobei has joined #openstack-infra | 10:43 | |
| *** gsagie has joined #openstack-infra | 10:46 | |
| gsagie | Hello, anyone here has access to add kuryr-core team to the new repositories kuryr-libnetwork and kuryr-kubernetes | 10:47 |
| gsagie | we need it in order to start merging and adding code there | 10:47 |
| dims_ | d0ugal :) | 10:48 |
| jroll | any project-config folks mind a quick review? https://review.openstack.org/#/c/316655/ | 10:49 |
| jroll | just dropping some jobs from master | 10:49 |
| *** duobei has quit IRC | 10:50 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Add dib element to generate logical volumes https://review.openstack.org/252041 | 10:54 |
| *** rhochmuth has joined #openstack-infra | 10:54 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:55 | |
| *** rhochmuth has quit IRC | 10:57 | |
| *** dtantsur is now known as dtantsur|brb | 10:59 | |
| *** camunoz_ has joined #openstack-infra | 10:59 | |
| *** deadnull has joined #openstack-infra | 11:00 | |
| *** Ravikiran_K has left #openstack-infra | 11:06 | |
| *** rhochmuth has joined #openstack-infra | 11:07 | |
| *** mancdaz has quit IRC | 11:09 | |
| *** weshay has joined #openstack-infra | 11:09 | |
| *** mancdaz has joined #openstack-infra | 11:09 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/puppet-openstackci: Include nodepool::mysql from openstackci https://review.openstack.org/303306 | 11:10 |
| *** andreas_s has joined #openstack-infra | 11:12 | |
| *** zeih has quit IRC | 11:15 | |
| *** javeriak has quit IRC | 11:18 | |
| *** javeriak_ has joined #openstack-infra | 11:18 | |
| *** Qiming has joined #openstack-infra | 11:18 | |
| *** Na3iL has quit IRC | 11:19 | |
| *** Goneri has joined #openstack-infra | 11:20 | |
| *** kushal has quit IRC | 11:21 | |
| *** asettle has quit IRC | 11:21 | |
| *** amitgandhinz has joined #openstack-infra | 11:25 | |
| *** ccamacho|lunch is now known as ccamacho | 11:27 | |
| *** asettle has joined #openstack-infra | 11:28 | |
| *** zeih has joined #openstack-infra | 11:29 | |
| *** javeriak_ has quit IRC | 11:29 | |
| *** amitgandhinz has quit IRC | 11:30 | |
| *** anteaya has joined #openstack-infra | 11:30 | |
| openstackgerrit | Dong Ma proposed openstack-infra/subunit2sql: Fix db API get_ids_for_all_tests https://review.openstack.org/310323 | 11:32 |
| *** thorst_ has joined #openstack-infra | 11:35 | |
| *** thorst__ has joined #openstack-infra | 11:35 | |
| *** ldnunes has joined #openstack-infra | 11:35 | |
| *** yamamoto_ has quit IRC | 11:38 | |
| *** lucasagomes is now known as lucas-hungry | 11:38 | |
| *** thorst_ has quit IRC | 11:39 | |
| *** julim has joined #openstack-infra | 11:40 | |
| *** baoli has joined #openstack-infra | 11:45 | |
| *** baoli_ has joined #openstack-infra | 11:46 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Increase tempest baremetal deploy/unprovision timeouts https://review.openstack.org/315545 | 11:47 |
| openstackgerrit | Dong Ma proposed openstack-infra/subunit2sql: Fix db API get_ids_for_all_tests https://review.openstack.org/310323 | 11:48 |
| *** baoli has quit IRC | 11:50 | |
| *** rfolco has joined #openstack-infra | 11:52 | |
| *** dtantsur|brb is now known as dtantsur | 11:52 | |
| *** ams_ has joined #openstack-infra | 11:52 | |
| *** rhallisey has joined #openstack-infra | 11:53 | |
| *** matrohon has joined #openstack-infra | 11:53 | |
| *** pavel_bondar has quit IRC | 11:56 | |
| *** andreas_s_ has joined #openstack-infra | 11:57 | |
| *** andreas_s_ has quit IRC | 11:57 | |
| *** rodrigods has quit IRC | 11:58 | |
| *** rodrigods has joined #openstack-infra | 11:58 | |
| *** zeih has quit IRC | 11:59 | |
| openstackgerrit | Merged openstack-infra/storyboard: Improve the worklist filtering functionality https://review.openstack.org/310287 | 12:02 |
| *** dprince has joined #openstack-infra | 12:05 | |
| *** aysyd has joined #openstack-infra | 12:05 | |
| *** rhochmuth has quit IRC | 12:05 | |
| *** eharney has quit IRC | 12:07 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: add a standard topic to all constraint updates https://review.openstack.org/318007 | 12:09 |
| *** trown|outtypewww is now known as trown | 12:12 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 12:12 | |
| openstackgerrit | Andrey Volochay proposed openstack-infra/project-config: Allow core reviewers to push merge commits to fuel-plugin-cinder-netapp https://review.openstack.org/318009 | 12:13 |
| *** |-paul-| has quit IRC | 12:14 | |
| *** zul has quit IRC | 12:14 | |
| *** oanson has joined #openstack-infra | 12:14 | |
| *** fawadkhaliq has quit IRC | 12:17 | |
| *** fawadkhaliq has joined #openstack-infra | 12:18 | |
| *** camunoz_ has quit IRC | 12:18 | |
| *** yonglihe has quit IRC | 12:18 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add magnum services call to shade https://review.openstack.org/313583 | 12:19 |
| *** zeih has joined #openstack-infra | 12:21 | |
| *** gordc has joined #openstack-infra | 12:23 | |
| *** tpsilva has joined #openstack-infra | 12:25 | |
| *** Goneri has quit IRC | 12:25 | |
| *** jordanP has joined #openstack-infra | 12:25 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/project-config: Bump tripleo containers job back to experimental https://review.openstack.org/317545 | 12:25 |
| *** degorenko is now known as _degorenko|afk | 12:26 | |
| *** amitgandhinz has joined #openstack-infra | 12:26 | |
| *** Ravikiran_K has joined #openstack-infra | 12:26 | |
| *** raildo-afk is now known as raildo | 12:28 | |
| *** kgiusti has joined #openstack-infra | 12:28 | |
| *** sree has quit IRC | 12:30 | |
| *** sree has joined #openstack-infra | 12:30 | |
| *** links has quit IRC | 12:31 | |
| *** amitgandhinz has quit IRC | 12:31 | |
| *** lucas-hungry is now known as lucasagomes | 12:32 | |
| *** deadnull has quit IRC | 12:32 | |
| *** zz_dimtruck is now known as dimtruck | 12:33 | |
| *** chuck__ has joined #openstack-infra | 12:34 | |
| *** deadnull has joined #openstack-infra | 12:34 | |
| *** rhochmuth has joined #openstack-infra | 12:34 | |
| *** links has joined #openstack-infra | 12:35 | |
| *** psachin has quit IRC | 12:36 | |
| *** Goneri has joined #openstack-infra | 12:37 | |
| *** promethe1nfire is now known as prometheanfire | 12:38 | |
| *** ihrachys has joined #openstack-infra | 12:40 | |
| *** salv-orlando has quit IRC | 12:42 | |
| *** javeriak has joined #openstack-infra | 12:42 | |
| *** rlandy has quit IRC | 12:45 | |
| *** akshai has joined #openstack-infra | 12:45 | |
| *** rlandy has joined #openstack-infra | 12:45 | |
| *** akshai_ has joined #openstack-infra | 12:47 | |
| *** psachin has joined #openstack-infra | 12:48 | |
| *** amrith is now known as _amrith_ | 12:48 | |
| *** akshai has quit IRC | 12:50 | |
| pabelanger | morning | 12:51 |
| pabelanger | fungi: looking into logs to see what is happening | 12:52 |
| *** daemontool has quit IRC | 12:52 | |
| *** gtop-323 has joined #openstack-infra | 12:53 | |
| *** _ari_ has joined #openstack-infra | 12:54 | |
| fungi | thanks, pabelanger | 12:56 |
| *** _degorenko|afk is now known as degorenko | 12:56 | |
| *** yamamoto has joined #openstack-infra | 12:58 | |
| *** roaet- has quit IRC | 12:58 | |
| pabelanger | fungi: so, it looks like firefox-45.1.1-1el7.centos.i686.rpm was released to the mirrors yesterday. We downloaded the repodata but it seems 6 hours later is when we actually downloaded the firefox binary. So, I wonder if the mirror we sync against was having an issue. | 12:58 |
| *** kzaitsev_mb has quit IRC | 12:58 | |
| pabelanger | we are using rsync://mirror.sfo12.us.leaseweb.net currently | 12:58 |
| *** psilvad has joined #openstack-infra | 12:58 | |
| *** sree has quit IRC | 12:59 | |
| pabelanger | fungi: I'll get started on finishing up our validation script, pretty sure we would have been able to detect the missing file on the local repo and not vos release. | 12:59 |
| *** eharney has joined #openstack-infra | 12:59 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Add the new Requirements team meeting https://review.openstack.org/318043 | 12:59 |
| pabelanger | then 6 hours later, seen firefox get added and release properly | 12:59 |
| *** roaet has joined #openstack-infra | 12:59 | |
| fungi | Zara: SotK: nibalizer: the puppet errors for the cert installation on storyboard-dev appear to probably be a dependency ordering/bootstrapping problem, which was made eventually consistent on a subsequent puppet run: | 13:00 |
| fungi | May 18 05:08:01 storyboard-dev puppet-user[32400]: (/Stage[main]/Storyboard::Cert/File[/etc/ssl/private/storyboard.openstack.org.key]/group) group changed 'root' to 'ssl-cert' | 13:00 |
| * rcarrillocruz fixes puppet issues by running it multiple times | 13:00 | |
| fungi | i have a feeling the ssl-cert group is created by a distro package post-install script and we're missing a dependency on the package | 13:01 |
| pabelanger | rcarrillocruz: :( | 13:01 |
| rcarrillocruz | the resource ordering is actually one of the things that annoys most about puppet | 13:01 |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Add the new Requirements team meeting https://review.openstack.org/318043 | 13:01 |
| rcarrillocruz | you have to be explicit | 13:01 |
| rcarrillocruz | and as soon as the manifest/class gets big | 13:02 |
| rcarrillocruz | or depends on other classes | 13:02 |
| rcarrillocruz | is really hard to get the picture of what actually runs before and after | 13:02 |
| *** Na3iL has joined #openstack-infra | 13:02 | |
| fungi | pabelanger: what are the chances that the rsync for the mirror actually worked as designed, but that the site from which we were mirroring updated its indices to mention the new firefox package before actually making the package available, so we caught it in between? | 13:03 |
| *** matrohon has quit IRC | 13:03 | |
| fungi | pabelanger: regardless, i think that index validation script we were talking about would have prevented this since we would have avoided running a vos release until files mentioned in the index actually appear on the mirror | 13:03 |
| pabelanger | fungi: that is possible too. I am trying to see if there are any logs upstream about the release of firefox | 13:03 |
| pabelanger | fungi: agreed | 13:04 |
| *** edmondsw has joined #openstack-infra | 13:04 | |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Sync up EndpointMap in enable-tls with default enable-tls from THT https://review.openstack.org/318050 | 13:04 |
| *** njohnsto- has joined #openstack-infra | 13:05 | |
| *** njohnsto- is now known as njohnston-- | 13:06 | |
| *** pilgrimstack1 has joined #openstack-infra | 13:06 | |
| openstackgerrit | Merged openstack-infra/storyboard: Improve the board filtering functionality https://review.openstack.org/310301 | 13:06 |
| *** pilgrimstack has quit IRC | 13:06 | |
| SotK | fungi: attempting to start apache on storyboard-dev gives the following error: http://paste.openstack.org/show/497498/ | 13:08 |
| SotK | the contents of that cert file are `' to be filled '` | 13:09 |
| *** Ravikiran_K has quit IRC | 13:11 | |
| *** zeih has quit IRC | 13:12 | |
| *** zeih has joined #openstack-infra | 13:12 | |
| fungi | SotK: i think the fallback in the puppet manifest was supposed to use /etc/ssl/private/ssl-cert-snakeoil.key and /etc/ssl/certs/ssl-cert-snakeoil.pem when /etc/ssl/private/storyboard.openstack.org.key and /etc/ssl/certs/storyboard.openstack.org.pem are empty | 13:13 |
| fungi | at least that | 13:13 |
| fungi | 's the pattern we usually follow in our other modules | 13:13 |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Sync up EndpointMap in enable-tls with default enable-tls from THT https://review.openstack.org/318050 | 13:13 |
| fungi | so probably either something is wrong with the logic in the manifest, or we're setting values we shouldn't be (possibly inheriting incorrect defaults?) | 13:13 |
| *** asselin has joined #openstack-infra | 13:14 | |
| *** mriedem has joined #openstack-infra | 13:15 | |
| *** matt-borland has joined #openstack-infra | 13:15 | |
| *** links has quit IRC | 13:16 | |
| anteaya | fungi: so the feeling round the table is that though both Zara and SotK can ssh into the storyboard-dev server, none of us know what to do in terms of next steps | 13:16 |
| anteaya | fungi: we are willing to take some direction if you have any to offer | 13:17 |
| *** thorst__ is now known as thorst_ | 13:17 | |
| fungi | anteaya: i'll be at my regular computer in about 30 minutes and can take a look at the puppet manifest and see if i can spot the problem | 13:20 |
| Zara | \o/ | 13:21 |
| Zara | thank you :) | 13:21 |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Remove kilo-bitrot-jobs from Designate https://review.openstack.org/318080 | 13:21 |
| anteaya | fungi: thank you | 13:22 |
| *** amitgandhinz has joined #openstack-infra | 13:22 | |
| *** kzaitsev_mb has joined #openstack-infra | 13:22 | |
| *** amitgandhinz has quit IRC | 13:22 | |
| *** amitgandhinz has joined #openstack-infra | 13:23 | |
| *** sree has joined #openstack-infra | 13:24 | |
| *** bexelbie has quit IRC | 13:25 | |
| Shrews | cloudnull: i haven't looked at the fip leak at all since mordred was on it. but seeing as he's on vacation, do you have something that reproduces the leak? | 13:26 |
| *** bexelbie has joined #openstack-infra | 13:27 | |
| *** akshai_ has quit IRC | 13:27 | |
| EmilienM | pabelanger: FYI our stable/liberty & stable/mitaka are now using AFS mirror on centos (we can't use it for master because we don't use centos mirror but trunk.rdo servers) | 13:28 |
| *** banix has joined #openstack-infra | 13:29 | |
| EmilienM | pabelanger: we might want having UCA (Ubuntu Cloud Archive) mirror in your 'next' list so we can do the same as we did for centos | 13:29 |
| pabelanger | EmilienM: Great! If you didn't see we launched epel yesterday too: http://mirror.dfw.rax.openstack.org/epel/7/ I don't think you use that any more | 13:30 |
| pabelanger | EmilienM: I'll likely switch gears up next to look into the gem mirror and our packaging effort with AFS | 13:31 |
| *** tonytan4ever has joined #openstack-infra | 13:31 | |
| *** matrohon has joined #openstack-infra | 13:31 | |
| *** akshai has joined #openstack-infra | 13:31 | |
| *** ddieterly has joined #openstack-infra | 13:32 | |
| EmilienM | pabelanger: no, we ran away from EPEL, because it overlaps with what RDO proposes. So now, we just use centos repo + RDO repos | 13:32 |
| EmilienM | pabelanger: yeah, gems are really critical for us, we have timeouts every week | 13:32 |
| EmilienM | let me know anytime if you need help on that | 13:33 |
| *** cloudtrainme has joined #openstack-infra | 13:36 | |
| *** deadnull has quit IRC | 13:36 | |
| *** Jeffrey4l has joined #openstack-infra | 13:36 | |
| *** ddieterly is now known as ddieterly[away] | 13:38 | |
| *** vhosakot has joined #openstack-infra | 13:39 | |
| *** nwkarsten has joined #openstack-infra | 13:39 | |
| *** lbragstad_ is now known as lbragstad | 13:39 | |
| *** yaume has quit IRC | 13:40 | |
| *** kzaitsev_mb has quit IRC | 13:41 | |
| *** yaume has joined #openstack-infra | 13:41 | |
| *** jordanP has quit IRC | 13:42 | |
| *** dimtruck is now known as zz_dimtruck | 13:42 | |
| *** hichihara has joined #openstack-infra | 13:43 | |
| *** salv-orlando has joined #openstack-infra | 13:43 | |
| *** mtanino has joined #openstack-infra | 13:43 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/gerritbot: Add _get_username method to discover username https://review.openstack.org/318096 | 13:44 |
| *** rhochmuth has quit IRC | 13:45 | |
| *** inc0 has joined #openstack-infra | 13:46 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/gerritbot: Add change-created event type https://review.openstack.org/286366 | 13:49 |
| *** ddieterly[away] is now known as ddieterly | 13:49 | |
| *** jordanP has joined #openstack-infra | 13:50 | |
| *** oanson has quit IRC | 13:52 | |
| *** ccamacho has quit IRC | 13:53 | |
| *** ccamacho has joined #openstack-infra | 13:54 | |
| nibalizer | rcarrillocruz: puppet can give you a visual graph | 13:55 |
| nibalizer | or a .dot file that you can visualize in any number of ways | 13:55 |
| *** doug-fish has joined #openstack-infra | 13:57 | |
| *** chem`` has joined #openstack-infra | 13:57 | |
| rcarrillocruz | y i know...there are even ways to change the resource ordering, just stating the fundamental design decisions of puppet | 14:00 |
| *** jbernard_ is now known as jbernard | 14:00 | |
| *** njohnston-- is now known as njohnston__ | 14:00 | |
| rcarrillocruz | nibalizer , pabelanger : may one of you puhlease review https://review.openstack.org/#/c/311275/ ? | 14:00 |
| *** pradk has joined #openstack-infra | 14:00 | |
| *** roaet has quit IRC | 14:01 | |
| *** hashar is now known as hasharMeeting | 14:01 | |
| *** sridhar_ram has joined #openstack-infra | 14:02 | |
| *** javeriak has quit IRC | 14:02 | |
| *** kushal has joined #openstack-infra | 14:03 | |
| *** Liuqing has joined #openstack-infra | 14:04 | |
| *** yamahata has joined #openstack-infra | 14:04 | |
| *** cloudtrainme has quit IRC | 14:05 | |
| *** rhochmuth has joined #openstack-infra | 14:06 | |
| sdague | fungi: https://review.openstack.org/#/c/318116 is the root issue on a bunch of the gate backup right now | 14:06 |
| *** zeih has quit IRC | 14:06 | |
| sdague | could we enqueue it into the gate (no need to promote) | 14:07 |
| *** mrmartin has joined #openstack-infra | 14:07 | |
| sdague | but getting it into the gate will hopefully relieve some of the current race fail on fernet revocations | 14:07 |
| *** nwkarsten has quit IRC | 14:07 | |
| *** Jeffrey4l has quit IRC | 14:08 | |
| sdague | and the check queue is a > 1 hr delay right now | 14:08 |
| *** nwkarsten has joined #openstack-infra | 14:08 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Allow storyboard-dev to use snakeoil SSL/TLS https://review.openstack.org/318120 | 14:08 |
| fungi | Zara: SotK: anteaya: ^ | 14:08 |
| *** salv-orlando has quit IRC | 14:09 | |
| *** jordanP has quit IRC | 14:09 | |
| fungi | sdague: enqueued now | 14:10 |
| *** links has joined #openstack-infra | 14:10 | |
| openstackgerrit | Thiago da Silva proposed openstack-infra/project-config: add python jobs to pyeclib project https://review.openstack.org/317672 | 14:10 |
| sdague | fungi: thank you | 14:10 |
| Zara | fungi: interesting, I tried taking those lines out of my config when attempting to deploy a storyboard instance with puppet and I just got errors, though guessing this is different enough for that to work... wish I knew more puppet... | 14:11 |
| Zara | (I wrote things up in the 'set up storyboard with puppet' task notes over here: https://storyboard.openstack.org/#!/story/2000535 ) | 14:12 |
| *** vhosakot has quit IRC | 14:12 | |
| *** vhosakot has joined #openstack-infra | 14:13 | |
| *** nwkarsten has quit IRC | 14:13 | |
| *** shardy_ is now known as shardy | 14:14 | |
| *** sdake has joined #openstack-infra | 14:14 | |
| *** nwkarsten has joined #openstack-infra | 14:14 | |
| *** rbrndt has joined #openstack-infra | 14:15 | |
| fungi | Zara: well, no guarantees, but the logic in http://git.openstack.org/cgit/openstack-infra/puppet-storyboard/tree/manifests/cert.pp relies on those being unset to avoid creating them, and http://git.openstack.org/cgit/openstack-infra/puppet-storyboard/tree/manifests/init.pp looks like it overrides their defaults to the snakeoil paths if not passed in when the module is instantiated (and we have the | 14:16 |
| fungi | defaults for them set to undef in the classes in system-config) | 14:16 |
| fungi | so it looks like it _should_ work. if it doesn't, then we also have a bug in the openstack-infra/puppet-storyboard repo which needs patching | 14:17 |
| EmilienM | pabelanger: also another update, our proposal bot is now working fine, see https://review.openstack.org/317849 | 14:17 |
| *** yamahata has quit IRC | 14:18 | |
| *** claudiub has quit IRC | 14:19 | |
| *** doug-fis_ has joined #openstack-infra | 14:19 | |
| fungi | i'm going to self-approve 318120 since it's just defaulting parameters for a dev server which isn't working yet anyway | 14:20 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/system-config: Refresh log files for tripleo project https://review.openstack.org/312985 | 14:20 |
| anteaya | fungi: thank you | 14:21 |
| *** doug-fish has quit IRC | 14:21 | |
| *** savihou has quit IRC | 14:22 | |
| *** hongbin has joined #openstack-infra | 14:23 | |
| *** rossella_s has quit IRC | 14:23 | |
| *** nwkarsten has quit IRC | 14:24 | |
| *** rossella_s has joined #openstack-infra | 14:24 | |
| *** mescanef has quit IRC | 14:24 | |
| *** nwkarsten has joined #openstack-infra | 14:24 | |
| *** Guest92292 is now known as mgagne | 14:25 | |
| *** mgagne has quit IRC | 14:25 | |
| *** mgagne has joined #openstack-infra | 14:25 | |
| *** mescanef has joined #openstack-infra | 14:25 | |
| *** yaume_ has joined #openstack-infra | 14:25 | |
| *** sdake has quit IRC | 14:26 | |
| *** sdake has joined #openstack-infra | 14:27 | |
| *** Swami has joined #openstack-infra | 14:27 | |
| *** daemontool has joined #openstack-infra | 14:28 | |
| *** mriedem is now known as mriedem_meeting | 14:29 | |
| openstackgerrit | Merged openstack-infra/system-config: Allow storyboard-dev to use snakeoil SSL/TLS https://review.openstack.org/318120 | 14:29 |
| *** nwkarsten has quit IRC | 14:29 | |
| *** yaume has quit IRC | 14:29 | |
| *** yaume has joined #openstack-infra | 14:30 | |
| *** yaume_ has quit IRC | 14:33 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Add offset/limit pagination for teams https://review.openstack.org/318139 | 14:33 |
| openstackgerrit | David TARDIVEL proposed openstack-infra/project-config: Add new puppet-watcher repository https://review.openstack.org/315431 | 14:33 |
| *** Liuqing has quit IRC | 14:33 | |
| *** salv-orlando has joined #openstack-infra | 14:35 | |
| *** doug-fis_ has quit IRC | 14:35 | |
| *** markusry has joined #openstack-infra | 14:35 | |
| *** nwkarsten has joined #openstack-infra | 14:36 | |
| *** sree has quit IRC | 14:36 | |
| *** links has quit IRC | 14:39 | |
| *** psilvad has quit IRC | 14:39 | |
| openstackgerrit | Chris Hoge proposed openstack-infra/project-config: Add DefCore guideline gate checks for json lint and schema https://review.openstack.org/317800 | 14:40 |
| *** psilvad has joined #openstack-infra | 14:40 | |
| *** nwkarsten has quit IRC | 14:41 | |
| *** sdake_ has joined #openstack-infra | 14:42 | |
| *** xarses has quit IRC | 14:42 | |
| *** javeriak has joined #openstack-infra | 14:42 | |
| *** pcrews has quit IRC | 14:42 | |
| *** jpr has joined #openstack-infra | 14:43 | |
| *** sdake has quit IRC | 14:43 | |
| *** psilvad has quit IRC | 14:45 | |
| *** inc0 has quit IRC | 14:45 | |
| *** pcrews has joined #openstack-infra | 14:46 | |
| *** xarses has joined #openstack-infra | 14:47 | |
| hogepodge | jhesketh: so can I add -nv to the end of those template strings? To start I want to make sure the jobs don't break the gate (they don't on my dev env) | 14:48 |
| fungi | hogepodge: if the template name has some sort of suffix parameter, you can pass -nv in that and it will end up appended to the job name | 14:49 |
| *** cloudtrainme has joined #openstack-infra | 14:51 | |
| *** xyang1 has joined #openstack-infra | 14:52 | |
| *** mriedem_meeting is now known as mriedem | 14:53 | |
| anteaya | aaaa, caught on the middle of a jaffa cake controversy argument | 14:53 |
| anteaya | ahhhhhh, how British | 14:53 |
| *** _amrith_ is now known as amrith | 14:53 | |
| anteaya | now arguing which is the top | 14:53 |
| fungi | oh, is it the cake vs biscuit argument again? | 14:55 |
| *** javeriak has quit IRC | 14:55 | |
| jeblair | fungi: apparently that was decided by a court in 1991 | 14:56 |
| *** xarses has quit IRC | 14:56 | |
| *** raildo is now known as raildo-afk | 14:56 | |
| jeblair | they are cakes! and tomatoes are vegetables! | 14:56 |
| *** hockeynut_afk is now known as hockeynut | 14:56 | |
| anteaya | fungi: yes | 14:57 |
| anteaya | fungi: still ongoing | 14:57 |
| anteaya | I have to admit I made the mistake of starting this | 14:57 |
| fungi | courts clearly cannot settle such crucial matters | 14:57 |
| anteaya | jeblair: yes that article has been referenced | 14:57 |
| *** kushal has quit IRC | 14:58 | |
| *** nwkarsten has joined #openstack-infra | 14:58 | |
| anteaya | jeblair: however they didn't establish which part constitutes the top | 14:58 |
| anteaya | we are currently going over that point | 14:58 |
| fungi | okay, my system-config change has been applied on storyboard-dev but the vhost template is still setting SSLCertificateFile /etc/ssl/certs/storyboard.openstack.org.pem and SSLCertificateKeyFile /etc/ssl/private/storyboard.openstack.org.key | 14:58 |
| *** jaosorior has quit IRC | 14:59 | |
| anteaya | :( | 14:59 |
| fungi | i have a feeling the scope lookups there don't work as expected | 14:59 |
| *** jaosorior has joined #openstack-infra | 14:59 | |
| *** matrohon has quit IRC | 15:00 | |
| *** xarses has joined #openstack-infra | 15:00 | |
| SotK | https://en.wikipedia.org/wiki/Jaffa_Cakes#Categorisation_as_cake_or_biscuit_for_VAT goes over how the ruling was made, if anyone is interested in such things | 15:00 |
| fungi | it's set to default to snakeoil in the storyboard module's init, and then default to the path indicated in the vhost in storyboard::cert | 15:00 |
| Zara | (it's not really the cake vs biscuit argument between us, as I refuse to believe that jaffa cakes are edible) | 15:00 |
| *** slaweq has quit IRC | 15:00 | |
| fungi | so possibility 1 is that a default can't override a default | 15:00 |
| SotK | fungi: yeah, I can't see where "storyboard.openstack.org.pem" is even coming from | 15:00 |
| anteaya | fungi: hmmmm | 15:00 |
| *** hasharMeeting is now known as hashar | 15:00 | |
| jeblair | apparently the workers at the factory are encouraged to eat as many as they want | 15:01 |
| anteaya | oh my | 15:01 |
| fungi | possibility 2 is that because the template looks up those values from the storyboard::cert scope it's using that default rather than the earlier default | 15:01 |
| *** tonytan4ever has quit IRC | 15:01 | |
| anteaya | I wonder how many have acquired diabetes | 15:01 |
| fungi | but i have a vague recollection that a default can't override a default | 15:02 |
| fungi | fix on the way | 15:02 |
| anteaya | fungi: thanks, standing by | 15:02 |
| *** sridhar_ram has quit IRC | 15:02 | |
| *** jistr is now known as jistr|mtg | 15:02 | |
| *** jordanP has joined #openstack-infra | 15:03 | |
| *** fawadkhaliq has quit IRC | 15:04 | |
| *** nadya has quit IRC | 15:04 | |
| mtreinish | krotscheck: have you seen this before: http://logs.openstack.org/19/311919/12/check/gate-openstack-health-npm-run-lint/12e7de3/console.html#_2016-05-18_13_55_52_412 | 15:05 |
| *** banix has quit IRC | 15:05 | |
| *** salv-orlando has quit IRC | 15:05 | |
| *** hichihara has quit IRC | 15:05 | |
| *** Sukhdev has joined #openstack-infra | 15:06 | |
| *** armax has joined #openstack-infra | 15:06 | |
| *** mixos has joined #openstack-infra | 15:06 | |
| fungi | oh, ugh. this fallback is actually overridden directly in the openstack_project::storyboard class | 15:07 |
| *** cody-somerville has joined #openstack-infra | 15:07 | |
| fungi | and openstack_project::storyboard::dev is wrapping that entire class | 15:07 |
| fungi | this will require a bit more surgery | 15:07 |
| anteaya | oh my | 15:08 |
| *** woodster_ has joined #openstack-infra | 15:08 | |
| *** e0ne has quit IRC | 15:10 | |
| zigo | fungi: Hi there! Could you help me to figure out whats wrong here? https://review.openstack.org/#/c/315603/ | 15:11 |
| *** doug-fish has joined #openstack-infra | 15:11 | |
| zigo | fungi: The publish job fails ... | 15:11 |
| *** e0ne has joined #openstack-infra | 15:11 | |
| *** mrmartin has quit IRC | 15:11 | |
| zigo | 2016-05-13 12:05:29.223 | Archiving artifacts | 15:12 |
| zigo | 2016-05-13 12:05:38.478 | [SCP] No SCP site is configured. This is likely a configuration problem. | 15:12 |
| zigo | 2016-05-13 12:05:38.478 | Build step 'Publish artifacts to SCP Repository' changed build result to UNSTABLE | 15:12 |
| zigo | What shall I do? | 15:12 |
| zigo | SotK: ^ | 15:12 |
| *** mrmartin has joined #openstack-infra | 15:13 | |
| *** andreas_s has quit IRC | 15:13 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Promote OSA infrastructure Xenial/CentOS jobs to non-voting https://review.openstack.org/318168 | 15:17 |
| *** doug-fish has quit IRC | 15:17 | |
| *** Qiming has quit IRC | 15:17 | |
| rcarrillocruz | UNSTABLE means at times the file could not be copied | 15:17 |
| rcarrillocruz | i.e. disk full | 15:17 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Publish deb pkgs to tarballs.o.o https://review.openstack.org/318169 | 15:17 |
| jeblair | zigo: ^ that should fix it | 15:17 |
| *** Qiming has joined #openstack-infra | 15:17 | |
| fungi | rcarrillocruz: in this case the error is about a missing site for the publisher | 15:17 |
| fungi | zigo: it looks like the deb-pkgs publisher doesn't set a site | 15:17 |
| zigo | jeblair: oh, thanks ! | 15:17 |
| rcarrillocruz | ah, k | 15:17 |
| fungi | ahh, jeblair has faster fingers | 15:18 |
| zigo | fungi: Can you review his patch please? | 15:18 |
| *** claudiub has joined #openstack-infra | 15:18 | |
| zigo | It's kind of blocking ... | 15:18 |
| *** ewilson has joined #openstack-infra | 15:19 | |
| *** ewilson has quit IRC | 15:19 | |
| *** cody-somerville has quit IRC | 15:19 | |
| *** ewilson has joined #openstack-infra | 15:19 | |
| *** jistr|mtg is now known as jistr | 15:19 | |
| *** oanson has joined #openstack-infra | 15:20 | |
| *** ajmiller has joined #openstack-infra | 15:21 | |
| sdague | jeblair: how is your "replace jenkins with a python script" effort going? I so miss my in progress console :) | 15:22 |
| *** migi has joined #openstack-infra | 15:22 | |
| *** kushal has joined #openstack-infra | 15:23 | |
| jeblair | sdague: really close -- i ran a job through all the motions late yesterday; i have a couple things on the punch list still, but hope to divert some production traffic to it today for another test | 15:23 |
| sdague | awesome | 15:23 |
| *** fawadkhaliq has joined #openstack-infra | 15:23 | |
| *** fawadkhaliq has quit IRC | 15:23 | |
| *** cody-somerville has joined #openstack-infra | 15:24 | |
| *** cody-somerville has quit IRC | 15:24 | |
| *** cody-somerville has joined #openstack-infra | 15:24 | |
| fungi | zigo: when i get done fixing this storyboard puppet problem, which is very much blocking the storyboard sprint activities right now | 15:24 |
| *** ajmiller_ has joined #openstack-infra | 15:24 | |
| zigo | fungi: Ok. | 15:24 |
| *** ramishra has quit IRC | 15:24 | |
| *** dprince has quit IRC | 15:24 | |
| zigo | fungi: I'm still surprised that you guys are still working on storyboard, I though we gave that up in Tokyo... | 15:24 |
| *** rcernin has quit IRC | 15:24 | |
| *** doug-fis_ has joined #openstack-infra | 15:25 | |
| *** doug-fis_ has quit IRC | 15:25 | |
| *** njohnston__ is now known as njohnston | 15:25 | |
| fungi | a new team of developers emerged who wanted to finish building it | 15:25 |
| *** doug-fis_ has joined #openstack-infra | 15:25 | |
| zigo | Good. | 15:25 |
| fungi | sometimes when you say software is unmaintained, that's the kick needed to get users of it to step up and maintain it | 15:25 |
| zigo | fungi: So, we'll eventually get rid of launchpad? Is this still the plan? | 15:26 |
| *** shamail has joined #openstack-infra | 15:26 | |
| *** itisha has joined #openstack-infra | 15:26 | |
| fungi | getting rid of launchpad for openstack has always been the plan. the current dilemma has been between using something off-the-shelf (e.g. phabircator's maniphest) which doesn't quite fit our workflow, or give storyboard another try | 15:27 |
| *** ajmiller has quit IRC | 15:27 | |
| *** rhallisey has quit IRC | 15:27 | |
| *** ccamacho has quit IRC | 15:28 | |
| *** rhallisey has joined #openstack-infra | 15:28 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Pass storyboard cert/key paths via global manifest https://review.openstack.org/318174 | 15:30 |
| *** salv-orlando has joined #openstack-infra | 15:31 | |
| *** vincentll has quit IRC | 15:31 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-storyboard: Move cert/key paths into the cert class https://review.openstack.org/318180 | 15:32 |
| *** psachin has quit IRC | 15:32 | |
| fungi | SotK: Zara: nibalizer: anteaya: ^ those two changes i think should take care of it | 15:32 |
| openstackgerrit | Lukas Bednar proposed openstack-infra/git-review: Fix AttributeError when can not connect to Gerrit https://review.openstack.org/318181 | 15:32 |
| *** abregman is now known as abregman|afk | 15:33 | |
| *** Sukhdev has quit IRC | 15:34 | |
| anteaya | fungi: thank you | 15:34 |
| SotK | fungi: thanks! | 15:34 |
| *** fawadkhaliq has joined #openstack-infra | 15:34 | |
| Zara | :D | 15:34 |
| fungi | definitely want nibalizer's feedback on it if he's around | 15:34 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Add dib element to generate logical volumes https://review.openstack.org/252041 | 15:35 |
| nibalizer | loking | 15:36 |
| *** dmk0202 has quit IRC | 15:37 | |
| *** dmk0202 has joined #openstack-infra | 15:37 | |
| *** hashar has quit IRC | 15:37 | |
| *** ajmiller_ has quit IRC | 15:38 | |
| fungi | thanks! | 15:38 |
| *** pedroalvarez has quit IRC | 15:39 | |
| *** Hunner_ is now known as Hunner | 15:39 | |
| *** pedroalvarez has joined #openstack-infra | 15:39 | |
| fungi | it looked like the fallback was only ever half-implemented, and someone may have assumed that defaulting in a class carries through to override any class instantiated in it | 15:39 |
| *** mikelk has quit IRC | 15:40 | |
| *** abregman|afk has quit IRC | 15:41 | |
| *** salv-orlando has quit IRC | 15:41 | |
| *** ajmiller has joined #openstack-infra | 15:42 | |
| *** salv-orlando has joined #openstack-infra | 15:42 | |
| *** pedroalvarez has left #openstack-infra | 15:44 | |
| *** kushal has quit IRC | 15:47 | |
| *** ZZelle has quit IRC | 15:48 | |
| vkramskikh | krotscheck: hi, when it's planned to enable NPM mirrors? today I wrote "recheck" about a billion times :) | 15:49 |
| *** dalgaaf has quit IRC | 15:50 | |
| *** jang has quit IRC | 15:50 | |
| *** dmk0202 has quit IRC | 15:51 | |
| *** zz_dimtruck is now known as dimtruck | 15:51 | |
| *** esikachev has quit IRC | 15:51 | |
| *** ZZelle has joined #openstack-infra | 15:51 | |
| *** bpokorny has joined #openstack-infra | 15:51 | |
| *** bpokorny has quit IRC | 15:52 | |
| krotscheck | vkramskikh: They should be enabled. | 15:52 |
| krotscheck | Can you point me at a log? | 15:52 |
| *** yaume has quit IRC | 15:52 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add Sahara role to OpenStack-Ansible https://review.openstack.org/317931 | 15:53 |
| *** tonytan4ever has joined #openstack-infra | 15:53 | |
| vkramskikh | krotscheck: http://logs.openstack.org/97/318097/1/check/gate-fuel-ui-npm-run-lint/102f5dd/console.html | 15:54 |
| *** lakshmiS has joined #openstack-infra | 15:55 | |
| *** kushal has joined #openstack-infra | 15:55 | |
| *** Rockyg has joined #openstack-infra | 15:55 | |
| vkramskikh | hmm, today they fail with different error | 15:55 |
| vkramskikh | a few days ago it was "ECONNRESET", now it's "module not found" | 15:55 |
| *** Sukhdev has joined #openstack-infra | 15:55 | |
| krotscheck | vkramskikh: That's... really odd. You've got ansi-regex installed, except it claims it's not available. | 15:55 |
| * krotscheck ponders. | 15:55 | |
| * krotscheck has seen this before. | 15:56 | |
| krotscheck | I just don't remember where. | 15:56 |
| vkramskikh | example of another missing module: http://logs.openstack.org/50/317350/1/check/gate-fuel-ui-npm-run-lint/a6a0115/console.html | 15:56 |
| mtreinish | krotscheck: hmm, ok | 15:56 |
| *** bpokorny has joined #openstack-infra | 15:57 | |
| *** jamesmcarthur has joined #openstack-infra | 15:57 | |
| *** ccamacho has joined #openstack-infra | 15:57 | |
| vkramskikh | if could be related to old (non-deduped) shrinkwrap file format. i'll try to test it on this RR: https://review.openstack.org/#/c/315119/ | 15:59 |
| vkramskikh | *it | 15:59 |
| krotscheck | I'm not certain that's it, I think it may be a backport bug in the npm client. | 16:00 |
| *** Guest36459 has quit IRC | 16:00 | |
| *** jistr has quit IRC | 16:00 | |
| *** gildub has quit IRC | 16:00 | |
| *** raildo-afk is now known as raildo | 16:03 | |
| *** fbo has quit IRC | 16:04 | |
| *** ifarkas has quit IRC | 16:05 | |
| *** asettle has quit IRC | 16:05 | |
| *** hashar has joined #openstack-infra | 16:06 | |
| *** jlanoux has quit IRC | 16:06 | |
| *** fbo has joined #openstack-infra | 16:07 | |
| dstufft | woo bandersnatch 1.11 :P Welcome back to the mainline :D | 16:07 |
| fungi | what was broken in the previous one? | 16:09 |
| *** arxcruz has quit IRC | 16:10 | |
| openstackgerrit | Merged openstack-infra/system-config: Pass storyboard cert/key paths via global manifest https://review.openstack.org/318174 | 16:11 |
| anteaya | fungi: we are off to get something to eat since we are all presenting tonight, then will check back on the dev server later | 16:12 |
| *** tphummel has joined #openstack-infra | 16:12 | |
| fungi | anteaya: have a good evening! | 16:12 |
| anteaya | thank you | 16:12 |
| fungi | i'm keeping tabs on the prod and dev servers now that those latest fixes are merging | 16:12 |
| anteaya | thanks for all your help with the -dev server | 16:12 |
| anteaya | fungi: thank you | 16:12 |
| openstackgerrit | Merged openstack-infra/puppet-storyboard: Move cert/key paths into the cert class https://review.openstack.org/318180 | 16:13 |
| dstufft | fungi: AFS directory limits | 16:13 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Remove cap on oslo.db version https://review.openstack.org/318199 | 16:13 |
| fungi | anteaya: well, nibalizer did the heavy lifting, i've just been applying spit polish | 16:14 |
| fungi | dstufft: great news! | 16:14 |
| jeblair | oh yay! | 16:14 |
| anteaya | nibalizer: thanks for the heavy lifting | 16:15 |
| anteaya | fungi: thanks for the spit polish | 16:15 |
| *** anteaya has quit IRC | 16:21 | |
| *** gyee has joined #openstack-infra | 16:25 | |
| *** IlyaG has joined #openstack-infra | 16:27 | |
| *** dimtruck is now known as zz_dimtruck | 16:27 | |
| *** mrmartin has quit IRC | 16:27 | |
| zxiiro | electrofelix: any news about getting a release out? | 16:28 |
| zxiiro | electrofelix: are we waiting on any more patches? | 16:28 |
| *** Jeffrey4l has joined #openstack-infra | 16:28 | |
| *** zz_dimtruck is now known as dimtruck | 16:29 | |
| *** raildo is now known as raildo-afk | 16:30 | |
| *** raildo-afk is now known as raildo | 16:30 | |
| *** sdake_ has quit IRC | 16:31 | |
| *** Qiming has quit IRC | 16:31 | |
| *** sdake has joined #openstack-infra | 16:31 | |
| pabelanger | EmilienM: great! Glad it works | 16:33 |
| *** sridhar_ram has joined #openstack-infra | 16:33 | |
| *** lakshmiS has quit IRC | 16:33 | |
| *** lakshmiS has joined #openstack-infra | 16:33 | |
| EmilienM | pabelanger: thx for your reviews :) | 16:33 |
| zaro | morning | 16:33 |
| odyssey4me | pabelanger if you have a moment, please take a look through https://review.openstack.org/318168 | 16:34 |
| *** hashar is now known as hasharAway | 16:34 | |
| *** ddieterly is now known as ddieterly[away] | 16:34 | |
| pabelanger | odyssey4me: it is a little confusing, can you make the xenial and centos changes in different patches | 16:36 |
| *** Swami has quit IRC | 16:36 | |
| *** njohnston has quit IRC | 16:37 | |
| *** sridhar_ram has quit IRC | 16:38 | |
| *** jpr has quit IRC | 16:38 | |
| odyssey4me | pabelanger sure, can do that | 16:38 |
| fungi | Zara: SotK: nibalizer: one step closer! the cert/key paths are correct on the dev server now (without altering production), and apache service seems to be starting now. however we've for some ssl weirdness when i try to browse to it, so i'll look into that as soon as i'm done eating | 16:38 |
| krotscheck | vkramskikh: The issue is with the LTS version of npm. 3.5.2 | 16:38 |
| clarkb | just a heads up that I will be afk much of today ferrying people to and from the dentist and physical therapy. | 16:38 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Added tool to filter out bugs with specific tag https://review.openstack.org/296454 | 16:38 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Add tool that annotates bug numbers with details from LP https://review.openstack.org/296470 | 16:38 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Added tool to filter out bugs of specified importance https://review.openstack.org/296421 | 16:38 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Added tool to scan project repo for new bug fixes in master https://review.openstack.org/296420 | 16:38 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Added tool to reset backport-potential tags once backports are merged https://review.openstack.org/295993 | 16:38 |
| krotscheck | vkramskikh: There's a bugfix in 3.5.5, however it seems like that was never backported in xenial. | 16:39 |
| *** ddieterly[away] is now known as ddieterly | 16:40 | |
| fungi | krotscheck: the ubuntu devs would probably appreciate a bug report and sru requests to backport that into main or trusty-updates | 16:41 |
| krotscheck | fungi: Writing on enow. | 16:41 |
| vkramskikh | krotscheck: there are 2 succesful runs against https://review.openstack.org/#/c/315119/ i'll try to recheck a few more times, so if there are no failures, we'll just switch to the new deduped shrinkwrap format - it's compaitble with node 0.10 | 16:41 |
| fungi | krotscheck: i get the impression they're also a little more fast and loose with sru'ing packages given 16.4.1 isn't released yet | 16:42 |
| fungi | er, 16.04.1 | 16:42 |
| *** jordanP has quit IRC | 16:43 | |
| *** Apoorva has joined #openstack-infra | 16:43 | |
| *** ri0 has joined #openstack-infra | 16:44 | |
| *** amrith is now known as _amrith_ | 16:45 | |
| krotscheck | vkramskikh: That's encouraging. | 16:45 |
| krotscheck | fungi: https://bugs.launchpad.net/ubuntu/+source/npm/+bug/1583252 | 16:45 |
| openstack | Launchpad bug 1583252 in npm (Ubuntu) "npm 3.5.2 intermittently fails to install packages" [Undecided,New] | 16:46 |
| pabelanger | clarkb: already down to 34 images for nodepool | 16:46 |
| *** afred312 has joined #openstack-infra | 16:46 | |
| pabelanger | clarkb: ovh uploads where super fast now that we are using qcow2 | 16:46 |
| *** esikachev has joined #openstack-infra | 16:46 | |
| krotscheck | mtreinish: You commented in our discussion earlier, is openstack-health impacted? | 16:46 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Promote OSA infrastructure Xenial/ jobs to non-voting https://review.openstack.org/318168 | 16:47 |
| *** asettle has joined #openstack-infra | 16:47 | |
| odyssey4me | pabelanger ^ revised | 16:48 |
| *** dprince has joined #openstack-infra | 16:50 | |
| pabelanger | odyssey4me: 1 comment | 16:50 |
| krotscheck | vkramskikh: In other news, maybe you'd like to help out with js-generator-openstack? | 16:50 |
| krotscheck | :D | 16:50 |
| *** fawadkhaliq has quit IRC | 16:50 | |
| vkramskikh | krotscheck: maybe, we'll look into it shortly | 16:50 |
| *** fawadkhaliq has joined #openstack-infra | 16:51 | |
| fungi | ooh, i know that one. it uses javascript to generate openstack, right? | 16:51 |
| *** Guest37264 is now known as melwitt | 16:51 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/devstack-gate: WIP: Add some debugging code https://review.openstack.org/318227 | 16:52 |
| openstackgerrit | Merged openstack-infra/system-config: Create folder to hold the cloud launcher yaml file https://review.openstack.org/311275 | 16:52 |
| *** banix has joined #openstack-infra | 16:53 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Promote OSA infrastructure Xenial/ jobs to non-voting https://review.openstack.org/318168 | 16:53 |
| odyssey4me | pabelanger thanks fixed ^ | 16:53 |
| *** BobBall is now known as BobBall_AWOL | 16:53 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard-webclient: Renamed karma-unit.conf.js https://review.openstack.org/304562 | 16:54 |
| *** dtantsur is now known as dtantsur|afk | 16:54 | |
| *** fawadkhaliq has quit IRC | 16:55 | |
| *** jerryz has joined #openstack-infra | 16:55 | |
| *** akshai has quit IRC | 16:56 | |
| *** Swami has joined #openstack-infra | 16:56 | |
| *** Sukhdev has quit IRC | 16:57 | |
| *** nadya has joined #openstack-infra | 16:57 | |
| *** shamail has quit IRC | 16:59 | |
| *** mrmartin has joined #openstack-infra | 16:59 | |
| *** sarob has joined #openstack-infra | 17:01 | |
| *** roxanaghe has joined #openstack-infra | 17:01 | |
| *** derekh has quit IRC | 17:02 | |
| *** mriedem1 has joined #openstack-infra | 17:04 | |
| *** claudiub has quit IRC | 17:04 | |
| *** jamesmcarthur has quit IRC | 17:04 | |
| *** mriedem1 has left #openstack-infra | 17:04 | |
| *** ddieterly is now known as ddieterly[away] | 17:05 | |
| *** mriedem has quit IRC | 17:06 | |
| *** tonytan4ever has quit IRC | 17:08 | |
| *** akshai has joined #openstack-infra | 17:08 | |
| *** esikachev has quit IRC | 17:09 | |
| *** mrmartin has quit IRC | 17:10 | |
| *** daemontool has quit IRC | 17:15 | |
| *** mriedem has joined #openstack-infra | 17:16 | |
| mtreinish | krotscheck: are you talking about the error log I linked to earlier? | 17:16 |
| *** Rockyg has quit IRC | 17:17 | |
| mtreinish | krotscheck: if so, then yes that was from an openstack-health js lint job | 17:17 |
| *** shashank_hegde has joined #openstack-infra | 17:17 | |
| *** akaszuba has quit IRC | 17:17 | |
| *** nwkarsten has quit IRC | 17:18 | |
| *** markusry has quit IRC | 17:18 | |
| *** nwkarsten has joined #openstack-infra | 17:18 | |
| *** shardy has quit IRC | 17:19 | |
| openstackgerrit | Madhuri Kumari proposed openstack-infra/project-config: Add new project Higginsclient to openstack repo https://review.openstack.org/317699 | 17:21 |
| *** nwkarsten has quit IRC | 17:23 | |
| *** sridhar_ram has joined #openstack-infra | 17:26 | |
| openstackgerrit | Merged openstack-infra/project-config: Ironic-Grenade: Remove DEVSTACK_GATE_TEMPEST_REGEX='ironic' https://review.openstack.org/317766 | 17:27 |
| *** sarob has quit IRC | 17:29 | |
| openstackgerrit | Merged openstack-infra/project-config: Remove the old Ironic ramdisk jobs from master https://review.openstack.org/316655 | 17:29 |
| openstackgerrit | Merged openstack-infra/project-config: add a build job for Gerrit importer plugin https://review.openstack.org/317223 | 17:30 |
| *** _amrith_ is now known as amrith | 17:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Adds doc publishing jobs for Sphinx extension, os-api-ref https://review.openstack.org/317690 | 17:33 |
| *** sarob has joined #openstack-infra | 17:33 | |
| *** Hal1 has joined #openstack-infra | 17:34 | |
| *** trown is now known as trown|lunch | 17:36 | |
| *** rhallisey has quit IRC | 17:36 | |
| *** rhallisey has joined #openstack-infra | 17:37 | |
| *** hongbin has quit IRC | 17:37 | |
| *** electrofelix has quit IRC | 17:37 | |
| *** cody-somerville has quit IRC | 17:38 | |
| *** nwkarsten has joined #openstack-infra | 17:39 | |
| *** abregman has joined #openstack-infra | 17:40 | |
| krotscheck | mtreinish: Urrr... lemme check eavesdrop, I didn't get that link | 17:41 |
| *** sridhar_ram has quit IRC | 17:43 | |
| *** tqtran has joined #openstack-infra | 17:43 | |
| *** Na3iL has quit IRC | 17:43 | |
| *** lucasagomes is now known as lucas-dinner | 17:44 | |
| *** Jeffrey4l has quit IRC | 17:46 | |
| mtreinish | krotscheck: http://logs.openstack.org/19/311919/12/check/gate-openstack-health-npm-run-lint/12e7de3/console.html#_2016-05-18_13_55_52_412 | 17:47 |
| *** Hal1 has quit IRC | 17:47 | |
| *** javeriak has joined #openstack-infra | 17:48 | |
| krotscheck | mtreinish: yep, saw that. Already running it locally, it feels like a cold cache. | 17:48 |
| krotscheck | Going to use that patch as a guieapig | 17:48 |
| mtreinish | krotscheck: ok | 17:48 |
| openstackgerrit | Merged openstack-infra/project-config: Publish deb pkgs to tarballs.o.o https://review.openstack.org/318169 | 17:49 |
| *** dimtruck is now known as zz_dimtruck | 17:50 | |
| *** piet has joined #openstack-infra | 17:51 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Allow puppet to configure commitmessage.maxLineLength https://review.openstack.org/316175 | 17:51 |
| krotscheck | mtreinish: Yep- def a cold cache. | 17:51 |
| *** zz_dimtruck is now known as dimtruck | 17:52 | |
| *** akshai has quit IRC | 17:53 | |
| *** akshai has joined #openstack-infra | 17:53 | |
| *** pvaneck has joined #openstack-infra | 17:55 | |
| *** IlyaG has quit IRC | 17:58 | |
| *** nadya has quit IRC | 17:59 | |
| *** dtardivel has quit IRC | 18:00 | |
| *** Apoorva has quit IRC | 18:00 | |
| *** yamahata has joined #openstack-infra | 18:00 | |
| *** cody-somerville has joined #openstack-infra | 18:00 | |
| *** bpokorny has quit IRC | 18:00 | |
| zaro | fungi: looks like gerrit bit the dust again? working on upgrade to 2.11.9 now. will also ask gerrit ML to see if others are experiencing leak as well. | 18:00 |
| fungi | zaro: yeah, jhesketh restarted it overnight our time. reported symptoms sound like we finally ran out of heap space in the jvm and java garbage collection fired up in earnest, dragging down performance | 18:02 |
| fungi | so increasing available memory didn't fix anything, merely reduced the frequency of our restarts | 18:03 |
| *** bpokorny has joined #openstack-infra | 18:03 | |
| *** wendar_ is now known as wendar | 18:04 | |
| *** ddieterly[away] has quit IRC | 18:05 | |
| *** Apoorva has joined #openstack-infra | 18:05 | |
| zaro | fungi: since it's unlikely updating to 2.11.9 will fix this issue I was wondering what the odds are of upgrading 2.11.9 vs sticking with current version to get to the bottom of this problem? | 18:11 |
| *** coreyob_ has quit IRC | 18:13 | |
| *** Sukhdev has joined #openstack-infra | 18:13 | |
| *** jcoufal has quit IRC | 18:15 | |
| *** jamesmcarthur has joined #openstack-infra | 18:16 | |
| *** HeOS has joined #openstack-infra | 18:16 | |
| *** doug-fish has joined #openstack-infra | 18:16 | |
| *** doug-fish has quit IRC | 18:17 | |
| *** doug-fish has joined #openstack-infra | 18:17 | |
| *** tonytan4ever has joined #openstack-infra | 18:18 | |
| *** ihrachys has quit IRC | 18:18 | |
| *** dimtruck is now known as zz_dimtruck | 18:19 | |
| *** asselin_ has quit IRC | 18:20 | |
| *** doug-fis_ has quit IRC | 18:20 | |
| *** bpokorny has quit IRC | 18:21 | |
| *** coreyob has joined #openstack-infra | 18:22 | |
| *** rossella_s has quit IRC | 18:23 | |
| *** rossella_s has joined #openstack-infra | 18:24 | |
| *** banix has quit IRC | 18:24 | |
| *** amit213 has quit IRC | 18:24 | |
| *** asettle has quit IRC | 18:25 | |
| fungi | zaro: i don't see any reason to _avoid_ an upgrade from 2.11.4 (plus patches) to 2.11.9 (perhaps plus fewer patches?) | 18:25 |
| fungi | unless you think changes between .4 and .9 which we haven't backported might make the situation worse | 18:25 |
| fungi | part of our goal for running mainline gerrit rather than a fork was that we could safely undertake more frequent upgrades | 18:26 |
| *** amit213 has joined #openstack-infra | 18:27 | |
| *** isq has joined #openstack-infra | 18:27 | |
| *** ddieterly has joined #openstack-infra | 18:27 | |
| *** bpokorny has joined #openstack-infra | 18:28 | |
| *** denisra has quit IRC | 18:30 | |
| zaro | fungi: no, i don't see anything in the changes between .4 and .9 that would make it worse. | 18:30 |
| *** akshai has quit IRC | 18:30 | |
| *** sdake_ has joined #openstack-infra | 18:31 | |
| zaro | fungi: was just wondering where I should put more of my energy. thanks, that clears it up for me. | 18:31 |
| *** nadya has joined #openstack-infra | 18:32 | |
| *** akshai has joined #openstack-infra | 18:33 | |
| *** sdake has quit IRC | 18:33 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Loosened npm cache timeout values. https://review.openstack.org/318279 | 18:34 |
| krotscheck | infra-core: ^^ Things to make npm mirror resolution less fragile around cold AFS caches. | 18:35 |
| krotscheck | mtreinish: ^^ | 18:35 |
| *** asselin_ has joined #openstack-infra | 18:35 | |
| pabelanger | krotscheck: are we seeing issue currently? | 18:36 |
| krotscheck | pabelanger: yep. Cold caches were impacting fuel-ui and openstack-health | 18:37 |
| e0ne | fungi: hi, I still have the same problem with my job. do you know who can help me? | 18:37 |
| pabelanger | krotscheck: okay, it will take a day for the patch to land, assuming approved today. Do we need new images or can we wait for nodepool to build them? | 18:37 |
| *** cody-somerville has quit IRC | 18:38 | |
| *** kushal has quit IRC | 18:38 | |
| *** nadya has quit IRC | 18:38 | |
| krotscheck | pabelanger: I think we can wait, there aren't _that_ many projecst that use javascript, and I can manually warm up the cache when requests come in. | 18:38 |
| pabelanger | krotscheck: ack | 18:38 |
| fungi | e0ne: yeah, i don't think anyone looked into it after i got sucked into the meeting black hole yesterday. i'm going to try putting one of our jenkins masters in shutdown so i can safely restart it and see if the job registration suddenly appears in gearman | 18:39 |
| *** ri0 has quit IRC | 18:39 | |
| e0ne | fungi: sounds good. I need to head home now. I'll be available in ~2 hours | 18:39 |
| *** roxanaghe has quit IRC | 18:40 | |
| *** ri0 has joined #openstack-infra | 18:40 | |
| *** jpr has joined #openstack-infra | 18:40 | |
| kgiusti | Hi all - anyone have experience with using 'feature branches' and gerrit? | 18:42 |
| *** ri0 has quit IRC | 18:42 | |
| kgiusti | I'm trying to work on a feature branch off oslo.messaging, but whever I 'git review' gerrit uses master as the branch, not the feature branch | 18:42 |
| *** nadya has joined #openstack-infra | 18:43 | |
| kgiusti | my .gitreview file: https://paste.fedoraproject.org/368118/96608146/ | 18:43 |
| kgiusti | my .git/config: http://paste.fedoraproject.org/368121/35966561/ | 18:43 |
| kgiusti | I'm trying to work on the 'feature/amqp-dispatch-router' branch | 18:43 |
| fungi | kgiusti: you need to update the .gitreview file to set defaultbranch=feature/whatever | 18:44 |
| *** trown|lunch is now known as trown | 18:44 | |
| fungi | kgiusti: or else pass the target branch as an additional command-line parameter to git review | 18:44 |
| *** rockyg has joined #openstack-infra | 18:44 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Sync up EndpointMap in enable-tls with default enable-tls from THT https://review.openstack.org/318050 | 18:44 |
| fungi | kgiusti: see the git-review(1) manpage or online documentation at http://docs.openstack.org/infra/git-review/ | 18:45 |
| kgiusti | fungi: ah - the manpage - why didn't I do that first? | 18:45 |
| kgiusti | fungi: sorry, I'm getting lazy in my old age... :D | 18:46 |
| fungi | kgiusti: no worries. i'm also terrible about remembering to read teh instructions | 18:47 |
| *** anteaya has joined #openstack-infra | 18:47 | |
| *** sambetts is now known as sambetts|afk | 18:47 | |
| *** e0ne has quit IRC | 18:48 | |
| jesusaur | fungi: clarkb: I've been thinking about ways to test the logstash-filters project, what are your thougts on running 'puppet apply' on a trusty slave to make it look like a logstash-worker and then running "logstash --configtest" on the resulting conf.d dir? | 18:48 |
| fungi | jesusaur: sounds reasonable and stateless | 18:49 |
| kgiusti | fungi: that did it - thanks | 18:49 |
| clarkb | jesusaur: that seems like a good idea. can also run a config with file input and stdout and verify the output | 18:49 |
| *** oanson has quit IRC | 18:49 | |
| jesusaur | clarkb: yeah, but then we would need some seed data that we expect to parse correctly | 18:49 |
| jesusaur | though putting that seed data in the logstash-filters project isn't a bad idea | 18:50 |
| jesusaur | that way the project has an example of what the filters parse | 18:50 |
| *** sridhar_ram has joined #openstack-infra | 18:53 | |
| clarkb | ya, could just be a small representative sample for each of the various types. syslog, console log, oslo, apache | 18:54 |
| *** amotoki has quit IRC | 18:56 | |
| *** anteaya has quit IRC | 18:57 | |
| clarkb | fungi: did anything further come out of the rax-ord quota debugging? should we file a ticket | 18:58 |
| *** tlian has quit IRC | 18:58 | |
| fungi | clarkb: not to my knowledge, no | 18:58 |
| fungi | also the fip cleanup doesn't seem to be having any effect... do we need a nodepool restart to put it into effect? | 18:59 |
| pabelanger | fungi: still waiting for 317737 to land enabling it | 19:00 |
| clarkb | fungi: we shouldn't, I thought I had caught that in review and it was corrected (the picking up new config for it without restarting daemon) | 19:00 |
| fungi | oh, did the config not merge? | 19:01 |
| *** denisra has joined #openstack-infra | 19:01 | |
| pabelanger | Ya, failed merge last night | 19:01 |
| clarkb | that I do not know, sort of been out of it recently | 19:01 |
| pabelanger | should land in 20mins | 19:01 |
| fungi | thanks pabelanger. if i'd known i'd have enqueued it into the gate and saved us some time/nodes | 19:01 |
| pabelanger | fungi: I did promote it, but not sure why it didn't move to the head of the check queue | 19:02 |
| fungi | pabelanger: promote operates on the queue, not the pipeline | 19:02 |
| pabelanger | ah, that explains it | 19:02 |
| *** pt_15 has joined #openstack-infra | 19:03 | |
| fungi | pabelanger: so you reordered the independent queue for that single change | 19:03 |
| fungi | what you wanted was zuul enqueue | 19:03 |
| fungi | to punt it to the gate pipeline | 19:03 |
| pabelanger | right | 19:03 |
| clarkb | looks like OVH is still having failures creating instances but doesn't seem worse with qcow2 than it was with raw | 19:03 |
| pabelanger | It is better then yesterday however | 19:04 |
| pabelanger | talking to them in #ovh, they has some hardware outage | 19:04 |
| *** IlyaG has joined #openstack-infra | 19:04 | |
| pabelanger | but we never can seem to reach out limit in OVH | 19:04 |
| pabelanger | wonder if we should bump it down a few nodes | 19:05 |
| clarkb | pabelanger: aiui they have specific hardware for us sized to our flavor | 19:05 |
| *** piet has quit IRC | 19:05 | |
| clarkb | pabelanger: so if we lose hardware then our available quota goes down | 19:05 |
| *** piet has joined #openstack-infra | 19:06 | |
| pabelanger | clarkb: okay, didn't know that. | 19:06 |
| *** jamesmcarthur has quit IRC | 19:06 | |
| *** esikachev has joined #openstack-infra | 19:07 | |
| *** mrmartin has joined #openstack-infra | 19:07 | |
| *** tlian has joined #openstack-infra | 19:10 | |
| *** doug-fish has quit IRC | 19:10 | |
| *** esikachev has quit IRC | 19:11 | |
| fungi | SotK: Zara: nibalizer: `echo GET / | nc storyboard-dev.openstack.org 443` will succinctly demonstrate why browsers are erroring on https://storyboard-dev.openstack.org/ | 19:12 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Archive Ironic VM nodes console logs for 'old' https://review.openstack.org/290171 | 19:12 |
| fungi | also it looks like we don't have an http->https redirect happening on port 80 | 19:12 |
| *** banix has joined #openstack-infra | 19:12 | |
| fungi | now that i know _what's_ broken, i should be able to spot the _why_ | 19:12 |
| *** jamesmcarthur has joined #openstack-infra | 19:13 | |
| *** doug-fish has joined #openstack-infra | 19:13 | |
| *** oanson has joined #openstack-infra | 19:14 | |
| clarkb | fungi: the redirect appears to be in the vhost config | 19:14 |
| fungi | yeah, i think we're missing enabling rewrite and ssl modules | 19:15 |
| fungi | for apache | 19:15 |
| *** jamesmcarthur has quit IRC | 19:15 | |
| fungi | which would explain both those phenomena | 19:15 |
| *** Sukhdev has quit IRC | 19:16 | |
| fungi | nope, ssl is linked in mods-enabled | 19:16 |
| fungi | strangely we have proxy enabled on production and not on dev | 19:17 |
| fungi | ohhhh | 19:17 |
| fungi | i bet this is apache 2.4 messing with us | 19:17 |
| fungi | since trusty on -dev, but still precise in prod | 19:18 |
| *** jamesmcarthur has joined #openstack-infra | 19:18 | |
| *** doug-fish has quit IRC | 19:18 | |
| *** jpr has quit IRC | 19:19 | |
| *** jamesmcarthur has quit IRC | 19:19 | |
| *** piet has quit IRC | 19:21 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Add clean-floating-ips validation test https://review.openstack.org/318298 | 19:21 |
| pabelanger | fungi: clarkb: we need to land ^ | 19:21 |
| pabelanger | for clean-floating-ips | 19:21 |
| *** banix has quit IRC | 19:22 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Enable clean-floating-ips for OVH and BlueBox https://review.openstack.org/317737 | 19:22 |
| fungi | are you planning to rebase 317737 on... | 19:22 |
| fungi | nevermind! | 19:22 |
| pabelanger | fungi: Yup! | 19:22 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Remove cap on oslo.db version https://review.openstack.org/318199 | 19:23 |
| *** sdake_ has quit IRC | 19:23 | |
| *** jpr has joined #openstack-infra | 19:23 | |
| craige | o/ | 19:24 |
| *** cody-somerville has joined #openstack-infra | 19:24 | |
| *** cody-somerville has quit IRC | 19:24 | |
| *** cody-somerville has joined #openstack-infra | 19:24 | |
| *** jpr has quit IRC | 19:24 | |
| *** mrmartin has quit IRC | 19:26 | |
| fungi | clarkb: none of the above... | 19:27 |
| * fungi makes drumroll noises | 19:27 | |
| * clarkb awaits the big reveal | 19:27 | |
| *** njohnston has joined #openstack-infra | 19:27 | |
| *** piet has joined #openstack-infra | 19:27 | |
| fungi | clarkb: we're using name-based virtual hosts for both ports, and /etc/hosts lists 127.0.1.1 as the ip address for storyboard-dev.openstack.org | 19:28 |
| fungi | need to wildcard that junk | 19:28 |
| fungi | so we were hitting an ip address with no vhost applied to it | 19:28 |
| *** xarses has quit IRC | 19:29 | |
| clarkb | huh. | 19:29 |
| fungi | i temporarily updated /etc/hosts to reference the public ip addresses of the server and restarted apache and it started working fine | 19:29 |
| fungi | i'll adjust the module config | 19:30 |
| fungi | i've put it back to broken again for now | 19:30 |
| *** jamesmcarthur has joined #openstack-infra | 19:33 | |
| *** baoli_ has quit IRC | 19:34 | |
| rockyg | hey, folks. Got a listserver question for you. A thread cross-posted to dev and ops shows subset of the emails in ops that were cc'ed to ops | 19:34 |
| rockyg | dev ml: http://lists.openstack.org/pipermail/openstack-dev/2016-May/095353.html ops ml: http://lists.openstack.org/pipermail/openstack-operators/2016-May/010482.html | 19:35 |
| fungi | which, by the way, is why cross-posting should generally be avoided | 19:36 |
| *** hasharAway is now known as hashar | 19:36 | |
| *** akshai has quit IRC | 19:36 | |
| rockyg | Yeah. So, is this normal, or do we have a problem, Houston? | 19:36 |
| fungi | not everyone will follow up to both lists on reply, some participants might have only subscribed to one | 19:36 |
| fungi | or might just use reply instead of reply to all | 19:37 |
| fungi | or have considered their reply only on topic for one of the cross-posted lists | 19:37 |
| rockyg | But, dtroyer did and his email didn't turn up. Can't imagine him not having an ops ml acct | 19:37 |
| clarkb | or reply to list may only do one list | 19:37 |
| *** KaiyanSheng has joined #openstack-infra | 19:37 | |
| fungi | oh, i see. you're saying a reply that went to both lists didn't actually end up on one of them? | 19:37 |
| rockyg | right. | 19:37 |
| rockyg | unless cc's don't count in listserver world | 19:38 |
| clarkb | I see it on both fwiw | 19:38 |
| clarkb | but that may be my client being smart | 19:38 |
| openstackgerrit | Merged openstack/diskimage-builder: Add dhcp-all-interfaces.target for syncing units https://review.openstack.org/314086 | 19:39 |
| rockyg | Yeah, I'm looking at the html page of the listings. Doesn't turn up there. | 19:39 |
| * dtroyer doesn't have an account on ops ML, has too much email as it is… | 19:39 | |
| clarkb | mailman itself definitely doesn't agree with my client so likely just my client being smart | 19:39 |
| clarkb | rockyg: there you have it :) | 19:39 |
| dtroyer | I did blindly reply all to that message, not even considering it might have been a cross-post | 19:39 |
| rockyg | Thanks dtroyer, that explains that one. | 19:39 |
| rockyg | And thanks clarkb and fungi. | 19:40 |
| *** doug-fish has joined #openstack-infra | 19:40 | |
| pabelanger | clarkb: nodepool uploads done | 19:40 |
| *** cody-somerville has quit IRC | 19:40 | |
| pabelanger | pretty good time today | 19:40 |
| fungi | so anyway, the preferred solution is generally to start a discussion on only one list and send an e-mail to the other list where there might be an interested audience letting them know where the discussion is going on | 19:40 |
| fungi | or, in the case of a feedback-gathering topic, perhaps post the same message independently to both lists, but not as a cross-post | 19:41 |
| fungi | and let two separate threads develop in those two places | 19:41 |
| rockyg | Yeah, this one could work for the second option. | 19:41 |
| fungi | threads that aren't expected to generate much discussion are usually relatively safe to cross-post, but if you guess wrong you can end up with a cross-posting mess on your hands | 19:42 |
| rockyg | I hear that. That's why I tend to post the link in a new email for threads of interest to another ML | 19:43 |
| *** cody-somerville has joined #openstack-infra | 19:43 | |
| KaiyanSheng | Hi this is Kaiyan from Monasca. We are trying to get our monasca projects into openstack global requirements. Can I get some reviews on https://review.openstack.org/#/c/316293/ please? This review is to add tempest tests to non-voting check jobs for all the monasca projects. Thank you! | 19:43 |
| *** xarses has joined #openstack-infra | 19:44 | |
| *** doug-fish has quit IRC | 19:44 | |
| *** dprince has quit IRC | 19:44 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: Stop rebuilding locels on centos-7 https://review.openstack.org/318311 | 19:44 |
| *** oanson has quit IRC | 19:45 | |
| *** tphummel has quit IRC | 19:46 | |
| *** e0ne has joined #openstack-infra | 19:47 | |
| fungi | clarkb: nibalizer: SotK: Zara: so i'm trying to think through the implications of switching the VirtualHost directives in the storyboard vhost templates from <%= scope.lookupvar("storyboard::application::hostname") %> to * (rather than going to the trouble to make it a new class parameter) and the main concern is that _if_ someone is deploying this module on the same server as other websites then | 19:47 |
| fungi | we'd be making it harder. in practice i'm not sure that's likely and am tempted to just do the * hard-coding for now | 19:47 |
| clarkb | KaiyanSheng: it looks like most of those new jobs are redundant with the first one defined. The exception are the two java jobs which are redundant with each other? | 19:47 |
| *** akshai has joined #openstack-infra | 19:47 | |
| clarkb | fungi: would ::fqdn work? | 19:47 |
| clarkb | or doe sthat match hostname here? | 19:47 |
| fungi | clarkb: $::fqdn would still resolve in puppet to the server's hostname which ends up in /etc/hosts as belonging to the loopback interface | 19:48 |
| *** sdake has joined #openstack-infra | 19:48 | |
| *** IlyaG has quit IRC | 19:49 | |
| clarkb | ah ya it is the full fqdn pointing at 127.0.1.1 | 19:49 |
| *** javeriak has quit IRC | 19:49 | |
| clarkb | what sets that? unbound? | 19:49 |
| fungi | not sure | 19:49 |
| pabelanger | we seem to be having an issue in blue-box with HDD space: http://logs.openstack.org/37/317737/2/check/gate-project-config-layout/5d08f72/console.html#_2016-05-18_19_32_54_927 | 19:50 |
| pabelanger | 2nd time today I have seen that | 19:50 |
| fungi | as precedent, i cite the puppet-zuul module where we just do *:80 and *:443 in the vhost template | 19:50 |
| *** matrohon has joined #openstack-infra | 19:50 | |
| KaiyanSheng | @clarkb we want each project to run its own integration tests. We have both java version of monasca api and python version monasca api. thats why we have two tests there | 19:51 |
| clarkb | fungi: ya * would be the easy fix here | 19:51 |
| clarkb | KaiyanSheng: thats fine but you only need one job each | 19:51 |
| *** asettle has joined #openstack-infra | 19:51 | |
| clarkb | KaiyanSheng: you don't need 10 identical jobs with different names | 19:51 |
| fungi | clarkb: i'm unconvinced there's a ton of interest in parameterizing it, and it shouldn't break production storyboard | 19:51 |
| mgagne | Is there a way to tell Zuul to inject a unique identifier when a pipeline run is triggered? I'm looking for an identifier that isn't unique per job (like ZUUL_UUID) but per pipeline run. | 19:51 |
| *** shashank_hegde has quit IRC | 19:52 | |
| fungi | mgagne: zuul's change object id isn't sufficient? | 19:53 |
| * fungi can't remember if that gets reused across queues/pipelines | 19:53 | |
| mgagne | fungi: I would like the ID to be unique per pipeline run, issuing a recheck should generate a new ID | 19:53 |
| fungi | ahh, i guess we reuse the changeish id because of state caching | 19:54 |
| *** hongbin has joined #openstack-infra | 19:54 | |
| *** fawadkhaliq has joined #openstack-infra | 19:54 | |
| clarkb | mgagne: the zuul ref? | 19:54 |
| *** fawadkhaliq has quit IRC | 19:54 | |
| clarkb | that is unique and shared for all jobs belonging to a change and should be per pipeline | 19:54 |
| fungi | that will change when a dependent pipeline reorders, right? | 19:55 |
| pabelanger | guess you could do it the same way we pass OFFLINE_NODE_WHEN_COMPLETE, with some python logic | 19:55 |
| mgagne | clarkb: cool, will look into it, thanks! | 19:55 |
| clarkb | but maybe it is only per merge state? so not all rechecks will get a new one? | 19:55 |
| *** fawadkhaliq has joined #openstack-infra | 19:55 | |
| fungi | e.g., gate reset | 19:55 |
| clarkb | fungi: ya it will | 19:55 |
| *** yamamoto has quit IRC | 19:55 | |
| mgagne | pabelanger: I'm afraid this code path is per job, not per pipeline which would make it impossible to generate a per pipeline run ID. | 19:55 |
| *** jamesmcarthur has quit IRC | 19:56 | |
| *** jamesmcarthur has joined #openstack-infra | 19:57 | |
| *** jamesmcarthur has quit IRC | 19:57 | |
| mgagne | ZUUL_REF is unique per pipeline run, even after a recheck. that should do the job. thanks! | 19:57 |
| *** jamesmcarthur has joined #openstack-infra | 19:57 | |
| fungi | mgagne: but it may change over the course of the pipeline run | 19:57 |
| clarkb | right if you hvae a dependent pipeline and that pipeline evicts a failing change then all the following changes will get new refs | 19:58 |
| mgagne | fungi: how? | 19:58 |
| *** e0ne has quit IRC | 19:58 | |
| mgagne | clarkb: will jobs be running at that time? | 19:58 |
| fungi | clarkb: just expounded on my earlier comment about dependent pipeline reordering (e.g., gate resent) | 19:58 |
| mgagne | clarkb: I mean, I don't care if it changes before the jobs are run as long as it's consistent when jobs are running. | 19:58 |
| clarkb | mgagne: no zuul kills the ones using the old refs, then queues new jobs with the new refs | 19:58 |
| clarkb | mgagne: yes it iwll be consistent when jobs are running | 19:59 |
| *** doug-fish has joined #openstack-infra | 19:59 | |
| mgagne | clarkb: dead jobs are dead, they don't care about their refs anymore =) | 19:59 |
| fungi | but may belong to a state which ran only some jobs, or aborted some jobs early, or might have run no jobs at all | 19:59 |
| *** salv-orlando has quit IRC | 19:59 | |
| mgagne | but it's good to know if I ever find an edge case which I could care about | 20:00 |
| KaiyanSheng | @clarkb Thank you Clark for pointing that out. The difference between those 10 jobs are the export PROJECTS part. There are always two project names in there: one is monasca-api, the other one is the project we are testing. So you can see the difference in line 181 and line 262 in my review. | 20:00 |
| fungi | or may have run the jobs to completion, but their results were never used because a longer-running job on a change ahead of it may have failed after that | 20:00 |
| mgagne | fungi: will downstream changes/runs get this ID? | 20:01 |
| mgagne | or ref | 20:01 |
| clarkb | KaiyanSheng: ya you can address that in a couple ways, you can inject the zuul env var data that tells you what is under test or you can always test the set of projects from source install | 20:01 |
| *** sridhar_ram has quit IRC | 20:01 | |
| clarkb | KaiyanSheng: personally I would put all of the projects in the list for all runs so that depends-on works properly | 20:01 |
| fungi | mgagne: no, the ref is specific to a single change in the pipeline, but it may end up with more than one over time. if you're talking about embedding it in job logs/artifacts, you're right only the last one it uses will ever be in your reported logs | 20:02 |
| mgagne | hmm only ZUUL_CHANGES contains info from upstream changes | 20:02 |
| *** cody-somerville has quit IRC | 20:03 | |
| *** bodepd has joined #openstack-infra | 20:03 | |
| *** tphummel has joined #openstack-infra | 20:03 | |
| fungi | mgagne: so if you're looking for a unique identifier for each zuul report, then the ZUUL_REF should fit the bill | 20:03 |
| mgagne | fungi: ok, I'm looking to find a way to share artifacts between jobs. So I'm looking for a unique value that can be shared between those jobs but also between chained changes so one can use the artifact built by an other project. | 20:04 |
| fungi | (there just might also be ZUUL_REFs which never end up getting reported) | 20:04 |
| mgagne | fungi: yes until I add this 2nd requirement :P | 20:04 |
| *** e0ne has joined #openstack-infra | 20:04 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: Stop rebuilding locales on centos-7 https://review.openstack.org/318311 | 20:05 |
| *** zz_dimtruck is now known as dimtruck | 20:06 | |
| mgagne | so I see that a change has in fact 3 IDs: change ID, patch set ID, run ID. I'm missing the run ID I guess to make the rest happens. (and make it shared to downstream changes) | 20:06 |
| fungi | mgagne: might make sense to separate those two needs. the second could possibly just be met by recording lists of git refs or version numbers for the other components used in the job? | 20:06 |
| KaiyanSheng | @clarkb Ok I will make the change to put them all together in the list. Thank you! | 20:06 |
| mgagne | fungi: I would be interested in the "version" part. that's the part we are struggling with. | 20:06 |
| fungi | mgagne: how are these other "components" obtained? do they not have some sort of unique identifier? | 20:07 |
| mgagne | fungi: project name + version | 20:07 |
| fungi | (e.g. git sha, package version number, something) | 20:07 |
| *** nelsnelson has quit IRC | 20:08 | |
| *** tonytan4ever has quit IRC | 20:08 | |
| pabelanger | looks like jenkins02.o.o just fell over | 20:08 |
| mgagne | our projects aren't consumable from git directly, you need to package them first. and package version needs to be globally unique to be stored in the binary repo. | 20:08 |
| *** jpr has joined #openstack-infra | 20:08 | |
| mgagne | that's where the challenge comes from | 20:08 |
| fungi | oh, you're trying to autogenerate package revision strings? | 20:08 |
| clarkb | mgagne: ya we lost that when pbr became pep440 compliant | 20:08 |
| fungi | and that's the reason for wanting a "run number"? | 20:08 |
| fungi | build increment, whatever you want to call it | 20:09 |
| mgagne | "yessih" | 20:09 |
| *** nelsnelson has joined #openstack-infra | 20:09 | |
| mgagne | build increment was more or less the number of commits since last tag | 20:09 |
| mgagne | we can compute that just fine. issue is when you rebuild that same git sha | 20:09 |
| fungi | mgagne: perhaps use a timestamp for that? | 20:09 |
| mgagne | fungi: how can it be shared between jobs and changes? | 20:10 |
| fungi | you'd probably need the jobs to consult an index you publish somewhere they can all reach | 20:10 |
| mgagne | fungi: some sort of place where "run IDs" per change are stored? | 20:11 |
| pabelanger | #status log ran restart_jenkins_masters.yaml on jenkins02.o.o | 20:12 |
| openstackstatus | pabelanger: finished logging | 20:12 |
| mgagne | I will look into it. ZUUL_REF was a good start. I think we can start from there and with your latest suggestion | 20:12 |
| fungi | pabelanger: thanks, i should have logged that i put jenkins02 in shutdown | 20:14 |
| fungi | sorry about that | 20:14 |
| pabelanger | fungi: Opps, did I mess up something? | 20:14 |
| *** fawadkhaliq has quit IRC | 20:15 | |
| fungi | pabelanger: i'm trying to figure out how to get a missing job registration to appear in gearman | 20:15 |
| *** asettle has quit IRC | 20:15 | |
| pabelanger | fungi: Ah, okay. Sorry about that | 20:15 |
| fungi | pabelanger: i could see the xml for it on the jenkins server but it was not registered in gearman at all, so hoping that a jenkins master restart might kick that in | 20:15 |
| bodepd | I just ran into a case where jjb test depends on versions of plugins installed in jenkins. I can't test if config compiles (jenkins-job test) without connecting to a jenkins instance that has certain version of plugins installed. two questions: 1. can I stub the versions of things in pkg_resource to get around this. 2. Is this the intended design (that you | 20:16 |
| bodepd | can't test if config compiles without connecting to your desired jenkins instance?) | 20:16 |
| *** Apoorva_ has joined #openstack-infra | 20:16 | |
| fungi | bodepd: i'm pretty sure we test compiling jjb configs without running a jenkins instance to connect it to, but that may differ for certain plugins i guess? | 20:17 |
| clarkb | fungi: ya I think its a per plugin ting | 20:17 |
| bodepd | fungi: would you consider that a bug in the plugin? | 20:18 |
| fungi | we also use very, very, very few plugins (soon to be 0!) | 20:18 |
| clarkb | when a plugin makes non backward compatible changes jjb attempts to handle the old and new versions by querying jenkins for the plugin version | 20:18 |
| bodepd | It's definitely just from a plugin | 20:18 |
| clarkb | bodepd: it is definitely a bug in how jenkins deals with config | 20:18 |
| clarkb | but that won'y likely change so jjb should probably handle it better, but I don't know how it can in this case as the test outputwill differ depending on your jenkins plugin versions | 20:18 |
| fungi | bodepd: at this stage it's probably also a question for zaro, waynr, electrofelix and zxiiro as to whether or not they consider that something to try and find alternative solutions for | 20:19 |
| bodepd | yeah, it seems like you need a config file where you can stub plugin versions | 20:19 |
| bodepd | and have pkg_resource read from that | 20:19 |
| *** Apoorva has quit IRC | 20:20 | |
| *** akshai has quit IRC | 20:20 | |
| bkero | pabelanger: ping, can you take a look at wiki? I'm getting 500s and inline 'Verification of the OpenID URL failed. Error message: "Nonce already used or out of range"' errors when trying to login | 20:20 |
| fungi | bkero: did you have an account on it previously? | 20:20 |
| bkero | fungi: I think so, but I'm not sure. | 20:20 |
| fungi | that may just be the way our temporary account creation lockdown manifests in the ui | 20:21 |
| *** shashank_hegde has joined #openstack-infra | 20:21 | |
| clarkb | bodepd: or even in the jjb config ini file | 20:21 |
| bkero | fungi: I have a task to go lock/strike through all the wiki pages in the Puppet/ heading since we finished migrating over to docs.o.o. | 20:21 |
| clarkb | bodepd: maybe something like check jenkins, if no jenkins and test then fallback to configuration values in ini file | 20:21 |
| *** Apoorva_ has quit IRC | 20:21 | |
| bkero | If that's how the no-new-accounts manifests, then I can find someone else to take it | 20:21 |
| bodepd | not that big of a deal, I'll open a ticket. I just mentioned something b/c I found it surprising :) thanks! | 20:21 |
| fungi | bkero: pabelanger: we've had a few other requests for wiki accounts since the lockdown. if we expect it to be like this much longer, i'm wondering how hard it would be to temporarily reenable it for a minute here ot there when coordinating account creation with a user in irc | 20:24 |
| bkero | fungi: I'd be ++ to that. Although ironically I only need it to strike-through the contents of a page and point them towards modern docs. | 20:24 |
| bkero | fungi: it might also be possible to just create users manually in the sql db if they come here and ask. | 20:25 |
| pabelanger | fungi: we can re-enable it, see how long before spammers notice | 20:25 |
| fungi | similarly, someone working on the new "fault genes" effort is wanting a wiki account to set up a few pages | 20:25 |
| fungi | pabelanger: i'd probably start slow by just manually enabling it while the user creates their account in real time and disable again immediately when done | 20:25 |
| *** roxanaghe has joined #openstack-infra | 20:26 | |
| clarkb | can I have a wiki account? I promise I won't use it to spam >_> <_> <_< | 20:26 |
| *** akshai has joined #openstack-infra | 20:27 | |
| fungi | heh | 20:27 |
| fungi | i'd likely stick with requests from or via known community members | 20:28 |
| JayF | fungi: if you all do that, let me get my wiki account too. I have all these bottles of pills and nowhere to sell them! /s | 20:28 |
| JayF | (but seriously, would like being able to edit the wiki) | 20:28 |
| pabelanger | bkero: okay, try now | 20:29 |
| fungi | JayF: you too i guess! | 20:29 |
| *** mnencia has quit IRC | 20:29 | |
| pabelanger | bkero: puppet will revert my change in 5mins or so | 20:29 |
| bkero | haha | 20:29 |
| * bkero hurries | 20:30 | |
| fungi | i'll let dfflanders know to arrange a time when we can do this for the fault genes project person | 20:30 |
| bkero | pabelanger: success! | 20:30 |
| JayF | fungi: worked | 20:30 |
| pabelanger | bkero: great | 20:30 |
| pabelanger | will get closed off shortly | 20:30 |
| bkero | pabelanger++ fungi++ | 20:30 |
| fungi | they're in china i suspect, so may be trickier to arrange | 20:30 |
| fungi | thanks pabelanger! | 20:30 |
| pabelanger | now to see how many spammer also registered | 20:31 |
| bkero | "Welcome to OpenStack, Ben.kero! We're glad you're here." | 20:31 |
| *** mnencia has joined #openstack-infra | 20:31 | |
| bkero | Aww, thanks OpenStack. | 20:31 |
| *** eharney has quit IRC | 20:31 | |
| *** e0ne has quit IRC | 20:32 | |
| pabelanger | https://wiki.openstack.org/w/index.php?title=Special%3AListUsers&username=&group=&creationSort=1&desc=1&limit=50 | 20:32 |
| clarkb | we might be able to whitelist users? perhaps we can just have a large file with them listed? | 20:32 |
| clarkb | I don't know if that is easier than what pabelanger just did | 20:33 |
| pabelanger | we talked about have a 2nd group for users | 20:33 |
| bkero | clarkb: at the very least we could make a check to see if a user registered against something (like the cla) | 20:33 |
| pabelanger | which required an admin to move them into to post | 20:33 |
| *** e0ne has joined #openstack-infra | 20:34 | |
| JayF | pabelanger: when I ran a large wiki, usually the users would just use the username -- the fact they existed -- to spam, which appears to have happened here too from that list | 20:34 |
| mgagne | fungi: ok, my previous idea was stupid. All changes are running in parallel, can't share artifacts between changes without making them serialized =) will just have to make sure packaging steps are very fast to mitigate that limitation. | 20:35 |
| *** e0ne has quit IRC | 20:35 | |
| fungi | JayF: odd that your account doesn't show up at the top of the new users list. maybe you already had one? | 20:36 |
| JayF | fungi: yeah, that's what I saw. I think maybe just any of the pages in the past I saw issues with were locked down to a higher group or smth | 20:36 |
| JayF | fungi: strangely enough, my account create date is on my wedding anniversary. Guess I didn't take that one off. haha | 20:36 |
| *** vhosakot has quit IRC | 20:37 | |
| fungi | okay, call for help with this one... | 20:38 |
| *** ddieterly is now known as ddieterly[away] | 20:38 | |
| fungi | i'm stumped as to why gate-brick-cinderclient-ext-dsvm-functional is not showing up in gearman | 20:38 |
| clarkb | fungi: no slaves matching the label on it | 20:39 |
| clarkb | ? | 20:39 |
| *** ddieterly[away] is now known as ddieterly | 20:39 | |
| fungi | that dawned on me, but it has a nodes parameter | 20:39 |
| fungi | ohhhh | 20:39 |
| fungi | clarkb: you were very close! | 20:40 |
| fungi | i see this in /var/lib/jenkins/jobs/gate-brick-cinderclient-ext-dsvm-functional/config.xml: | 20:40 |
| fungi | <assignedNode>devstack-trusty</assignedNode> | 20:40 |
| fungi | i think that must have been a change in flight at the time we fixed up all the old devstack-trusty references | 20:40 |
| fungi | patch on the way | 20:40 |
| *** asettle has joined #openstack-infra | 20:43 | |
| *** asettle has quit IRC | 20:44 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-storyboard: Wildcard the VirtualHost directive addresses https://review.openstack.org/318331 | 20:44 |
| fungi | clarkb: nibalizer: SotK: Zara: vhost fix for storyboard-dev ^ | 20:45 |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config: Revert "Mark swarm test as non-voting in Magnum" https://review.openstack.org/265273 | 20:45 |
| clarkb | fungi: did we glean that new server in vexxhost by any chance? | 20:45 |
| clarkb | or I guess glean in rax? I think glean may set /etc/hosts that way maybe | 20:46 |
| clarkb | I can't rmember | 20:46 |
| fungi | clarkb: storyboard-dev? it's in rax-dwf because of needing trove | 20:46 |
| fungi | er, rax-dfw | 20:46 |
| clarkb | ah, then likely used rax provided image | 20:46 |
| *** asettle has joined #openstack-infra | 20:46 | |
| *** IlyaG has joined #openstack-infra | 20:47 | |
| fungi | yeah, i used the default image name chosen by launch-node.py | 20:47 |
| fungi | i didn't specify one | 20:47 |
| *** akshai has quit IRC | 20:47 | |
| fungi | interestingly, not even any ipv6 loopback entries in its /etc/hosts file | 20:48 |
| *** jordanP has joined #openstack-infra | 20:48 | |
| *** psilvad has joined #openstack-infra | 20:48 | |
| fungi | which in retrospect is sort of strange | 20:48 |
| *** raildo is now known as raildo-afk | 20:49 | |
| pabelanger | I've also noticed some wierdness with /etc/hosts using launch-node.py | 20:50 |
| *** vhosakot has joined #openstack-infra | 20:50 | |
| clarkb | launch node doesn't touch it | 20:50 |
| pabelanger | but I've only launched 1 server (centos-7 wheel) | 20:50 |
| clarkb | that is entirely up to cloud init/glean/nova agent/puppet | 20:50 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Correct brick-cinderclient-ext functional job node https://review.openstack.org/318333 | 20:50 |
| pabelanger | I thought there was an ansible playbook now | 20:50 |
| pabelanger | maybe that is run to fix the issue | 20:51 |
| clarkb | I believe that was a specific instance of a problem? | 20:51 |
| clarkb | but maybe we didn't properly fix it and I am mistaken | 20:51 |
| pabelanger | I think we used it on infracloud | 20:51 |
| *** kgiusti has left #openstack-infra | 20:51 | |
| clarkb | ya | 20:52 |
| fungi | i know we ran it to fix up hostname/mailname/hosts files on infra-cloud | 20:52 |
| fungi | but not sure where else, if anywhere | 20:52 |
| *** Zhoragh has joined #openstack-infra | 20:53 | |
| openstackgerrit | Merged openstack-infra/nodepool: Add clean-floating-ips validation test https://review.openstack.org/318298 | 20:54 |
| pabelanger | okay, we should be able to restart nodepool in about 20mins | 20:54 |
| pabelanger | then I'll recheck 317737 and enqueue | 20:54 |
| pabelanger | need to fix tox -enodepool to use zuul-cloner | 20:54 |
| *** matt6434 is now known as mattoliverau | 20:55 | |
| *** yamamoto has joined #openstack-infra | 20:56 | |
| pabelanger | brb, starting up BBQ | 20:56 |
| fungi | huh, we got another job failure with "no space left on device" in bluebox | 20:56 |
| jeblair | i'm going to run some errands now, and try to sneak some zuulv2.5 production testing in tonight | 20:59 |
| mtreinish | fungi: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22IOError%3A%5C%22%20AND%20message%3A%5C%22no%20space%20left%20on%20device%5C%22 | 21:00 |
| *** ewilson has quit IRC | 21:00 | |
| *** akshai has joined #openstack-infra | 21:00 | |
| *** esikachev has joined #openstack-infra | 21:01 | |
| fungi | mtreinish: a majority of those are tripleo jobs, so presumably something to do with their ongoing struggle for sufficient disk space on their environment | 21:02 |
| *** aysyd has quit IRC | 21:02 | |
| fungi | over the past 7 days it looks like only two hits in normal jobs, the other one in ovh-bhs1 not bluebox-sjc1 | 21:02 |
| openstackgerrit | Hongbin Lu proposed openstack-infra/irc-meetings: Add Higgins team meeting https://review.openstack.org/318335 | 21:03 |
| *** yamamoto has quit IRC | 21:03 | |
| mtreinish | fungi: I think both of those were on gate-project-config-layout jobs | 21:04 |
| *** jamesmcarthur has quit IRC | 21:04 | |
| mtreinish | fungi: does that generate a lot of disk output? Or do we have small /tmp and that's what's being used? | 21:05 |
| fungi | and seems to be during the pip install phase both times | 21:05 |
| *** esikachev has quit IRC | 21:05 | |
| *** ddieterly is now known as ddieterly[away] | 21:05 | |
| fungi | it shouldn't create much... just xml expansions of jjb configuration | 21:06 |
| fungi | it's thousands of jobs, but the file count and sizes are still pretty small (a few kb each worst case) | 21:06 |
| fungi | i wonder if something we're installing there is running away with itself | 21:07 |
| *** trown is now known as trown|outtypewww | 21:08 | |
| *** akshai_ has joined #openstack-infra | 21:08 | |
| *** ffrank has joined #openstack-infra | 21:08 | |
| *** psilvad has quit IRC | 21:09 | |
| mtreinish | fungi: hmm, it's too bad the logs don't say which of the things it's copying that caused the failure | 21:09 |
| fungi | yeah, and we're not collecting the .tox/logs | 21:10 |
| fungi | which is where i'd normally look for that detail | 21:10 |
| *** piet has quit IRC | 21:11 | |
| *** akshai has quit IRC | 21:12 | |
| *** thorst_ has quit IRC | 21:12 | |
| *** matt-borland has quit IRC | 21:12 | |
| *** Sukhdev has joined #openstack-infra | 21:12 | |
| *** banix has joined #openstack-infra | 21:13 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Use openstackclient in cinder volume examples https://review.openstack.org/317027 | 21:14 |
| fungi | stevemar: ^ addressed one of your comments there, mildly confused what you were suggesting for the other | 21:14 |
| *** ldnunes has quit IRC | 21:15 | |
| *** thorst_ has joined #openstack-infra | 21:16 | |
| *** ccamacho has quit IRC | 21:18 | |
| *** ayoung has quit IRC | 21:18 | |
| *** ayoung has joined #openstack-infra | 21:18 | |
| waynr | bodepd: it is possible to stub config versions in the jenkins-job-builder test fixtures | 21:19 |
| waynr | s/config/plugin/ | 21:19 |
| *** nadya has quit IRC | 21:19 | |
| *** thorst_ has quit IRC | 21:20 | |
| waynr | i'm looking up an example for you to follow now | 21:20 |
| *** nadya has joined #openstack-infra | 21:20 | |
| *** nadya has quit IRC | 21:20 | |
| *** nadya has joined #openstack-infra | 21:21 | |
| *** salv-orlando has joined #openstack-infra | 21:21 | |
| *** asettle has quit IRC | 21:21 | |
| *** IlyaG has quit IRC | 21:22 | |
| zigo | pabelanger: How can I check that my build actually published something on tarballs.o.o? https://review.openstack.org/#/c/315603/ | 21:22 |
| *** jamesmcarthur has joined #openstack-infra | 21:22 | |
| *** amitgandhinz has quit IRC | 21:23 | |
| zigo | pabelanger: Also, I was thinking that maybe the publish job is launch also on each patch, not just on merge, and I'm not sure how to check for this. | 21:23 |
| *** kzaitsev_mb has joined #openstack-infra | 21:23 | |
| dtroyer | M@Xbedr00m | 21:24 |
| dtroyer | or not... | 21:24 |
| * dtroyer looks for time machine | 21:24 | |
| *** nadya has quit IRC | 21:25 | |
| fungi | zigo: if this job was supposed to upload something, it didn't and i see why http://logs.openstack.org/03/315603/4/gate/pkgdeb-build-openstack-pkg-tools/76f28ba/console.html#_2016-05-18_20_04_46_595 | 21:26 |
| *** jamesmcarthur has quit IRC | 21:27 | |
| zigo | fungi: It has a folder containing what's to be uploaded. | 21:27 |
| fungi | zigo: no, wait, i don't see why upload/* failed to match anything | 21:27 |
| fungi | zigo: i missed that the rm was only for the .build file | 21:27 |
| zigo | fungi: Maybe the scp doesn't support that? | 21:27 |
| zigo | That's the build logs, yes, which we obviously already have. | 21:27 |
| zigo | There's stuff in uploads/c39d00eedf2944d4980303b771bf72a33c764c8d/* | 21:28 |
| fungi | it's possible the scp publisher doesn't support fildcards and simply expects you to use its recursive behavior by just specifying the directory | 21:28 |
| zigo | The folder c39d00eedf2944d4980303b771bf72a33c764c8d isn't being uploaded. | 21:28 |
| fungi | i'll have to look at some other examples | 21:28 |
| zigo | fungi: Should I do uploads/*/* instead? | 21:28 |
| bodepd | waynr: not sure I understand what you mean. That would just be for testing right? I could stub those and have it effect the behavior of jenkins-jobs command? | 21:29 |
| zigo | This way, it will match files, but then I'm afraid it wont create the correct folder on the destination... | 21:29 |
| fungi | zigo: we definitely seem to use wildcards in the source: line in other scp publisher macros | 21:29 |
| zigo | fungi: Yup, but to match *files*, not *folders*, no? | 21:30 |
| *** ajmiller has quit IRC | 21:30 | |
| *** ajmiller has joined #openstack-infra | 21:30 | |
| zigo | The error message says "No file(s) found", and that's correct ... | 21:30 |
| zigo | There's only a single folder there. | 21:30 |
| *** doug-fish has quit IRC | 21:30 | |
| zigo | (FYI: I was following Monty's instruction when doing this way...) | 21:30 |
| waynr | bodepd: actually i might not understand your need...are you writing a test for jenkins-job-builder? this is the use case I was thinking about but if by "testing" you mean running jenkins-jobs on your laptop (for example) to see if your configs are valid that's different | 21:31 |
| fungi | zigo: well, the scp publisher has only two options for copying. either put all copied files into a flat adjacency in the target: path, or keep the complete relative file hierarchy (keep-hierarchy: true, which you're using there) | 21:31 |
| zigo | Right, but maybe it expects to find files, still? | 21:31 |
| *** Apoorva has joined #openstack-infra | 21:31 | |
| bodepd | waynr: in this case, I just want to test that my configs are valid without having to connect to the live jenkins server | 21:31 |
| *** piet has joined #openstack-infra | 21:32 | |
| waynr | bodepd: in that case, check out the "-p" option of the "test" subcommand | 21:32 |
| *** annegentle has joined #openstack-infra | 21:32 | |
| waynr | it takes a YAML file that contains plugin info, let me see if i can find a link to documentation for the data structure format | 21:32 |
| fungi | zigo: it looks like in other scp publisher macros (for example, the devstack-logs publisher) we do "source: 'logs/**'" (double asterisk) | 21:33 |
| zigo | What does it mean? | 21:33 |
| fungi | zigo: so that may be the magic needed. add an extra * to tell it to match recursively | 21:33 |
| zigo | Oh ok. | 21:34 |
| *** thorst_ has joined #openstack-infra | 21:34 | |
| *** lakshmiS has quit IRC | 21:34 | |
| bodepd | waynr: oh cool. I see it. | 21:34 |
| zigo | Trying then. | 21:34 |
| *** ddieterly[away] is now known as ddieterly | 21:34 | |
| bodepd | waynr: I totally missed that. thanks! | 21:34 |
| zigo | fungi: How about the fact that the job is done on each patch, rather than on the merge only? | 21:34 |
| *** matrohon has quit IRC | 21:34 | |
| zigo | fungi: How should I fix it? | 21:34 |
| *** rockyg has quit IRC | 21:35 | |
| fungi | zigo: as an aside, if the goal of this job is to publish durable copies of packages when changes merge to that repo, we should be running that in the post pipeline not the check or gate pipeline. in check and gate you should test that it can build (and maybe upload the result to logs.openstack.org) but the post job should be the only one uploading to tarballs.openstack.org | 21:35 |
| waynr | bodepd: the plugins info yaml file should look something like https://git.openstack.org/cgit/openstack-infra/jenkins-job-builder/tree/tests/cmd/fixtures/plugins-info.yaml | 21:35 |
| Shrews | pabelanger: jeblair: i don't suppose either of you have developed tools to trigger nodepool events via gearman messages, have you? I could do it myself, but hoping one of you can save me some time. | 21:35 |
| zigo | fungi: Where do I write the post job? | 21:35 |
| waynr | the jjb documentation doesn't actually mention this option though, sadly | 21:35 |
| zigo | fungi: In jenkins/jobs/deb-openstack-pkg-tools.yaml still? | 21:36 |
| zigo | fungi: Oh, in zuul/layout.yamlzuul/layout.yaml, right? | 21:36 |
| fungi | zigo: i'll take a stab at it, just a sec | 21:36 |
| pabelanger | infra-root: I've restarted nodepool to pick up 318298 | 21:36 |
| zigo | After gate:, I would write post: with the name of the job, no? | 21:36 |
| *** esikachev has joined #openstack-infra | 21:37 | |
| fungi | zigo: right, but we need two slightly different versions of the job so that we validate package building works in check and gate but actually build it again and that time upload the resulting package in post | 21:37 |
| waynr | bodepd: you can see valid plugins-info data structure looking at <HOSTNAME>/pluginManager/api/json?depth=1&pretty=1 | 21:37 |
| *** thorst_ has quit IRC | 21:38 | |
| *** matrohon has joined #openstack-infra | 21:38 | |
| pabelanger | Shrews: jeblair has review 264910 open. Which created jobs in nodepool | 21:38 |
| *** jpr has quit IRC | 21:38 | |
| *** earlephilhower has joined #openstack-infra | 21:39 | |
| pabelanger | Shrews: but for my testing, I have a local nodepool / zuul system running locally and connect into review.o.o, then listen to the openstack-dev/sandbox. More complicated but works well for me | 21:39 |
| Shrews | pabelanger: yeah, a bit more complex than i need to try and hunt down this fip leak, but i'll look at that review | 21:39 |
| *** esikachev has quit IRC | 21:41 | |
| Shrews | i think i found what i need, actually | 21:42 |
| *** esikachev has joined #openstack-infra | 21:42 | |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Publish build files correctly on merge https://review.openstack.org/318347 | 21:43 |
| zigo | fungi: Does this looks right? | 21:43 |
| *** sridhar_ram has joined #openstack-infra | 21:43 | |
| zigo | look | 21:43 |
| fungi | i have a version almost done, but looking | 21:44 |
| zigo | Oh... | 21:44 |
| zigo | Yours must be better, of course. | 21:44 |
| fungi | not necessarily! if yours is close, i'll just leave notes | 21:45 |
| fungi | wow, you even used the same name i did for the post job ;) | 21:45 |
| zigo | :) | 21:46 |
| *** cloudtrainme has quit IRC | 21:46 | |
| *** mixos has quit IRC | 21:46 | |
| fungi | what you have there looks basically identical to mine. there was one optional thing i was adding in my version which was to have a second publisher macro for the build job which put upload files onto logs.openstack.org so you could manually inspect them for proposed patches, but that can always be added later | 21:47 |
| *** burgerk_ has joined #openstack-infra | 21:49 | |
| zigo | fungi: I expect contributors to have a working build environment locally on their work machine, so I don't think that's necessary. | 21:49 |
| *** _ari_ has quit IRC | 21:50 | |
| zigo | But why not ... | 21:50 |
| zigo | Maybe a good idea. | 21:50 |
| fungi | well, as i said, thought for later. not necessary now for sure | 21:50 |
| *** jordanP has quit IRC | 21:50 | |
| fungi | i'm +2 on your patch as is | 21:50 |
| *** markvoelker has joined #openstack-infra | 21:51 | |
| *** burgerk has quit IRC | 21:52 | |
| *** weshay has quit IRC | 21:52 | |
| *** mjblack- has joined #openstack-infra | 21:52 | |
| zigo | fungi: I'm thinking, maybe it'd be nice to, instead of just publishing a few .deb files, to actually prepare a Debian repo with the built packages, so that it could be used for testing. | 21:52 |
| *** hashar has quit IRC | 21:52 | |
| zigo | (ie: piuparts and such) | 21:52 |
| *** markvoelker has quit IRC | 21:52 | |
| *** markvoelker has joined #openstack-infra | 21:53 | |
| fungi | yep, there's a ton of flexibility there | 21:53 |
| *** mcarden_ is now known as mcarden | 21:53 | |
| pabelanger | fungi: looks like growroot might not be working on ubuntu-precise | 21:54 |
| fungi | scary | 21:54 |
| fungi | but that could certainly explain the no space left on device errors | 21:54 |
| fungi | mtreinish: ^ logic! | 21:54 |
| fungi | also would explain why our layout job is the only one hitting it | 21:55 |
| pabelanger | fungi: ianw: here is the output of growroot: http://paste.openstack.org/show/497608/ | 21:55 |
| *** gtop-323 has quit IRC | 21:55 | |
| zigo | pabelanger: What may not work could be the online resize of the partition, depending on the FS and the kernel version. | 21:55 |
| zigo | pabelanger: growroot itself should be working. | 21:55 |
| zigo | pabelanger: What kind of FS do you run? Ext3 or ext4 ? | 21:55 |
| zigo | XFS ? | 21:55 |
| pabelanger | ext4 | 21:56 |
| zigo | pabelanger: Bingo then! :) | 21:56 |
| zigo | pabelanger: I can't remember the exact kernel version needed, but for sure, the precise kernel doesn't support online resize. | 21:56 |
| zigo | (with ext4) | 21:56 |
| fungi | too-old kernel on precise to have support for growing ext4? | 21:56 |
| fungi | aha | 21:56 |
| pabelanger | I guess | 21:56 |
| zigo | fungi: *online* resize (ie: resize when you have read access) | 21:57 |
| pabelanger | I though I checked the FS | 21:57 |
| *** matrohon has quit IRC | 21:57 | |
| pabelanger | when I first launched it | 21:57 |
| fungi | i wonder if the rax-provided images we were using had ext3 as their root filesystem | 21:57 |
| zigo | pabelanger: If you switch to ext3, it should work, AFAIR. | 21:57 |
| *** bhunter71 has joined #openstack-infra | 21:57 | |
| bodepd | waynr: does exactly what I was looking for. thanks! | 21:57 |
| clarkb | we can tell dib to use ext3 | 21:57 |
| *** piet has quit IRC | 21:57 | |
| zigo | The Debian official image was using ext3 until this week because of this reason. | 21:57 |
| pabelanger | clarkb: okay, let me look into that | 21:58 |
| clarkb | this is one of the huge benefits to using dib that I think the trove people overlooked when wanting to just use the existing cloud images | 21:59 |
| clarkb | with dib you can control your filesystems which lsat I checked is actually useful for databses | 21:59 |
| *** bpokorny_ has joined #openstack-infra | 22:00 | |
| zigo | pabelanger: Also, what you want to use with precise, is cloud-initramfs-growroot, so that the partition resizing is done *very* early, before the kernel even attempts to read it for the first time. | 22:00 |
| zigo | pabelanger: Do you use that? | 22:01 |
| clarkb | pabelanger: looks like lib/img-defaults sets FS_TYPE to default to ext4, I would expect that adding FS_TYPE: ext3 would fix this in the nodepool.yaml | 22:01 |
| *** thiagop has quit IRC | 22:01 | |
| clarkb | zigo: iirc no because it is broken | 22:02 |
| clarkb | or was broken at one time | 22:02 |
| zigo | clarkb: There's unfortunately no other way in Precise. | 22:02 |
| clarkb | it depends on cloud-init or something silly which causes the rest of the build to blow up | 22:02 |
| zigo | clarkb: As much as I can tell, it worked well in Debian. | 22:02 |
| zigo | Oh... | 22:03 |
| pabelanger | clarkb: looks like FS_TYPE=ext3 is the setting? | 22:03 |
| clarkb | protip cloud init is not actually required to resize your fs | 22:03 |
| clarkb | pabelanger: ya | 22:03 |
| *** mriedem has quit IRC | 22:03 | |
| zigo | clarkb: If you don't use cloud-initramfs-growroot, it's going to fail in Precise, I'm almost sure (with the kind of output Paul just gave: the kernel can't re-read the partition table). | 22:04 |
| *** bpokorny has quit IRC | 22:04 | |
| clarkb | zigo: thats possible, I am just explaining why cloud-initramfs-growroot is not used. It is broken | 22:04 |
| zigo | I don't see why it would depend on cloud-init. | 22:04 |
| *** julim has quit IRC | 22:04 | |
| clarkb | I don't recall all the details though. They should be captured in dib's git log history | 22:05 |
| zigo | clarkb: It depends on cloud-utils, initramfs-tools and util-linux, not on cloud-init. | 22:05 |
| zigo | Ok. | 22:05 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Switch ubuntu-precise to ext3 https://review.openstack.org/318353 | 22:05 |
| pabelanger | zigo: clarkb: fungi: I _think_ that is correct ^ | 22:06 |
| *** esikachev has quit IRC | 22:06 | |
| clarkb | worth a shot | 22:06 |
| openstackgerrit | Merged openstack-infra/puppet-storyboard: Wildcard the VirtualHost directive addresses https://review.openstack.org/318331 | 22:07 |
| ianw | ext4 isn't exactly cutting edge ... do we think it's a precise problem? | 22:10 |
| clarkb | ianw: yes according to zigo its kernel can't do it | 22:11 |
| mtreinish | fungi: oh, that would do it | 22:11 |
| ianw | ahh. well worth a try, though i bet that dib flag does not get much testing | 22:12 |
| pabelanger | We can also purge /opt/git for precise too | 22:14 |
| pabelanger | don't use a lot of things for our 2 tests | 22:14 |
| *** anteaya has joined #openstack-infra | 22:14 | |
| *** vhosakot has quit IRC | 22:15 | |
| *** Zhoragh has quit IRC | 22:16 | |
| *** aeng has joined #openstack-infra | 22:16 | |
| zigo | clarkb: ianw: http://www.phoronix.com/scan.php?page=news_item&px=MTA0MDg <--- On-line ext4 resize is supported as of kernel 3.3, precise has 3.2. | 22:17 |
| clarkb | zigo: ty | 22:17 |
| *** HeOS has quit IRC | 22:17 | |
| zigo | clarkb: My pleasure. In return, get this one merged? https://review.openstack.org/#/c/318347/ :) | 22:19 |
| *** nadya has joined #openstack-infra | 22:21 | |
| *** harlowja has quit IRC | 22:22 | |
| *** rossella_s has quit IRC | 22:23 | |
| *** rossella_s has joined #openstack-infra | 22:24 | |
| *** gordc has quit IRC | 22:25 | |
| *** nadya has quit IRC | 22:26 | |
| *** annegentle has quit IRC | 22:28 | |
| *** rhallisey has quit IRC | 22:29 | |
| ianw | heh, someone just posted this to the internal chat list -> linus introducting 1.0 : https://www.youtube.com/watch?v=qaDpjlFpbfo | 22:29 |
| ianw | at least we've moved on a bit from that | 22:29 |
| *** itisha has quit IRC | 22:29 | |
| *** roxanaghe has quit IRC | 22:31 | |
| *** mjblack has quit IRC | 22:32 | |
| *** mjblack- is now known as mjblack | 22:32 | |
| *** edmondsw has quit IRC | 22:32 | |
| *** earlephilhower has quit IRC | 22:33 | |
| *** bpokorny_ has quit IRC | 22:33 | |
| *** cloudtrainme has joined #openstack-infra | 22:33 | |
| *** roxanaghe has joined #openstack-infra | 22:34 | |
| jhesketh | Morning | 22:36 |
| openstackgerrit | Merged openstack-infra/project-config: Enable clean-floating-ips for OVH and BlueBox https://review.openstack.org/317737 | 22:36 |
| *** cloudtrainme has quit IRC | 22:36 | |
| *** ddieterly is now known as ddieterly[away] | 22:41 | |
| *** pradk has quit IRC | 22:41 | |
| *** rhochmuth has quit IRC | 22:42 | |
| asselin_ | dstufft, any issues going on with this package? 2016-05-18 22:42:49,973 INFO: Syncing package: wotlk (serial 2122468) | 22:45 |
| asselin_ | 2016-05-18 22:42:49,974 DEBUG: Getting /pypi/wotlk/json (serial 2122468) | 22:45 |
| asselin_ | bandersnatch is getting stuck on it | 22:45 |
| dstufft | asselin_: is there an error? | 22:45 |
| asselin_ | no...just stuck on it | 22:45 |
| *** pt_15 has quit IRC | 22:46 | |
| dstufft | asselin_: strange, I'm not aware of any problems | 22:46 |
| asselin_ | strace is showing these: futex(0x294bbf0, FUTEX_WAIT_PRIVATE, 0, NULL) = -1 EAGAIN (Resource temporarily unavailable) | 22:46 |
| asselin_ | seems to be looping forever on it | 22:47 |
| *** tpsilva has quit IRC | 22:47 | |
| fungi | nibalizer: SotK: Zara: anteaya: better late than never. https://review.openstack.org/318331 seems to have done the trick. you should be able to go to https://storyboard-dev.openstack.org/ and take it for a spin now (just need to accept the snakeoil cert on it) | 22:47 |
| openstackgerrit | John L. Villalovos proposed openstack-infra/irc-meetings: Add helper to find full slots https://review.openstack.org/317809 | 22:48 |
| fungi | and no production servers were harmed in the making of this mess | 22:48 |
| anteaya | fungi: wooooo | 22:48 |
| anteaya | fungi: thank you thank you thank you | 22:48 |
| *** kzaitsev_mb has quit IRC | 22:48 | |
| *** IlyaG has joined #openstack-infra | 22:49 | |
| anteaya | fungi: yay the production servers are safe | 22:49 |
| fungi | and now i return you to our regularly scheduled programming ;) | 22:49 |
| anteaya | jhesketh: hey there | 22:49 |
| anteaya | fungi: I am watching a movie | 22:49 |
| asselin_ | dstufft, here's my current 'todo' if that helps: http://paste.openstack.org/show/497618/ | 22:49 |
| fungi | anteaya: perfect. i will probably go do the same in a bit | 22:49 |
| anteaya | fungi: sounds like a good idea, thanks so much | 22:49 |
| openstackgerrit | John L. Villalovos proposed openstack-infra/irc-meetings: Add helper to find full slots https://review.openstack.org/317809 | 22:50 |
| asselin_ | dstufft, full log output to stuck job: http://paste.openstack.org/show/497620/ | 22:50 |
| dstufft | asselin_: https://bitbucket.org/pypa/bandersnatch/src/bfc1bb85c3673572db65f72d4ee27efcbe8a9848/CHANGES.txt?fileviewer=file-view-default#CHANGES.txt-14 wonder if that | 22:51 |
| *** tphummel has quit IRC | 22:51 | |
| *** rbrndt has quit IRC | 22:51 | |
| openstackgerrit | Merged openstack-infra/project-config: Publish build files correctly on merge https://review.openstack.org/318347 | 22:51 |
| asselin_ | yeah...maybe | 22:51 |
| pabelanger | fungi: clarkb: mordred: getting an exception with cleanupLeakedFloaters() http://paste.openstack.org/show/497622/ | 22:52 |
| *** nwkarsten has quit IRC | 22:52 | |
| *** kzaitsev_mb has joined #openstack-infra | 22:53 | |
| fungi | that looks like a bug | 22:53 |
| pabelanger | indeed | 22:53 |
| pabelanger | trying to see what the dict looks like | 22:53 |
| fungi | if you mean the one it tried to pass, it has it there in the traceback | 22:54 |
| fungi | or at least has the line of it where it's passing in id=ip['id'] | 22:54 |
| fungi | presumably the argument to delete_floating_ip() is named something else? | 22:55 |
| openstackgerrit | Fei Long Wang proposed openstack-infra/project-config: Add new project python-distilclient https://review.openstack.org/318367 | 22:55 |
| *** bpokorny has joined #openstack-infra | 22:55 | |
| pabelanger | fungi: Yup, I see the issue | 22:56 |
| fungi | would likely be a good idea to exercise that codepath in a test somewhere too | 22:56 |
| openstackgerrit | Merged openstack-infra/project-config: Switch ubuntu-precise to ext3 https://review.openstack.org/318353 | 22:56 |
| pabelanger | indeed, that is what I am looking for now | 22:57 |
| *** yamahata has quit IRC | 22:58 | |
| *** kzaitsev_mb has quit IRC | 22:58 | |
| *** akshai_ has quit IRC | 22:58 | |
| *** jaosorior has quit IRC | 22:58 | |
| *** jaosorior has joined #openstack-infra | 22:59 | |
| *** harlowja has joined #openstack-infra | 23:00 | |
| *** anteaya has quit IRC | 23:01 | |
| openstackgerrit | David Lyle proposed openstack-infra/project-config: Update horizon dsvm tempest job https://review.openstack.org/314795 | 23:02 |
| *** rhochmuth has joined #openstack-infra | 23:02 | |
| *** rhochmuth has quit IRC | 23:02 | |
| *** ams_ has quit IRC | 23:03 | |
| *** rhochmuth has joined #openstack-infra | 23:03 | |
| *** rhochmuth has quit IRC | 23:04 | |
| *** jamielennox is now known as jamielennox|away | 23:04 | |
| *** ddieterly[away] is now known as ddieterly | 23:05 | |
| *** kaisers has quit IRC | 23:05 | |
| *** rhochmuth has joined #openstack-infra | 23:05 | |
| *** markvoelker_ has joined #openstack-infra | 23:05 | |
| *** markvoelker_ has quit IRC | 23:05 | |
| *** markvoelker_ has joined #openstack-infra | 23:06 | |
| *** kaisers has joined #openstack-infra | 23:07 | |
| *** markvoelker has quit IRC | 23:09 | |
| *** kzaitsev_mb has joined #openstack-infra | 23:10 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/irc-meetings: Add helper to find full slots https://review.openstack.org/317809 | 23:10 |
| *** salv-orl_ has joined #openstack-infra | 23:10 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/devstack-gate: DO NOT REVIEW: This is for verifying CI with local.conf https://review.openstack.org/243545 | 23:11 |
| *** ddieterly has quit IRC | 23:12 | |
| *** sarob has quit IRC | 23:12 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/shade: Rework delete_unattached_floating_ips function https://review.openstack.org/318369 | 23:12 |
| pabelanger | fungi: it was mocked out, but mocked wrong ^ | 23:13 |
| bkero | pabelanger: ANy clue about this? "The action you have requested is limited to users in the group: Users. " | 23:13 |
| bkero | (context: trying to make a wiki edit to Puppet/CI) | 23:13 |
| pabelanger | Shrews: Thoughts on review above ^ | 23:13 |
| pabelanger | bkero: did you fill out captcha? | 23:13 |
| *** salv-orlando has quit IRC | 23:13 | |
| bkero | I didn't see a captcha | 23:14 |
| pabelanger | look at top | 23:14 |
| bkero | Don't see a captcha at the top of 'edit' or 'edit denied' page | 23:14 |
| pabelanger | hmm | 23:14 |
| *** sdague has quit IRC | 23:14 | |
| pabelanger | bkero: you able to edit https://wiki.openstack.org/w/index.php?title=User:Ben.kero&action=edit&redlink=1 | 23:16 |
| bkero | pabelanger: "There is currently no text in this page. You can search for this page title in other pages, or search the related logs, but you do not have permission to create this page." | 23:16 |
| pabelanger | logged in? | 23:16 |
| openstackgerrit | Paul Belanger proposed openstack-infra/shade: Rework delete_unattached_floating_ips function https://review.openstack.org/318369 | 23:17 |
| bkero | ah, it logged me out | 23:18 |
| * bkero tries again | 23:18 | |
| *** dingyichen has joined #openstack-infra | 23:18 | |
| *** jamesmcarthur has joined #openstack-infra | 23:18 | |
| bkero | that worked | 23:18 |
| *** xyang1 has quit IRC | 23:19 | |
| bkero | pabelanger: yeah, works now. Thanks. | 23:19 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Revert "Enable clean-floating-ips for OVH and BlueBox" https://review.openstack.org/318370 | 23:20 |
| pabelanger | fungi: clarkb: revert of clean-floating-ips until shade is fixed | 23:20 |
| *** jamesmcarthur has quit IRC | 23:23 | |
| *** amitgandhinz has joined #openstack-infra | 23:24 | |
| *** ewilson has joined #openstack-infra | 23:24 | |
| *** hongbin has quit IRC | 23:24 | |
| Shrews | pabelanger: oh, geez | 23:25 |
| pabelanger | Shrews: indeed | 23:25 |
| Shrews | pabelanger: i don't even know when that method got in | 23:25 |
| pabelanger | Shrews: Ya, going to see how to do functional testing with it | 23:26 |
| *** kzaitsev_mb has quit IRC | 23:26 | |
| pabelanger | cause it is b0rked atm | 23:26 |
| Shrews | pabelanger: i think what we actually want to do is introduce wait/timeout to delete_floating_ip | 23:28 |
| clarkb | pabelanger: I say self approve I cany currently review it myself | 23:28 |
| *** amitgandhinz has quit IRC | 23:28 | |
| Shrews | pabelanger: i'll take a closer look in the morning. a bit late in the evening for me to dig too deep | 23:29 |
| Shrews | pabelanger: but, i think there may be some code in nodepool that might use that method. might want to take a quick grep through it | 23:29 |
| Shrews | that might be what led you there, though | 23:30 |
| *** kzaitsev_mb has joined #openstack-infra | 23:30 | |
| *** Qiming has joined #openstack-infra | 23:32 | |
| *** sridhar_ram1 has joined #openstack-infra | 23:33 | |
| *** sridhar_ram has quit IRC | 23:33 | |
| fungi | Shrews: yep, we're calling it from nodepool, just turned on the configuration to be able to try it out | 23:34 |
| fungi | which is how pabelanger found the bug | 23:34 |
| pabelanger | Shrews: sure, we can dive into it tomorrow | 23:35 |
| fungi | i'm pretty sure that method was added entirely so that we could clean up leaked fips from nodepool | 23:35 |
| pabelanger | we're going to revert | 23:35 |
| fungi | i already approved the config revert a few minutes ago | 23:36 |
| notmorgan | oh shade needs fixing :( | 23:36 |
| notmorgan | ugh | 23:36 |
| *** kzaitsev_mb has quit IRC | 23:37 | |
| fungi | notmorgan: unsurprising that nodepool is good at finding shade bugs, since shade basically started as code we ripped out of nodepool | 23:37 |
| *** vhosakot has joined #openstack-infra | 23:37 | |
| pabelanger | yar | 23:38 |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Enable clean-floating-ips for OVH and BlueBox" https://review.openstack.org/318370 | 23:38 |
| pabelanger | okay, ubuntu-precise is currently building with ext3 | 23:38 |
| pabelanger | I'll check back in a bit to see what happend | 23:38 |
| pabelanger | then do a quick test on the cloud to see if it fixes growroot | 23:38 |
| *** kzaitsev_mb has joined #openstack-infra | 23:38 | |
| *** KaiyanSheng has quit IRC | 23:39 | |
| *** rhochmuth has quit IRC | 23:40 | |
| *** nelsnels_ has joined #openstack-infra | 23:41 | |
| *** Sukhdev has quit IRC | 23:42 | |
| *** nelsnelson has quit IRC | 23:43 | |
| openstackgerrit | Tin Lam proposed openstack-infra/project-config: Add releasenotes jobs for networking-midonet https://review.openstack.org/318380 | 23:44 |
| *** mjblack- has joined #openstack-infra | 23:45 | |
| *** IlyaG has quit IRC | 23:45 | |
| *** salv-orl_ has quit IRC | 23:46 | |
| *** kzaitsev_mb has quit IRC | 23:47 | |
| *** kzaitsev_mb has joined #openstack-infra | 23:47 | |
| *** Sukhdev has joined #openstack-infra | 23:48 | |
| *** mjblack- has quit IRC | 23:48 | |
| *** mjblack- has joined #openstack-infra | 23:48 | |
| *** mjblack- has quit IRC | 23:49 | |
| *** Swami has quit IRC | 23:49 | |
| *** mjblack- has joined #openstack-infra | 23:50 | |
| *** jamielennox|away is now known as jamielennox | 23:51 | |
| *** zqfan has quit IRC | 23:53 | |
| *** markvoelker has joined #openstack-infra | 23:53 | |
| *** kzaitsev_mb has quit IRC | 23:54 | |
| *** doug-fish has joined #openstack-infra | 23:54 | |
| *** roxanaghe has quit IRC | 23:54 | |
| *** mjblack- has quit IRC | 23:55 | |
| *** mjblack- has joined #openstack-infra | 23:56 | |
| *** ewilson has quit IRC | 23:56 | |
| *** markvoelker_ has quit IRC | 23:56 | |
| *** mjblack has quit IRC | 23:57 | |
| *** mjblack- is now known as mjblack | 23:57 | |
| *** lakshmiS has joined #openstack-infra | 23:57 | |
| *** doug-fish has quit IRC | 23:58 | |
| notmorgan | fungi: hehehe | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!