crinkle | greghaynes: yes | 00:00 |
---|---|---|
greghaynes | crinkle: the setup was eth2 -> eth2.25 -> br-vlan25 -> vetha -> vethb, we feed vethb to neutron. | 00:00 |
greghaynes | crinkle: To make the pair its ip link add vetha type veth peer name vethb; brctl add br-vlan25 vetha | 00:01 |
crinkle | greghaynes: I have ip link add veth1 type veth peer name veth2; brctl addif br-vlan25 veth1 | 00:01 |
greghaynes | yea, that | 00:01 |
crinkle | ha | 00:01 |
greghaynes | then you have to ip link set dev veth* up | 00:01 |
crinkle | ya | 00:01 |
greghaynes | and you should be good to go | 00:01 |
dims_ | thanks mordred for the https://review.openstack.org/#/c/224259/ - if anyone else with requirements karma please help as well, will unblock horizon (as it unblocks django_openstack_auth) | 00:02 |
*** nijaba has joined #openstack-infra | 00:02 | |
*** nijaba has joined #openstack-infra | 00:02 | |
mordred | greghaynes, Shrews: I sent a quick email to the ansible-devel mailing list warning people that there is a specific set of things they can do to trigger this and how to work around it | 00:03 |
*** nijaba_ has quit IRC | 00:03 | |
mordred | (tl;dr - just use auth_url intead of auth-url in your playbook, or just use a named cloud in clouds.yaml) | 00:03 |
*** Sukhdev has quit IRC | 00:04 | |
*** thinrichs has joined #openstack-infra | 00:04 | |
*** markvoelker has joined #openstack-infra | 00:06 | |
*** aysyd has quit IRC | 00:07 | |
mordred | clarkb: we could catch keystoneauth1.exceptions.auth_plugins.MissingRequiredOptions and raise one that does the substitution we're wanting | 00:08 |
mordred | also | 00:08 |
mordred | ok. I'm going to sleep now. for realz | 00:08 |
greghaynes | mordred: sure. we believe you. | 00:08 |
*** cloudtrainme has joined #openstack-infra | 00:08 | |
* mordred has to get up in 4 hours to go give a keynote | 00:08 | |
mordred | MAYBE should have gone to bed a while ago :) | 00:09 |
*** Sukhdev has joined #openstack-infra | 00:10 | |
clarkb | good night looks like nodepool is on its way to working | 00:10 |
clarkb | so I will just have to approve that if we can get a +2 from someone else | 00:10 |
clarkb | jeblair: ^ | 00:10 |
greghaynes | ugh, so that race needs to get tracked down | 00:10 |
*** thinrichs has left #openstack-infra | 00:10 | |
*** mdbooth has quit IRC | 00:10 | |
clarkb | greghaynes: ya | 00:11 |
*** pfalleno1 has quit IRC | 00:11 | |
*** stevemar has joined #openstack-infra | 00:11 | |
*** markvoelker has quit IRC | 00:11 | |
clarkb | so one problem with the dsvm test is its going to ping keystoneauth to probably the previous version? how old is that release? | 00:12 |
clarkb | its close enough of a test I suppose since unittests will do the right things | 00:12 |
*** yamamoto has joined #openstack-infra | 00:13 | |
*** stevemar has quit IRC | 00:15 | |
*** devlaps has quit IRC | 00:15 | |
*** mdbooth has joined #openstack-infra | 00:16 | |
*** glauco has joined #openstack-infra | 00:18 | |
*** tsekiyama has quit IRC | 00:20 | |
*** mtanino has quit IRC | 00:20 | |
*** lawrancejing has quit IRC | 00:22 | |
*** glauco has quit IRC | 00:22 | |
*** Sukhdev has quit IRC | 00:23 | |
*** rlandy has quit IRC | 00:23 | |
*** dingyichen has joined #openstack-infra | 00:23 | |
*** shashank_hegde has quit IRC | 00:27 | |
greghaynes | mordred: https://review.openstack.org/#/c/224368/ | 00:27 |
greghaynes | crinkle: is working for you? | 00:28 |
sridhar_ram | clarkb: a question, perhaps noob one, on the devstack-gate (after browsing entries in projects.yaml). We currently have 'tox -e functional' to run the tests. Just wondering, is it guaranteed only this cmd will be invoked in the gate ? | 00:29 |
clarkb | well a lot more is done to setup devstack | 00:30 |
clarkb | can you expand on what you need or expect? | 00:31 |
*** achanda_ has quit IRC | 00:31 | |
*** achanda has joined #openstack-infra | 00:33 | |
sridhar_ram | our need is fairly simple.. stack up devstack with our enable_plugin, cd /opt/stack/tacker, run 'tox -e functional' .. that's it | 00:35 |
sridhar_ram | clarkb: also, I gather first we add the jobs to experimental queue before switching to the gate queue ? | 00:37 |
*** achanda has quit IRC | 00:38 | |
ianw | sridhar_ram : that seems like it would be fine done with gate hooks; many examples to follow | 00:39 |
ianw | sridhar_ram: experimental maybe, non-voting probably; depends on the project & what they want | 00:39 |
claudiub | hello, is there any infra person that can add me as a core for the os-win project that was just approved? https://review.openstack.org/#/c/209204/ | 00:40 |
ianw | sridhar_ram: but obviously committing a voting test that doesn't work kind of wedges you making forward progress | 00:40 |
*** abitha has quit IRC | 00:41 | |
*** abitha has joined #openstack-infra | 00:42 | |
sridhar_ram | ianw: I, perhaps naively, took 'experimental' as the way to run things that wouldn't block merges on test failure ... at least initially | 00:42 |
sridhar_ram | I see pipeline: experimental .. now which attr control voting vs non-voting ? | 00:43 |
clarkb | greghaynes nodepool fix isnt a fix | 00:44 |
greghaynes | clarkb: oh? | 00:44 |
greghaynes | clatkb: I linked oscc fix | 00:44 |
greghaynes | clarkb: that is another option | 00:44 |
clarkb | ya see the dsvm job | 00:45 |
clarkb | I'm guessing 'auth' is important because oscc looks in 'auth' | 00:45 |
clarkb | greghaynes link? | 00:45 |
greghaynes | https://review.openstack.org/#/c/224368/ | 00:45 |
greghaynes | clarkb: yea, I was just pushing the believe button on not needing that sub dict | 00:46 |
kun_huang | guys, anyone knows could PTL update gerrit label for his own project? | 00:46 |
clarkb | greghaynes should we do thst for all dicts? | 00:46 |
greghaynes | clarkb: seems like either wait to merge that and release or we need to do our own munging in nodepool | 00:46 |
*** otter768 has joined #openstack-infra | 00:46 | |
greghaynes | clarkb: all? | 00:46 |
greghaynes | clarkb: theres only one sub dict AFAIK | 00:46 |
*** abitha has quit IRC | 00:46 | |
*** yamamoto has quit IRC | 00:47 | |
clarkb | untio we add another | 00:47 |
greghaynes | clarkb: youre saying type introspect instead of if == auth? | 00:47 |
clarkb | kun_huang code review labels? can you explain what you would like to achieve? | 00:47 |
clarkb | greghaynes ya | 00:47 |
ianw | sridhar_ram: experimental must be manually triggered "check experimental", while non-voting jobs are run always | 00:47 |
greghaynes | clarkb: yea, thats fair, one sec | 00:47 |
*** sigmavirus24 is now known as sigmavirus24_awa | 00:48 | |
*** dimtruck is now known as zz_dimtruck | 00:48 | |
kun_huang | clarkb: yep, like code-review -> vote | 00:48 |
clarkb | kun_huang some projects have non default setups, what would you like to do? | 00:48 |
kun_huang | just want to know could PTL do it himself clarkb | 00:49 |
greghaynes | clarkb: updated | 00:49 |
*** zz_dimtruck is now known as dimtruck | 00:49 | |
clarkb | no, you have to submut a change to your project acls byt tryibg to understand what you would like to do | 00:50 |
sridhar_ram | ianw: that helps! I'm tempted to go w/ non-voting gate jobs... something that gets run w/ every PS. the core team can manually honor them until we build confidence on the tests | 00:50 |
*** lawrancejing has joined #openstack-infra | 00:50 | |
kun_huang | clarkb: okay got it | 00:50 |
kun_huang | clarkb: thanks :) | 00:50 |
*** otter768 has quit IRC | 00:51 | |
clarkb | greghaynes use auth-url in your test not auth_url | 00:52 |
greghaynes | clarkb: hah | 00:53 |
greghaynes | clarkb: I did test the real thing, I just reworked the test afterwards ;) | 00:53 |
*** ozamiatin has joined #openstack-infra | 00:56 | |
*** pvaneck has quit IRC | 00:56 | |
*** tiswanso has joined #openstack-infra | 00:57 | |
*** tiswanso has quit IRC | 00:58 | |
*** tiswanso has joined #openstack-infra | 00:58 | |
kevinbenton | hi all, gate-grenade-dsvm-neutron is dying with this | 00:58 |
kevinbenton | http://logs.openstack.org/37/224337/4/check/gate-grenade-dsvm-neutron/d0d019a/logs/grenade.sh.txt.gz#_2015-09-17_00_51_25_124 | 00:58 |
*** kun_huang has left #openstack-infra | 00:58 | |
kevinbenton | blocking all neutron patches at least | 00:58 |
sridhar_ram | ianw: clarkb: for now I'll go with a gate-functional-dsvm-tacker job w/ voting: false in zuul/layout.yaml | 00:59 |
*** tiswanso_ has joined #openstack-infra | 00:59 | |
*** dims_ has quit IRC | 01:01 | |
*** tiswanso has quit IRC | 01:02 | |
*** gildub has quit IRC | 01:02 | |
openstackgerrit | Merged openstack-infra/irc-meetings: Change Horizon Drivers meeting ID https://review.openstack.org/224267 | 01:03 |
greghaynes | clarkb: ok, we got one +2 on https://review.openstack.org/#/c/224368/ | 01:03 |
greghaynes | clarkb: just need to hunt down another core and release | 01:03 |
*** hdd has quit IRC | 01:03 | |
*** gildub has joined #openstack-infra | 01:03 | |
*** dimtruck is now known as zz_dimtruck | 01:04 | |
*** plaqky17 has quit IRC | 01:05 | |
*** bharathm has quit IRC | 01:05 | |
*** geoffarn_ is now known as geoffarnoldX | 01:05 | |
ruagair | thanks jeblair. Yes I am ready for a storyboard db dump. Perhaps jhesketh can help out, as he's timezone friendly. | 01:06 |
*** markvoelker has joined #openstack-infra | 01:06 | |
*** Daisy has joined #openstack-infra | 01:07 | |
ianw | clarkb: i think i know what's going on -- did you account for centos' "iptables-services" package? | 01:07 |
clarkb | ianw yes | 01:07 |
clarkb | ianw its in params.pp | 01:07 |
clarkb | iptables is the puppet namvar but shouldnt be the package name | 01:08 |
clarkb | but maybe its broken | 01:08 |
ianw | clarkb: ok, have to dig a bit, because i think maybe that's the issue | 01:08 |
ianw | "systemctl enable missing-service" seems to give "access denied", rather than something helpful like "not around" | 01:08 |
*** pfallenop has joined #openstack-infra | 01:08 | |
clarkb | ianw it did work with my daenon reload thing though | 01:09 |
ianw | hmmm, this is a PITA. my vm, that was failing with it the other dya, seems to have stopped replicating it | 01:10 |
ianw | let me do the dance to bring up a hpcloud node and see | 01:10 |
*** Daisy has quit IRC | 01:11 | |
*** alexsyip has quit IRC | 01:14 | |
*** shashank_hegde has joined #openstack-infra | 01:22 | |
*** achanda has joined #openstack-infra | 01:22 | |
clarkb | greghaynes I dont have oscc core oyherwise I would approve | 01:26 |
*** dims_ has joined #openstack-infra | 01:26 | |
clarkb | I guess we wait and dont restart nodepool :/ | 01:26 |
tonyb | fungi: thanks for following up I got to the bottom of it. | 01:26 |
greghaynes | clarkb: yea | 01:26 |
*** larainema has quit IRC | 01:27 | |
*** yamahata has quit IRC | 01:27 | |
*** larainema has joined #openstack-infra | 01:27 | |
*** larainema has quit IRC | 01:28 | |
*** EricGonczer_ has joined #openstack-infra | 01:29 | |
*** larainema has joined #openstack-infra | 01:29 | |
*** larainema has quit IRC | 01:30 | |
*** larainema has joined #openstack-infra | 01:31 | |
*** zhenguo has joined #openstack-infra | 01:31 | |
*** fitoduarte has quit IRC | 01:33 | |
*** thorst has quit IRC | 01:33 | |
*** yolanda has quit IRC | 01:36 | |
*** sridhar_ram has quit IRC | 01:36 | |
*** FallenPegasus is now known as MarkAtwood | 01:39 | |
*** xyang1 has quit IRC | 01:39 | |
*** achanda has quit IRC | 01:41 | |
*** ozamiatin has quit IRC | 01:44 | |
*** shashank_hegde has quit IRC | 01:45 | |
*** lawrance_ has joined #openstack-infra | 01:46 | |
*** chlong has joined #openstack-infra | 01:47 | |
*** Zhongjun has quit IRC | 01:47 | |
*** ashleigh has quit IRC | 01:47 | |
*** lawrancejing has quit IRC | 01:49 | |
*** edmondsw has quit IRC | 01:52 | |
*** chlong_ has joined #openstack-infra | 01:53 | |
*** dingyichen has quit IRC | 01:55 | |
*** dingyichen has joined #openstack-infra | 01:56 | |
*** larainema has quit IRC | 01:57 | |
*** larainema has joined #openstack-infra | 01:58 | |
*** bpokorny has quit IRC | 01:58 | |
*** MarkAtwood has quit IRC | 01:59 | |
*** gildub has quit IRC | 02:00 | |
*** jerryz has quit IRC | 02:01 | |
*** r-daneel has quit IRC | 02:02 | |
*** ybathia has quit IRC | 02:04 | |
*** EricGonczer_ has quit IRC | 02:10 | |
*** unicell has quit IRC | 02:11 | |
*** stevemar has joined #openstack-infra | 02:12 | |
*** zeih has joined #openstack-infra | 02:14 | |
*** rick-chen has joined #openstack-infra | 02:16 | |
*** stevemar has quit IRC | 02:16 | |
*** salv-orlando has joined #openstack-infra | 02:18 | |
*** yamahata has joined #openstack-infra | 02:18 | |
*** zeih has quit IRC | 02:18 | |
*** yamamoto has joined #openstack-infra | 02:19 | |
*** zz_dimtruck is now known as dimtruck | 02:19 | |
rick-chen | Does anyone know how to trace CI result unable to post on the git review window? | 02:20 |
*** r1chardj0n3s has joined #openstack-infra | 02:23 | |
*** salv-orlando has quit IRC | 02:23 | |
r1chardj0n3s | lifeless: we're still seeing devstack fail in django-openstack-auth after your fix https://review.openstack.org/#/c/222478/ | 02:24 |
*** EricGonczer_ has joined #openstack-infra | 02:24 | |
*** ddieterly has joined #openstack-infra | 02:25 | |
*** kengo_sakai has joined #openstack-infra | 02:28 | |
*** yamamoto has quit IRC | 02:29 | |
*** EricGonczer_ has quit IRC | 02:30 | |
*** rlandy has joined #openstack-infra | 02:30 | |
*** david-lyle has joined #openstack-infra | 02:34 | |
*** ddieterl_ has joined #openstack-infra | 02:35 | |
*** ddieterly has quit IRC | 02:35 | |
*** hdd has joined #openstack-infra | 02:36 | |
jhesketh | ruagair: not at the moment I'm not ;-) | 02:39 |
*** achanda has joined #openstack-infra | 02:41 | |
ruagair | ah, so sneaky :-D | 02:41 |
ruagair | Then I'll make is a general call for someone who has root to grab me a dump of storyboard so I can test the phabricator import :-D | 02:42 |
*** huanxie has joined #openstack-infra | 02:43 | |
*** harlowja_at_home has joined #openstack-infra | 02:43 | |
*** gildub has joined #openstack-infra | 02:45 | |
*** achanda has quit IRC | 02:45 | |
*** otter768 has joined #openstack-infra | 02:47 | |
*** earlephilhower has quit IRC | 02:47 | |
*** chlong_ has quit IRC | 02:50 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul/layout: puppet openstack updates https://review.openstack.org/224397 | 02:51 |
EmilienM | crinkle: ^ | 02:52 |
*** otter768 has quit IRC | 02:52 | |
EmilienM | mordred: have you tried to run compute tests against cloudwatt ? | 02:52 |
ianw | clarkb: ok, new theory. i think updating the selinux rules first might be the solution. the daemon-reload doesn't seeem tow work, as we've noticed | 02:56 |
*** dpaterson has quit IRC | 03:03 | |
*** achanda has joined #openstack-infra | 03:03 | |
clarkb | ianw I think the package needs to reload | 03:06 |
clarkb | we get a new unit file and until the reload happens systemd has no idea | 03:06 |
*** MarkAtwood has joined #openstack-infra | 03:07 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul/layout: puppet openstack updates https://review.openstack.org/224397 | 03:09 |
ianw | clarkb: the thing is, the iptables-services should be doing that, from the spec file | 03:10 |
EmilienM | hello, I know if anyone could review zuul/layout change for puppet: https://review.openstack.org/#/c/224397/ - thanks and good night/day | 03:10 |
*** btully has quit IRC | 03:11 | |
StevenK | pleia2: I'm rebuilding my pretend proposal slave, then I'm going to dig into the glossary fun and games | 03:13 |
pleia2 | StevenK: thank you, I got tired | 03:14 |
*** yamamoto has joined #openstack-infra | 03:15 | |
*** coolsvap is now known as coolsvap|holiday | 03:17 | |
*** Shrews has quit IRC | 03:19 | |
*** Shrews has joined #openstack-infra | 03:19 | |
*** glauco has joined #openstack-infra | 03:19 | |
ianw | clarkb: actually, what happens is the .spec file calls "systemctl preset iptables" which is the same as "enable" which handles the equivalent of the reload (http://www.freedesktop.org/software/systemd/man/systemctl.html) | 03:20 |
*** r1chardj0n3s has quit IRC | 03:20 | |
*** r1chardj0n3s has joined #openstack-infra | 03:21 | |
*** jyuso1 has joined #openstack-infra | 03:22 | |
*** purp has quit IRC | 03:22 | |
*** purp has joined #openstack-infra | 03:22 | |
*** glauco has quit IRC | 03:24 | |
*** geoffarnoldX is now known as geoffarn_ | 03:26 | |
openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Add job for the ovs mechanism driver with native mode https://review.openstack.org/221143 | 03:28 |
clarkb | the man page just says its the same as enable or disable | 03:28 |
clarkb | I dont see where it does a reload | 03:28 |
clarkb | enable != reload | 03:29 |
*** cloudtrainme has quit IRC | 03:29 | |
ianw | clarkb: under "enable" -> "After the symlinks have been created, the systemd configuration is reloaded (in a way that is equivalent to daemon-reload) to ensure the changes are taken into account immediately." | 03:29 |
*** bpokorny has joined #openstack-infra | 03:30 | |
ianw | it has to work, because that's how the generic rpm macro does it, which works for everything else | 03:30 |
clarkb | my experinece is that is not sufficient on centos7 | 03:30 |
*** mrmartin has joined #openstack-infra | 03:30 | |
clarkb | I had to manually reload all the things | 03:30 |
clarkb | enable would conplain that the service is unknown, reload then I could enable | 03:31 |
clarkb | but maybe thats the selinux issue? | 03:31 |
ianw | clarkb: https://github.com/systemd/systemd/blob/master/src/core/macros.systemd.in#L39 <- systemd_post macro , which is what every package calls | 03:31 |
*** tlian has quit IRC | 03:32 | |
ianw | so iptables-services installs itself, then calls systemd_post macro (systemctl preset iptables), which fails due to the selinux error | 03:32 |
ianw | that actually gets hidden by rpm, i guess that script doesn't run with "-e" | 03:33 |
clarkb | is selinux problem related to the symlinking? | 03:33 |
ianw | but then we notice when we do "systemctl enable iptables" | 03:33 |
*** claudiub has quit IRC | 03:33 | |
clarkb | hrm must not he because explicit reload later works | 03:34 |
ianw | clarkb: i am wondering about the split of iptables/iptables-services and if that affects things | 03:34 |
clarkb | which implies symlinks are rhere | 03:34 |
ianw | why a reload of systemd *after* iptables is installed i'm not 100% sure, yet | 03:34 |
clarkb | oh is it presetting iptables-services? | 03:34 |
clarkb | but service name is actually iptables? | 03:34 |
*** achanda has quit IRC | 03:35 | |
*** achanda has joined #openstack-infra | 03:35 | |
*** harlowja_at_home has quit IRC | 03:35 | |
ianw | %postun services | 03:35 |
ianw | /sbin/ldconfig | 03:35 |
ianw | %systemd_postun_with_restart iptables.service ip6tables.service | 03:35 |
ianw | no | 03:35 |
clarkb | I dont know what %{?*} evaluates to | 03:36 |
ianw | you can also see that from the avc denial in https://bugzilla.redhat.com/show_bug.cgi?id=1261747 | 03:36 |
openstack | bugzilla.redhat.com bug 1261747 in systemd "Upgrade of systemd leaves service enablement failing with selinux error" [Unspecified,New] - Assigned to systemd-maint | 03:36 |
ianw | ^ that's the wrong paste above (postun), but yeah, it specifies the names correctly | 03:37 |
clarkb | I see, so the scontext is unconfined but it wants it to be system_u | 03:37 |
clarkb | I wobder if yum needs to be part of the init context | 03:38 |
clarkb | would be good to see if other packages fail this way too | 03:38 |
clarkb | but I dont know enough about yum/rpm to know if that is really a good way to approach that | 03:39 |
*** tlian has joined #openstack-infra | 03:40 | |
ianw | i feel like it might be a bug in the selinux targeted policy that is maybe fixed, but i can't pinpoint it yet | 03:40 |
clarkb | or maybe systemctl needs to never inherit context and have a rule for very specific needs? | 03:40 |
*** olaph has quit IRC | 03:41 | |
clarkb | ianw maybe fixed? because rax is ok? | 03:41 |
*** ivar-laz_ has joined #openstack-infra | 03:41 | |
ianw | clarkb: maybe, because it might have a higher version | 03:41 |
ianw | the fix might be upgrade selinux-policy , restart systemd , install iptables-services as usual | 03:42 |
*** rlandy has quit IRC | 03:43 | |
*** ivar-lazzaro has quit IRC | 03:44 | |
*** vmbrasseur is now known as vmbrasseur_BIAB | 03:44 | |
*** vmbrasse- is now known as vmbrasseur | 03:44 | |
*** geoffarn_ has quit IRC | 03:44 | |
*** ivar-laz_ has quit IRC | 03:45 | |
*** boris-42 has quit IRC | 03:50 | |
*** sdake_ has joined #openstack-infra | 03:51 | |
*** boris-42 has joined #openstack-infra | 03:51 | |
greghaynes | clarkb: ok, merged. Now we just need a release... | 03:51 |
clarkb | greghaynes :/ its time to sleep not make releases | 03:52 |
greghaynes | clarkb: for NA, yes | 03:52 |
clarkb | maybe mordred will wake in a few hours | 03:52 |
greghaynes | yea | 03:53 |
*** harlowja_at_home has joined #openstack-infra | 03:53 | |
*** sdake has quit IRC | 03:54 | |
rm_work | anyone know why this might happen? | 03:55 |
rm_work | 2015-09-17 01:11:00.440 | + git fetch http://zm03.openstack.org/p/openstack-infra/devstack-gate refs/zuul/master/Za8018611f6f441aaa4e2dbb328a07c3c | 03:55 |
rm_work | 2015-09-17 01:11:00.673 | fatal: Couldn't find remote ref refs/zuul/master/Za8018611f6f441aaa4e2dbb328a07c3c | 03:55 |
rm_work | in devstack setup | 03:55 |
rm_work | http://logs.openstack.org/65/223265/9/check/gate-grenade-dsvm-neutron/2ef176b/logs/devstack-gate-setup-workspace-new.txt.gz | 03:55 |
rm_work | and http://logs.openstack.org/45/224345/2/check/gate-grenade-dsvm-neutron/bdf49f2/logs/devstack-gate-setup-workspace-new.txt.gz | 03:56 |
rm_work | both | 03:56 |
rm_work | not sure why that would be a thing | 03:56 |
*** hdd has quit IRC | 03:58 | |
ianw | i think that's an expected failure | 03:58 |
rm_work | erm | 03:58 |
rm_work | hmm | 03:58 |
ianw | uselessly, i can't remember why | 03:58 |
rm_work | ok so maybe not the problem | 03:59 |
anteaya | jeblair: http://23.253.49.144/ looks good and about the look I got as far as css | 03:59 |
* rm_work keeps looking | 03:59 | |
anteaya | jeblair: doing the rest by hand for this round sounds reasonable to me | 03:59 |
rm_work | oh i guess for a grenade test i look in grenade.sh | 03:59 |
rm_work | hmm | 03:59 |
rm_work | ok looks like 2015-09-17 01:21:39.403 | pkg_resources.ContextualVersionConflict: (Babel 2.0 (/usr/local/lib/python2.7/dist-packages), Requirement.parse('Babel<=1.3,>=1.3'), set(['oslo.utils'])) | 03:59 |
rm_work | part of keystone? | 04:00 |
rm_work | during 2015-09-17 01:21:39.146 | + /usr/local/bin/keystone-manage db_sync | 04:00 |
*** ddieterl_ has quit IRC | 04:00 | |
rm_work | sorry, debugging out loud | 04:00 |
greghaynes | mordred: Youre probably keynoting right now, but when you return we could use a new release of oscc :) | 04:02 |
rm_work | is it that someone merged a requirements update and someone didn't yet? | 04:03 |
rm_work | could that cause the pkg_resources.ContextualVersionConflict issue? | 04:03 |
*** unicell has joined #openstack-infra | 04:03 | |
*** yamahata has quit IRC | 04:03 | |
*** unicell has quit IRC | 04:03 | |
*** unicell has joined #openstack-infra | 04:03 | |
*** geoffarnold has joined #openstack-infra | 04:04 | |
greghaynes | rm_work: That says there is Babel 2.0 installed but Babel 1.3 is specified in requirements | 04:08 |
*** tiswanso_ has quit IRC | 04:10 | |
Nakato | rm_work: Looks like keystonemiddleware that is being installed gets olso.utils 1.4.1 which requires "Babel<=1.3,>=1.3" and 2.0 has been installed already by keystonemiddleware 1.5.2. | 04:11 |
*** larainema has quit IRC | 04:11 | |
greghaynes | Yerp | 04:12 |
*** stevemar has joined #openstack-infra | 04:12 | |
rm_work | hm | 04:13 |
rm_work | awesome | 04:14 |
*** fawadkhaliq has joined #openstack-infra | 04:15 | |
*** zeih has joined #openstack-infra | 04:15 | |
tonyb | rm_work: let me have a look at that, it could be my fault .... | 04:15 |
*** chlong has quit IRC | 04:16 | |
*** stevemar has quit IRC | 04:16 | |
tonyb | rm_work: what's the review url? | 04:16 |
*** hdd has joined #openstack-infra | 04:16 | |
*** reed_ has joined #openstack-infra | 04:16 | |
*** reed_ has quit IRC | 04:18 | |
*** zeih has quit IRC | 04:19 | |
rm_work | https://review.openstack.org/#/c/224345/2 is one | 04:19 |
rm_work | i just rebased the review below it, maybe it randomly will fix itself? :P | 04:19 |
rm_work | wouldn't that be nice | 04:19 |
*** harlowja_at_home has quit IRC | 04:19 | |
greghaynes | we rebase before running tests and fail if we cant, so unlikely | 04:20 |
rm_work | ah :/ | 04:20 |
rm_work | TIL | 04:20 |
*** olaph has joined #openstack-infra | 04:21 | |
Nakato | Fairly widespread http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwicGtnX3Jlc291cmNlcy5Db250ZXh0dWFsVmVyc2lvbkNvbmZsaWN0OiAoQmFiZWwgMi4wICgvdXNyL2xvY2FsL2xpYi9weXRob24yLjcvZGlzdC1wYWNrYWdlcyksIFJlcXVpcmVtZW50LnBhcnNlKCdCYWJlbDw9MS4zLD49MS4zJyksIHNldChbJ29zbG8udXRpbHMnXSkpXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjQzMjAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQ0MjQ2MzY2ODM4MX0= | 04:21 |
rm_work | nice tool | 04:22 |
*** stevemar has joined #openstack-infra | 04:23 | |
greghaynes | this sort of thing usually happens if we need to pin something in our stable branch | 04:24 |
greghaynes | only half here so cant fully debug though | 04:24 |
*** amotoki has joined #openstack-infra | 04:25 | |
tonyb | rm_work: No I think it'm my fault oslo.utils for juno came out about 4 hours ago. too much of a coincidence | 04:25 |
rm_work | hmm k | 04:26 |
StevenK | pleia2: Still around? | 04:26 |
greghaynes | yea, so that sounds like the typical case where this happens | 04:26 |
Nakato | tonyb: You just tagged 1.4.1 if I'm seing right. Which switched requirements.txt from Babel>=1.3 to Babel<=1.3,>=1.3. So it looks like that might be it. | 04:26 |
tonyb | Nakato: correct. | 04:27 |
*** larainema has joined #openstack-infra | 04:27 | |
lifeless | r1chardj0n3s: my fix? | 04:31 |
lifeless | r1chardj0n3s: https://review.openstack.org/#/c/224259/ is the fix | 04:31 |
lifeless | r1chardj0n3s: and as you can see it hasn't landed yt | 04:31 |
*** unicell1 has joined #openstack-infra | 04:32 | |
r1chardj0n3s | oh, that's weird, someone said it had merged, and for some reason when I looked at it I thought it had. sorry, braino | 04:32 |
lifeless | r1chardj0n3s: de nada | 04:33 |
*** chlong has joined #openstack-infra | 04:33 | |
*** unicell has quit IRC | 04:33 | |
tonyb | Gah so oslo utils was supposed to the for juno only and it's being used in kilo and hence the big bang | 04:37 |
*** dims_ has quit IRC | 04:38 | |
*** achanda has quit IRC | 04:39 | |
tonyb | So I think the quick fix is the blacklist 1.4.1 from kilo and then qorkout how to fix the overlapping ranges. | 04:41 |
*** fedexo has joined #openstack-infra | 04:42 | |
*** dims_ has joined #openstack-infra | 04:43 | |
*** bpokorny has quit IRC | 04:44 | |
*** dims_ has quit IRC | 04:44 | |
*** pcrews has quit IRC | 04:46 | |
*** sdake has joined #openstack-infra | 04:46 | |
*** bpokorny has joined #openstack-infra | 04:46 | |
*** chlong has quit IRC | 04:48 | |
*** bpokorny has quit IRC | 04:48 | |
*** sdake_ has quit IRC | 04:49 | |
*** salv-orlando has joined #openstack-infra | 04:50 | |
*** ivar-lazzaro has joined #openstack-infra | 04:50 | |
*** unicell1 has quit IRC | 04:51 | |
*** unicell has joined #openstack-infra | 04:51 | |
*** lawrance_ has quit IRC | 04:53 | |
*** MarkAtwood has quit IRC | 04:56 | |
rm_work | ok cool, so there exists a solution :) | 04:56 |
*** pcrews has joined #openstack-infra | 04:56 | |
*** salv-orlando has quit IRC | 04:57 | |
*** nadya has joined #openstack-infra | 04:57 | |
*** unicell has quit IRC | 04:58 | |
*** yfried_ has quit IRC | 04:58 | |
*** nadya has quit IRC | 04:59 | |
*** rkukura_ has joined #openstack-infra | 04:59 | |
tonyb | rm_work: Umm yeah, I wish it were a quicker solution. | 04:59 |
*** rkukura has quit IRC | 05:00 | |
*** rkukura_ is now known as rkukura | 05:00 | |
*** ivar-lazzaro has quit IRC | 05:00 | |
*** ddieterly has joined #openstack-infra | 05:01 | |
*** ivar-lazzaro has joined #openstack-infra | 05:01 | |
*** nadya has joined #openstack-infra | 05:02 | |
*** dimtruck is now known as zz_dimtruck | 05:03 | |
*** MarkAtwood has joined #openstack-infra | 05:07 | |
openstackgerrit | Tony Breeds proposed openstack-infra/elastic-recheck: Add signatire for 1496678 https://review.openstack.org/224425 | 05:08 |
*** nadya has quit IRC | 05:09 | |
*** btully has joined #openstack-infra | 05:12 | |
*** hdd has quit IRC | 05:19 | |
*** achanda has joined #openstack-infra | 05:20 | |
*** hrou has quit IRC | 05:20 | |
*** unicell has joined #openstack-infra | 05:28 | |
openstackgerrit | Tony Breeds proposed openstack/requirements: Ban oslo.utils 1.4.1 from kilo https://review.openstack.org/224429 | 05:28 |
*** stevemar has quit IRC | 05:28 | |
*** stevemar has joined #openstack-infra | 05:29 | |
*** geoffarnold is now known as geoffarnoldX | 05:29 | |
mordred | greghaynes, clarkb: occ released | 05:35 |
*** rick-chen has quit IRC | 05:36 | |
openstackgerrit | Timo Tijhof proposed openstack-infra/zuul: Pass change and pipeline to the status_url https://review.openstack.org/86900 | 05:39 |
*** fedexo has quit IRC | 05:42 | |
*** hdd has joined #openstack-infra | 05:44 | |
greghaynes | mordred: awesome, ty | 05:44 |
openstackgerrit | Timo Tijhof proposed openstack-infra/zuul: Pass change and pipeline to the status_url https://review.openstack.org/86900 | 05:44 |
*** dims_ has joined #openstack-infra | 05:45 | |
openstackgerrit | Timo Tijhof proposed openstack-infra/zuul: Pass change and pipeline to the status_url https://review.openstack.org/86900 | 05:45 |
*** zeih has joined #openstack-infra | 05:45 | |
*** hdd has quit IRC | 05:47 | |
mordred | greghaynes: thanks for th epatch! | 05:47 |
openstackgerrit | Ian Wienand proposed openstack-infra/system-config: Systemd+selinux vs iptables on centos7, round 2 https://review.openstack.org/224433 | 05:50 |
*** zeih has quit IRC | 05:50 | |
ianw | clarkb: ^ for later. hopefully we can pinpoint a cause in the rhbz, but my testing shows this works. I *think* with the old change I had inadvertently run a daemon reload after the iptables install, convincing myself it worked when it didn't | 05:52 |
*** ivar-lazzaro has quit IRC | 05:52 | |
*** dims_ has quit IRC | 05:53 | |
*** ivar-lazzaro has joined #openstack-infra | 05:53 | |
*** Sukhdev has joined #openstack-infra | 05:54 | |
*** cloudtrainme has joined #openstack-infra | 05:54 | |
*** cloudtrainme has quit IRC | 05:54 | |
*** cloudtrainme has joined #openstack-infra | 05:55 | |
*** che-arne has joined #openstack-infra | 05:56 | |
*** asettle has quit IRC | 05:57 | |
*** bexelbie_ has joined #openstack-infra | 06:00 | |
*** bexelbie_ is now known as bexelbie | 06:01 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/224437 | 06:02 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/221157 | 06:07 |
openstackgerrit | Andrey Pavlov proposed openstack-infra/project-config: ec2api job: enable voting of py34 for master branch https://review.openstack.org/224441 | 06:07 |
*** lawrancejing has joined #openstack-infra | 06:07 | |
*** aeng has quit IRC | 06:09 | |
*** Daisy has joined #openstack-infra | 06:12 | |
*** bharathm has joined #openstack-infra | 06:15 | |
*** armax has quit IRC | 06:15 | |
*** chlong has joined #openstack-infra | 06:18 | |
*** yfried_ has joined #openstack-infra | 06:19 | |
*** yfried__ has joined #openstack-infra | 06:23 | |
*** yfried_ has quit IRC | 06:24 | |
*** yamahata has joined #openstack-infra | 06:28 | |
*** balajin has quit IRC | 06:28 | |
*** MarkAtwood has quit IRC | 06:29 | |
*** nadya has joined #openstack-infra | 06:29 | |
*** harlowja has quit IRC | 06:29 | |
*** rkukura_ has joined #openstack-infra | 06:29 | |
*** MarkAtwood has joined #openstack-infra | 06:29 | |
*** rkukura has quit IRC | 06:29 | |
*** rkukura_ is now known as rkukura | 06:29 | |
*** zhenguo has quit IRC | 06:30 | |
*** zhenguo has joined #openstack-infra | 06:32 | |
*** nadya has quit IRC | 06:33 | |
*** abregman has joined #openstack-infra | 06:35 | |
*** balajin has joined #openstack-infra | 06:36 | |
*** salv-orlando has joined #openstack-infra | 06:37 | |
*** yfried__ is now known as yfried|afk | 06:37 | |
*** scheuran has joined #openstack-infra | 06:38 | |
*** yfried|afk is now known as yfried__ | 06:40 | |
*** salv-orlando has quit IRC | 06:43 | |
*** MarkAtwood has quit IRC | 06:43 | |
*** zeih has joined #openstack-infra | 06:46 | |
*** otter768 has joined #openstack-infra | 06:49 | |
ttx | jeblair: yeah, if I have SSH access to that one I can probably make it go the last mile now. I'll note down what I had to do to "finalize" it so we can improve the puppet recipe later | 06:50 |
*** zeih has quit IRC | 06:51 | |
*** dingyichen has quit IRC | 06:52 | |
*** markvoelker has quit IRC | 06:53 | |
*** otter768 has quit IRC | 06:54 | |
*** bexelbie has quit IRC | 06:55 | |
*** dizquierdo has joined #openstack-infra | 06:55 | |
*** e0ne has joined #openstack-infra | 06:56 | |
*** claudiub has joined #openstack-infra | 06:58 | |
openstackgerrit | Kevin Carter proposed openstack-infra/project-config: Added periodic job for OpenStack-Ansible https://review.openstack.org/224215 | 06:59 |
openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/224437 | 07:02 |
*** e0ne has quit IRC | 07:03 | |
*** ivar-lazzaro has quit IRC | 07:05 | |
*** peristeri has joined #openstack-infra | 07:08 | |
*** HeOS_ has quit IRC | 07:09 | |
*** stevemar has quit IRC | 07:10 | |
*** ildikov has quit IRC | 07:10 | |
*** Sukhdev has quit IRC | 07:11 | |
*** huanxie has quit IRC | 07:14 | |
*** fawadkhaliq has quit IRC | 07:17 | |
*** arxcruz has joined #openstack-infra | 07:18 | |
*** salv-orlando has joined #openstack-infra | 07:18 | |
*** Ala has joined #openstack-infra | 07:19 | |
*** markus_z has joined #openstack-infra | 07:19 | |
*** glauco has joined #openstack-infra | 07:21 | |
*** s0nea has quit IRC | 07:21 | |
*** markus_z has quit IRC | 07:24 | |
*** shardy has joined #openstack-infra | 07:25 | |
*** glauco has quit IRC | 07:26 | |
*** yamahata has quit IRC | 07:26 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Use a specific fedora mirror on the jenkins node https://review.openstack.org/223868 | 07:26 |
*** dtantsur|afk is now known as dtantsur | 07:27 | |
openstackgerrit | yolanda.robla proposed openstack-infra/puppet-jenkins: Allow to specify a different jenkins default https://review.openstack.org/211481 | 07:28 |
*** bexelbie_ has joined #openstack-infra | 07:29 | |
*** yolanda has joined #openstack-infra | 07:30 | |
*** claudiub has quit IRC | 07:31 | |
*** alex_xu_ is now known as alex_xu | 07:32 | |
*** Hal has joined #openstack-infra | 07:32 | |
*** yfried has joined #openstack-infra | 07:34 | |
*** hashar has joined #openstack-infra | 07:35 | |
*** larainema has quit IRC | 07:36 | |
*** yfried__ has quit IRC | 07:36 | |
*** larainema has joined #openstack-infra | 07:36 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Use a specific mirror for CentOS builds https://review.openstack.org/224000 | 07:37 |
openstackgerrit | yolanda.robla proposed openstack-infra/puppet-jenkins: Allow to specify a different jenkins default https://review.openstack.org/211481 | 07:38 |
*** achanda has quit IRC | 07:38 | |
*** larainema has quit IRC | 07:41 | |
*** larainema has joined #openstack-infra | 07:42 | |
*** jlanoux has joined #openstack-infra | 07:44 | |
*** ildikov has joined #openstack-infra | 07:45 | |
*** shardy_ has joined #openstack-infra | 07:47 | |
*** shardy has quit IRC | 07:47 | |
*** achanda has joined #openstack-infra | 07:47 | |
*** larainema has quit IRC | 07:49 | |
*** larainema has joined #openstack-infra | 07:49 | |
*** achanda has quit IRC | 07:50 | |
*** dims_ has joined #openstack-infra | 07:51 | |
*** shardy_ has quit IRC | 07:51 | |
*** fawadkhaliq has joined #openstack-infra | 07:51 | |
*** shardy has joined #openstack-infra | 07:52 | |
openstackgerrit | yolanda.robla proposed openstack-infra/puppet-jenkins: Properly setup of jenkins keys https://review.openstack.org/215197 | 07:52 |
*** svasheka has quit IRC | 07:54 | |
*** yfried has quit IRC | 07:54 | |
*** markvoelker has joined #openstack-infra | 07:54 | |
*** gildub has quit IRC | 07:55 | |
*** yfried has joined #openstack-infra | 07:55 | |
*** Daisy_ has joined #openstack-infra | 07:56 | |
*** dims_ has quit IRC | 07:57 | |
*** ifarkas has joined #openstack-infra | 07:59 | |
*** markvoelker has quit IRC | 07:59 | |
*** mpaolino has joined #openstack-infra | 08:01 | |
*** svasheka has joined #openstack-infra | 08:01 | |
*** Daisy_ has quit IRC | 08:01 | |
-openstackstatus- NOTICE: Gate is currently stuck, failing grenade upgrade tests due the release of oslo.utils 1.4.1 for Juno. | 08:01 | |
hrubi | jhesketh: hi, did you have time to check my comment in https://review.openstack.org/#/c/121528/35/zuul/scheduler.py ? | 08:03 |
*** s0nea has joined #openstack-infra | 08:03 | |
*** btully has quit IRC | 08:03 | |
openstackgerrit | Jan Klare proposed openstack-infra/project-config: move 'gate-{name}-chef-rake-integration' job https://review.openstack.org/194181 | 08:03 |
*** yolanda has quit IRC | 08:04 | |
*** sflanigan has quit IRC | 08:05 | |
*** fhubik has joined #openstack-infra | 08:10 | |
lifeless | tonyb: ttx: ok so | 08:10 |
tonyb | lifeless: I see | 08:10 |
lifeless | Kilo has no constraints protection which is why its broken | 08:11 |
tonyb | lifeless: I didn't know about : gate-oslo.utils-requirements which fails as you said it would | 08:11 |
lifeless | I *thought* the proposed plan included the kilo caps, but clearly not. To fix it we'd need to update kilo to make sure it doesn't get the juno release | 08:11 |
lifeless | assuming thats even possible | 08:11 |
tonyb | lifeless: Well the quickest fix would be to ban 1.4.1, which I had out there but I abandoned it in favor of this plan that wont work | 08:12 |
tonyb | that will make it nearly impossible to do further release of 1.4 for kilo though (IIUC) | 08:13 |
ttx | bah, one problem at a time | 08:14 |
tonyb | ttx: :) | 08:15 |
lifeless | and this is why branches of libraries.. gets off of hobby horse | 08:15 |
tonyb | lifeless: :) | 08:15 |
*** larainema has quit IRC | 08:16 | |
lifeless | https://etherpad.openstack.org/p/branchless-clients-and-libs | 08:16 |
lifeless | anyhoo | 08:16 |
tonyb | lifeless: so should I restore my ban 1.4.1 in kilo review? | 08:16 |
*** larainema has joined #openstack-infra | 08:17 | |
lifeless | tonyb: I don't know what that review looks like | 08:17 |
lifeless | tonyb: so I can't answer that | 08:17 |
tonyb | lifeless: https://review.openstack.org/#/c/224429/ | 08:17 |
*** markus_z has joined #openstack-infra | 08:18 | |
tonyb | lifeless: IIUC banning 1.4.1 from juno will mean it gets 1.4.0 (again) and juno still gets 1.4.1 .... | 08:18 |
openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Make gate-python-ironic-inspector-client-dsvm voting https://review.openstack.org/224476 | 08:19 |
*** jistr has joined #openstack-infra | 08:20 | |
tonyb | lifeless: but that'll have a cascade effect where we need to get g-r updates into every library that uses oslo.utils wont it? | 08:20 |
lifeless | yes, unabandon that | 08:20 |
lifeless | yes | 08:20 |
ttx | looks like that can't hurt | 08:20 |
lifeless | welcome to why I'm pushing on the stuff I'm pushing on | 08:20 |
lifeless | tonyb: would you like to help me? :) | 08:20 |
tonyb | lifeless: we can talk about it in Tokyo | 08:21 |
tonyb | lifeless: I'm not agreeing to anything right now ;P | 08:21 |
tonyb | lifeless: restored that it's in the check queue, bonus is it already has a +2 | 08:23 |
*** Daisy has quit IRC | 08:23 | |
openstackgerrit | Bob Ball proposed openstack-infra/project-config: Add fuel-plugin-xenserver project https://review.openstack.org/224151 | 08:26 |
tonyb | ooo so much red in the gate. | 08:28 |
ttx | tonyb: approving | 08:30 |
tonyb | ttx: Thanks :) | 08:30 |
ttx | gating now | 08:30 |
ttx | (since it already passed tests) | 08:30 |
tonyb | ttx:After it merges will the g-r sync bot do it's think or does that need a kick | 08:31 |
lifeless | it's event driven | 08:32 |
ttx | tonyb: I think it's running daily, so we might want to push down the syncs we need | 08:32 |
ttx | lifeless: is it ? | 08:32 |
lifeless | ttx: yes | 08:32 |
lifeless | ttx: the constraints generator is daily | 08:32 |
lifeless | ttx: this is not that | 08:32 |
ttx | oh, cool. | 08:32 |
*** derekh has joined #openstack-infra | 08:33 | |
*** btully has joined #openstack-infra | 08:34 | |
*** ozamiatin has joined #openstack-infra | 08:35 | |
*** ihrachys has joined #openstack-infra | 08:36 | |
*** btully has quit IRC | 08:38 | |
*** ams___ is now known as ams_ | 08:40 | |
*** ams_ has joined #openstack-infra | 08:40 | |
*** ams_ has joined #openstack-infra | 08:40 | |
*** lawrancejing has quit IRC | 08:41 | |
*** lawrancejing has joined #openstack-infra | 08:41 | |
*** bharathm has quit IRC | 08:43 | |
odyssey4me | does the oslo.utils 1.4.1 library only affect kilo? | 08:43 |
*** romcheg has joined #openstack-infra | 08:44 | |
tonyb | odyssey4me: yes. | 08:45 |
tonyb | odyssey4me: master has >=2.0.0 so it's only a juno/kilo thing and juno is fine with 1.4.1 so that leaves only kilo | 08:46 |
*** ozamiatin has quit IRC | 08:46 | |
tonyb | ttx, lifeless: I need to leave. I'll be back in about 2 - 2.5 hours to try and pick up where I left off. | 08:47 |
odyssey4me | ok, cool - waiting for the patch to merge so that I can update the openstack-ansible sha's to include the restriction | 08:47 |
tonyb | ttx, lifeless: thanks for you help. | 08:47 |
*** zeih has joined #openstack-infra | 08:47 | |
ttx | tonyb: thanks for staying around to fix it ! | 08:47 |
*** nadya has joined #openstack-infra | 08:47 | |
*** HeOS_ has joined #openstack-infra | 08:47 | |
tonyb | ttx: np. | 08:47 |
*** soren has joined #openstack-infra | 08:48 | |
*** ozamiatin has joined #openstack-infra | 08:49 | |
*** teran has quit IRC | 08:49 | |
openstackgerrit | Doron Chen proposed openstack-infra/project-config: Adding a functional test to the storlets project https://review.openstack.org/220139 | 08:49 |
*** hichihara has quit IRC | 08:50 | |
*** zeih has quit IRC | 08:51 | |
*** ozamiatin has quit IRC | 08:52 | |
openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/requirements: Raise jsonpath-rw-ext version https://review.openstack.org/224494 | 08:54 |
*** alexpilotti has joined #openstack-infra | 08:55 | |
*** yfried is now known as yfried|afk | 08:56 | |
openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/requirements: Raise jsonpath-rw-ext version https://review.openstack.org/224494 | 08:56 |
*** oomichi has joined #openstack-infra | 08:58 | |
openstackgerrit | Michal Rostecki proposed openstack-infra/project-config: Fix jobs names for Puppet 4.0 https://review.openstack.org/224496 | 08:59 |
*** jordanP has joined #openstack-infra | 08:59 | |
*** nihilifer has joined #openstack-infra | 09:00 | |
openstackgerrit | Merged openstack-infra/project-config: Add PyPi jobs to yaql https://review.openstack.org/224176 | 09:01 |
*** madong_ has joined #openstack-infra | 09:02 | |
*** larainema has quit IRC | 09:02 | |
*** rick-chen has joined #openstack-infra | 09:03 | |
openstackgerrit | Derek Higgins proposed openstack/diskimage-builder: Download a compressed centos cloud images https://review.openstack.org/224155 | 09:04 |
ttx | heh weird. The requirements change is in both the check and the gate queue. | 09:05 |
ttx | I bet that's a sideeffect of the unabandon | 09:05 |
rick-chen | fungi: ping | 09:06 |
*** rick-chen_ has joined #openstack-infra | 09:09 | |
*** rick-chen has quit IRC | 09:11 | |
ttx | SergeyLukjanov: around for a quick release status update ? | 09:17 |
openstackgerrit | Merged openstack/requirements: Ban oslo.utils 1.4.1 from kilo https://review.openstack.org/224429 | 09:17 |
ttx | oops. wrong channel | 09:17 |
ttx | lifeless: the requirements change just merged. Anything else we need to do to unblock this ? | 09:18 |
lifeless | ttx: I don't know. Try a recheck on a master patch | 09:19 |
*** yfried|afk is now known as yfried | 09:20 | |
ttx | on it | 09:20 |
*** ociuhandu has quit IRC | 09:25 | |
*** ozamiatin has joined #openstack-infra | 09:26 | |
*** pelix has joined #openstack-infra | 09:27 | |
*** lawrancejing has quit IRC | 09:28 | |
openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/requirements: Raise jsonpath-rw-ext version https://review.openstack.org/224494 | 09:28 |
*** peristeri has quit IRC | 09:29 | |
*** yfried is now known as yfried|afk | 09:30 | |
*** fhubik has quit IRC | 09:33 | |
*** fhubik has joined #openstack-infra | 09:33 | |
*** Daisy has joined #openstack-infra | 09:39 | |
*** fhubik_ has joined #openstack-infra | 09:39 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use the get_auth function from occ https://review.openstack.org/221126 | 09:42 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add wrapper for heat's get_template_contents https://review.openstack.org/222929 | 09:42 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Abstract out the name of the name key https://review.openstack.org/222930 | 09:42 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add heatclient support https://review.openstack.org/222856 | 09:42 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Start using keystoneauth for keystone sessions https://review.openstack.org/183176 | 09:42 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add heat support https://review.openstack.org/151900 | 09:42 |
*** fawadkhaliq has quit IRC | 09:42 | |
*** fawadkhaliq has joined #openstack-infra | 09:43 | |
*** Daisy has quit IRC | 09:43 | |
*** fhubik is now known as fhubik_brb | 09:43 | |
openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added new Openstack repository for Fuel Zabbix Agents integration https://review.openstack.org/221259 | 09:43 |
*** teran has joined #openstack-infra | 09:45 | |
*** fawadkhaliq has quit IRC | 09:47 | |
*** e0ne has joined #openstack-infra | 09:51 | |
*** markvoelker has joined #openstack-infra | 09:55 | |
*** rick-chen_ has quit IRC | 09:56 | |
*** cdent has joined #openstack-infra | 09:56 | |
*** vgridnev has joined #openstack-infra | 09:57 | |
*** dims_ has joined #openstack-infra | 09:59 | |
*** markvoelker has quit IRC | 10:00 | |
*** e0ne has quit IRC | 10:00 | |
*** fawadkhaliq has joined #openstack-infra | 10:02 | |
*** cfarquhar has quit IRC | 10:06 | |
*** cfarquhar has joined #openstack-infra | 10:08 | |
*** cfarquhar has quit IRC | 10:08 | |
*** cfarquhar has joined #openstack-infra | 10:08 | |
*** fhubik_ has quit IRC | 10:10 | |
*** fhubik_brb has quit IRC | 10:10 | |
ttx | Looks like we have some grenade jobs passing now, so we may be unblocked | 10:10 |
*** yfried|afk is now known as yfried | 10:10 | |
*** e0ne has joined #openstack-infra | 10:11 | |
*** fhubik has joined #openstack-infra | 10:11 | |
*** mrmartin has quit IRC | 10:11 | |
*** fhubik has quit IRC | 10:13 | |
*** fhubik has joined #openstack-infra | 10:13 | |
ttx | #status notice Gate back to normal, thanks to the backlisting of the problematic version | 10:14 |
openstackstatus | ttx: sending notice | 10:14 |
-openstackstatus- NOTICE: Gate back to normal, thanks to the backlisting of the problematic version | 10:15 | |
openstackgerrit | Antoine Musso proposed openstack/diskimage-builder: Prettify 'Caches and offline mode' documentation https://review.openstack.org/224554 | 10:16 |
openstackstatus | ttx: finished sending notice | 10:16 |
*** kengo_sakai has quit IRC | 10:17 | |
openstackgerrit | Merged openstack/diskimage-builder: Don't create a centos yum repository https://review.openstack.org/223996 | 10:23 |
*** peristeri has joined #openstack-infra | 10:24 | |
*** IvanKliuk has joined #openstack-infra | 10:25 | |
*** yfried is now known as yfried|afk | 10:26 | |
IvanKliuk | Hello! | 10:27 |
*** salv-orlando has quit IRC | 10:27 | |
dims_ | thanks ttx and tonyb | 10:28 |
IvanKliuk | Colleagues, can you please review https://review.openstack.org/#/c/223980/ ? | 10:29 |
*** zeih has joined #openstack-infra | 10:33 | |
*** soren has quit IRC | 10:35 | |
*** zeih has quit IRC | 10:37 | |
*** yfried|afk is now known as yfried | 10:37 | |
*** salv-orlando has joined #openstack-infra | 10:38 | |
*** pc_m has joined #openstack-infra | 10:39 | |
*** zhenguo has quit IRC | 10:40 | |
*** lawrancejing has joined #openstack-infra | 10:46 | |
*** mpaolino has quit IRC | 10:47 | |
*** ZZelle has quit IRC | 10:50 | |
*** ZZelle has joined #openstack-infra | 10:51 | |
*** fawadkhaliq has quit IRC | 10:52 | |
openstackgerrit | Andrea Frittoli proposed openstack-infra/subunit2sql: Add pagination support for the runs query https://review.openstack.org/224344 | 10:53 |
*** dtantsur is now known as dtantsur|lunch | 10:55 | |
*** fawadkhaliq has joined #openstack-infra | 10:55 | |
*** yfried is now known as yfried|afk | 11:00 | |
*** MarkAtwood has joined #openstack-infra | 11:06 | |
*** romcheg has quit IRC | 11:07 | |
*** ozamiatin has quit IRC | 11:07 | |
*** dguitarbite has quit IRC | 11:08 | |
*** dguitarbite has joined #openstack-infra | 11:10 | |
tonyb | ttx: Wow! | 11:10 |
*** yfried|afk is now known as yfried | 11:11 | |
* tonyb is very surprised that was enough to do it. | 11:11 | |
*** IvanKliuk has left #openstack-infra | 11:11 | |
r1chardj0n3s | \o | 11:12 |
r1chardj0n3s | yay | 11:13 |
*** MarkAtwood has quit IRC | 11:13 | |
*** MarkAtwo_ has joined #openstack-infra | 11:13 | |
*** doug-fish has quit IRC | 11:14 | |
*** MarkAtwood has joined #openstack-infra | 11:14 | |
*** doug-fish has joined #openstack-infra | 11:14 | |
*** matbu_ has joined #openstack-infra | 11:17 | |
openstackgerrit | Andrey Pavlov proposed openstack-infra/project-config: ec2api job: enable voting of py34 for master branch https://review.openstack.org/224441 | 11:17 |
*** MarkAtwo_ has quit IRC | 11:17 | |
*** nadya has quit IRC | 11:19 | |
*** matbu has quit IRC | 11:20 | |
*** nadya has joined #openstack-infra | 11:20 | |
*** glauco_ has joined #openstack-infra | 11:22 | |
*** e0ne has quit IRC | 11:23 | |
*** oomichi has quit IRC | 11:24 | |
openstackgerrit | Antoine Musso proposed openstack/diskimage-builder: Prettyfy source-repositories doc https://review.openstack.org/224578 | 11:25 |
*** hashar has quit IRC | 11:25 | |
*** markvoelker has joined #openstack-infra | 11:26 | |
*** glauco_ has quit IRC | 11:27 | |
*** dprince has joined #openstack-infra | 11:28 | |
*** claudiub has joined #openstack-infra | 11:30 | |
*** markvoelker has quit IRC | 11:31 | |
*** Zhongjun has joined #openstack-infra | 11:31 | |
*** bexelbie_ is now known as bexelbie | 11:32 | |
*** zeih has joined #openstack-infra | 11:33 | |
*** weshay_xchat has quit IRC | 11:35 | |
*** dzamboni has joined #openstack-infra | 11:35 | |
*** ldnunes has joined #openstack-infra | 11:35 | |
*** weshay_xchat has joined #openstack-infra | 11:37 | |
*** zeih has quit IRC | 11:38 | |
*** EricGonczer_ has joined #openstack-infra | 11:40 | |
*** jordanP has quit IRC | 11:40 | |
*** sdake_ has joined #openstack-infra | 11:43 | |
*** geoffarnoldX is now known as geoffarnold | 11:46 | |
*** markvoelker has joined #openstack-infra | 11:47 | |
*** sdake has quit IRC | 11:47 | |
*** doug-fish has quit IRC | 11:48 | |
ttx | jeblair, fungi: I don't have SSH access to 23.253.49.144 (the odsreg machine) yet -- if that is setup I can probably push the last manual steps in | 11:49 |
*** thorst has joined #openstack-infra | 11:50 | |
*** amuller has joined #openstack-infra | 11:50 | |
*** nadya has quit IRC | 11:50 | |
*** EricGonczer_ has quit IRC | 11:50 | |
*** EricGonc_ has joined #openstack-infra | 11:50 | |
fungi | ttx: i can take a look in an hour or so. trying to get the voter rolls generated and need to drop my wife off at her office, but can dig into it once i get back | 11:51 |
*** gordc has joined #openstack-infra | 11:52 | |
*** romcheg has joined #openstack-infra | 11:53 | |
ttx | hmm, maybe that was a test host, not the real thing | 11:54 |
ttx | maybe better to wait for jeblair | 11:54 |
*** trown|outttypeww is now known as trown | 11:55 | |
openstackgerrit | Merged openstack/requirements: Update our handling of pbr. https://review.openstack.org/224330 | 11:59 |
*** fawadkhaliq has quit IRC | 12:01 | |
*** baoli has joined #openstack-infra | 12:04 | |
*** e0ne has joined #openstack-infra | 12:04 | |
*** fhubik is now known as fhubik_brb | 12:05 | |
openstackgerrit | Bob Ball proposed openstack-infra/project-config: Add fuel-plugin-xenserver project https://review.openstack.org/224151 | 12:06 |
*** bswartz has quit IRC | 12:10 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements https://review.openstack.org/224595 | 12:10 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/224606 | 12:11 |
*** amotoki has quit IRC | 12:12 | |
*** sdake_ is now known as sdake | 12:13 | |
*** ajmiller has quit IRC | 12:15 | |
*** fawadkhaliq has joined #openstack-infra | 12:15 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements https://review.openstack.org/224685 | 12:17 |
mordred | Shrews: shade unittest are all broken because of te occ/ksa release - but it's because we were doing a very weird thing in the shade tests that isn't actually a valid thing to do | 12:19 |
mordred | Shrews: I'm working on a fix | 12:19 |
mordred | Shrews: (basically, we were instantiating a cloud with absolutely no config information at all) | 12:20 |
*** yamamoto has quit IRC | 12:20 | |
mordred | which worked for the unit tests - but isn't actually a thing | 12:20 |
*** glauco has joined #openstack-infra | 12:23 | |
*** ociuhandu has joined #openstack-infra | 12:23 | |
*** romcheg has quit IRC | 12:23 | |
claudiub | fungi: hello. the os-win project repo merged yesterday: https://review.openstack.org/#/c/209204/ can you add me to its core and release groups? Thanks! | 12:23 |
*** burgerk has joined #openstack-infra | 12:25 | |
*** glauco has quit IRC | 12:28 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Start using keystoneauth for keystone sessions https://review.openstack.org/183176 | 12:28 |
mordred | Shrews: ^^ that should do it | 12:28 |
*** jsavak has joined #openstack-infra | 12:30 | |
*** fhubik_brb is now known as fhubik | 12:31 | |
*** markvoelker has quit IRC | 12:31 | |
*** romcheg has joined #openstack-infra | 12:31 | |
*** ociuhandu has quit IRC | 12:31 | |
*** weshay_xchat is now known as weshay | 12:32 | |
*** doug-fish has joined #openstack-infra | 12:34 | |
*** LimorStotland has joined #openstack-infra | 12:34 | |
LimorStotland | Hi all... i have a question ... is there any way to rerun gate test? | 12:35 |
*** aysyd has joined #openstack-infra | 12:35 | |
*** achanda has joined #openstack-infra | 12:35 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use the get_auth function from occ https://review.openstack.org/221126 | 12:36 |
*** cburroughs has joined #openstack-infra | 12:38 | |
*** hashar has joined #openstack-infra | 12:38 | |
*** dizquierdo has quit IRC | 12:39 | |
*** EricGonc_ has quit IRC | 12:42 | |
*** nadya has joined #openstack-infra | 12:43 | |
*** geoffarnold is now known as geoffarnoldX | 12:46 | |
*** dprince has quit IRC | 12:47 | |
*** hamzy has quit IRC | 12:47 | |
*** mdbooth has quit IRC | 12:48 | |
*** dtantsur|lunch is now known as dtantsur | 12:48 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Trap exceptions in helper modules https://review.openstack.org/224713 | 12:48 |
EmilienM | good morning infra, I have an outstanding request to unblock our stable/x branches CI: https://review.openstack.org/#/c/224397/ | 12:49 |
EmilienM | mordred: I was wondering if you also tested cloudwatt (french compute & storage public cloud) | 12:49 |
*** mdbooth has joined #openstack-infra | 12:50 | |
*** amotoki has joined #openstack-infra | 12:50 | |
*** julim has joined #openstack-infra | 12:50 | |
*** edmondsw has joined #openstack-infra | 12:51 | |
Shrews | mordred: hrm | 12:51 |
mordred | EmilienM: I have not yet- it's now on my list | 12:51 |
EmilienM | mordred: they use OpenContrail for SDN & Neutron plugin | 12:52 |
EmilienM | might be interesting to benchmark how they allow to use public network | 12:52 |
fungi | LimorStotland: leave a review comment starting with the word "recheck" | 12:53 |
*** gordc has quit IRC | 12:53 | |
LimorStotland | Thanks | 12:53 |
EmilienM | mordred: i've been working with us when I was eNovance - let me know if you need to reach out someone from there | 12:53 |
mordred | EmilienM: | 12:54 |
mordred | Bienvenue et merci de votre inscription sur Cloudwatt ! | 12:54 |
*** Daisy has joined #openstack-infra | 12:55 | |
*** redixin has quit IRC | 12:55 | |
mordred | EmilienM: boo. it does not take Amex :) | 12:56 |
EmilienM | mordred: Bienvenue en France | 12:56 |
EmilienM | mordred: ;-) | 12:56 |
openstackgerrit | Bob Ball proposed openstack-infra/project-config: Add fuel-plugin-xenserver project https://review.openstack.org/224151 | 12:56 |
*** kgiusti has joined #openstack-infra | 12:57 | |
*** pradk has joined #openstack-infra | 12:58 | |
openstackgerrit | Merged openstack-infra/project-config: zuul/layout: puppet openstack updates https://review.openstack.org/224397 | 12:58 |
*** ociuhandu has joined #openstack-infra | 12:58 | |
fungi | claudiub: i've added you to those groups now | 12:58 |
*** jolsen has joined #openstack-infra | 12:59 | |
*** glauco has joined #openstack-infra | 13:02 | |
*** yamamoto has joined #openstack-infra | 13:02 | |
mordred | EmilienM: aww. cloudwatt reuqires floating ips. | 13:03 |
*** xyang1 has joined #openstack-infra | 13:03 | |
* mordred shakes fist at EmilienM | 13:03 | |
EmilienM | mordred: afik, they use provider networks but I used to work on it long time ago - it might have changed | 13:03 |
*** gordc has joined #openstack-infra | 13:03 | |
EmilienM | iirc, when you spawned a VM, it was directly on the internet | 13:03 |
mordred | EmilienM: nope. it's changed | 13:03 |
EmilienM | damn | 13:03 |
mordred | now if you go to create a vm, it says "you don't have any networks" | 13:04 |
*** rlandy has joined #openstack-infra | 13:04 | |
EmilienM | mordred: I'm sure they are really open to discussion, I can give you contacts there | 13:04 |
*** geoffarnoldX is now known as geoffarnold | 13:05 | |
*** ccarrara has joined #openstack-infra | 13:05 | |
*** geoffarnold is now known as geoffarnoldX | 13:05 | |
*** rossella_s has quit IRC | 13:06 | |
*** rossella_s has joined #openstack-infra | 13:06 | |
openstackgerrit | Bob Ball proposed openstack-infra/project-config: Add fuel-plugin-xenserver project https://review.openstack.org/224151 | 13:06 |
EmilienM | for the record, I sent to mordred in /query the email of their network architect, also neutron contributor | 13:07 |
*** ozamiatin has joined #openstack-infra | 13:09 | |
odyssey4me | odd, https://git.openstack.org/cgit/openstack/governance/commit/?id=b8b01adf2171596a03cd5fe3948867da071df834 is in, but it's not reflected yet at http://governance.openstack.org/reference/projects/openstackansible.html | 13:10 |
*** ddieterly has quit IRC | 13:11 | |
*** ddieterly has joined #openstack-infra | 13:11 | |
*** hdd has joined #openstack-infra | 13:15 | |
*** fawadkhaliq has quit IRC | 13:16 | |
*** zns_ has joined #openstack-infra | 13:17 | |
openstackgerrit | Bob Ball proposed openstack-infra/project-config: Add fuel-plugin-xenserver project https://review.openstack.org/224151 | 13:17 |
*** teran_ has joined #openstack-infra | 13:17 | |
openstackgerrit | Merged openstack-infra/project-config: Added new Openstack repository for Fuel Zabbix Agents integration https://review.openstack.org/221259 | 13:17 |
openstackgerrit | Merged openstack/diskimage-builder: Add centos7 support for DIB_DISTRIBUTION_MIRROR https://review.openstack.org/223997 | 13:17 |
*** HeOS_ has quit IRC | 13:17 | |
*** [HeOS] has joined #openstack-infra | 13:17 | |
*** mattymo has quit IRC | 13:18 | |
*** teran has quit IRC | 13:19 | |
*** zhenguo has joined #openstack-infra | 13:20 | |
*** ddieterly has quit IRC | 13:21 | |
*** romcheg has quit IRC | 13:22 | |
*** bltavares has joined #openstack-infra | 13:22 | |
*** asselin_ has joined #openstack-infra | 13:22 | |
*** mattymo has joined #openstack-infra | 13:23 | |
*** hrou has joined #openstack-infra | 13:23 | |
*** arxcruz has quit IRC | 13:24 | |
*** romcheg has joined #openstack-infra | 13:24 | |
*** eharney has quit IRC | 13:24 | |
*** ajmiller has joined #openstack-infra | 13:24 | |
*** fawadkhaliq has joined #openstack-infra | 13:25 | |
*** romcheg has quit IRC | 13:26 | |
*** glauco has quit IRC | 13:26 | |
*** romcheg has joined #openstack-infra | 13:28 | |
*** cdent has quit IRC | 13:28 | |
*** dramalho has joined #openstack-infra | 13:28 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Use a specific mirror for CentOS builds https://review.openstack.org/224000 | 13:30 |
*** redixin has joined #openstack-infra | 13:30 | |
*** dramalho has quit IRC | 13:30 | |
*** alivigni has joined #openstack-infra | 13:31 | |
*** openstackgerrit has quit IRC | 13:31 | |
*** tongli has joined #openstack-infra | 13:31 | |
*** andrearosa has joined #openstack-infra | 13:31 | |
*** openstackgerrit has joined #openstack-infra | 13:31 | |
*** ccarrara has quit IRC | 13:32 | |
*** geoffarnoldX is now known as geoffarnold | 13:32 | |
fungi | tristanC: tonyb: i'll go ahead and put together the final electoral rolls for: cinder, glance, ironic, keystone, mistral, neutron, oslo and also the general atc roll for the upcoming tc election | 13:32 |
*** mriedem has joined #openstack-infra | 13:32 | |
tonyb | fungi: Thanks! | 13:32 |
tristanC | fungi: many thanks :-) | 13:33 |
*** tiswanso has joined #openstack-infra | 13:33 | |
*** zeih has joined #openstack-infra | 13:34 | |
fungi | tonyb: tristanC: i'm basing it on the state of the governance repo at the sept-2015-elections tag ttx created a week ago | 13:34 |
*** dramalho has joined #openstack-infra | 13:35 | |
*** sabeen has joined #openstack-infra | 13:35 | |
tonyb | fungi: I believe that is the correct thing to do. | 13:35 |
*** julim has quit IRC | 13:37 | |
claudiub | fungi: thanks for adding me to the groups. :) | 13:38 |
*** ajmiller_ has joined #openstack-infra | 13:39 | |
*** zeih has quit IRC | 13:39 | |
*** achanda has quit IRC | 13:40 | |
fungi | tonyb: tristanC: one glitch here... wiki says "over the Kilo-Liberty timeframe (September 18, 2014 06:00 UTC to September 18, 2015 05:59 UTC)" | 13:40 |
*** ajmiller has quit IRC | 13:40 | |
*** ajmiller_ has quit IRC | 13:41 | |
fungi | September 18, 2015 05:59 UTC is still ~16 hours from now | 13:41 |
tristanC | fungi: yes, we pick that timeframe arbritarly to make it match with election dates | 13:41 |
fungi | so i guess i should hold off generating the electoral rolls until then | 13:41 |
*** ajmiller has joined #openstack-infra | 13:42 | |
*** burgerk has quit IRC | 13:44 | |
*** dprince has joined #openstack-infra | 13:46 | |
*** sigmavirus24_awa is now known as sigmavirus24 | 13:46 | |
tonyb | fungi: That makes sense to me but I'll let tristanC make the call. | 13:46 |
tristanC | ouch, would have been better to pick a day earlier. but since we communicate those dates, we'll have to stick with them | 13:46 |
tristanC | tonyb: fungi: yes that will have to wait tomorrow then | 13:47 |
*** ajmiller has quit IRC | 13:47 | |
*** hdd has quit IRC | 13:47 | |
mriedem | jhesketh: can you hit this again now that pep8 is happy? https://review.openstack.org/#/c/224162/ | 13:48 |
*** jpeeler has joined #openstack-infra | 13:49 | |
*** jpeeler has quit IRC | 13:49 | |
*** jpeeler has joined #openstack-infra | 13:49 | |
*** stevemar has joined #openstack-infra | 13:50 | |
mordred | least favorite thing - waiting on a patch to land after all the tests have finished | 13:51 |
mriedem | least favorite, of all things? | 13:51 |
openstackgerrit | Merged openstack-infra/project-config: Don't run python jobs for old Fuel Client https://review.openstack.org/223980 | 13:52 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Remove code to pull clone repositories https://review.openstack.org/222406 | 13:54 |
openstackgerrit | Bob Ball proposed openstack-infra/project-config: Add fuel-plugin-xenserver project https://review.openstack.org/224151 | 13:55 |
*** hichihara has joined #openstack-infra | 13:56 | |
*** mtanino has joined #openstack-infra | 13:58 | |
openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: Add devstack-plugin-bdd to project config https://review.openstack.org/224738 | 13:58 |
*** jyuso1 has quit IRC | 14:00 | |
*** e0ne has quit IRC | 14:01 | |
*** eharney has joined #openstack-infra | 14:05 | |
*** julim has joined #openstack-infra | 14:05 | |
*** dramalho has quit IRC | 14:05 | |
*** peristeri has quit IRC | 14:06 | |
*** e0ne has joined #openstack-infra | 14:06 | |
mordred | SergeyLukjanov, ttx: it's really painful waiting for the US to wake up - how do you do it on a regular basis? | 14:07 |
* Clint snickers. | 14:08 | |
openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: change verify group to fuel-plugins-ci https://review.openstack.org/224136 | 14:09 |
openstackgerrit | Dmitry Tantsur proposed openstack/requirements: Bump upper-constraint for python-ironic-inspector-client to 1.2.0 https://review.openstack.org/223143 | 14:09 |
*** gordc has quit IRC | 14:10 | |
*** Daisy has quit IRC | 14:11 | |
*** gordc has joined #openstack-infra | 14:11 | |
*** burgerk has joined #openstack-infra | 14:11 | |
EmilienM | i'm not sure but is there a DNS issue? when I go on https://trystack.org/ I land in the OpenStack Security page | 14:11 |
*** glauco has joined #openstack-infra | 14:12 | |
Clint | sounds more like a vhost issue | 14:12 |
pabelanger | yes | 14:12 |
pabelanger | looks like it | 14:12 |
EmilienM | damn | 14:12 |
pabelanger | when we did trystack.o.o we didn't do https | 14:12 |
pabelanger | easy fix | 14:12 |
pabelanger | but we need a cert | 14:12 |
ttx | mordred: I know, right | 14:14 |
openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: Add devstack-plugin-bdd to project config https://review.openstack.org/224738 | 14:14 |
*** Piet has quit IRC | 14:14 | |
*** dramalho has joined #openstack-infra | 14:15 | |
*** regXboi has joined #openstack-infra | 14:15 | |
openstackgerrit | Paul Carver proposed openstack-infra/irc-meetings: Add more details to the Service Function Chaining meeting https://review.openstack.org/224747 | 14:16 |
openstackgerrit | Bob Ball proposed openstack-infra/project-config: Add fuel-plugin-xenserver project https://review.openstack.org/224151 | 14:17 |
*** burgerk_ has joined #openstack-infra | 14:17 | |
*** IvanKliuk has joined #openstack-infra | 14:17 | |
fungi | EmilienM: there is no https://trystack.org/ only http://trystack.org/ | 14:17 |
fungi | pabelanger: ^ | 14:18 |
pabelanger | EmilienM: Clint: it should be noted, that all vhosts on static.o.o if you use https will redirect to security.o.o | 14:18 |
pabelanger | so, it is not limited to trystack | 14:18 |
fungi | also we'd need to do sni since we already have an https site on that apache server and it has only one global ip address | 14:18 |
EmilienM | fungi: yeah but when I used it in the past it was https | 14:18 |
fungi | EmilienM: interesting, that was probably not called out as a requirement when we redirected it | 14:19 |
Clint | sni's pretty widespread now | 14:19 |
BobBall | fungi: And I thought you were going to say there is no trystack there is only dostack... | 14:19 |
IvanKliuk | Colleagues, I got problem with installing 'hacking' on CI http://logs.openstack.org/31/205131/5/check/gate-python-fuelclient-pep8/ee4612e/console.html | 14:19 |
IvanKliuk | ERROR: could not install deps [hacking==0.7] | 14:19 |
*** ccarrara has joined #openstack-infra | 14:19 | |
*** MarkAtwood has quit IRC | 14:19 | |
*** mmedvede has joined #openstack-infra | 14:19 | |
IvanKliuk | Can you please help? | 14:19 |
openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: Add devstack-plugin-bdd to project config https://review.openstack.org/224738 | 14:20 |
pabelanger | IvanKliuk: looks like a networking issue | 14:20 |
pabelanger | No route to host | 14:20 |
*** burgerk has quit IRC | 14:20 | |
fungi | Clint: yep, it's mostly just a matter of replacing our existing security.o.o cert with a new one that the ca allows additional subjectaltnames | 14:20 |
fungi | which is more expensive, but not terribly so. i've already checked into it with the ca we're using | 14:20 |
pabelanger | fungi: Ya, that would likely be the simplest way | 14:20 |
fungi | BobBall: oops! i totally missed the opportunity there | 14:21 |
Clint | fungi: if only letsencrypt would mature faster | 14:21 |
BobBall | :P | 14:21 |
*** Daisy has joined #openstack-infra | 14:21 | |
IvanKliuk | pabelanger: how can I be resolved? | 14:21 |
IvanKliuk | it* | 14:21 |
*** achanda has joined #openstack-infra | 14:22 | |
fungi | Clint: they issued their first cert this week | 14:22 |
fungi | i think | 14:22 |
fungi | first non-experimental/production cert anyway | 14:23 |
Clint | yeah, not cross-signed though | 14:23 |
*** amotoki has quit IRC | 14:23 | |
fungi | if only cacert.org could have thrived instead of merely highlighting how the browser and ca cabal is not in any way an open community | 14:23 |
*** dkranz has joined #openstack-infra | 14:24 | |
clarkb | dont worry firefox will just negotiate ad hoc tls for us and never have any bugs | 14:24 |
Clint | i dunno, you needed a blackbelt in bureaucracy to participate in that thing | 14:24 |
pabelanger | IvanKliuk: not sure. looks like http://pypi.region-b.geo-1.openstack.org is down? | 14:24 |
Clint | cacert, not bug-free firefox | 14:25 |
clarkb | its actually a neat feature unfortunate that that bug occured in the first release of it | 14:25 |
pabelanger | fungi: clarkb: any current issues with pypi mirrors? | 14:25 |
fungi | pabelanger: you tell us | 14:25 |
*** achanda has quit IRC | 14:25 | |
pabelanger | fungi: I see what you did there | 14:25 |
fungi | pabelanger: IvanKliuk: yeah, sure looks unresponsive to me | 14:26 |
pabelanger | fungi: Ya, cacti doesn't look happy about it either | 14:26 |
fungi | that's not good | 14:26 |
fungi | can't ssh into it | 14:26 |
*** markvoelker has joined #openstack-infra | 14:26 | |
fungi | i wonder whether it's just that machine or if hpcloud is suffering somehow | 14:26 |
clarkb | last time that happened hp deleted out account | 14:27 |
fungi | doesn't even respond to ping | 14:27 |
fungi | le sigh | 14:27 |
clarkb | or suspended it | 14:27 |
*** jordanP has joined #openstack-infra | 14:27 | |
pabelanger | clarkb: wow | 14:27 |
clarkb | jeblair did you forget to update the email addr :) | 14:27 |
*** tjcocozz has joined #openstack-infra | 14:27 | |
clarkb | fungi I am on phone but I would check if account works | 14:28 |
*** hdd has joined #openstack-infra | 14:28 | |
fungi | ERROR (Unauthorized): Account is inactive (HTTP 401) | 14:28 |
clarkb | ya... | 14:29 |
fungi | yep | 14:29 |
clarkb | wendar ^ | 14:29 |
Clint | ruh-roh | 14:29 |
fungi | that's what i get when trying to authenticate as openstackci2 for tenant openstackci2-project1 | 14:29 |
*** dramalho has quit IRC | 14:29 | |
openstackgerrit | Tony Breeds proposed openstack/requirements: Add a warning near oslo.utils. https://review.openstack.org/224757 | 14:29 |
clarkb | we should maybe redeploy mirror in the slave account at least that way they die together | 14:29 |
*** esker has joined #openstack-infra | 14:30 | |
*** mtanino has quit IRC | 14:31 | |
openstackgerrit | Tony Breeds proposed openstack/requirements: Add a warning near oslo.utils. https://review.openstack.org/224758 | 14:31 |
*** mmedvede has quit IRC | 14:31 | |
*** bltavares has quit IRC | 14:32 | |
clarkb | fungi should we disable hpcloud in nodepool? | 14:32 |
fungi | i am doing that now | 14:32 |
*** geoffarnold is now known as geoffarnoldX | 14:32 | |
clarkb | ok let me actually wake up and find food so I can be useful in abit | 14:33 |
*** ccarrara has quit IRC | 14:33 | |
*** ildikov has quit IRC | 14:33 | |
*** glauco has quit IRC | 14:34 | |
*** rfolco has joined #openstack-infra | 14:34 | |
fungi | set max-servers to 0 for all 5 hpcloud networks and have deleted all ready nodes there | 14:35 |
clarkb | cool | 14:35 |
fungi | puppet agent is disabled | 14:35 |
fungi | change on teh way to do the same | 14:35 |
*** btully has joined #openstack-infra | 14:35 | |
openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: Subscriptions WIP https://review.openstack.org/223562 | 14:35 |
*** ajmiller has joined #openstack-infra | 14:36 | |
*** dizquierdo has joined #openstack-infra | 14:36 | |
clarkb | this is a benefit to the ovh model of one account multiple users | 14:37 |
fungi | too bad ovh gra1 isn't already completely in place and tested for us | 14:37 |
mordred | fungi, clarkb is that ... sigh | 14:39 |
mordred | let me ping some humans | 14:39 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Temporarily disable hpcloud in nodepool https://review.openstack.org/224766 | 14:39 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Revert "Temporarily disable hpcloud in nodepool" https://review.openstack.org/224767 | 14:39 |
purp | Hi, mordred. Consider me pinged. | 14:39 |
*** tonytan4ever has joined #openstack-infra | 14:39 | |
mordred | purp: yay! | 14:39 |
*** ashleigh has joined #openstack-infra | 14:39 | |
* mordred does the happy purp dance | 14:39 | |
*** lawrancejing has quit IRC | 14:39 | |
anteaya | purp: thanks | 14:40 |
purp | I need the account id/username via email so I can get this to someone to look at. | 14:40 |
mordred | purp: on it | 14:40 |
mordred | clarkb: do we know account id? | 14:40 |
openstackgerrit | Michael Xin proposed openstack-infra/project-config: Add a new project syntribos https://review.openstack.org/220351 | 14:41 |
fungi | mordred: openstackci2-project1 is the "tenant name" | 14:41 |
*** cloudtrainme has joined #openstack-infra | 14:41 | |
pabelanger | fungi: just, just noticed the work jeblair did with OVH. Exciting | 14:41 |
clarkb | and openstackci2 the account name | 14:41 |
fungi | yeah, not sure which is the one they need | 14:41 |
*** Daisy has quit IRC | 14:42 | |
purp | Thanks, clarkb. Relaying. | 14:42 |
*** rfolco has quit IRC | 14:42 | |
fungi | is there a many:many relationship model for api accounts and tenants in keystone? some providers seem to do many:one and some seem to do one:many | 14:43 |
mordred | clarkb, fungi: what about openstackjenkins2 ? | 14:43 |
clarkb | mordred seemed fine | 14:43 |
fungi | mordred: seems to still be working because the nodes are being booted there and running jobs | 14:43 |
openstackgerrit | Pino Toscano proposed openstack-infra/tripleo-ci: [WIP] Generate overcloud image outside the undercloud https://review.openstack.org/224166 | 14:43 |
mordred | fungi: yes | 14:43 |
clarkb | I think that account is actually aet up properly | 14:43 |
mordred | fungi: awesome. so it's just the mirror | 14:43 |
ihrachys | infra pypi cache broken? http://logs.openstack.org/09/224209/2/check/gate-neutron-pep8/f7e112c/console.html | 14:43 |
clarkb | because it didnt break last time either | 14:43 |
fungi | it's just the tenant for our long-lived servers (notably our pypi mirror) that is currently broken | 14:43 |
mordred | ihrachys: yes. we're having some issues with our mirror in hpcloud and are working on it | 14:43 |
ihrachys | cool, thanks | 14:44 |
*** yfried is now known as yfried|afk | 14:44 | |
*** ashleigh has quit IRC | 14:44 | |
fungi | ihrachys: we've stopped running jobs in hpcloud now until it's resolved, so the failures should subside | 14:44 |
ihrachys | so rechecks justified? | 14:44 |
mordred | ihrachys: yup | 14:45 |
*** Daisy has joined #openstack-infra | 14:45 | |
*** dangers_away is now known as dangers | 14:45 | |
*** Daisy has quit IRC | 14:45 | |
openstackgerrit | Thierry Carrez proposed openstack-infra/puppet-statusbot: Enable #success feature from statusbot https://review.openstack.org/224768 | 14:45 |
openstackgerrit | Thierry Carrez proposed openstack-infra/system-config: Enable the #success feature in statusbot https://review.openstack.org/224769 | 14:45 |
jeblair | restarted carbon-cache | 14:46 |
mordred | fungi: so - users and projects can be many to many - a project is a place in which you put resources, such as vms. a user is an acocunt that can have a role in a project | 14:46 |
clarkb | we can also update dns temporarily to point at iad | 14:46 |
ttx | clarkb: ^ those should be enough to enable the #success feature -- we might want to land them in a particular order though I could not decide which. | 14:46 |
fungi | clarkb: not a terrible idea | 14:46 |
jhesketh | Morning | 14:46 |
clarkb | I think iad is closest as the crow flies | 14:47 |
ttx | Also wondering if we enforce '=>' alignment and whether I should correct untouched lines. | 14:47 |
*** skolekonov is now known as _skolekonov | 14:47 | |
jeblair | ttx: not on system-config | 14:47 |
*** geoffarnoldX is now known as geoffarnold | 14:47 | |
clarkb | ttx we do in everything but system-config | 14:47 |
jhesketh | mriedem: looking | 14:47 |
*** mmedvede has joined #openstack-infra | 14:47 | |
ttx | ok, so that should work | 14:47 |
fungi | clarkb: i'm tempted to wait a bit and see if hpcloud comes back with a quick resolution before making dns changes we need to undo again | 14:47 |
jeblair | ttx: and yeah, .144 is a test host. i can spin up a real one today. what should it be called? | 14:47 |
*** ildikov has joined #openstack-infra | 14:48 | |
ttx | jeblair: your guess is as good as mine | 14:48 |
fungi | jeblair: ttx: any reason the module shouldn't be deployed to the summit prep server? or should it not coexist with cheddar? | 14:48 |
clarkb | fungi +1 | 14:48 |
*** btully has quit IRC | 14:49 | |
ttx | fungi: current cheddar host is manually deployed, so not sure how that would play out. But we can certainly try | 14:49 |
fungi | (noting that the cheddar deployment on the summit prep server needs puppeting still, though the server itself is in puppet) | 14:49 |
ttx | yeah,n the cheddar stuff is not even on Gerrit | 14:49 |
*** Daisy has joined #openstack-infra | 14:50 | |
fungi | oh, ugh | 14:50 |
fungi | maybe we just avoid touching that then | 14:50 |
ttx | those 6 months sure did fly | 14:50 |
fungi | for now | 14:50 |
*** oomichi has joined #openstack-infra | 14:51 | |
*** Piet has joined #openstack-infra | 14:51 | |
*** achanda has joined #openstack-infra | 14:52 | |
jeblair | odsreg.o.o then? | 14:53 |
jeblair | for now | 14:53 |
pabelanger | fungi: is there a reason not to add the other mirrors to PIP_USE_MIRRORS for jenkins slaves? In an effort to find an available mirror the if the default goes down? | 14:53 |
ttx | jeblair: sure | 14:53 |
pabelanger | I guess we only use the local pypi only | 14:53 |
*** dims_ has quit IRC | 14:53 | |
jroll | mordred: out of curiousity, what's the status with phabricator stuff, anything I can do to help move that? | 14:54 |
clarkb | pabelanger the way pip works evwry single one is contacted | 14:54 |
clarkb | mirrors arent for ha in your pypi config | 14:54 |
*** bhunter71 has joined #openstack-infra | 14:54 | |
fungi | pabelanger: well, one reason is so that situations like this don't fly under the radar until something is broken with several of our mirror servers | 14:54 |
clarkb | fungi the joba would fail abyways | 14:55 |
fungi | yeah, that too | 14:55 |
clarkb | because pip would ask for the index fail and exit | 14:55 |
pabelanger | fungi: Ya, thats the downside I see. Sometime, you want things to break and scream so you need to fix them | 14:55 |
*** dims_ has joined #openstack-infra | 14:55 | |
*** lucasagomes has joined #openstack-infra | 14:56 | |
*** btully has joined #openstack-infra | 14:56 | |
*** rfolco has joined #openstack-infra | 14:56 | |
*** armax has joined #openstack-infra | 14:57 | |
*** asselin__ has joined #openstack-infra | 14:57 | |
*** rick-chen has joined #openstack-infra | 14:58 | |
jeblair | Clint: ^ see question from jroll | 14:58 |
*** asselin_ has quit IRC | 14:58 | |
*** vgridnev has quit IRC | 14:59 | |
clarkb | I think tge idea is that you really have non overlappying indexes and need to look at all of them to find the correct packages | 14:59 |
clarkb | like if you have a bunch of non open source python hosting your web app | 14:59 |
*** unicell1 has joined #openstack-infra | 15:00 | |
*** dramalho has joined #openstack-infra | 15:00 | |
clarkb | * for hosting | 15:00 |
*** unicell has quit IRC | 15:00 | |
*** tiswanso has quit IRC | 15:00 | |
fungi | right, or "internal" pip repositories in your company for locally-produced packages | 15:00 |
rick-chen | anteaya: HI, Do you know how to revert the CI verify machine to be clean for next testing? | 15:00 |
*** glauco has joined #openstack-infra | 15:01 | |
fungi | rick-chen: we delete the machine and boot a fresh one | 15:01 |
fungi | for each job run | 15:01 |
*** tiswanso has joined #openstack-infra | 15:01 | |
*** ccarrara has joined #openstack-infra | 15:01 | |
*** yfried|afk is now known as yfried | 15:02 | |
*** Swami has joined #openstack-infra | 15:02 | |
fungi | rick-chen: because especially if you're running a job which has root access to the machine and is testing untrusted code change proposals, the job could render the worker completely unusable/unreachable (we see that happen pretty often in fact) | 15:02 |
rick-chen | fungi: Use nodepool? | 15:02 |
fungi | rick-chen: yes, that's why we wrote nodepool | 15:02 |
*** zz_dimtruck is now known as dimtruck | 15:03 | |
rick-chen | fungi: Do you have detail how to build up node pool document? | 15:04 |
*** bltavares has joined #openstack-infra | 15:04 | |
*** jsavak has quit IRC | 15:04 | |
fungi | rick-chen: nodepool has documentation at http://docs.openstack.org/infra/nodepool/ | 15:04 |
pabelanger | wouldn't it be cool is nodepool also built the targets too. Oh, you need a new jenkins master, let me launch that for you | 15:05 |
*** jsavak has joined #openstack-infra | 15:05 | |
Clint | jeblair: thanks | 15:05 |
hashar | rick-chen: the doc is part of the source repo openstack-infra/nodepool.git you can build it locally using: tox -e docs | 15:05 |
rick-chen | fungi: I use vphere plugin for esxi, but I got the problem that cannot post the result to the gerrit review windows. | 15:05 |
anteaya | rick-chen: I don't see you in the #openstack-cinder channel | 15:05 |
fungi | pabelanger: yep, we talked about that, though for jenkins the trick is that it's nontrivial to automate a new deployment of one | 15:05 |
hashar | rick-chen: resulting HTML will end up in /doc/build/html/ | 15:05 |
anteaya | rick-chen: these questions are great questions for the other cinder third party ci operators | 15:06 |
Clint | jroll: http://docs-draft.openstack.org/72/219372/7/check/gate-infra-specs-docs/5e9573f//doc/build/html/status/maniphest.html is slightly out of date | 15:06 |
smcginnis | rick-chen: Just joining. What's the question? | 15:06 |
anteaya | and asking them in #openstack-cinder is a great way to get to know cinder developers | 15:06 |
rick-chen | anteaya: OK, Got. | 15:06 |
anteaya | smcginnis: thank you | 15:06 |
clarkb | and jenkins is not required | 15:06 |
pabelanger | fungi: Ya, I'm going to try some stuff with ansible to see if I can automate some of the manual steps. But, I might try adding some code into nodepool too | 15:06 |
smcginnis | rick-chen: If it's cinder specific, let's head over to -cinder. | 15:06 |
*** zhenguo has quit IRC | 15:06 | |
anteaya | smcginnis: rick-chen is asking about how to get a clean environment for testing | 15:06 |
hashar | anteaya: is there any third parties using Nodepool already? | 15:07 |
anteaya | smcginnis: we directed him to look at nodepool | 15:07 |
anteaya | hashar: many | 15:07 |
smcginnis | anteaya: OK, cool. Thanks! | 15:07 |
anteaya | smcginnis: following up in cinder is a great way to integrated with the cinder folks | 15:07 |
anteaya | in my opinion | 15:07 |
hashar | anteaya: damn I thought I was one of the early adopters :-}Â Good to see it matches the needs of other CIs | 15:07 |
anteaya | hashar: you were | 15:07 |
anteaya | and still are an early adopter of many of our tools | 15:08 |
anteaya | but eventually other folks climb onto a good thing :) | 15:08 |
hashar | I turned it on for prod usage yesterday \O/ | 15:08 |
fungi | pabelanger: at the moment we've not really seen a lot of benefit to continuing to do anything more than limp our use of jenkins along until we finish getting rid of it. certainly scaling jenkins masters in and out is an infrequent enough task so as to be beneath the threshold of necessity | 15:08 |
anteaya | hashar: yay! | 15:08 |
jroll | Clint: cool, ty, I'm excited for this | 15:09 |
jhesketh | to save me reading scrollback... did we just do a nodepool restart? | 15:09 |
*** achanda has quit IRC | 15:09 | |
Clint | jroll: also feel free to code-review https://review.openstack.org/#/c/219372/ if you have opinions about that page | 15:10 |
pabelanger | fungi: Ya, would be more a task to see if it could be done vs pushing it back upstream. | 15:10 |
fungi | jhesketh: nodepoold hasn't been restarted for a week, no | 15:10 |
jroll | there are currently pypi mirror issues yes? | 15:10 |
fungi | jhesketh: i reloaded it to pick up the hpcloud max-servers=0 config change but that's it | 15:10 |
jhesketh | fungi: what's up with the broken job stats on http://status.openstack.org/zuul/ | 15:11 |
hashar | and now for my 2 million dollars morning question: could Zuul rely on OpenStack Mistral for workflow / job definitions? | 15:11 |
*** dkranz has quit IRC | 15:11 | |
mordred | hashar: out current plan is to rely on ansible | 15:12 |
mordred | hashar: our | 15:12 |
mordred | hashar: does mistral support operating against clouds it's not installed in? | 15:12 |
fungi | jhesketh: looks like carbon-cache had a sad on graphite.o.o and jeblair logged in and restarted it | 15:12 |
jhesketh | fungi: okay, good to know, thanks :-) | 15:12 |
fungi | jhesketh: same oom condition we seem to hit there frequently | 15:12 |
*** mariojv has joined #openstack-infra | 15:13 | |
anteaya | jhesketh: what are your plans for the day? I was soon going to drive downtown | 15:13 |
jhesketh | anteaya: was just going to do bits of work, pack and head off... I was contemplating wandering around though | 15:14 |
mordred | jhesketh: with you in the US and me in Europe, our globla core distributoin is strange | 15:14 |
hashar | mordred: I have no idea. Seems it can be run without an OpenStack environment. That needs a worker on the clients though where as I think Ansible just compile everything and send the resulting blob; clienteles? | 15:14 |
jhesketh | anteaya: but I wouldn't be ready for a bit, so I might just do my own thing :-) | 15:15 |
mordred | hashar: yah. we want to avoid agents because they pollute the test nodes | 15:15 |
anteaya | sounds good | 15:15 |
mordred | hashar: this is one of the things we really like about the ansible job definition approach | 15:15 |
hashar | mordred: this way you only need a ssh connection and python right? | 15:15 |
mordred | hashar: allows the worker machines to be extremely minimal in what exists outside of the job definition | 15:15 |
mordred | hashar: yah | 15:15 |
hashar | \O/ | 15:15 |
mordred | hashar: and I think we're at the point where both of those are fairly standard :) | 15:16 |
hashar | mordred: so will Zuul define the ansible tasks ? Or would you still use JJB to generate them ? | 15:16 |
jhesketh | mordred: yes, but so long as we all keep moving around, we should be fine | 15:16 |
jhesketh | mordred: it's like musical chairs, we can't stop moving | 15:16 |
mordred | hashar: we have a whole spec! one sec, I get you a link | 15:16 |
mordred | hashar: http://specs.openstack.org/openstack-infra/infra-specs/specs/zuulv3.html | 15:16 |
hashar | mordred: yeah the Zuul v3 spec, I haven't found time to read it yet :-(((( | 15:17 |
mordred | hashar: short version - we will have zuul define things about the mapping of job content to workers | 15:17 |
mordred | hashar: this will also describe how many of what type of machine you might want | 15:17 |
openstackgerrit | Merged openstack-infra/irc-meetings: Add more details to the Service Function Chaining meeting https://review.openstack.org/224747 | 15:17 |
mordred | hashar: but the actual content itself will just be ansible roles/playbooks | 15:17 |
mordred | hashar: so that it would be conceivable that you could use your real deployment code as part of your CI | 15:17 |
pabelanger | hashar: I recommend the read! I am super excited for it | 15:18 |
*** DericHorn-HP has joined #openstack-infra | 15:18 | |
pabelanger | mordred: !!!! | 15:18 |
hashar | I will for sure | 15:18 |
hashar | gotta upgrade Wikimedia Zuul to catch up with six months of dev you guys did | 15:18 |
pabelanger | using real depolyment code to do both production and testing environments is super awesome | 15:18 |
*** tongli has quit IRC | 15:19 | |
pabelanger | that's the main reason for me right now to use ansible | 15:19 |
*** alexpilotti has quit IRC | 15:19 | |
*** angdraug has joined #openstack-infra | 15:20 | |
hashar | queue: integrated # Shared queues are manually built  \O/ | 15:20 |
*** hemnafk is now known as hemna | 15:21 | |
* mordred loves making hashar excited | 15:21 | |
hashar | mordred: you could even have Zuul to ship built-in jobs such as the tox runner. Would save third parties a bunch of time I guess | 15:22 |
*** johnsom has joined #openstack-infra | 15:22 | |
mordred | yup | 15:22 |
*** MarkAtwood has joined #openstack-infra | 15:22 | |
mordred | ttx, morgan, dhellmann: https://review.openstack.org/#/c/224739/ if you get a sec | 15:22 |
*** madong_ has quit IRC | 15:23 | |
*** madong_ has joined #openstack-infra | 15:24 | |
*** alexpilotti has joined #openstack-infra | 15:24 | |
*** dkranz has joined #openstack-infra | 15:24 | |
*** amitgandhinz has joined #openstack-infra | 15:24 | |
morgan | mordred: yep was on my list for today but ++ provided Jenkins doesn't get in the way | 15:25 |
*** puranamr has joined #openstack-infra | 15:25 | |
mordred | morgan: thanks! | 15:27 |
*** ozamiatin has quit IRC | 15:27 | |
*** yfried has quit IRC | 15:27 | |
fungi | mordred: see my comment to your 224743 governance change. this may have consequences you did not intend (or perhaps you did intend, i don't know) | 15:28 |
fungi | mordred: i'm not opposed to the cleanup, but the resulting retroactive invalidation should probably be mentioned in the commit message | 15:29 |
*** krtaylor has quit IRC | 15:29 | |
mordred | fungi: nod. I given the timing - I would be fine holding off on voting such a thing until after the current TC election - and I agree, it should definitely be mentioned | 15:30 |
*** hyakuhei has joined #openstack-infra | 15:30 | |
fungi | mordred: well, luckily i'll be generating the electoral rolls for the upcoming tc election tomorrow, at the same time i do so for the ptl elections, and the review is unlikely to get approved before the next tc meeting anyway | 15:31 |
*** MarkAtwo_ has joined #openstack-infra | 15:31 | |
*** earlephilhower has joined #openstack-infra | 15:32 | |
* hyakuhei is apparently unable to track dates or effectively grok email :( | 15:32 | |
*** sridhar_ram has joined #openstack-infra | 15:32 | |
*** fhubik has quit IRC | 15:32 | |
*** mdenny has joined #openstack-infra | 15:32 | |
fungi | also the final batch of complimentary contributor discount codes for the upcoming summit has already been sent, so no impact there until the "n" summit timeframe anyway | 15:32 |
*** cbader has joined #openstack-infra | 15:33 | |
mordred | hyakuhei: dates and email are both hard | 15:34 |
anteaya | which is why for critical dates and times I confirm with a few others to ensure I am thinking the right thing | 15:34 |
anteaya | so confirmation is good | 15:34 |
hyakuhei | oh don’t even get me started on timeframes :( | 15:34 |
anteaya | ha ha ha | 15:34 |
hyakuhei | s/frames/zones/ | 15:34 |
*** bpokorny has joined #openstack-infra | 15:35 | |
*** zeih has joined #openstack-infra | 15:35 | |
fungi | this is why i try to do things at the earliest possible moment rather than leaving them for the last possible moment. that way if i miscalculate, at worst i look proactive ;) | 15:35 |
anteaya | good strategy! | 15:36 |
*** mmedvede has quit IRC | 15:36 | |
purp | Hi fungi jeblair et al. HP Cloud should be available to you again. | 15:37 |
fungi | hyakuhei: i assumed you were talking about einstein spacetime frames of reference | 15:37 |
mordred | purp: yay! | 15:37 |
anteaya | purp: yay \o/ | 15:37 |
anteaya | purp: thank you | 15:37 |
* mordred hands purp a completely uneaten basket of fruit | 15:37 | |
anteaya | wow | 15:37 |
hyakuhei | fungi: those too! | 15:37 |
anteaya | something useful | 15:37 |
purp | Heh. Thanks. I did so little. | 15:37 |
anteaya | purp: timing | 15:37 |
anteaya | it is all timing | 15:37 |
hyakuhei | In fact, if I’m travelling at lightspeed and you’re walking backwards I think you’ll find the election window is still open… | 15:37 |
anteaya | purp: mordred never hands out useful things to anyone else | 15:38 |
anteaya | purp: you're special | 15:38 |
Clint | i don't think that's true | 15:38 |
Clint | unless you think fuzzy llamas are not useful | 15:38 |
fungi | purp: thanks! i'll check again now | 15:38 |
mordred | anteaya: come on. you did not enjoy the somewhat unfrazzled aardvark? | 15:39 |
*** tongli has joined #openstack-infra | 15:39 | |
*** zeih has quit IRC | 15:39 | |
anteaya | it was handy | 15:39 |
anteaya | it eats ants | 15:40 |
anteaya | doesn't it? | 15:40 |
*** tonytan4ever has quit IRC | 15:40 | |
jeblair | openstackci2-hpcloud-region-b.sh <-- this one, right? | 15:40 |
anteaya | well llama fur is useful I think | 15:40 |
jeblair | i still get ERROR (Unauthorized): Tenant not accessible (HTTP 401) | 15:40 |
fungi | jeblair: i get the same' | 15:40 |
*** devlaps has joined #openstack-infra | 15:40 | |
fungi | purp: is there some propagation delay? | 15:41 |
jeblair | fungi, mordred: btw, i built gra1 on trusty without thinking... i think we have some trustification to do with our pypi mirror puppet | 15:41 |
anteaya | okay I am running away for a bit | 15:42 |
anteaya | I don't think anyone is waiting on me for anything | 15:42 |
anteaya | see all y'all later | 15:42 |
*** dramalho has quit IRC | 15:43 | |
fungi | jeblair: most likely issue will be accommodating apache 2.4isms in the vhost config | 15:43 |
*** glauco has quit IRC | 15:43 | |
jeblair | fungi: yep | 15:43 |
jeblair | working on that now | 15:43 |
fungi | i need to disappear to run some errands, but should be back within the hour | 15:43 |
*** Hal has quit IRC | 15:43 | |
jeblair | fungi, clarkb: looks like nodepool was not restarted? | 15:44 |
jeblair | what's the status there, and when am i clear to do so? :) | 15:44 |
openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: The apikey is now optional https://review.openstack.org/224796 | 15:44 |
jeblair | mordred: ^ | 15:44 |
mordred | jeblair: you are clear to restart. the issues in the tests were related to fake config construction | 15:44 |
*** moravec has joined #openstack-infra | 15:44 | |
mordred | jeblair: or, rather, construction of configs for a scheme we do not use in production | 15:44 |
clarkb | jeblair mordred fix didnt work. greghaynes fixed oscc instead which has a new release | 15:45 |
jeblair | okay, so all i have to do now is wait a few hours for dib builds to complete, then we can see if ovh works | 15:45 |
clarkb | but did we merge pbr update? | 15:45 |
clarkb | tgats what we were waiting on | 15:45 |
*** dramalho has joined #openstack-infra | 15:45 | |
*** dramalho has quit IRC | 15:45 | |
*** hamzy has joined #openstack-infra | 15:47 | |
*** bltavares has quit IRC | 15:47 | |
*** annegentle has joined #openstack-infra | 15:47 | |
*** hodos|2 has joined #openstack-infra | 15:48 | |
*** geoffarnold is now known as geoffarnoldX | 15:49 | |
fungi | jeblair: clarkb: mordred: i've gone ahead and approved 224766 for now so that puppet agent can get enabled again | 15:49 |
*** IvanKliuk has left #openstack-infra | 15:49 | |
fungi | i have a wip revert proposed which can be approved once we're sure the issue in hpcloud is resolved | 15:50 |
*** mmedvede has joined #openstack-infra | 15:50 | |
*** Ala has quit IRC | 15:50 | |
fungi | at the moment pypi.region-b.geo-1.openstack.org is still not responding to ping, so not sure how long our account reenablement will take to be effective again | 15:50 |
*** geoffarnoldX is now known as geoffarnold | 15:50 | |
*** puranamr has quit IRC | 15:51 | |
*** oomichi has quit IRC | 15:51 | |
purp | fungi jeblair shouldn't be propagation delay. I'll check in tho | 15:51 |
fungi | anyway, really heading to do errands now | 15:51 |
clarkb | maybe we need to rebuild it? | 15:51 |
fungi | clarkb: well, also still getting "ERROR (Unauthorized): Tenant not accessible (HTTP 401)" with that account so rebuilding it probably isn't possible yet | 15:51 |
clarkb | ah | 15:52 |
jeblair | wow, erm. nodepool throws an exception every time through the loop when there's a missing disk image... | 15:52 |
*** annegentle has quit IRC | 15:52 | |
* jeblair switches to nodepool hacking | 15:53 | |
*** annegentle has joined #openstack-infra | 15:53 | |
greghaynes | jeblair: oh? | 15:55 |
*** matrohon has joined #openstack-infra | 15:56 | |
mriedem | clarkb: fungi: i think we're going to need a force merge on stable/juno for a chicken/egg issue | 15:56 |
mriedem | detailed here https://bugs.launchpad.net/python-ceilometerclient/+bug/1494516/comments/8 | 15:56 |
openstack | Launchpad bug 1494516 in python-ceilometerclient "python-ceilometerclient 1.0.12 has uncapped oslo.utils which breaks unit test jobs on stable/juno" [Critical,New] | 15:56 |
greghaynes | jeblair: it it when it tries to rm the missing image? | 15:56 |
*** krtaylor has joined #openstack-infra | 15:57 | |
*** markus_z has quit IRC | 15:57 | |
openstackgerrit | James E. Blair proposed openstack-infra/system-config: Use ubuntu-trusty as base for u-t-check in nodepool https://review.openstack.org/224803 | 15:58 |
jeblair | clarkb, greghaynes: first there's that ^ | 15:58 |
*** e0ne has quit IRC | 15:59 | |
*** LimorStotland has quit IRC | 15:59 | |
greghaynes | ok. I did notice yesterday that if an image is missing on disk itll try and rm it with no exception handling before it cleans up the db | 15:59 |
greghaynes | so just loop on that | 15:59 |
clarkb | jeblair your gra1 image is -check | 15:59 |
*** e0ne has joined #openstack-infra | 16:00 | |
clarkb | line 918ish | 16:00 |
*** [HeOS] is now known as HeOS | 16:00 | |
*** ashleigh has joined #openstack-infra | 16:01 | |
jeblair | clarkb: hrm. now i'm confused. | 16:01 |
*** serg_melikyan has joined #openstack-infra | 16:01 | |
jeblair | it should have uploaded an image yesterday, because there should already be an ubuntu-trusty image | 16:01 |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: make gate-puppet-ironic-puppet-beaker-rspec-dsvm-trusty voting https://review.openstack.org/224805 | 16:02 |
*** purp has quit IRC | 16:02 | |
*** sabeen has quit IRC | 16:02 | |
clarkb | jeblair not raw | 16:02 |
clarkb | jeblair the new image type forces a rebuild | 16:03 |
greghaynes | ah, yep | 16:03 |
*** warpc__ is now known as warpc | 16:03 | |
mriedem | fungi: clarkb: ignore force-merge thing, i tihnk i have another way | 16:03 |
*** rlandy has quit IRC | 16:03 | |
*** rick-chen has quit IRC | 16:04 | |
jeblair | okay.... so open questions are: why didn't that happen, and why are there 5 images showing up as building in the dib-image-list with only one running? | 16:04 |
*** yamamoto has quit IRC | 16:04 | |
jeblair | oh, are the other 4 queued? | 16:04 |
*** woodster_ has joined #openstack-infra | 16:04 | |
clarkb | yes they are serial | 16:04 |
jeblair | then there should be a new db state :) | 16:05 |
greghaynes | I think we just query for any image of that type in state building | 16:05 |
*** sergmelikyan has quit IRC | 16:05 | |
greghaynes | yea, and if we find one we wait | 16:05 |
*** hichihara has quit IRC | 16:05 | |
*** jlanoux has quit IRC | 16:05 | |
greghaynes | type is overloaded, any image with that name. | 16:05 |
clarkb | it puts them in a Queue object and pulls one at atime | 16:05 |
jeblair | clarkb: yeah, i knew that, i was just surprised the cli told me 5 were building | 16:05 |
clarkb | we can have popping off that be a new state change | 16:05 |
jeblair | it looks like you can infer that by the presence of a 'version' field | 16:06 |
*** dtantsur is now known as dtantsur|afk | 16:06 | |
*** erikwilson has joined #openstack-infra | 16:06 | |
*** moravec has quit IRC | 16:07 | |
jeblair | clarkb, greghaynes: i'm worride that image type differences are suppressed... | 16:08 |
*** moravec has joined #openstack-infra | 16:09 | |
greghaynes | jeblair: You sure its not related to the traceback? | 16:09 |
jeblair | if you say that we need to do a new image build for a new type; it looks like the thing that goes into the queue is only a single record | 16:09 |
openstackgerrit | Merged openstack/requirements: Deal with underscores in names in edit-constraints https://review.openstack.org/224259 | 16:09 |
jeblair | greghaynes: no | 16:09 |
jeblair | greghaynes: not sure :) | 16:09 |
jeblair | greghaynes: well, tangentially -- | 16:10 |
*** unicell1 has quit IRC | 16:10 | |
jeblair | greghaynes: in that i think we're only checking the _name_ to see if an image is building and skipping in that case | 16:10 |
*** bexelbie has quit IRC | 16:10 | |
*** hyakuhei has quit IRC | 16:11 | |
jeblair | greghaynes: (we're 'skipping' incorrectly by throwing an exception, but even if we did what i think the code intended we would still only build ubuntu-trusty qcow and never get around to building u-t raw) | 16:11 |
greghaynes | yea, I think that just serializes us though - in theory the main loop will pick up the missing image type I think | 16:11 |
greghaynes | hrm | 16:11 |
jeblair | greghaynes: line 2070 only queries by image name | 16:12 |
clarkb | jeblair yes each image in the db has N formats on disk | 16:12 |
jeblair | greghaynes: oh, we're supposed to build all types at once i think | 16:12 |
clarkb | yes | 16:13 |
jeblair | line 865 | 16:13 |
jeblair | clarkb: ah, i misunderstood you | 16:13 |
openstackgerrit | Alexey Elagin proposed openstack-infra/project-config: change verify group to fuel-plugins-ci https://review.openstack.org/224159 | 16:13 |
*** Daisy has quit IRC | 16:13 | |
jeblair | clarkb: we _do_ need a new image built for adding a new type, but we don't need one build per-type | 16:13 |
*** purp has joined #openstack-infra | 16:13 | |
openstackgerrit | Matt Riedemann proposed openstack/requirements: stable/juno: adjust python-ceilometerclient version range https://review.openstack.org/224807 | 16:13 |
clarkb | correct | 16:13 |
mriedem | tonyb: ^ | 16:13 |
jeblair | clarkb: next run we end up with one build producing multiple types | 16:13 |
clarkb | yup | 16:13 |
*** unicell has joined #openstack-infra | 16:13 | |
*** Daisy has joined #openstack-infra | 16:14 | |
*** abregman_ has joined #openstack-infra | 16:14 | |
greghaynes | yea, we pass the multipe types in to dib at once | 16:14 |
jeblair | okay, back to the drawing board for why this didn't happen yesterday :) | 16:14 |
*** hashar has quit IRC | 16:14 | |
*** Daisy has quit IRC | 16:14 | |
*** tonytan4ever has joined #openstack-infra | 16:15 | |
*** abregman has quit IRC | 16:15 | |
*** e0ne has quit IRC | 16:15 | |
*** che-arne has quit IRC | 16:16 | |
*** romcheg has quit IRC | 16:16 | |
jeblair | looking at the logs... i think it's been sucessfully building ubuntu-trusty images all night | 16:16 |
jeblair | it just consistently thinks they are missing | 16:16 |
openstackgerrit | Kevin L. Mitchell proposed stackforge/python-jenkins: Allow setting the next build number https://review.openstack.org/224275 | 16:16 |
*** che-arne has joined #openstack-infra | 16:16 | |
*** bharathm has joined #openstack-infra | 16:17 | |
greghaynes | jeblair: Is there a tb somewhere? | 16:17 |
*** rlandy has joined #openstack-infra | 16:18 | |
openstackgerrit | Dan Moravec proposed openstack-infra/subunit2sql: Add --verbose option to show sql statements generated https://review.openstack.org/224314 | 16:18 |
jeblair | greghaynes: nope (aside from the one about skipping) | 16:18 |
jeblair | 2015-09-17 07:02:56,227 WARNING nodepool.NodePool: Missing disk image ubuntu-trusty-check | 16:18 |
jeblair | greghaynes: i'm wondering if we've introduced a layer of abstraction in the config that doesn't actually exist -- maybe the provider image name needs to match the dib image name | 16:19 |
clarkb | hrm I wonder if it has diskimage name, image name, and label name cobfused | 16:19 |
clarkb | ya that | 16:19 |
*** scheuran has quit IRC | 16:19 | |
greghaynes | jeblair: ok, so that is the method that seemed kind of broken to me | 16:19 |
greghaynes | when I was doing builder stuff yesterday | 16:19 |
*** sdake_ has joined #openstack-infra | 16:19 | |
*** fitoduarte has joined #openstack-infra | 16:20 | |
openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Initial support for graph panel https://review.openstack.org/224811 | 16:20 |
greghaynes | jeblair: What its going to do is check if the image exists on disk for all the types in the config (which it wont), then its going to try and rm the missing image and retry | 16:20 |
greghaynes | and when I say retry its going to set found = false and return, so itll just wait for that method to be called again | 16:20 |
*** ifarkas has quit IRC | 16:20 | |
*** jsavak has quit IRC | 16:20 | |
*** moravec has quit IRC | 16:21 | |
*** jsavak has joined #openstack-infra | 16:21 | |
mriedem | so is this an ok time to announce my candidacy for PTL of magnetodb? | 16:21 |
pabelanger | mordred: jeblair: do you mind re-approving https://review.openstack.org/#/c/223280/? queue gate failed last night, recheck is clean today | 16:22 |
greghaynes | jeblair: actually, it does call buildImage after, so it should kick off a new build | 16:22 |
greghaynes | jeblair: something I would check in the logs - does the filename dib makes match the filename in the row for the dib image it says is missing? | 16:23 |
*** unicell1 has joined #openstack-infra | 16:23 | |
*** sdake has quit IRC | 16:23 | |
greghaynes | specifically for the raw type, might be somethign wierd going on with that | 16:23 |
clarkb | greghaynes but we test this | 16:23 |
clarkb | in dsvm and unittests | 16:23 |
greghaynes | clarkb: for raw? | 16:23 |
clarkb | tge specific type doesnt matter | 16:24 |
greghaynes | well, if dib doesnt append a .raw for example | 16:24 |
clarkb | oh unless it does | 16:24 |
*** tiswanso has quit IRC | 16:24 | |
clarkb | :| | 16:24 |
clarkb | damnit dib | 16:24 |
* greghaynes is kind of just theorizing, might not be the case | 16:24 | |
greghaynes | I dont actually remember if dib does that | 16:24 |
*** Daisy has joined #openstack-infra | 16:24 | |
*** tiswanso has joined #openstack-infra | 16:24 | |
*** unicell has quit IRC | 16:25 | |
jeblair | i'm pretty sure it thinks it's missing because the image name (not the suffix) doesn't match | 16:25 |
*** tiswanso has quit IRC | 16:25 | |
*** tiswanso has joined #openstack-infra | 16:25 | |
clarkb | our tests do qcow2 with real dib and qcow2 and vhd with the fake script dib in unittests | 16:26 |
jeblair | yeah, we're hitting this: 2015-09-17 06:13:35,141 WARNING nodepool.NodePool: Missing disk image ubuntu-trusty-check | 16:26 |
jeblair | on line 1959 | 16:26 |
jeblair | followed by: 2015-09-17 06:13:35,143 DEBUG nodepool.NodePool: Queued image building task for ubuntu-trusty | 16:26 |
*** yamamoto has joined #openstack-infra | 16:26 | |
greghaynes | jeblair: that happens if it cant fine name + "." + type on disk | 16:26 |
purp | fungi jeblair clarkb: Sorry, I'm too churned this morning for prolonged attention. Has the HP cloud account come back for you yet? | 16:26 |
greghaynes | jeblair: line 1941 | 16:26 |
jeblair | greghaynes: i don't think it's making it past line 1932 | 16:27 |
greghaynes | looks like dib should make a .raw though, so that theory is out | 16:27 |
greghaynes | jeblair: oh, it just isnt finding any matching images at all? :( | 16:28 |
* dims_ checking in on zuul... | 16:28 | |
*** pblaho has quit IRC | 16:28 | |
*** romcheg has joined #openstack-infra | 16:28 | |
jeblair | purp still getting ERROR (Unauthorized): Tenant not accessible (HTTP 401) | 16:28 |
purp | Thanks, jeblair. I'll go ask some further questions. | 16:29 |
greghaynes | we could definitely put better debug info to say what specific image + type it thinks is missing | 16:29 |
clarkb | and ping still fails | 16:29 |
*** Daisy has quit IRC | 16:29 | |
greghaynes | jeblair: ok, so you dont see the image filename missing log message im guessing is why youre saying its not going around that loop at all | 16:30 |
jeblair | greghaynes: from existing log messages, i know that it thinks it's missing u-t-c, and so it decides to build u-t (which is correct). so we handled the dinection in one place, not another. | 16:30 |
jeblair | greghaynes: correct, no 'missing filename' msg | 16:30 |
jeblair | greghaynes: the loop is "u-t-c" is missing; built "u-t"; "u-t" is being built; "u-t-c" is missing.... | 16:31 |
*** fawadkhaliq has quit IRC | 16:31 | |
jeblair | greghaynes: the loop is "u-t-c" is missing; build "u-t"; "u-t" is being built; "u-t" is built; "u-t-c" is missing.... | 16:31 |
*** unicell1 has quit IRC | 16:32 | |
mordred | jeblair, clarkb: I just had a phone call but am bck - anything need my attention righ tnow? | 16:32 |
*** matrohon has quit IRC | 16:32 | |
greghaynes | jeblair: huh. Can you see the dib command it ends up running for u-t-c? | 16:32 |
jeblair | greghaynes: yes | 16:32 |
*** serg_melikyan has quit IRC | 16:32 | |
greghaynes | jeblair: and it has raw in the types? | 16:33 |
*** sergmelikyan has joined #openstack-infra | 16:33 | |
jeblair | 2015-09-17 06:13:35,157 INFO nodepool.DiskImageBuilderThread: Running disk-image-create -x -t qcow2,vhd,raw --no-tmpfs --qemu-img-options 'compat=0.10' -o /opt/nodepool_dib/ubuntu-trusty-1442470415 ubuntu-minimal vm simple-init openstack-repos nodepool-base node-devstack cache-bindep growroot | 16:33 |
*** jordanP has quit IRC | 16:33 | |
*** HeOS has quit IRC | 16:33 | |
mordred | jeblair: btw - it's not a problem, but I believe we can rmeove --qemu-img-options 'compat=0.10' now | 16:34 |
jeblair | just so we're clear -- i believe i've known what the problem is for 15 minutes now... | 16:34 |
mordred | ok | 16:34 |
mordred | cool | 16:34 |
greghaynes | ok, so for some reason the row for that image isnt going to READY | 16:34 |
*** sdake has joined #openstack-infra | 16:34 | |
jeblair | no, the problem is the name mismatch. let me work on a fix by way of explanation. :) | 16:34 |
greghaynes | haha, ok | 16:34 |
*** jistr has quit IRC | 16:35 | |
* greghaynes wonders if by mismatch you mean u-t vs u-t-c | 16:35 | |
greghaynes | or is that just the u-t dib line | 16:36 |
jeblair | greghaynes: ut/utc | 16:36 |
*** david-lyle has quit IRC | 16:36 | |
*** kiran-r has joined #openstack-infra | 16:37 | |
*** ifarkas has joined #openstack-infra | 16:37 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/224606 | 16:38 |
*** sdake_ has quit IRC | 16:38 | |
*** fedexo has joined #openstack-infra | 16:41 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements https://review.openstack.org/224685 | 16:43 |
clarkb | mordred we dont need compat because hpcloud upgraded? | 16:43 |
*** glauco has joined #openstack-infra | 16:43 | |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Correct missing DIB image detection https://review.openstack.org/224821 | 16:43 |
*** hyakuhei has joined #openstack-infra | 16:43 | |
jeblair | greghaynes, clarkb: ^ let me know what you think of that | 16:43 |
jeblair | (meanwhile, i'll correct the exception too) | 16:44 |
openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Initial support for graph panel https://review.openstack.org/224811 | 16:44 |
samueldmq | hello, could I get a couple of extra eyes on https://review.openstack.org/#/c/224103/ ? | 16:45 |
samueldmq | it has a +2 from fungi already, and it fixes a regression in our etherpad.o.o | 16:45 |
clarkb | jeblair seems right, dsvm job will test it doesnt break old behavior | 16:45 |
clarkb | jeblair maybe we should update that job to use mismatched names? | 16:46 |
mordred | clarkb: no, we don't need it because it's now just what dib does | 16:46 |
clarkb | you want to look in devstack/ and tools/check_devstack something or other to do that | 16:46 |
*** ericksonsantos has joined #openstack-infra | 16:46 | |
clarkb | mordred ah | 16:46 |
*** david-lyle has joined #openstack-infra | 16:47 | |
*** DericHorn-HP has quit IRC | 16:47 | |
mordred | jeblair: looks good | 16:48 |
*** mtanino has joined #openstack-infra | 16:48 | |
pabelanger | timrc_: some new grafyaml reviews up! Adds the graph panels support | 16:49 |
*** glauco has quit IRC | 16:49 | |
mordred | pabelanger: ooo | 16:49 |
timrc_ | pabelanger, Cool, I'll review today if my day job doesn't keep getting in the way :) | 16:49 |
timrc_ | pabelanger, I'm really looking forward to having grafyaml deployed because turtles... I mean metrics. | 16:50 |
*** timrc_ is now known as timrc | 16:50 | |
greghaynes | jeblair: have you retried deploying the hp pypi since last 401 unauthorized? (I am trying to kind of liason with support, curious what status is) | 16:50 |
*** derekh has quit IRC | 16:50 | |
pabelanger | timrc: Ya, going to start adding some of my local dashboards into project config. Then deal with getting grafyaml running upstream | 16:51 |
*** glauco has joined #openstack-infra | 16:51 | |
*** zeih has joined #openstack-infra | 16:51 | |
greghaynes | jeblair: They say they have reactivated services since you got that 401 so might be better now... | 16:51 |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Correct exception when waiting for image build https://review.openstack.org/224823 | 16:51 |
greghaynes | jeblair: also, awesome explanation of nodepool abstractions ;) | 16:52 |
jeblair | greghaynes: yay! | 16:52 |
*** unicell has joined #openstack-infra | 16:52 | |
jeblair | +----+------+--------+------------+-------------+----------+ | 16:52 |
jeblair | | ID | Name | Status | Task State | Power State | Networks | | 16:52 |
jeblair | +----+------+--------+------------+-------------+----------+ | 16:52 |
jeblair | +----+------+--------+------------+-------------+----------+ | 16:52 |
jeblair | nova list works ^ | 16:52 |
jeblair | :| | 16:52 |
zaro | morning | 16:53 |
clarkb | actually non dsvm is sufficient since it wasnt related to dib itself | 16:53 |
greghaynes | jeblair: is that supposed to be empty? | 16:53 |
clarkb | jeblair thats not what nova list should look like | 16:53 |
*** Swami has quit IRC | 16:53 | |
jeblair | greghaynes: i mean, ideally no. | 16:53 |
*** lucasagomes has quit IRC | 16:53 | |
jeblair | greghaynes: depends on whether we expect that they have deleted the server. | 16:53 |
jeblair | greghaynes: (and the other nodepool thing is here: https://review.openstack.org/224823 ) | 16:54 |
*** changbl has joined #openstack-infra | 16:55 | |
mordred | jeblair: well, since you're already working on trusty-ifying pypi mirrors, maybe this is a good time to make a shiny new trusty pypi mirror there too | 16:55 |
greghaynes | jeblair: yep, everything was delted | 16:55 |
*** dramalho has joined #openstack-infra | 16:55 | |
jeblair | greghaynes: then everything is working as expected! | 16:55 |
*** zeih has quit IRC | 16:55 | |
d0ugal | I've been added to https://review.openstack.org/#/admin/groups/190,members but it hasn't impacted my account. Wondering if I have somehow managed to make two gerrit accounts for dougal@redhat.com | 16:55 |
clarkb | if we have to update dns anyeays lets switch to iad and turn on hpcloud? | 16:56 |
*** salv-orlando has quit IRC | 16:56 | |
*** bltavares has joined #openstack-infra | 16:56 | |
clarkb | lower the ttl too so a seitch to new host is quicker | 16:56 |
*** DericHorn-HP has joined #openstack-infra | 16:56 | |
timrc | pabelanger, Cool, I'll contribute some of our stuff. | 16:56 |
timrc | I think we're going to get some really need data if/when my work merges to submit metrics from zuul by node label. | 16:56 |
*** fawadkhaliq has joined #openstack-infra | 16:57 | |
*** _kiran_ has joined #openstack-infra | 16:57 | |
timrc | At least that'll be true downstream where we're particularly resource-constrained. | 16:57 |
timrc | neat* not need | 16:57 |
*** nadya has quit IRC | 16:57 | |
jeblair | timrc: we're not particularly flush upstream at the moment | 16:57 |
zaro | waynr: ping | 16:58 |
*** serg_melikyan has joined #openstack-infra | 16:58 | |
timrc | jeblair, ;-) | 16:59 |
jeblair | mordred, clarkb: i'll go ahead and launch a trusty hpcloud node; it can sync while i hack out the puppet bits | 16:59 |
*** kiran-r has quit IRC | 16:59 | |
clarkb | ok | 16:59 |
jeblair | clarkb: are we going to need to ask hpcloud to let us use the internet again? | 16:59 |
clarkb | jeblair the internet? | 17:00 |
jeblair | clarkb: security groups | 17:00 |
mordred | jeblair: run "nova secgroup-list-rules" | 17:00 |
clarkb | oh yes you need to delete the rules and add a couple to open everything | 17:00 |
jeblair | | IP Protocol | From Port | To Port | IP Range | Source Group | | 17:01 |
jeblair | +-------------+-----------+---------+----------+--------------+ | 17:01 |
jeblair | | | | | | default | | 17:01 |
jeblair | | | | | | default | | 17:01 |
jeblair | i don't know if that's good or bad | 17:01 |
*** sergmelikyan has quit IRC | 17:01 | |
clarkb | thas bad | 17:01 |
clarkb | says only your hosts can talk to your hosts | 17:01 |
jeblair | clarkb: any chance you want to fix that while i launch the node? | 17:02 |
clarkb | I can in a few yes | 17:02 |
jeblair | clarkb: cool, no rush i think :) | 17:02 |
mordred | jeblair: nova secgroup-add-rule default tcp -1 -1 0.0.0.0/0 | 17:02 |
mordred | jeblair: want me to go do it? | 17:02 |
jeblair | mordred: yeah, cause copy/paste that didn't work | 17:02 |
mordred | awesome | 17:02 |
* mordred on it | 17:02 | |
jeblair | clarkb: you're off the hook :) | 17:02 |
jeblair | oh, what flavor did we use for this? | 17:03 |
jeblair | i'll check cacti | 17:03 |
*** david-lyle has quit IRC | 17:03 | |
clarkb | dont forget udp and icmp | 17:04 |
mordred | yah | 17:04 |
clarkb | and delete the old rulrs | 17:04 |
*** harlowja has joined #openstack-infra | 17:04 | |
jeblair | clarkb, mordred: considering we have zero cacti data for it, i think we _did_ for get udp last time. | 17:04 |
clarkb | since thodr are the ones that break hpcloud | 17:04 |
jeblair | anyone have a guess as to what flavor we should use? | 17:04 |
clarkb | jeblair woo check rax? | 17:04 |
clarkb | it should line up flavor wise and had a 300gb volume iirc | 17:05 |
jeblair | clarkb: well, i was thinking in terms of ram and cpu... but probably we actually need to size it by ephemeral disk, right? | 17:05 |
*** salv-orlando has joined #openstack-infra | 17:05 | |
clarkb | jeblair no we use cinder volumes | 17:05 |
mordred | jeblair: I'll have it in a saved inventory file - one sec | 17:05 |
clarkb | so ephemeral disk is not used | 17:05 |
jeblair | clarkb: we use cinder on hpcloud? | 17:05 |
*** dprince has quit IRC | 17:06 | |
*** dizquierdo has quit IRC | 17:06 | |
mordred | oh - no I won't - I did not rsync my cache dir | 17:06 |
clarkb | jeblair ya | 17:07 |
*** abitha has joined #openstack-infra | 17:07 | |
*** dprince has joined #openstack-infra | 17:08 | |
*** serg_melikyan has quit IRC | 17:08 | |
*** sergmelikyan has joined #openstack-infra | 17:09 | |
*** AJaeger has joined #openstack-infra | 17:09 | |
*** trown is now known as trown|lunch | 17:10 | |
mordred | clarkb: http://paste.openstack.org/show/466589/ | 17:10 |
*** romcheg has quit IRC | 17:10 | |
jeblair | clarkb, mordred: then i'm all ears for what we think the flavor should be | 17:10 |
openstackgerrit | Paul Michali proposed openstack-infra/project-config: Move VPN Functional tests to check queue https://review.openstack.org/223049 | 17:10 |
jeblair | looks like we use 4g machines on rax, with very little cpu | 17:11 |
clarkb | mordred delete the default group rules we break hpcloud with those | 17:11 |
clarkb | why they are there by default is beyond me | 17:11 |
jeblair | should we do 8g+4cpu on hpcloud then? | 17:11 |
clarkb | sure | 17:12 |
mordred | clarkb: ok. I believe we're good on the default sec group now | 17:13 |
*** romcheg has joined #openstack-infra | 17:14 | |
jeblair | /dev/xvdb 197G 188G 0 100% /srv | 17:16 |
jeblair | i think the rax mirrors may be about full. | 17:16 |
*** angdraug has quit IRC | 17:17 | |
mordred | yay! | 17:17 |
*** fedexo has quit IRC | 17:17 | |
jeblair | my stack is too deep; if someone else could take that, that would be great | 17:17 |
jeblair | erm | 17:18 |
jeblair | we don't seem to be using lvm there | 17:18 |
jeblair | why in the world would we not do that | 17:18 |
mordred | that seems like a bad choice | 17:18 |
jeblair | it looks like the launch-node volume stuff doesn't support lvm... it just does what was done on the pypi mirrors... | 17:19 |
*** _kiran_ has quit IRC | 17:19 | |
doug-fish | is there a spec or similar doc for Zanata integration into stackalytics? | 17:19 |
*** tonytan4ever has quit IRC | 17:20 | |
*** ihrachys has quit IRC | 17:20 | |
pleia2 | doug-fish: I don't remember if it was actually part of the spec, I think it may have just been a bug with the zanata team directly | 17:20 |
openstackgerrit | Tetiana Lashchova proposed openstack-infra/project-config: Add translation-jobs for python-heatclient https://review.openstack.org/224832 | 17:20 |
jeblair | mordred, pleia2, fungi, jhesketh, clarkb, SergeyLukjanov: all of the rax pypi mirrors need to have lvm volumes created and attached, and the bandersnatch mirror moved to them, and the existing cinder volume deleted. i'm looking for a volunteer. | 17:20 |
pleia2 | doug-fish: yeah, not in the spec http://specs.openstack.org/openstack-infra/infra-specs/specs/migrate_to_zanata.html since it wasn't vital to launching, it was something Daisy said we could tackle next cycle | 17:21 |
pleia2 | doug-fish: Daisy would be the best one to ask re: status of her work with the Zanata folks and statistics | 17:21 |
doug-fish | pleia2: cool thank - that's not a surprise to me, but I wanted to see what was planned for next cycle | 17:21 |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add grafana dashboard for status.o.o/zuul https://review.openstack.org/224834 | 17:21 |
pabelanger | timrc: mordred ^ example grafyaml dashboard for zuul status | 17:22 |
pleia2 | doug-fish: yeah, definitely, with i18n becoming all official we'll need a way to track ATC status for translations | 17:22 |
mordred | jeblair: I'm close to end of day and have a phone call coming up - I cannot do it right now - I can work on it tomorrow though | 17:22 |
greghaynes | "tomorrow" | 17:23 |
doug-fish | pleia2: my concern-of-the-day is how email addresses/Zanata ids get associated with companies for rolling up contributions | 17:23 |
timrc | pabelanger, What needs to happen to get grafyaml into place? | 17:23 |
timrc | pabelanger, Last I checked you had your dashboard change as WIP/ | 17:23 |
timrc | ? | 17:23 |
doug-fish | well, that's one of my concerns-of-the-day | 17:23 |
greghaynes | AKA tonight :) | 17:23 |
*** mriedem has quit IRC | 17:23 | |
pabelanger | timrc: not much, I need to build puppet-grafyaml and import it | 17:23 |
pabelanger | timrc: then, add test coverage for datasource | 17:24 |
pabelanger | and some sort of caching like JJB | 17:24 |
pleia2 | doug-fish: openstackid is used for login, which is what we use on openstack.org and want to eventually use for everything, so we're kind of ahead of everyone else when it comes to using non-launchpad federated login, if there isn't mapping now, there will be soon | 17:24 |
jeblair | mordred: hopefully someone else will volunteer to do it sooner, as 0 bytes free makes it somewhat urgent (thoug, we're probably just not breaking openstack as fast as normal since the mirror is effectively frozen) | 17:25 |
*** ybathia has joined #openstack-infra | 17:25 | |
doug-fish | pleia2: I think you are telling me that want I want will work - that is if we have people contributing translations on behalf of IBM that those will get rolled up into the IBM totals that we would see on stackalytics, even if they don't have IBM email ids. | 17:26 |
*** sergmelikyan has quit IRC | 17:26 | |
*** sergmelikyan has joined #openstack-infra | 17:27 | |
*** mriedem has joined #openstack-infra | 17:27 | |
timrc | pabelanger, Any thoughts on how to organize dashboards? E.g. do we want a dashboard that lists other dashboards that are associate with certain tags? | 17:27 |
doug-fish | pleia2: my other concern-of-the-day that I'd like to share is that we are uploading all of the translations we'd like to contribute to the translation-dev server today (to make sure we aren't going to break the production server) | 17:27 |
jeblair | novaclient.exceptions.BadRequest: No nw_info cache associated with instance (HTTP 400) (Request-ID: req-8b664234-bc8a-442a-bcec-1c0b6017883b) | 17:28 |
jeblair | what in the WORLD does that mean ^? | 17:28 |
timrc | pabelanger, I really hate grafana's opinion on what an organization is. The fact grafana only allows one anonymous organization makes logically segregating dashboards difficult. | 17:28 |
pleia2 | doug-fish: yeah, just like right now with launchpad, you don't need to be using a company email address, we have a file that maps email addresses to companies, we'll definitely have something like that for openstackid too | 17:29 |
greghaynes | jeblair: https://bugs.launchpad.net/nova/+bug/1249065 huh. | 17:29 |
openstack | Launchpad bug 1249065 in OpenStack Compute (nova) "Nova throws 400 when attempting to add floating ip (instance.info_cache.network_info is empty)" [Medium,Fix released] - Assigned to Matt Riedemann (mriedem) | 17:29 |
pabelanger | timrc: Ya, I haven't done much work with orgs. For me, I've just used the default one to create dashboards. However, I am just a single person :D | 17:29 |
doug-fish | pleia2: excellent! thanks! | 17:29 |
pleia2 | doug-fish: that's fine re: uploading translations to the -dev server, there should be a plan for migrating all the translations to the production server at some time, AJaeger may be a good one to talk to about that, we don't want to get in the way of the automated scripts | 17:30 |
greghaynes | jeblair: looks like its a race | 17:30 |
*** tonytan4ever has joined #openstack-infra | 17:30 | |
timrc | pabelanger, When you start getting a lot of dashboards it can become quite chaotic. | 17:31 |
* jeblair launches again | 17:31 | |
doug-fish | pleia2: we actually talked through that in the i18n meeting today. We are going to start with separate branches (just like we are doing on -dev today), then the language coordinators can merge when (if?) they are comfortable with a contribution | 17:31 |
openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: Add devstack-plugin-bdd to project config https://review.openstack.org/224738 | 17:31 |
AJaeger | pleia2: sorry, can't help with that. I don't think our scripts touch the -dev server - and if it's a separate version, it's no problem either. | 17:31 |
pabelanger | timrc: Ya. I am hoping our git workflow will help with some of that | 17:31 |
*** ifarkas has quit IRC | 17:31 | |
pleia2 | AJaeger: not on the dev server, when we move into production | 17:32 |
pleia2 | s/we/the translations | 17:32 |
pleia2 | don't want to upload files over existing translations or anything | 17:32 |
pleia2 | but something like a separate branch should work | 17:32 |
openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: Add devstack-plugin-bdd to project config https://review.openstack.org/224738 | 17:32 |
fungi | okay, sorry, back at computer now | 17:33 |
fungi | catching up | 17:33 |
*** Flcn has joined #openstack-infra | 17:34 | |
mriedem | greghaynes: jeblair: yeah it's a race | 17:34 |
jeblair | mriedem: i'm 0/2 so far :( | 17:34 |
mriedem | should be squashed in liberty as of last week | 17:34 |
jeblair | 0/3 | 17:34 |
greghaynes | jeblair: youre winning the race! | 17:34 |
mriedem | jeblair: nova-net right? | 17:34 |
fungi | i see that pypi.region-b.geo-1.openstack.org still does not respond to ping but our creds are working there again (albeit with empty nova list so i guess the account and contents were baleeted) | 17:34 |
*** ivar-lazzaro has joined #openstack-infra | 17:34 | |
jeblair | mriedem: erm, whatever hpcloud runs in production | 17:34 |
mriedem | anyone know what that is? i assume neutron | 17:35 |
jeblair | mriedem: but yeah, i'm at least talking to nova, not neutron | 17:35 |
mriedem | oh | 17:35 |
mriedem | do we know what version? | 17:35 |
*** abregman_ has quit IRC | 17:35 | |
*** austin81 has joined #openstack-infra | 17:35 | |
jeblair | mriedem: oh, i think they use neutron, so it must be proxied. | 17:35 |
AJaeger | pleia2: easiest looks like a script that downloads current translation and IBM translation, merges them with giving current priority and upload again. | 17:35 |
jeblair | mriedem: and don't know version info | 17:36 |
AJaeger | There's still a small race that people edit one of those strings at that time but that can always happen. | 17:36 |
mriedem | jeblair: ok, i'm intimately familiar with the nova-net race, | 17:36 |
mriedem | i feel like there was a related neutron api fix for that same error in nova at some point, i can poke | 17:36 |
jeblair | mriedem, greghaynes: i've hit it 4 out of 4 attempts so far in production hpcloud | 17:36 |
mriedem | mestery: do you know if hpcloud runs with neutron? | 17:37 |
jeblair | greghaynes: i think it might be time to start talking to the hpcloud folks | 17:37 |
mriedem | and if so, what eversion of nova/neutron? | 17:37 |
*** bltavares has quit IRC | 17:37 | |
greghaynes | jeblair: yep, one sec | 17:37 |
mestery | mriedem: Aye aye, it indeed does, /cc haleyb carl_baldwin | 17:37 |
AJaeger | pleia2: what's up with all the python-Xclient projects that now want translations? | 17:37 |
jeblair | mriedem: if i sleep before adding the floating ip will it work? :) | 17:38 |
mriedem | AJaeger: zanata stuff that happened this week right? | 17:38 |
pleia2 | AJaeger: I don't know, more than just keystone? | 17:38 |
mriedem | jeblair: it's not actually adding the floating IP that's the problem, at least it wasn't in the nova-net case | 17:38 |
mriedem | jeblair: might be different for neutron api | 17:38 |
pleia2 | AJaeger: I thought the python-Xclients were mostly deprecated in favor of the openstack one x_x | 17:38 |
mriedem | pleia2: that's going to be a long time coming | 17:38 |
AJaeger | pleia2: https://review.openstack.org/224832 heat and https://review.openstack.org/224222 nova | 17:38 |
pleia2 | mriedem: aha | 17:38 |
pleia2 | AJaeger: I see | 17:38 |
*** achanda has joined #openstack-infra | 17:39 | |
pleia2 | AJaeger: yeah, I have no idea what triggered this | 17:39 |
mriedem | AJaeger: oh you mean why are there now a flood of requests for those | 17:39 |
AJaeger | mriedem: yes | 17:39 |
pleia2 | mriedem: yeah | 17:39 |
mriedem | AJaeger: it's because we've been translating strings in the clients but not actually having translations for them | 17:39 |
AJaeger | mriedem: three in a week - and before that now.... | 17:39 |
mriedem | like people were literally pushing changes to _() things | 17:39 |
pleia2 | just the one before that | 17:39 |
AJaeger | mriedem: marking strings, not translating ;) | 17:39 |
mriedem | but it was useless since we didn't have the actual translations in tree | 17:39 |
mriedem | yeah | 17:39 |
AJaeger | mriedem: the translators have limited resources and have to priotize. | 17:40 |
greghaynes | jeblair: this is happening when you try to attach a FIP to an instance? | 17:40 |
mriedem | AJaeger: pleia2: http://lists.openstack.org/pipermail/openstack-dev/2015-September/073698.html | 17:40 |
jeblair | greghaynes: yes; fip creation works | 17:40 |
AJaeger | mriedem, I suggest you talk with Daisy. I would see as prios: Horizon and friends, openstack client - and then the python clients, and then server projects (let's leave docs out of this). | 17:41 |
doug-fish | mriedem: And Horizon is and should be the top priority. :-P | 17:41 |
mriedem | honestly i don't care about priorities | 17:41 |
mriedem | i just thought it was dumb that we were marking strings in a project that didn't actually have translation support setup in infra | 17:41 |
pleia2 | well, you are adding to the burden of the translations team | 17:41 |
haleyb | jeblair: hpcloud having issues ? just reading scrollback | 17:41 |
pleia2 | so talking to them would be good | 17:41 |
mriedem | pleia2: that's why i suggested in the ML to just stop marking strings in novaclient and pretending like it was helpful | 17:42 |
jeblair | haleyb: yep, seeing novaclient.exceptions.BadRequest: No nw_info cache associated with instance (HTTP 400) (Request-ID: req-f80b8ab6-fc88-4491-9ea6-fefe9a333691) | 17:42 |
pleia2 | mriedem: yeah, that's fair | 17:42 |
mriedem | my priority right now is figuring out what jeblair is hitting :) | 17:42 |
*** austin81 has left #openstack-infra | 17:42 | |
jeblair | haleyb: which apparently is bug 1249065 | 17:42 |
openstack | bug 1249065 in OpenStack Compute (nova) "Nova throws 400 when attempting to add floating ip (instance.info_cache.network_info is empty)" [Medium,Fix released] https://launchpad.net/bugs/1249065 - Assigned to Matt Riedemann (mriedem) | 17:42 |
mriedem | b/c i think it's fixed | 17:42 |
mriedem | jeblair: haleyb: https://review.openstack.org/#/c/186315/ | 17:43 |
AJaeger | mriedem: let me write an email to the i18n list | 17:43 |
greghaynes | mriedem: its possible they are just running old code | 17:43 |
mriedem | https://review.openstack.org/#/q/I3b9f60a2c4aea904f39d6914c8f35c4d682a6b3a,n,z goes back to stable/juno | 17:43 |
fungi | and now i think i'm fully caught up, at least as much as skimming scrollback can accomplish | 17:43 |
mriedem | i'd expect hpcloud to be at least at kilo | 17:43 |
*** rm_work has quit IRC | 17:43 | |
jeblair | fungi: any chance you want to take on the rax cinder work? | 17:43 |
mriedem | that might not be the issue, but it's related | 17:43 |
fungi | jeblair: mordred: pleia2: jhesketh: clarkb: SergeyLukjanov: i'll start working on cinder volumes for our rax servers | 17:44 |
fungi | jeblair: ;) | 17:44 |
jeblair | fungi: awesome :) | 17:44 |
*** austin81 has joined #openstack-infra | 17:44 | |
fungi | yeah, i didn't see anyone else volunteer anyway | 17:44 |
greghaynes | jeblair: pinged in support chat... hopefully get some response on it | 17:44 |
*** vgridnev has joined #openstack-infra | 17:45 | |
*** rm_work has joined #openstack-infra | 17:45 | |
fungi | wow, yeah. we've got some pretty thoroughly full filesystems on our pypi mirrors. i guess i should just go with 0.5tb cinder volumes for each and use lvm this time around | 17:46 |
fungi | this will... not be fast | 17:46 |
jeblair | fungi: yeah, that's my plan with hpcloud | 17:46 |
fungi | quite a bit of data to rsync | 17:46 |
*** dahoo has joined #openstack-infra | 17:46 | |
fungi | at least i can set them going in parallel | 17:46 |
*** dahoo is now known as jerryz | 17:46 | |
*** daenney has quit IRC | 17:47 | |
haleyb | jeblair: i work on the hpcloud neutron team, so don't know if that fix is in the queue | 17:47 |
openstackgerrit | Ryan Carey proposed openstack-infra/jenkins-job-builder: Add support for Artifactory plugin https://review.openstack.org/173932 | 17:47 |
fungi | will almost certainly need to blow away the bandersnatch state and resync it once that's done too | 17:47 |
*** sergmelikyan has quit IRC | 17:47 | |
*** julim has quit IRC | 17:48 | |
*** julim has joined #openstack-infra | 17:48 | |
*** bltavares has joined #openstack-infra | 17:48 | |
*** amuller is now known as amuller_afk | 17:49 | |
*** sergmelikyan has joined #openstack-infra | 17:50 | |
Flcn | Hello. My merge request was merged to master 2 days ago, and PTL said that i can still receive ATC pass if write here. Somebody know were i need to request them? Thanks. | 17:50 |
*** ociuhandu has quit IRC | 17:50 | |
fungi | Flcn: contact summitreg@openstack.org and see if they can issue one to you | 17:51 |
greghaynes | jeblair: do you have an instance-id for one of the nodes? | 17:51 |
fungi | Flcn: the infra team doesn't actually handle those, i just happen to run the scripts that send the mass mailings of them because i also work for the foundation | 17:51 |
jeblair | greghaynes: i'll generate one | 17:51 |
Flcn | @funigi Thanks | 17:51 |
jeblair | greghaynes: | da8d0813-1c62-4b8c-bfb4-5a87072e3f8e | pypi.region-b.geo-1.openstack.org | ACTIVE | - | Running | | | 17:52 |
jeblair | greghaynes: novaclient.exceptions.BadRequest: No nw_info cache associated with instance (HTTP 400) (Request-ID: req-5cc635c6-5ff8-4306-9373-1f416262c81c) | 17:52 |
jeblair | greghaynes: there's a matching instance-id and request-id for the failed req | 17:52 |
fungi | ia shub-pypi, ia! | 17:52 |
*** sergmelikyan has quit IRC | 17:52 | |
*** dprince has quit IRC | 17:53 | |
greghaynes | jeblair: ty | 17:53 |
*** vgridnev_ has joined #openstack-infra | 17:53 | |
pleia2 | jumping on a call, will bbiab | 17:54 |
fungi | it's unfortunate nova volume-attach doesn't take volume names | 17:54 |
fungi | silly extra lookup | 17:54 |
openstackgerrit | James E. Blair proposed openstack-infra/system-config: Revert "Add support to launch node for attaching volumes" https://review.openstack.org/224848 | 17:55 |
*** vgridnev has quit IRC | 17:55 | |
fungi | yeah, that's simply created extra work in the end | 17:55 |
openstackgerrit | James E. Blair proposed openstack-infra/system-config: Disable volume option until it is cinderified. https://review.openstack.org/224849 | 17:56 |
jeblair | or the less intrusive option ^ | 17:57 |
greghaynes | jeblair: support says instance isnt getting a private ip either | 17:57 |
greghaynes | jeblair: do you have a nova command I can give to support for creating the instances | 17:57 |
clarkb | maybe we lack a network and router? | 17:57 |
clarkb | nova show-net or something | 17:58 |
jeblair | nova net-list is 404 | 17:58 |
clarkb | oh you may need to use neutronclient | 17:59 |
*** SumitNaiksatam has joined #openstack-infra | 17:59 | |
clarkb | because some things are proxied but notbothers just to be confusing | 17:59 |
jeblair | | id | name | subnets | | 18:00 |
jeblair | +--------------------------------------+---------+---------------------------------------+ | 18:00 |
jeblair | | 7da74520-9d5e-427b-a508-213c84e69616 | Ext-Net | e9440419-d276-4c3d-9c18-7991b77e2465 | | 18:00 |
jeblair | | | | ef3bde66-8ac4-4356-8ab4-099519ba218a | | 18:00 |
*** dkranz has quit IRC | 18:00 | |
jeblair | neutron router-list is empty; like not even a table | 18:01 |
jeblair | greghaynes: let me see if i can recreate the process with nova commands | 18:01 |
*** Flcn has quit IRC | 18:01 | |
*** HeOS has joined #openstack-infra | 18:01 | |
*** vgridnev_ has quit IRC | 18:02 | |
*** trown|lunch is now known as trown | 18:03 | |
haleyb | jeblair: do the tools create networks on the fly? or is there one default one ? | 18:03 |
*** bhunter71 has quit IRC | 18:04 | |
*** pvaneck has joined #openstack-infra | 18:04 | |
jeblair | haleyb: our tools don't create networks; we're counting on a default one. that makes me think that there is a default one, though i don't know why there are 2 subnets, and i don't understand the router situation. | 18:04 |
greghaynes | jeblair: Yea, so sounds like our network config is not like it should be - thats something we set up by hand? | 18:04 |
*** doug-fi__ has joined #openstack-infra | 18:04 | |
*** doug-fish has quit IRC | 18:04 | |
greghaynes | oh, heh | 18:04 |
jeblair | greghaynes: apparently? i am unaware of any documentation on the subject. | 18:04 |
*** jamielennox is now known as jamielennox|away | 18:05 | |
haleyb | jeblair: we have two public networks, they show up since the floaters need them | 18:05 |
*** dprince has joined #openstack-infra | 18:05 | |
*** kgiusti has quit IRC | 18:05 | |
haleyb | that command should have showed a private network as well | 18:05 |
*** kgiusti has joined #openstack-infra | 18:05 | |
jeblair | haleyb: that sounds like it might explain why we're not getting a private ip too. | 18:06 |
*** doug-fi__ has quit IRC | 18:06 | |
*** nadya has joined #openstack-infra | 18:07 | |
*** e0ne has joined #openstack-infra | 18:07 | |
haleyb | sounds like something deleted your neutron pieces | 18:07 |
clarkb | I rhink the deletion broke us | 18:07 |
clarkb | and undelete didnt populate with defaults | 18:07 |
clarkb | so we need to manually make a subnet, a network, a router and hook them up | 18:07 |
clarkb | (for anyone following along this is why we argue against all this complicated stuff in neutron) | 18:08 |
jeblair | i have no idea how to do this | 18:08 |
jeblair | i am going to log into the gui and click on things until it looks like it might work | 18:08 |
*** jsavak has quit IRC | 18:08 | |
*** bltavares has quit IRC | 18:08 | |
clarkb | yes gui is best bet | 18:08 |
clarkb | horizon makes it easier | 18:08 |
greghaynes | :( | 18:09 |
greghaynes | if we say that... | 18:09 |
*** bltavares has joined #openstack-infra | 18:09 | |
greghaynes | who doesnt? | 18:09 |
openstackgerrit | Alex Schultz proposed stackforge/gertty: Make permalink clickable https://review.openstack.org/224851 | 18:09 |
jeblair | i'm told we need a private network, so i'm going to make a network called "private" | 18:10 |
jeblair | there is a checkbox labeled "Admin State". it is checked. I don't know what it means. | 18:10 |
jeblair | i will leave it checked | 18:10 |
*** hyakuhei has quit IRC | 18:10 | |
clarkb | jeblair in the other accounr is accountname-networkX iirc | 18:10 |
haleyb | at the same time you make it (in horizon) you can also create a subnet | 18:10 |
*** doug-fish has joined #openstack-infra | 18:10 | |
jeblair | do i want a subnet? | 18:10 |
clarkb | yes its required | 18:11 |
clarkb | I would do a /24 | 18:11 |
* haleyb opens a horizon window on his hpcloud account to help if necessary | 18:11 | |
clarkb | since a router cant handle more than that many hosts sanely | 18:11 |
*** hyakuhei has joined #openstack-infra | 18:11 | |
clarkb | and 10.0.0.0/24 is probably fine | 18:11 |
*** pelix has quit IRC | 18:11 | |
jeblair | enable dhcp? | 18:11 |
haleyb | yes | 18:12 |
clarkb | yes | 18:12 |
clarkb | and probably set google dns | 18:12 |
jeblair | do i need to fill in the allocation pools, or will it just use the whole range if i leave it blank? | 18:12 |
*** sabeen1 has joined #openstack-infra | 18:12 | |
clarkb | though puppet will anyways | 18:12 |
clarkb | it will do the right thing if blank | 18:12 |
clarkb | reserves first for router and second for dnsmaq and everything else is ours iirc | 18:13 |
jeblair | oh, "admin state" means "up or down" | 18:13 |
fungi | jeblair: mordred: pleia2: jhesketh: clarkb: SergeyLukjanov: rsync is running under a root-owned screen session on each of the rax pypi servers. i'll check on them periodically and swap them into service once completed | 18:13 |
jeblair | fungi: thank you! | 18:13 |
fungi | a pleasure as always | 18:13 |
*** jsavak has joined #openstack-infra | 18:14 | |
*** hyakuhei has quit IRC | 18:14 | |
jeblair | hrm, doesn't show up in neutron net-list | 18:14 |
*** tonytan4ever has quit IRC | 18:15 | |
jeblair | oh well. i'll make a router now. | 18:15 |
*** dkranz has joined #openstack-infra | 18:15 | |
openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Remove Babel bits https://review.openstack.org/224855 | 18:16 |
haleyb | jeblair: there are two datacenters for hpcloud, perhaps your horizon is pointing at one, commands running against the other? | 18:16 |
*** e0ne has quit IRC | 18:17 | |
jeblair | haleyb: ah, that was it | 18:17 |
*** sabeen3 has joined #openstack-infra | 18:17 | |
haleyb | i don't know if infra uses both | 18:17 |
openstackgerrit | Danilo Ramalho proposed openstack-infra/puppet-logstash: Add acceptance tests for puppet-logstash. https://review.openstack.org/224858 | 18:18 |
*** bhunter71 has joined #openstack-infra | 18:18 | |
haleyb | your previous net-list was showing our East datacenter | 18:18 |
fungi | haleyb: we've been using "region b" a.k.a. "usa east 1.1" i think | 18:18 |
fungi | hard to know what to call it since hpcloud has renamed it at least a couple times | 18:19 |
*** AJaeger has quit IRC | 18:19 | |
*** sdake has quit IRC | 18:19 | |
*** sabeen1 has quit IRC | 18:19 | |
jeblair | okay switching to east and repeating | 18:19 |
haleyb | jeblair: so you will need to go create a network in East | 18:19 |
jeblair | apparently there is an ipv6 subnet option? | 18:20 |
haleyb | fungi: horizon calls it US East and West, so I'm sticking with that :) | 18:20 |
haleyb | jeblair: no, but horizon does show it | 18:20 |
fungi | haleyb: thanks, since we generally never touch the web interface it's hard to know | 18:20 |
*** ociuhandu has joined #openstack-infra | 18:20 | |
openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Bump pbr requirement to >= 1.3 https://review.openstack.org/224860 | 18:20 |
*** e0ne has joined #openstack-infra | 18:21 | |
jeblair | haleyb: yeah, makes sense -- though the horizon/api disconnect is why i missed that (our cli tools use region-b.geo-1, and i can never remember if that's east or west) | 18:21 |
*** jsavak has quit IRC | 18:21 | |
haleyb | fungi: the region name in an openrc file does have region-b, so there's your confusion | 18:22 |
jeblair | yay, shows up in net-list now | 18:22 |
*** jsavak has joined #openstack-infra | 18:22 | |
*** sdake has joined #openstack-infra | 18:23 | |
fungi | haleyb: well, it was also "1.1 beta" for a while when we first started using it, and since that was only in the "new" (east) region at the time the cardinal direction tended not to get mentioned | 18:23 |
*** doug-fish has quit IRC | 18:23 | |
*** doug-fish has joined #openstack-infra | 18:23 | |
*** AJaeger has joined #openstack-infra | 18:24 | |
*** alexsyip has joined #openstack-infra | 18:25 | |
*** hyakuhei has joined #openstack-infra | 18:25 | |
*** vmbrasseur_BIAB is now known as vmb | 18:25 | |
jeblair | okay, our network topology looks like an H now | 18:25 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: (WIP) Add compute class for Infra Cloud https://review.openstack.org/213980 | 18:26 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: (WIP) Add controller class for Infra Cloud https://review.openstack.org/209698 | 18:26 |
haleyb | i think that's goodness, as it implies router has interface on Ext-Net | 18:26 |
*** hyakuhei has quit IRC | 18:26 | |
openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Simplify .gitignore https://review.openstack.org/224864 | 18:26 |
jeblair | okay, launching again | 18:27 |
*** Zhongjun has quit IRC | 18:27 | |
*** doug-fish has quit IRC | 18:27 | |
openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Drop pypy test coverage https://review.openstack.org/224865 | 18:28 |
jeblair | neat, now it's an H with a thing hanging off the right side :) | 18:28 |
jeblair | i think we're making progress | 18:28 |
*** doug-fish has joined #openstack-infra | 18:28 | |
*** doug-fis_ has joined #openstack-infra | 18:29 | |
jeblair | mriedem: it looks like that error message can also mean "your cloud provider forgot to reset your default network topology after reactivating your deleted account" | 18:30 |
jeblair | hrm | 18:30 |
jeblair | the instance is up, but i'm unable to access it over the internet | 18:30 |
*** ihrachys has joined #openstack-infra | 18:30 | |
jeblair | i can see the console in horizon though | 18:30 |
*** doug-fi__ has joined #openstack-infra | 18:30 | |
clarkb | fip attached? | 18:31 |
*** mmedvede has quit IRC | 18:31 | |
fungi | default security groups blocking everything? | 18:31 |
*** nadya has quit IRC | 18:31 | |
jeblair | clarkb: 10.0.0.3, 15.126.140.7 | 18:31 |
openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Clean up tox.ini https://review.openstack.org/224866 | 18:31 |
jeblair | ALLOW IPv4 to 0.0.0.0/0 | 18:31 |
*** fawadkhaliq has quit IRC | 18:31 | |
jeblair | ALLOW IPv4 from default | 18:31 |
clarkb | need to delete the default rule | 18:31 |
*** sdake has quit IRC | 18:31 | |
*** fawadkhaliq has joined #openstack-infra | 18:31 | |
* fungi assumes "default" means the local network in this case | 18:31 | |
clarkb | but that shouldnt cause this | 18:32 |
mriedem | jeblair: hmm, well, the nw_info not found thing means we literally don't have nw_info in the nova database for that instance | 18:32 |
mriedem | jeblair: and nw_info should be stored on the instance after the instance is first created | 18:32 |
clarkb | fungi it means any host in the same group | 18:32 |
*** fawadkhaliq has quit IRC | 18:32 | |
fungi | righg | 18:32 |
clarkb | it breaks hpcloud | 18:32 |
mriedem | the race before was nw_info was reset/wiped out after booting the instance but before attaching the floating ip | 18:32 |
jeblair | clarkb: yeah, the defaults are the only ingress rule | 18:32 |
jeblair | looks like mordred didn't complete the work | 18:32 |
jeblair | will fix in gui | 18:32 |
mriedem | jeblair: did you find out what version of nova they are running? | 18:32 |
*** doug-fish has quit IRC | 18:32 | |
*** Flcn has joined #openstack-infra | 18:33 | |
*** hyakuhei has joined #openstack-infra | 18:33 | |
*** sdake has joined #openstack-infra | 18:33 | |
*** doug-fis_ has quit IRC | 18:33 | |
*** sabeen3 has quit IRC | 18:34 | |
*** hyakuhei has quit IRC | 18:34 | |
*** sabeen1 has joined #openstack-infra | 18:34 | |
*** doug-fi__ has quit IRC | 18:35 | |
jeblair | mriedem: no, and i don't think haleyb knows either | 18:35 |
clarkb | jeblair maybe mordred got regions wrong too? | 18:35 |
*** Flcn has joined #openstack-infra | 18:36 | |
jeblair | clarkb: no, other region has ingress range=default | 18:36 |
clarkb | huh | 18:36 |
haleyb | mriedem: i don't know if that fix is in production, i pinged the nova team | 18:36 |
openstackgerrit | Kevin Fox proposed openstack-infra/puppet-apps_site: Fix for Murano Liberty version issue. https://review.openstack.org/224869 | 18:37 |
*** dprince has quit IRC | 18:37 | |
jeblair | and puppet is running on the server | 18:37 |
fungi | i thought in the past we set the source on the ingress rule to 0.0.0.0/0 as well | 18:38 |
fungi | maybe compare to the security groups on the openstackjenkins2 account's routers? | 18:38 |
jeblair | fungi: s/router/security group/? | 18:38 |
fungi | oh, are security groups not per-router? | 18:39 |
jeblair | they don't seem to be? | 18:39 |
clarkb | no they are per host | 18:39 |
clarkb | you can apply them to VMs independent of the router they sit on | 18:39 |
jeblair | wow | 18:40 |
fungi | got it. i'm constantly forgetting which openstack abstractions are per what other abstractions | 18:40 |
clarkb | so for us we just say allow all icmp udp and tcp traffic wverywhere in the default group | 18:40 |
jeblair | it's kind of a mess over there | 18:40 |
clarkb | its 3 rules I think | 18:40 |
jeblair | oh, west again, sorry, switching | 18:40 |
jeblair | we're east, right? | 18:40 |
clarkb | yes | 18:40 |
jeblair | okay, er, i'm sticking with it's a mess: | 18:40 |
*** Flcn has quit IRC | 18:42 | |
jeblair | openstackjenkins2 has ingress: tcp/0-65535, tcp/22, icmp, udp/0-65535 | 18:42 |
jeblair | so 4 rules | 18:42 |
jeblair | in openstackci, i made 1 ingress rule: any ipv4 protocol | 18:42 |
jeblair | clarkb, fungi: did you end up changing dns for hpcloud? | 18:43 |
fungi | i did not. afaik we still have nodepool's max set to 0 there | 18:43 |
clarkb | tcp/22 is unnecessary and no I did not change it | 18:44 |
clarkb | been swamped with family home things this morning | 18:44 |
clarkb | going to be at thing tonight which means I parent now | 18:45 |
jeblair | fungi: do you want to change dns to point to iad, with a, say, 300 or 600 second timeout? | 18:45 |
*** mmedvede has joined #openstack-infra | 18:45 | |
fungi | jeblair: sure, i'll do that now | 18:45 |
*** AJaeger has quit IRC | 18:46 | |
fungi | we're getting pretty far behind | 18:46 |
jeblair | fungi: and re-enable hpcloud? we're still hours away from having a usable mirror and our queue is climbing | 18:46 |
mriedem | haleyb: ok | 18:46 |
fungi | i also suspect, based on the node graph, that we're failing to build much in rax (likely over quota or some other error there) | 18:46 |
haleyb | jeblair: ping me if you need more help with hpcloud/neutron, but need to step out for a little bit | 18:47 |
jeblair | haleyb: thanks, i think we're all good now. thanks for your help! | 18:48 |
fungi | "This First Generation server will be converted to a Next Generation server after October 6, 2015. You can choose to convert it yourself by soft rebooting the server." | 18:48 |
fungi | neat! rax is near-seamlessly migrating their old virtual servers to nova | 18:48 |
*** greghaynes has quit IRC | 18:49 | |
*** ihrachys has quit IRC | 18:50 | |
fungi | i can't remember what we're still serving from the old wiki server besides old-wiki.openstack.org and some long-abandoned redirects like nova.openstack.org | 18:50 |
fungi | might should look into deleting that soonish if there's nothing of value remaining | 18:50 |
*** erikwilson has quit IRC | 18:51 | |
*** jsavak has quit IRC | 18:51 | |
jeblair | fungi: i can never remember -- did we finish moving tarballs? | 18:51 |
*** zeih has joined #openstack-infra | 18:51 | |
*** johnsom has left #openstack-infra | 18:52 | |
fungi | yep, that's on static.o.o now | 18:52 |
jeblair | yes, apparently :) | 18:52 |
*** jsavak has joined #openstack-infra | 18:52 | |
fungi | dns agrees! | 18:52 |
*** ihrachys has joined #openstack-infra | 18:52 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Pull tripleo related packages from delorean/current https://review.openstack.org/224168 | 18:53 |
*** ddieterly has joined #openstack-infra | 18:53 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Stop building tuskar-ui-extras https://review.openstack.org/222407 | 18:54 |
fungi | ipv4 address for pypi.region-b.geo-1.o.o has been switched to match pypi.iad.o.o in dns and ttl set to 300s. the previous ttl was 3600s and so google's resolvers may still have it cached for a while | 18:54 |
*** ozamiatin has joined #openstack-infra | 18:55 | |
*** burgerk__ has joined #openstack-infra | 18:55 | |
fungi | soliciting opinions on how long we should wait to spin up workers in hpcloud again | 18:55 |
*** greghaynes has joined #openstack-infra | 18:56 | |
*** zeih has quit IRC | 18:56 | |
jeblair | fungi: probably the full hour :| | 18:56 |
*** ddieterly has quit IRC | 18:56 | |
fungi | 'twas my assumption as well | 18:56 |
jeblair | the new hpcloud mirror is performing the initial bandersnatch sync | 18:57 |
fungi | that'll be hours to complete still anyway | 18:57 |
openstackgerrit | Kevin L. Mitchell proposed stackforge/python-jenkins: Allow setting the next build number https://review.openstack.org/224275 | 18:57 |
jeblair | yup | 18:57 |
*** hyakuhei has joined #openstack-infra | 18:57 | |
jeblair | i've been in this chair for too many hours; i'm going to resume after an extended lunch | 18:57 |
fungi | rsync is currently on packages starting with capital C and seems to be going in posix sort order | 18:58 |
fungi | for the rax pypi volume replacementds | 18:58 |
*** burgerk_ has quit IRC | 18:58 | |
greghaynes | jeblair: made a test case for your nodepool fix and I think theres a bug | 18:58 |
jeblair | greghaynes: awesome, thanks! | 18:59 |
*** tonytan4ever has joined #openstack-infra | 18:59 | |
jeblair | i'll start with that after lunch | 18:59 |
*** ccarrara has quit IRC | 18:59 | |
*** amuller_afk is now known as amuller | 18:59 | |
*** burgerk__ has quit IRC | 19:00 | |
*** dprince has joined #openstack-infra | 19:00 | |
*** glauco has quit IRC | 19:01 | |
*** glauco has joined #openstack-infra | 19:01 | |
*** erikwilson has joined #openstack-infra | 19:02 | |
fungi | oh, the ordering on this rsync may be less normalized than i thought. really no clue, going by inode count we're at ~50% complete i think | 19:02 |
*** hyakuhei has quit IRC | 19:02 | |
fungi | wait, no. looked at wrong numbers. ~25% | 19:02 |
Clint | do not taunt happy fun ball | 19:02 |
*** erikwilson has quit IRC | 19:02 | |
*** dzamboni has quit IRC | 19:02 | |
*** abregman has joined #openstack-infra | 19:03 | |
*** ccarrara has joined #openstack-infra | 19:04 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Stop building ironic-discoverd https://review.openstack.org/222408 | 19:06 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Remove support for mgt-master branches https://review.openstack.org/223599 | 19:06 |
fungi | have to pop out again for a few minutes... brb | 19:08 |
*** devlaps has quit IRC | 19:08 | |
*** dkranz has quit IRC | 19:08 | |
*** austin81 has left #openstack-infra | 19:10 | |
*** austin81 has joined #openstack-infra | 19:10 | |
*** glauco has quit IRC | 19:11 | |
*** bhunter71 has quit IRC | 19:11 | |
*** david-lyle has joined #openstack-infra | 19:11 | |
*** kushal has joined #openstack-infra | 19:12 | |
*** glauco has joined #openstack-infra | 19:13 | |
*** teran_ has quit IRC | 19:15 | |
*** glauco has quit IRC | 19:16 | |
*** olaph has quit IRC | 19:18 | |
*** glauco has joined #openstack-infra | 19:19 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Pull tripleo related packages from delorean/current https://review.openstack.org/224168 | 19:20 |
*** glauco has quit IRC | 19:20 | |
*** matrohon has joined #openstack-infra | 19:21 | |
*** dkranz has joined #openstack-infra | 19:22 | |
*** hdd has quit IRC | 19:22 | |
*** hdd has joined #openstack-infra | 19:23 | |
*** bswartz has joined #openstack-infra | 19:24 | |
*** bhunter71 has joined #openstack-infra | 19:25 | |
*** david-lyle has quit IRC | 19:25 | |
greghaynes | jeblair: I think (minus the issue I pointed out on review) your patch fixes builds, but uploads are also broken in a similar way :( | 19:25 |
* greghaynes -> lunch, bbiab | 19:26 | |
*** claudiub has quit IRC | 19:27 | |
*** ccarrara has quit IRC | 19:27 | |
*** _skolekonov has quit IRC | 19:28 | |
*** armax has quit IRC | 19:28 | |
*** vmbrasseur is now known as vmb_work_AWAY | 19:31 | |
*** vmb is now known as vmbrasseur | 19:33 | |
*** ozamiatin has quit IRC | 19:33 | |
*** jlebon has left #openstack-infra | 19:35 | |
*** alexpilotti has quit IRC | 19:35 | |
dims_ | zuul is in rough shape... | 19:36 |
clarkb | dims_ we are only running on one cloud | 19:38 |
dims_ | clarkb: y i saw that float by | 19:38 |
*** Sukhdev has joined #openstack-infra | 19:39 | |
*** ZZelle_ has joined #openstack-infra | 19:39 | |
*** gordc has quit IRC | 19:39 | |
*** pc_m has quit IRC | 19:42 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: (WIP) Add compute class for Infra Cloud https://review.openstack.org/213980 | 19:42 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: (WIP) Add controller class for Infra Cloud https://review.openstack.org/209698 | 19:42 |
EmilienM | trying to push a new puppet module for one week: https://review.openstack.org/#/c/222289/ - any chance to have a review please :-) ? | 19:45 |
*** sridhar_ram has quit IRC | 19:45 | |
*** sdake has quit IRC | 19:46 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API https://review.openstack.org/221964 | 19:47 |
*** Piet has quit IRC | 19:47 | |
*** sdake has joined #openstack-infra | 19:48 | |
fungi | okay, back again | 19:49 |
*** derekh has joined #openstack-infra | 19:51 | |
*** Sukhdev has quit IRC | 19:51 | |
*** HeOS has quit IRC | 19:51 | |
openstackgerrit | Ben Nemec proposed openstack/diskimage-builder: Update rhel7 element readme https://review.openstack.org/222351 | 19:52 |
*** ldnunes has quit IRC | 19:52 | |
*** Sukhdev_ has joined #openstack-infra | 19:53 | |
*** ldnunes has joined #openstack-infra | 19:56 | |
*** sdake has quit IRC | 19:57 | |
pleia2 | hm, I don't remember where we landed on which projects require what goverance changes and the depends-on order (looking at EmilienM's new puppet module depending on a governance page) | 19:58 |
*** earlephilhower has quit IRC | 19:59 | |
EmilienM | pleia2: it has been one week now, TC should approve the change (non negative reviews) | 19:59 |
EmilienM | pleia2: I just want to create puppet-aodh :) | 19:59 |
EmilienM | which is required to run ceilometer | 19:59 |
pleia2 | EmilienM: well, this won't land until the governance change is approved | 19:59 |
*** sdake has joined #openstack-infra | 20:00 | |
*** ihrachys has quit IRC | 20:00 | |
EmilienM | pleia2: yep... I asked ttx if we could approve the gov change - will see tomorrow | 20:00 |
pleia2 | the change looks fine, I just need a refresher on how we handle our depends here | 20:01 |
*** fitoduarte has quit IRC | 20:04 | |
*** fitoduarte has joined #openstack-infra | 20:05 | |
*** zns_ has quit IRC | 20:06 | |
*** Sukhdev_ has quit IRC | 20:06 | |
*** Piet has joined #openstack-infra | 20:07 | |
*** teran has joined #openstack-infra | 20:09 | |
*** HeOS has joined #openstack-infra | 20:09 | |
*** zns has joined #openstack-infra | 20:11 | |
*** Piet has quit IRC | 20:12 | |
*** Piet has joined #openstack-infra | 20:13 | |
*** sabeen1 has quit IRC | 20:13 | |
*** Piet has quit IRC | 20:13 | |
jeblair | EmilienM, pleia2: the governance change can depend on the repo creation (ie, you can reverse it) | 20:14 |
EmilienM | jeblair: do you want me to change something? | 20:14 |
jeblair | simple additions of repos to existing projects are assumed okay with ptl ack | 20:14 |
jeblair | EmilienM: up to you -- whether or not you want to wait :) | 20:14 |
EmilienM | jeblair: I don't | 20:14 |
EmilienM | let's change it | 20:14 |
jeblair | k | 20:14 |
pleia2 | thanks jeblair | 20:14 |
*** bhunter71 has quit IRC | 20:15 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: OIDC - OpenId Connect Implementation https://review.openstack.org/198458 | 20:15 |
jeblair | hpcloud bandersnatch is at 28G (out of a presumed >= 200G) | 20:15 |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Create puppet-aodh repository https://review.openstack.org/222289 | 20:15 |
jeblair | greghaynes: you said you wrote a test? | 20:16 |
greghaynes | jeblair: Yea, although I havent gotten it to pass because hitting other fails | 20:17 |
greghaynes | jeblair: I can push it up as depndent | 20:17 |
*** dramalho has quit IRC | 20:17 | |
*** lucasagomes has joined #openstack-infra | 20:17 | |
*** glauco has joined #openstack-infra | 20:18 | |
*** teran has quit IRC | 20:18 | |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Correct exception when waiting for image build https://review.openstack.org/224823 | 20:19 |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Correct missing DIB image detection https://review.openstack.org/224821 | 20:19 |
jeblair | greghaynes: cool, thx. and i agree with your -1 :) | 20:19 |
*** fifieldt has quit IRC | 20:19 | |
jeblair | fungi, clarkb: er, it looks like we run bandersnatch in a 30m timeout... | 20:20 |
*** fifieldt has joined #openstack-infra | 20:21 | |
jeblair | i think the initial syncs are going to be hard pressed to work under those circumstances | 20:21 |
jeblair | that's probably why gra1 is only at 76G | 20:21 |
fungi | jeblair: yep, it used to have a tendency to hang, so starting a fresh sync means don't do it under cron | 20:21 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: (WIP) Add compute class for Infra Cloud https://review.openstack.org/213980 | 20:21 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: (WIP) Add controller class for Infra Cloud https://review.openstack.org/209698 | 20:21 |
*** derekh has quit IRC | 20:21 | |
fungi | the timeouts were a safeguard against bandersnatch getting stuck in a livelock and ceasing to update | 20:21 |
jeblair | fungi: i'll do a manual flock+run then | 20:22 |
openstackgerrit | greghaynes proposed openstack-infra/nodepool: Test different provider and dib image names https://review.openstack.org/224886 | 20:22 |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: Fix broken CI due to discoverd/inspector rename https://review.openstack.org/224887 | 20:22 |
fungi | but do mean that a full resync won't work without manual assistance | 20:22 |
greghaynes | jeblair: ^ very trivial way to test ;) | 20:22 |
*** mmedvede has quit IRC | 20:22 | |
fungi | we're around 2/3 complete on the rsyncs now too | 20:22 |
fungi | also we're good and clear on the old ttl for the pypi mirror in hpcloud now, so i'll approve my wip revert | 20:23 |
fungi | and i'll also apply it manually because it'll take forever to land without enough nodes to run jobs | 20:24 |
*** jsavak has quit IRC | 20:25 | |
fungi | jeblair: are you okay with me temporarily disabling puppet on nodepool.o.o while 224767 is working its way through the ci? is that going to further cramp your ovh testing?| | 20:25 |
jeblair | fungi: no it's fine; i'm stuck until https://review.openstack.org/224821 lands and we restart | 20:26 |
*** jsavak has joined #openstack-infra | 20:26 | |
jeblair | fungi: heh | 20:26 |
jeblair | fungi: it looks like the disable patch hasn't actually landed | 20:26 |
jeblair | fungi: you could probably abandon both and just run puppet to reset :) | 20:27 |
fungi | ahh, and yes i never enabled it the first time because of that | 20:27 |
fungi | i'll do so | 20:27 |
*** lucasagomes has quit IRC | 20:29 | |
fungi | okay, that change and its revert have been abandoned, puppet agent is enabled again on nodepool.o.o and i've manually run puppet agent --test there to get things back on track | 20:29 |
jeblair | Hello Rackspace Customer, Thank you for your payment of $86.90, your credit card on file has been charged based on your invoice dated 17-Sep-15. | 20:30 |
fungi | now to see if i can spot what's going on in rax that has our booting percentage so high | 20:30 |
jeblair | i wish i had the _foggiest_ idea which account that was about. | 20:30 |
*** gyee has joined #openstack-infra | 20:31 | |
fungi | jeblair: is that on one of our infra accounts? | 20:31 |
jeblair | fungi: no idea! | 20:31 |
*** julim has quit IRC | 20:31 | |
fungi | oh! | 20:31 |
greghaynes | jeblair: at the bottom of that checkForMissingDiskImage I noticed you didnt change image.name to image.diskimage for the uploadImage call... was that knowingly done? | 20:31 |
fungi | wow, yeah that's great | 20:31 |
fungi | jeblair: did you maybe have an iopenedthecloud.com promotional 2-year discount and it just ran out this month? | 20:32 |
greghaynes | asking because im kind of on the fence for how I want to fix this | 20:32 |
jeblair | greghaynes: hrm, it looks like uploadImage may need a similar set of fixes. | 20:34 |
greghaynes | jeblair: yep, thats what im running in to :) | 20:34 |
greghaynes | jeblair: working on a fix now | 20:34 |
jeblair | greghaynes: cool, all yours, thx | 20:34 |
fungi | lots of 500 errors booting in hpcloud. checking for fips, but possible we're overrunning an api throttle with the big spike in boot calls | 20:35 |
*** mmedvede has joined #openstack-infra | 20:35 | |
jeblair | fungi: ah, yeah that was it. deleted :) | 20:36 |
*** miqui has quit IRC | 20:36 | |
*** tiswanso has quit IRC | 20:37 | |
*** ccarrara has joined #openstack-infra | 20:38 | |
*** doug-fish has joined #openstack-infra | 20:38 | |
*** doug-fish has quit IRC | 20:38 | |
*** doug-fish has joined #openstack-infra | 20:39 | |
*** tonytan4ever has quit IRC | 20:39 | |
*** esker has quit IRC | 20:41 | |
*** Sukhdev has joined #openstack-infra | 20:42 | |
*** jsavak has quit IRC | 20:42 | |
*** jsavak has joined #openstack-infra | 20:43 | |
openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add signatire for 1496678 https://review.openstack.org/224425 | 20:43 |
fungi | i think it must have been api throttles because i'm not seeing new ones in the log and there weren't really any stale disassociated fips | 20:44 |
fungi | and i see more and more nodes coming online | 20:44 |
*** lucasagomes has joined #openstack-infra | 20:44 | |
fungi | already 18 running jobs in hpcloud | 20:44 |
*** glauco has quit IRC | 20:44 | |
*** bswartz has quit IRC | 20:45 | |
*** krtaylor has quit IRC | 20:45 | |
mriedem | anyone know what caused this to spike today? http://logs.openstack.org/39/193139/1/gate/gate-grenade-dsvm/0086d24/console.html#_2015-09-17_14_32_11_368 | 20:45 |
*** baoli has quit IRC | 20:46 | |
*** baoli has joined #openstack-infra | 20:46 | |
jeblair | mriedem: i see failures to pip install ansible, so probably hpcloud deleting our mirror account. | 20:46 |
*** kushal has quit IRC | 20:47 | |
fungi | yep, it subsided when we reconfigured nodepool to stop booting new nodes in hpcloud | 20:47 |
fungi | in theory | 20:47 |
fungi | the timing on that log certainly looks like it's from the timeframe where it was still broken anyway | 20:47 |
openstackgerrit | Merged openstack-infra/nodepool: Bump pbr requirements to >=1.3 https://review.openstack.org/223280 | 20:48 |
mriedem | ah yeah, ok | 20:48 |
mriedem | yeah it was definitely just a spike today in logstash | 20:48 |
mriedem | build_node probably is all hpcloud too | 20:48 |
mriedem | yup | 20:48 |
fungi | clarkb: the latest update on 1348954 is very promising | 20:48 |
fungi | clarkb: er, on bug 1348954 | 20:48 |
openstack | bug 1348954 in python3-defaults (Ubuntu) "update Python3 for trusty" [Undecided,New] https://launchpad.net/bugs/1348954 | 20:48 |
clarkb | fungi only a year late | 20:49 |
*** sridhar_ram has joined #openstack-infra | 20:49 | |
*** bltavares has quit IRC | 20:49 | |
*** e0ne has quit IRC | 20:50 | |
*** ccarrara has quit IRC | 20:51 | |
openstackgerrit | James E. Blair proposed openstack-infra/puppet-odsreg: Deploy as a wsgi app https://review.openstack.org/224353 | 20:51 |
openstackgerrit | Merged openstack-infra/puppet-etherpad_lite: Ensure abiword package is always present https://review.openstack.org/224103 | 20:52 |
fungi | we're now at 165 nodes running jobs in hpcloud, so hopefully we'll start catching up | 20:52 |
jeblair | fungi: are we sure we want abiword on there? ^ | 20:52 |
*** annegentle has quit IRC | 20:52 | |
jeblair | (i read the commit message as "ensure we will need to log in and kill abiword periodically") | 20:53 |
pleia2 | :\ | 20:53 |
openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for ansible not on hpcloud nodes bug 1497006 https://review.openstack.org/224893 | 20:53 |
openstack | bug 1497006 in OpenStack-Gate "gate jobs fail because ansible is not installed on hpcloud nodes" [Undecided,New] https://launchpad.net/bugs/1497006 | 20:53 |
fungi | jeblair: apparently etherpad is injecting an error about missing abiword into every new pad created | 20:53 |
openstackgerrit | greghaynes proposed openstack-infra/nodepool: Correct missing DIB image detection https://review.openstack.org/224821 | 20:53 |
jeblair | fungi: yeah, would be nice to turn that off. | 20:53 |
*** aeng has joined #openstack-infra | 20:54 | |
greghaynes | jeblair: ^ think thats it | 20:54 |
fungi | also, it might make sense to find out if anyone's relying on the pad import/export features | 20:54 |
jeblair | but still, i feel like we're going from "spurious error message telling us we are broken when we aren't" to "actually broken but with no error message" :/ | 20:54 |
fungi | but i agree, i'd rather we just disabled that, i simply haven't had an opportunity to dig in and find out whether it's possible | 20:54 |
pleia2 | the error message it gives only tells you how to turn off all errors, with is not optimal | 20:55 |
pleia2 | s/with/which | 20:55 |
*** tongli has quit IRC | 20:55 | |
fungi | i guess the current situation does technically disable import/export, albeit with some associated ugly | 20:55 |
openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add odsreg server https://review.openstack.org/223871 | 20:56 |
openstackgerrit | Akash Gangil proposed openstack-infra/project-config: Gerrit bot request for vmware-nsx irc channel https://review.openstack.org/224898 | 20:57 |
jeblair | fungi, pleia2: can you review/aprv "status:open topic:odsreg" ? then i can spin up the server for ttx to use tomorrow | 20:58 |
*** gangil has joined #openstack-infra | 20:58 | |
fungi | jeblair: was just pulling that up since i saw gerritbot chiming one in here | 20:58 |
*** yfried has joined #openstack-infra | 20:58 | |
*** yfried has quit IRC | 20:59 | |
*** hodos|2 has quit IRC | 20:59 | |
*** matrohon has quit IRC | 20:59 | |
jeblair | fungi: and i fixed your (0) comment in a followup | 21:00 |
*** abregman has quit IRC | 21:00 | |
*** thorst has quit IRC | 21:01 | |
gangil | Hi, I wanted to make sure that I registered openstack-vmware-nsx the right way. I just came across this doc for IRC channels for various openstack projects https://wiki.openstack.org/wiki/IRC | 21:02 |
gangil | Could anyone please help me with that? | 21:02 |
pleia2 | jeblair: reviewing now | 21:03 |
*** regXboi has quit IRC | 21:04 | |
*** jsavak has quit IRC | 21:05 | |
*** david-lyle has joined #openstack-infra | 21:06 | |
pleia2 | gangil: you want to add the openstackinfra as a founder, see: http://docs.openstack.org/infra/system-config/irc.html#access | 21:07 |
fungi | jeblair: have you been testing that vhost on trusty or precise? | 21:07 |
jeblair | fungi: trusty | 21:07 |
fungi | interesting | 21:07 |
fungi | i wonder why the permissions in those directory blocks don't need a "satisfy all" directive | 21:08 |
jeblair | fungi: maybe mod_access_compat ? | 21:08 |
gangil | pleia2: done | 21:08 |
fungi | er, "satisfy any" i mean | 21:08 |
*** bswartz has joined #openstack-infra | 21:08 | |
fungi | jeblair: oh! that would be why | 21:08 |
jeblair | fungi: though i'm currently trying to figure out why that's not sufficient for pypi | 21:08 |
*** david-lyle has quit IRC | 21:09 | |
*** baoli has quit IRC | 21:09 | |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: Fix broken CI due to discoverd/inspector rename https://review.openstack.org/224887 | 21:09 |
*** baoli has joined #openstack-infra | 21:09 | |
*** alivigni has quit IRC | 21:09 | |
*** eharney has quit IRC | 21:11 | |
*** trown is now known as trown|outttypeww | 21:11 | |
*** aysyd has quit IRC | 21:12 | |
*** Sukhdev has quit IRC | 21:12 | |
*** mdenny has quit IRC | 21:13 | |
*** baoli has quit IRC | 21:14 | |
*** ldnunes has quit IRC | 21:15 | |
*** olaph has joined #openstack-infra | 21:16 | |
*** mdenny has joined #openstack-infra | 21:16 | |
fungi | okay, the rax pypi mirror rsyncs are completed, so i'm going to swap them in and get full bandersnatch state refreshes going on them now | 21:16 |
*** dkranz has quit IRC | 21:17 | |
*** ajmiller has quit IRC | 21:19 | |
*** tonytan4ever has joined #openstack-infra | 21:19 | |
*** tonytan4ever has quit IRC | 21:20 | |
*** tiswanso has joined #openstack-infra | 21:22 | |
*** dims_ has quit IRC | 21:23 | |
*** armax has joined #openstack-infra | 21:24 | |
*** jamielennox|away is now known as jamielennox | 21:24 | |
openstackgerrit | James E. Blair proposed openstack-infra/puppet-httpd: Add "Satisfy any" to default vhost template https://review.openstack.org/224905 | 21:26 |
*** tiswanso has quit IRC | 21:26 | |
jeblair | fungi, mordred: ^ that's needed for pypi mirrors on trusty | 21:26 |
*** dprince has quit IRC | 21:27 | |
fungi | yep, that looks like something i would expect | 21:27 |
jeblair | fungi: i'm guessing that isn't needed in odsreg because "wsgi app" or something? | 21:28 |
fungi | i'm kinda stumped as to why odsreg doesn't need it, unless wsgi is handling the authorization bit, yeah | 21:29 |
fungi | wsgi is sort of a black box to nme | 21:29 |
clarkb | jeblair: greghaynes I am not sure https://review.openstack.org/#/c/224821/3/nodepool/nodepool.py is correct, that assumes you will never use the same diskimage as the base for two different provider images | 21:30 |
clarkb | jeblair: greghaynes maybe they have different flavors or other differences | 21:30 |
clarkb | I think for upload image you want to apss the provider image then in uploadImage look up what specific diskimage needs to be uploaded for that image | 21:30 |
clarkb | unfortunately nodepool has no way of sharing images in a provider between flavors right now | 21:31 |
jeblair | oh, that's my change? | 21:31 |
clarkb | jeblair: ya but greghaynes updated it to fix the test | 21:32 |
clarkb | I think the test only works if you don't share a diskimage in multiple provider images | 21:32 |
greghaynes | clarkb: lets make a test for that | 21:32 |
jeblair | clarkb: well, he updated it to further correct the bug in uploadImage | 21:32 |
jeblair | though, i think that could have been a separate patch :) | 21:32 |
clarkb | jeblair: right that | 21:32 |
waynr | zaro: pong | 21:32 |
greghaynes | jeblair: woops, sorry | 21:33 |
greghaynes | I was hoping to make a thing with a passing test | 21:33 |
clarkb | let me leave a comment then it can be cleaned up however | 21:33 |
greghaynes | clarkb: So I dont see how the behavior would be different now - before it was looking up the image in a spcific provider | 21:33 |
*** mriedem has quit IRC | 21:33 | |
greghaynes | clarkb: or maybe I dont understand exactly what youre saying | 21:33 |
clarkb | greghaynes: I think the old behavior was wrong too | 21:34 |
greghaynes | clarkb: oh, well then yes | 21:34 |
clarkb | greghaynes: but if we are going to fix it lets actually fix it | 21:34 |
greghaynes | clarkb: agreed | 21:34 |
*** mdenny has quit IRC | 21:34 | |
jeblair | clarkb: thanks. part of why i don't understand your comment is i don't know whether you are criticizing my change or greghaynes :) | 21:34 |
greghaynes | clarkb: what is extra :( is that I did rework this to be less crazypants in my nodepool builder patches | 21:34 |
clarkb | commented | 21:35 |
*** mdenny has joined #openstack-infra | 21:35 | |
jeblair | clarkb, greghaynes: i'm not sure i full understand what greghaynes wrote yet, but based on our earlier conversation, i did expect uploadImage to need an additional argument (or at least know both names) | 21:36 |
jeblair | (that's tentative agreement with clarkb's comment) | 21:36 |
greghaynes | clarkb: my thought on fixing that now - I intentionally didnt change the function signature because theres more than one place where we call that and kind of wanted to get it fixed with less chance of breaking more things | 21:37 |
openstackgerrit | Merged openstack-infra/puppet-odsreg: Initial commit https://review.openstack.org/223870 | 21:37 |
*** cloudtrainme has quit IRC | 21:37 | |
*** tonytan4ever has joined #openstack-infra | 21:37 | |
clarkb | greghaynes: it should only be called in 2 places | 21:37 |
fungi | okay, i have root-owned screen sessions with full pypi mirror state refreshes going on all three rax mirrors now | 21:37 |
greghaynes | clarkb: grep counts 6 | 21:37 |
clarkb | oh maybe tests? | 21:38 |
jeblair | fungi: similarly i have 2 bootstraps in screen | 21:38 |
greghaynes | clarkb: not including tests | 21:38 |
greghaynes | clarkb: oh, one of them is in provider, so 4 | 21:38 |
clarkb | greghaynes: huh anyways the name of the arg is image_name we aren't passing that in that change | 21:38 |
clarkb | greghaynes: we need to pass the image name and can lookup the diskimage from there or we need to pass the diskimage too | 21:38 |
clarkb | but diskimage alone isn't unique key | 21:38 |
fungi | jeblair: yep, and as discussed i'm basically running the command from the crontab minus wrapping with timeout | 21:38 |
greghaynes | clarkb: its passing diskimage + provider | 21:39 |
clarkb | greghaynes: correct thats not unique | 21:39 |
clarkb | greghaynes: you can have multiple provider images that use the same diskimage | 21:39 |
fungi | so still with flock | 21:39 |
fungi | and the log redirects | 21:39 |
clarkb | greghaynes: it is one way of having multiple flavors in use | 21:39 |
greghaynes | clarkb: right. So this was just horribly borken | 21:39 |
clarkb | greghaynes: yes | 21:39 |
jeblair | greghaynes: yes | 21:39 |
pleia2 | jeblair: reviewed and +2ed those changes, but they're still going through checks, can +A at will, I need to go get my cat from the vet :) | 21:39 |
greghaynes | clarkb: ugh | 21:39 |
jeblair | it only ever worked because we _happened_ to use the same names | 21:40 |
greghaynes | heh, yea, saved by the bug | 21:40 |
greghaynes | ok, I can dive in on that | 21:40 |
jeblair | pleia2: feel free to +A things before check has finished, that's what gate is for | 21:40 |
jeblair | pleia2: i know they don't like that in openstackland, but we're more relaxed :) | 21:40 |
*** andersonvom has joined #openstack-infra | 21:41 | |
*** amuller has quit IRC | 21:43 | |
*** abregman has joined #openstack-infra | 21:43 | |
*** ddieterly has joined #openstack-infra | 21:43 | |
jeblair | greghaynes, clarkb: yeah, my first mental cut of the fix for this is basically: pass both image names, use dib image name for getOrderedReadyDibImages, and use the provider image name the rest of the time. more or less. would expect very little code change. | 21:44 |
*** ddieterly has joined #openstack-infra | 21:44 | |
greghaynes | jeblair: yea, using the provider name is better, I was hoping to get away without changing the arg types but didnt realize how broken it is | 21:45 |
fungi | i've also now detached and deleted the old cinder volumes from the rax pypi mirrors, so cleanup is finished | 21:46 |
greghaynes | actually I did change it anyways, /me make it less bad | 21:46 |
*** tlian has quit IRC | 21:47 | |
*** jaypipes has quit IRC | 21:47 | |
*** amitgandhinz has quit IRC | 21:48 | |
*** dims_ has joined #openstack-infra | 21:49 | |
openstackgerrit | Akash Gangil proposed openstack-infra/project-config: Gerrit bot request for vmware-nsx irc channel https://review.openstack.org/224898 | 21:51 |
*** tiswanso has joined #openstack-infra | 21:52 | |
fungi | okay, popping out to get a bite to eat, will be back in a while to check in on the pypi mirror update progress | 21:53 |
openstackgerrit | greghaynes proposed openstack-infra/nodepool: Correct missing DIB image detection https://review.openstack.org/224821 | 21:53 |
greghaynes | clarkb: jeblair ^ is that what you mean? | 21:53 |
*** DericHorn-HP has quit IRC | 21:54 | |
*** r1chardj0n3s has left #openstack-infra | 21:54 | |
*** bhunter71 has joined #openstack-infra | 21:54 | |
clarkb | yes | 21:56 |
jeblair | greghaynes: that looks like it should work | 21:56 |
greghaynes | trying to fix up the test now... | 21:56 |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Correct exception when waiting for image build https://review.openstack.org/224823 | 21:57 |
jeblair | rebase ^ | 21:57 |
*** Sukhdev has joined #openstack-infra | 21:57 | |
*** gordc has joined #openstack-infra | 21:58 | |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Test different provider and dib image names https://review.openstack.org/224886 | 21:58 |
jeblair | rebased that too | 21:59 |
*** sabeen1 has joined #openstack-infra | 21:59 | |
greghaynes | clarkb: jeblair when you do the image-update command - you are specifying the provider image.name, not the diskimage name, correct? | 22:00 |
jeblair | greghaynes: not sure i've used it; lemme see | 22:01 |
clarkb | yes | 22:02 |
greghaynes | hrm, I think there might be a similar break for nodepoolcmd image-update | 22:03 |
jeblair | greghaynes: yes, looks like it :) | 22:03 |
*** NikitaKonovalov has quit IRC | 22:03 | |
jeblair | (er, unsure about break, i was confirming cmd syntax) | 22:03 |
greghaynes | yep | 22:03 |
*** jd__ has quit IRC | 22:03 | |
*** fbo has quit IRC | 22:03 | |
greghaynes | It is really cool that we have tests now, though | 22:04 |
*** fbo has joined #openstack-infra | 22:04 | |
*** jd__ has joined #openstack-infra | 22:04 | |
*** ddieterly has quit IRC | 22:04 | |
*** Sukhdev has quit IRC | 22:05 | |
*** NikitaKonovalov has joined #openstack-infra | 22:05 | |
*** stevemar has quit IRC | 22:05 | |
*** tonytan4ever has quit IRC | 22:05 | |
*** shivharis has joined #openstack-infra | 22:06 | |
*** annegentle has joined #openstack-infra | 22:08 | |
*** ozamiatin has joined #openstack-infra | 22:08 | |
*** bhunter71 has quit IRC | 22:09 | |
*** dimtruck is now known as zz_dimtruck | 22:09 | |
ruagair | still looking for the Storyboard dump if any root folk are about and can slot it in :-) | 22:10 |
jeblair | ruagair: oh hi. i guess i'm it :) | 22:10 |
*** achanda has quit IRC | 22:11 | |
*** doug-fish has quit IRC | 22:11 | |
*** stevemar has joined #openstack-infra | 22:11 | |
ruagair | Thanks jeblair. Greatly appreciated. My phabricator instance looks sad and lonely at present :-D | 22:12 |
jeblair | so looks like i need to strip these tables: accesstokens, authorizationcodes, refreshtokens | 22:12 |
*** bpokorny has quit IRC | 22:12 | |
*** bpokorny has joined #openstack-infra | 22:12 | |
*** ozamiatin has quit IRC | 22:13 | |
*** ZZelle_ has quit IRC | 22:14 | |
openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Support copyartifact build selector param https://review.openstack.org/133774 | 22:14 |
*** stevemar has quit IRC | 22:14 | |
*** hodos has joined #openstack-infra | 22:16 | |
*** dims_ has quit IRC | 22:17 | |
*** dims_ has joined #openstack-infra | 22:20 | |
*** ozamiatin has joined #openstack-infra | 22:20 | |
*** weshay has quit IRC | 22:20 | |
*** armax has quit IRC | 22:21 | |
*** sigmavirus24 is now known as sigmavirus24_awa | 22:21 | |
jeblair | ruagair: grab https://storyboard.openstack.org/db-dump/storyboard.sql.gz | 22:21 |
jeblair | ruagair: and let me know when you have it | 22:21 |
greghaynes | jeblair: clarkb ok, so this kind of breaks our image-update semantics. Multiple providers could have multiple images with name foo which point to different diskimages. In that case we should rebuild all the images being pointed to? | 22:22 |
jeblair | i've disabled puppet because i believe it will reinstall storyboard which will remove that directory | 22:22 |
*** bltavares has joined #openstack-infra | 22:22 | |
jeblair | greghaynes: image-update takes a provider name (or the special case 'all') | 22:22 |
jeblair | greghaynes: so in normal use, we have provider+image | 22:22 |
gangil | https://review.openstack.org/#/c/224898/ reviews would be great :) thanks! | 22:22 |
greghaynes | jeblair: yes, in the all case though | 22:22 |
jeblair | greghaynes: yes, i think so. that probably breaks the "dib_image_built" part of that doesn't it? | 22:23 |
greghaynes | yep | 22:23 |
greghaynes | well, the code doesnt even slightly resemble something that might be able to do multiple builds | 22:24 |
jeblair | greghaynes: yeah, that's the only thing that makes sense to me | 22:24 |
greghaynes | ok. I think this is where were heading but to codify it a bit more - nodepool itself should only deal with provider image names, not diskimage names at all | 22:25 |
jeblair | greghaynes: yeah; i think what we want (for the all case) is: for each provider image, update its diskimage if it has not already been done, then upload. | 22:26 |
jeblair | greghaynes: right | 22:26 |
greghaynes | This is important when nodepool builders break out diskimages to a config that nodepool doesnt have | 22:26 |
*** achanda has joined #openstack-infra | 22:26 | |
*** tiswanso has quit IRC | 22:27 | |
jeblair | greghaynes: (so normally, we would update the ubuntu-trusty diskimage once and then upload that to 8 providers; but if there were 2 diskimages involved, they would both get updated) | 22:28 |
*** mriedem has joined #openstack-infra | 22:28 | |
greghaynes | yep | 22:28 |
greghaynes | sounds good | 22:28 |
*** annegentle has quit IRC | 22:30 | |
*** mriedem1 has joined #openstack-infra | 22:33 | |
jeblair | interesting... slack seems to be receiving this irc channel | 22:33 |
greghaynes | slack? | 22:34 |
jeblair | the private chat tool for teams startup du jour | 22:34 |
clarkb | its like hipchat but hipper | 22:34 |
pleia2 | hah | 22:34 |
jeblair | i suspect someone has it piped into a slack channel automatically | 22:34 |
* greghaynes looks at mordred | 22:35 | |
*** mriedem has quit IRC | 22:35 | |
greghaynes | if anyone was to try that kind of thing... | 22:35 |
jeblair | greghaynes: mordred seems to be good at using irc to irc :) | 22:35 |
greghaynes | doesnt he have some crazy mutiple layers of bouncer setup? | 22:36 |
greghaynes | might have crossed the streams | 22:36 |
clarkb | no thats dansmith and sdague | 22:36 |
jeblair | !say hello | 22:36 |
openstack | jeblair: Error: "say" is not a valid command. | 22:36 |
jeblair | ircbot say hello | 22:36 |
jeblair | nope, not that one ;) | 22:36 |
*** annegentle has joined #openstack-infra | 22:37 | |
*** hdd has quit IRC | 22:40 | |
*** hdd has joined #openstack-infra | 22:41 | |
*** hrou has quit IRC | 22:45 | |
tonyb | mriedem1: /win 80 | 22:45 |
tonyb | *sigh* mriedem1 Thanks for that change. | 22:45 |
*** ddieterly has joined #openstack-infra | 22:47 | |
openstackgerrit | Darragh Bailey proposed stackforge/python-jenkins: Provider helper classes for plugin data management https://review.openstack.org/154316 | 22:47 |
ruagair | about to be airbourne jeblair. Will check on the other side. Thanks! | 22:47 |
*** ddieterly has quit IRC | 22:47 | |
*** ddieterl_ has joined #openstack-infra | 22:48 | |
*** erlon has quit IRC | 22:48 | |
jlvillal | greghaynes: In disk-image-builder is there an easy way to get more verbose logging of what the image is doing when it is booting up? | 22:48 |
greghaynes | jlvillal: -x | 22:48 |
*** ddieterly has joined #openstack-infra | 22:48 | |
jlvillal | Sweet :) | 22:48 |
greghaynes | jlvillal: oh, booting | 22:48 |
clarkb | thats independent of dib | 22:49 |
greghaynes | jlvillal: dib doesnt know anything about what goes on at boot - it just makes the image | 22:49 |
clarkb | depends on your init system | 22:49 |
jlvillal | I was doing a: disk-image-create ubuntu baremetal localboot dhcp-all-interfaces -o my-image | 22:49 |
jlvillal | And seeing errors on boot, so was hoping to make it be more verbose. | 22:49 |
jlvillal | I will keep looking | 22:50 |
greghaynes | jlvillal: yea, dib really doesnt have anything to do with that, youre gonna have to look at the upstart logs or similar | 22:50 |
jlvillal | greghaynes: Yeah it fails to finish the boot :( So I don't have access to any logs. | 22:50 |
*** ozamiatin has quit IRC | 22:50 | |
greghaynes | jlvillal: console log? | 22:50 |
clarkb | or boot recovery instance | 22:51 |
jlvillal | greghaynes: I got that :) | 22:51 |
jeblair | or worse, try to figure how to access the logs in systemd | 22:51 |
greghaynes | jeblair: only possible suggestions please | 22:51 |
clarkb | jeblair journalctl -something -somethingelse | 22:51 |
jeblair | which is going to be really hard if you can't run the journal command thingy | 22:51 |
jlvillal | I can see tftp failing with 'c' not valid option | 22:51 |
greghaynes | :) | 22:51 |
jlvillal | And then a curl command fails, but I don't see what the command is | 22:51 |
jlvillal | I will keep investigating. Thanks | 22:51 |
clarkb | jeblair wow I never considered that before and just wait for binary format to be versioned | 22:52 |
*** ddieterl_ has quit IRC | 22:52 | |
*** zeih has joined #openstack-infra | 22:53 | |
*** ddieterly has quit IRC | 22:53 | |
*** Piet has joined #openstack-infra | 22:53 | |
*** Piet has quit IRC | 22:54 | |
*** gildub has joined #openstack-infra | 22:55 | |
*** ddieterly has joined #openstack-infra | 22:55 | |
*** gangil1 has joined #openstack-infra | 22:56 | |
*** andersonvom has quit IRC | 22:56 | |
*** gangil has quit IRC | 22:57 | |
*** zeih has quit IRC | 22:58 | |
*** gordc has quit IRC | 22:58 | |
*** dims_ has quit IRC | 22:59 | |
*** austin81 has left #openstack-infra | 22:59 | |
*** mrmartin has joined #openstack-infra | 22:59 | |
*** david-lyle has joined #openstack-infra | 22:59 | |
*** bpokorny has quit IRC | 23:00 | |
*** bpokorny has joined #openstack-infra | 23:01 | |
*** dangers is now known as dangers_away | 23:02 | |
*** krtaylor has joined #openstack-infra | 23:02 | |
*** sridhar_ram has quit IRC | 23:03 | |
*** annegentle has quit IRC | 23:03 | |
*** DericHorn-HP has joined #openstack-infra | 23:04 | |
*** bltavares has quit IRC | 23:06 | |
*** bltavares has joined #openstack-infra | 23:07 | |
*** rfolco has quit IRC | 23:08 | |
*** bltavares has quit IRC | 23:11 | |
jeblair | i'm deleting leaked hpcloud ports | 23:14 |
*** hemna is now known as hemnafk | 23:14 | |
*** lucasagomes has quit IRC | 23:16 | |
*** MarkAtwood has quit IRC | 23:18 | |
*** hodos has quit IRC | 23:21 | |
*** MarkAtwo_ is now known as MarkAtwood | 23:21 | |
openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Reorder imports to match hacking guidelines https://review.openstack.org/133465 | 23:25 |
*** trown|outttypeww is now known as trown | 23:25 | |
*** baoli has joined #openstack-infra | 23:25 | |
*** MarkAtwood has quit IRC | 23:29 | |
tonyb | is the gerrit UI slow for others? | 23:29 |
*** sergmelikyan has joined #openstack-infra | 23:33 | |
openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Support default string values for variables https://review.openstack.org/180117 | 23:33 |
*** ozamiatin has joined #openstack-infra | 23:36 | |
*** markvoelker has quit IRC | 23:36 | |
openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Separate out custom yaml tags into separate classes https://review.openstack.org/180370 | 23:37 |
*** ivar-lazzaro has quit IRC | 23:37 | |
openstackgerrit | lifeless proposed openstack/requirements: Remove workaround for pypy https://review.openstack.org/224924 | 23:37 |
*** ddieterly has joined #openstack-infra | 23:38 | |
*** ivar-lazzaro has joined #openstack-infra | 23:38 | |
openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Support lazy resolving of include yaml tags https://review.openstack.org/63580 | 23:39 |
pleia2 | happy to report that once this change (documentation) lands, we can mark the Zanata spec as implemented :) https://review.openstack.org/#/c/222314/ | 23:40 |
pleia2 | good week \o/ | 23:41 |
*** dkehn has quit IRC | 23:43 | |
*** romcheg has quit IRC | 23:44 | |
*** zns has quit IRC | 23:45 | |
*** mdenny has quit IRC | 23:47 | |
*** ddieterl_ has joined #openstack-infra | 23:48 | |
*** armax has joined #openstack-infra | 23:48 | |
*** alexpilotti has joined #openstack-infra | 23:49 | |
ianw | has something changed on etherpad? when i paste in a bunch of logs, it strips otu all the newlines and really screws it up | 23:49 |
geoffarnold | Question: how come oslo-related blueprints don't show up in http://status.openstack.org/release/ ? What other projects don't show up there? | 23:49 |
*** xyang1 has quit IRC | 23:49 | |
*** dkehn has joined #openstack-infra | 23:50 | |
*** sergmelikyan has quit IRC | 23:50 | |
*** ddieterly has quit IRC | 23:51 | |
*** DericHorn-HP has quit IRC | 23:52 | |
jamielennox | can anyone tell me what this failure is: http://logs.openstack.org/50/217450/1/gate/gate-keystoneclient-dsvm-functional/ea52785/console.html#_2015-09-15_22_50_49_490 | 23:53 |
jamielennox | it seems all the tests passed and then there's an ansible issue | 23:53 |
tonyb | fungi: https://wiki.openstack.org/wiki/Election_Officiating_Guidelines#Generate_a_list_of_voters has instructions on how to generate a list of voter email addresses | 23:53 |
openstackgerrit | John L. Villalovos proposed openstack/diskimage-builder: Fix variable misspelling error https://review.openstack.org/224928 | 23:53 |
tonyb | fungi: a) is that basically what you'll do? ; b) if not, does what youll do for us need any special permissions? | 23:54 |
ianw | jamielennox: nah, ansible is perfect, i think the issue is above that http://logs.openstack.org/50/217450/1/gate/gate-keystoneclient-dsvm-functional/ea52785/console.html#_2015-09-15_22_50_45_136 | 23:55 |
ianw | jamielennox: is this a new test or something? | 23:55 |
tonyb | fungi: for example I have all the repos from "ssh review gerrit ls-projects" on my laptop | 23:55 |
jamielennox | ianw: no, it's an old one, a gate job on keystoneclient stable - so something that doesn't get run often | 23:56 |
*** baoli has quit IRC | 23:56 | |
fungi | tonyb: that's not at all what we do for official technical elections, because what we do involves getting table dumps from the gerrit database to identify primary contact addresses and change owners (so they can be confirmed to be cla signers) | 23:56 |
*** sflanigan has joined #openstack-infra | 23:57 | |
jamielennox | ianw: hmm, weird - it still seems like something that wouldn't be under the control of that test | 23:57 |
tonyb | fungi: Ah okay good to know. | 23:57 |
fungi | tonyb: i think that wiki was something someone came up with as an "almost as good" suggestion for unofficial projects wanting to conduct their own elections | 23:57 |
tonyb | fungi: okay. I'll edit the wiki to make that clear so you don't get asked again ;P | 23:58 |
*** ybathia has quit IRC | 23:58 | |
*** thorst has joined #openstack-infra | 23:59 | |
*** zns has joined #openstack-infra | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!