*** sdake_ has joined #openstack-infra | 00:00 | |
*** ZZelle_ has joined #openstack-infra | 00:01 | |
*** ZZelle_ has quit IRC | 00:01 | |
jeblair | mordred, fungi: the gozer folks encountered an error that i think may be responsible for the 'nodepool demand outage' that we saw this morning during uploads | 00:01 |
---|---|---|
jeblair | i believe it is fixed by https://review.openstack.org/193368 | 00:02 |
jeblair | SpamapS: ^ you may be interested too | 00:02 |
mordred | jeblair: I am in favor of bugfixe | 00:02 |
mordred | jeblair: I am in favor of bugfixes | 00:02 |
jeblair | this exception is in our geard log file: http://paste.openstack.org/show/303024/ | 00:02 |
*** Guest44457 has quit IRC | 00:03 | |
openstackgerrit | Steven Dake proposed openstack-infra/project-config: Revert "Make kolla functional job voting" https://review.openstack.org/193369 | 00:03 |
jeblair | note, i have not run zuul tests with that yet (we should set up a x-gate job with that) | 00:03 |
jeblair | which is something that should be done before we try that in prod | 00:03 |
jeblair | i have to run now though | 00:03 |
*** rcarrillocruz has joined #openstack-infra | 00:03 | |
*** sdake has quit IRC | 00:03 | |
sdake_ | could a couple infra cats approve that revert - our gating software apparenty doesn't work well with both a check and gate at the same time | 00:04 |
*** sarob has quit IRC | 00:04 | |
SpamapS | jeblair: quite interesting | 00:04 |
*** puranamr has quit IRC | 00:04 | |
jeblair | SpamapS: yeah, it's kind of in the "how did that ever work department" and then, as we found out this morning, perhaps it doesn't work. :) | 00:05 |
greghaynes | oh - so are we filling up the TCP buffers while were sending data to rax? | 00:05 |
greghaynes | which uncovered this buyg? | 00:05 |
jeblair | greghaynes: i think so | 00:05 |
greghaynes | awesome! | 00:05 |
SpamapS | jeblair: we should run some libhostile testing on geard btw. ;) | 00:05 |
SpamapS | jeblair: http://libhostile.readthedocs.org/en/latest/ | 00:05 |
sdake_ | by "our gating softwre" I mean kollas, not infras | 00:06 |
*** puranamr has joined #openstack-infra | 00:06 | |
*** sdake_ is now known as sdake | 00:06 | |
*** puranamr has quit IRC | 00:07 | |
*** rlandy has quit IRC | 00:09 | |
greghaynes | mordred: hrm, so looks like glean is just not writing out any net config at all. \O/ | 00:09 |
greghaynes | mordred: I also forgot to give my console user sude perms, so waiting on a respin | 00:10 |
*** rcarrillocruz has quit IRC | 00:11 | |
mordred | greghaynes: oh good! | 00:11 |
mordred | greghaynes: (you remembered to boot your vm with config-drive attached, right?) | 00:12 |
greghaynes | yep | 00:12 |
greghaynes | saw the config drive | 00:12 |
*** armax has quit IRC | 00:16 | |
*** rcarrillocruz has joined #openstack-infra | 00:17 | |
*** olaph has quit IRC | 00:17 | |
openstackgerrit | Merged openstack-infra/system-config: Enable logging on openstack-app-catalog IRC channel https://review.openstack.org/190343 | 00:18 |
*** miqui has quit IRC | 00:19 | |
openstackgerrit | lifeless proposed openstack-dev/pbr: Strip markers from test requirements. https://review.openstack.org/193372 | 00:19 |
*** wenlock has quit IRC | 00:19 | |
*** erlon has quit IRC | 00:20 | |
*** sarob has joined #openstack-infra | 00:20 | |
openstackgerrit | lifeless proposed openstack/requirements: Remove hacking and hacking-owned dependencies. https://review.openstack.org/192929 | 00:20 |
openstackgerrit | lifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are. https://review.openstack.org/189250 | 00:20 |
openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt. https://review.openstack.org/189251 | 00:20 |
*** vnod has quit IRC | 00:21 | |
*** amotoki_ has joined #openstack-infra | 00:23 | |
*** sabeen3 has quit IRC | 00:24 | |
*** yamamoto has joined #openstack-infra | 00:24 | |
*** hdd has quit IRC | 00:27 | |
*** gyee has quit IRC | 00:27 | |
*** amotoki_ has quit IRC | 00:28 | |
*** yamamoto has quit IRC | 00:29 | |
sdake | the kolla review queue is completely blocked atm, could couple infra cores approve this revert : https://review.openstack.org/193369 | 00:30 |
*** mtanino has quit IRC | 00:31 | |
lifeless | mordred: how did you go reviewing my stack ? | 00:33 |
lifeless | mordred: I see less +2's than I'd hoped :/ | 00:33 |
*** r-daneel has quit IRC | 00:34 | |
*** weshay has joined #openstack-infra | 00:35 | |
*** dims has joined #openstack-infra | 00:39 | |
*** sdake_ has joined #openstack-infra | 00:41 | |
*** abitha has quit IRC | 00:42 | |
*** sdake has quit IRC | 00:44 | |
*** dims has quit IRC | 00:47 | |
*** dims has joined #openstack-infra | 00:47 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul: actually enable puppet4 voting https://review.openstack.org/193379 | 00:48 |
openstackgerrit | Jerry Zhao proposed openstack-infra/nodepool: add option to use ipv6 for image update and node launching https://review.openstack.org/156178 | 00:51 |
*** koolhead17 has joined #openstack-infra | 00:52 | |
*** koolhead17 has quit IRC | 00:52 | |
*** koolhead17 has joined #openstack-infra | 00:52 | |
*** weshay has quit IRC | 00:53 | |
*** openstack has joined #openstack-infra | 00:56 | |
*** markvoelker has joined #openstack-infra | 00:56 | |
*** alexsyip has quit IRC | 00:59 | |
*** markvoelker has quit IRC | 01:02 | |
*** hodos has quit IRC | 01:02 | |
openstackgerrit | Matt Riedemann proposed openstack/requirements: Add glance_store to projects.txt https://review.openstack.org/182681 | 01:04 |
*** mriedem_afk is now known as mriedem | 01:09 | |
*** bknudson has joined #openstack-infra | 01:10 | |
*** enikanorov2 has quit IRC | 01:10 | |
*** yamamoto has joined #openstack-infra | 01:14 | |
*** vaidy_ has joined #openstack-infra | 01:15 | |
*** yamamoto has quit IRC | 01:18 | |
*** ivar-lazzaro has quit IRC | 01:19 | |
*** otter768 has joined #openstack-infra | 01:22 | |
*** enikanorov2 has joined #openstack-infra | 01:23 | |
openstackgerrit | Kyle Mestery proposed openstack-infra/project-config: Take configuraiton control to test hooks for networking-odl https://review.openstack.org/192433 | 01:23 |
*** otter768 has quit IRC | 01:26 | |
*** EricGonczer_ has joined #openstack-infra | 01:27 | |
*** zz_dimtruck is now known as dimtruck | 01:28 | |
*** woodster_ has quit IRC | 01:31 | |
*** Longgeek has joined #openstack-infra | 01:31 | |
*** tlian has joined #openstack-infra | 01:33 | |
*** ddieterly has joined #openstack-infra | 01:33 | |
*** EricGonczer_ has quit IRC | 01:38 | |
lifeless | fungi: 189250 got dims +1 | 01:39 |
lifeless | fungi: ( I tweaked a couple entries subsequently ) | 01:39 |
*** clu_ has quit IRC | 01:39 | |
*** samueldmq has joined #openstack-infra | 01:39 | |
fungi | lifeless: cool. i take it you're still wrestling with devstack there? | 01:42 |
lifeless | fungi: I added a depends-on to a pbr change | 01:42 |
fungi | ahh, keen | 01:42 |
openstackgerrit | John Trowbridge proposed openstack-infra/project-config: add stackforge/ahc-tools https://review.openstack.org/193392 | 01:42 |
lifeless | but even if it passes via depends-on, I don't think we should merge it until pbr is released with that fix | 01:43 |
lifeless | right now I'm poking at the new deps proton needs | 01:43 |
*** dkranz has joined #openstack-infra | 01:43 | |
lifeless | to make generate-constraints work locally | 01:43 |
lifeless | swig -python -threads -o cproton_wrap.c cproton.i | 01:43 |
lifeless | cproton.i:310: Error: Unable to find 'proton/cproton.i' | 01:43 |
lifeless | error: command 'swig' failed with exit status 1 | 01:43 |
lifeless | fungi: 193372 is the pbr change | 01:43 |
lifeless | fungi: which appeard to run its devstack run with the transiently broken pbr thing which has now landed | 01:44 |
lifeless | fungi: so should be fine (now) | 01:44 |
fungi | yeah, i'm looking at the test logs from the pbr change | 01:45 |
lifeless | I've told it to recheck | 01:45 |
fungi | /opt/stack/new/devstack/inc/python: line 230: ./.venv/bin/python: No such file or directory | 01:46 |
lifeless | yes | 01:46 |
lifeless | that was the transient breakage | 01:46 |
lifeless | see devstack master git log | 01:47 |
lifeless | do you happen to know what packages we need to add to install python-proton-qpid ? | 01:47 |
lifeless | I've adde uuid-dev swig | 01:47 |
lifeless | but its barfing | 01:47 |
lifeless | as above | 01:47 |
lifeless | flaper87: ^ | 01:47 |
fungi | aha, yep | 01:48 |
fungi | lifeless: i think they were recently added to the bare-.* workers. checking git history now | 01:49 |
lifeless | fungi: they were added to tools/integration.sh | 01:50 |
lifeless | hmm, wonder if its python3 | 01:50 |
fungi | lifeless: on debuntu it needs uuid-dev and swig | 01:50 |
fungi | on frhelos it's libuuid-devel instead of uuid-dev | 01:50 |
*** Longgeek has quit IRC | 01:50 | |
lifeless | yeah | 01:51 |
lifeless | it fails on python 3.4 | 01:51 |
lifeless | hahahahahaaha | 01:51 |
fungi | so nice | 01:51 |
* lifeless blacklists it | 01:51 | |
fungi | lifeless: at least proton is old and being retired, right? | 01:51 |
*** laughterwym has joined #openstack-infra | 01:52 | |
lifeless | well | 01:54 |
lifeless | this is the new shiny one | 01:54 |
lifeless | apparently | 01:54 |
*** tjones1 has joined #openstack-infra | 01:54 | |
lifeless | flaper has been doing some work to make it less awful | 01:54 |
lifeless | but yes, the pyngus update needs to be version capped | 01:55 |
fungi | oh, found https://issues.apache.org/jira/browse/PROTON-490 | 01:55 |
lifeless | so I'm thinking we probably want to run generate-constraints during CI of changes to openstack/requirements | 01:56 |
lifeless | because new things that come in might be wrongly versioned | 01:56 |
lifeless | erm | 01:56 |
lifeless | markered | 01:56 |
lifeless | and we won't catch that until the periodic job today | 01:56 |
* fungi was also kidding about proton being retired. knows it's recent addition | 01:56 | |
*** vaidy_ has quit IRC | 01:56 | |
*** sarob has quit IRC | 01:57 | |
*** markvoelker has joined #openstack-infra | 01:57 | |
openstackgerrit | lifeless proposed openstack/requirements: Remove hacking and hacking-owned dependencies. https://review.openstack.org/192929 | 01:58 |
openstackgerrit | lifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are. https://review.openstack.org/189250 | 01:58 |
openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt. https://review.openstack.org/189251 | 01:58 |
*** enikanorov2 has quit IRC | 01:59 | |
lifeless | meh, restart all your CIs. :/ | 01:59 |
openstackgerrit | lifeless proposed openstack-dev/pbr: Strip markers from test requirements. https://review.openstack.org/193372 | 01:59 |
*** nijaba has joined #openstack-infra | 02:00 | |
*** tsufiev has quit IRC | 02:01 | |
*** ddieterly has quit IRC | 02:02 | |
*** yamamoto has joined #openstack-infra | 02:02 | |
*** markvoelker has quit IRC | 02:02 | |
*** tsufiev has joined #openstack-infra | 02:06 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Don't sanitize node names for log directories https://review.openstack.org/193104 | 02:11 |
*** rlandy has joined #openstack-infra | 02:15 | |
bhunter71 | hi all, a question. When post/release/tag zuul pipelines fail jobs, how does one know? Does it email someone? (I only know by watching my zuul UI) | 02:24 |
*** amotoki_ has joined #openstack-infra | 02:24 | |
*** amotoki_ has quit IRC | 02:30 | |
*** claudiub has quit IRC | 02:31 | |
*** ddieterly has joined #openstack-infra | 02:33 | |
*** sdake_ has quit IRC | 02:34 | |
*** prad has quit IRC | 02:35 | |
*** marzif has quit IRC | 02:36 | |
*** ddieterly has quit IRC | 02:37 | |
*** AzherKhan has joined #openstack-infra | 02:38 | |
*** sabeen has joined #openstack-infra | 02:39 | |
*** tjones1 has quit IRC | 02:39 | |
*** cburgess has quit IRC | 02:39 | |
*** hdd has joined #openstack-infra | 02:41 | |
*** cburgess has joined #openstack-infra | 02:44 | |
*** rlandy has quit IRC | 02:45 | |
*** rlandy has joined #openstack-infra | 02:45 | |
*** jamielennox is now known as jamielennox|away | 02:46 | |
*** Longgeek has joined #openstack-infra | 02:47 | |
*** jamielennox|away is now known as jamielennox | 02:53 | |
lifeless | fungi: 193372 is green | 02:57 |
lifeless | mordred: ^ | 02:57 |
lifeless | thats a critical-path fix for pbr | 02:57 |
*** stevemar has joined #openstack-infra | 03:01 | |
*** wuhg has joined #openstack-infra | 03:03 | |
*** cburgess has quit IRC | 03:04 | |
*** cburgess has joined #openstack-infra | 03:05 | |
*** dims has quit IRC | 03:06 | |
*** cburgess has quit IRC | 03:07 | |
*** cburgess has joined #openstack-infra | 03:10 | |
*** rlandy has quit IRC | 03:12 | |
*** rlandy has joined #openstack-infra | 03:13 | |
*** bhunter71 has quit IRC | 03:13 | |
*** koolhead17 has quit IRC | 03:14 | |
*** armax has joined #openstack-infra | 03:16 | |
*** tlian has quit IRC | 03:17 | |
*** Longgeek has quit IRC | 03:19 | |
*** stevemar has quit IRC | 03:22 | |
*** EricGonczer_ has joined #openstack-infra | 03:22 | |
*** otter768 has joined #openstack-infra | 03:23 | |
*** rm_work has quit IRC | 03:25 | |
*** EricGonczer_ has quit IRC | 03:25 | |
*** amotoki_ has joined #openstack-infra | 03:25 | |
*** stevemar has joined #openstack-infra | 03:26 | |
*** otter768 has quit IRC | 03:28 | |
*** coolsvap|away is now known as coolsvap | 03:30 | |
*** amotoki_ has quit IRC | 03:30 | |
*** rm_work|away has joined #openstack-infra | 03:31 | |
*** rm_work|away is now known as rm_work | 03:31 | |
*** rm_work has joined #openstack-infra | 03:31 | |
*** crc32 has quit IRC | 03:31 | |
*** sdake has joined #openstack-infra | 03:33 | |
*** dimtruck is now known as zz_dimtruck | 03:37 | |
*** ashleighfarnham has joined #openstack-infra | 03:42 | |
*** markvoelker has joined #openstack-infra | 03:46 | |
*** markvoelker has quit IRC | 03:51 | |
*** mriedem has quit IRC | 03:55 | |
*** ildikov_ has quit IRC | 03:55 | |
*** koolhead17 has joined #openstack-infra | 04:00 | |
*** koolhead17 has quit IRC | 04:00 | |
*** koolhead17 has joined #openstack-infra | 04:00 | |
*** Longgeek has joined #openstack-infra | 04:00 | |
*** rlandy has quit IRC | 04:02 | |
sdake | https://www.centos.org/forums/viewtopic.php?t=1420 | 04:04 |
sdake | is it possible some chnge in infra affects the setting of the system clocks in a negative way? | 04:04 |
*** zz_jgrimm has quit IRC | 04:05 | |
*** zz_ja has quit IRC | 04:05 | |
*** maurosr has quit IRC | 04:05 | |
*** Longgeek has quit IRC | 04:06 | |
*** zz_jgrimm has joined #openstack-infra | 04:06 | |
*** maurosr has joined #openstack-infra | 04:06 | |
*** vnod has joined #openstack-infra | 04:07 | |
*** zz_ja has joined #openstack-infra | 04:07 | |
*** sdake_ has joined #openstack-infra | 04:07 | |
*** Longgeek has joined #openstack-infra | 04:08 | |
*** abitha has joined #openstack-infra | 04:10 | |
*** sdake has quit IRC | 04:10 | |
*** abitha has quit IRC | 04:10 | |
*** abitha has joined #openstack-infra | 04:11 | |
*** Longgeek_ has joined #openstack-infra | 04:12 | |
*** fedexo has joined #openstack-infra | 04:12 | |
*** Longgeek has quit IRC | 04:15 | |
*** harlowja_at_home has joined #openstack-infra | 04:21 | |
*** ashleighfarnham has quit IRC | 04:26 | |
*** amotoki_ has joined #openstack-infra | 04:26 | |
*** vivek_v_c has joined #openstack-infra | 04:27 | |
*** camunoz is now known as camunoz_mtg | 04:30 | |
*** rossella_s has quit IRC | 04:30 | |
*** rossella_s has joined #openstack-infra | 04:31 | |
*** amotoki_ has quit IRC | 04:31 | |
*** vivek_v_c is now known as vivcheri | 04:31 | |
*** achanda has joined #openstack-infra | 04:33 | |
*** rm_you has joined #openstack-infra | 04:37 | |
*** koolhead17 has quit IRC | 04:40 | |
*** jtomasek has joined #openstack-infra | 04:42 | |
*** markvoelker has joined #openstack-infra | 04:47 | |
*** markvoelker has quit IRC | 04:51 | |
*** achanda has quit IRC | 04:59 | |
ianw | sdake: devstack-gate should get the time right -> http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n118 | 05:00 |
sdake_ | ianw thanks | 05:03 |
sdake_ | but we dont actually run devstack ;) | 05:04 |
*** ddieterly has joined #openstack-infra | 05:04 | |
ianw | sdake_: ok, what's the problem then? | 05:05 |
sdake_ | ianw we download a bunch of stuff via epel (https) | 05:07 |
sdake_ | we do it about 40-50 times separately incontainers | 05:07 |
sdake_ | sometimes they fail | 05:07 |
sdake_ | the failure rate has gone from 1-5% previously to 100% today | 05:07 |
*** jog0 has joined #openstack-infra | 05:07 | |
sdake_ | ianw internet googling points to time synchronization issues resulting in the 500 errors coming out of the mirror list via the https protocol | 05:08 |
sdake_ | ianw or firewalls on port 443 | 05:08 |
*** ddieterly has quit IRC | 05:09 | |
sdake_ | since we dont run devstack we have our own gate setup | 05:09 |
sdake_ | ianw https://github.com/stackforge/kolla/blob/master/tests/setup_gate.sh | 05:09 |
sdake_ | I guess one quetion I'd have is why is this spiraled out of control today | 05:11 |
sdake_ | we made our gate from nonvoting to voting | 05:11 |
sdake_ | but I dont think that is the immediate issue | 05:12 |
*** boris-42 has quit IRC | 05:12 | |
ianw | sdake_: well, could be, i've certainly seen yum go a bit crazy when restoring a snapshot image that has a very wrong time | 05:15 |
*** sabeen has quit IRC | 05:17 | |
*** abitha has quit IRC | 05:18 | |
*** garyk has joined #openstack-infra | 05:19 | |
*** rm_you has quit IRC | 05:19 | |
*** otter768 has joined #openstack-infra | 05:24 | |
*** camunoz_mtg is now known as camunoz | 05:24 | |
*** amotoki_ has joined #openstack-infra | 05:27 | |
*** otter768 has quit IRC | 05:28 | |
*** harlowja_at_home has quit IRC | 05:29 | |
*** yamada-h has joined #openstack-infra | 05:31 | |
*** amotoki_ has quit IRC | 05:31 | |
*** jog0 has quit IRC | 05:32 | |
*** AzherKhan has quit IRC | 05:33 | |
*** sdake_ has quit IRC | 05:33 | |
*** BharatK has joined #openstack-infra | 05:48 | |
*** puranamr has joined #openstack-infra | 05:48 | |
*** sarob has joined #openstack-infra | 05:56 | |
*** vnod has quit IRC | 05:56 | |
*** maishsk_afk has quit IRC | 06:01 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/192979 | 06:01 |
*** maishsk_afk has joined #openstack-infra | 06:03 | |
*** laughterwym has quit IRC | 06:05 | |
*** ddieterly has joined #openstack-infra | 06:05 | |
AJaeger | StevenK: good morning! | 06:06 |
StevenK | AJaeger: Hai! | 06:06 |
AJaeger | your scripts are life and seems they fail - did you see that already? | 06:07 |
*** Kennan2 has joined #openstack-infra | 06:07 | |
*** Kennan has quit IRC | 06:07 | |
AJaeger | Go to https://jenkins.openstack.org/ and check the "upstream translation update" output, e.g. https://jenkins.openstack.org/job/oslo.db-upstream-translation-update/18/consoleFull | 06:08 |
*** maishsk_afk has quit IRC | 06:08 | |
*** hdd has quit IRC | 06:09 | |
StevenK | AJaeger: Yup, I knew they would fail, since other parts haven't landed, but they do not impact the running of the script | 06:09 |
AJaeger | StevenK: Indeed,... | 06:10 |
*** stevemar has quit IRC | 06:10 | |
StevenK | So it's all good, the scripts will just be a little noisier | 06:10 |
*** ddieterly has quit IRC | 06:10 | |
AJaeger | Ok, then let's get the other parts in | 06:10 |
AJaeger | Yeah, nobody besides the two of us looks at that noise ;) | 06:11 |
AJaeger | Regarding horizon, did you see https://review.openstack.org/#/c/188665 - I doubt it will help with your scripting work but wanted you to be aware of it | 06:11 |
StevenK | AJaeger: Requires hiera setup, pleia2 is on it | 06:11 |
*** maishsk_afk has joined #openstack-infra | 06:12 | |
StevenK | Oh, and zanata server setup | 06:12 |
StevenK | AJaeger: Yes, I don't believe those changes will impact my script work | 06:12 |
*** ParsectiX has joined #openstack-infra | 06:15 | |
*** maishsk_afk has quit IRC | 06:16 | |
*** flepied1 has joined #openstack-infra | 06:20 | |
AJaeger | StevenK: That's my impression as well. Initially I thought they might. But them going to babel might make life easier in some areas if you need to make changes there. | 06:21 |
*** armax has quit IRC | 06:22 | |
*** sarob has quit IRC | 06:22 | |
*** puranamr has quit IRC | 06:22 | |
StevenK | AJaeger: My current issue is that Zanata won't deal with django{,js}.po -- I have to symlink it to a .pot file :-( | 06:23 |
*** e0ne has joined #openstack-infra | 06:25 | |
*** mrunge has joined #openstack-infra | 06:25 | |
AJaeger | StevenK: can we rename that in the repos? | 06:26 |
AJaeger | StevenK: moving forward: We need to handle translation of stable branches as well. But that's a complete new feature and one the translators would really love AFAIU. | 06:27 |
AJaeger | right now we do not handle branches at all with our scripts | 06:27 |
StevenK | AJaeger: Zanata can in fact do that, we can handle multiple versions | 06:27 |
StevenK | At the moment, we have one version, 'master', but we could certainly have a job that creates a 'liberty' version, and then pushes and pulls from that | 06:28 |
StevenK | AJaeger: So, we could, except for the fact that the proposal scripts have the current path hardcoded | 06:29 |
*** e0ne has quit IRC | 06:31 | |
*** jtomasek has quit IRC | 06:32 | |
*** k4n0 has joined #openstack-infra | 06:34 | |
*** markvoelker has joined #openstack-infra | 06:36 | |
openstackgerrit | Merged openstack-infra/irc-meetings: Revert "Fix incorrect docs meeting time" https://review.openstack.org/193224 | 06:37 |
openstackgerrit | Merged openstack-infra/irc-meetings: Change name of calendar dir to 'calendars' https://review.openstack.org/193123 | 06:38 |
openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/192979 | 06:39 |
*** markvoelker has quit IRC | 06:40 | |
openstackgerrit | Wayne Warren proposed openstack-infra/infra-specs: Jenkins Job Builder 2.0.0 API Changes/Rewrite https://review.openstack.org/182542 | 06:41 |
*** koolhead17 has joined #openstack-infra | 06:43 | |
*** juggler has quit IRC | 06:43 | |
AJaeger | StevenK: yeah, something for the future. Just wanted to remind you of that since you're working on the scripts... | 06:45 |
openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Add tricircle meeting https://review.openstack.org/191793 | 06:45 |
*** maishsk_afk has joined #openstack-infra | 06:47 | |
*** koolhead17 has quit IRC | 06:48 | |
StevenK | AJaeger: Yeah, that may require a smaller spec, or at least concensus on the mailing list, but let's get master working first. :-) | 06:49 |
AJaeger | StevenK: agreed on both points | 06:49 |
*** koolhead17 has joined #openstack-infra | 06:49 | |
*** mpaolino has joined #openstack-infra | 06:54 | |
*** fedexo has quit IRC | 06:55 | |
AJaeger | lifeless: are you around and can help with library releases? | 06:58 |
*** AzherKhan has joined #openstack-infra | 07:00 | |
StevenK | AJaeger: Re Horizon and .pot files, I think I'll draft a mailing list post on my Monday and see what the Horizon folk say before writing up a patch | 07:03 |
StevenK | Because there are number of ways we could handle it | 07:04 |
*** jlanoux has joined #openstack-infra | 07:04 | |
AJaeger | StevenK: ok... | 07:05 |
*** camunoz has quit IRC | 07:05 | |
*** oomichi has joined #openstack-infra | 07:05 | |
*** oomichi_ has joined #openstack-infra | 07:05 | |
*** ddieterly has joined #openstack-infra | 07:06 | |
*** chlong has quit IRC | 07:06 | |
*** ddieterly has quit IRC | 07:10 | |
*** markus_z has joined #openstack-infra | 07:16 | |
*** Hal has joined #openstack-infra | 07:17 | |
*** ihrachyshka has joined #openstack-infra | 07:17 | |
*** Hal is now known as Guest10917 | 07:17 | |
*** jlanoux has quit IRC | 07:18 | |
*** jlanoux has joined #openstack-infra | 07:19 | |
*** dizquierdo has joined #openstack-infra | 07:23 | |
*** oomichi has quit IRC | 07:24 | |
*** oomichi_ has quit IRC | 07:24 | |
*** otter768 has joined #openstack-infra | 07:24 | |
*** ashleighfarnham has joined #openstack-infra | 07:26 | |
*** devvesa has joined #openstack-infra | 07:26 | |
lifeless | AJaeger: I am | 07:27 |
lifeless | AJaeger: but part of the decision in vancouver was to release very early in the week | 07:27 |
lifeless | AJaeger: friday is not early :) | 07:27 |
AJaeger | lifeless: I wasn't aware that "internal tools" were part of the library release. | 07:28 |
lifeless | AJaeger: this is the docs thing? | 07:28 |
AJaeger | lifeless: I send you and dhellmann an email asking for a release in the mean time. | 07:28 |
AJaeger | lifeless: yes. I'm fine having it handled by you, it's just changing my workflow ;) | 07:28 |
*** Ala has joined #openstack-infra | 07:29 | |
*** otter768 has quit IRC | 07:29 | |
AJaeger | If you batch release early next week, it's fine for me as well. | 07:29 |
*** deepakcs has joined #openstack-infra | 07:30 | |
*** ashleighfarnham has quit IRC | 07:30 | |
lifeless | let me reply on the list | 07:32 |
AJaeger | lifeless: sure, thanks! | 07:33 |
*** _nadya_ has joined #openstack-infra | 07:34 | |
*** otherwiseguy has quit IRC | 07:36 | |
*** notnownikki has joined #openstack-infra | 07:36 | |
AJaeger | lifeless: I see ttx answered as well my mail (thanks) - so, let's continue via email | 07:37 |
*** dtantsur|afk is now known as dtantsur | 07:45 | |
*** maishsk_afk has quit IRC | 07:49 | |
*** maishsk_afk has joined #openstack-infra | 07:56 | |
*** claudiub has joined #openstack-infra | 07:58 | |
*** jamielennox is now known as jamielennox|away | 08:00 | |
*** hashar has joined #openstack-infra | 08:01 | |
*** otherwiseguy has joined #openstack-infra | 08:02 | |
*** ZZelle has quit IRC | 08:03 | |
*** ZZelle has joined #openstack-infra | 08:03 | |
*** jcoufal has joined #openstack-infra | 08:06 | |
*** ddieterly has joined #openstack-infra | 08:06 | |
*** arxcruz has joined #openstack-infra | 08:11 | |
*** ddieterly has quit IRC | 08:11 | |
*** bexelbie_ has joined #openstack-infra | 08:14 | |
*** hashar has quit IRC | 08:15 | |
*** ildikov_ has joined #openstack-infra | 08:15 | |
*** cdent has joined #openstack-infra | 08:16 | |
*** yamada-h has quit IRC | 08:16 | |
*** boris-42 has joined #openstack-infra | 08:17 | |
*** e0ne has joined #openstack-infra | 08:18 | |
*** derekh has joined #openstack-infra | 08:18 | |
*** hashar has joined #openstack-infra | 08:23 | |
*** nihilifer has joined #openstack-infra | 08:25 | |
*** markvoelker has joined #openstack-infra | 08:25 | |
*** afazekas has joined #openstack-infra | 08:25 | |
*** e0ne has quit IRC | 08:25 | |
*** amotoki_ has joined #openstack-infra | 08:29 | |
*** markvoelker has quit IRC | 08:29 | |
*** yamada-h has joined #openstack-infra | 08:29 | |
*** alexpilotti has joined #openstack-infra | 08:33 | |
*** hashar has quit IRC | 08:34 | |
*** amotoki_ has quit IRC | 08:34 | |
*** hashar has joined #openstack-infra | 08:34 | |
*** hichihara has quit IRC | 08:35 | |
*** yamada-h has quit IRC | 08:39 | |
*** vivcheri has quit IRC | 08:41 | |
*** devvesa has quit IRC | 08:46 | |
*** hodos has joined #openstack-infra | 08:49 | |
*** Longgeek_ has quit IRC | 08:51 | |
*** Longgeek has joined #openstack-infra | 08:51 | |
nihilifer | hello | 08:57 |
nihilifer | can someone look at this patch? https://review.openstack.org/#/c/189853/ | 08:57 |
nihilifer | it already had +2 yesterday, but needed rebase | 08:57 |
nihilifer | sdauge: could you take a look? | 08:59 |
*** aarefiev has quit IRC | 09:00 | |
*** devvesa has joined #openstack-infra | 09:01 | |
*** masayukig_ has quit IRC | 09:01 | |
*** svasheka has quit IRC | 09:01 | |
*** sslypushenko has quit IRC | 09:02 | |
*** romcheg has joined #openstack-infra | 09:02 | |
*** masayukig_ has joined #openstack-infra | 09:02 | |
*** wznoinsk has quit IRC | 09:03 | |
*** dtantsur is now known as dtantsur|brb | 09:03 | |
*** wznoinsk has joined #openstack-infra | 09:04 | |
*** vponomaryov has quit IRC | 09:05 | |
*** aarefiev has joined #openstack-infra | 09:06 | |
*** ddieterly has joined #openstack-infra | 09:07 | |
openstackgerrit | Thomas Bechtold proposed openstack-dev/pbr: Remove sphinx_config.init_values() manual call https://review.openstack.org/193462 | 09:10 |
*** vponomaryov has joined #openstack-infra | 09:11 | |
*** ddieterly has quit IRC | 09:12 | |
*** devvesa has quit IRC | 09:13 | |
*** juggler has joined #openstack-infra | 09:14 | |
*** romcheg has quit IRC | 09:21 | |
*** Hal has joined #openstack-infra | 09:21 | |
*** Guest10917 has quit IRC | 09:21 | |
*** Hal is now known as Guest16598 | 09:21 | |
*** otter768 has joined #openstack-infra | 09:25 | |
flip214 | Hi. Is there some way I can get a list of recent CI runs (for drbd-devstack) with the SUCCESS/FAILURE information and a link to the results? Perhaps even statistics can be queried? | 09:26 |
*** dizquierdo has quit IRC | 09:27 | |
*** e0ne has joined #openstack-infra | 09:28 | |
*** devvesa has joined #openstack-infra | 09:29 | |
*** coolsvap is now known as coolsvap|away | 09:30 | |
*** _nadya_ has quit IRC | 09:30 | |
*** amotoki_ has joined #openstack-infra | 09:30 | |
*** Guest16598 has quit IRC | 09:30 | |
*** otter768 has quit IRC | 09:30 | |
Kiall | flip214: http://graphite.openstack.org/ has stats etc for jobs, including pass/fail.. It's not quite a list, but if you know graphite, you can probably get the data you wan | 09:32 |
Kiall | t | 09:32 |
Kiall | e.g. for the first job I found ;) http://graphite.openstack.org/render/?width=586&height=308&_salt=1434706376.002&target=stats_counts.zuul.pipeline.check.job.check-devstack-dsvm-cells.ABORTED&target=stats_counts.zuul.pipeline.check.job.check-devstack-dsvm-cells.FAILURE&target=stats_counts.zuul.pipeline.check.job.check-devstack-dsvm-cells.SUCCESS | 09:33 |
*** amotoki_ has quit IRC | 09:34 | |
marzif_ | any core can help me moving this forward please https://review.openstack.org/#/c/193125/ | 09:35 |
*** coolsvap|away is now known as coolsvap | 09:37 | |
*** bexelbie has joined #openstack-infra | 09:38 | |
*** romcheg has joined #openstack-infra | 09:39 | |
*** jlanoux_ has joined #openstack-infra | 09:40 | |
*** abregman has quit IRC | 09:41 | |
*** abregman has joined #openstack-infra | 09:41 | |
*** jasondotstar has joined #openstack-infra | 09:41 | |
*** jlanoux has quit IRC | 09:42 | |
*** hashar has quit IRC | 09:45 | |
*** _nadya_ has joined #openstack-infra | 09:45 | |
flip214 | Kiall: thanks. I do not know it now, but perhaps I will... | 09:47 |
*** hashar has joined #openstack-infra | 09:48 | |
*** abregman has quit IRC | 09:49 | |
*** Kennan2 is now known as Kennan | 09:49 | |
*** e0ne is now known as e0ne_ | 09:52 | |
*** e0ne_ is now known as e0ne | 09:54 | |
flip214 | Kiall: thanks, could make it working | 09:59 |
*** amotoki_ has joined #openstack-infra | 10:07 | |
*** ddieterly has joined #openstack-infra | 10:08 | |
*** dims has joined #openstack-infra | 10:09 | |
*** Hal has joined #openstack-infra | 10:09 | |
*** Hal is now known as Guest13586 | 10:10 | |
*** coolsvap is now known as coolsvap|away | 10:11 | |
*** ddieterly has quit IRC | 10:13 | |
*** markvoelker has joined #openstack-infra | 10:13 | |
*** markvoelker has quit IRC | 10:18 | |
Odd_Bloke | sdague: Did you see my comment on https://review.openstack.org/#/c/191081/3/zuul/layout.yaml ? | 10:19 |
*** sc` has quit IRC | 10:21 | |
*** Alexandra_ has joined #openstack-infra | 10:24 | |
*** kushal has joined #openstack-infra | 10:24 | |
marzif_ | sdague, AJaeger I really need help on https://review.openstack.org/#/c/193125/ I'm blocked... | 10:25 |
flip214 | Kiall: I tried to login to graphite now, hoping that I can store the graph (or export it as URL). | 10:25 |
flip214 | But all I got was "Graphite encountered an unexpected error while handling your request." | 10:25 |
sdague | Odd_Bloke: so what's the test failure scenario? | 10:26 |
flip214 | http://paste.openstack.org/show/304478/ is the complete error message | 10:26 |
Odd_Bloke | sdague: If coverage drops below 90%. | 10:27 |
flip214 | How can I get an URL that shows me that data? | 10:27 |
sdague | that still seems weird to gate on, because that means some merge put you accross a threshold and it's going to be really hard to debug | 10:28 |
AJaeger | marzif_: I'm quite busy with other work today, I'll see what I can do for that one later. | 10:28 |
sdague | we're enforcing clean check, you can't get into the gate unless this test has passed | 10:28 |
marzif_ | AJaeger, appreciate your answer | 10:28 |
AJaeger | marzif_: just a quick question: Do you want to import some parts of your repository into the new repo together with history? In that case use the "upstream" keyword and setup a new repo using "git filter". | 10:28 |
Odd_Bloke | sdague: What might have changed between check and gate? HEAD of the branch we're merging in to? | 10:29 |
sdague | Odd_Bloke: yep | 10:29 |
*** aarefiev has quit IRC | 10:29 | |
marzif_ | AJaeger, yes I want to do that - this is the option I was thinking about: git filter-branch --prune-empty --subdirectory-filter horizon_web_ui/ master | 10:30 |
sdague | and, it might not even be in head yet. It could be multiple things in flight | 10:30 |
marzif_ | AJaeger, I'll check your solution | 10:30 |
sdague | so you push 3 patches into gate they collide and bounce off each other, and no one understands why | 10:30 |
sdague | it just seems like a weird gate job. If you really want it, so be it, but I'd recommend against it | 10:30 |
Odd_Bloke | sdague: I'll chat with harlowja (PING), and see what he thinks. | 10:31 |
AJaeger | marzif_: you only have one chance for that - now. Once your patch is in, we cannot import, this needs to be setup as part of your patch. | 10:31 |
AJaeger | marzif_: check the infra manual and how oslo does it. | 10:32 |
marzif_ | AJaeger, ok | 10:32 |
flip214 | thanks, got it | 10:38 |
openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Disable several tempest jobs for Manila stable/juno branch https://review.openstack.org/193491 | 10:39 |
*** afazekas has quit IRC | 10:44 | |
*** hashar has quit IRC | 10:45 | |
openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP list/search/get https://review.openstack.org/183496 | 10:47 |
openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP create (allocate to project) https://review.openstack.org/183555 | 10:47 |
*** samueldmq has quit IRC | 10:51 | |
openstackgerrit | Fausto Marzi proposed openstack-infra/project-config: Splitting stackforge/freezer on multiple repos https://review.openstack.org/193125 | 10:54 |
*** dims has quit IRC | 10:57 | |
*** rguillebert has joined #openstack-infra | 11:00 | |
*** pc_m has joined #openstack-infra | 11:00 | |
*** Guest13586 has quit IRC | 11:01 | |
*** sc` has joined #openstack-infra | 11:01 | |
*** samuel has joined #openstack-infra | 11:02 | |
*** samuel has quit IRC | 11:02 | |
*** samuel has joined #openstack-infra | 11:03 | |
*** samuel has quit IRC | 11:03 | |
*** samueldmq has joined #openstack-infra | 11:04 | |
*** wuhg has quit IRC | 11:04 | |
*** AzherKhan has quit IRC | 11:04 | |
samueldmq | morning :) | 11:05 |
*** dims has joined #openstack-infra | 11:06 | |
*** afazekas has joined #openstack-infra | 11:07 | |
*** ddieterly has joined #openstack-infra | 11:09 | |
*** aarefiev has joined #openstack-infra | 11:11 | |
*** ddieterly has quit IRC | 11:14 | |
*** Hal has joined #openstack-infra | 11:18 | |
*** Hal is now known as Guest70353 | 11:19 | |
*** e0ne is now known as e0ne_ | 11:19 | |
*** ala_ has joined #openstack-infra | 11:24 | |
marzif_ | AJaeger, I understand your are busy, so please reply at your convenience: I'm not sure why I need to track upstream to do that | 11:24 |
marzif_ | here I wrote some instruction int he dashboard field on how to possible to that | 11:24 |
marzif_ | https://blueprints.launchpad.net/freezer/+spec/main-repo-split | 11:24 |
AJaeger | marzif_: you're not tracking upstream | 11:24 |
marzif_ | I'm not sure I need to do that | 11:24 |
AJaeger | upstream keyword means: Seed this directory from the other one. | 11:25 |
AJaeger | Alternative is: You get an empty repository and push everything through gerrti - and loose your revision history | 11:25 |
AJaeger | the usual work flow is: use git filter to create a new repository with the initial content for your new repo. | 11:26 |
AJaeger | Make that new repo public somewhere and reference it via the upstream keyword | 11:26 |
*** otter768 has joined #openstack-infra | 11:26 | |
AJaeger | Once we approve the change, the "upstream" repo gets imported into your new repo | 11:26 |
*** Alexandra_ has quit IRC | 11:27 | |
*** Ala has quit IRC | 11:27 | |
marzif_ | I'll do that because it's the usual way and I don't want to change it, but I think the steps are not necessary, without losing the history, I'll follow your indication anyway | 11:28 |
AJaeger | marzif_: It's the best way doing it with our infrastructure. | 11:29 |
*** markvoelker has joined #openstack-infra | 11:29 | |
marzif_ | AJaeger, ok : ) | 11:29 |
*** e0ne_ has quit IRC | 11:29 | |
*** koolhead17 has quit IRC | 11:31 | |
*** mwagner_afk has quit IRC | 11:31 | |
*** otter768 has quit IRC | 11:31 | |
*** markvoelker has quit IRC | 11:34 | |
tchaypo | sdague: before reading https://review.openstack.org/#/c/192253/, I’d been expecting to start with talking about what data we need to collect; what’s already in graphite, what we can easily put there by tweaking zuul, what we’re going to have to collect from elsewhere. Starting the conversation with what technology we’re going to used to present the | 11:42 |
tchaypo | data surprised me. In hindsight it makes sense - we don’t want to start throwing data into a system we’ll be throwing away. | 11:43 |
*** jasondotstar has quit IRC | 11:43 | |
*** kushal has quit IRC | 11:44 | |
tchaypo | marzif_: AJaeger: The first time I saw the “upstream” keyword there I was surprised too. It made me think of a git upstream - something that gets constantly tracked and pulled from. It took me a while to understand that in this context it’s something we read from once, but afterwards never look at again | 11:44 |
marzif_ | AJaeger, I've replied to your comments https://review.openstack.org/#/c/193125/ if we could use the openstack name space I think would be better, the project now is growing, it will save us to do similar work in the future | 11:45 |
marzif_ | tchaypo, yes, agreed, git-upstream was written by the guy in front of my desk : ) | 11:45 |
*** abregman has joined #openstack-infra | 11:46 | |
sdague | tchaypo: yeh, so, the implementation steps hopefully provide some of that road map. | 11:46 |
sdague | because I expect that what we need is going to get discovered over time as things get implemented | 11:47 |
tchaypo | sdague: so I don’t have any particular thoughts on what we want to use. I assume we’d want something python if we can, but I hadn’t really thought past that. | 11:47 |
tchaypo | I assume we’ll find over time that the data we thought was interesting isn’t actually the thing we end up referring to, so something that can be easily tweaked and drilled down into would be nice | 11:47 |
*** romcheg has quit IRC | 11:48 | |
*** erlon has joined #openstack-infra | 11:50 | |
*** boris-42 has quit IRC | 11:52 | |
*** koolhead17 has joined #openstack-infra | 11:53 | |
*** maishsk_afk has quit IRC | 11:54 | |
*** mrunge has quit IRC | 11:54 | |
sdague | tchaypo: yeh, I think it most cases we'll be able to get more data put back into graphite | 11:54 |
*** maishsk_afk has joined #openstack-infra | 11:56 | |
*** deepakcs has quit IRC | 11:56 | |
*** weshay has joined #openstack-infra | 11:58 | |
AJaeger | marzif_: openstack namespace is a TC decision - shouldn't be hard with the new big tent model. Best talk later with jeblair or with sdague about that. | 11:59 |
*** marcusvrn has joined #openstack-infra | 11:59 | |
AJaeger | tchaypo: yeah, upstream is misnamed ;( | 11:59 |
AJaeger | tchaypo: that's why we remove these semi-automatically after import ;) | 11:59 |
*** asahlin_away has quit IRC | 12:00 | |
tchaypo | sdague: I’m assuming we’re not going to decide these things before, or during, next week’s meeting - but hopefully we’ll identify who is interested in driving the choices | 12:00 |
marzif_ | AJaeger, ok, ty | 12:01 |
*** bknudson has quit IRC | 12:01 | |
*** asahlin has joined #openstack-infra | 12:01 | |
*** marcusvrn has quit IRC | 12:01 | |
sdague | tchaypo: yeh, honestly, if I was just hacking on this myself I'd have started coding already, but it's pretty clear I'm not going to have a huge amount of coding cycles for this, so I'm just trying to curate the needs | 12:03 |
*** marcusvrn has joined #openstack-infra | 12:04 | |
tchaypo | thanks :) | 12:04 |
*** dprince has joined #openstack-infra | 12:05 | |
*** markvoelker has joined #openstack-infra | 12:05 | |
*** BharatK has quit IRC | 12:05 | |
openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP create (allocate to project) https://review.openstack.org/183555 | 12:07 |
*** e0ne has joined #openstack-infra | 12:08 | |
*** radez_g0n3 is now known as radez | 12:09 | |
*** ddieterly has joined #openstack-infra | 12:10 | |
*** romcheg has joined #openstack-infra | 12:10 | |
*** dtantsur|brb is now known as dtantsur | 12:11 | |
*** coolsvap|away is now known as coolsvap | 12:12 | |
*** ddieterly has quit IRC | 12:14 | |
*** laughterwym has joined #openstack-infra | 12:17 | |
openstackgerrit | yolanda.robla proposed openstack-infra/nodepool: Different queues for slow tasks. https://review.openstack.org/170788 | 12:19 |
*** yamamoto has quit IRC | 12:19 | |
*** tlian has joined #openstack-infra | 12:20 | |
*** coolsvap is now known as coolsvap|away | 12:22 | |
*** bknudson has joined #openstack-infra | 12:25 | |
*** unicell1 has quit IRC | 12:26 | |
*** kgiusti has joined #openstack-infra | 12:26 | |
*** EricGonczer_ has joined #openstack-infra | 12:26 | |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: New oslo library - oslo.service https://review.openstack.org/192886 | 12:26 |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: New oslo library - oslo.service https://review.openstack.org/192886 | 12:26 |
*** trown has joined #openstack-infra | 12:28 | |
*** unicell has joined #openstack-infra | 12:29 | |
AJaeger | jeblair: could you look at https://review.openstack.org/#/c/193392/ and https://review.openstack.org/#/c/191131/ and talk with the Ironic team, please? We might need some kind of "official" message for usage of stackforge vs. openstack for reference | 12:29 |
*** rossella_s has quit IRC | 12:30 | |
*** unicell has quit IRC | 12:30 | |
*** rossella_s has joined #openstack-infra | 12:31 | |
*** rlandy has joined #openstack-infra | 12:33 | |
*** coolsvap|away is now known as coolsvap | 12:34 | |
*** EricGonczer_ has quit IRC | 12:35 | |
*** xyang1 has joined #openstack-infra | 12:36 | |
*** dpaterson has joined #openstack-infra | 12:38 | |
*** pelix has joined #openstack-infra | 12:39 | |
trown | AJaeger: thanks for the feedback on ahc-tools | 12:39 |
dtantsur | jeblair, seconding the request :) we might have a wrong idea what stackforge is for | 12:40 |
trown | AJaeger: I understand that with the "big tent" that we no longer strictly need to have projects incubate in stackforge | 12:40 |
dtantsur | I'm still not sure however, how to prove usefullness of the project without it being baked somewhere | 12:40 |
AJaeger | dtantsur, trown: Times change ;) | 12:40 |
trown | AJaeger: what about immature projects that do actually need incubation? | 12:40 |
*** woodster_ has joined #openstack-infra | 12:40 | |
trown | AJaeger: I would consider ahc-tools very immature at this point | 12:40 |
AJaeger | trown: If it'S not successful, you can make it read-only, independent where it is. | 12:41 |
*** Longgeek has quit IRC | 12:41 | |
*** bswartz has quit IRC | 12:41 | |
fungi | dtantsur: yeah, the idea with the big tent is that teams get recognized by the tc, and as long as they stick with the scope they've defined they can have as many repos as they want in openstack. there's no reason for it to wait for usability or progress before making it openstack, as long as it's being handled by the team the tc has already recognized | 12:41 |
trown | AJaeger: I guess my question is, what is the purpose of stackforge namespace at this point | 12:42 |
fungi | trown: very little | 12:42 |
dtantsur | fungi, here is the problem: of the whole team only I know this project | 12:42 |
AJaeger | trown: With the big tent, it'S more about the 4 opens and being part of OpenStack for a team than mature repositories. | 12:42 |
fungi | trown: i and a number of others would like to just get rid of it | 12:42 |
*** Longgeek has joined #openstack-infra | 12:42 | |
trown | fungi: ah that is useful info | 12:43 |
*** jasondotstar has joined #openstack-infra | 12:43 | |
dtantsur | wow, never thought about it | 12:43 |
fungi | trown: i wish we didn't have these git namespaces at all, but they started because we needed to map repo names to orgs we controlled in github for replication purposes | 12:43 |
AJaeger | trown, dtantsur: For your project - and that'S why I asked - I see no need to be part of stackforge. Only costs and pain for fungi when you move from stackforge to openstack ;) | 12:43 |
trown | AJaeger: I like your optimism :) | 12:43 |
dtantsur | lol | 12:43 |
dtantsur | AJaeger, fungi, that all makes a lot of sense to me, thanks! But I believe someone has to write a lot of long ML posts explaining this new position | 12:44 |
fungi | the namespaces themselves accumulated some unwarranted meaning, but they're entirely cosmetic (and a serious amount of work to change after the repo is created) | 12:44 |
marzif_ | AJaeger, fungi what would be needed to do to migratee a repo from stackforge to openstack namespace? | 12:44 |
AJaeger | trown: It's a shift in mindset: Moving from "mature projects in openstack/, incubation in stackforge" to "repos can mature - or fail - in openstack" | 12:45 |
fungi | marzif_: we take down all our developer services for a maintenance window and do http://docs.openstack.org/infra/system-config/gerrit.html#renaming-a-project | 12:45 |
marzif_ | as I need to split components, would be probably helpful do it now, and do the job only once... | 12:45 |
marzif_ | ah ok fungi thanks | 12:45 |
AJaeger | fungi: marzif_'s background: https://review.openstack.org/193125 which proposes a split of a repo in stackforge... | 12:46 |
fungi | so gerrit, zuul et cetera are offline for 30 minutes or more | 12:46 |
*** dims has quit IRC | 12:46 | |
*** dims has joined #openstack-infra | 12:46 | |
AJaeger | fungi: seems jeblair needs to put on his marketing head for some emails or ask others in the TC to help out ;) | 12:47 |
fungi | and basically the 2k+ developers we have working on openstack can't push changes or get them tested until we finish the renaming work for a single project | 12:47 |
dtantsur | marzif_, I feel sorry for you, splitting a project can be painful :) doing the same right now | 12:47 |
fungi | AJaeger: yeah, i'm hoping https://review.openstack.org/192016 is able to make some headway, after further revision | 12:48 |
marzif_ | dtantsur, lol doing it once, it's part of the game, but doing the same twice... | 12:48 |
*** mrunge has joined #openstack-infra | 12:48 | |
trown | AJaeger, fungi, I am still a little unclear on the criteria for putting a repo in the openstack namespace | 12:48 |
*** aysyanne has joined #openstack-infra | 12:49 | |
trown | AJaeger: fungi, I get that it is not "mature stable project", I just dont get what it is instead | 12:49 |
marzif_ | trown, I think it's still in discussion probably... | 12:49 |
trown | AJaeger: fungi, ie is it everything that would have got accepted to stackforge before? | 12:50 |
*** sarob has joined #openstack-infra | 12:50 | |
fungi | trown: if it's part of a tc recognized project, it's simply necessary that the project says it'll be taking on governance of that repo (either directly or through some auxiliary subteam) | 12:50 |
*** dizquierdo has joined #openstack-infra | 12:50 | |
fungi | trown: if it's a new project rather than joining an existing project, http://governance.openstack.org/reference/new-projects-requirements.html are the guidelines | 12:51 |
*** jaypipes has quit IRC | 12:51 | |
fungi | and i think even that document makes some unnecessary assumptions about "maturity" of a team's work | 12:52 |
trown | fungi: perfect, that answers my question quite well | 12:52 |
fungi | i'll see if i can come up with a better wording to propose to the tc | 12:52 |
dtantsur | fungi, that all sounds good. I wonder what happens if a PTL does not approve including of subproject... would it be a use case for stackforge? | 12:52 |
*** ldnunes has joined #openstack-infra | 12:53 | |
openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP create (allocate to project) https://review.openstack.org/183555 | 12:53 |
fungi | dtantsur: more likely the case for it to be a separate project. a good example is the searchlight project which just spun out of an effort in glance | 12:53 |
fungi | it's closely related to glance, but since it has its own team and they're already working together quite effectively, they simply because a new tc recognized project (last week or the week before i think?) | 12:54 |
dtantsur | hmm, interesting | 12:54 |
fungi | s/because/became/ | 12:54 |
dtantsur | ok folks, thanks for clarifying, much appreciated! | 12:55 |
*** sarob has quit IRC | 12:55 | |
krtaylor | interesting discussion, I'll also throw in that a stackforge project doesn't have to have the TC blessing to start, I always viewed it as a place to start forming, then get TC recognized, then promotion | 12:55 |
*** dpaterson has quit IRC | 12:55 | |
fungi | dtantsur: the resolution to make searchlight a new project is at https://review.openstack.org/188014 | 12:56 |
fungi | they're one of many, but i use them as an example because they didn't follow the pattern of "create a repo in stackforge, apply to the tc, move the repo from stackforge to openstack" | 12:56 |
*** pblaho has joined #openstack-infra | 12:56 | |
*** yamamoto has joined #openstack-infra | 12:57 | |
*** unicell has joined #openstack-infra | 12:57 | |
dtantsur | I see | 12:57 |
*** yamamoto has quit IRC | 12:57 | |
fungi | instead they did "talk to an existing project about inclusion, apply to the tc, create a repo in openstack" | 12:57 |
*** yamamoto has joined #openstack-infra | 12:57 | |
*** Longgeek has quit IRC | 12:57 | |
trown | fungi: thanks again, all very helpful information, I will go that route and talk to Ironic first | 12:58 |
trown | and see what happens from there | 12:58 |
fungi | and if glance had agreed instead, the process for searchlight would have been simply "talk to an existing project about inclusion, create a repo in openstack" | 12:59 |
AJaeger | trown: thanks! | 12:59 |
trown | AJaeger: thank you for helping clear up the confusion | 12:59 |
AJaeger | fungi: Thanks for jumping in, here! | 12:59 |
*** Longgeek has joined #openstack-infra | 12:59 | |
*** coolsvap is now known as coolsvap|away | 12:59 | |
*** unicell has quit IRC | 13:00 | |
fungi | but i like the timeline on that tc motion. searchlight proposed a new project to the tc on june 3, and within 6 days it was approved as a new openstack project. clearly the tc is getting a lot faster at this now | 13:02 |
*** dboik has joined #openstack-infra | 13:03 | |
*** eharney has joined #openstack-infra | 13:03 | |
*** romcheg has quit IRC | 13:04 | |
fungi | the motion is all of ~40 lines of prose and half a dozen bits of metadata | 13:04 |
*** sdake has joined #openstack-infra | 13:05 | |
*** julim has joined #openstack-infra | 13:05 | |
*** HenryG has quit IRC | 13:05 | |
*** dboik_ has joined #openstack-infra | 13:05 | |
*** HenryG has joined #openstack-infra | 13:05 | |
*** HenryG has quit IRC | 13:06 | |
*** rfolco has joined #openstack-infra | 13:06 | |
fungi | and now they can create however many repos they need to achieve their stated mission | 13:06 |
*** sdake_ has joined #openstack-infra | 13:07 | |
*** julim has quit IRC | 13:07 | |
*** HenryG has joined #openstack-infra | 13:07 | |
*** soren has joined #openstack-infra | 13:08 | |
*** julim has joined #openstack-infra | 13:08 | |
*** dboik has quit IRC | 13:08 | |
*** devvesa has quit IRC | 13:08 | |
*** claudiub has quit IRC | 13:08 | |
*** mmedvede has quit IRC | 13:09 | |
mordred | fungi: ok. shade 0.8.1 is on nodepool | 13:09 |
fungi | mordred: excellent. should we restart it before image update time? | 13:09 |
mordred | fungi: I'd like to restart nodepool to pick up the change - that ok with you? | 13:09 |
mordred | fungi: yah | 13:09 |
fungi | go for it. can you give me about 5 minutes though? i'm finishing up a check for alient nodes to see if i can gauge how well the new cleanup is working | 13:10 |
*** laughterwym has quit IRC | 13:10 | |
fungi | s/alient/alien/ | 13:10 |
*** ddieterly has joined #openstack-infra | 13:10 | |
*** sdake has quit IRC | 13:10 | |
*** laughterwym has joined #openstack-infra | 13:10 | |
mordred | sure! | 13:11 |
fungi | mainly just a spot check to see if i can find (via the old traditional comparison method) any which have somehow slipped through the new metadata-based autocleanup | 13:11 |
samueldmq | mordred: nice, I starte looking at shade yesterday, left a review on one of those patches keystone-related | 13:12 |
mordred | fungi: btw - "sudo -H nodepool shade-inventory --yaml --list" should give you a lovely yaml output of all of the nodes in nodepool, if you ever want such a thing | 13:12 |
mordred | samueldmq: woot! thanks | 13:12 |
*** dustins has joined #openstack-infra | 13:13 | |
*** baoli has joined #openstack-infra | 13:14 | |
fungi | mordred: that's excellent--new nodepool cli subcommands to play with | 13:14 |
fungi | oh, wait, it's a separate shade cli. still cool | 13:14 |
fungi | assuming you meant -u nodepool? | 13:15 |
*** ddieterly has quit IRC | 13:15 | |
fungi | rather -H -u nodepool | 13:15 |
samueldmq | mordred: that's still a small project, and I guess it's intended to be simple :) | 13:15 |
openstackgerrit | Merged openstack-dev/pbr: Strip markers from test requirements. https://review.openstack.org/193372 | 13:15 |
samueldmq | mordred: it will be fun to take a deeper look on it | 13:15 |
*** maishsk_afk has quit IRC | 13:16 | |
mordred | fungi: yes. I did mean -H -u nodepool | 13:16 |
samueldmq | mordred: as I find some time between dynamic policies tasks ;) | 13:16 |
fungi | indeed, `sudo -H -u nodepool shade-inventory --yaml --list` works. just tried it | 13:16 |
sdague | samueldmq: it will be more fun if we can make it obsolete by fixing openstack | 13:16 |
*** baoli_ has joined #openstack-infra | 13:16 | |
mordred | yup | 13:16 |
mordred | that's the goal | 13:16 |
mordred | but hopefully it'll be a clear target to aim for | 13:17 |
fungi | samueldmq: sdague: the smaller shade gets, the more successful openstack is becoming at achieving consistency and interoperability | 13:17 |
samueldmq | sdague: ahha yes I agree | 13:17 |
samueldmq | sdague: mordred fungi that's great! :) | 13:17 |
*** yamamoto has quit IRC | 13:17 | |
*** koolhead17 has quit IRC | 13:18 | |
samueldmq | mordred: https://github.com/openstack-infra/shade/blob/master/shade/__init__.py#L202-L207 | 13:18 |
samueldmq | mordred: this is a great description on what it is different fro ma simple OpenStack sdk | 13:19 |
AJaeger | sdague: should we add a link to governance or one of its subpages on docs.o.o ? I haven't found the proper text and place yet. | 13:19 |
samueldmq | mordred: as we were discussing a couple of days ago, iirc | 13:19 |
*** bswartz has joined #openstack-infra | 13:19 | |
*** baoli has quit IRC | 13:19 | |
*** romcheg has joined #openstack-infra | 13:19 | |
AJaeger | sdague: I just read your comment on the stackforge -> openstack TC proposal | 13:20 |
*** sdake has joined #openstack-infra | 13:20 | |
openstackgerrit | Wayne Warren proposed openstack-infra/infra-specs: Jenkins Job Builder 2.0.0 API Changes/Rewrite https://review.openstack.org/182542 | 13:21 |
openstackgerrit | Wayne Warren proposed openstack-infra/infra-specs: Jenkins Job Builder 2.0.0 API Changes/Rewrite https://review.openstack.org/182542 | 13:21 |
*** weshay is now known as weshay_mtg | 13:22 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Convert ironicclient node.get() call to Task https://review.openstack.org/193535 | 13:23 |
*** achanda has joined #openstack-infra | 13:23 | |
*** sdake_ has quit IRC | 13:24 | |
*** mriedem has joined #openstack-infra | 13:24 | |
mordred | dguerri`, Shrews: oops. error in the get_ipv4 code | 13:25 |
EmilienM | mordred:,AJaeger: good morning here! I think I did wrong yesterday in trying to enable voting for puppet4. Here is a fix: https://review.openstack.org/#/c/193379/ | 13:25 |
*** zz_dimtruck is now known as dimtruck | 13:25 | |
sdague | AJaeger: that would probably be a good thing to do | 13:25 |
sdague | AJaeger: I don't know the best place | 13:25 |
AJaeger | sdague: let me do a patch and see what others think... | 13:26 |
AJaeger | it's not the first time it came up but I haven't found the perfect place - so time for a non-perfect one ;) | 13:26 |
*** jaypipes has joined #openstack-infra | 13:26 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Add several jobs for Manila periodic pipeline https://review.openstack.org/193538 | 13:26 |
*** dguerri` is now known as dguerri | 13:26 | |
sdague | I also kind of feel that - http://governance.openstack.org/reference/projects/index.html should at least have a summary of the projects in question, that's most a weird wall of text that means nothing to people that don't already know what it means | 13:26 |
AJaeger | sdague: yeah | 13:26 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Catch all exceptions around port for ip finding https://review.openstack.org/193540 | 13:26 |
fungi | mordred: jeblair: interestingly i have 10 alien nodes showing in dfw, 3 in iad and 2 in ord (in addition to the 4 in hpcloud which i think are undeletable, "locked" according to novaclient) | 13:27 |
Shrews | mordred: fix it fix it fix it | 13:27 |
mordred | fungi, Shrews: ^^ I need to land that patch now | 13:27 |
mordred | because inventory is broken for rax | 13:27 |
*** otter768 has joined #openstack-infra | 13:27 | |
dguerri | mordred: looking | 13:27 |
*** yamamoto has joined #openstack-infra | 13:27 | |
mordred | dguerri: then, I think after we cut a bugfix - we should probably go add another test to highlight that issue, if you have a sec | 13:28 |
fungi | mordred: any reason not to build up a list of known exceptions there? is it safe to just treat any exception that might throw equally? | 13:28 |
mordred | fungi: it's safe for now, since that's a function where if one service doesn't work we're just going to try another one | 13:29 |
dguerri | can't open https://review.openstack.org ... hope it's just me | 13:29 |
*** bcourt has joined #openstack-infra | 13:29 | |
fungi | dguerri: i assume it's just you because it's working for me | 13:29 |
*** devvesa has joined #openstack-infra | 13:29 | |
dguerri | fungi: tnx | 13:29 |
mordred | dguerri: hrm. something is off in that code in general - I do not have a good accessIPv4 on any of my clouds | 13:29 |
*** abregman has quit IRC | 13:30 | |
mordred | dguerri: I'm going to put in some local tracing and let you know what's up | 13:30 |
dguerri | mordred: ++ | 13:30 |
*** abregman has joined #openstack-infra | 13:30 | |
fungi | mordred: should i un-approve that exception change? | 13:30 |
dguerri | mordred: that's quite odd, we tested it quite a bit before merging | 13:30 |
*** peristeri has joined #openstack-infra | 13:30 | |
fungi | or are you planning to submit a different change for the rest of whatever you find rather than evolving that one? | 13:30 |
mordred | fungi: exception change is still great | 13:31 |
mordred | it's actually _totally_ broken | 13:31 |
fungi | cool, i'll leave it in flight | 13:31 |
Shrews | :( | 13:31 |
mordred | this other thing is a specific metadata thing | 13:31 |
*** dannywilson has joined #openstack-infra | 13:32 | |
*** otter768 has quit IRC | 13:32 | |
mordred | Shrews, dguerri: we're missing a layer - you're trying to map a server port to a network - but a server port is going to be attached to a subnet which will be attached to a network | 13:34 |
AJaeger | sdague: what do you think of https://review.openstack.org/193547 for the governance change on docs.o.o? | 13:35 |
*** trown has left #openstack-infra | 13:35 | |
*** puranamr has joined #openstack-infra | 13:36 | |
*** mmedvede has joined #openstack-infra | 13:37 | |
AJaeger | sdague, fungi: could either of you unblock kolla, please? https://review.openstack.org/193369 | 13:37 |
*** maishsk_afk has joined #openstack-infra | 13:38 | |
sdake | would be much appreciated :) | 13:38 |
sdague | +A | 13:38 |
fungi | lgtm | 13:38 |
fungi | we double-approved it, for double goodness i guess | 13:38 |
AJaeger | sdague, fungi : Either not both ;) | 13:38 |
AJaeger | fungi: indeed - thanks | 13:39 |
openstackgerrit | Antoine Musso proposed openstack/diskimage-builder: doc: migrate from README.rst to Sphinx https://review.openstack.org/193051 | 13:39 |
*** tvanderwiel has joined #openstack-infra | 13:39 | |
*** dguerri is now known as dguerri` | 13:40 | |
*** asselin has quit IRC | 13:40 | |
*** ddieterly has joined #openstack-infra | 13:41 | |
*** weshay_mtg is now known as weshay | 13:41 | |
*** ghostpl has joined #openstack-infra | 13:43 | |
*** ddieterly has quit IRC | 13:44 | |
*** prad has joined #openstack-infra | 13:44 | |
*** dguerri` is now known as dguerri | 13:45 | |
*** dansmith is now known as superdan | 13:45 | |
*** dannywilson has quit IRC | 13:46 | |
*** ddieterly has joined #openstack-infra | 13:46 | |
*** yolanda has quit IRC | 13:46 | |
*** dannywilson has joined #openstack-infra | 13:46 | |
*** yamamoto_ has joined #openstack-infra | 13:47 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Convert ironicclient node.update() call to Task https://review.openstack.org/193553 | 13:48 |
*** yolanda has joined #openstack-infra | 13:48 | |
mordred | Shrews, dguerri: ok - may have been pebkac | 13:48 |
Shrews | TheJulia: final two reviews that convert ironic calls to Task: https://review.openstack.org/193535 and https://review.openstack.org/193553 | 13:48 |
*** nihilifer has quit IRC | 13:48 | |
dguerri | mordred: please tell me it is :) | 13:49 |
mordred | Shrews, dguerri: yup. sorry, there is a field called "accessIPv4" in the nova metadata that isn't actually what we use and isn't actually useful | 13:49 |
mordred | I was looking at the wrong thing - it all works | 13:49 |
fungi | AJaeger: dtantsur: krtaylor: https://review.openstack.org/193550 is my proposal to make the new project requirements look less like a suggestion to incubate projects in stackforge first | 13:49 |
dguerri | thank god | 13:50 |
mordred | yah | 13:50 |
dguerri | o/ | 13:50 |
* dtantsur is looking | 13:50 | |
Shrews | mordred: yay! that exception patch is still needed though. we should have caught that | 13:50 |
dguerri | (other arm is doing an italian thing I can't explain) | 13:50 |
mordred | dguerri: hahahaha | 13:50 |
dguerri | ;) | 13:50 |
*** jaypipes is now known as leakypipes | 13:50 | |
mordred | I almost think we shoudl fill in accessIPv4 and accessIPv6 since they're blank everywhere and we actuallyknow the answer | 13:51 |
mordred | sdague: is nova supposed to be providing those back? | 13:51 |
AJaeger | fungi, thanks! | 13:51 |
dguerri | rght | 13:51 |
*** yamamoto has quit IRC | 13:51 | |
*** ddieterly has quit IRC | 13:52 | |
*** maishsk_afk has quit IRC | 13:52 | |
mordred | ah - so, it IS filled in on rackspace, but nobody else has bothered | 13:53 |
* mordred hands rackspace a gold star | 13:53 | |
dguerri | erheh | 13:53 |
Shrews | jroll: congrats! | 13:53 |
mordred | dguerri: we could add a piece to the logic "if server['accessIPv4']:" to bypass all the rest of the stuff if the cloud is nice enough to have given us the data | 13:53 |
Shrews | that sounds worthwhile | 13:54 |
dguerri | yup | 13:54 |
mordred | dguerri: it would actually mean that our fallback of "hrm, not sure, let's see if it's a public address might be removable" | 13:54 |
mordred | dguerri: it would actually mean that our fallback of "hrm, not sure, let's see if it's a public address" might be removable | 13:54 |
mordred | bad quoting | 13:54 |
* mordred test drives that thought real quick | 13:54 | |
*** amitgandhinz has joined #openstack-infra | 13:54 | |
openstackgerrit | Merged openstack-infra/project-config: Revert "Make kolla functional job voting" https://review.openstack.org/193369 | 13:54 |
*** ddieterly has joined #openstack-infra | 13:54 | |
jroll | Shrews: uh oh, what'd I do? | 13:54 |
dims | fungi: please add oslo-core to oslo-reports-core and oslo-reports-release gerrit groups when you get a chance | 13:55 |
pabelanger | morning | 13:55 |
Shrews | jroll: you get mordred's gold star by proxy | 13:55 |
jroll | \o/ | 13:55 |
jroll | mordred: so afaik nova is supposed to provide those, but they are able to be set/modified by the user (or other things?) and are not to be trusted | 13:55 |
sdague | mordred: so the upstream code feels like that should be thre | 13:56 |
dguerri | mordred: is accessIPv4 rax only? | 13:56 |
openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Add several jobs for Manila periodic pipeline https://review.openstack.org/193538 | 13:56 |
mordred | jroll: what other things would be ... wait ... aroo? | 13:56 |
*** pblaho has quit IRC | 13:56 | |
mordred | dguerri: no, they're openstack constructs | 13:56 |
mordred | dguerri: it just seems liek rax is the only cloud who is filing them in | 13:57 |
*** mwagner_afk has joined #openstack-infra | 13:57 | |
mordred | except now jroll tells me that somethign might cause them to lie | 13:57 |
fungi | dims: done | 13:57 |
*** dims is now known as dimsum__ | 13:57 | |
mordred | jroll: honestly, if a user overwrites that value with something else somehow, they're on their own I cannot be responsible for insanity | 13:57 |
dimsum__ | fungi: thanks! | 13:57 |
jroll | mordred: indeed. I could just imagine neutron or something doing insane things and setting it. idk. | 13:58 |
*** hashar has joined #openstack-infra | 13:58 | |
jroll | mordred: but you're probably fine to trust it | 13:58 |
mordred | jroll: it does deflate a little bit of my rage at rackspace networking though | 13:58 |
jroll | \o/ | 13:58 |
fungi | mordred: so, we're down to ~15 minutes before image updates. are we safe to go ahead and restart nodepoold now? | 13:58 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Pin to a specific fedora mirror https://review.openstack.org/193560 | 13:58 |
mordred | fungi: yes! | 13:58 |
jroll | mordred: feel free to continue sending rage this way | 13:59 |
fungi | mordred: okay, i'll do it unless you wanted to | 13:59 |
fungi | looks like nodepool is keeping pace with zuul demand for the moment | 13:59 |
*** koolhead17 has joined #openstack-infra | 13:59 | |
*** ParsectiX has quit IRC | 13:59 | |
mordred | fungi: sorry - I got distracted by the other shade bug | 13:59 |
fungi | though until we get jeblair's 193368 tested out and applied, we're going to see nodepool lose track of zuul demand while glance uploads happen (unless latest shade has broken our uploads today!) | 14:00 |
dguerri | mordred: not 100% sure what you have in mind, I would keep the public IP check anyway | 14:00 |
fungi | mordred: okay, nodepoold has restarted now | 14:01 |
dguerri | mordred: we can just skip all the code if we have the accessIPv4 available | 14:01 |
fungi | i'm tailing the debug log to see if there is any obvious crazy | 14:01 |
fungi | tripleo cloud seems to be pitching us 500 errors | 14:02 |
*** dannywilson has quit IRC | 14:02 | |
Shrews | mordred: fungi: the exception change did not merge. does that break nodepool still? | 14:02 |
fungi | i'm assuming that's just business as usual there | 14:02 |
*** claudiub has joined #openstack-infra | 14:02 | |
fungi | Shrews: oh, not sure. i bet we need a new release tagged with that fix in place? | 14:02 |
*** morgan has quit IRC | 14:02 | |
fungi | mordred: ^? | 14:03 |
*** morgan has joined #openstack-infra | 14:03 | |
fungi | looks like the patch is 8 minutes out from completing its devstack functional jobs | 14:03 |
fungi | in check | 14:03 |
*** morgan is now known as Guest93126 | 14:03 | |
fungi | and then it will i guess need another half hour in the gate, so not going to be in time for today's image updates | 14:04 |
fungi | should i downgrade shade and restart nodepoold again? | 14:04 |
fungi | if so, i have about 10 minutes to do that | 14:04 |
mordred | Shrews: no, it does not | 14:05 |
mordred | the exception change won't affect nodepool - that's just a break on inventory | 14:06 |
Shrews | mordred: ok. the approval urgency led me to believe otherwise | 14:06 |
*** morganfainberg is now known as morgan-devserver | 14:06 | |
fungi | excellent. then i'll just leave this chugging | 14:06 |
openstackgerrit | Merged openstack/requirements: Add glance_store to projects.txt https://review.openstack.org/182681 | 14:07 |
mordred | Shrews: sorry - it was just a bug that would break ansible inventory for anyone with rackspace, and I know ansible tower has started using openstack inventory module, so I didn't want to leave a known hard break (you get no inventory back) in the wild | 14:07 |
*** tonytan4ever has joined #openstack-infra | 14:07 | |
fungi | the tripleo cloud seems really unhappy. the exceptions look like they're related to floating ip allocation. maybe we've leaked some? | 14:07 |
*** morgan-devserver is now known as CaptainMorgan | 14:08 | |
AJaeger | sdague: governance side can soon be found on docs.openstack.org home page - patch has been approved | 14:08 |
*** ihrachyshka has quit IRC | 14:09 | |
*** ajmiller has joined #openstack-infra | 14:10 | |
*** puranamr has quit IRC | 14:10 | |
*** puranamr has joined #openstack-infra | 14:11 | |
sdague | AJaeger: cool | 14:12 |
*** sigmavirus24_awa is now known as sigmavirus24 | 14:12 | |
*** krtaylor has quit IRC | 14:15 | |
openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for neutron update port bug 1465407 https://review.openstack.org/191981 | 14:15 |
openstack | bug 1465407 in neutron "StaleDataError: UPDATE statement on table 'ports' expected to update 1 row(s); 0 were matched." [High,In progress] https://launchpad.net/bugs/1465407 - Assigned to Kevin Benton (kevinbenton) | 14:15 |
openstackgerrit | Antoine Musso proposed openstack-infra/project-config: nodepool: describe nodepool-base env variables https://review.openstack.org/193566 | 14:16 |
openstackgerrit | Antoine Musso proposed openstack-infra/project-config: nodepool: nodepool-base can now skip unbound conf https://review.openstack.org/193567 | 14:16 |
hashar | I should really just create my own element :-D | 14:16 |
*** asselin has joined #openstack-infra | 14:16 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Catch all exceptions around port for ip finding https://review.openstack.org/193540 | 14:16 |
Shrews | mordred: ^^^^ fixed the pep8 error for you | 14:16 |
*** puranamr has quit IRC | 14:16 | |
*** yfried_ has quit IRC | 14:20 | |
*** zz_jgrimm is now known as jgrimm | 14:20 | |
openstackgerrit | Sean Dague proposed openstack-infra/elastic-recheck: remove query for bug 1342380 https://review.openstack.org/193568 | 14:21 |
openstack | bug 1353939 in OpenStack Compute (nova) "duplicate for #1342380 Rescue fails with 'Failed to terminate process: Device or resource busy' in the n-cpu log" [High,Fix committed] https://launchpad.net/bugs/1353939 - Assigned to Matt Riedemann (mriedem) | 14:21 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use accessIPv4 if it's there https://review.openstack.org/193569 | 14:21 |
mordred | Shrews: cool. thanks! and there's the patch to use accessIPv4 if it exists | 14:21 |
mordred | dguerri: ^^ | 14:21 |
*** maishsk_afk has joined #openstack-infra | 14:22 | |
*** stevemar has joined #openstack-infra | 14:24 | |
derekh | fungi RE tripleo floating ip's looks like your bumping up against the floating IP quota, should we delete the unsed floating IP's? | 14:24 |
derekh | dprince: ^ | 14:24 |
*** soren has quit IRC | 14:25 | |
derekh | We also have 8 VM's not being used so could do with some eyes on this https://review.openstack.org/#/c/187675/2 | 14:25 |
*** fallenpegasus has joined #openstack-infra | 14:25 | |
fungi | derekh: we've seen leaks in other providers in the past (exhibited as fips which are not associated with any instance) | 14:26 |
fungi | seems to happen when nodepool requests a fip deletion and for whatever reason it doesn't happen (but possibly reports that it did) | 14:26 |
*** leopoldj has joined #openstack-infra | 14:27 | |
*** hdd has joined #openstack-infra | 14:27 | |
*** r-daneel has joined #openstack-infra | 14:27 | |
openstackgerrit | Merged openstack-infra/elastic-recheck: remove query for bug 1342380 https://review.openstack.org/193568 | 14:28 |
openstack | bug 1353939 in OpenStack Compute (nova) "duplicate for #1342380 Rescue fails with 'Failed to terminate process: Device or resource busy' in the n-cpu log" [High,Fix committed] https://launchpad.net/bugs/1353939 - Assigned to Matt Riedemann (mriedem) | 14:28 |
dprince | derekh: we just reset all the floating ips on MOnday I think | 14:28 |
openstackgerrit | Sean Dague proposed openstack-infra/elastic-recheck: add query for keystone wsgi restart issue https://review.openstack.org/193571 | 14:28 |
dprince | derekh: so any leak we've got would be a fast one... | 14:28 |
derekh | fungi dprince : ok, so it may have been like this since the probelms we had on monday, currently there is 111 FIP's in the tenants with 27 associated with a VM | 14:28 |
*** stevemar is now known as stevedoor | 14:29 | |
*** alaski is now known as lascii | 14:29 | |
jeblair | AJaeger, fungi: i think all the questions about stackforge got answered? | 14:30 |
derekh | fungi: dprince so if nodepool doesn't know about them I guess we can delete them and see if they keep leaking | 14:30 |
derekh | brb | 14:30 |
*** maishsk_afk has quit IRC | 14:31 | |
jeblair | AJaeger, fungi: at any rate, i'm definitely working on clarifying the situation; i want to see where i can get agreement with the tc on it. that will probably take a couple of weeks. until then, i would say that technically nothing has changed, but it would be good to ask projects to start in openstack if they can, and if there is some reason they must be in stackforge, let them | 14:31 |
*** nihilifer has joined #openstack-infra | 14:32 | |
jeblair | AJaeger, fungi: doing so thus far has given us a lot of useful information (and i think worked out well for some projects) | 14:32 |
fungi | jeblair: yep, we've not been insisting, just explaining how easy it is to "just start in openstack" | 14:34 |
*** dboik_ has quit IRC | 14:34 | |
fungi | jeblair: also https://review.openstack.org/193550 | 14:34 |
*** jasondotstar has quit IRC | 14:35 | |
*** cgoncalves has left #openstack-infra | 14:35 | |
*** achanda has quit IRC | 14:36 | |
openstackgerrit | Merged openstack-infra/project-config: zuul: actually enable puppet4 voting https://review.openstack.org/193379 | 14:36 |
*** maishsk_afk has joined #openstack-infra | 14:36 | |
*** maishsk_afk has quit IRC | 14:37 | |
*** jasondotstar has joined #openstack-infra | 14:37 | |
*** rlandy has quit IRC | 14:39 | |
*** sarob has joined #openstack-infra | 14:39 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add IPv6 to the server information too https://review.openstack.org/193581 | 14:40 |
mordred | jeblair, fungi, Shrews, dguerri: ^^ while poking at that section, figured I should add ipv6 info into the server record while we were at it | 14:41 |
*** tvanderwiel has quit IRC | 14:41 | |
openstackgerrit | Sean Dague proposed openstack-infra/elastic-recheck: add query for keystone wsgi restart issue https://review.openstack.org/193571 | 14:41 |
hashar | mordred: hello :) Will you ever upstream your diskimage-builder puppet element ? :D | 14:41 |
mordred | hashar: hrm. that's a great idea. | 14:42 |
mordred | hashar: so - let's say "yes" - and if the dib-nodepool stuff goes well today, I'll see if I can work on that next | 14:42 |
hashar | mordred: I guess once it is stable enough, you probably want to move it from puppet to "upstream" | 14:42 |
mordred | hashar: I don't know if you saw - but our ansible module for running puppet is now in upstream ansible | 14:42 |
hashar | \O/ | 14:42 |
hashar | congratulations! | 14:42 |
mordred | yah I'm exciteda bout that | 14:43 |
hashar | we have discussions regarding salt/puppet/ansible etc on our side. But there is no firm consensus yes | 14:43 |
hashar | yes/yet | 14:43 |
hashar | meanwhile, I got nodepool setup on our system. Tweaking the disk image to have something eventually working for us :} | 14:43 |
*** _nadya_ has quit IRC | 14:43 | |
*** miqui has joined #openstack-infra | 14:43 | |
*** _nadya_ has joined #openstack-infra | 14:44 | |
*** sarob has quit IRC | 14:44 | |
*** dguerri is now known as dguerri` | 14:44 | |
mordred | hashar: well, I'm pretty pleased with ansible+puppet so far ... and we'll hopefully soon have moved from ansible+puppet-agent+puppetmaster to ansible+puppet-apply - which I think will be very nice | 14:44 |
*** krtaylor has joined #openstack-infra | 14:45 | |
mordred | hashar: reduces the bootstrapping - with either salt or puppet agent, you need an additional agent on the machine that you need to enroll in the certificate management | 14:45 |
*** yamahata has joined #openstack-infra | 14:45 | |
mordred | hashar: salt + puppet agent was the worst - two different certs and two different agents :) | 14:45 |
hashar | so you just crontab the ansible/puppet-apply run ? | 14:46 |
mordred | yup | 14:46 |
hashar | does ansible has anything to run stuff to all machines? (we use salt) | 14:46 |
mordred | our cron job runs ansible, which runs puppet in sequence on the node where we need a certain order, and then in parallel on the others | 14:46 |
mordred | it does | 14:46 |
mordred | it's very good at running stuff on all machines | 14:46 |
*** kushal has joined #openstack-infra | 14:46 | |
fungi | it reminds me of the "parallel ssh" tools which we used to use on high-performance computing clusters to run specific commands on every cluster member from the cluster master | 14:47 |
mordred | hashar: otoh - if you're already using salt for that and you're happy with it, salt would also do a fine job - but we're going to have a bit soon with ansible to deal with copying a node's hieradata around appropriately | 14:47 |
mordred | fungi: it really does | 14:47 |
*** yamamoto_ has quit IRC | 14:48 | |
*** _nadya_ has quit IRC | 14:48 | |
hashar | mordred: I am far from those pre occupations to be honest. I use whatever is provided by our sysadmins :D | 14:48 |
*** bdemers has joined #openstack-infra | 14:48 | |
fungi | i like that ansible reduces well to the simple case of "here's a list of machines to which i have assh access and a command i want you to run now on all of them... let me know how it turns out" | 14:48 |
mordred | hashar: this is a good choice | 14:49 |
*** dvorak is now known as clayton | 14:49 | |
*** bhunter71 has joined #openstack-infra | 14:49 | |
*** pblaho has joined #openstack-infra | 14:50 | |
*** dguerri` is now known as dguerri | 14:50 | |
*** yamamoto has joined #openstack-infra | 14:53 | |
*** krtaylor has quit IRC | 14:53 | |
*** Longgeek has quit IRC | 14:53 | |
*** Longgeek has joined #openstack-infra | 14:54 | |
*** mmedvede has quit IRC | 14:54 | |
*** sabeen1 has joined #openstack-infra | 14:55 | |
*** clu_ has joined #openstack-infra | 14:56 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Pin to a specific fedora mirror https://review.openstack.org/193560 | 14:56 |
openstackgerrit | Christopher Aedo proposed openstack-infra/system-config: Add app-catalog-admin mailing list https://review.openstack.org/191478 | 14:57 |
*** sarob has joined #openstack-infra | 15:01 | |
openstackgerrit | Merged openstack-infra/shade: Catch all exceptions around port for ip finding https://review.openstack.org/193540 | 15:02 |
*** ala_ has quit IRC | 15:03 | |
*** _nadya_ has joined #openstack-infra | 15:05 | |
*** k4n0 has quit IRC | 15:05 | |
*** yamamoto has quit IRC | 15:06 | |
*** mmedvede has joined #openstack-infra | 15:10 | |
*** dboik has joined #openstack-infra | 15:10 | |
*** esker has joined #openstack-infra | 15:11 | |
mordred | sdague: in a nova+neutron context with multiple network sources possible from neutron, do floating ip pools still make sense? like, are they a thing at all? | 15:12 |
*** dangers_away is now known as dangers | 15:12 | |
mordred | sdague: it seems like the two concepts fill a similar space, and I'm torn on what to do about it in the floating-ip abstraction code in shade | 15:12 |
*** armax has joined #openstack-infra | 15:13 | |
*** yamamoto has joined #openstack-infra | 15:13 | |
*** jsavak has joined #openstack-infra | 15:14 | |
dguerri | mordred: fwiw: when the cloud has neutron, neutron external networks _are_ floating ip pools. | 15:14 |
mordred | dguerri: they are exposed as pools in the nova passthrough interface? | 15:14 |
dguerri | mordred: afaik yes | 15:15 |
* dguerri is doublechecking | 15:15 | |
* mordred goes to check vexxhost behavior | 15:15 | |
*** mriedem has quit IRC | 15:16 | |
*** mriedem has joined #openstack-infra | 15:16 | |
mordred | dguerri: yes. I verify this | 15:16 |
dguerri | yes | 15:16 |
dguerri | acc, too slow :) | 15:16 |
* mordred wonders why subnets aren't exposed as floating ip pools ... but decides to drop it | 15:17 | |
dguerri | mordred: good point | 15:17 |
*** tvanderwiel has joined #openstack-infra | 15:18 | |
*** mtanino has joined #openstack-infra | 15:18 | |
mordred | ok. I've also confirmed that there is a default floating-ip pool on auro, which uses nova-net with floating ips | 15:19 |
mordred | AND that HP does not expose nova floating-ip-pool-list | 15:21 |
mordred | at least not to me | 15:21 |
* mordred does a little dance | 15:21 | |
dguerri | mordred: that's also a big difference between nova-net and neutron: when you allocate a new floater, you can omit the pool for nova (getting it from the default pool) but you can't omit the net_id for neutron | 15:21 |
*** nihilifer has quit IRC | 15:22 | |
mordred | wow. that's amazing | 15:22 |
mordred | have I mentioned I dislike floating ips in general? | 15:22 |
dguerri | mordred: I addressed that here: https://review.openstack.org/#/c/183555/5/shade/__init__.py | 15:22 |
dguerri | #18245 | 15:23 |
dguerri | sorry #1824 | 15:23 |
*** yamamoto has quit IRC | 15:23 | |
mordred | dguerri: yes. awesome | 15:24 |
mordred | so - I think the logic and functionality is all spot on | 15:24 |
mordred | I think the main question is - do we use the words "network_or_pool" - or do we just say "network" and have folks using teh pool interface hand their pool name as a param | 15:25 |
mordred | (I ask because we normalize nova networking concepts to neutron shape frequently) | 15:25 |
*** cdent_ has joined #openstack-infra | 15:25 | |
*** koolhead17 has quit IRC | 15:25 | |
*** koolhead17 has joined #openstack-infra | 15:26 | |
*** jasondotstar has quit IRC | 15:26 | |
dguerri | mordred: I am fine either way. But I feel a subtle pleasure thinking we could just pretend nova-network doesn't exists :-) | 15:27 |
*** jasondotstar has joined #openstack-infra | 15:28 | |
openstackgerrit | Antoine Musso proposed openstack-infra/nodepool: Fix enable_node and disable_node methods https://review.openstack.org/193600 | 15:28 |
*** otter768 has joined #openstack-infra | 15:28 | |
Shrews | mordred: dguerri: maybe just network, and explain in the docstring it can be pool for nova | 15:28 |
*** romcheg has quit IRC | 15:28 | |
openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Allow the use of git add !!null as an `scm` value https://review.openstack.org/193601 | 15:29 |
*** cdent has quit IRC | 15:29 | |
*** cdent_ is now known as cdent | 15:29 | |
dguerri | Shrews: ++ | 15:29 |
mordred | Shrews: ++ | 15:29 |
mordred | sold | 15:29 |
Shrews | mordred: dguerri: and for instance vs. port? | 15:30 |
dguerri | let's get rid of it | 15:30 |
dguerri | mordred: Shrews if needed we can add something later | 15:31 |
dguerri | mordred: Shrews removing stuff, is trickier, tho | 15:31 |
mordred | ++ | 15:31 |
mordred | dguerri: I don't think it's currently used, right? | 15:31 |
dguerri | it's not | 15:31 |
Shrews | dguerri: i'm good with that | 15:32 |
mordred | dguerri: well, that said ... in nova-net, instance is the server id, right? | 15:32 |
dguerri | sold | 15:32 |
dguerri | yes | 15:32 |
mordred | dguerri: in neutron, we get the port id and should be able to infer the server id from that, no? | 15:32 |
dguerri | yes | 15:32 |
dguerri | ah | 15:32 |
dguerri | I see | 15:32 |
mordred | I ask, because having the server_id (possibly always called "server_id") is useful | 15:32 |
dguerri | do you wan't the server id | 15:32 |
mordred | I've never once thought about ports when wrking with floating ips | 15:33 |
dguerri | it need an API call, tho | 15:33 |
mordred | it does? | 15:33 |
dguerri | *needs | 15:33 |
mordred | it's not in the port struct? | 15:33 |
*** otter768 has quit IRC | 15:33 | |
*** mfisch has joined #openstack-infra | 15:33 | |
mordred | oh - because the floating struct has port_id, so we'd need to look up what server that's on | 15:33 |
dguerri | yes, unfortunately... | 15:34 |
mordred | dguerri: if it's not attached, it will not have a port id, right? | 15:34 |
dguerri | correct, it is None | 15:34 |
*** mfisch has left #openstack-infra | 15:34 | |
mordred | hrm | 15:34 |
dguerri | hold on | 15:34 |
dguerri | not always | 15:34 |
mordred | so - "is_attached" is an important piece of information ... oh awesome | 15:34 |
mordred | let's do what you said and omit it for now | 15:34 |
dguerri | agreed | 15:34 |
mordred | and then go to the nodepool code and see what our consumption there needs to be successful - like, if we were to use shade floating ips in nodepool | 15:35 |
dguerri | a port could actually live without a server | 15:35 |
mordred | and that should give us a good sense of where/if we need to make an extra call to fill this out, or if it's fine | 15:35 |
*** yamamoto has joined #openstack-infra | 15:35 | |
mordred | but I think we can land this without for now | 15:35 |
*** MarkAtwood has joined #openstack-infra | 15:35 | |
dguerri | ok, patching the patch now | 15:36 |
Shrews | yay! my question brought about changes and concensus. thx dguerri, mordred | 15:36 |
dguerri | Shrews: you are very welcome | 15:36 |
*** jsavak has quit IRC | 15:37 | |
ttx | mordred: got 5 minutes to talk Maniphest ? | 15:37 |
*** EricGonczer_ has joined #openstack-infra | 15:37 | |
dguerri | I would actually ask those questions before sending out the review, but we live in different TZs :D | 15:37 |
mordred | ttx: yes! | 15:37 |
*** jsavak has joined #openstack-infra | 15:38 | |
*** abregman has quit IRC | 15:38 | |
ttx | mordred: so... looking into that CustomField thingy | 15:38 |
ttx | https://secure.phabricator.com/book/phabdev/class/ManiphestCustomField/ | 15:39 |
uberjay | asselin: well, finally ran into that floating ip leak issue, and apparently hadn't put the relclaim cron job in. d'oh.... | 15:39 |
mordred | ttx: for security things yeah? | 15:39 |
ttx | No, for tracking repo/branch | 15:39 |
mordred | ah | 15:39 |
mordred | yes | 15:39 |
ttx | (so that we can use "project" as free form tags | 15:39 |
mordred | (sorry, context switching things in) | 15:39 |
ttx | and build random dashboards freely as-needed) | 15:40 |
mordred | yup - which would be neat | 15:40 |
mordred | people like random dashboards | 15:40 |
ttx | On paper, it seems CustomField is plenty powerful enough | 15:40 |
ttx | I just have a hard time picturing how to use it | 15:40 |
mordred | do you have to add custom fields via php? | 15:41 |
ttx | you apparently shoudl drop a class in some random folder and voila | 15:41 |
openstackgerrit | Antoine Musso proposed openstack-infra/nodepool: Fix enable_node and disable_node methods https://review.openstack.org/193600 | 15:42 |
ttx | but reading PHP makes my head hurt. I suspect I could work it out from a working install though | 15:42 |
*** EricGonczer_ has quit IRC | 15:42 | |
ttx | mordred: was wondering what the best next step would be for us there | 15:42 |
mordred | ttx: it seems there is a "maniphest.custom-field-definitions" config setting | 15:42 |
mordred | ttx: http://15.126.194.141/config/group/maniphest/ | 15:42 |
*** dizquierdo has quit IRC | 15:42 | |
ttx | yes but that is pretty basic from what I read | 15:42 |
mordred | ah | 15:43 |
ttx | in particular doesn't use shouldAppearInListView() so is invisible in lists | 15:43 |
ttx | where I think that would be great to have them to emulate story tasks | 15:43 |
*** flepied1 has quit IRC | 15:43 | |
ttx | but I'm at level 0.1 of exploring so I won't pretend I have all the keys here | 15:44 |
pelix | looking for another review for JJB to see if the following changes can be approved: https://review.openstack.org/183488, https://review.openstack.org/133997, https://review.openstack.org/181541, https://review.openstack.org/180150 | 15:44 |
ttx | mordred: see https://secure.phabricator.com/book/phabricator/article/custom_fields/ | 15:44 |
pelix | zaro: you around to review https://review.openstack.org/#/c/180150/? other three above need someone else besides you or me to approve | 15:45 |
ttx | you can configure easy ones in JSON. FOr complex ones you need to write a class | 15:45 |
ttx | mordred: but then the class sounds not that complicated, since by default it behaves like a basic field and you just override extra methods | 15:45 |
ttx | see bottom of that last page | 15:46 |
*** laughterwym has quit IRC | 15:46 | |
ttx | Was just wondering what's the best way to play with it. How easy is it to fire your own ? | 15:46 |
openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Add several jobs for Manila periodic pipeline https://review.openstack.org/193538 | 15:46 |
mordred | ttx: (reading) | 15:47 |
mordred | ttx: it's very easy to fire your own ... it's slighly harder to fire your own _and_ import useful dataset - but I can get you a copy of one pretty easily | 15:48 |
*** krtaylor has joined #openstack-infra | 15:48 | |
ttx | mordred: bah, I don't need dataset | 15:49 |
ttx | mordred: I guess it's simpler I just set up one and try that advances Custom field thing, unless you beat me to it | 15:49 |
*** leopoldj has quit IRC | 15:49 | |
*** mmedvede has quit IRC | 15:50 | |
*** marzif has joined #openstack-infra | 15:50 | |
mordred | ttx: I usd this: https://github.com/openstack-infra/puppet-phabricator to set up the one I have running right now | 15:51 |
mordred | ttx: there is a readme in there with some more notes | 15:51 |
*** marzif has quit IRC | 15:51 | |
ttx | hmm, ok, hopefully will have some time soon. I would really like to explore how we can solve that before we go any further | 15:52 |
*** marzif has joined #openstack-infra | 15:52 | |
ttx | it's a pretty basic field(s) but ideally would need to appear prominently to be useful | 15:53 |
ttx | and I have no idea how powerful that public function renderOnListItem($view) is | 15:54 |
ttx | documentation is pretty minimal | 15:54 |
mordred | yah - I think it'll take poking for sure | 15:55 |
mordred | ttx: my next thing after I get nodepool-dib sorted is to jump on this | 15:55 |
ttx | ok, feel free to beat me to it | 15:55 |
openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add Parameterized Remote Trigger Plugin support. https://review.openstack.org/150327 | 15:56 |
*** bexelbie has quit IRC | 15:57 | |
Shrews | dguerri: i was looking at one of mordred's shade changes and noticed he is used the object form to address server info. A lot of the new IP code is doing similar things for servers (and we were bad reviewers and didn't catch it). We need to start using the dict form so we can phase out the object form. | 15:57 |
mordred | Shrews: nod. | 15:58 |
dguerri | Shrews: yep... how much have you found of that? | 15:58 |
*** marzif has quit IRC | 15:58 | |
dguerri | could someone explain the meaning of floating IP status in neutron? it seems to be used differently in different openstack version :-S but it could be just me | 15:59 |
Shrews | dguerri: several places. some old, some new | 15:59 |
Shrews | doh | 15:59 |
mordred | markmcclain: ^^ any chance you can tell us where to look to learn about that? | 15:59 |
Shrews | oh, yeah. right channel | 15:59 |
*** lascii is now known as alaski | 15:59 | |
dguerri | :D | 15:59 |
jeblair | fungi, mordred: i tested https://review.openstack.org/193368 with zuul tests, and they did not fail | 16:00 |
jeblair | fungi, mordred: i think we can merge/release; then a zuul restart should pick it up and hopefully we won't see the demand gap | 16:00 |
Shrews | dguerri: we need to put that on our todo list to change those | 16:00 |
dguerri | Shrews: ++ | 16:00 |
*** RichardRaseley has joined #openstack-infra | 16:01 | |
*** bexelbie_ has quit IRC | 16:02 | |
*** jlanoux_ has quit IRC | 16:02 | |
fungi | jeblair: cool, i'm +2 on it in that case | 16:02 |
mordred | jeblair: ++ | 16:02 |
*** RichardRaseley has quit IRC | 16:03 | |
*** RichardRaseley has joined #openstack-infra | 16:03 | |
*** RichardRaseley has quit IRC | 16:03 | |
*** yamahata has quit IRC | 16:03 | |
fungi | based on the cacti graph, we should in moments be entering the overflow condition again | 16:04 |
*** RichardRaseley has joined #openstack-infra | 16:04 | |
jeblair | oh drat; shoulda done this 30 mins ago | 16:05 |
*** esker has quit IRC | 16:05 | |
*** markus_z has quit IRC | 16:06 | |
*** mmedvede has joined #openstack-infra | 16:06 | |
openstackgerrit | Merged openstack-infra/gear: Do not raise RetryIOError on blocked write https://review.openstack.org/193368 | 16:06 |
*** e0ne has quit IRC | 16:10 | |
*** dannywilson has joined #openstack-infra | 16:11 | |
jeblair | tagged 0.5.8 | 16:11 |
*** mpaolino has quit IRC | 16:11 | |
*** pbourke has quit IRC | 16:13 | |
pleia2 | good morning | 16:13 |
*** pbourke has joined #openstack-infra | 16:13 | |
openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Allow the use of git add !!null as an `scm` value https://review.openstack.org/193601 | 16:14 |
*** ujuc has joined #openstack-infra | 16:14 | |
*** gyee has joined #openstack-infra | 16:14 | |
openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Enable parameter ordering in trigger_parameterized_builds https://review.openstack.org/175049 | 16:15 |
anteaya | morning pleia2 | 16:15 |
*** ashleighfarnham has joined #openstack-infra | 16:16 | |
*** derekh has quit IRC | 16:17 | |
jeblair | fungi: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2014-12-09.log.html | 16:18 |
openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Update 'timeout' wrapper module https://review.openstack.org/129467 | 16:18 |
jeblair | fungi: that was our discussion where we decided to use two servers instead of growing the haproxy server | 16:18 |
fungi | jeblair: oh! good find | 16:18 |
openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Allow the use of !!null as an `scm` value https://review.openstack.org/193601 | 16:19 |
jeblair | that seems to suggest that we believe backend distribution is based on ip addresses, not backend load | 16:19 |
*** koolhead17 has quit IRC | 16:19 | |
fungi | yeah, i don't think that haproxy is currently configured to be at all smart about it and is simply hashing the requester's ip address and destination port | 16:20 |
fungi | and using that to choose a backend | 16:21 |
fungi | at least that's my recollection but i need to go back through the config and manpage | 16:21 |
jeblair | yep, "balance source" | 16:21 |
*** hashar has quit IRC | 16:21 | |
jeblair | is what we have configured | 16:21 |
*** Guest70353 has quit IRC | 16:22 | |
*** arxcruz has quit IRC | 16:22 | |
*** mriedem is now known as mriedem_burgers | 16:22 | |
*** achanda has joined #openstack-infra | 16:23 | |
*** ildikov_ has quit IRC | 16:23 | |
openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP list/search/get https://review.openstack.org/183496 | 16:24 |
*** RichardRaseley has quit IRC | 16:24 | |
clarkb | I am pretty sure git is good about one connwction per command now and we can change that if desireable | 16:25 |
clarkb | even when using non smart gttp | 16:25 |
dguerri | Shrews: mordred : I had to add an additional attribute 'attached'. It turned out I was using port_or_instance_id to determine if a floater was attached... so ... | 16:26 |
*** RichardRaseley has joined #openstack-infra | 16:26 | |
dguerri | Shrews: mordred : ^ review is the above | 16:26 |
*** romcheg has joined #openstack-infra | 16:27 | |
*** sdake_ has joined #openstack-infra | 16:27 | |
jeblair | clarkb, fungi: so here's my current (incomplete) thinking: we lower maxconn for the backends to prevent them from being overloaded. if we stick with 2 fe's, then we probably need to be conservative with that since each fe only knows about potentially half the connections (though, each fe is "git.o.o" for 5 mins at a time, so maybe it's not that far off) | 16:27 |
jeblair | clarkb, fungi: we might consider switching to least-connections, and moving to a single fe, which would then make the maxconn accounting more accurate | 16:28 |
jeblair | clarkb: and it sounds like you were saying you think that might be reasonable to do? | 16:28 |
*** dguerri is now known as dguerri` | 16:29 | |
*** igorbelikov has quit IRC | 16:29 | |
clarkb | jeblair yup as git clients are well behaved and dont seem to make multiple connections per fetch/clone | 16:29 |
*** vponomaryov has quit IRC | 16:30 | |
mordred | dguerri`: looks great! | 16:30 |
clarkb | the source balance method was being conservative so that multiple connections per client would be safe | 16:30 |
*** rossella_s has quit IRC | 16:30 | |
*** rossella_s has joined #openstack-infra | 16:30 | |
*** sdake has quit IRC | 16:31 | |
*** dannywilson has quit IRC | 16:31 | |
*** RichardRaseley has quit IRC | 16:31 | |
*** RichardRaseley has joined #openstack-infra | 16:31 | |
*** devvesa has quit IRC | 16:31 | |
*** RichardRaseley has quit IRC | 16:32 | |
*** dannywilson has joined #openstack-infra | 16:32 | |
*** fedexo has joined #openstack-infra | 16:32 | |
*** jsavak has quit IRC | 16:33 | |
jeblair | clarkb, fungi: okay, options: a) leave everything as is, except set maxconn on backends (and probably spin up more backends); b) switch to single haproxy, maxconn on backends, least-connections lb algorithm | 16:33 |
jeblair | anything else? which one do you like? | 16:33 |
anteaya | jeblair: would option b) include more backends as well? | 16:35 |
*** olaph has joined #openstack-infra | 16:35 | |
*** yamamoto has quit IRC | 16:36 | |
jeblair | anteaya: not sure; it would spread load better which may make better use of the ones we have | 16:36 |
anteaya | very good, thanks | 16:36 |
* anteaya listens | 16:36 | |
*** dannywilson has quit IRC | 16:36 | |
openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Validate the use of `[]` as an `scm` value https://review.openstack.org/193601 | 16:36 |
jeblair | (whereas with a, the inefficiency makes needing more backends more likely) | 16:36 |
anteaya | ah yes | 16:37 |
*** rm_work is now known as rm_work|away | 16:37 | |
jeblair | it looks like a 30G compute-optimized instance will get us 1GB of outbound bandwidth, which is slightly less than what we have now (1.2), but more than we need (mean 0.16, median somewhere around 0.2, peak 0.6-0.7) | 16:38 |
*** asahlin is now known as asahlin_away | 16:38 | |
anteaya | do we have a quota on how many of those instances we can use? | 16:38 |
jeblair | yes, but if we ask nice, they might raise it | 16:39 |
openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Validate the use of `[]` as an `scm` value https://review.openstack.org/193601 | 16:39 |
anteaya | okay great | 16:39 |
clarkb | jeblair we can easily try both and use dns to move between them | 16:39 |
jeblair | clarkb: git-fe03? :) | 16:39 |
anteaya | clarkb: spin up an entire second git farm? | 16:39 |
jeblair | anteaya: we only need the fe, not backends | 16:39 |
clarkb | jeblair ya something like that | 16:39 |
anteaya | jeblair: ah okay | 16:40 |
fungi | yeah, i'd just add a third one and then spin down the other two, doing it all through dns updates | 16:40 |
clarkb | or just git-fe.o.o | 16:40 |
anteaya | guess I thought front ends were tied to specific backends | 16:40 |
clarkb | not really since they are read only we can share backends | 16:42 |
anteaya | wonderful | 16:43 |
jeblair | okay, i'll see if i can come up with a good maxconn value for backends and set that everywhere, then spin up a 30g compute instance and configure least-conn on it only | 16:44 |
sc68cal | mordred: hey I read scrollback about the floating IP stuff - let me know if there is anything else I can help answer | 16:44 |
sc68cal | mordred: I too, dislike floating IPs - all hail IPv6! | 16:44 |
*** dguerri` is now known as dguerri | 16:45 | |
mordred | sc68cal: did we say anything that sounded completely terrible? | 16:45 |
mordred | sc68cal: ++ | 16:45 |
mordred | zomg. ipv6 == so much better | 16:45 |
*** ryanpetrello has quit IRC | 16:45 | |
sc68cal | mordred: no it sounds like we found another nova-net and neutron mismatch in the API :( | 16:45 |
fungi | sc68cal: i only need these dirty old ipv4 addresses for a few more years, i hope ;) | 16:45 |
sc68cal | fungi: haha | 16:46 |
*** dguerri is now known as dguerri` | 16:46 | |
mordred | sc68cal: well, to be more precise, we found another place where neutron has a nicer api | 16:46 |
*** ryanpetrello has joined #openstack-infra | 16:46 | |
sc68cal | mordred: heresey! | 16:46 |
* sc68cal falls on his fainting couch | 16:47 | |
*** jcoufal has quit IRC | 16:47 | |
* mordred hands sc68cal a mint julep and a fan | 16:47 | |
fungi | i'm disappointed that here it is 2015 and my residential broadband isp provides ipv6 by letting me configure a "6rd" tunnel to a broker on their network border | 16:47 |
mordred | fungi: I'm disappointed by many things | 16:48 |
*** ZZelle_ has joined #openstack-infra | 16:48 | |
sc68cal | fungi: ouch. | 16:48 |
fungi | i want a full mtu for my v6 traffic, darn it! | 16:48 |
*** rlandy has joined #openstack-infra | 16:48 | |
*** jsavak has joined #openstack-infra | 16:48 | |
fungi | gimme slaac/dhcp6/rtsol/bgp6/something native | 16:49 |
yolanda | jeblair, thx for the quick fix and release of gear | 16:49 |
jeblair | yolanda: np; i'll probably restart our zuul later today to pick it up | 16:49 |
yolanda | we are heading for that tomorrow | 16:49 |
*** puranamr has joined #openstack-infra | 16:49 | |
fungi | jeblair: in good news, we may have avoided the gearman outage today because of new shade. or at least something seems to have caused us to _still_ not started uploading our dib results | 16:50 |
yolanda | jeblair, did you ever hit that bug, or that's an special case we were facing? | 16:50 |
*** ujuc has quit IRC | 16:50 | |
fungi | mordred: have you checked up on image updates? | 16:50 |
*** _nadya_ has quit IRC | 16:50 | |
*** puranamr has quit IRC | 16:50 | |
*** puranamr has joined #openstack-infra | 16:51 | |
*** _nadya_ has joined #openstack-infra | 16:51 | |
jeblair | yolanda: we're pretty sure we see it when we upload dib images, because they use so much bandwidth | 16:51 |
eantyshev | Hello! Does anybody here run many CI accounts? AFAIU, they should be run in separate Zuul nodes. Do you have many Jenkins nodes too? | 16:51 |
*** ZZelle__ has joined #openstack-infra | 16:51 | |
fungi | as soon as i've finished my lunch i'll see if i can tell if it's still going or broke | 16:51 |
*** vnod has joined #openstack-infra | 16:51 | |
asselin | uberjay, fyi this merged https://review.openstack.org/#/c/191216/ and this needs review...might interest you: https://review.openstack.org/#/c/192819/ | 16:52 |
*** sdake has joined #openstack-infra | 16:52 | |
asselin | eantyshev, I have a few accounts. they all run independently | 16:52 |
yolanda | jeblair good to know, and thx for that help yesterday | 16:52 |
mordred | fungi: I was also going to check it after lunch | 16:52 |
uberjay | asselin: ah, that's a great idea. thanks for the pointer. | 16:52 |
jeblair | np, thank you :) | 16:53 |
*** yamahata has joined #openstack-infra | 16:53 | |
mgagne | I'm looking at nodepool and I'm wondering at what time is the keypair injected into the image. Is it done by dib or nova boot? if nova boot, does nodepool assume a keypair is pre-created and available via Nova api? | 16:53 |
asselin | eantyshev, I tried sharing, but it was too complicated. | 16:53 |
*** rm_work|away is now known as rm_work | 16:53 | |
eantyshev | asselin: So you have independent Jenkins nodes? | 16:53 |
uberjay | asselin: i'm a bit behind, as the floating ip pool was full since earlier this morning... the queue is ~10 jobs behind | 16:53 |
greghaynes | dguerri`: https://review.openstack.org/#/c/183496/ failure is wierd | 16:54 |
*** thedodd has joined #openstack-infra | 16:54 | |
asselin | uberjay, right this patch can help, in case any of them merged already, but still queued: https://review.openstack.org/#/c/192819/ | 16:54 |
greghaynes | dguerri`: that got modified in the parent patch, not sure why it'd fail there but not in parent | 16:54 |
greghaynes | dguerri`: er, sorry, that test fail is wierd, not the patch ;) | 16:54 |
asselin | eantyshev, yes, each their own jenkins master and nodepool slaves | 16:54 |
mordred | mgagne: for dib images, it's done by dib | 16:54 |
mgagne | mordred: is it done by a custom element or is an env var set? | 16:55 |
eantyshev | asselin: thank you for that information! | 16:55 |
mordred | mgagne: our puppet, which we run in our dib, adds it | 16:55 |
*** _nadya_ has quit IRC | 16:55 | |
*** sdake_ has quit IRC | 16:55 | |
mgagne | oh, thanks for the info! | 16:55 |
mordred | mgagne: although there is a dib element (local-config I think?) which will inject a local ssh key if you want for doing testing of things | 16:56 |
greghaynes | Well, itll need to get injected with the correct user and such, I tend to use devuser for that | 16:57 |
greghaynes | the devuser element, that is | 16:57 |
mordred | devuser | 16:57 |
mordred | that's it | 16:57 |
*** Swami has joined #openstack-infra | 16:57 | |
waynr | clarkb: would you mind looking at https://review.openstack.org/#/c/183488 ? | 16:58 |
*** bradjones has quit IRC | 16:58 | |
mgagne | so supported methods are: dib element (devuser), puppet, node keypair (config nodepool) | 16:58 |
waynr | no rush I just noticed your last comment indicating that you would eventually review and approve | 16:58 |
*** bradjones has joined #openstack-infra | 16:58 | |
*** bradjones has quit IRC | 16:58 | |
*** bradjones has joined #openstack-infra | 16:58 | |
*** yamahata has quit IRC | 16:59 | |
*** mwagner_afk has quit IRC | 16:59 | |
*** ddieterly has quit IRC | 17:00 | |
*** doug-fish has joined #openstack-infra | 17:01 | |
mordred | mgagne: well, node keypar really only works if you're using not-dib and template nodes | 17:01 |
mgagne | really? what if I install cloud-init? | 17:02 |
mordred | mgagne: it's conceivable we could add keypair support to dib-based image boots - it would not be hard to do - but we do not currently use that | 17:02 |
mordred | mgagne: nodepool doesn't provide any keypair information to nodes it boots | 17:02 |
mgagne | wth | 17:02 |
mordred | because it's never been an interesting thing to us | 17:02 |
mgagne | http://docs.openstack.org/infra/nodepool/configuration.html keypair | 17:02 |
mordred | we have already pre-created the images in both sides | 17:02 |
mordred | so injecting them at boot time is not really a benefit | 17:03 |
*** RichardRaseley has joined #openstack-infra | 17:03 | |
openstackgerrit | Vinod Pandarinathan proposed openstack-infra/system-config: Add openstack cloudpulse channel bot https://review.openstack.org/193643 | 17:03 |
fungi | mgagne: that tells it what keypair to use when connecting to a template instance, when customizing it in preparation to make a snapshot (used for old-style non-dib nodes) | 17:03 |
mgagne | now that's a confusing config name | 17:03 |
fungi | mgagne: basically a bootstrapping key | 17:03 |
mordred | agree | 17:03 |
*** ashleighfarnham has quit IRC | 17:03 | |
mordred | it should also get some better docs to indicate what it's there for | 17:04 |
devananda | hey, so apparently I missed a conversation in the early hours of this morning re: whether young/new/whatever projects should go on stackforge/ or openstack/ namespace | 17:05 |
*** sdake_ has joined #openstack-infra | 17:05 | |
mordred | devananda: tl;dr - there is no reason for them to go into stackforge/ | 17:05 |
mordred | devananda: there is no new policy on the subject, that is under discussion | 17:05 |
greghaynes | \o/ less renaming | 17:06 |
mordred | devananda: but it is not required, nor is there benefit, for them to go to stackforge | 17:06 |
devananda | mordred: sure. except if they're not part of the existing team, then they dont belong in openstack/ under the umbrella of said team | 17:06 |
mordred | devananda: there is nothing stopping them from being a new team | 17:06 |
jeblair | s/team/project/ but yeah :) | 17:06 |
devananda | mordred: do we have a policy for leaderless teams in openstack/ ? or just forming a new team? | 17:06 |
devananda | jeblair: no, I mean team | 17:06 |
mordred | just form a new team | 17:06 |
openstackgerrit | Merged openstack-infra/shade: Centralize exception management for Neutron https://review.openstack.org/192181 | 17:06 |
mordred | yay ^^ I like that patch | 17:07 |
*** tvanderwiel has quit IRC | 17:07 | |
greghaynes | mordred: did you see my comment on the parent patch? it has me a little worried | 17:07 |
mordred | greghaynes: I did not | 17:07 |
mordred | but I'm going to AFK for lunch | 17:07 |
mordred | so I'll look in a minute | 17:07 |
greghaynes | mordred: basically - the parent patch failed a test that looks like it was a bug in the dependent patch | 17:07 |
greghaynes | ok | 17:07 |
*** sdake has quit IRC | 17:09 | |
*** ddieterly has joined #openstack-infra | 17:09 | |
fungi | devananda: ideally the policy for just forming a new project team is simple enough that people don't need to spend much time debating whether it's worth doing. i note that the searchlight proposal made it from motion uploaded to gerrit to approved by the tc in a mere 6 days | 17:09 |
asselin | fungi, is today a better day to merge this? https://review.openstack.org/#/c/183422/ | 17:09 |
jeblair | devananda: i mean simply to point out that to add a new "team" you propose a "project" :) | 17:10 |
asselin | fungi, and this? https://review.openstack.org/#/c/183429/ | 17:10 |
jeblair | i suspect for the purposes of this conversation, they are largely synonymous though. | 17:10 |
devananda | jeblair: https://review.openstack.org/#/c/191142/2/reference/projects.yaml isn't proposing a new team | 17:10 |
devananda | jeblair: and its first iteration did not either -- it proposed (and still does) adding a new project to an existing team | 17:10 |
jeblair | devananda: yeah, that's proposing a new repo for an existing project/team | 17:10 |
*** jtomasek has joined #openstack-infra | 17:11 | |
*** bradjones has quit IRC | 17:11 | |
jeblair | devananda: if you don't want it, don't accept it, and they can propose a new project/team :) | 17:11 |
fungi | asselin: looking | 17:11 |
devananda | jeblair: exactly what we did. now for questoin #2 -- what if we don't like the direction it's going? | 17:12 |
*** ashleighfarnham has joined #openstack-infra | 17:12 | |
devananda | I believe the answer is: that's OK. it's a big tent. | 17:12 |
fungi | jeblair: devananda: also if you accept it now, doesn't mean it can't spin out to be under a separate project team later, and if it's created with a new project team now that doesn't mean that it can't be absorbed into another one later. those are just governance changes at that point | 17:12 |
devananda | fungi: *nod* | 17:12 |
*** bradjones has joined #openstack-infra | 17:12 | |
*** bradjones has quit IRC | 17:12 | |
*** bradjones has joined #openstack-infra | 17:12 | |
jeblair | devananda: yeah, if they aren't part of your project/team, er, ask nicely? post to the mailing list? if you think it's a really bad idea to start with, ask that the project be rejected at the start because they aren't collaborating or something? | 17:13 |
jeblair | devananda: but yeah, general answer is probably as you say. | 17:14 |
devananda | big tent allows project (teams) to exist and compete. but we haven't had a case before, afaik, where within a project, a subcomponent (like the UI) had competing implementations | 17:14 |
jeblair | i believe the tc is willing to exercise some discretion here | 17:14 |
devananda | jeblair: sounds like we're on the same page :) | 17:14 |
fungi | devananda: yeah, that would be as crazy as a project subcomponent like networking having competing implementations ;) | 17:15 |
*** claudiub has quit IRC | 17:15 | |
jeblair | devananda: so if a project competes with something in a way that you think is harmful to the project, i think the tc would be willing to talk about it. | 17:15 |
devananda | fungi: totally crazy :) | 17:15 |
fungi | that way lies madness | 17:15 |
jeblair | devananda: is ironic-dashboard competing with something? | 17:15 |
*** nihilifer has joined #openstack-infra | 17:16 | |
*** abitha has joined #openstack-infra | 17:16 | |
jeblair | devananda: (from my pov, i hear things like "ironic wants to run standalone" so an "ironic-dashboard" project shows up and i think "oh it must be part of that"). if i need re-education, i'm ready to recieve it. :) | 17:17 |
devananda | jeblair: yup. see ML thread about all this, to which I have not replied yet, but clearly need to | 17:17 |
devananda | jeblair: tldr; I wasn't aware of this new project before it was proposed to openstack/governance | 17:18 |
anteaya | devananda: wow | 17:18 |
*** puranamr has quit IRC | 17:18 | |
fungi | that's indeed a bit jarring | 17:18 |
devananda | yup | 17:18 |
anteaya | devananda: yes when I saw the patch fly past with ironic in the title I figured you were aware if not behind it | 17:18 |
devananda | anteaya: I was not. | 17:18 |
anteaya | devananda: thanks for telling us | 17:19 |
devananda | the big tent allows for anyone to propose changes to governance. so I'm happy that folks are taking up their rights. but this wasn't socialized properly | 17:19 |
devananda | none of the current ironic TEAM are behind or involved in this | 17:19 |
devananda | and that is my only problem with it | 17:19 |
jeblair | devananda: is there another ironic-dashboard project? or is there a panel in horizon? | 17:20 |
fungi | well, if the projects it fronts and integrates into aren't aware of its existence, that suggests that at a minimum open design is missing from their team methodology | 17:20 |
jeblair | devananda: where is the ironic team focusing ui work? | 17:20 |
jeblair | fungi: indeed | 17:20 |
devananda | jeblair: there was some (now abandoned) work from a few teams last cycle. I've been working with krotscheck (he's really been doing all the work) on new things for the past few months | 17:21 |
fungi | this is one of the places i fear we've still somehow sent the wrong message with our governance restructuring, that teams think they need to have something designed and working _before_ they bring it to the community for consideration | 17:21 |
*** mriedem_burgers is now known as mriedem | 17:22 | |
*** rguillebert has quit IRC | 17:22 | |
devananda | jeblair: we talked about it on friday in YVR. folks in our community know about it. there's nothing in gerrit yet, though there is a working POC on github | 17:22 |
jeblair | devananda, krotscheck; my understanding from krotscheck's ml post is that krotscheck is working on plumbing/design, right? | 17:22 |
jeblair | devananda: there's a what on where? | 17:23 |
devananda | proof of concept | 17:23 |
*** jsavak has quit IRC | 17:23 | |
jeblair | devananda: can you provide a link to that? | 17:23 |
fungi | please explain this "gi-thub" of which you speak | 17:23 |
devananda | heh | 17:23 |
*** jsavak has joined #openstack-infra | 17:23 | |
devananda | jeblair: yes, but not sure how it's relevant to the discussion | 17:24 |
* fungi read "there's some random code sprayed somewhere out on the internet" | 17:24 | |
*** zul has quit IRC | 17:25 | |
devananda | fungi: so this proposal from niuzhenguo was a 2,500 line code drop on github with one contributor | 17:25 |
*** zul has joined #openstack-infra | 17:25 | |
fungi | yeah, that's pretty crazy | 17:25 |
JayF | devananda: where's the github repository that you'er all speaking about? | 17:26 |
devananda | i assume you looked at the upstream: ref | 17:26 |
devananda | https://github.com/niuzhenguo/ironic-dashboard | 17:26 |
*** notnownikki has quit IRC | 17:26 | |
fungi | clearly this is something written somewhere at a service provider/integrator now being "opened" | 17:26 |
devananda | clearly | 17:26 |
devananda | which is great. I'm delighted they wanted to share | 17:26 |
openstackgerrit | Merged openstack-infra/jenkins-job-builder: Move writexml fix for older minidom to same module as caller https://review.openstack.org/180150 | 17:26 |
*** mrunge has quit IRC | 17:27 | |
jeblair | devananda: okay, so here's my perception: huawei went and wrote a dashboard. hp went and wrote a dashboard. they are both on github. public discussions about them are only now starting. | 17:27 |
devananda | but we need to colletively rewind and actually have a discussion within the project about whether we want to do this | 17:27 |
devananda | jeblair: exactly | 17:27 |
devananda | and the discussion recently got sideswiped by 'should it be on stackforge or openstack' | 17:27 |
*** puranamr has joined #openstack-infra | 17:28 | |
devananda | which really isn't hte point :) | 17:28 |
jeblair | devananda: i think there is an opportunity for both teams to get together, and figure out a way to collaborate (or else, decide that they want completely different things and these are actually two projects) | 17:28 |
fungi | this is from huawei? i'm having _no_ luck so far finding copyright from anybody | 17:28 |
jeblair | devananda: agreed; the stackforge/openstack thing is an inflection point where we discover things like this :) | 17:28 |
openstackgerrit | Sean Dague proposed openstack-infra/elastic-recheck: add query for keystone wsgi restart issue https://review.openstack.org/193571 | 17:28 |
jeblair | fungi: er, well, someone advocating for it on the list has a huawei address | 17:29 |
*** otter768 has joined #openstack-infra | 17:29 | |
devananda | the person who proposed the gov changes has an @huawei address | 17:29 |
fungi | jeblair: got it | 17:30 |
fungi | i mean, whoever put this thing on github seems to fairly consistently mark it as apache 2 license at least. just no real indication of provenance | 17:31 |
jeblair | at any rate, i think it would good for _any_ project to start its life in a public manner, and using our project infrastructure. it doesn't help anyone to go off and work on something in private and then be surprised that someone else is doing the same thing. | 17:32 |
*** ZZelle_ has quit IRC | 17:32 | |
fungi | i do find a few files which were lifted from nova, so they still have "Copyright 2012 United States Government as represented by the Administrator of the National Aeronautics and Space Administration. All Rights Reserved." | 17:33 |
*** ZZelle__ has quit IRC | 17:33 | |
*** otter768 has quit IRC | 17:33 | |
openstackgerrit | Merged openstack-infra/elastic-recheck: add query for keystone wsgi restart issue https://review.openstack.org/193571 | 17:34 |
*** tqtran has joined #openstack-infra | 17:35 | |
*** SumitNaiksatam has quit IRC | 17:36 | |
*** yamamoto has joined #openstack-infra | 17:37 | |
*** wenlock has joined #openstack-infra | 17:37 | |
fungi | asselin: i'm cool with the zuul log management puppet changes, but feel like we should wait to merge them until after jeblair restarts zuul later today, just so that if we do discover a problem with this it won't complicate/extend that restart | 17:38 |
*** e0ne has joined #openstack-infra | 17:38 | |
asselin | fungi, ok | 17:38 |
asselin | fungi, I won't be around this afternoon, but I shouldn't be needed | 17:38 |
fungi | asselin: yep. absolute worst case we revert it, but this is simple enough that we should be able to just iron out the bugs if there are any without reverting | 17:39 |
asselin | fungi, agreed | 17:39 |
*** ghostpl has quit IRC | 17:40 | |
devananda | jeblair: I agree. though in practice, I find it easier to do a proof of concept on github, where I can delete the project if it turns out not to be a good idea. | 17:40 |
devananda | jeblair: but pivot it to openstack/ as soon as the question "is this actually useful" is answered | 17:40 |
devananda | afaik, ya'll still can't delete projects, right? | 17:41 |
greghaynes | mordred: so, a few things are wierd on this image | 17:41 |
greghaynes | mordred: on the rax image with no networking, that is | 17:41 |
greghaynes | mordred: first is the lack of logs from simple-init | 17:41 |
fungi | devananda: we mark them as inactive/abandoned | 17:41 |
*** yamamoto has quit IRC | 17:42 | |
fungi | technically we set them to "read-only" in gerrit | 17:42 |
jeblair | there's no good reason to delete code that's been written. no one has to use it, and it may be useful to someone in the future. | 17:42 |
*** puranamr has quit IRC | 17:43 | |
jeblair | (even deleting something on github is illusory at best; the internet in general is really bad about deleting things) | 17:43 |
*** dtantsur is now known as dtantsur|afk | 17:43 | |
devananda | indeed | 17:43 |
*** mpaolino has joined #openstack-infra | 17:44 | |
fungi | do sort of wish gerrit's api let you query/filter the repo list by config parameters | 17:45 |
fungi | er, i do | 17:45 |
jeblair | devananda: our community can handle experimentation. if people wanting to start new efforts just said "hey, i want to try to do a foo" then we could get people coalescing around those ideas. i'm not saying there is no place for private experimentation, but i think that the moment one thinks "i'll put this on github" is probably at or past the time one should actually be thinking "i will share this with my colleagues on the openstack proje | 17:45 |
*** Longgeek has quit IRC | 17:45 | |
*** mpaolino has quit IRC | 17:45 | |
anteaya | fungi: isn't that what hound is good for? | 17:45 |
*** cdent has quit IRC | 17:45 | |
*** koolhead17 has joined #openstack-infra | 17:45 | |
anteaya | fungi: though that doesn't help in finding a given patch | 17:46 |
anteaya | as hound can't index proposed patches | 17:46 |
fungi | anteaya: in this case i'm talking about the gerrit configuration for each repo | 17:46 |
anteaya | ah | 17:46 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Pin to a specific fedora mirror https://review.openstack.org/193560 | 17:46 |
anteaya | so no way in there | 17:46 |
fungi | anteaya: the idea being "give me a list of active (not read-only or hidden) projects in gerrit" | 17:46 |
anteaya | oh yeah | 17:46 |
*** mpaolino has joined #openstack-infra | 17:46 | |
anteaya | gerrit only | 17:46 |
anteaya | :( | 17:47 |
jeblair | fungi: i bet that's not a super-difficult gerrit change | 17:47 |
fungi | anteaya: the project list api call doesn't filter on anything besides project name and pagination | 17:47 |
*** ildikov has joined #openstack-infra | 17:47 | |
anteaya | yeah, less then what you want | 17:47 |
*** mpaolino has quit IRC | 17:47 | |
fungi | jeblair: yeah, likely could be added as an option to the projects method | 17:48 |
*** ildikov has quit IRC | 17:48 | |
*** ildikov has joined #openstack-infra | 17:48 | |
*** tvanderwiel has joined #openstack-infra | 17:48 | |
fungi | interesting that they _do_ have a rest api call to initiate git garbage collection per project though | 17:48 |
anteaya | interesting | 17:48 |
*** mpaolino has joined #openstack-infra | 17:49 | |
anteaya | I didn't know git had garbage collection | 17:49 |
fungi | anteaya: man git-gc | 17:49 |
anteaya | thank yo9u | 17:49 |
devananda | jeblair: what is the appropriate way to experiment on new projects in gerrit? | 17:49 |
fungi | devananda: normally when someone on the infra team wants to do that, they just create a new git repo in gerrit within the infra team | 17:50 |
pelix | fungi jeblair mordred: there are a few changes in JJB from both Khai or myself (or have been worked on by us) that need a +2 from another core reviewer assuming they look good. | 17:50 |
devananda | fungi: with consummate proposals to projects.yaml, governance, etc ? | 17:50 |
*** mpaolino has quit IRC | 17:50 | |
fungi | devananda: yep. those are remarkably short and easy to churn out | 17:51 |
fungi | especially if you're starting with an empty repo and no-op jobs | 17:51 |
devananda | fungi: maybe I'm missing something ... but it seems totaly unnecessary to involve the TC for every experimental project. and while on the TC, I dont recall ever seeing such things from infra | 17:51 |
*** puranamr has joined #openstack-infra | 17:51 | |
devananda | fungi: also - it's much easier for infra to do that, since infra can approve infra's changes to infra | 17:51 |
openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Ensure tests run with ConfigParser object https://review.openstack.org/179822 | 17:51 |
devananda | fungi: than, say, me waiting a few days for ya'll to approve a new project that i want to experiment on | 17:52 |
fungi | devananda: this is one of the reasons we pushed to have governance changes adding repos to an existing project be administrivia and not need air time in tc meetings | 17:52 |
krotscheck | Sorry I'm late to the conversation, was relocating to Zoka | 17:52 |
fungi | and also not block new project changes to project-config on them | 17:52 |
*** zxiiro has quit IRC | 17:53 | |
fungi | devananda: it's getting faster. we have something like 10 core reviewers on that repo now | 17:53 |
krotscheck | (That's a coffee place) | 17:53 |
jeblair | yep, at this point, a new repo for an existing team can be created as fast as the project-config folks review it. | 17:53 |
*** mpaolino has joined #openstack-infra | 17:53 | |
*** marzif has joined #openstack-infra | 17:53 | |
fungi | and we can add more people to that fairly easily | 17:53 |
devananda | jeblair: fungi: oh, that's great :) | 17:54 |
jeblair | i can't remember the last time i +Ad my own repo creation change either; i usually wake up to find a repo there 2 or 3 days later | 17:54 |
jeblair | sometimes 1 | 17:54 |
openstackgerrit | Merged openstack-infra/jenkins-job-builder: Change zuul-cloner parameters https://review.openstack.org/176008 | 17:54 |
openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Ensure tests run with ConfigParser object https://review.openstack.org/179822 | 17:54 |
devananda | krotscheck: welcome back. I may step away soon, now | 17:54 |
krotscheck | devananda: Alrightey, what's left to discuss? | 17:55 |
yolanda | mordred, jeblair, do you have some feedback for the nodepool 2 queue change? about working on some approach to guarantee the rate | 17:55 |
*** jasondotstar has quit IRC | 17:56 | |
yolanda | mordred, yesterday i had to go, my children were looking at me with angry eyes, so i lost your feedback if you gave me | 17:56 |
openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Take parameter order from yaml in trigger_parameterized_builds https://review.openstack.org/193660 | 17:56 |
fungi | yolanda: great news, we have logs! http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2015-06-18.log.html#t2015-06-18T17:29:36 | 17:57 |
*** koolhead17 has quit IRC | 17:57 | |
yolanda | heh, fungi, good point | 17:58 |
fungi | yolanda: though after a quick skim, i don't see them mention any suggestions after you left | 17:58 |
*** jasondotstar has joined #openstack-infra | 17:59 | |
yolanda | yep, empty there | 17:59 |
*** jasondot_ has joined #openstack-infra | 17:59 | |
jeblair | yolanda: i don't have a suggestion. but i will say that to get a +2 from me you will need to convince me that the change is necessary and worth the complexity. i am not sure i believe it's needed at this point. | 18:00 |
*** mpaolino has quit IRC | 18:00 | |
AJaeger | devananda: just reading the scrollback. Thanks for showing up and all the comments. | 18:00 |
yolanda | fungi, about the logrotate approach, i got -1 from Spencer and he is proposing a new approach of not using logrotate::fileremoval, but adding the absent functionality on the logrotate::file one | 18:00 |
anteaya | fungi: do we run git-gc on any gerrit repos? | 18:00 |
anteaya | fungi: I haven't seen it anywhere that I recall | 18:00 |
jeblair | anteaya: we repack them | 18:00 |
anteaya | ah | 18:01 |
*** SumitNaiksatam has joined #openstack-infra | 18:01 | |
jeblair | anteaya: git repack -afd as i recall | 18:01 |
anteaya | thanks I'll re-read that section | 18:01 |
*** prad_ has joined #openstack-infra | 18:01 | |
jeblair | anteaya: you can probably find the configuration of it by searching for 'repack' in all of our repos because i have no idea where it is in puppet now. (yay hound) | 18:01 |
anteaya | hehe | 18:02 |
yolanda | jeblair, using you simulator it was still reporting better times, even if hpcloud times were much better | 18:02 |
fungi | yolanda: okay, interesting. mostly just wanting to make sure we can use puppet to clean up logrotate configs somehow when we remove/rename them in the manifest | 18:02 |
yolanda | i'm ok with using nibalizer's approach if that's simpler | 18:02 |
fungi | yep, i don't personally care how we get therwe | 18:03 |
fungi | there | 18:03 |
yolanda | fungi, but i don't think that he picked the concept: https://review.openstack.org/#/c/189378/2/manifests/file.pp | 18:04 |
yolanda | the attempt of this patch is to remove files with old naming from logrotate | 18:04 |
fungi | it's just right now we're still throwing puppet errors on review.openstack.org because of a missing logrotate file, and i would like that if we fix how that's pathed we don't leave extra logrotate configs on people's servers double-rotating some logs | 18:04 |
*** rlandy has quit IRC | 18:05 | |
*** Rockyg has joined #openstack-infra | 18:05 | |
*** rlandy has joined #openstack-infra | 18:05 | |
fungi | yolanda: seems like your fix is also useful long-term, and his fix is probably better for this transition | 18:05 |
yolanda | mm, that patch he did tries to clean only the /etc/logrotate.d/basename , i'm not sure if that will help | 18:05 |
yolanda | that's not cleaning the whole old path | 18:05 |
AJaeger | devananda: I also pushed these folks in your direction: https://review.openstack.org/#/c/193392/ | 18:06 |
yolanda | so if the old logrotate was /var/log/jeepyb/manage_projects.log, he will clean /etc/logrotate.d/manage_projects.log, not /etc/logrotate.d/var/log/manage_projects.log | 18:06 |
yolanda | that was the point of that | 18:06 |
yolanda | i'll update the depends-on i created on your change to pont at nibalizer's one, but i think that this needs a fix | 18:07 |
*** olaph has quit IRC | 18:07 | |
greghaynes | mordred: ubuntu-minimal really is missing a lot of tools | 18:08 |
anteaya | the birds are calling, time for me to get a walk in | 18:08 |
greghaynes | mordred: tools like ping | 18:08 |
fungi | yolanda: ahh, yeah looking closely i think you're right, though the file_basename var he's inserting seems to be defined outside the scope of that class | 18:09 |
yolanda | he creates that using basename stdlib method | 18:09 |
fungi | no, i misread | 18:09 |
fungi | yeah, he's instantiating it in the previous line | 18:09 |
yolanda | but i think he should remove whole path if exists, not basename | 18:09 |
openstackgerrit | yolanda.robla proposed openstack-infra/puppet-jeepyb: Separate the fetch remotes log dir and file https://review.openstack.org/192187 | 18:10 |
yolanda | just updated the depends | 18:10 |
fungi | thanks! | 18:10 |
*** dannywilson has joined #openstack-infra | 18:10 | |
*** dannywilson has quit IRC | 18:10 | |
*** jasondotstar has quit IRC | 18:10 | |
*** dannywilson has joined #openstack-infra | 18:10 | |
devananda | AJaeger: yup, thanks. I missed the discussion this morning. the question is similar for both projects, but also different | 18:11 |
*** esker has joined #openstack-infra | 18:12 | |
*** esker has quit IRC | 18:12 | |
AJaeger | devananda: I guess it was early this morning for you ;). Discuss with them and figure out what works. For me it looked like something that might fit into ironic... | 18:12 |
devananda | AJaeger: ahc-tools is at least developed by some folks already known in ironic's community (dtantsur is an active core). but it hasn't been discussed yet whether the project-as-a-whole wants to embrace it | 18:12 |
*** mrunge has joined #openstack-infra | 18:12 | |
pleia2 | fungi: did we want more feedback from cores re: 192473? (git-review drop period in commit message check) | 18:12 |
devananda | AJaeger: fwiw, dtantur's explanation as to why this was proposed to stackforge is spot on | 18:13 |
yolanda | fungi, i'll remove my fileremoval part as well, we can move under a new change to simplify it | 18:13 |
*** esker has joined #openstack-infra | 18:13 | |
fungi | pleia2: i don't think so. because ultimately we aren't specifically dropping that check, we're upgrading to a later version of hacking where the community at large dropped that check | 18:13 |
pleia2 | fungi: yeah, just realized I was reading the old commit message | 18:14 |
devananda | AJaeger: in past cycles, i've strongly encouraged folks to do initial work on stackforge and move to openstack/* when the project met a few requirements: it has unit and functional tests, it has sufficient developer docs that other devs can jump in easily, and the project team agrees with the direction | 18:14 |
pleia2 | fungi: thanks | 18:14 |
dimsum__ | pleia2: fungi: can one of you please bless this? (devstack-gate review for oslo.service) https://review.openstack.org/#/c/186365/ | 18:14 |
devananda | AJaeger, jeblair: I feel that that ^ is still a good bar, but if we're not using stackforge for it, then I'm not sure where to encourage that work to happen, or how to indicate it within the openstack/* namespace | 18:15 |
fungi | devananda: it's a good question, and i think it still needs some debate. as a thought experiment i like to consider what we'd do if there weren't namespaces at all on these. we still have the governance repo to indicate who's leading the effort for any group of one or more repos | 18:16 |
openstackgerrit | yolanda.robla proposed openstack-infra/puppet-jeepyb: Separate the fetch remotes log dir and file https://review.openstack.org/192187 | 18:16 |
yolanda | ok, that's it | 18:16 |
pleia2 | dimsum__: sure, lgtm | 18:16 |
*** pelix has quit IRC | 18:16 | |
* AJaeger agrees with fungi | 18:16 | |
dimsum__ | thanks pleia2 | 18:17 |
openstackgerrit | Merged openstack-infra/project-config: Take configuraiton control to test hooks for networking-odl https://review.openstack.org/192433 | 18:17 |
mgagne | clarkb: I'm getting "TypeError: execve() arg 3 contains a non-string value" with nodepool. Remember what was the cause of it? | 18:17 |
AJaeger | devananda: right now the default seems to be "go stackforge, then move to openstack". I'd like us to break out of this | 18:17 |
devananda | fungi: following your thought experiment ... let's say someone creates openstack/ironic-foo, but no one in ironic-core team knows them, so they create a new ironic-foo team in gerrit | 18:17 |
yolanda | jeblair, for nodepool.conf new file, i got some questions that i think they are valid. One is rename nodepool.conf to auth.conf | 18:18 |
AJaeger | devananda: If there's a review for ironic-foo in openstack, we ask for which project this is part of. | 18:18 |
yolanda | second one is not use [mysql] section for the database, and use the more generic [database] term | 18:18 |
*** doug-fish has left #openstack-infra | 18:18 | |
*** marzif has quit IRC | 18:18 | |
devananda | fungi: do we expect the consumers of openstack (distros, ops, etc) to realize that the openstack/ironic-foo project (the code itself, i mean) is essentially unrelated and not maintained by the same people as openstack/ironic ? | 18:18 |
AJaeger | If it's in ironic, we would only approve after your explicit +1 on it. | 18:18 |
*** alexpilotti has quit IRC | 18:18 | |
AJaeger | And if there's no project adoptiong it, it needs to be a new project -> so first to TC via governance repo before we approve it | 18:19 |
devananda | AJaeger: sure, that's how it is today. but i'm following fungi's thought experiment a bit to see what alternatives might exist | 18:19 |
AJaeger | devananda: Ah, you think two steps further... | 18:20 |
devananda | AJaeger: sure. creation of a new *team* now requires TC approval, whereas an existing team gets a rubber stamp to create a new *repository* | 18:20 |
devananda | AJaeger: that's an interesting world, and I largely agree -- the teams are what matters to us developers. but the rest of the world is looking at the software our teams produce | 18:20 |
devananda | AJaeger: and they look at the project // code repository names, at least today | 18:21 |
fungi | devananda: agreed, it's a grey area. this is one of the reasons i'm in favor of jeblair's proposal to require all repos we host to be in tc-recognized projects, and just make it as easy as possible to get a new project recognized by the tc | 18:21 |
devananda | fungi: s/tc-recognized projects/tc-recognized project teams/ | 18:22 |
AJaeger | devananda: I see the point. Right now an "ironic-FOO" project in stackforge might tell people "look closely, it's not mature" while in openstack the perception is different. We have the tags in the governance repo but those are new | 18:22 |
devananda | we renamed it again :) | 18:22 |
fungi | yeah | 18:22 |
devananda | AJaeger: exactly. | 18:22 |
fungi | at least then if there is a concern by one project-team over repo names chosen by another project-team, they're both under the governance of the tc and can seek mediation if needed | 18:22 |
devananda | AJaeger: also, tags do not indicate maturity of a project, and many folks object to ever allowing that | 18:23 |
devananda | AJaeger: so there is no way to tell, from tags, that openstack/ironic-foo and openstack/ironic-bar are of different maturity levels, managed by different teams of people, etc | 18:23 |
devananda | so i think the name of a project still carries a ver ysignificant association | 18:24 |
fungi | aside from the obvious "getting out of the business of renaming constantly repos," i'd love it if the infra team could also get out of the business of deciding who gets to create projects under what teams, with what names, et cetera | 18:24 |
devananda | fungi: ++ | 18:24 |
AJaeger | fungi: ++ | 18:24 |
AJaeger | devananda: so that's only part of the OPS tag discussion? | 18:24 |
devananda | as an aside, this is one reason why bifrost is called bifrost, not ironic-installer. i anticipate that, some day, someone else may create a similar project using chef or puppet or something else with ironic, and didn't want to imply that there would be one and only one such project | 18:26 |
AJaeger | devananda: but nothing hinders the TC to propose a tag "experimental" that the PTL decides on and which would be the default for new repositories... | 18:26 |
devananda | AJaeger: heh ... but who decides what project(s) are experimental? | 18:26 |
devananda | AJaeger: I think the TC will not do that | 18:26 |
AJaeger | devananda: my proposal was: Every new repo is by default experimental. The PTL of the project team adopting it can ask for removal of the flag | 18:27 |
persia | +1 | 18:27 |
AJaeger | devananda: that puts you into the driver seat for ironic-BAR. Once you consider it non-experimental, you remove the flag. | 18:28 |
AJaeger | Like today: You experiment in stackforge and when you consider it non-experimental, you ask for moving it to openstack. | 18:28 |
fungi | devananda: also i'm unsure it matters if a project-team and/or repo is experimental. we have plenty of people creating experimental work and hosting it in our infrastructure already. if we need a registry of what's experimental we can consider maintaining one, but remaning a git repo to indicate whether or not it's experimental is the current thing we would love to _not_ be doing | 18:28 |
fungi | s/remaning/renaming/ | 18:28 |
devananda | fungi: indeed. I support you in wanting to have less of that | 18:29 |
mgagne | anyone got "TypeError: execve() arg 3 contains a non-string value" when nodepool tries to build an image with DIB? It stopped working for reasons yet unknown to me | 18:30 |
greghaynes | mgagne: got more detailed traceback? | 18:31 |
*** mwagner_afk has joined #openstack-infra | 18:31 | |
*** jasondotstar has joined #openstack-infra | 18:32 | |
greghaynes | mgagne: also, youre running latest nodepool? | 18:32 |
mgagne | from pypi | 18:32 |
mgagne | http://paste.openstack.org/show/305001/ | 18:32 |
*** SumitNaiksatam has quit IRC | 18:32 | |
*** SumitNaiksatam has joined #openstack-infra | 18:33 | |
*** jsavak has quit IRC | 18:33 | |
*** jsavak has joined #openstack-infra | 18:33 | |
fungi | i tried to pull up one of our dib logs but it has caused firefox to eat all my cpu now | 18:34 |
*** kushal has quit IRC | 18:35 | |
mgagne | yea, try chrome instead. AFAIK, firefox doesn't stream the page while it's rendering it unlike chrome | 18:35 |
greghaynes | mgagne: hrm, that looks like its the qemu-img-options bit | 18:35 |
fungi | not seeing it at http://nodepool.openstack.org/dib.devstack-trusty.log | 18:35 |
fungi | i'll check our debug logs though | 18:36 |
mgagne | clarkb once saw it in 2014 :D | 18:36 |
fungi | the internet never forgets! | 18:36 |
fungi | no hits in our nodepool debug logs either | 18:37 |
*** kushal has joined #openstack-infra | 18:37 | |
greghaynes | mgagne: youre in a spot where you can edit nodepool and retry? | 18:37 |
mgagne | yes | 18:38 |
greghaynes | mgagne: I have some code you could inject to debug | 18:38 |
mgagne | sure | 18:38 |
greghaynes | mgagne: add self.log.info(str([type(x) for x in [dib_cmd, img_types, qemu_img_options, filename, img_elements])) right after self.log.info('Running %s' % cmd) in nodepool.py on line 832 | 18:38 |
greghaynes | actually | 18:38 |
greghaynes | thatll syntax fail | 18:38 |
mgagne | in _buildImage right? | 18:38 |
greghaynes | mgagne: self.log.info(str([type(x) for x in [dib_cmd, img_types, qemu_img_options, filename, img_elements]])) | 18:39 |
greghaynes | yes | 18:39 |
*** stevedoor has quit IRC | 18:40 | |
mgagne | I think you were looking for "<type 'unicode'>" right? :D | 18:40 |
mgagne | last argument | 18:40 |
mgagne | img_elements | 18:41 |
greghaynes | nice | 18:41 |
mgagne | rerunning with (what I hope) is now ascii | 18:42 |
openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/system-config: Add StevenK and Infra as Zanata admins https://review.openstack.org/193677 | 18:42 |
mgagne | my element is "développeur" /jk | 18:42 |
greghaynes | well, no wonder :p | 18:42 |
*** hdd has quit IRC | 18:43 | |
greghaynes | clearly we shouldnt have tried to make the tableflip emoji element | 18:43 |
mgagne | should nodepool be updated to str() the value? | 18:43 |
greghaynes | very possibly, although that does beg the question of what do we encode as... | 18:44 |
greghaynes | almost seems like we should error if it needs to be encoded | 18:45 |
mgagne | not sure how encoded that is: https://github.com/openstack-infra/nodepool/blob/ab191ad797a5ae00cc006473cf733c38f92d1ab7/nodepool/cmd/config_validator.py#L94 | 18:46 |
*** Longgeek has joined #openstack-infra | 18:46 | |
*** clu_ has quit IRC | 18:46 | |
*** esker has quit IRC | 18:46 | |
greghaynes | huh, I have no idea if that schema validation accepts unicode for str, I guess it must?} | 18:46 |
mgagne | or add encoding validation below, I'm really not familiar with voluptuous | 18:46 |
greghaynes | anyhnow, we should make 100% sure that is the actualy issue before charging ahead | 18:47 |
greghaynes | I am kind of surprised at it... | 18:47 |
mgagne | self.log.info('%s of type %s', image.elements, type(image.elements)) | 18:49 |
mgagne | nodepool.DiskImageBuilderThread: ubuntu vm devuser of type <type 'unicode'> | 18:49 |
mgagne | # file /etc/nodepool/nodepool.yaml | 18:50 |
mgagne | /etc/nodepool/nodepool.yaml: ASCII text | 18:50 |
*** rlandy has quit IRC | 18:50 | |
*** nihilifer has quit IRC | 18:51 | |
mgagne | now they are all str and it's crashing still | 18:53 |
*** jalvis has joined #openstack-infra | 18:53 | |
*** ZZelle_ has joined #openstack-infra | 18:54 | |
*** hodos|2 has joined #openstack-infra | 18:54 | |
*** HeOS has quit IRC | 18:56 | |
*** jtomasek has quit IRC | 18:57 | |
*** hodos has quit IRC | 18:57 | |
openstackgerrit | Merged openstack-infra/infra-manual: Improve wording in governance change https://review.openstack.org/192665 | 19:00 |
openstackgerrit | Merged openstack-infra/infra-manual: Add clarification on questions in reviews https://review.openstack.org/177364 | 19:00 |
*** jasondotstar has quit IRC | 19:01 | |
openstackgerrit | BorneMace proposed openstack-infra/project-config: Made bashate test voting https://review.openstack.org/193682 | 19:03 |
*** jalvis has quit IRC | 19:03 | |
*** sabeen1 has quit IRC | 19:04 | |
*** mmedvede has quit IRC | 19:05 | |
greghaynes | mgagne: awesome | 19:05 |
*** puranamr has quit IRC | 19:06 | |
mgagne | ok, I casted everything to str() and it works. now dib requires sudo which it didn't yesterday for some reasons (or sudo got reverted?) | 19:06 |
greghaynes | dib has always required sodo | 19:06 |
greghaynes | er, sudo | 19:06 |
*** puranamr has joined #openstack-infra | 19:06 | |
mgagne | yea so I don't know really what changed here | 19:06 |
*** jtomasek has joined #openstack-infra | 19:07 | |
*** SumitNaiksatam_ has joined #openstack-infra | 19:08 | |
openstackgerrit | greghaynes proposed openstack-infra/nodepool: Cast DIB args to strings https://review.openstack.org/193683 | 19:09 |
greghaynes | mgagne: ^ is that what you did? | 19:09 |
greghaynes | also -> lunch | 19:09 |
fungi | huh, so we did eventually get our dib uploads, they just started a couple hours later today than yesterday http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=982&rra_id=all | 19:10 |
fungi | mordred: ^ | 19:10 |
mgagne | I think I tried cmd = str(...) and it didn't worked. I cast everything above with str(). will have to test again to make sure | 19:10 |
mgagne | and I would really like to know what happened since yesterday | 19:10 |
*** SumitNaiksatam has quit IRC | 19:10 | |
*** SumitNaiksatam_ is now known as SumitNaiksatam | 19:10 | |
openstackgerrit | Merged openstack-infra/git-review: Update to newer hacking checks https://review.openstack.org/192473 | 19:10 |
mordred | fungi: yes - I agree that we have just started those | 19:11 |
greghaynes | mgagne: If you said youre installing from pip then nothing should be different since then - we havent cut any releases | 19:11 |
fungi | mordred: well, they seem to have ended now and nodepool is building new nodes again | 19:11 |
mgagne | sure, that's why I'm wondering what I did since :-/ | 19:11 |
*** EricGonczer_ has joined #openstack-infra | 19:12 | |
mgagne | maybe I paste a string from the internet which was encoded in UTF-8 and now my whole file is considered UTF-8, I'm not sure | 19:12 |
mordred | fungi: have you looked in the logs to see if we successfully uploaded??? | 19:13 |
fungi | mordred: looking now | 19:13 |
*** dimtruck is now known as zz_dimtruck | 19:14 | |
fungi | mordred: i see devstack-trusty uploads in hpcloud with an age of ~20 minutes | 19:14 |
fungi | that's reported in the image-list, now i'm correlating to the log | 19:14 |
*** sabeen1 has joined #openstack-infra | 19:15 | |
fungi | 2015-06-19 17:55:02,014 INFO nodepool.DiskImageUpdater: Uploading dib image id: 123439 from /opt/nodepool_dib/devstack-trusty-1434723361 for devstack-trusty-1434736502.template.openstack.org in hpcloud-b5 | 19:16 |
fungi | 2015-06-19 18:52:58,124 DEBUG nodepool.DiskImageUpdater: Image id: 123439 saving image 891bf712-579c-4df2-8dd5-471f4e1d15ec | 19:16 |
fungi | 2015-06-19 18:52:58,507 DEBUG nodepool.ProviderManager: Status of image in hpcloud-b5 891bf712-579c-4df2-8dd5-471f4e1d15ec: ACTIVE | 19:16 |
fungi | looks like that was successful | 19:17 |
mordred | awesome | 19:17 |
*** mmedvede has joined #openstack-infra | 19:17 | |
mordred | any rax hits? | 19:17 |
openstackgerrit | Daneyon Hansen proposed openstack-infra/irc-meetings: Add meeting for Magnum Networking Subgroup https://review.openstack.org/193694 | 19:17 |
fungi | are we dib-ing anything into rax yet? ubuntu-trusty images yeah? | 19:17 |
*** sabeen2 has joined #openstack-infra | 19:17 | |
mordred | yeah | 19:18 |
pleia2 | we're in friday afternoon no meeting time, if anyone wants to look at some channel logging reviews we have piling up: https://review.openstack.org/#/c/161106/ https://review.openstack.org/#/c/187492/ https://review.openstack.org/#/c/190691/ https://review.openstack.org/#/c/193643/ | 19:18 |
fungi | there are ubuntu-trusty images in rax (supposedly) for the past 4.5 hours | 19:18 |
fungi | that seems incongruous with the upload times for hpcloud | 19:18 |
*** hashar has joined #openstack-infra | 19:18 | |
mordred | yah | 19:18 |
fungi | the same images were uploaded to hpcloud 20 minutes ago | 19:19 |
mgagne | muhaha, found it! | 19:19 |
*** sdake_ has quit IRC | 19:19 | |
*** sabeen1 has quit IRC | 19:20 | |
*** bradjones has quit IRC | 19:20 | |
mgagne | execve() arg 3 -> http://linux.die.net/man/2/execve int main(int argc, char *argv[], char *envp[]) | 19:20 |
mgagne | envp <- I added a bunch of env variables for the devuser element. One could be considered a boolean by yaml: yes, true, etc. | 19:20 |
fungi | mordred: though in positive news, the only ubuntu-trusty images reported in rax are from today, so that implies some change in the right direction | 19:20 |
*** mrmartin has joined #openstack-infra | 19:20 | |
mgagne | greghaynes: so I think the correct fix would be to cast all environment variable to str() | 19:21 |
*** achanda has quit IRC | 19:21 | |
greghaynes | ahh | 19:21 |
greghaynes | yes, Ill abandon my patch | 19:21 |
mgagne | that's why str(cmd) didn't work | 19:22 |
mgagne | but I also included env variables when I tried to cast everything | 19:22 |
*** hdd has joined #openstack-infra | 19:22 | |
*** bradjones has joined #openstack-infra | 19:22 | |
*** bradjones has quit IRC | 19:22 | |
*** bradjones has joined #openstack-infra | 19:22 | |
mordred | fungi: Last Modified: Fri, 19 Jun 2015 14:22:33 GMT | 19:23 |
openstackgerrit | Chris Burroughs proposed openstack-infra/jenkins-job-builder: support sparse/polling path git plugin settings https://review.openstack.org/193696 | 19:23 |
mordred | fungi: I show that the image uploaded to swift with that as a timestamp | 19:24 |
mordred | fungi: also, the glance and swift images withteh same name have the same metadata md5 and sha256 | 19:24 |
mordred | so that's nice | 19:24 |
fungi | mordred: excellent. i wonder why the 4-hour time skew | 19:24 |
*** cburroughs has joined #openstack-infra | 19:25 | |
mgagne | "Password auth exception. Try number 14..." would be great to know which node is tried ^^' | 19:25 |
mordred | fungi: hrm. I wonder if the timezone is off on those swift servers | 19:25 |
fungi | we did have two spikes today, 4 hours apart, the first higher but finished more quickly | 19:25 |
*** kgiusti has left #openstack-infra | 19:25 | |
openstackgerrit | Merged openstack-infra/git-review: Fix H238 violation and enable check for that rule https://review.openstack.org/192477 | 19:26 |
fungi | mordred: so i think that nodepool uploaded diskimages into rax shortly after the 14:14 start time, basically first thing, then did other stuff for 4 hours, then uploaded into hpcloud | 19:27 |
*** achanda has joined #openstack-infra | 19:27 | |
fungi | it's conceivable with a warm cache that the ubuntu-trusty image build, since there's so little to it, would happen very quickly | 19:27 |
fungi | and that's the only one we're dib'ing in rax currently | 19:27 |
*** Sukhdev has joined #openstack-infra | 19:28 | |
mordred | yah | 19:28 |
fungi | also i deleted the existing ubuntu-trusty nodes because they were in hpcloud, and the replacement is now building in rax-iad | 19:28 |
fungi | since ~5 minutes | 19:28 |
fungi | it disappeared :( | 19:29 |
fungi | looking in the logs now | 19:29 |
mordred | 2015-06-19 14:01:12,931 INFO nodepool.DiskImageUpdater: Uploading dib image id: 123352 from /opt/nodepool_dib/ubuntu-trusty-1434291359 for ubuntu-trusty-1434722472.template.openstack.org in rax-dfw | 19:29 |
mordred | 2015-06-19 14:49:23,269 INFO nodepool.DiskImageUpdater: Image ubuntu-trusty-1434722472.template.openstack.org in rax-dfw is ready | 19:29 |
lifeless | mordred: so hu | 19:29 |
mordred | btw | 19:29 |
lifeless | erm | 19:29 |
lifeless | hi | 19:29 |
fungi | mordred: raise LaunchNetworkException("Unable to find public IP of server") | 19:29 |
lifeless | actually nvm, I was going to ask for a silly thing because I'm impatient. I'll just do it Monday. | 19:29 |
*** mriedem has quit IRC | 19:30 | |
* mordred hands lifeless a lovely saturday morning | 19:30 | |
fungi | lifeless: greetings over there in the future. how's the weekend | 19:30 |
*** otter768 has joined #openstack-infra | 19:30 | |
mordred | fungi: yah - I think that's what greghaynes may have been working on yesterday | 19:30 |
lifeless | fungi: dark and early :) | 19:30 |
fungi | heh | 19:30 |
lifeless | seriously. pitch black outside - mid winter 730 | 19:30 |
*** marcusvrn has quit IRC | 19:31 | |
fungi | lifeless: clearly you're wrong. i'm looking out the door and it's a bright, sunny summer day | 19:31 |
fungi | we can't both be right | 19:31 |
fungi | mordred: so anyway, we _can_ dib into rax now, but we can't boot the result (yet) | 19:31 |
fungi | so, anyway, yay progress! | 19:32 |
openstackgerrit | yolanda.robla proposed openstack-infra/nodepool: Allow to delete nodes with missing target or provider https://review.openstack.org/192629 | 19:32 |
greghaynes | mordred: fungi: yep, poking at that | 19:32 |
mordred | fungi: it's SO MUCH PROGRESS | 19:33 |
greghaynes | fungi: it boots, just no networking | 19:33 |
mordred | fungi: now all we have to do is fix an element | 19:33 |
fungi | so much progress it all over yuo screen | 19:33 |
fungi | and mine too | 19:33 |
* jeblair lunches | 19:33 | |
fungi | i'm going back to doc sprinting if anyone needs me | 19:34 |
*** otter768 has quit IRC | 19:34 | |
mordred | greghaynes: anything I can do to help on that - I feel like I have not been useful in helping to diagnose | 19:35 |
*** _nadya_ has joined #openstack-infra | 19:35 | |
*** _nadya_ has quit IRC | 19:36 | |
greghaynes | mordred: dont think so, although soon I may be throwing some theories your way, have to test a couple thoughts | 19:36 |
mordred | cool | 19:36 |
*** ihrachyshka has joined #openstack-infra | 19:36 | |
greghaynes | mordred: most of the time is just how slow dev cycles are for buil/upload/boot | 19:36 |
*** _nadya_ has joined #openstack-infra | 19:36 | |
openstackgerrit | Merged openstack-infra/git-review: Ignore .eggs cruft https://review.openstack.org/192478 | 19:37 |
*** jtomasek has quit IRC | 19:37 | |
*** jasondotstar has joined #openstack-infra | 19:37 | |
greghaynes | oh, funny bug - I think if we run gean -i eth0, then glean -i eth1 we end up with only eth1 into in e/n/i | 19:37 |
mordred | greghaynes: hrm. maybe it's a race with the event-driven stuff? | 19:38 |
fungi | especially if you ran gean rather than glean for the first one | 19:38 |
greghaynes | yep, thats kind of what I suspect | 19:38 |
*** jasondotstar has quit IRC | 19:38 | |
*** pc_m has quit IRC | 19:38 | |
greghaynes | added a bunch of debug and am respinning | 19:38 |
mordred | woot | 19:39 |
*** jsavak has quit IRC | 19:39 | |
openstackgerrit | Merged openstack-infra/system-config: Add app-catalog-admin mailing list https://review.openstack.org/191478 | 19:39 |
*** jsavak has joined #openstack-infra | 19:39 | |
lifeless | fungi: lets take the mean | 19:40 |
*** EricGonc_ has joined #openstack-infra | 19:41 | |
*** amotoki_ has quit IRC | 19:41 | |
mordred | lifeless: what is the mean of gean and glean? | 19:42 |
greghaynes | glear | 19:42 |
mordred | we need a glear project clearly | 19:42 |
persia | ghchg | 19:42 |
*** puranamr has quit IRC | 19:44 | |
*** puranamr has joined #openstack-infra | 19:45 | |
lifeless | mordred: summer and winter, day and night. | 19:45 |
*** EricGonczer_ has quit IRC | 19:45 | |
*** jasondotstar has joined #openstack-infra | 19:46 | |
*** flepied has joined #openstack-infra | 19:46 | |
*** hashar has quit IRC | 19:46 | |
fungi | mordred: or glare | 19:46 |
mgagne | mordred: we had someone come to an interview and talked about the OpenStack Glare and Redstone projects | 19:46 |
*** jasondotstar has quit IRC | 19:47 | |
fungi | hah | 19:47 |
*** yamahata has joined #openstack-infra | 19:48 | |
*** yamahata has quit IRC | 19:48 | |
*** yamahata has joined #openstack-infra | 19:49 | |
openstackgerrit | Merged openstack-infra/devstack-gate: Add oslo.service to devstack-vm-gate-wrap.sh https://review.openstack.org/186365 | 19:49 |
*** marzif has joined #openstack-infra | 19:49 | |
*** jsavak has quit IRC | 19:50 | |
timrc | mgagne, Hope you hired them on the spot. | 19:50 |
mgagne | timrc: so we are the first to contribute to this Glare project | 19:50 |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: don't run dsvm tests on doc only changes https://review.openstack.org/193707 | 19:53 |
timrc | Seriously though... keystone, pbr... whoever is naming these projects has poor taste in beer ;-) | 19:53 |
greghaynes | keystone-lite, even | 19:53 |
sdague | so, anyone want to give me a friday gift and land https://review.openstack.org/193707 so we can land devstack doc patches faster :) | 19:54 |
timrc | We should switch Openstack codenames over to cheap beers... (M)ilwuake's Best, (N)atty Light, (S)chlitz, etc. | 19:54 |
*** jasondotstar has joined #openstack-infra | 19:54 | |
*** puranamr has quit IRC | 19:55 | |
*** puranamr has joined #openstack-infra | 19:55 | |
*** mrmartin has quit IRC | 19:57 | |
anteaya | so if I contribute to Glare to I get sunglasses as a gift? | 20:01 |
anteaya | polarized? | 20:01 |
dimsum__ | Glare and Redstone. whoa | 20:02 |
anteaya | Redstone is a lake close to where I live | 20:03 |
*** achanda has quit IRC | 20:03 | |
*** dustins has quit IRC | 20:04 | |
*** boris-42 has joined #openstack-infra | 20:04 | |
*** mrmartin has joined #openstack-infra | 20:07 | |
*** stevemar has joined #openstack-infra | 20:07 | |
greghaynes | mordred: so whats happening is glean is getting run before the config-drive is findable via blkid | 20:08 |
greghaynes | mordred: so were back in init dependency hell | 20:08 |
mordred | greghaynes: OH GOOD | 20:10 |
*** krtaylor has quit IRC | 20:10 | |
*** peristeri has quit IRC | 20:10 | |
greghaynes | mordred: oh wait, I think im wrong, I put my debug info wrong | 20:11 |
mordred | PHEW | 20:11 |
greghaynes | its telling me no confi drive found but it might actualyl mean the opposite | 20:11 |
*** e0ne has quit IRC | 20:11 | |
*** mrmartin has quit IRC | 20:12 | |
greghaynes | mordred: another bug found though - we depend on openssh-server which isnt in ubuntu-minimal | 20:13 |
*** dan is now known as Guest87808 | 20:14 | |
*** marzif has quit IRC | 20:14 | |
*** dan_ has joined #openstack-infra | 20:14 | |
greghaynes | because we do the dpkg-reconfigure openssh-server with set -e | 20:14 |
sdague | AJaeger, anteaya, fungi - thanks! | 20:14 |
*** dan_ is now known as Guest96299 | 20:14 | |
anteaya | sdague: happy Friday to you | 20:14 |
mordred | greghaynes: heh. well, also - we should definitely put an ssh server on there | 20:16 |
*** sdake has joined #openstack-infra | 20:16 | |
*** sdake_ has joined #openstack-infra | 20:17 | |
anteaya | do we have a server up for hound currently? | 20:17 |
anteaya | I'm guessing kdc01 and 02 are not it | 20:18 |
fungi | anteaya: there's a hound.openstack.org which is up for testing, mentioned in the spec | 20:18 |
anteaya | and I can't browse to them anyway | 20:18 |
anteaya | ah I didn't see it in cacti | 20:18 |
fungi | anteaya: kdc01 and 02 are kerberos domain controllers | 20:18 |
anteaya | didn't check the spec, thanks | 20:19 |
anteaya | ah okay thanks | 20:19 |
fungi | anteaya: er, kerberos key distribution centers, sorry | 20:19 |
*** tonytan4ever has quit IRC | 20:19 | |
openstackgerrit | Merged openstack-infra/project-config: don't run dsvm tests on doc only changes https://review.openstack.org/193707 | 20:20 |
anteaya | np | 20:20 |
anteaya | I would have to look up the difference anyway | 20:20 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Clean up old SSH keys for fungi https://review.openstack.org/193713 | 20:20 |
*** sdake has quit IRC | 20:21 | |
anteaya | taron: something of note, in hound when I search for `git pack ` I still get results with git package though I did specify the whitespace after pack in my entry | 20:21 |
* taron notes | 20:22 | |
anteaya | thanks | 20:22 |
anteaya | and git package is all I am returned | 20:22 |
taron | if I'm going to work on refreshing the config files I might as well hack on the rest of it too | 20:22 |
anteaya | no git pack results at all, regardless of flags | 20:22 |
taron | huh | 20:22 |
mordred | taron, anteaya: I'm not sure what their definition of regex is | 20:23 |
mordred | but I can't seem to get any regexes to work | 20:23 |
mordred | anteaya: I _DO_ get some resulst for git pack with no quotes | 20:23 |
*** tlian2 has joined #openstack-infra | 20:23 | |
anteaya | I didn't use quotes | 20:23 |
anteaya | http://hound.openstack.org/?q=git%20pack&i=nope&files=&repos= | 20:23 |
taron | yeah the results without quotes are all git package it seems | 20:24 |
anteaya | taron: thanks for confirming | 20:24 |
fungi | anteaya: you want git repack | 20:24 |
mordred | this works: http://hound.openstack.org/?q=git.*pack\b.*&i=nope&files=&repos= | 20:24 |
anteaya | ah | 20:24 |
fungi | but yeah | 20:24 |
*** miqui has quit IRC | 20:24 | |
mordred | http://hound.openstack.org/?q=git%20repack\b&i=nope&files=&repos= | 20:24 |
mordred | anteaya: \b is a regex char that says "word boundary" | 20:24 |
mordred | fwiw | 20:24 |
mordred | and yeah - regexes _do_ work when I search for something with hits :) | 20:25 |
taron | my kingdom for consistent regex implementation across languages/tools :| | 20:25 |
mordred | taron: it seems fairly consistent with what I'd expect ... my first tries just weren't actually anything with hits | 20:25 |
* anteaya must attend to the stove for about 10 minutes and will return | 20:25 | |
jeblair | if only there were a, i don't know, "perl compatible regular expression library" that any language could link against and use! | 20:25 |
*** tlian has quit IRC | 20:25 | |
taron | \b seems to be one of the more consistently supported characters | 20:26 |
fungi | anteaya: http://hound.openstack.org/?q=git.*repack&i=nope&files=&repos= manages to get the places i expect to see (system-config, puppet-gerrit, zuul) | 20:26 |
*** prad_ has quit IRC | 20:26 | |
fungi | jeblair: we should invent that and call it pcre | 20:26 |
jeblair | fungi: good name for it! | 20:26 |
taron | heh | 20:26 |
fungi | mainly because we're uninventive people | 20:26 |
fungi | when it comes to names | 20:26 |
mordred | fungi: and then reimplement it in scratch in languages that don't link against C | 20:26 |
mordred | s/in/from/ | 20:27 |
fungi | mordred: sometimes very badly | 20:27 |
fungi | and inconsistently | 20:27 |
* taron uses pcre for everything they can but doesn't know what to do with themself when bits of it are missing | 20:27 | |
fungi | and that brings us up to... today | 20:27 |
taron | yup | 20:27 |
openstackgerrit | Merged openstack-infra/shade: Add Neutron/Nova Floating IP list/search/get https://review.openstack.org/183496 | 20:27 |
* mordred is not sure if taron means "taron" or "pcre" by "it" | 20:28 | |
taron | pcre | 20:28 |
* mordred is not implying that taron misspoke - but rather that choosing to be confused is more fun | 20:28 | |
taron | heh | 20:28 |
taron | this is fair | 20:28 |
jeblair | mordred always choses confusion | 20:28 |
jeblair | i think | 20:28 |
jeblair | maybe? | 20:28 |
jeblair | sometimes | 20:28 |
jeblair | mordred always causes confusion | 20:28 |
mordred | jeblair: I may or may not always, sometimes or never choose confusion or lack thereof | 20:28 |
*** wenlock has quit IRC | 20:29 | |
Clint | seems like a useful strategy | 20:29 |
*** puranamr has quit IRC | 20:29 | |
*** puranamr has joined #openstack-infra | 20:29 | |
* mordred thinks his policy is too clearly stated | 20:29 | |
fungi | mordred embodies the chaos and confusion which underlies the creative process | 20:30 |
*** bswartz has quit IRC | 20:30 | |
*** esker has joined #openstack-infra | 20:30 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet-gnocchi: enable beaker jobs https://review.openstack.org/193715 | 20:30 |
*** marzif has joined #openstack-infra | 20:30 | |
*** rossella_s has quit IRC | 20:30 | |
*** rossella_s has joined #openstack-infra | 20:31 | |
*** julim has quit IRC | 20:31 | |
* mordred underlies the embodiement of confusion and creativity in the chaos process | 20:31 | |
anteaya | mordred fungi thank you for the search queries both were better than mine | 20:32 |
taron | chaos... blood for the blood god? | 20:32 |
fungi | the sacred chao | 20:33 |
Clint | chao of chaos | 20:34 |
fungi | as a member of the golden apple corps, i fully endorse this consistent inconsistency | 20:34 |
mordred | anteaya: fun with regexes is fun | 20:35 |
* taron is fond of regex crosswords | 20:35 | |
mordred | anteaya: hopefully soon you can get mmmpork to mind-meld some perl with you, at which point you'll never quite be the same | 20:35 |
taron | I'm quite bad at them, but they're good practice | 20:36 |
mordred | taron: that sounds wow | 20:36 |
anteaya | mordred: I'm looking forward to it? | 20:36 |
*** zz_dimtruck is now known as dimtruck | 20:36 | |
mordred | anteaya: exactly | 20:36 |
taron | http://regexcrossword.com/ relatedly | 20:36 |
anteaya | wonderful | 20:37 |
*** jasondotstar has quit IRC | 20:37 | |
*** marzif has quit IRC | 20:38 | |
*** mmedvede has quit IRC | 20:38 | |
fungi | oh, and since it's friday, i should partake of no hot dog buns. almost forgot | 20:39 |
openstackgerrit | K Jonathan Harker proposed openstack-infra/project-config: Fix logic error in gate-project-config-projects-yaml https://review.openstack.org/193717 | 20:39 |
mordred | taron: ok. that is entirely too much fun | 20:40 |
taron | :) | 20:40 |
jesusaurus | taron: oh cool | 20:40 |
*** CaptainMorgan is now known as morgan | 20:41 | |
jesusaurus | mordred: fungi: jeblair: I found a lack of test coverage in check_valid_gerrit_projects.py ^^ | 20:41 |
*** _nadya_ has quit IRC | 20:41 | |
*** amotoki_ has joined #openstack-infra | 20:42 | |
*** _nadya_ has joined #openstack-infra | 20:42 | |
*** cburroughs has quit IRC | 20:43 | |
*** dprince has quit IRC | 20:43 | |
fungi | jesusaurus: great catch. i take it that job still succeeds on the current dataset with that fix | 20:43 |
jesusaurus | yep :) | 20:44 |
fungi | ahh, so it does. i see the job has already completed | 20:45 |
fungi | looks like someone added the label check later | 20:45 |
fungi | and missed that they were adding after an unrelated short-circuit | 20:46 |
*** _nadya_ has quit IRC | 20:47 | |
*** amotoki_ has quit IRC | 20:47 | |
*** mrunge has quit IRC | 20:47 | |
*** vnod has quit IRC | 20:47 | |
*** unicell has joined #openstack-infra | 20:47 | |
*** ihrachyshka has quit IRC | 20:47 | |
*** marzif has joined #openstack-infra | 20:51 | |
openstackgerrit | K Jonathan Harker proposed openstack-infra/project-config: Add 'head-reference' as a valid gerrit project label https://review.openstack.org/193721 | 20:51 |
*** tlian2 has quit IRC | 20:51 | |
*** unicell has quit IRC | 20:54 | |
*** rlandy has joined #openstack-infra | 20:56 | |
*** unicell has joined #openstack-infra | 20:57 | |
*** esker has quit IRC | 20:58 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use accessIPv4 if it's there https://review.openstack.org/193569 | 20:58 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add IPv6 to the server information too https://review.openstack.org/193581 | 20:58 |
SpamapS | jeblair: oh interesting, I was just looking through gear and I noticed another thing the ambiguity around unique ids affected. | 21:00 |
*** mjturek1 has quit IRC | 21:00 | |
*** marzif has quit IRC | 21:00 | |
SpamapS | jeblair: In other gearman clients, when you submit a job, they use a hash ring to select which server based on the unique id. | 21:00 |
SpamapS | jeblair: this way if you have coalescing, you are more likely to coalesce only once. | 21:00 |
* anteaya having finished dinner clicks on http://regexcrossword.com/ | 21:02 | |
openstackgerrit | Doug Hellmann proposed openstack-infra/infra-manual: Update gerrit ACL docs to mention library-release https://review.openstack.org/193309 | 21:04 |
*** rfolco has quit IRC | 21:05 | |
*** soren has joined #openstack-infra | 21:08 | |
*** krtaylor has joined #openstack-infra | 21:08 | |
*** mmedvede has joined #openstack-infra | 21:09 | |
openstackgerrit | Merged openstack-infra/project-config: Fix logic error in gate-project-config-projects-yaml https://review.openstack.org/193717 | 21:09 |
*** radez is now known as radez_g0n3 | 21:14 | |
*** tvanderwiel has quit IRC | 21:18 | |
*** hashar has joined #openstack-infra | 21:19 | |
*** bradjones has quit IRC | 21:20 | |
openstackgerrit | Daneyon Hansen proposed openstack-infra/irc-meetings: Add meeting for Magnum Networking Subgroup https://review.openstack.org/193694 | 21:22 |
*** bradjones has joined #openstack-infra | 21:22 | |
*** bradjones has quit IRC | 21:22 | |
*** bradjones has joined #openstack-infra | 21:22 | |
openstackgerrit | Merged openstack/requirements: Fix setup.cfg. https://review.openstack.org/192921 | 21:25 |
*** amitgandhinz has quit IRC | 21:26 | |
*** aysyanne has quit IRC | 21:27 | |
greghaynes | mordred: pretty sure whats happening is just the bug where if we run glean -i <interface> we overwrite existing interface config, and were running eth0, then eth1, eth0 is the public and gets overwritten therefore no networking | 21:27 |
*** Sukhdev has quit IRC | 21:27 | |
greghaynes | mordred: I kind of think we should be using the e/n/i.d rather then e/n/i then this isnt an issue | 21:28 |
*** bswartz has joined #openstack-infra | 21:28 | |
fungi | greghaynes: how is that handled for red hat derivative distros? | 21:29 |
*** tqtran is now known as tqtran_afk | 21:29 | |
greghaynes | fungi: looks like we do per-interface | 21:29 |
greghaynes | er, per-interface files | 21:30 |
fungi | got it, so separate /etc/sysconfig/network-scripts/ifcfg-eth0 et cetera | 21:30 |
*** Rockyg has quit IRC | 21:30 | |
greghaynes | yep | 21:30 |
fungi | so this was already fine for them, just not debian derivatives | 21:31 |
*** otter768 has joined #openstack-infra | 21:31 | |
fungi | that makes sense | 21:31 |
greghaynes | yea, and im guessing what happened is we switched to triggering this init script per-interface rather than once for all interfaces, this bug cropped | 21:31 |
greghaynes | er, this bug cropped up then | 21:31 |
*** dboik has quit IRC | 21:33 | |
waynr | anteaya: great, and I was starting to actually feel productive today | 21:34 |
mordred | greghaynes: cool. let's do ifcfg.d | 21:34 |
anteaya | waynr: ah congratulations? | 21:34 |
waynr | (was being sarcastically appreciative of your link) | 21:35 |
greghaynes | mordred: ya, working on that now | 21:35 |
anteaya | waynr: ah, sarcasm floats right past me, grew up with a household of it | 21:35 |
*** otter768 has quit IRC | 21:35 | |
anteaya | waynr: glad you are appreciative, taron is the original sharer of the link | 21:35 |
mordred | greghaynes: woot. I guess that probably means a change to both glean and the simple-init element (such that simple-init should lay down /e/n/i with the include line in it) | 21:36 |
dhellmann | fungi, mordred : could one of you look at this change to sync requirements into mox3? https://review.openstack.org/#/c/190741/ | 21:36 |
*** tqtran_afk is now known as tqtran | 21:38 | |
greghaynes | mordred: yep | 21:38 |
mordred | dhellmann: +3 | 21:39 |
dhellmann | mordred: ty | 21:39 |
anteaya | mordred: I want you to find a restaurant with a triclinium: https://en.wikipedia.org/wiki/Triclinium | 21:39 |
hashar | lifeless: thanks a ton for diskimage-builder , seems you are one of the early committer :-} | 21:39 |
anteaya | I had been looking up fainting couches and it led me here | 21:39 |
anteaya | mordred: I don't have to be in attendance at the restaurant I just need to know one exists | 21:40 |
*** dboik has joined #openstack-infra | 21:43 | |
*** justchecking has joined #openstack-infra | 21:45 | |
*** ldnunes has quit IRC | 21:46 | |
*** esker has joined #openstack-infra | 21:51 | |
*** stevemar has quit IRC | 21:52 | |
*** dboik has quit IRC | 21:53 | |
*** esker has quit IRC | 21:54 | |
openstackgerrit | Daneyon Hansen proposed openstack-infra/irc-meetings: Add meeting for Magnum Networking Subgroup https://review.openstack.org/193694 | 21:55 |
bknudson | requirements update breaks keystone unit tests -- https://review.openstack.org/#/c/190405/7 | 21:56 |
*** esker has joined #openstack-infra | 21:57 | |
*** marzif has joined #openstack-infra | 21:58 | |
*** soren has quit IRC | 21:58 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/irc-meetings: Update the chair for the Puppet OpenStack meetings https://review.openstack.org/193738 | 21:59 |
*** erlon has quit IRC | 22:00 | |
*** xyang1 has quit IRC | 22:00 | |
*** abitha has quit IRC | 22:03 | |
*** abitha has joined #openstack-infra | 22:03 | |
*** justchecking has quit IRC | 22:04 | |
*** justchecking has joined #openstack-infra | 22:05 | |
*** dimtruck is now known as zz_dimtruck | 22:09 | |
*** marzif has quit IRC | 22:10 | |
*** isq has joined #openstack-infra | 22:11 | |
*** ddieterly has quit IRC | 22:12 | |
*** puranamr has quit IRC | 22:13 | |
*** yamahata has quit IRC | 22:14 | |
*** RichardRaseley has quit IRC | 22:14 | |
*** rlandy has quit IRC | 22:18 | |
*** dimsum__ has quit IRC | 22:19 | |
*** rlandy has joined #openstack-infra | 22:19 | |
*** dimsum__ has joined #openstack-infra | 22:20 | |
*** puranamr has joined #openstack-infra | 22:22 | |
*** puranamr_ has joined #openstack-infra | 22:24 | |
*** puranamr_ has quit IRC | 22:24 | |
*** sdake_ has quit IRC | 22:25 | |
hashar | everyone must have left but. Nodepool more or less works for Wikimedia Fundation !!! https://integration.wikimedia.org/ci/computer/ci-jessie-wikimedia-38/ :-D | 22:26 |
hashar | have a good week-end everone | 22:26 |
*** hdd has quit IRC | 22:27 | |
*** puranamr has quit IRC | 22:27 | |
*** bknudson has quit IRC | 22:30 | |
*** jasondot_ has quit IRC | 22:32 | |
anteaya | hashar: yay | 22:32 |
anteaya | hashar: and to you too | 22:32 |
*** dimsum__ has quit IRC | 22:32 | |
hashar | of course nodepool deleted the slave as soon as I ran a job on it :-} | 22:32 |
anteaya | of course | 22:33 |
anteaya | :) | 22:33 |
jeblair | hashar: it has a habit of doing that. :) and cool! | 22:33 |
anteaya | working as expected | 22:33 |
hashar | overall it was not that hard to install and setup | 22:33 |
anteaya | nice | 22:33 |
hashar | had to understand what OpenStack is and all the related jargon and of course read the doc | 22:33 |
*** marzif has joined #openstack-infra | 22:33 | |
hashar | so kudos guys for supporting unrelated 3rd parties with nice software and docs :-] | 22:34 |
jeblair | hashar: we try to confuse people by writing docs. no one expects that. | 22:35 |
*** EricGonc_ has quit IRC | 22:35 | |
hashar | oh | 22:35 |
hashar | I just amend them as needed | 22:35 |
jeblair | even better :) | 22:35 |
jeblair | fungi: when you have a minute, it looks like we still have 2 ask.o.o servers; do you know if we're ready to delete one? | 22:36 |
jeblair | (for that matter, we also have two review.o.o servers. i bet we could delete one of them as well) | 22:37 |
*** puranamr has joined #openstack-infra | 22:37 | |
*** gyee has quit IRC | 22:39 | |
hashar | happy week-end. | 22:39 |
*** amotoki_ has joined #openstack-infra | 22:43 | |
jeblair | novaclient.exceptions.Forbidden: Policy doesn't allow compute_flavor:create:image_backed to be performed. (HTTP 403) (Request-ID: req-66be769b-2901-4ab0-b263-664ad7a35812) | 22:44 |
*** hashar has quit IRC | 22:45 | |
jeblair | oh that's neat; that happens if you try to use launch-node to create a compute-flavor instance in rax | 22:45 |
*** puranamr has quit IRC | 22:47 | |
openstackgerrit | Merged openstack-infra/system-config: Add jhesketh to infrastructure servers https://review.openstack.org/190879 | 22:47 |
*** amotoki_ has quit IRC | 22:49 | |
openstackgerrit | Merged openstack-infra/system-config: Up the haproxy timeout for git-fe* https://review.openstack.org/192649 | 22:49 |
*** puranamr has joined #openstack-infra | 22:50 | |
*** puranamr has quit IRC | 22:54 | |
*** puranamr has joined #openstack-infra | 22:54 | |
*** hdd has joined #openstack-infra | 22:58 | |
*** SotK has quit IRC | 22:59 | |
*** SotK has joined #openstack-infra | 22:59 | |
*** Swami has quit IRC | 23:00 | |
openstackgerrit | Merged openstack/requirements: sync requirements to mox3 https://review.openstack.org/190741 | 23:03 |
uberjay | asselin: huh, something funny going on for me. changes which have deps on unknown projects are sitting in the queue and not getting executed. see screenshot: http://i.imgur.com/rvnHzfa.png | 23:04 |
*** zigo has quit IRC | 23:05 | |
*** marzif has quit IRC | 23:06 | |
*** ondergetekende has quit IRC | 23:06 | |
*** juggler has quit IRC | 23:06 | |
*** juggler has joined #openstack-infra | 23:06 | |
*** dangers is now known as dangers_away | 23:06 | |
*** puranamr has quit IRC | 23:06 | |
*** zigo has joined #openstack-infra | 23:07 | |
*** ondergetekende has joined #openstack-infra | 23:07 | |
*** taron has quit IRC | 23:07 | |
*** thedodd has quit IRC | 23:08 | |
*** puranamr has joined #openstack-infra | 23:09 | |
*** jgrimm is now known as zz_jgrimm | 23:10 | |
*** juggler has quit IRC | 23:16 | |
*** juggler has joined #openstack-infra | 23:17 | |
*** tbarron has quit IRC | 23:19 | |
*** MarkAtwood has quit IRC | 23:19 | |
*** krtaylor has quit IRC | 23:21 | |
*** eharney has quit IRC | 23:21 | |
*** jlvillal has quit IRC | 23:21 | |
*** ianw has quit IRC | 23:21 | |
*** eharney has joined #openstack-infra | 23:22 | |
*** krtaylor has joined #openstack-infra | 23:22 | |
*** vaidy has quit IRC | 23:25 | |
*** hdd has quit IRC | 23:26 | |
*** isviridov_away has quit IRC | 23:27 | |
anteaya | I always feel so bad standing up | 23:27 |
anteaya | the cat has spend such time to get comfy | 23:27 |
anteaya | and then I stand up and all is lost | 23:27 |
anteaya | :( | 23:27 |
*** esker has quit IRC | 23:28 | |
*** esker has joined #openstack-infra | 23:28 | |
fungi | jeblair: yeah, pretty sure we can delete the review and ask servers which don't match dns at this point. just a sec and i'll get rid of the right ones | 23:29 |
*** fedexo has quit IRC | 23:31 | |
*** otter768 has joined #openstack-infra | 23:32 | |
*** romcheg has left #openstack-infra | 23:32 | |
*** fedexo has joined #openstack-infra | 23:32 | |
fungi | jeblair: all gone! | 23:32 |
*** jlvillal has joined #openstack-infra | 23:33 | |
*** tlian has joined #openstack-infra | 23:33 | |
*** vaidy_ril has joined #openstack-infra | 23:33 | |
*** isviridov_away has joined #openstack-infra | 23:33 | |
*** ianw has joined #openstack-infra | 23:34 | |
*** tbarron has joined #openstack-infra | 23:34 | |
fungi | back to trying to make myself document things on a friday night | 23:36 |
*** otter768 has quit IRC | 23:36 | |
jeblair | fungi: i'm still trying to figure out how to launch a node that boots from a volume :( | 23:37 |
fungi | jeblair: that sounds like friday fun for masochists | 23:38 |
jeblair | fungi: i'm starting to think it involves setting up an ec2 account | 23:38 |
fungi | https://artfulanxiety.files.wordpress.com/2015/06/pdvd_056.jpg | 23:39 |
*** ajmiller has quit IRC | 23:42 | |
*** SumitNaiksatam has quit IRC | 23:45 | |
*** hogepodge has quit IRC | 23:45 | |
*** EricGonczer_ has joined #openstack-infra | 23:46 | |
anteaya | ha ha ha | 23:47 |
*** rlandy has quit IRC | 23:47 | |
fungi | it's the american way | 23:48 |
anteaya | effective in many cases | 23:49 |
anteaya | in canada every business has to have at least three purposes | 23:49 |
anteaya | the dollar store/post office/drycleaners is in the centre of town | 23:49 |
*** taron has joined #openstack-infra | 23:51 | |
*** hemna_ has joined #openstack-infra | 23:52 | |
*** hemna has quit IRC | 23:53 | |
anteaya | cinder channel is fairly quiet right now | 23:56 |
anteaya | I looked to see if someone was about | 23:57 |
*** ZZelle_ has quit IRC | 23:57 | |
*** dannywilson has quit IRC | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!