| *** svarnau_ has joined #openstack-infra | 00:01 | |
| openstackgerrit | A change was merged to openstack-infra/devstack-gate: Add support for large_ops tempest test https://review.openstack.org/43779 | 00:03 |
|---|---|---|
| *** svarnau has quit IRC | 00:04 | |
| openstackgerrit | A change was merged to openstack-infra/config: Run the ceilometerclient tests under PyPy https://review.openstack.org/45336 | 00:05 |
| openstackgerrit | A change was merged to openstack-infra/config: Removes separate Object Storage Admin manual as the content is now in other books. https://review.openstack.org/45333 | 00:05 |
| *** thomasm has quit IRC | 00:05 | |
| mordred | jeblair: any reason you didn't APRV this one: https://review.openstack.org/#/c/45283/ ? | 00:05 |
| clarkb | don't ever give me a real chainsaw there won't be anything left | 00:06 |
| mordred | jeblair: (it looks like a great patch to me, but I wanted to make sure there wasn't a larger consideration)_ | 00:06 |
| openstackgerrit | A change was merged to openstack-infra/config: Add python 3.3 and pypy checks to ironicclient https://review.openstack.org/45327 | 00:06 |
| mordred | omg. https://review.openstack.org/#/c/45023/ wins the prize for using the word 'gerunds' in a commit message | 00:07 |
| openstackgerrit | A change was merged to openstack-infra/config: Gerrit sysadmin tips for account repairs/renaming https://review.openstack.org/44912 | 00:10 |
| *** Ryan_Lane has quit IRC | 00:11 | |
| *** Ryan_Lane has joined #openstack-infra | 00:11 | |
| openstackgerrit | A change was merged to openstack-infra/config: Enable translation jobs for the savanna project https://review.openstack.org/44213 | 00:15 |
| *** pcrews has joined #openstack-infra | 00:23 | |
| jeblair | mordred: it changes a job i don't have time to babysit | 00:27 |
| mordred | jeblair: nod | 00:29 |
| *** Ryan_Lane has quit IRC | 00:32 | |
| *** dkliban has joined #openstack-infra | 00:34 | |
| *** UtahDave has quit IRC | 00:34 | |
| jeblair | mordred: https://jenkins02.openstack.org/view/All/job/gate-tempest-devstack-vm-iad-trial/1/ took 30 mins | 00:37 |
| jeblair | er 36 mins | 00:38 |
| mordred | jeblair: the current norm has dropped below that, hasn't it? | 00:38 |
| jeblair | current runs on hp are taking 25 mins | 00:38 |
| jeblair | mordred: so about 1.4 times the hp time | 00:38 |
| mordred | which is roughly what the speed difference was before, wasn't it? | 00:39 |
| jeblair | mordred: i think we saw up to 2x, but yeah, i think about 1.5 was pretty common | 00:39 |
| jeblair | mordred: we should add dfw and ord in the same manner and benchmark them as well | 00:39 |
| mordred | jeblair: agree | 00:39 |
| jeblair | so we're not just going on memory | 00:39 |
| clarkb | ++ | 00:46 |
| clarkb | mordred: jeblair: also with testr tempest ~36 minutes may be acceptable if we need that extra capacity | 00:46 |
| mordred | good point | 00:46 |
| *** reed_ is now known as reed | 00:46 | |
| *** reed has joined #openstack-infra | 00:46 | |
| *** svarnau has joined #openstack-infra | 00:46 | |
| mordred | 10 minutes is not nearly as bad a hit at 30 minutes when the test run 1 hours and 1.5 hours | 00:46 |
| clarkb | so I have really taken a chainsaw to the etherpad manifests | 00:47 |
| clarkb | This is definitely not going to be backward compat | 00:48 |
| *** svarnau_ has quit IRC | 00:48 | |
| *** darraghb has joined #openstack-infra | 00:48 | |
| clarkb | but I think it will amke what sdague has done easier | 00:48 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Add test jobs for RAX DFW and ORD regions https://review.openstack.org/45358 | 00:48 |
| mordred | jeblair, clarkb: ^^ | 00:48 |
| darraghb | query on writing the param documentation for JJB: should current plugin defaults that are not explicitly set by JJB be noted or just skipped and marked as optional? | 00:49 |
| * mordred not sure | 00:49 | |
| mordred | darraghb: how's australia? | 00:49 |
| darraghb | mordred: getting warmer, was 31C yesterday :) bit too warm to go running in the afternoons though | 00:50 |
| mordred | darraghb: heh. yeah, I'll bet! | 00:50 |
| darraghb | query above is in regards to: https://review.openstack.org/#/c/45165/1/jenkins_jobs/modules/scm.py | 00:51 |
| mordred | jeblair: ^^ opinion from you? | 00:52 |
| darraghb | Not sure whether to only specify as defaults what the JJB code specifies and mark others as optional, or note the current plugin defaults as well if not set by the yaml | 00:53 |
| *** nosnos has joined #openstack-infra | 00:53 | |
| *** dina_belova has joined #openstack-infra | 00:54 | |
| darraghb | mordred: rewritting the threading code sometime today since I spotted that there is now a delete-all option that could benefit from using similar code, should have sometime up today | 00:54 |
| *** gyee has quit IRC | 00:54 | |
| *** rfolco has joined #openstack-infra | 00:57 | |
| *** dina_belova has quit IRC | 00:58 | |
| *** michchap has joined #openstack-infra | 00:59 | |
| *** ryanpetrello has joined #openstack-infra | 01:00 | |
| *** ryanpetrello has quit IRC | 01:07 | |
| *** changbl has joined #openstack-infra | 01:08 | |
| pabelanger | jeblair, nodepool is licensed under apache 2.0? | 01:13 |
| *** rfolco has quit IRC | 01:14 | |
| *** yongli_going_hom is now known as yongli | 01:19 | |
| *** ryanpetrello has joined #openstack-infra | 01:25 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Update etherpad and etherpad puppet manifests. https://review.openstack.org/45360 | 01:26 |
| *** krtaylor has quit IRC | 01:28 | |
| *** dkehn has quit IRC | 01:30 | |
| *** marun has quit IRC | 01:33 | |
| *** dkehn has joined #openstack-infra | 01:35 | |
| *** svarnau has quit IRC | 01:37 | |
| *** ericw has joined #openstack-infra | 01:44 | |
| *** dims has quit IRC | 01:45 | |
| *** dina_belova has joined #openstack-infra | 01:54 | |
| *** lnxnut has joined #openstack-infra | 01:55 | |
| openstackgerrit | Darragh Bailey proposed a change to openstack-infra/jenkins-job-builder: Add repo scm https://review.openstack.org/45165 | 01:55 |
| *** ryanpetrello has quit IRC | 01:56 | |
| *** sdake_ has quit IRC | 01:56 | |
| *** dina_belova has quit IRC | 01:58 | |
| *** sarob_ has joined #openstack-infra | 01:59 | |
| *** sarob has quit IRC | 01:59 | |
| *** ryanpetrello has joined #openstack-infra | 02:01 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Update etherpad and etherpad puppet manifests. https://review.openstack.org/45360 | 02:03 |
| clarkb | our apache rewrite rules are not working with new etherpad, other than that ^ seems to work | 02:03 |
| openstackgerrit | Darragh Bailey proposed a change to openstack-infra/jenkins-job-builder: Add repo scm https://review.openstack.org/45165 | 02:03 |
| clarkb | oh the database user stuff for root@::1 seems to break on hosts without ipv6 which is annoying | 02:04 |
| *** ericw has quit IRC | 02:05 | |
| *** nati_ueno has quit IRC | 02:05 | |
| *** yaguang has joined #openstack-infra | 02:13 | |
| *** rcleere has joined #openstack-infra | 02:15 | |
| *** reed has quit IRC | 02:18 | |
| *** fifieldt has quit IRC | 02:19 | |
| *** sarob_ has quit IRC | 02:20 | |
| *** sarob has joined #openstack-infra | 02:20 | |
| openstackgerrit | Kui Shi proposed a change to openstack/requirements: Unpin WebTest version in global-requirements.txt https://review.openstack.org/44773 | 02:21 |
| *** ryanpetrello has quit IRC | 02:27 | |
| clarkb | success! and i have imports working but not exports | 02:27 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Update etherpad and etherpad puppet manifests. https://review.openstack.org/45360 | 02:32 |
| *** xchu has joined #openstack-infra | 02:35 | |
| *** yaguang has quit IRC | 02:40 | |
| *** ericw has joined #openstack-infra | 02:42 | |
| clarkb | huh | 02:44 |
| clarkb | my test vm in hpcloud land can't talk to review.openstack.org right now | 02:45 |
| *** ericw has quit IRC | 02:45 | |
| clarkb | at least not over http | 02:45 |
| clarkb | for whatever reason my local test vm decided to stop trusting review.o.o | 02:53 |
| *** pmoosh has joined #openstack-infra | 02:54 | |
| *** dina_belova has joined #openstack-infra | 02:55 | |
| clarkb | something to be aware of if our d-g nodes in hp land start failing | 02:55 |
| clarkb | hmm works as root but not the ubuntu user, so confused | 02:58 |
| *** mriedem has quit IRC | 02:59 | |
| *** yaguang has joined #openstack-infra | 02:59 | |
| *** dina_belova has quit IRC | 02:59 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Update etherpad and etherpad puppet manifests. https://review.openstack.org/45360 | 03:09 |
| clarkb | well now I feel silly latest patchset fixes the cert issue | 03:09 |
| *** jhesketh has joined #openstack-infra | 03:18 | |
| *** dims has joined #openstack-infra | 03:22 | |
| *** pcrews has quit IRC | 03:36 | |
| *** xchu has quit IRC | 03:47 | |
| *** rcleere has quit IRC | 03:54 | |
| *** dina_belova has joined #openstack-infra | 03:55 | |
| *** sandywalsh has quit IRC | 03:56 | |
| *** dina_belova has quit IRC | 04:00 | |
| *** vogxn has joined #openstack-infra | 04:00 | |
| *** nati_ueno has joined #openstack-infra | 04:01 | |
| *** pcrews has joined #openstack-infra | 04:05 | |
| *** lnxnut has quit IRC | 04:15 | |
| *** yaguang has quit IRC | 04:17 | |
| *** xchu has joined #openstack-infra | 04:18 | |
| *** yongli has quit IRC | 04:20 | |
| *** jhesketh_ has quit IRC | 04:24 | |
| *** xchu has quit IRC | 04:25 | |
| *** jhesketh_ has joined #openstack-infra | 04:25 | |
| openstackgerrit | Darragh Bailey proposed a change to openstack-infra/jenkins-job-builder: Use threads to update jobs in jenkins https://review.openstack.org/45371 | 04:26 |
| *** yaguang has joined #openstack-infra | 04:34 | |
| *** sandywalsh has joined #openstack-infra | 04:39 | |
| *** xchu has joined #openstack-infra | 04:42 | |
| *** amotoki has joined #openstack-infra | 04:45 | |
| *** jergerber has joined #openstack-infra | 04:49 | |
| *** dina_belova has joined #openstack-infra | 04:56 | |
| *** nati_uen_ has joined #openstack-infra | 04:57 | |
| *** sarob has quit IRC | 04:57 | |
| *** sarob has joined #openstack-infra | 04:57 | |
| *** dina_belova has quit IRC | 04:58 | |
| *** dina_bel_ has joined #openstack-infra | 04:58 | |
| *** dina_bel_ has quit IRC | 04:58 | |
| *** yongli has joined #openstack-infra | 04:59 | |
| *** sarob has quit IRC | 05:02 | |
| *** pcrews has quit IRC | 05:09 | |
| *** sarob has joined #openstack-infra | 05:11 | |
| *** pmoosh has quit IRC | 05:15 | |
| *** sarob has quit IRC | 05:16 | |
| *** Ryan_Lane has joined #openstack-infra | 05:20 | |
| *** xchu has quit IRC | 05:31 | |
| *** nati_ueno has quit IRC | 05:33 | |
| *** nati_ueno has joined #openstack-infra | 05:34 | |
| *** nicedice_ has quit IRC | 05:36 | |
| *** xchu has joined #openstack-infra | 05:43 | |
| *** pblaho has joined #openstack-infra | 05:49 | |
| *** dina_belova has joined #openstack-infra | 05:59 | |
| *** dina_belova has quit IRC | 06:03 | |
| *** dina_belova has joined #openstack-infra | 06:09 | |
| *** dina_belova has quit IRC | 06:13 | |
| *** odyssey4me has joined #openstack-infra | 06:16 | |
| *** xchu has quit IRC | 06:20 | |
| *** nati_ueno_2 has joined #openstack-infra | 06:21 | |
| *** alexpilotti has quit IRC | 06:22 | |
| *** sarob has joined #openstack-infra | 06:22 | |
| *** nati_ueno has quit IRC | 06:25 | |
| *** sarob has quit IRC | 06:28 | |
| *** xchu has joined #openstack-infra | 06:33 | |
| *** tian has joined #openstack-infra | 06:55 | |
| *** dina_belova has joined #openstack-infra | 07:04 | |
| *** dina_belova has quit IRC | 07:09 | |
| *** vogxn has quit IRC | 07:13 | |
| *** alexpilotti has joined #openstack-infra | 07:13 | |
| *** vogxn has joined #openstack-infra | 07:14 | |
| *** zhiyan1 has joined #openstack-infra | 07:20 | |
| zhiyan1 | fungi: ping | 07:20 |
| *** vogxn has quit IRC | 07:28 | |
| *** dina_belova has joined #openstack-infra | 07:31 | |
| *** jergerber has quit IRC | 07:35 | |
| *** mkerrin has quit IRC | 07:39 | |
| *** nati_uen_ has quit IRC | 07:39 | |
| *** dina_belova has quit IRC | 07:40 | |
| *** dina_belova has joined #openstack-infra | 07:42 | |
| *** mkerrin has joined #openstack-infra | 07:47 | |
| *** jpich has joined #openstack-infra | 07:49 | |
| *** boris-42 has joined #openstack-infra | 07:49 | |
| *** vogxn has joined #openstack-infra | 08:00 | |
| *** xchu has quit IRC | 08:03 | |
| *** dizquierdo has joined #openstack-infra | 08:10 | |
| *** xchu has joined #openstack-infra | 08:16 | |
| *** alexpilotti has quit IRC | 08:17 | |
| *** sld has joined #openstack-infra | 08:18 | |
| *** dina_belova has quit IRC | 08:24 | |
| *** alexpilotti has joined #openstack-infra | 08:26 | |
| *** derekh has joined #openstack-infra | 08:32 | |
| openstackgerrit | Steven Deaton proposed a change to openstack-infra/config: Added 'clean-remote' flag to jenkins jobs for docs site. Added 'clean-remote: true' to all ftp publisher jobs so as to clean out any stale / stagnant documentation files that may be left from prior OpenStack releases. https://review.openstack.org/45395 | 08:32 |
| *** ruhe has joined #openstack-infra | 08:44 | |
| *** Ryan_Lane has quit IRC | 08:47 | |
| *** ruhe has quit IRC | 08:48 | |
| *** dkehn has quit IRC | 08:53 | |
| *** dkehn has joined #openstack-infra | 08:54 | |
| *** ruhe has joined #openstack-infra | 08:59 | |
| *** saschpe has quit IRC | 09:11 | |
| *** xchu has quit IRC | 09:12 | |
| *** dina_belova has joined #openstack-infra | 09:22 | |
| *** sandywalsh has quit IRC | 09:26 | |
| *** alexpilotti has quit IRC | 09:30 | |
| openstackgerrit | Boris Pavlovic proposed a change to openstack-infra/config: Add new project Rally https://review.openstack.org/44952 | 09:30 |
| *** dina_belova has quit IRC | 09:35 | |
| *** CaptTofu has quit IRC | 09:38 | |
| *** CaptTofu has joined #openstack-infra | 09:39 | |
| *** vogxn has quit IRC | 09:42 | |
| *** alexpilotti has joined #openstack-infra | 09:42 | |
| *** CaptTofu has quit IRC | 09:44 | |
| *** yaguang has quit IRC | 09:44 | |
| *** vogxn has joined #openstack-infra | 09:52 | |
| *** alexpilotti_ has joined #openstack-infra | 09:57 | |
| *** dkehn_ has joined #openstack-infra | 09:57 | |
| *** alexpilotti has quit IRC | 10:00 | |
| *** alexpilotti_ is now known as alexpilotti | 10:00 | |
| *** pcm_ has joined #openstack-infra | 10:00 | |
| *** dkehn has quit IRC | 10:00 | |
| *** dina_belova has joined #openstack-infra | 10:03 | |
| *** echohead has quit IRC | 10:09 | |
| *** ruhe has quit IRC | 10:17 | |
| *** ruhe has joined #openstack-infra | 10:20 | |
| *** echohead has joined #openstack-infra | 10:24 | |
| *** darraghb has left #openstack-infra | 10:31 | |
| *** ruhe has quit IRC | 10:32 | |
| *** pcm_ has quit IRC | 10:32 | |
| *** pcm_ has joined #openstack-infra | 10:33 | |
| *** dkehn__ has joined #openstack-infra | 10:35 | |
| *** SergeyLukjanov has joined #openstack-infra | 10:37 | |
| *** vogxn has quit IRC | 10:37 | |
| *** dkehn_ has quit IRC | 10:39 | |
| *** sergmelikyan has joined #openstack-infra | 10:42 | |
| *** sergmelikyan has quit IRC | 10:53 | |
| *** vogxn has joined #openstack-infra | 11:00 | |
| *** dkehn__ has quit IRC | 11:03 | |
| *** dkehn__ has joined #openstack-infra | 11:04 | |
| *** zhiyan1 has quit IRC | 11:06 | |
| *** saschpe_ has joined #openstack-infra | 11:08 | |
| *** ruhe has joined #openstack-infra | 11:17 | |
| *** CaptTofu has joined #openstack-infra | 11:20 | |
| dizquierdo | hi fungi, I've got a doubt related to the review process, I guess you may help me (probably any core reviewer) | 11:23 |
| dizquierdo | the activity-board project is now under openstack-infra and I'm the only core reviewer there | 11:23 |
| dizquierdo | but also probably the only one committing changes there | 11:23 |
| dizquierdo | so, how should I proceed with changes? should I wait for a second reviewer opinion? (I guess I should...) | 11:23 |
| sld | imho, it's always good to get a second set of eyes on things. (not that you asked. ;-) ) | 11:24 |
| dizquierdo | https://review.openstack.org/#/c/45413/ just an example :) | 11:24 |
| dizquierdo | I guess so sld :) | 11:25 |
| sld | not that my +1 matters much, but there you go. | 11:26 |
| dizquierdo | hehe, thanks sld, just learning how this works, thanks ;) | 11:27 |
| sld | i sent something for review, myself, earlier this morning... the hard part is the waiting for a core reviewer to take a look at things. heh | 11:28 |
| *** nosnos has quit IRC | 11:29 | |
| dizquierdo | yep, my doubt was related to that, given that I'm the only core reviewer for that project :S (at least directly assigned, not sure if there are some meta-reviewers for the whole openstack-infra) | 11:29 |
| sld | i don't think it is project-related, per se, but moreso section and group related... for example - there are multiple projects in / under openstack-infra... and I think there is a group of core reviewers that look or can look at all projects in there. | 11:30 |
| sld | yeah....that's what i am thinking. (sorry, didn't read your whole message before I started typing mine. lol) | 11:30 |
| dizquierdo | :) | 11:33 |
| *** vogxn has quit IRC | 11:38 | |
| *** vogxn has joined #openstack-infra | 11:44 | |
| *** dkranz has quit IRC | 11:51 | |
| *** vogxn has quit IRC | 11:56 | |
| *** adalbas has quit IRC | 12:01 | |
| *** anteaya has joined #openstack-infra | 12:04 | |
| *** ruhe has quit IRC | 12:07 | |
| *** ArxCruz has joined #openstack-infra | 12:08 | |
| *** weshay has joined #openstack-infra | 12:09 | |
| *** rfolco has joined #openstack-infra | 12:12 | |
| *** rfolco has quit IRC | 12:13 | |
| *** ruhe has joined #openstack-infra | 12:15 | |
| *** ruhe has quit IRC | 12:16 | |
| *** adalbas has joined #openstack-infra | 12:18 | |
| *** dkehn has joined #openstack-infra | 12:21 | |
| *** dkehn__ has quit IRC | 12:22 | |
| *** thomasm has joined #openstack-infra | 12:23 | |
| *** ruhe has joined #openstack-infra | 12:25 | |
| *** annegentle has quit IRC | 12:27 | |
| openstackgerrit | Peter Liljenberg proposed a change to openstack-infra/jenkins-job-builder: Added support for JaCoCo plugin Publisher https://review.openstack.org/44705 | 12:32 |
| chmouel | friday fun http://openstackreactions.enovance.com/2013/09/when-someone-just-recheck-no-bug-without-actually-reading-the-log/ | 12:33 |
| anteaya | chmouel: nice | 12:42 |
| *** ruhe_ has joined #openstack-infra | 12:42 | |
| lifeless | chmouel: LOL | 12:43 |
| *** ruhe has quit IRC | 12:43 | |
| *** enikanorov-w has joined #openstack-infra | 12:44 | |
| lifeless | chmouel: where do you find all these gifs? | 12:44 |
| anteaya | chmouel is the gif master | 12:45 |
| chmouel | google has filtering by animated images | 12:45 |
| chmouel | but that one is thanks to http://www.reactiongifs.com/ | 12:46 |
| anteaya | if I had to pick a gif I think of when I think of chmouel, this is the gif: http://blog.chmouel.com/2013/04/11/trying-to-be-pylint-compatible/ | 12:46 |
| chmouel | heh | 12:46 |
| *** odyssey4me has quit IRC | 12:47 | |
| *** markmcclain has quit IRC | 12:47 | |
| lifeless | hmm | 12:49 |
| lifeless | wtf are you doing up anteaya ? | 12:49 |
| lifeless | I should go to bed I suspect' | 12:50 |
| anteaya | it is 10 to 9am my time | 12:50 |
| anteaya | time to be at work | 12:50 |
| lifeless | 0050 por moi | 12:50 |
| anteaya | ah ha | 12:50 |
| anteaya | which one of us should be asleep? | 12:50 |
| anteaya | but it is always nice to see you lifeless | 12:51 |
| lifeless | anteaya: ALL OF US | 12:51 |
| anteaya | hey I'm for that | 12:51 |
| anteaya | the gate is empty | 12:52 |
| lifeless | it'ssat morming | 12:52 |
| anteaya | not yet for me | 12:52 |
| lifeless | I'm in the bar, not-exactly-sober working on talks for tomorrow, cursing mordred. | 12:52 |
| anteaya | ha ha ha | 12:52 |
| anteaya | sounds like the perfect kind of Saturday morning activity | 12:52 |
| anteaya | in case anyone was wondering about guitarzan: http://www.youtube.com/watch?v=vLtl5F91w6c | 12:53 |
| anteaya | lifeless: will your presentation be recorded? | 12:54 |
| anteaya | not only do I want to see it, I want to be able to point others to it | 12:54 |
| lifeless | anteaya: yes, it will be | 12:55 |
| anteaya | yay | 12:55 |
| lifeless | anteaya: formy sins | 12:55 |
| anteaya | I don't know that reference but... good? | 12:55 |
| anteaya | foamy sins | 12:55 |
| anteaya | is that like drinking too much beer? | 12:56 |
| lifeless | for | 12:57 |
| lifeless | my | 12:57 |
| lifeless | sins | 12:57 |
| lifeless | -> because I'm a bad bad boy :) | 12:57 |
| anteaya | ah okay, got it | 12:58 |
| anteaya | well you are a bad boy that churns out some code, so you have a few redeeming qualities | 12:58 |
| lifeless | anyhow, 1 beer is too much for me these days. Feed me spirits or cider or wine | 12:58 |
| *** dprince has joined #openstack-infra | 12:58 | |
| anteaya | okay | 12:58 |
| lifeless | speaking of ;) | 12:58 |
| * anteaya writes that down somewhere | 12:58 | |
| anteaya | yeah you did say you were in a bar | 12:59 |
| lifeless | anteaya: hotel one yeah; C and Lynne are asleep upstairs | 12:59 |
| anteaya | oh good, I am glad they are travelling with you on this one | 12:59 |
| anteaya | will they be in seattle too? | 12:59 |
| lifeless | no | 13:00 |
| anteaya | :( | 13:00 |
| lifeless | bit far afield | 13:00 |
| anteaya | guess I am just going to have to come to NZ to meet them then | 13:00 |
| lifeless | you should! | 13:00 |
| anteaya | yeah, would be a long flight | 13:00 |
| lifeless | great skiing | 13:00 |
| lifeless | and stuff | 13:00 |
| anteaya | yay | 13:00 |
| anteaya | now we just have to come up with a plan that mordred will buy so I can go | 13:00 |
| *** annegentle has joined #openstack-infra | 13:01 | |
| anteaya | let's think of some group that will tolerate a presentation by me | 13:01 |
| lifeless | LCA? | 13:01 |
| anteaya | sure | 13:01 |
| anteaya | what can I talk about and are they still accepting proposals? | 13:01 |
| anteaya | i feel like I don't know anything, so it is tough for me to come up with a proposal for a talk | 13:02 |
| lifeless | I don't know and no. | 13:02 |
| lifeless | LCA miniconfs will be looking for talks | 13:02 |
| anteaya | great, is there a url I can stare blankly at | 13:03 |
| anteaya | ideas swimming in my head | 13:03 |
| *** pcm__ has joined #openstack-infra | 13:03 | |
| anteaya | or a url that leads to a page I can stare blankly at | 13:03 |
| lifeless | flamingspork is running a CICD miniconf | 13:03 |
| anteaya | CICD? | 13:03 |
| lifeless | mikal is running an OpenStack miniconfo | 13:03 |
| lifeless | continuous integration/C deployment. | 13:03 |
| anteaya | what channel is flamingspork in? | 13:04 |
| anteaya | ah yay | 13:04 |
| *** pcm__ has quit IRC | 13:04 | |
| lifeless | #drizzle often | 13:04 |
| lifeless | stewart smith | 13:05 |
| lifeless | sometimes known as 'stewart' | 13:05 |
| anteaya | mikal - I would like to speak at LCA - the OpenStack miniconf - how do I apply? | 13:05 |
| *** pcm__ has joined #openstack-infra | 13:05 | |
| lifeless | ok, I need to halt() | 13:05 |
| anteaya | okay thanks | 13:05 |
| lifeless | night, or morning as the case() may be; all. | 13:05 |
| anteaya | don't see flamingspork there yet but I will lurk | 13:05 |
| anteaya | happy sleep lifeless | 13:06 |
| anteaya | and have a great presentation | 13:06 |
| lifeless | he's probably still travelling from the burn. | 13:06 |
| anteaya | ah okay | 13:06 |
| *** pcm_ has quit IRC | 13:06 | |
| *** thomasbiege has joined #openstack-infra | 13:10 | |
| *** dina_belova has quit IRC | 13:11 | |
| sdague | jeblair: so I think I figured out the sparkline flicker thing. because you are wholesale replacing the html, I think you've basically lost all the img geometry, so the solution is going to be to change the way the rewrite goes so you are only replacing the inner html and then doing the src update on the images directly | 13:12 |
| *** markmcclain has joined #openstack-infra | 13:13 | |
| *** ryanpetrello has joined #openstack-infra | 13:18 | |
| *** yaguang has joined #openstack-infra | 13:19 | |
| *** dizquierdo has quit IRC | 13:21 | |
| *** Bada has joined #openstack-infra | 13:22 | |
| *** derekh has quit IRC | 13:23 | |
| *** dims has quit IRC | 13:24 | |
| *** krtaylor has joined #openstack-infra | 13:29 | |
| *** derekh has joined #openstack-infra | 13:30 | |
| anteaya | I found the page talking about miniconfs: http://lca2014.linux.org.au/programme/miniconfs | 13:33 |
| anteaya | the only information I see about speaker selection is this line: The miniconfs are selected as part of the Call for Papers process which was run from June to July 2013. Which indicates to me that I am too late. | 13:34 |
| boris-42 | somebody pls help=) https://review.openstack.org/#/c/44952/ already 2x 2+ (and already 2 times approved..) | 13:35 |
| boris-42 | thankyou=) | 13:36 |
| anteaya | how interesting | 13:37 |
| anteaya | it passed yet didn't merge | 13:38 |
| *** dims has joined #openstack-infra | 13:38 | |
| anteaya | the only thing i could do is post reverify and send it through the gate again | 13:38 |
| anteaya | but I am curious why it passed the gate yet didn't merge | 13:39 |
| anteaya | mind if I wait for more eyes boris-42? they shouldn't be long | 13:39 |
| openstackgerrit | A change was merged to openstack-infra/config: Add new project Rally https://review.openstack.org/44952 | 13:40 |
| boris-42 | I wrote recheck no bug | 13:40 |
| *** prad has joined #openstack-infra | 13:40 | |
| boris-42 | so it pass tests in that cases | 13:40 |
| boris-42 | anteaya ^ | 13:40 |
| anteaya | recheck puts it through the gate queue | 13:40 |
| anteaya | you want reverify | 13:40 |
| boris-42 | I just periodically was typing git review, to check that it still could be merged | 13:40 |
| anteaya | sorry I don't understand | 13:41 |
| anteaya | if you sent another comment to the patch while it was in the gate that could have affected how zuul dealt with it | 13:41 |
| openstackgerrit | Ryan Petrello proposed a change to openstack-infra/config: Add py26 and py33 tests and mirror uploads. https://review.openstack.org/45323 | 13:42 |
| *** dina_belova has joined #openstack-infra | 13:43 | |
| *** eharney has joined #openstack-infra | 13:43 | |
| anteaya | boris-42: I assume you want it merged? | 13:44 |
| *** jhesketh has quit IRC | 13:44 | |
| boris-42 | anteaya it is already merged https://review.openstack.org/#/c/44952/ | 13:44 |
| boris-42 | anteaya but I wan't just to ensure that it could be merged (before pinging cores, so I was calling recheck no bug) | 13:45 |
| anteaya | I'm glad it is merged | 13:45 |
| anteaya | umm, well if you leave a comment with recheck on it, zuul puts it through the check queue | 13:46 |
| boris-42 | yeah | 13:46 |
| anteaya | so patch set 6 passed the check queue twice | 13:47 |
| *** tstevenson has joined #openstack-infra | 13:48 | |
| *** ruhe_ has quit IRC | 13:49 | |
| *** vogxn has joined #openstack-infra | 13:55 | |
| *** burt has joined #openstack-infra | 13:56 | |
| *** jhesketh has joined #openstack-infra | 13:57 | |
| boris-42 | anteaya hmm there is no new project on stack forge is it ok? | 13:57 |
| boris-42 | anteaya https://github.com/stackforge/rally | 13:57 |
| anteaya | well the first thing that has to happen after your patch was merged, is that puppet needs to run | 13:58 |
| anteaya | and puppet runs jobs on a timer, not triggered by event changes | 13:59 |
| anteaya | so we have to wait for the timer to run first | 13:59 |
| boris-42 | anteaya ah I should just wait=) | 13:59 |
| anteaya | then if it doesn't show up, we have to wait for a core to run manage_projects manually | 13:59 |
| anteaya | yes, and keep an eye on it | 13:59 |
| anteaya | if you don't see anything after an hour, come back in and ask | 14:00 |
| boris-42 | oh here is it!=) | 14:00 |
| anteaya | yay | 14:00 |
| boris-42 | niccce | 14:00 |
| boris-42 | finally OpenStack CI=) | 14:00 |
| anteaya | it looks very nice | 14:00 |
| anteaya | congratulations boris-42 | 14:00 |
| boris-42 | anteaya thanks | 14:01 |
| *** pcm_ has joined #openstack-infra | 14:01 | |
| *** pblaho has quit IRC | 14:03 | |
| *** pcm__ has quit IRC | 14:04 | |
| chmouel | somebody knows which options of pip has 'install', '--pre', | 14:04 |
| *** dina_belova has quit IRC | 14:10 | |
| *** dkranz has joined #openstack-infra | 14:11 | |
| mordred | chmouel: uhm | 14:12 |
| chmouel | mordred: seems like 1.4.1 | 14:12 |
| chmouel | ? | 14:12 |
| mordred | chmouel: --pre doesn't exist until 1.4 | 14:12 |
| mordred | yeah | 14:12 |
| chmouel | yeah not 1.4 :) | 14:12 |
| chmouel | but 1.4.1 | 14:12 |
| mordred | ah, neat. I did not realize that | 14:12 |
| mordred | well, then we all want to be on 1.4.1 at least then :) | 14:12 |
| chmouel | yep probably want to change devstack | 14:13 |
| chmouel | install_pip | 14:13 |
| jeblair | mordred: see conversation btwn lifeless and dachary in #jenkins; also https://github.com/ceph/teuthology | 14:14 |
| *** dina_belova has joined #openstack-infra | 14:15 | |
| mordred | jeblair: neat | 14:17 |
| chmouel | mordred: https://review.openstack.org/#/c/45436/ | 14:17 |
| mordred | jeblair: are you thinking teuthology might be an interesting starting point for non-jenkins runners? | 14:19 |
| *** pblaho has joined #openstack-infra | 14:19 | |
| jeblair | mordred: i was indeed thinking that | 14:19 |
| annegentle | clarkb: jeblair: I still don't think Closes-Bug: nnnnnn is workign right for openstack-manuals. | 14:20 |
| annegentle | see https://bugs.launchpad.net/openstack-manuals/+bug/1218375 | 14:20 |
| uvirtbot | Launchpad bug 1218375 in openstack-manuals "wrong network interfaced in docs" [High,Fix released] | 14:20 |
| annegentle | and https://bugs.launchpad.net/openstack-manuals/+bug/1195571 | 14:20 |
| uvirtbot | Launchpad bug 1195571 in openstack-manuals "havana: nova - Editable default quota support" [Medium,Confirmed] | 14:20 |
| annegentle | The commit messages have Closes-Bug: or Closes-bug: | 14:21 |
| annegentle | jeblair: and the email you sent said bug: nnnn should still work as if it is closes-bug | 14:21 |
| jeblair | did i? i thought it acted as Affects? | 14:22 |
| jeblair | (or Related or whatever it is... i haven't actually used it yet) | 14:22 |
| sdague | hmmmm... any idea why this page isn't viewable - https://review.openstack.org/#/c/44639/17/nova/compute/api.py ? | 14:23 |
| jeblair | annegentle: i think we need to make hudson-openstack part of the group that is the bug supervisor for openstack-manuals | 14:23 |
| annegentle | jeblair: http://lists.openstack.org/pipermail/openstack-dev/2013-August/012945.html | 14:23 |
| jeblair | annegentle: which means we need to make a group that is the bug supervisor, since it's just you right now | 14:23 |
| annegentle | jeblair: we can use the openstack-doc-core@lists.launchpad.net | 14:24 |
| annegentle | jeblair: (that was a question not a statement) :) | 14:24 |
| jeblair | annegentle: we usually have a -bugs group, why don't we set openstack-doc-bugs up? | 14:25 |
| *** dina_belova has quit IRC | 14:26 | |
| *** thedodd has joined #openstack-infra | 14:28 | |
| annegentle | jeblair: sure | 14:29 |
| annegentle | jeblair: can I add a group to that group? | 14:30 |
| jeblair | annegentle: ok, all set up now. yes you can | 14:30 |
| annegentle | jeblair: ok done | 14:30 |
| *** markmcclain has quit IRC | 14:31 | |
| jeblair | annegentle: now the script should be able to assign bugs and change their statuses | 14:31 |
| jeblair | sdague: wfm | 14:32 |
| sdague | hmmmm | 14:32 |
| jeblair | sdague: you're comparing patchset 17 to base? | 14:33 |
| chmouel | mordred: how do I get tox to bootstrap pip with 1.4.1 | 14:33 |
| chmouel | it's always trying 1.3.1 | 14:33 |
| mordred | chmouel: you need new tox | 14:33 |
| mordred | chmouel: do you have tox 1.6 yet? | 14:33 |
| chmouel | i have 1.6.1 | 14:34 |
| mordred | hrm. and it's using pip 1.3? | 14:34 |
| mordred | that's really weird | 14:34 |
| mordred | I'll have to poke for a minute | 14:34 |
| *** pentameter has joined #openstack-infra | 14:34 | |
| chmouel | yeah let me grep around if it's not my vm borked | 14:34 |
| mordred | chmouel: aiui, tox 1.6 should bundle/tie in the lastest virtualenv, which itself should bundle in latest setuptools and latest pip | 14:35 |
| mordred | dstufft: ^^ yeah? | 14:35 |
| chmouel | mordred: oh that was the part i forgot | 14:36 |
| chmouel | virtualenv | 14:36 |
| chmouel | i had the one from the distro | 14:36 |
| chmouel | not from whatever pip gives me | 14:36 |
| chmouel | distro==raring | 14:36 |
| mordred | ah. that's probably too old | 14:37 |
| *** vogxn has quit IRC | 14:37 | |
| chmouel | (it used to be more simple with python tests/test_foot.py :) | 14:37 |
| mordred | chmouel: fwiw, after this upgrade of pip/setuptools/virtualenv/tox, I don't forsee needing to do it again, so hopefully the fun we've had with this this cycle will not come back | 14:38 |
| mordred | chmouel: many things used to be more simple :) | 14:38 |
| chmouel | ah nice | 14:38 |
| chmouel | heheh | 14:38 |
| *** alexpilotti has quit IRC | 14:38 | |
| *** weshay has quit IRC | 14:39 | |
| *** zeus has joined #openstack-infra | 14:40 | |
| *** ruhe has joined #openstack-infra | 14:41 | |
| fungi | mordred: jeblair: clarkb: i notice we're using openstack-ci-core and openstack-ci-admins somewhat interchangeably in gerrit acls and group inclusions. both have identical memberships at the moment, but i guess the thought is that core could be more inclusive later. should the acls using -admins currently get switched to use -core instead? | 14:43 |
| *** vogxn has joined #openstack-infra | 14:44 | |
| mordred | fungi: I believe some of that may be hysterical raisins | 14:44 |
| mordred | fungi: I believe one of them was people with launchpad super-admin ability and one of them was ci-core | 14:45 |
| mordred | fungi: but then when the lp auth change happened, I don't think we re-assessed | 14:45 |
| fungi | right, that sounds reasonable. i wonder if we should empty -core and add -admin as included by it, then switch all normal infra project acls to refer to -core instead of -admins | 14:46 |
| jeblair | fungi, mordred: i'd be in favor of changing the acls to use -core | 14:46 |
| mordred | jeblair: ++ | 14:46 |
| mordred | jeblair: perhaps taking the oportunity to make a new group called openstack-infra-core and remove references to ci-core and ci-admins? | 14:47 |
| fungi | mordred: perhaps | 14:47 |
| jeblair | sounds good to me | 14:47 |
| mordred | wow. I just tried to set a lp bug to fix released and got a timeout error | 14:48 |
| fungi | i think i might also like to clean up acls that specify already-default values, and then possibly collapse identical acls to ease future management (we can always break them back out when one needs to be a special snowflake) | 14:48 |
| *** markmcclain has joined #openstack-infra | 14:48 | |
| mordred | fungi: ++ | 14:48 |
| * mordred supports fungi in this endeavor | 14:48 | |
| fungi | mordred: i get timeouts from lp click actions semi-often | 14:49 |
| fungi | also oops error pages | 14:49 |
| *** _TheDodd_ has joined #openstack-infra | 14:49 | |
| mordred | ttx: is storyboard finished yet? | 14:49 |
| ttx | ha ha ha | 14:49 |
| fungi | mordred: particularly bad on bugs with too many bugtasks | 14:49 |
| *** thedodd has quit IRC | 14:49 | |
| * mordred keeps trying to recruit people to work on it... | 14:49 | |
| anteaya | fungi so this might mean that as I gain competence in an area, I can get -core status for that project and improve one project at a time | 14:49 |
| *** dina_belova has joined #openstack-infra | 14:49 | |
| *** sarob has joined #openstack-infra | 14:50 | |
| fungi | anteaya: well, those are projects with their own individual acls/groups in that case (e.g. jjb) | 14:50 |
| *** thedodd has joined #openstack-infra | 14:50 | |
| *** thedodd has quit IRC | 14:50 | |
| openstackgerrit | Alex Gaynor proposed a change to openstack-infra/config: Run the marconiclient tests under PyPy https://review.openstack.org/45440 | 14:50 |
| anteaya | I'm trying to work on storyboard but I also keep getting recruited for other stuff - puppet-dashboard, refstack, owncloud... | 14:50 |
| fungi | great! | 14:50 |
| anteaya | fungi: ah okay, so no | 14:50 |
| * anteaya tries to make progress on puppet-dashboard today | 14:51 | |
| anteaya | oh and asterisk testing in 2 hours | 14:51 |
| fungi | anteaya: no acls/groups are set in stone. if we need to add someone as a core on a particular project it's easy enough to individualize it | 14:51 |
| jeblair | so, given a list of images from python-novaclient, how can i determine if they are "my" images or "system" images? | 14:52 |
| anteaya | oh okay | 14:52 |
| mordred | Alex_Gaynor: you're just running like a beast on pypy on the client libs! | 14:52 |
| anteaya | I'll try to make -core on something easy before Christmas | 14:52 |
| jeblair | mordred: any ideas there? ^ | 14:52 |
| fungi | jeblair: i think it can show you which ones are private | 14:52 |
| ttx | mordred: I'll be back full speed on it as soon as I'm out of the tunnel. In 2 months and a half. | 14:52 |
| mordred | Alex_Gaynor: are you trying to get all of them pypy enabled by havana? | 14:52 |
| anteaya | I'm open for suggestions | 14:52 |
| jeblair | fungi: oh, any idea how? | 14:52 |
| Alex_Gaynor | mordred: most of them "just work" out of the box, so my job is more mechanical than exciting | 14:52 |
| fungi | jeblair: i'm looking. came up on a security vulnerability a while back where that wasn't being enforced properly ;) | 14:53 |
| mordred | jeblair: hrm | 14:53 |
| *** _TheDodd_ has quit IRC | 14:53 | |
| jeblair | fungi: that's the best way to learn about new software features. | 14:53 |
| fungi | jeblair: surprisingly, yes | 14:53 |
| *** thedodd has joined #openstack-infra | 14:53 | |
| jeblair | heh, i hear graphite has clustering now. :) | 14:53 |
| ttx | mordred: I would certainly welcome someone who actually knows Django and web UIs to work on it. My blatant ignorance of those things shall soon start to show. | 14:53 |
| mordred | jeblair: I'm not sure | 14:54 |
| Alex_Gaynor | mordred: Possibly, I need to take inventory and see what I skipped so far, I couldn't figure out how to get the keystone tests going, and openstack-client needs PyCrypto which doesn't work | 14:54 |
| mordred | Alex_Gaynor: it needs PyCrypto? when did we start using that? | 14:55 |
| Alex_Gaynor | mordred: :noclue: | 14:55 |
| mordred | Alex_Gaynor: when you say "I couldn't figure out how to get the keystone tests going" do you mean keystone or keystoneclient? and "tox" didn't work? | 14:55 |
| Alex_Gaynor | mordred: keystoneclient | 14:56 |
| fungi | was that pulled in to start providing a certificate authority trust bundle maybe | 14:56 |
| *** thedodd has quit IRC | 14:56 | |
| mordred | Alex_Gaynor: oy | 14:56 |
| fungi | in response to the whole not checking validity on https endpoint certs | 14:56 |
| Alex_Gaynor | mordred: keystoneclient tests fail if I just run `tox` out of the box | 14:56 |
| mordred | Alex_Gaynor: that's quite odd - that's pretty much all we do in the gate | 14:56 |
| Alex_Gaynor | mordred: let me flush the venv and try again | 14:57 |
| Alex_Gaynor | err the .tox that is | 14:57 |
| *** pabelanger has quit IRC | 14:57 | |
| fungi | jeblair: oh, nevermind, it was public vs non-public flavors, not images | 14:58 |
| fungi | though i wonder if nova image-show gives similar parameter details | 14:58 |
| Alex_Gaynor | mordred: http://bpaste.net/show/ZIdH1EHec7356b2dMwja/ | 14:58 |
| Alex_Gaynor | mordred: is there some background server I need running? | 14:58 |
| *** thedodd has joined #openstack-infra | 14:59 | |
| *** sarob has quit IRC | 14:59 | |
| * ttx puts the music on and starts pushing H3 out | 14:59 | |
| mordred | Alex_Gaynor: nope. unittests should be unittests | 14:59 |
| *** sarob has joined #openstack-infra | 14:59 | |
| *** sarob has quit IRC | 15:00 | |
| mordred | fungi, jeblair: nova image-show seems to have a metadata owner field | 15:00 |
| *** sarob has joined #openstack-infra | 15:00 | |
| fungi | mordred: yes, i'm staring at the same right now ;) | 15:00 |
| *** sarob has joined #openstack-infra | 15:01 | |
| fungi | owner and owner_id, both of which seem to be the same | 15:01 |
| jeblair | mordred: i believe hpcloud has that but rackspace does not | 15:01 |
| mordred | and at least on hp cloud, metadata owner is None for system images | 15:01 |
| mordred | oh joy | 15:01 |
| chmouel | Alex_Gaynor: yeah on keystone the API test for v2 start a background server | 15:01 |
| mordred | wow. that's a win for interop | 15:01 |
| jeblair | mordred: it is also a number for some system images | 15:01 |
| * anteaya pictures ttx dancing around his office | 15:02 | |
| anteaya | in a Hawaiian shirt | 15:02 |
| Alex_Gaynor | chmouel: I guess it doesn't do it correctly? | 15:02 |
| mordred | chmouel: this is keystoneclient | 15:02 |
| fungi | interestingly, owner_id doesn't seem to be displayed for the stuff from hpcloud's global catalog (just owner) | 15:02 |
| chmouel | Alex_Gaynor: ah for keystonesclient i have never were able to run that on my mba | 15:02 |
| Alex_Gaynor | chmouel: encouraging! :) | 15:02 |
| jeblair | fungi, clarkb: rackspace has | metadata image_type | base | | 15:03 |
| mordred | jaypipes: why did you guys think that vendor-defined fields for metadata was a good idea? | 15:03 |
| mordred | jaypipes: I blame you | 15:03 |
| jeblair | and | metadata image_type | snapshot | | 15:03 |
| * chmouel is at the moment fighting with trying to run the keysotne tests even on a vm :-p | 15:03 | |
| mordred | Alex_Gaynor, chmouel: http://paste.openstack.org/show/45919/ | 15:04 |
| mordred | that's me running py27 keystone client tests after removing the .tox dir | 15:04 |
| chmouel | mordred: yeah you running linux you lucky | 15:04 |
| mordred | chmouel: yes. I run the operating system that we develop for | 15:04 |
| jeblair | mordred: any idea how i can find out what my "owner" id is in hpcloud? | 15:04 |
| mordred | jeblair: I'm guessing it's probably your account id, which is show in the management console | 15:04 |
| mordred | jeblair: it might also be in the json returned from keystone in the service catalog, but I'd have to look | 15:05 |
| *** sarob has quit IRC | 15:05 | |
| mordred | now this is fun: | 15:05 |
| mordred | running=${PYTHON:-python} -m subunit.run discover -t ./ ./tests --list | 15:05 |
| mordred | No module named _bsddb | 15:05 |
| mordred | that's in python 2.6 | 15:05 |
| chmouel | mordred: ah | 15:05 |
| chmouel | i got that on macosx | 15:05 |
| chmouel | for a while | 15:05 |
| chmouel | and fixed this morning | 15:05 |
| Alex_Gaynor | mordred: http://bpaste.net/show/hVaMtsD2xBgvZzn2aDlm/ | 15:05 |
| *** UtahDave has joined #openstack-infra | 15:05 | |
| mordred | Alex_Gaynor: that's fantastic | 15:06 |
| jaypipes | mordred: I fought that tooth and nail. | 15:06 |
| ttx | jeblair: I'm getting certificates fail on https://jenkins*.openstack.org | 15:06 |
| ttx | are those self-signed ? | 15:06 |
| mordred | Alex_Gaynor: so, I'm going to blame a difference between osx and linux - probably in a dependent lib? | 15:06 |
| fungi | ttx: those are self-signed/snakeoil | 15:07 |
| *** pblaho has quit IRC | 15:07 | |
| mordred | jaypipes: well, then, I apologize that I did not help you fight more | 15:07 |
| ttx | fungi: do we plan to fix that ? | 15:07 |
| mordred | ttx: no | 15:07 |
| Alex_Gaynor | mordred: are these tests based on mocking http requests with some on disk representation of a response? | 15:07 |
| jaypipes | mordred: I pushed for a tag model... | 15:07 |
| mordred | jaypipes: how about a "this is the metadata you will return, and if you don't like it, tough" model? | 15:07 |
| fungi | ttx: since we're deprecating the intrface and trying to move users/tools away from interfacing with it, there wasn't a lot of reason to buy certs for those | 15:07 |
| mordred | ttx: do you have a use case where you need it? | 15:08 |
| mordred | Alex_Gaynor: looking | 15:08 |
| sdague | mordred: looking at logs in process | 15:08 |
| ttx | mordred: I'm using it to check when -tarball jobs complete | 15:08 |
| Alex_Gaynor | mordred: I don't see any, but want to make sure, my first instinct is case-insensitive FS | 15:08 |
| sdague | I end up having to go to jenkins a lot | 15:08 |
| ttx | (and that they succeeded) | 15:08 |
| chmouel | Alex_Gaynor: must be my lucky day, the keystoneclient tests are running for me on my mba http://pastie.org/8303381 | 15:08 |
| *** sarob has joined #openstack-infra | 15:09 | |
| *** sarob has quit IRC | 15:09 | |
| *** thomasbiege has quit IRC | 15:09 | |
| *** sarob has joined #openstack-infra | 15:09 | |
| mordred | ttx: but I mean is there something you're doing with that which needs a real cert chain? | 15:10 |
| ttx | mordred: not so much... making sure that my tarball information is not MiMed | 15:11 |
| ttx | so publishing cert fingerprints somewhere would work for me as well | 15:12 |
| jeblair | well, the tarball itself isn't even behind https | 15:12 |
| ttx | jeblair: at some point we said we could store its MD5 in the job result, for my script to compare | 15:13 |
| ttx | but I agree it's not the only weak area in the chain at this point | 15:13 |
| jeblair | ah, then you'd have something to verify, certainly. so.... | 15:14 |
| *** thomasbiege has joined #openstack-infra | 15:15 | |
| ttx | jeblair: I should be able to go through the API once I make my script multimaster aware | 15:17 |
| ttx | so that I don't really need the UI | 15:18 |
| *** dina_bel_ has joined #openstack-infra | 15:18 | |
| tstevenson | jeblair: Could you take a look at review 44913 and let me know if I am on the right track? I'll need to make adjustments to the config files in another repo for the bug to be closed. | 15:19 |
| *** vogxn has quit IRC | 15:20 | |
| *** ericw has joined #openstack-infra | 15:21 | |
| jeblair | tstevenson: i'd like clarkb to take a first look at that; i think he wrote that code and knows it the best, so i'd want him to weigh in on the approach. | 15:22 |
| *** dina_belova has quit IRC | 15:22 | |
| *** rnirmal has joined #openstack-infra | 15:22 | |
| jeblair | he should be around here soon | 15:22 |
| tstevenson | jeblair: Thanks. Hoping to celebrate my first merge today. :) | 15:23 |
| *** danger_fo_away is now known as danger_fo | 15:24 | |
| jeblair | mordred, fungi, jaypipes: huh, hpcloud has an image_type field, but for snapshots only; so it looks like "metadata.get('image_type') == 'snapshot'" would work on both hpcloud and rackspace | 15:25 |
| fungi | oh, cool | 15:25 |
| *** thomasbiege has quit IRC | 15:25 | |
| jaypipes | jeblair: on JayCloud, I use image_type = "snappy" | 15:26 |
| pleia2 | phew, quite the scrollback for being out just one day | 15:26 |
| pleia2 | good morning | 15:27 |
| anteaya | morning pleia2 | 15:27 |
| anteaya | UtahDave wanted to stop by and say hello | 15:28 |
| anteaya | he has booked next week to work with us | 15:29 |
| UtahDave | Hey, everyone! | 15:29 |
| anteaya | to see what we can do to get salt really working this time | 15:29 |
| jeblair | hi UtahDave! | 15:29 |
| anteaya | I'll work with him and we will be asking many questions | 15:29 |
| anteaya | he also knows we have bug day next Tuesday and will do his best to help | 15:29 |
| UtahDave | hi, jeblair! | 15:29 |
| anteaya | we just wanted to give everyone a heads up | 15:30 |
| anteaya | in case there are good logs for us to read | 15:30 |
| anteaya | regarding salt | 15:30 |
| UtahDave | Yep | 15:30 |
| anteaya | and good places for us to start | 15:30 |
| jeblair | wed and thurs are the best days for me next week; but hopefully others will be around on other days | 15:31 |
| anteaya | awesome | 15:31 |
| fungi | i'm here all week. don't forget to tip your waiters | 15:31 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/nodepool: Add 'alien-list' command https://review.openstack.org/45448 | 15:32 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/nodepool: Add alien-image-list command https://review.openstack.org/45449 | 15:32 |
| anteaya | heh | 15:32 |
| fungi | UtahDave: though to brace you for what we're seeing, things seem to work fine initially and then after a few days salt starts chewing up all the ram on the master and most minions have hundreds of salt processes running on them and refuse to respond to salt commands any longer | 15:33 |
| *** odyssey4me has joined #openstack-infra | 15:33 | |
| fungi | hopefully this is a familiar failure pattern | 15:34 |
| UtahDave | fungi: what version of Salt was running on that system? | 15:34 |
| fungi | i believe we were installing the debs from salt rather than the ones from ubuntu, and constantly updating them | 15:34 |
| *** pcrews has joined #openstack-infra | 15:34 | |
| UtahDave | fungi: yeah, we did have an issue with that. zmq issue | 15:34 |
| fungi | i know at least recently we updated them all again to deal with the key generation vulnerability (a month or two ago?) | 15:35 |
| Alex_Gaynor | dhellmann: FYI: if you don't have mongodb installed and try to run teh ceilometer tests they don't bail when it tries to start mongo, they just have like 70000 failures of "Cannot connect to localhost:29000" | 15:35 |
| UtahDave | fungi: that's great. | 15:36 |
| fungi | UtahDave: so even with basically current salt releases and newly generated/enrolled keys it was still happening | 15:36 |
| openstackgerrit | Pierre Rognant proposed a change to openstack-infra/jenkins-job-builder: Fix plot plugin support https://review.openstack.org/45280 | 15:36 |
| UtahDave | fungi: What OS was the host? | 15:36 |
| fungi | UtahDave: most of them (including the master) are ubuntu 12.04 lts (precise pangolin) | 15:37 |
| fungi | though some minions are centos 6.4 | 15:37 |
| fungi | all with current updates from their respective distros | 15:38 |
| UtahDave | fungi: Do you know if all the minion's keys were accepted on the master? There was a memory leak issue where unaccepted minions attempting to authenticate with the master would cause zmq to not release ram for each connection | 15:39 |
| *** odyssey4me2 has joined #openstack-infra | 15:39 | |
| *** odyssey4me has quit IRC | 15:40 | |
| mordred | UtahDave: we actually pre-make the keys on the master and then copy them to the minion when we create the minion - so they _should_ all be pre-accepted | 15:40 |
| *** tstevenson has quit IRC | 15:40 | |
| fungi | UtahDave: yeah, they were all accepted. i manually accepted all of them when regenerating the keys, and every machine launched from that point on also auto-accepted the key on the master via the edits you made to the aunch script | 15:40 |
| fungi | er, launch script | 15:40 |
| mordred | UtahDave: https://git.openstack.org/cgit/openstack-infra/config/tree/launch/launch-node.py#n103 | 15:41 |
| mordred | oh. he made edits to that already? cool | 15:41 |
| UtahDave | right. I was just wondering if something went awry with that key generation process | 15:41 |
| fungi | mordred: yep, that's his handywork there | 15:41 |
| *** thedodd has quit IRC | 15:41 | |
| *** thedodd has joined #openstack-infra | 15:42 | |
| fungi | UtahDave: i looked at it the other day when we were pulling it back offline for now, and there was nothing relevant pending | 15:42 |
| *** tstevenson has joined #openstack-infra | 15:42 | |
| UtahDave | ok, good to know | 15:43 |
| fungi | actually, looking back at the list, there was one machine with a key listed in /etc/salt/pki/master/minions_pre which is actually online and hadn't been accepted | 15:44 |
| fungi | so maybe that one was the cause? | 15:44 |
| fungi | would just one unaccepted minion do it? | 15:44 |
| UtahDave | Yeah, if you were running a version of Salt that didn't have the fix, that minion would keep trying to auth. zmq would open a thread for each connection and never release it. | 15:46 |
| *** dina_belova has joined #openstack-infra | 15:46 | |
| *** dina_bel_ has quit IRC | 15:47 | |
| *** swann has quit IRC | 15:47 | |
| *** mrodden has joined #openstack-infra | 15:47 | |
| saper | sip testing soon? | 15:47 |
| boris-42 | morder hi | 15:47 |
| boris-42 | mordred hi one more time | 15:48 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/nodepool: Add a hold command https://review.openstack.org/45453 | 15:48 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/nodepool: Add a delete command https://review.openstack.org/45454 | 15:48 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/nodepool: Add image-delete command https://review.openstack.org/45455 | 15:48 |
| jeblair | saper: 1 hour 10 minutes from now | 15:48 |
| *** markmcclain has quit IRC | 15:48 | |
| *** odyssey4me has joined #openstack-infra | 15:49 | |
| *** pabelanger has joined #openstack-infra | 15:49 | |
| *** dina_belova has quit IRC | 15:49 | |
| *** dina_belova has joined #openstack-infra | 15:49 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/nodepool: Add alien-list command https://review.openstack.org/45448 | 15:50 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/nodepool: Add alien-image-list command https://review.openstack.org/45449 | 15:50 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/nodepool: Add a hold command https://review.openstack.org/45453 | 15:50 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/nodepool: Add a delete command https://review.openstack.org/45454 | 15:50 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/nodepool: Add image-delete command https://review.openstack.org/45455 | 15:50 |
| *** sarob has quit IRC | 15:51 | |
| *** odyssey4me2 has quit IRC | 15:51 | |
| jeblair | nodepool is becoming useful! | 15:51 |
| UtahDave | fungi and mordred: I'm looking over the Salt installation manifests | 15:51 |
| *** ruhe has quit IRC | 15:52 | |
| fungi | UtahDave: cool. well we can pick it up next week when you have time of course | 15:52 |
| fungi | it's not something which needs to be solved asap | 15:52 |
| UtahDave | fungi: That sounds good. | 15:52 |
| *** michchap has quit IRC | 15:53 | |
| boris-42 | mordred should I be already a Rally core? | 15:53 |
| fungi | UtahDave: and as always, we REALLY appreciate your help and input. thanks again! | 15:53 |
| *** odyssey4me has quit IRC | 15:53 | |
| fungi | boris-42: i'll check | 15:53 |
| boris-42 | fungi thank you | 15:53 |
| *** dina_belova has quit IRC | 15:54 | |
| fungi | boris-42: looks like i need to re-run manage-projects. doing that now | 15:54 |
| boris-42 | fungi btw how could I manage core team? | 15:54 |
| fungi | acl didn't get applied yet | 15:54 |
| UtahDave | fungi: so from what I understand, the next step was to set up the Jenkins server so that when the tests pass it can execute a Salt command that would cause the Salt Master to execute a puppet command on all the nodes. Does that sound right? | 15:54 |
| fungi | boris-42: once the acl gets applied the group will automatically be created, empty but self-managed. then i add you as the initial member and you can add others through the gerrit webui (i'll give you the url for it when i add you) | 15:55 |
| *** KennethWilke has joined #openstack-infra | 15:55 | |
| boris-42 | fungy seems that i made nasty thing | 15:55 |
| fungi | boris-42: oh? | 15:55 |
| boris-42 | fungi I thought that I have to add rally-core team | 15:56 |
| boris-42 | fungi https://launchpad.net/~rally-core | 15:56 |
| boris-42 | fungi or this is not connected with acl at all?) | 15:56 |
| fungi | boris-42: oh, no problem. it's just not used by gerrit, but you can use that as your bug triage team in lp or whatever you want | 15:56 |
| mordred | UtahDave: yes, that's the idea | 15:56 |
| mordred | UtahDave: or, rather, not the jenkinsmaster | 15:56 |
| boris-42 | fungi aA ok =) | 15:57 |
| mordred | UtahDave: but the slaves - or something | 15:57 |
| mordred | UtahDave: not sure where the _best_ place to do it is - but something that is not the salt master needs to be able to tell the salt master to tell the minions to run a puppet command | 15:57 |
| fungi | UtahDave: what we discussed more specifically, is that we'll write a jenkins job which runs in zuul's post pipeline whenever a change merges to openstack-infra/config (or other infra projects of interest) and that tells the salt master to have all minions update their puppetry from our puppet master | 15:58 |
| mordred | yes. what fungi said | 15:58 |
| UtahDave | mordred: yeah, we can totally do that. very easy to do. | 15:59 |
| mordred | UtahDave: woot | 15:59 |
| mordred | I like it when things are easy | 15:59 |
| fungi | and i guess also tells the puppet master to update its git clone of the config project too, before telling the minions to check in with it | 15:59 |
| mordred | ++ | 15:59 |
| fungi | but yeah, fairly few involved steps with known triggers | 15:59 |
| mordred | I'd say "hey, master, update yourself" followed by "hey, everybody else, update yourselves" | 15:59 |
| *** Ryan_Lane has joined #openstack-infra | 16:00 | |
| jeblair | mordred: can you update https://review.openstack.org/#/c/45358/1 ? | 16:00 |
| mordred | jeblair: I can | 16:00 |
| fungi | we mainly just need to know that the git pull has completed on the master before telling puppet agent to update on the other systems | 16:00 |
| boris-42 | mordred fungi thanks =) | 16:00 |
| UtahDave | OK, so I'll get a demo of that going here on a simple setup | 16:00 |
| fungi | boris-42: looks like you're the current only member of rally-core, and can manage it via https://review.openstack.org/#/admin/groups/uuid-b809b67b705ecb181cef2e1e68e06cac5c61882b,info | 16:01 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Add test jobs for RAX DFW and ORD regions https://review.openstack.org/45358 | 16:01 |
| UtahDave | then I'm sure I'll have a few questions to make sure it works on the config project | 16:01 |
| boris-42 | fungi thanks for help ) | 16:01 |
| fungi | boris-42: or https://review.openstack.org/#/admin/groups/211,members is a little shorter | 16:02 |
| jeblair | mordred, fungi, clarkb: https://review.openstack.org/#/c/45371/1 | 16:02 |
| jeblair | mordred, fungi, clarkb: that change scares me a little bit; especially since in our experience, jeknins does very poorly when lots of things happen to it at once | 16:02 |
| mordred | jeblair: I believe they're using that in production internally, fwiw, but I haven't read the change yet | 16:02 |
| *** mgagne has joined #openstack-infra | 16:03 | |
| fungi | they is hp? | 16:03 |
| jeblair | mordred: are they doing it with the gearman-plugin with 1200 jobs and 150 slaves? | 16:04 |
| mordred | jeblair: perhaps making MAXTHREADS configurable? | 16:04 |
| jeblair | mordred: yeah, that's what i was thinking | 16:04 |
| fungi | that would be a good compromise | 16:04 |
| mordred | jeblair: I doubt they have gearman plugin and 150 slaves, I _do_ believe they have at least that many jobs | 16:04 |
| UtahDave | so fungi mordred and jeblair: I'll have this ready for next week. | 16:04 |
| *** nicedice_ has joined #openstack-infra | 16:04 | |
| fungi | setting it to 1 would in theory preserve the current behavior | 16:04 |
| mordred | UtahDave: awesome! thakns! | 16:04 |
| fungi | UtahDave: awesome! | 16:04 |
| *** thomasbiege has joined #openstack-infra | 16:05 | |
| mordred | fungi: yeah- and it's possible that something like 5 or 10 might even be acceptable for us - and if it's configurable would be easy enough to test/tune | 16:05 |
| UtahDave | I'll be lurking in here if any of you have any questions or anything | 16:05 |
| jeblair | mordred: (keep in mind a job change for us involves a moderately expensive function set calculation and re-registering the gearman functions, all of which happens inside of a lock) | 16:06 |
| mordred | jeblair: ah yes. good point. | 16:07 |
| *** gyee has joined #openstack-infra | 16:07 | |
| ttx | ok, we are officially done with H3 | 16:08 |
| ttx | get wild :) | 16:08 |
| mordred | so I'd say configurable MAX_THREADS, and perhaps set the default value to 1 so that landing it doesn't bork us, and then folks who want to use multi-thread and just configure the value up | 16:08 |
| * mordred runs around waving his arms in the air and foaming at the mouth | 16:08 | |
| ttx | and celebrate. The amount of load we've seen in the last couple weeks was nothing short of amazing | 16:08 |
| mordred | ++ | 16:08 |
| jeblair | mordred: so to change one job means that g-p grabs a lock, iterates over 150 nodes, for each node, {iterate over 1200 jobs, and re-register}; so the idea of 100 jenkins threads all waiting on that lock could be a lot for us. | 16:08 |
| *** odyssey4me has joined #openstack-infra | 16:08 | |
| jeblair | ttx: yaay! | 16:09 |
| fungi | it looks like passing it in [jenkins] maxThreads already overrides MAXTHREADS so maybe just setting MAXTHREADS=1 would be enough? | 16:09 |
| mordred | hats off to all of the people who were not at burningman | 16:09 |
| fungi | unless i'm misreading the _parallel_exec() method | 16:09 |
| ttx | jeblair: for some reason, bugfixing doesn't seem to create the same kind of load. Go wonder | 16:09 |
| mordred | fungi: oh, nice | 16:09 |
| jeblair | ttx: it will when we have storyboard. everyone is going to love fixing bugs! | 16:10 |
| ttx | jeblair: that's its main feature. It will make you love filing and fixing bugs. | 16:10 |
| fungi | jeblair: i do actually believe bug mnagement will be much more pleasant when i no longer have to touch lp to do it | 16:10 |
| ttx | including flaky neutron gate tests. | 16:11 |
| jeblair | ttx: actually, here's what i've learned -- if storyboard has a status page with lots of little progress bars and stuff, people will look at it all day long! | 16:11 |
| ttx | make it shiny and they will come | 16:11 |
| fungi | that too. widgets keep them coming back for more | 16:11 |
| *** SergeyLukjanov has quit IRC | 16:11 | |
| jeblair | fungi: yes, i agree. i may have been exagerrating, but i wasn't being sarcastic. :) | 16:12 |
| jeblair | i definitely wasn't speeling. | 16:12 |
| * ttx eows before collapsing in a coma | 16:12 | |
| jeblair | ttx: congrats! have a nice coma! | 16:13 |
| ttx | I will! | 16:13 |
| *** svarnau has joined #openstack-infra | 16:13 | |
| jeblair | so, speaking of going crazy; https://review.openstack.org/#/c/45334/ is up for review! :) | 16:14 |
| * anteaya sets up an IV for ttx | 16:14 | |
| fungi | iv beer | 16:15 |
| *** thomasbiege1 has joined #openstack-infra | 16:15 | |
| fungi | jeblair: and passing tests! | 16:15 |
| *** thomasbiege has quit IRC | 16:16 | |
| *** thomasbiege1 has quit IRC | 16:16 | |
| zul | actually ttx really loves cheese so if you give him alot of cheese then he will be soooooooo happpy | 16:19 |
| *** dolphm has joined #openstack-infra | 16:21 | |
| *** pcrews has quit IRC | 16:21 | |
| *** jpich has quit IRC | 16:24 | |
| dolphm | how should developers be installing tox? it's not in openstack/requirements or any test-requirements.txt (yet?) | 16:24 |
| dims | dolphm, i think i found the instruction here - https://wiki.openstack.org/wiki/DependsOnUbuntu | 16:26 |
| clarkb | jeblair: looking | 16:28 |
| dolphm | dims: hmm, i didn't consider that it doesn't need to be inside the environment being tested | 16:29 |
| clarkb | jeblair: perhaps we can default to one thread for safety but give folks the opporunity to use more? | 16:31 |
| clarkb | tstevenson: looking at your change | 16:32 |
| clarkb | tstevenson: any chance you spun the bot up against a gerrit and irc server and watched it run? | 16:34 |
| * anteaya adds ttx's love for cheese to the same card that notes lifeless' penchant for spirits, cider and wine | 16:34 | |
| clarkb | a weekend long coma sounds nice | 16:35 |
| *** markmcclain has joined #openstack-infra | 16:35 | |
| *** changbl has quit IRC | 16:37 | |
| SpamapS | you know what would be a killer feature for git review? git review --tox ... which would run tox on every patch in the series I'm submitting. | 16:40 |
| SpamapS | or just --run=tox | 16:40 |
| *** CaptTofu has quit IRC | 16:42 | |
| *** CaptTofu has joined #openstack-infra | 16:42 | |
| *** Bada has quit IRC | 16:43 | |
| fungi | i'm not positive that belongs in git-review, but should be a pretty easy stand-alone script to write (for each patch not present in origin, repeat this command and stop on any nonzero return code) | 16:45 |
| tstevenson | clarkb: No, unfortunately I do not have access to the gerrit event stream for review.openstack.org. That's the only thing stopping me. | 16:45 |
| fungi | tstevenson: in fact, you do! | 16:45 |
| fungi | tstevenson: anyone can use their gerrit account to watch the event stream, just need to ssh to its api port with your registered ssh key | 16:46 |
| *** CaptTofu has quit IRC | 16:47 | |
| fungi | same socket, protocol and authentication which is used to submit patches for review | 16:47 |
| tstevenson | fungi: tried that. told me shell was disabled. | 16:47 |
| fungi | so if you feed the bot your gerrit account name and your ssh key, it should be able to connect and see events | 16:47 |
| clarkb | tstevenson: port 29418 :) | 16:47 |
| clarkb | tstevenson: overall though I like it, still working through the change, but if tested I could see this merging | 16:48 |
| tstevenson | clarkb: I followed the instructions from http://ci.openstack.org/third_party.html | 16:48 |
| jeblair | tstevenson: or maybe you didn't give it the stream events command | 16:48 |
| jeblair | tstevenson: ssh -p 29418 corvus@review.openstack.org gerrit stream-events | 16:48 |
| tstevenson | jeblair: That may be the case. Will try that. | 16:49 |
| fungi | tstevenson: yeah, if you can submit patches you should be able to see the event stream. it's allowed for all registered users, no special permissions required | 16:50 |
| jeblair | https://etherpad.openstack.org/pbx-testing | 16:50 |
| openstackgerrit | Elizabeth Krumbach Joseph proposed a change to openstack-infra/config: Add git.o.o to list of ssl certificates we monitor https://review.openstack.org/45461 | 16:51 |
| pleia2 | so while looking into this patch, I realized lists.openstack.org isn't https, which is not optimal with list admins dropping their passwords in, do we have plans here? shall I submit a bug report? | 16:52 |
| mordred | jeblair, fungi, clarkb: if you get bored, https://review.openstack.org/#/c/42530/ | 16:53 |
| *** dkehn has quit IRC | 16:53 | |
| fungi | pleia2: it probably ought to be https, but also keep in mind that listadmins use shared passwords and individual subscriber passwords are sent monthly in plaintext e-mail so... poorly-kept secrets at best | 16:54 |
| pleia2 | fungi: fair enough | 16:54 |
| sdague | pleia2: mailman is so terrible on security anyway, passwords are plain text stored, https probably gives people a false sense of security | 16:54 |
| *** dkehn has joined #openstack-infra | 16:54 | |
| sdague | so basically what fungi said :) | 16:54 |
| jeblair | fungi: (i hope we disabled the monthly password reminders) | 16:54 |
| fungi | pleia2: though i still personally support switching it to https with a cert | 16:54 |
| fungi | jeblair: oh, good point, we very well may have | 16:54 |
| fungi | now that i think about it, openstack lists may be the only ones i don't get spammed by on mailman day | 16:55 |
| *** gyee has quit IRC | 16:55 | |
| jeblair | speaking of spam... | 16:55 |
| jeblair | clarkb: your email provider is rejecting cronspam for your account. | 16:56 |
| clarkb | tstevenson: for the dynamic method dispatching was there a reason for that? I am slightly worried about it because the data it "switches" on comes from an external source | 16:56 |
| anteaya | 4 minutes to asterisk | 16:56 |
| clarkb | jeblair: woo, more incentive to use a non gmail MX | 16:56 |
| clarkb | jeblair: I have a fastmail account configured to accept email under my domain, should I go ahead and switch to that now to cut down on your cronspam? (assuming of course that fastmail isn't going to do the same thing) | 16:57 |
| pleia2 | ok, filed a bug for when someone gets bored ;) https://bugs.launchpad.net/openstack-ci/+bug/1221842 | 16:57 |
| uvirtbot | Launchpad bug 1221842 in openstack-ci "Add ssl cert to lists.openstack.org" [Undecided,New] | 16:57 |
| clarkb | this is my halfway step to running a real MX | 16:57 |
| jeblair | clarkb: i don't see why not. | 16:57 |
| jeblair | russellb: ping | 16:59 |
| tstevenson | clarkb: Just thinking if there were any adjustment to types of events handled by gerritbot that there wouldn't be a need to keep adding if statements to handle them. Only an additional method to support the type. | 16:59 |
| jeblair | pabelanger: ping | 16:59 |
| russellb | jeblair: hi! | 16:59 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: link git sha in commit comments to the gerrit review https://review.openstack.org/45464 | 16:59 |
| jeblair | hi! | 16:59 |
| russellb | let's play with phones! | 16:59 |
| jeblair | https://etherpad.openstack.org/pbx-testing | 16:59 |
| jeblair | there is the list of servers i've set up | 16:59 |
| russellb | nice | 16:59 |
| pabelanger | jeblair: pong | 16:59 |
| jeblair | so that's 2, 8, 30 gb of ram each in dfw, ord, and iad rackspace datacenters | 17:00 |
| jesusaurus | clarkb: https://github.com/jedi4ever/logstash-cli | 17:00 |
| jeblair | and then 2,8,30 in hpcloud az1 | 17:00 |
| *** dina_belova has joined #openstack-infra | 17:00 | |
| jeblair | i think that's 2, 4, and 8 vcpus respectively | 17:01 |
| anteaya | https://wiki.openstack.org/wiki/Infrastructure/Conferencing | 17:01 |
| russellb | jeblair: where shall we start? | 17:01 |
| jeblair | i've just restarted asterisk on pbx.o.o (dfw-2) | 17:02 |
| anteaya | I am currently the only person in this conference | 17:02 |
| *** CaptTofu has joined #openstack-infra | 17:02 | |
| jeblair | so how about we dial into that for a baseline | 17:02 |
| jeblair | and then we can try the other vm sizes in dfw | 17:02 |
| russellb | anteaya: is the DID going to work on each? | 17:02 |
| russellb | err, jeblair | 17:02 |
| jeblair | russellb: i'm hoping so, if i only run asterisk on one at a time | 17:03 |
| russellb | yeah, it should then | 17:03 |
| jeblair | russellb: (and when we switch data centers, i expect i'll need to tweak something in the voip.ms gui) | 17:03 |
| russellb | i went ahead and called via SIP ... | 17:03 |
| clarkb | jeblair: that is so awesome | 17:03 |
| clarkb | jesusaurus: ^ | 17:03 |
| jeblair | clarkb, fungi, mordred: want to dial in? | 17:04 |
| jeblair | anyone else: https://wiki.openstack.org/wiki/Infrastructure/Conferencing | 17:04 |
| clarkb | yes doing so now | 17:04 |
| svarnau | i'm in | 17:04 |
| *** dina_belova has quit IRC | 17:05 | |
| * saper joined 6000 | 17:05 | |
| saper | it's only 8000 narrowband? | 17:06 |
| russellb | saper: it supports G.722 | 17:06 |
| * pleia2 dials in too | 17:06 | |
| saper | russellb: does not seem to be offered... | 17:07 |
| clarkb | tstevenson: I think I lean towards not doing dynamic dispatch because it makes me less paranoid | 17:07 |
| russellb | saper: worked for me? | 17:07 |
| *** nati_ueno has joined #openstack-infra | 17:08 | |
| saper | russellb: http://dpaste.com/1368355/ what I get | 17:08 |
| saper | russellb: checking my SIP client and my FreeSWITCH now | 17:09 |
| tstevenson | clarkb: Sounds good. I was able to get access to the stream so I will adjust and test. Thanks! | 17:09 |
| clarkb | tstevenson: great, thank you | 17:09 |
| *** ruhe has joined #openstack-infra | 17:09 | |
| russellb | saper: i called directly via a SIP client and it used G.722 | 17:09 |
| russellb | jeblair: say when | 17:09 |
| svarnau | 6000 again? | 17:09 |
| pabelanger | saper: pb a full sip trace please | 17:10 |
| jeblair | dfw-8 192.237.217.242 | 17:10 |
| jeblair | is up now | 17:10 |
| *** pcrews has joined #openstack-infra | 17:10 | |
| jeblair | and i'm dialed in | 17:10 |
| saper | russellb: how many kHz? | 17:10 |
| russellb | saper: for what, G.722? 16kHz | 17:10 |
| saper | russellb: thx, wasn't enabled on my Android client | 17:11 |
| russellb | ok. | 17:11 |
| anteaya | can anyone hear me? | 17:11 |
| anteaya | i can hear you yes | 17:11 |
| anteaya | I will dial in again | 17:12 |
| saper | russellb: now got G722 8kHz | 17:13 |
| pabelanger | wow | 17:14 |
| pabelanger | that is choppy | 17:14 |
| pabelanger | audio gains to high | 17:14 |
| SpamapS | hrm, why is this review gone? https://review.openstack.org/#/c/43798/ | 17:14 |
| SpamapS | https://bugs.launchpad.net/heat/+bug/1214602 references it | 17:14 |
| uvirtbot | Launchpad bug 1214602 in heat "stack_list loads all resource from the database via the ORM" [Medium,In progress] | 17:14 |
| anteaya | I think my sound problem is related to this laptop | 17:14 |
| clarkb | SpamapS: possibly a draft | 17:15 |
| *** gyee has joined #openstack-infra | 17:15 | |
| anteaya | it doesn't pick up usb sound cards or headsets, so not related to asterisk | 17:15 |
| anteaya | the laptop speakers and mike are what I am using now, so you can hear me using those | 17:15 |
| clarkb | SpamapS: yes status = d in the database | 17:17 |
| jeblair | shutting down dfw-8 | 17:17 |
| SpamapS | clarkb: ah, so it was converted to a draft later (hence the bug ref) ? | 17:17 |
| clarkb | SpamapS: no, I think the gerrit hooks see the drafts, but most other things do not | 17:18 |
| * russellb in | 17:18 | |
| SpamapS | _ah_ | 17:18 |
| jeblair | dfw-30 166.78.186.109 is up | 17:18 |
| russellb | pabelanger: hmm, i think your silence detection idea is a good one ... | 17:19 |
| russellb | pabelanger: after we try out some other servers to see if it makes any difference, i agree that should be the next variable to tweak | 17:19 |
| clarkb | SpamapS: checking for draftiness is something the hook scripts should probably do | 17:19 |
| pabelanger | russellb: Ya, been dealing with it locally actually | 17:19 |
| russellb | oh yeah? | 17:19 |
| pabelanger | and causing choppy audio, because the bandwidth spikes up and down (for me) | 17:20 |
| russellb | pabelanger: bandwidth should be constant in this case | 17:20 |
| pabelanger | Yup | 17:20 |
| * saper 's in | 17:20 | |
| russellb | pabelanger: just an optimization in conference mixing | 17:20 |
| pabelanger | yar | 17:20 |
| SpamapS | clarkb: I think its fine to have it as a draft, it would just be nice if gerrit said "This exists but you can't see it." not "its gone OR you can't see it" | 17:20 |
| saper | can you see 178.33.55.227 connected? | 17:21 |
| jeblair | SpamapS: i would like it if we could just disable drafts because they never work like people expect | 17:21 |
| SpamapS | jeblair: agreed actually, I stopped trying to use them. | 17:21 |
| SpamapS | I'd actually rather have a --wip than a -D | 17:21 |
| SpamapS | as in, just submit it but immediately mark as WIP | 17:22 |
| *** derekh has quit IRC | 17:22 | |
| pabelanger | saper: yes, but your audio is very poor | 17:22 |
| *** reed has joined #openstack-infra | 17:22 | |
| clarkb | we had that but had to revert it | 17:22 |
| clarkb | could probably add it back in | 17:22 |
| saper | pabelanger: not saying anything | 17:22 |
| pabelanger | saper: talk now | 17:22 |
| jeblair | clarkb: except that we might be about to lose wip | 17:22 |
| russellb | i muted saper heh | 17:22 |
| jeblair | from gerrit | 17:22 |
| pabelanger | trolo | 17:22 |
| saper | oh:) | 17:22 |
| russellb | just trying to kill echo | 17:22 |
| clarkb | jeblair: true | 17:22 |
| russellb | you can unmute using *1 | 17:22 |
| russellb | in theory | 17:23 |
| saper | I'm on mobile phone using ear+mic | 17:23 |
| anteaya | in | 17:23 |
| russellb | saper: ah ok | 17:23 |
| saper | on wifi | 17:23 |
| fungi | saper: maybe input gain on the mic? | 17:23 |
| pabelanger | press 7 | 17:24 |
| russellb | hold mic further away perhaps, heh | 17:24 |
| fungi | ahh, actual phone | 17:24 |
| pabelanger | that decreases talk volume | 17:24 |
| pabelanger | dropped | 17:25 |
| russellb | now what | 17:26 |
| pabelanger | have a meeting :) | 17:26 |
| russellb | cya pabelanger | 17:26 |
| *** dina_belova has joined #openstack-infra | 17:26 | |
| russellb | sorry saper muted you again | 17:26 |
| saper | russellb: ok | 17:29 |
| saper | russellb: too much bg noise? | 17:30 |
| russellb | yeah | 17:30 |
| saper | russellb: will try from a narrowband cisco phone, at least wired, not wireless | 17:31 |
| anteaya | saper: and a lot of background noise | 17:31 |
| *** ruhe has quit IRC | 17:32 | |
| anteaya | oh sorry missed the bg in your question | 17:32 |
| *** mkerrin has quit IRC | 17:32 | |
| saper | what's the current IP address? | 17:33 |
| russellb | about to switch | 17:33 |
| jeblair | we're going to iad-2 162.209.98.215 next, but it'll take me a minute since we're switching data centers | 17:34 |
| saper | maybe my kids did too much noise :) | 17:34 |
| anteaya | I have a lower pitched crystal bowl handy now, let me know if you want me to test with it | 17:35 |
| *** dkehn has quit IRC | 17:36 | |
| russellb | jeblair: what makes switching DCs take longer? | 17:36 |
| *** dkehn has joined #openstack-infra | 17:36 | |
| jeblair | russellb: so voip.ms has a a preferred pop for the did; i assume incoming calls would be routed through that pop to our server | 17:37 |
| jeblair | russellb: or do you think they would just use whatever host it registered with? | 17:37 |
| fungi | saper: it seemed there was a combination of background hum/static, echo and the gain was so high that your voice was being overdriven | 17:37 |
| russellb | i guess i don't know for sure, but it should switch as soon as the new host registers | 17:37 |
| * russellb blames freeswitch | 17:37 | |
| russellb | trololo | 17:37 |
| jeblair | russellb: well, just in case, let's wait 60 seconds (which is their propogation time)... | 17:38 |
| russellb | k | 17:39 |
| saper | fungi: interesting | 17:39 |
| jeblair | okay starting asterisk now | 17:39 |
| saper | connected to 6000@162.209.98.215 | 17:40 |
| saper | the only person in this conference | 17:40 |
| fungi | seems to be up | 17:40 |
| *** hemnafk is now known as hemna | 17:40 | |
| *** dkehn has quit IRC | 17:41 | |
| saper | I think that might me wifi | 17:42 |
| *** mdenny has joined #openstack-infra | 17:42 | |
| *** ruhe has joined #openstack-infra | 17:44 | |
| *** nati_ueno_2 has quit IRC | 17:45 | |
| *** nati_ueno_2 has joined #openstack-infra | 17:45 | |
| * saper has a dedicated, almost empty box if we want to test | 17:45 | |
| *** dkehn has joined #openstack-infra | 17:47 | |
| russellb | pbx*CLI> channel originate SIP/6000@162.209.98.215 application Milliwatt | 17:48 |
| pabelanger | and back | 17:48 |
| russellb | pabelanger: ohai | 17:48 |
| *** UtahDave has quit IRC | 17:49 | |
| jeblair | next up: az1-2 15.185.127.85 | 17:49 |
| *** nati_ueno_2 has quit IRC | 17:50 | |
| fungi | saper: might make for an interesting baseline, but i think the bigger issue is proving we can do this with donated cloud virtual resources and have something which is still usable under load | 17:50 |
| fungi | so while a dedicated machine might help prove asterisk or our selected settings are sane, it doesn't help us much beyond that | 17:50 |
| clarkb | we need something like openstack on moonshot providing 1:1 resources | 17:50 |
| clarkb | mordred: ^ you should get on that :) | 17:51 |
| saper | fungi: sure, I think I just setup "open@saper.info", no pin | 17:51 |
| jeblair | starting asterisk now | 17:51 |
| saper | FreeSWITCH plays nice spanish music if you are alone in the conference :) | 17:52 |
| jeblair | saper: are you going to connect? 15.185.127.85 | 17:55 |
| *** vogxn has joined #openstack-infra | 17:55 | |
| saper | jeblair: yep, just configued "az1" extension on my box | 17:56 |
| saper | calling... | 17:56 |
| saper | 2013-09-06 17:57:24.995889 [DEBUG] sofia.c:6282 Channel sofia/external/6000@15.185.127.85 entering state [calling][0] | 17:57 |
| russellb | saper: it's not going to work | 17:58 |
| jeblair | saper: oops, we forgot to fix security groups, so the port is blocked | 17:58 |
| saper | russellb: why? | 17:58 |
| russellb | security group settings | 17:58 |
| *** nicedice_ has quit IRC | 17:58 | |
| *** yaguang has quit IRC | 17:58 | |
| jeblair | saper: clark is going to try to fix it | 17:58 |
| saper | good | 17:58 |
| jeblair | saper: try now | 18:01 |
| *** mrmartin has joined #openstack-infra | 18:01 | |
| saper | I keep being disconnected | 18:03 |
| saper | after ~30 secs or so | 18:04 |
| pabelanger | session timers? | 18:04 |
| russellb | yeah, some sort of SIP timeout | 18:05 |
| russellb | saper: you can try TCP | 18:05 |
| saper | trying again | 18:05 |
| russellb | that'd probably avoid whatever the issue is | 18:05 |
| pabelanger | russellb: tt-monkeys do it! | 18:05 |
| * saper has bass sounds in the background, but I'm muted | 18:05 | |
| russellb | pabelanger: on it | 18:06 |
| saper | checking the disconnect reason | 18:07 |
| russellb | did the conference die? | 18:07 |
| pleia2 | I don't hear anything anymore | 18:07 |
| jeblair | seems like it | 18:07 |
| jeblair | i can't ssh into the host | 18:07 |
| clarkb | same here | 18:07 |
| russellb | server stopped responding | 18:07 |
| russellb | yay | 18:07 |
| clarkb | wow | 18:07 |
| *** dina_belova has quit IRC | 18:07 | |
| russellb | monkeys did it | 18:07 |
| anteaya | my connection is still open | 18:07 |
| pleia2 | hehe | 18:07 |
| anteaya | those monkeys | 18:07 |
| saper | 2013-09-06 18:05:20.625874 [INFO] switch_rtp.c:3579 Auto Changing port from 10.5.203.7 | 18:07 |
| saper | 0:13536 to 15.185.127.85:13536 are you NATTing? | 18:07 |
| anteaya | now my connection is closed, skype closed it | 18:07 |
| clarkb | saper: yes hpcloud is NATing that server | 18:07 |
| russellb | it's the cloud! | 18:08 |
| *** gerritTestMan has joined #openstack-infra | 18:08 | |
| *** gerritTestMan has left #openstack-infra | 18:08 | |
| clarkb | I am still in the web ui for that account should I reboot the server? | 18:08 |
| saper | 2013-09-06 18:05:52.324960 [DEBUG] switch_ivr_bridge.c:501 sofia/external/6000@15.185. | 18:08 |
| saper | 127.85 ending bridge by request from write function | 18:08 |
| saper | that's interesting | 18:08 |
| jeblair | clarkb: yes please | 18:08 |
| anteaya | that was the best sounding connection of the bunch | 18:08 |
| anteaya | so far | 18:08 |
| saper | let me tcpdump it | 18:08 |
| clarkb | rebooting | 18:08 |
| jeblair | the last thing i did before the server died was "tcpdump not port 22 | 18:09 |
| jeblair | i'm not accepting responsibility for killing it though. :) | 18:09 |
| fungi | heh | 18:09 |
| saper | ICMP host 15.185.127.85 unreachable AH :) | 18:09 |
| fungi | yeah, whole server turned itself upside down apparently | 18:10 |
| clarkb | should be up now | 18:10 |
| clarkb | and I have the ocnsole log window open | 18:10 |
| jeblair | russellb, pabelanger: do we need to set any asterisk params to deal with the NAT? it is just straight NAT (not PNAT or anything) | 18:10 |
| pabelanger | I think russellb did something for it already | 18:11 |
| russellb | nat=yes | 18:11 |
| russellb | that's all we should need to do | 18:11 |
| clarkb | there is nothing in the log from when it went sideways | 18:11 |
| russellb | i think | 18:11 |
| fungi | hpcloud doesn't give us a non-translated global address bound directly to the vif i guess | 18:11 |
| saper | the only person @6000 | 18:12 |
| saper | at az1 | 18:12 |
| jeblair | i'm not having a good time using the shell | 18:12 |
| jeblair | i got the last login motd, but i don't have a shell yet | 18:12 |
| clarkb | jeblair: console log doesn't show anything | 18:13 |
| fungi | dns resolvers misconfigured? | 18:13 |
| clarkb | *anything out of the ordinary | 18:13 |
| fungi | oh, motd, so not rdns lookup timing out | 18:13 |
| *** changbl has joined #openstack-infra | 18:13 | |
| jeblair | fungi: well just the "Last login: Fri Sep 6 17:50:35 2013 from" line | 18:14 |
| fungi | maybe local disk i/o starvation trying to update wtmp/utmp | 18:14 |
| jeblair | fungi: nothing past that | 18:14 |
| clarkb | jeblair: I am having similar ssh problems | 18:14 |
| jeblair | fungi: it keeps updating the last login time, so i don't think that's it | 18:14 |
| * saper is in | 18:16 | |
| jeblair | i have a prompt now | 18:16 |
| saper | 30seconds I'm gone | 18:16 |
| jeblair | and now when i log in again, i get one instantly | 18:16 |
| jeblair | that was weird | 18:16 |
| jeblair | ./sip.conf:nat = no | 18:17 |
| jeblair | russellb: so i'll flip that, yeah? | 18:17 |
| russellb | thought i turned it on | 18:17 |
| russellb | check the node specific config | 18:17 |
| clarkb | puppet may have changed it if puppet is running | 18:17 |
| saper | interesting | 18:17 |
| jeblair | ./sip.conf.d/sip.conf:nat=force_rport,comedia | 18:17 |
| russellb | yes that | 18:17 |
| saper | after 30 secs or so I stop getting UDP packets | 18:17 |
| russellb | that's equivalent to nat=yes | 18:17 |
| russellb | nat=yes is old school, heh | 18:17 |
| jeblair | russellb: ok | 18:17 |
| saper | http://dpaste.com/1368419/ | 18:18 |
| saper | after that I get | 18:18 |
| saper | 18:17:14.542590 IP 15.185.127.85.sip > h.saper.info.sip: SIP, length: 430 | 18:18 |
| saper | 18:17:14.548735 IP h.saper.info.sip > 15.185.127.85.sip: SIP, length: 479 | 18:18 |
| jeblair | saper: try again, i have a tcpdump running on az1-2 | 18:19 |
| saper | in | 18:19 |
| fungi | i wonder if hpcloud's translation is simply useless for long-running datagram streams | 18:19 |
| saper | gone 18:20:04.097472 | 18:20 |
| clarkb | fungi: could be, a lot of NAT systems try to treat them as stateful and derp all over them | 18:20 |
| saper | NAT timeout? | 18:20 |
| mordred | clarkb: already working on openstack on moonshot | 18:20 |
| fungi | it's one theory anyway | 18:20 |
| russellb | btw fwiw, all of our calls involve a datagram stream | 18:20 |
| saper | I have no NAT on my SIP box | 18:20 |
| russellb | each call has a separate datagraph stream of audio | 18:20 |
| * mordred on way to airport - sorry not more help | 18:20 | |
| *** adalbas has quit IRC | 18:20 | |
| russellb | datagram.. | 18:21 |
| anteaya | mordred: happy trails | 18:21 |
| clarkb | russellb: I understood | 18:21 |
| fungi | mordred: i need openstack-moonshot-in-a-box for my basement for... um... purely academic purposes | 18:21 |
| saper | in | 18:21 |
| *** vishy is now known as vishious | 18:22 | |
| saper | gone | 18:22 |
| jeblair | http://paste.openstack.org/show/45943/ | 18:22 |
| jeblair | saper: that was the end of your previous call | 18:22 |
| fungi | okay, so not necessarily the nat killing the sockets in that case | 18:22 |
| *** thomasbiege has joined #openstack-infra | 18:22 | |
| pabelanger | jeblair: *CLI> sip set debug | 18:22 |
| pabelanger | err | 18:22 |
| pabelanger | sip set debug on | 18:22 |
| russellb | sip set debug ip <whatever> | 18:22 |
| russellb | so you don't get the whole world | 18:22 |
| pabelanger | that too | 18:22 |
| saper | jeblair: ah, so you keep getting my udp packets? | 18:22 |
| *** jog0 is now known as flashgordon | 18:23 | |
| jeblair | 18:20:01.124858 IP h.saper.info > pbx-az1-2.novalocal: ICMP h.saper.info udp port 28873 unreachable, length 36 | 18:23 |
| jeblair | oh look at that one ^ | 18:23 |
| saper | jeblair: getting those in the middle of the call | 18:23 |
| saper | jeblair: http://dpaste.com/1368436/ | 18:23 |
| *** adalbas has joined #openstack-infra | 18:23 | |
| saper | I hear blurp or something but that ICMP does not disconnect | 18:24 |
| jeblair | saper: can you call in now | 18:24 |
| saper | why it suddenly wants my media port plus one? | 18:24 |
| saper | in | 18:24 |
| jeblair | saper: i'm doing a full packet capture; let me know when you disconnect too | 18:24 |
| pabelanger | asterisk not getting a response back from 200OK | 18:25 |
| saper | done | 18:25 |
| russellb | Retransmitting #7 (NAT) to 178.33.55.229:5060: | 18:25 |
| russellb | it's not getting a response | 18:25 |
| russellb | so asterisk hangs up on you | 18:25 |
| saper | is it an attempt to do some NAT avoidance using another UDP port? | 18:25 |
| russellb | it's all like "yo, i answered your call, ACK ME BRO" | 18:25 |
| pabelanger | http://pastebin.com/gPe6E91h | 18:25 |
| russellb | it's funny though, but it does respond to the BYE | 18:26 |
| fungi | ahh, so it's a control channel timeout causing it to drop the data channel | 18:26 |
| russellb | fungi: yep | 18:26 |
| russellb | he sends INVITE, Asterisk responds with 200 OK (answers the call) ... and retransmits it a bunch of times, meanwhiel the audio stream is up | 18:27 |
| fungi | reminds me of ftp ;) | 18:27 |
| russellb | it eventually gives up, sends BYE, and then receives a 200 OK in response | 18:27 |
| russellb | heh, SIP is a bit of a mess | 18:27 |
| russellb | and that's being nice about it | 18:27 |
| *** thomasbiege has quit IRC | 18:27 | |
| saper | in | 18:28 |
| saper | but why 30 sec? | 18:28 |
| fungi | yeah, i used to support a rather large sip-based shoretel deployment as well as the data circuits and ipsec vpns interconnecting it. troubleshooting was always fun | 18:28 |
| saper | gone | 18:28 |
| russellb | fungi: ooh, sounds fun :) | 18:29 |
| fungi | saper: 30 seconds is presumably how long asterisk waits for a reply on the control channel before deciding your client is dead | 18:29 |
| pabelanger | fungi: saper: correct, timers | 18:29 |
| saper | but we have control channel and media | 18:29 |
| saper | I can hear you guys and maybe you can hear me even | 18:30 |
| pabelanger | saper: you haven't ack'd the call control | 18:30 |
| saper | rly? | 18:30 |
| russellb | yes | 18:30 |
| pabelanger | so, asterisk tears down the call | 18:30 |
| fungi | saper: yeah, the data stream is getting through fine until asterisk decides to drop your call | 18:30 |
| russellb | so back to bridge testing ... | 18:30 |
| russellb | what have we learned? heh | 18:30 |
| saper | but it was not an issue with other hosts we tried | 18:30 |
| clarkb | hpcloud handles PSTN connections really well | 18:31 |
| clarkb | but not sip potentially | 18:31 |
| jeblair | which is weird because they come in over sip | 18:31 |
| fungi | saper: right, i wonder if hpcloud is filtering your response on the control channel for some reason | 18:31 |
| * saper downloads freeswitch.log to post | 18:31 | |
| * russellb blames freeswitch | 18:32 | |
| pabelanger | I can try to debug sip from my home connection later today | 18:32 |
| russellb | :-p | 18:32 |
| pabelanger | will fire up a few clients to see what happens | 18:32 |
| russellb | dropped me as well, | 18:33 |
| fungi | comparing packet captures at both ends, would be curious to see if that particular control channel response is transmitted but never arrives, or whether the 200 ok never gets to saper in the first place | 18:33 |
| saper | full debug dump of a call http://dpaste.com/1368440/ | 18:34 |
| saper | freeswitch is also using mod_sofia | 18:34 |
| russellb | huh | 18:36 |
| openstackgerrit | Anne Gentle proposed a change to openstack-infra/jeepyb: Adds <service>-api to map to openstack-api-site in Launchpad https://review.openstack.org/45324 | 18:36 |
| pabelanger | jeblair: clarkb does this host have IPv6? | 18:37 |
| pabelanger | [2013-09-06 18:36:37.726] WARNING[22748]: chan_sip.c:4174 retrans_pkt: Retransmission timeout reached on transmission e0dfc6139b19ba0faba2cec45b9e642e@0:0:0:0:0:0:0:0 for seqno 1 (Critical Response) -- See https://wiki.asterisk.org/wiki/display/AST/SIP+Retransmissions | 18:37 |
| pabelanger | russellb: that IP is wrong | 18:37 |
| pabelanger | saper: are you using IPv6? | 18:38 |
| russellb | yeah. | 18:38 |
| * russellb gives up for now | 18:38 | |
| clarkb | pabelanger: it does not | 18:38 |
| russellb | we have IPv6 enabled in our configs | 18:38 |
| pabelanger | right | 18:38 |
| pabelanger | maybe try disabling it | 18:38 |
| saper | yes, I have ipv6 | 18:39 |
| russellb | or just setting on rackspace dulles | 18:39 |
| russellb | heh | 18:39 |
| russellb | settle. | 18:39 |
| russellb | rackspace IAD, even the small instance, seemed to work OK | 18:39 |
| russellb | for now | 18:39 |
| saper | and my freeswitch is using it probably | 18:39 |
| pabelanger | well, asterisk could be confusing the IPv6 | 18:39 |
| fungi | lack of ipv6 is a big sticking point for me when it comes to offering public-facing services from hpcloud anyway | 18:40 |
| clarkb | the host does have a link ipv6 address | 18:40 |
| pabelanger | if we don't plan on routing it, we can just disable it in asterisk | 18:40 |
| clarkb | but not a global scope address | 18:40 |
| clarkb | fungi: I think rackspace is one of the few that offer ipv6 | 18:40 |
| clarkb | amazon doesn't even do it | 18:41 |
| clarkb | not to the VM at least I think you can have IPv6 VIPs on their load balancers | 18:41 |
| pabelanger | so, test ipv6 disabled? | 18:41 |
| jeblair | http://paste.openstack.org/show/45947/ | 18:42 |
| clarkb | pabelanger: sure, I have to run now though | 18:42 |
| russellb | yeah me too | 18:42 |
| jeblair | saper: http://paste.openstack.org/show/45947/ | 18:42 |
| pabelanger | saper: try your call again | 18:43 |
| saper | jeblair: seems like NAT to me? | 18:43 |
| saper | roger | 18:43 |
| *** russellb is now known as rustlebee | 18:43 | |
| saper | talking does not help | 18:44 |
| pabelanger | is a routing issue | 18:44 |
| pabelanger | still not ack'ing packet | 18:44 |
| saper | strange | 18:44 |
| saper | checking previous conversations logs | 18:44 |
| *** ruhe has quit IRC | 18:44 | |
| pabelanger | okay, need to stop and start the conference to properly change the bindaddress | 18:45 |
| pabelanger | so, people need to drop for a sec | 18:45 |
| pabelanger | cool? | 18:45 |
| fungi | cool | 18:45 |
| jeblair | pabelanger: yep | 18:45 |
| pabelanger | okay, back | 18:46 |
| tstevenson | clarkb: Having some issue getting my own instance of gerritbot running. When I go to run it and pass my small test config as an argument it just dies silently. Not seeing any activity in the logs as to why. | 18:46 |
| pabelanger | saper: want to try again | 18:47 |
| tstevenson | clarkb: I've added the log_config path to my main gerrit config. Also added that information to the documentation. | 18:49 |
| saper | sure | 18:50 |
| saper | in | 18:50 |
| pabelanger | pbx-az1-2*CLI> [2013-09-06 18:35:05.680] NOTICE[22748][C-00000028]: chan_sip.c:25381 handle_request_invite: Call from '' (50.139.221.52:55002) to extension 'sip:6000' rejected because extension not found in context 'public'. | 18:51 |
| saper | I'm in from mobile | 18:52 |
| pabelanger | saper: drop the sip: from the extension | 18:52 |
| saper | gone | 18:52 |
| *** thomasbiege has joined #openstack-infra | 18:52 | |
| *** cp16net has left #openstack-infra | 18:52 | |
| saper | 50.139.221.52 is not me | 18:52 |
| jeblair | saper: so if you look in your tcpdump logs, do you get the 200 OK for your invite? | 18:53 |
| *** sdake_ has joined #openstack-infra | 18:53 | |
| saper | jeblair: let me get a full tcpdump saved, w8 | 18:53 |
| fungi | 50.139.221.52 looks like someone in the charleston, sc region using comcast | 18:54 |
| jeblair | saper: it should be: you send an invite request, then asterisk sends '100 trying' then '200 ok' | 18:54 |
| *** thomasbiege has quit IRC | 18:55 | |
| saper | checking the dump | 18:56 |
| saper | ah didn't get a whole call | 18:57 |
| saper | retry | 18:57 |
| jeblair | saper: how's it going? | 19:01 |
| *** vipul is now known as vipul-away | 19:05 | |
| jeblair | saper: let us know if you have a good tcpdump | 19:05 |
| *** atiwari has joined #openstack-infra | 19:05 | |
| jeblair | saper: we want to switch to another server and try some settings there | 19:05 |
| jeblair | saper: (and you can also call that server for comparison) | 19:05 |
| pabelanger | saper: can you call again please | 19:07 |
| pabelanger | saper: still there? | 19:10 |
| *** tstevenson is now known as codenamekt | 19:13 | |
| *** sarob has joined #openstack-infra | 19:14 | |
| anteaya | checking dependencies for puppet-dashboard, I can get ruby1.9.3 through apt-get (calling it ruby1.9.1) but when I load rubygems through apt-get is it going to pull in ruby1.8: http://packages.ubuntu.com/precise/rubygems | 19:14 |
| anteaya | rarrrrr | 19:14 |
| anteaya | what is that music/sound called? | 19:14 |
| anteaya | did eveyone else leave the call? | 19:15 |
| * saper is back | 19:15 | |
| *** codenamekt is now known as tstevenson | 19:16 | |
| fungi | i assume it's a music generator? | 19:16 |
| * saper hears the music | 19:16 | |
| saper | and now in | 19:16 |
| fungi | anteaya: i wonder if there's a separate gems deb for 1.9.x | 19:16 |
| jeblair | saper: pabelanger is changing another setting | 19:17 |
| jeblair | saper: stick around and we'll ask you to call back in a minute | 19:17 |
| anteaya | fungi: if I can find it, can we use the deb? | 19:17 |
| *** sarob has quit IRC | 19:17 | |
| saper | I'm sending INVITE, getting 100 Trying | 19:17 |
| saper | and then many times 200 OK | 19:17 |
| pabelanger | saper: okay, try again | 19:17 |
| fungi | anteaya: http://packages.ubuntu.com/precise-updates/rubygems1.9.1 | 19:17 |
| *** sarob has joined #openstack-infra | 19:17 | |
| jeblair | saper: are you sending anything in response to the 200 ok? | 19:17 |
| *** CaptTofu has quit IRC | 19:18 | |
| saper | not sure | 19:18 |
| saper | looks strange | 19:18 |
| saper | but RTP seems fine | 19:18 |
| fungi | anteaya: looks like the rubygems1.9.1 package is just a virtual package name provided by the ruby1.9.1 package anyway | 19:19 |
| jeblair | saper: try calling again; pabelanger changed another setting | 19:19 |
| *** Vivek has quit IRC | 19:19 | |
| anteaya | fungi: I don't quite understand virtual packages yet | 19:19 |
| anteaya | but http://paste.openstack.org/show/45950/ | 19:19 |
| saper | hm | 19:19 |
| saper | let me check | 19:19 |
| anteaya | I have ruby 1.9.1 package (ruby.1.9.3) installed, no rubygems | 19:19 |
| fungi | anteaya: http://www.debian.org/doc/debian-policy/ch-binary.html#s-virtual_pkg | 19:19 |
| saper | maybe I try to respond to 10.5.203.70 | 19:19 |
| anteaya | I'll see if I can find a deb for it | 19:19 |
| saper | that's what I got in "Contact" | 19:20 |
| pabelanger | yes | 19:20 |
| pabelanger | that is what I am changing | 19:20 |
| *** vogxn has quit IRC | 19:20 | |
| pabelanger | okay will update puppet | 19:20 |
| fungi | anteaya: http://packages.ubuntu.com/precise-updates/amd64/ruby1.9.1/filelist says it includes the /usr/bin/gem1.9.1 executable | 19:20 |
| anteaya | you are correct it is there, it responds to gem list but not rubygem -v | 19:22 |
| anteaya | $ gem -v | 19:22 |
| anteaya | 1.8.11 | 19:22 |
| anteaya | gem it is called gem not rubygem, thanks fungi | 19:22 |
| jeblair | pabelanger: i'll let you make the change on pbx.o.o and start asterisk | 19:23 |
| pabelanger | jeblair: okay | 19:24 |
| jeblair | pabelanger: i've already updated voip.ml to use the other pop | 19:24 |
| pabelanger | okay | 19:25 |
| pabelanger | back up | 19:25 |
| pabelanger | saper: ya, the issue was with our configs and the az1 zone | 19:26 |
| *** Vivek has joined #openstack-infra | 19:26 | |
| clarkb | what was the problem? | 19:27 |
| *** reed has quit IRC | 19:27 | |
| pabelanger | clarkb: nat, we bind to public IP on rackspace, not on az1 | 19:27 |
| *** Vivek is now known as Guest63959 | 19:27 | |
| pabelanger | so, asterisk needs updating to know the external IP | 19:27 |
| jeblair | mordred: hpcloud feedback: nat is evil | 19:27 |
| pabelanger | so, depending on which provider we use, puppet changes need to happen | 19:28 |
| SpamapS | is there a "the cloud was too slow" bug that we should do rechecks against? | 19:29 |
| SpamapS | Seeing a few where it just took 400s for the database to even respond to a request... guessing it was just resource starvation. | 19:30 |
| clarkb | in tempest? | 19:31 |
| fungi | SpamapS: we've talked about having something benchmark each devstack slave before deeming it available for use (and discarding unusably slow machines) | 19:32 |
| clarkb | we are running tests in parallel now could also be self generated load | 19:32 |
| jeblair | is anyone else around to call into the conference server? | 19:33 |
| clarkb | I am not | 19:34 |
| pleia2 | I can | 19:35 |
| jeblair | https://wiki.openstack.org/wiki/Infrastructure/Conferencing | 19:35 |
| pleia2 | rolex, score | 19:35 |
| *** pcrews has quit IRC | 19:36 | |
| jeblair | https://etherpad.openstack.org/pbx-testing | 19:39 |
| *** reed has joined #openstack-infra | 19:41 | |
| fungi | pleia2: i think you you didn't press 3 quickly enough, so no rolex for you | 19:41 |
| fungi | oh, rolex was 2 anyway | 19:43 |
| *** jhesketh has quit IRC | 19:43 | |
| pabelanger | that is 20 | 19:43 |
| pabelanger | sounds like ducks | 19:44 |
| anteaya | ducks selling viagra | 19:44 |
| pabelanger | might want to mute a phone jeblair | 19:45 |
| jeblair | all of my phones are muted now | 19:45 |
| jeblair | it's someone else i think | 19:45 |
| pabelanger | that is the down side of silence suppression | 19:45 |
| anteaya | I'm muted | 19:45 |
| *** jhesketh has joined #openstack-infra | 19:45 | |
| anteaya | was that me? | 19:45 |
| pabelanger | think so | 19:45 |
| pabelanger | unmite | 19:45 |
| anteaya | let's test | 19:46 |
| pabelanger | mute* | 19:46 |
| fungi | heh | 19:46 |
| anteaya | okay | 19:46 |
| pabelanger | and back | 19:46 |
| anteaya | unmuted | 19:46 |
| anteaya | I'll mute again | 19:46 |
| anteaya | muted | 19:46 |
| anteaya | is that me? | 19:46 |
| pabelanger | anteaya: I believe so | 19:46 |
| anteaya | because I hear the noise | 19:46 |
| fungi | i mistook anteaya for a white-noise generator ;) | 19:46 |
| anteaya | I don't usually when I generate it but it could be | 19:47 |
| anteaya | fungi: oh I generate lots of that | 19:47 |
| anteaya | I'll stay muted | 19:47 |
| anteaya | why would that just start now though? | 19:47 |
| anteaya | guess my microphone generates white-noise at a low level and when silencing is off it is picked up | 19:54 |
| anteaya | the sound card in this laptop could be better | 19:54 |
| anteaya | nice music | 19:56 |
| pabelanger | okay, back up | 19:57 |
| saper | srry it was my | 19:57 |
| saper | me | 19:57 |
| saper | 16kHz music it was | 19:57 |
| anteaya | it was nice | 19:58 |
| saper | it's used here for holding | 19:58 |
| anteaya | I am in and unmuted | 19:58 |
| anteaya | should I mute? | 19:58 |
| jeblair | pabelanger, rustlebee: thanks for your help! | 20:07 |
| pabelanger | jeblair: np. I'll do more testing tonight with hp cloud, and get some patches ready if you decide to go that route | 20:08 |
| jeblair | pabelanger: cool; voip.ms is still configured to use the dallas did, which is far away from hpcloud, but that probably won't bother you too much. | 20:10 |
| *** sarob_ has joined #openstack-infra | 20:11 | |
| *** mrmartin has quit IRC | 20:11 | |
| *** sarob has quit IRC | 20:15 | |
| openstackgerrit | Anne Gentle proposed a change to openstack-infra/config: Adds info about building a Jenkins slave with script https://review.openstack.org/41942 | 20:17 |
| openstackgerrit | Anne Gentle proposed a change to openstack-infra/config: Flattens directories based on https://review.openstack.org/45487 https://review.openstack.org/45489 | 20:22 |
| clarkb | sysadmin email addresses are in hiera now... took me long enough to figure that out | 20:23 |
| clarkb | jeblair: I am updating my email address now, cronspam should hopefully get to me | 20:23 |
| jeblair | clarkb: yeah, if we put them in puppet, we get spam from random peoples servers that use our exim module | 20:23 |
| clarkb | yeah I remember now | 20:23 |
| * anteaya goes for a walk | 20:24 | |
| jeblair | so it's "private information", which isn't really a stretch. | 20:24 |
| *** pabelanger has quit IRC | 20:25 | |
| *** UtahDave has joined #openstack-infra | 20:25 | |
| clarkb | jeblair: new address is in hiera | 20:25 |
| openstackgerrit | Anne Gentle proposed a change to openstack-infra/config: Updates user guide and basic install to point to new pom.xml file https://review.openstack.org/45490 | 20:27 |
| zul | is there a way to watch new commits on github like subscribe to all the commits for a particular project | 20:28 |
| saper | anteaya: https://commons.wikimedia.org/wiki/File:Enrique_Granados_-_danza_espanola,_op._37,_h._142_-_xii._arabesca.ogg | 20:28 |
| fungi | enrique granados has magic fingers on those strings | 20:29 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Add backup restore docs. https://review.openstack.org/45312 | 20:29 |
| fungi | oh, he was the composer | 20:29 |
| *** eharney has quit IRC | 20:29 | |
| clarkb | fungi: jeblair ^ how is that | 20:29 |
| clarkb | zul: if you have control of the project github can do callbacks on events to http servers for you | 20:30 |
| *** ftcjeff has joined #openstack-infra | 20:30 | |
| annegentle | jeblair: clarkb: looks like I'll need a core approval for https://review.openstack.org/#/c/45489/ before I can flatten the directory structure for the Ops-guide | 20:31 |
| annegentle | chicken-and-egg -- the flatter structure won't pass the gate until the gate is updated with the new pom.xml file location. oh joy | 20:31 |
| annegentle | jeblair: maybe we should do this next week when we sit next to each other? | 20:32 |
| fungi | zul: add a script to cron.hourly to pull from that repo and echo the results of nonempty pulls | 20:32 |
| fungi | slight delay, but also helps batch them up | 20:32 |
| zul | fungi ill just install an rss reader :) | 20:32 |
| fungi | zul: ahh, they have an rss feed. problem solved | 20:32 |
| annegentle | jeblair: clarkb: fungi: perhaps if you approve https://review.openstack.org/#/c/45489/ we can test in a small batch (that was my hope originally, start small!) | 20:33 |
| fungi | baby steps. got it | 20:33 |
| lifeless | anteaya: LCA miniconf selection works like this: CFP selects conference papers and *what* miniconfs. Then the miniconf organisers run their own CFPs. | 20:34 |
| fungi | annegentle: so the thought is to merge 45489 and then recheck 45487 to see if it passes? | 20:34 |
| annegentle | fungi: yep | 20:35 |
| lifeless | anteaya: also some papers submitted for the main conf are forwarded to the miniconf organisers as being suitable fodder | 20:35 |
| * annegentle loves baby steps | 20:35 | |
| lifeless | anteaya: so yeah yuo need to talk to mikal and steward/flamingspork | 20:35 |
| *** dprince has quit IRC | 20:38 | |
| *** dkliban has quit IRC | 20:43 | |
| *** KennethWilke has quit IRC | 20:51 | |
| *** pabelanger has joined #openstack-infra | 21:00 | |
| clarkb | who was just in the room | 21:04 |
| clarkb | I should've checked irc before he left oh well | 21:04 |
| *** boris-42 has quit IRC | 21:05 | |
| *** rnirmal has quit IRC | 21:06 | |
| clarkb | annegentle: reviewing | 21:07 |
| *** ruhe has joined #openstack-infra | 21:07 | |
| clarkb | jeblair: did you want to review that before I approve? | 21:08 |
| *** pentameter has quit IRC | 21:12 | |
| *** vipul-away is now known as vipul | 21:14 | |
| *** sarob_ has quit IRC | 21:14 | |
| *** sarob has joined #openstack-infra | 21:15 | |
| jeblair | annegentle: ping | 21:16 |
| clarkb | jeblair: annegentle's change has my +2, but I have held off on approving | 21:16 |
| *** pcrews has joined #openstack-infra | 21:17 | |
| jeblair | clarkb: i was wondering if it could be made slightly more generic for easier jjb templating | 21:18 |
| clarkb | jeblair: good idea | 21:18 |
| jeblair | so this is for a manual that's in its own repo | 21:18 |
| clarkb | if the dir structure is consistent the {name} could potentially determine everything else | 21:18 |
| jeblair | which is bound to be a little different from the manuals that are built from openstack-manuals | 21:19 |
| *** prad has left #openstack-infra | 21:19 | |
| jeblair | but i think there's at least one other that's similar to the ops guide, right? | 21:19 |
| clarkb | jeblair: yes, the translated doc job iirc | 21:19 |
| jeblair | clarkb: what repo is that? | 21:19 |
| clarkb | I thought it was the ops repo | 21:20 |
| jeblair | oh i see | 21:20 |
| jeblair | openstack-operations-guide-ja | 21:20 |
| jeblair | (i wonder if it needs changeng even for this change) | 21:21 |
| clarkb | jeblair: I don't think it works yet, but will need changing | 21:21 |
| clarkb | actually maybe not | 21:21 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: update thirdy party testing how to doc https://review.openstack.org/45495 | 21:21 |
| clarkb | it appears to use the generated dir which is already less deep | 21:21 |
| jeblair | ok i think the ops guide is the only separate repo atm | 21:22 |
| jeblair | so my suggestion is largely theoretical | 21:22 |
| jeblair | but even so, if the root pom were either at "/pom.xml" or something generic like "/src/pom.xml", the same definition could be used for a subsequent repo | 21:24 |
| clarkb | the doc jobs could use templatization though, but this may not be a good place to start | 21:24 |
| *** yjiang5 is now known as bmqq123 | 21:24 | |
| *** thomasm has quit IRC | 21:25 | |
| jeblair | i'm going to approve but leave that suggestion for later consideration | 21:25 |
| *** ruhe has quit IRC | 21:25 | |
| clarkb | wfm | 21:25 |
| dkranz | jeblair, clarkb : Got a minute to chat about all the bogus ERRORs in the logs and how to get rid of them? | 21:26 |
| mordred | o/ | 21:26 |
| jeblair | i mean, we could still template it, it's just a mostly useless parameter to add | 21:26 |
| mordred | dkranz: they should go away | 21:26 |
| dkranz | mordred: May a suggest a way? | 21:26 |
| dkranz | mordred: We were going to file bugs and create a whitelist | 21:27 |
| mordred | dkranz: I have no suggestions, but I support the effort | 21:27 |
| mordred | hrm | 21:27 |
| mordred | dkranz: when you say whitelist - what do you mean? | 21:27 |
| clarkb | dkranz: no, you need to talk to dhellman and jd__ | 21:27 |
| clarkb | or do you mean in general? | 21:27 |
| clarkb | contenxt switching on a friday afternoon is not going well for me | 21:28 |
| * mordred throws salmon at clarkb | 21:28 | |
| openstackgerrit | A change was merged to openstack-infra/config: Flattens directories based on https://review.openstack.org/45487 https://review.openstack.org/45489 | 21:28 |
| dkranz | mordred: Then hopefully you guys could put something in devstack-gate to fail the build if any new ones show up. | 21:28 |
| dkranz | mordred: hrm about which part :) | 21:28 |
| *** danger_fo is now known as danger_fo_away | 21:28 | |
| dkranz | clarkb: In general. It is not just the new ceilo thing! | 21:29 |
| dkranz | clarkb: There are 99 ERROR in n-cpu after a success | 21:29 |
| fungi | 99 errors but failure ain't one | 21:29 |
| clarkb | right most (maybe all) ceilo traces | 21:29 |
| dkranz | clarkb: No | 21:29 |
| dkranz | clarkb: I wish that were the case. I just looked. | 21:30 |
| *** NobodyCam_ has joined #openstack-infra | 21:30 | |
| mordred | dkranzfunwow | 21:30 |
| mordred | fungi: if you're having nova problems I feel bad for you son | 21:30 |
| dkranz | clarkb: You saw the link in #openstack-qa a moment ago? | 21:30 |
| *** odyssey4me has quit IRC | 21:30 | |
| *** NobodyCam_ has quit IRC | 21:30 | |
| clarkb | dkranz: I see it now | 21:30 |
| jeblair | dkranz: i've forgotten, are we working from the assumption that there should be no errors in logs? ie, it's never legitimate for a test to cause one? | 21:31 |
| dkranz | clarkb: Some of that seems like simple bugs and others seem nasty | 21:31 |
| dkranz | jeblair: Well, they are blackbox tests | 21:31 |
| *** dolphm has quit IRC | 21:31 | |
| fungi | i thought the objection was more to presence of exception tracebacks when the test itself is succeeding just fine | 21:32 |
| dkranz | jeblair: IMO, there should only be an error in the log if it indicates a problem with the system | 21:32 |
| clarkb | dkranz: that particular trace appears to be a result of the level we log at | 21:32 |
| dkranz | fungi: What do you think a developer means when does log.error? | 21:32 |
| jeblair | dkranz: and is tempest legitimately able to cause system problems such that there should be error logs? | 21:32 |
| fungi | dkranz: good point | 21:32 |
| clarkb | dkranz: it is a debug trace | 21:32 |
| * mordred thinks that it's never legitimate for a test to cause one | 21:32 | |
| mordred | an error in the log should indicate an operational error in the software | 21:33 |
| mordred | not an invalid request from a user | 21:33 |
| dkranz | mordred: exactly | 21:33 |
| clarkb | mordred: unless you are logging at debug level | 21:33 |
| jeblair | yes, we're all agreed on that, that is not what i'm asking | 21:33 |
| clarkb | I think it is perfectly valid to see a trace at debug level | 21:33 |
| dkranz | clarkb: I thought debug trace meant you get debug messages | 21:33 |
| dkranz | clarkb: Not error messages that would not have shown up at another level | 21:33 |
| clarkb | dkranz: that is what you have there its a debug message + the corresponding trace | 21:33 |
| jeblair | dkranz: i'm trying to think about the whitelist -- is it only for grandfathering current errors and should trend to zero, or do we need to have a way for someone writing a new tempest test to indicate what error messages it is expeceted to cause? | 21:33 |
| dkranz | jeblair: I think it is just until the bugs are fixed | 21:34 |
| mordred | jeblair: I read it as grandfathering and trending towards zero | 21:34 |
| dkranz | mordred: Yes | 21:34 |
| jeblair | ok, so it doesn't much matter where it is, the system could be as simple as grep and a list of regexes in a script in the devstack-gate repo | 21:34 |
| dkranz | jeblair: I think so | 21:34 |
| clarkb | (trace having its own level is a oslo.logging thing and isn't correct imo) | 21:34 |
| dkranz | jeblair: That is actually what I was thinking | 21:34 |
| fungi | we do similar things for the oom and sudo checks | 21:35 |
| jeblair | clarkb: it's alse extremely confusing -- trace, when it exists in logging systems, usually means "level that's even finer grained than debug" | 21:35 |
| *** bmqq123 has quit IRC | 21:35 | |
| mordred | yeah. like, I'd think trace would be "magically show me all function enters and exists in sequence with indentation to indicate stack depth" | 21:35 |
| clarkb | jeblair: it goes debug <- trace <- info <- warn <- error or somesuch | 21:36 |
| mordred | which would be EPICLY verbose, but somethings super the hell useful | 21:36 |
| mordred | clarkb: I consider that a bug in the design of oslo.logging | 21:36 |
| clarkb | mordred: right | 21:36 |
| clarkb | mordred: there shouldn't be a trace level at all imo | 21:36 |
| flashgordon | mordred: with 28MB of n-cpu logs from a tempest run you would thing we do ta ht now | 21:36 |
| mordred | similar to the config files override command line arguments :) | 21:36 |
| mordred | flashgordon: :) | 21:36 |
| clarkb | mordred: because, it isn't standard and means I have to special case openstack logs :) | 21:36 |
| flashgordon | I think we are getting off topic here no? | 21:37 |
| dkranz | mordred: I think the main thing is we want operators (and tempest) to have something to run on the logs that says "no problem" | 21:37 |
| clarkb | flashgordon: not entirely. I still assert that tracebacks like that may be valid | 21:37 |
| *** adalbas has quit IRC | 21:37 | |
| clarkb | flashgordon: because we are explicitly logging at that level | 21:37 |
| mordred | dkranz: yes | 21:37 |
| flashgordon | clarkb:to me stacktrace == sharting | 21:37 |
| dkranz | clarkb: Then people have to know that, and what the valid ones look like. | 21:37 |
| clarkb | flashgordon: its debug info | 21:38 |
| mordred | I'm ok with stacktraces in debug output - sometimes it's helpful debug info | 21:38 |
| clarkb | the ERROR you see first is what normal users will see | 21:38 |
| flashgordon | clarkb: lets take a concrete example http://logs.openstack.org/76/44876/5/check/gate-tempest-devstack-vm-full/f729bb6/logs/screen-n-cpu.txt.gz#_2013-09-04_15_49_01_323 | 21:38 |
| fungi | perhaps debug output shouldn't go to the test console and should instead be captured separately (additional debug log files or something)? | 21:38 |
| jeblair | errors should have tracebacks, but there should be no errors, so i think we can ignore it | 21:38 |
| flashgordon | I see no value in that stacktrace | 21:39 |
| clarkb | flashgordon: that is the one I am looking at | 21:39 |
| flashgordon | or the glanceclient loggin for that matter | 21:39 |
| jeblair | flashgordon: there is no value in that stacktrace only because there is no value in the _error_ | 21:39 |
| clarkb | flashgordon: in general TRACE level stacktraces are fine imo | 21:39 |
| flashgordon | jeblair: agreed | 21:39 |
| *** sarob has quit IRC | 21:39 | |
| dkranz | Sorry to start a fight and run but I just noticed the time and I'm late to leave. | 21:39 |
| clarkb | because of what TRACE means | 21:39 |
| jeblair | dkranz: i think we all agree | 21:39 |
| fungi | happy fridaying, dkranz | 21:39 |
| dkranz | sdague and I are interested in helping with this | 21:39 |
| clarkb | dkranz: yes I agree (I just think we need to articulate what is allowed) | 21:40 |
| jeblair | dkranz: i think it's fine to stick something in d-g to accomplish this | 21:40 |
| flashgordon | jeblair: \o/ | 21:41 |
| dkranz | clarkb: Yes, some instructions for developers need to end up in HACKING or somewhere. | 21:41 |
| mordred | jeblair: ++ | 21:41 |
| clarkb | because it should be valid to log a stacktrace during a passing test at your most verbose log level | 21:41 |
| dkranz | fungi: Same to you. Later... | 21:41 |
| clarkb | because info like that is what debug log level exists for | 21:41 |
| clarkb | similar to how glance was logging all of its sql queries | 21:41 |
| clarkb | (and still can if you choose) | 21:42 |
| flashgordon | I would love to see this logic in place for havana | 21:42 |
| jeblair | flashgordon: icehouse? | 21:42 |
| flashgordon | jeblair: havana, any issue we find is a bug | 21:42 |
| flashgordon | unless there is FF on infra too | 21:42 |
| jeblair | flashgordon: nope, and it's likely to be a relatively simple system, so i'm sure we can get it in. i'm not sure how well people would react to that kind of change at this stage though. | 21:43 |
| jeblair | flashgordon: nope -> nope there is no infra ff | 21:43 |
| clarkb | jeblair: flashgordon: ya I expect the biggest problem being that people will need to be convinced that there are bugs that have to be fixed | 21:43 |
| mordred | flashgordon: have I talked to you about moving HACKING.rst to doc/source/hacking.rst and having it publish to docs.openstack.org/developer/hacking ? | 21:43 |
| clarkb | at least before havana releases | 21:43 |
| mordred | clarkb: we can convince them by filing the bugs and then putting in a gate :) | 21:44 |
| flashgordon | jeblair: I am a fan of public shaming of projects when all else fails | 21:44 |
| mordred | (honestly, I don't think anyone disagrees that it's a problem, do they?) | 21:44 |
| flashgordon | mordred: no but that is a great idea | 21:44 |
| mordred | essentially, anyone who has ever tried to diagnose a devstack problem... | 21:44 |
| mordred | flashgordon: woot | 21:44 |
| flashgordon | and the whitelisting will make this easier to do at first | 21:45 |
| flashgordon | baby steps | 21:45 |
| *** dkranz has quit IRC | 21:45 | |
| anteaya | saper listening, lovely thank you | 21:46 |
| clarkb | mordred: I still think we need to be careful about how we do it | 21:46 |
| *** mgagne has quit IRC | 21:46 | |
| clarkb | flashgordon's example is one that I don't think should cause a failure | 21:47 |
| clarkb | normal logging levels log an ERROR which tests may cause then debug level spits out a traceback | 21:47 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Publish hacking docs to docs.openstack.org https://review.openstack.org/45498 | 21:47 |
| mordred | flashgordon: ^^ | 21:47 |
| mordred | clarkb: I never think that tempest should ever cause ERRORs to be logged | 21:47 |
| mordred | in a successful frun | 21:48 |
| mordred | run | 21:48 |
| clarkb | mordred: aren't their negative tests? | 21:48 |
| clarkb | s/their/there/ | 21:48 |
| mordred | doesn't matter | 21:48 |
| flashgordon | I agree with mordred | 21:48 |
| mordred | there are negative tests for behavior | 21:48 |
| mordred | that test that requested invalid image does not return or something | 21:48 |
| clarkb | how else do you capture that something went wrong in your logs? | 21:48 |
| mordred | those are not errors in the software | 21:48 |
| mordred | different things | 21:48 |
| clarkb | it may be that we fail if ERROR level happens and allow stacktraces below that | 21:48 |
| mordred | a user error and a software error are different | 21:48 |
| mordred | yes | 21:49 |
| clarkb | that makes sense to me | 21:49 |
| mordred | I think that eventually any ERROR logged by the software should be an indication that something failed | 21:49 |
| mordred | that way, an operator knows to go dig into a problem if an error is logged | 21:49 |
| fungi | apache has ruined people into thinking that errors in what the client requests should be treated as errors in the server, and mixes them accordingly | 21:49 |
| fungi | at least where its logs are concerned | 21:50 |
| anteaya | lifeless: thanks, just skimmed the backscroll | 21:50 |
| fungi | though you thankfully have error code ranges to fall back on to tell the difference in most cases | 21:50 |
| anteaya | I appreciate the introduction and will followup with mikal and flamingspork | 21:50 |
| mordred | anteaya: flamingspork's IRC nick is actuall stewart | 21:51 |
| anteaya | yeah just met him in #drizzle | 21:51 |
| anteaya | but I really like typing flamingspork | 21:51 |
| anteaya | just like I like typing guitarzan | 21:52 |
| anteaya | some nicks just need to be typed | 21:52 |
| anteaya | my other favourite is niftylettuce | 21:52 |
| flashgordon | clarkb: I see it as unexpected errors vs expected errors | 21:52 |
| anteaya | don't know him but that is a great nick | 21:52 |
| *** mancdaz has left #openstack-infra | 21:52 | |
| *** mancdaz has joined #openstack-infra | 21:52 | |
| clarkb | flashgordon: but do you log them differently? mordred's assertion is that you do | 21:54 |
| clarkb | and I am on board with that | 21:54 |
| flashgordon | clarkb: works for me | 21:54 |
| openstackgerrit | K Jonathan Harker proposed a change to openstack-infra/config: Poke a hole through the proxy for cluster health https://review.openstack.org/45500 | 21:54 |
| clarkb | flashgordon: the problem was originaly framed as stacktraces shouldn't end up in our logs and I think that is wrong. I am on board with no ERROR level logs should end up in the logs during tempest testing | 21:56 |
| flashgordon | which would mean only stacktraces that are explicitly raised are ok? | 21:57 |
| clarkb | right | 21:57 |
| flashgordon | clarkb: I can get behind that | 21:57 |
| flashgordon | I am just not sure what case we have for that | 21:57 |
| clarkb | flashgordon: its similar to glance and the sql logs | 21:57 |
| flashgordon | clarkb: can you fill me in on that one | 21:58 |
| clarkb | flashgordon: until recently glance logged sqlalchemy at the debug level when its log level was set to debug | 21:58 |
| clarkb | flashgordon: so you got everything out of sqlalchemy | 21:58 |
| mordred | jeblair: are you going to submit the openstack ci talk for pycon? | 21:58 |
| clarkb | flashgordon: they are now individually toggleable so that glance=debug does not imply sqlalchemy=debug | 21:59 |
| clarkb | flashgordon: but the functionality wasn't completely removed because sometimes you need to log running state | 21:59 |
| flashgordon | clarkb: ahh yes | 21:59 |
| mordred | clarkb: btw - you never review my patches anymore :( I have patches in the queue going back to aug 10 than have gotten no love. | 22:00 |
| * mordred pouts | 22:00 | |
| clarkb | mordred: I haven't reviewed much stuff over the last few days | 22:01 |
| clarkb | so everyone is suffering | 22:01 |
| mordred | clarkb: what, you've been BUSY??? | 22:01 |
| clarkb | mordred: did you see the chainsawed etherpad manifests? | 22:01 |
| mordred | clarkb: saw they went up - haven't looked yet | 22:01 |
| clarkb | mordred: I am actually pretty happy with how it turned out. I am considering possibly using a PPA for nodejs instead of building from source | 22:02 |
| clarkb | https://launchpad.net/~chris-lea/+archive/node.js/ not sure what we need to do to vet that though | 22:02 |
| clarkb | anyone know chris-lea? | 22:02 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/config: Move gate-tempest-devstack-vm-large-ops to silent https://review.openstack.org/45501 | 22:03 |
| *** pcm_ has quit IRC | 22:03 | |
| jeblair | mordred: yes, i'll submit the openstack ci talk for pycon | 22:04 |
| mordred | jeblair: great. I'll do one on pbr/packaging then | 22:04 |
| flashgordon | which pycon is this? | 22:04 |
| mordred | flashgordon: US - next april | 22:04 |
| *** burt has quit IRC | 22:04 | |
| flashgordon | oh montreal | 22:04 |
| clarkb | flashgordon: are you going to openstack on ales? | 22:05 |
| flashgordon | clarkb: yup | 22:05 |
| *** ericw has quit IRC | 22:05 | |
| fungi | chris lea was apparently vp of business development at media temple. i don't know him, but sounds like a suit ;) | 22:05 |
| flashgordon | giving the triple talk | 22:05 |
| ryanpetrello | anybody feel comfortable w/ approval for https://review.openstack.org/#/c/42393/ ? | 22:05 |
| clarkb | flashgordon: cool, I will give the CI talk. I am planning on driving there which may or may not be a mistake. But drives in and around the cascades are always fun | 22:06 |
| flashgordon | not sure if I got the patch above right ^ | 22:06 |
| flashgordon | clarkb: nice where you driving in from? | 22:06 |
| mordred | ryanpetrello: it terrifys all of us | 22:06 |
| flashgordon | I am flying in from bay area | 22:06 |
| mordred | ryanpetrello: your javascript exceeds me | 22:06 |
| clarkb | flashgordon: seattle | 22:06 |
| flashgordon | ahh niceshould be a gerat drive | 22:07 |
| ryanpetrello | @mordred oh come on, a little javascript never heard anybody | 22:07 |
| *** w_ has joined #openstack-infra | 22:07 | |
| ryanpetrello | s/heard/hurt | 22:07 |
| ryanpetrello | wow, it's so late in the day my brain is making serious leaps here | 22:07 |
| flashgordon | clarkb: I gave this talk at europycon http://jogo.github.io/slides/VeryLargeDevelopment/ | 22:08 |
| *** zeus has quit IRC | 22:08 | |
| flashgordon | which is CI from the developers side | 22:08 |
| anteaya | mordred "flashgordon: have I talked to you about moving HACKING.rst to doc/source/hacking.rst and having it publish to docs.openstack.org/developer/hacking ?" you talked to me about that and getting sphinx to generate docs for that repo | 22:09 |
| anteaya | and I haven't done it yet | 22:10 |
| clarkb | flashgordon: http://docs.openstack.org/infra/publications/overview/#%281%29 is the one I will give, need to update it though | 22:10 |
| *** olaph has quit IRC | 22:10 | |
| flashgordon | clarkb: nice | 22:10 |
| *** olaph has joined #openstack-infra | 22:10 | |
| clarkb | flashgordon: the developer focus is neat | 22:11 |
| flashgordon | clarkb: it was fun going back in time looking at our tests and how we did it in the beginning | 22:11 |
| anteaya | mordred upvoting 45498 is easier than waiting for me to do it | 22:12 |
| flashgordon | like http://jogo.github.io/slides/VeryLargeDevelopment/#/10 | 22:12 |
| flashgordon | or http://jogo.github.io/slides/VeryLargeDevelopment/#/11/2 | 22:12 |
| *** w_ has quit IRC | 22:13 | |
| clarkb | it has come a long way :) | 22:13 |
| *** w_ has joined #openstack-infra | 22:14 | |
| *** olaph has quit IRC | 22:15 | |
| *** lcestari has quit IRC | 22:16 | |
| clarkb | I am going to walk home in hopes that a break will help me tackle code review later | 22:18 |
| openstackgerrit | Ryan Petrello proposed a change to openstack-dev/pbr: Add a hint for users who don't have git installed. https://review.openstack.org/45502 | 22:18 |
| flashgordon | o/ | 22:18 |
| annegentle | clarkb: jeblair: fungi: this spreadsheet http://goo.gl/gvTJ2z has the changes to the directories spelled out, I do like the idea of templating but mostly right now just need to not break the gate before boot camp :) | 22:19 |
| fungi | annegentle: makes perfect sense | 22:19 |
| *** tstevenson has quit IRC | 22:21 | |
| *** thedodd has quit IRC | 22:22 | |
| annegentle | fungi: I hope so :) | 22:23 |
| annegentle | fungi: flattening is good | 22:23 |
| annegentle | fungi: I hope it doesn't throw translators off | 22:23 |
| fungi | since those are showing up as git renames, hopefully transifex is smart enough to see that the files are only moving | 22:24 |
| * mordred has a goal to start beating clarkb on code reviews... | 22:24 | |
| * mordred will probably not achieve his goal, but it's good motivation | 22:24 | |
| annegentle | fungi: yeah I hope | 22:24 |
| jeblair | mordred: quality is more important than quantity | 22:25 |
| jeblair | jhesketh: thanks for noticing the gaping hole in my new algorithm for zuul. :) | 22:27 |
| openstackgerrit | A change was merged to openstack-infra/config: Add new manual "Cloud Administrator Guide" https://review.openstack.org/45229 | 22:28 |
| fungi | jeblair: did your change actually stop checking checkForChangesNeededBy() after all? | 22:29 |
| mordred | jeblair: agree | 22:30 |
| jeblair | fungi: no, but it would try to reparent changes without their dependent changes which would end up causing it to flail around because gerrit wouldn't merge them | 22:30 |
| fungi | ahh, right | 22:31 |
| jeblair | so it turns out there are some cases where we will have 'dead' items in the queue; items which aren't themselves failing, but can't be merged because their dependent change(s) are failing | 22:31 |
| mordred | jeblair: AH - nice | 22:31 |
| * fungi needs to go for a quick walk. bbiab | 22:32 | |
| sdague | sorry I missed the conversation earlier on the traces. I'm going to dig into that next week. But it's friday, so time for a beer :) | 22:33 |
| *** sarob has joined #openstack-infra | 22:33 | |
| mordred | sdague: NO - NO BEER FOR YOU - ONLY WORK!!! | 22:34 |
| sdague | heh | 22:34 |
| mordred | speaking of | 22:34 |
| mordred | I will not be working this weekend | 22:34 |
| sdague | you should say that more often | 22:34 |
| jeblair | it's the weekend, no one should be working | 22:34 |
| mordred | as I will be working my other job - Monty Taylor, Lighting Designer | 22:34 |
| *** olaph has joined #openstack-infra | 22:34 | |
| jeblair | mordred: what about the job as Spirit Taster? | 22:35 |
| mordred | jeblair: I'll be doing that later in the week | 22:35 |
| mordred | I think that it would be dangerous to mix Spirit Taster with Stands on Top of Ladder | 22:35 |
| mordred | I have finally read the script though - and I will say it's quite good | 22:36 |
| *** w_ has quit IRC | 22:36 | |
| mordred | I can totally see how it won the tony a couple of years ago | 22:36 |
| *** ericw has joined #openstack-infra | 22:39 | |
| anteaya | I hope the show is well received | 22:40 |
| mordred | anteaya: the guys I'm working with are top notch - I LOVE working with them because they always do quality, thoughtful work | 22:41 |
| mordred | anteaya: and thank you | 22:41 |
| mordred | http://www.penfoldtheatre.org/about/14season/RED | 22:42 |
| mordred | for anyone who happens to be in Austin | 22:42 |
| *** atiwari has quit IRC | 22:43 | |
| *** nati_ueno_2 has joined #openstack-infra | 22:46 | |
| *** w_ has joined #openstack-infra | 22:49 | |
| *** olaph has quit IRC | 22:51 | |
| *** stevebaker_ has joined #openstack-infra | 22:51 | |
| *** ericw has quit IRC | 22:51 | |
| *** sarob has quit IRC | 22:52 | |
| *** nati_ueno_2 has quit IRC | 22:55 | |
| *** nati_ueno_2 has joined #openstack-infra | 22:56 | |
| *** nati_uen_ has joined #openstack-infra | 22:58 | |
| *** nati_ueno_2 has quit IRC | 23:00 | |
| *** pcrews has quit IRC | 23:05 | |
| *** Ryan_Lane has quit IRC | 23:07 | |
| *** Ryan_Lane has joined #openstack-infra | 23:07 | |
| *** bnemec_away is now known as bnemec | 23:09 | |
| *** vipul is now known as vipul-away | 23:09 | |
| *** nati_uen_ has quit IRC | 23:09 | |
| *** nati_ueno_2 has joined #openstack-infra | 23:10 | |
| *** nati_uen_ has joined #openstack-infra | 23:11 | |
| lifeless | mordred: do we have any go-to stats on gerrit? e.g. new patch versions/day? | 23:12 |
| mordred | lifeless: yeah. there are the graphs on zuul status page of course | 23:14 |
| *** nati_ueno_2 has quit IRC | 23:14 | |
| mordred | lifeless: I _believe_ that the other day we did something like 10k jobs run or something | 23:15 |
| mordred | I'm not sure what our patches merged stat is recently, but I konw that it usually hovers between 100-150 patches landed | 23:15 |
| lifeless | thanks | 23:15 |
| mordred | clarkb: ^^ you got any better go-to numbers? | 23:15 |
| *** nati_uen_ has quit IRC | 23:16 | |
| *** nati_ueno_2 has joined #openstack-infra | 23:17 | |
| anteaya | mordred: I hear ya, working with amazing people is awesome | 23:17 |
| *** stevebaker_ has quit IRC | 23:17 | |
| *** stevebaker_ has joined #openstack-infra | 23:18 | |
| *** vipul-away is now known as vipul | 23:20 | |
| clarkb | mordred: graphite is the source of all that | 23:21 |
| *** nati_ueno_2 has quit IRC | 23:21 | |
| clarkb | the graph at the bottom right of the zuul status page can have its url pasted elswhere and mucked with to show additional data | 23:21 |
| clarkb | lifeless: ^ | 23:21 |
| clarkb | show you the number of comments, new patchests, and changes merged | 23:22 |
| flashgordon | http://graphite.openstack.org/render/?from=-4week&height=400&until=now&width=960&bgcolor=ffffff&fgcolor=000000&target=alias(summarize(stats_counts.gerrit.event.comment-added,%20'1h'),%20'Comment%20added')&target=alias(summarize(stats_counts.gerrit.event.patchset-created,%20'1h'),%20'Patchset%20created')&target=alias(summarize(stats_counts.gerrit.event.change-merged,%20'1h'),%20'Change%20merged')&title=Gerrit%20Events%20(per%20Hour)&_t=0.9697208071 | 23:23 |
| flashgordon | took the link and mucked with it to get 4 weeks | 23:24 |
| lifeless | clarkb: thank you! | 23:24 |
| clarkb | I find opening it in firefox makes the url human readable | 23:24 |
| lifeless | http://graphite.openstack.org/render/?from=-60days&height=640&until=now&width=800&bgcolor=ffffff&fgcolor=000000&target=alias%28summarize%28stats_counts.gerrit.event.comment-added,%20%271d%27%29,%20%27Comment%20added%27%29&target=alias%28summarize%28stats_counts.gerrit.event.patchset-created,%20%271d%27%29,%20%27Patchset%20created%27%29&target=alias%28summarize%28stats_counts.gerrit.event.change-merged,%20%271d%27%29,%20%27Change%20merged%27%29&ti | 23:24 |
| clarkb | would be nice if chrom* did that too | 23:24 |
| lifeless | stab. | 23:24 |
| lifeless | anyhow ^ shows some very interesting cyclic behaviour | 23:25 |
| flashgordon | http://graphite.openstack.org/render/?from=-26week&height=700&until=now&width=1000&bgcolor=ffffff&fgcolor=000000&target=alias(summarize(stats_counts.gerrit.event.comment-added,%20'1h'),%20'Comment%20added')&target=alias(summarize(stats_counts.gerrit.event.patchset-created,%20'1h'),%20'Patchset%20created')&target=alias(summarize(stats_counts.gerrit.event.change-merged,%20'1h'),%20'Change%20merged')&title=Gerrit%20Events%20(per%20Hour)&_t=0.96972080 | 23:25 |
| lifeless | aka the work week :) | 23:25 |
| flashgordon | even better 26 weeks | 23:25 |
| flashgordon | you can see H3 | 23:25 |
| clarkb | lifeless: and tehre are cycles within milestones, and you can see the larger 6 month cycle | 23:25 |
| jeblair | lifeless, flashgordon: take a /render/ url and s/render/compose/ and you get the graphite composer ui for that graph | 23:25 |
| jeblair | (also, neat trick; s/render/json/ and you get data) | 23:26 |
| flashgordon | neato | 23:26 |
| clarkb | mordred: http://mrsharpoblunto.github.io/foswig.js/ I kept that tab open while you were at burning man so I woudln't forget | 23:28 |
| *** sarob has joined #openstack-infra | 23:29 | |
| *** stevebaker_ has quit IRC | 23:29 | |
| *** stevebaker_ has joined #openstack-infra | 23:32 | |
| *** flaper87 has joined #openstack-infra | 23:32 | |
| flaper87 | clarkb: ping | 23:33 |
| clarkb | flaper87: pong | 23:33 |
| flaper87 | clarkb: hey, any news about moving marconi under openstack/ ? | 23:33 |
| flaper87 | :D | 23:33 |
| clarkb | flaper87: I haven't had a chance to think about it | 23:33 |
| flaper87 | clarkb: kk, whenever you do, could you ping me? | 23:34 |
| jeblair | flaper87: why don't you add it as an agenda item to our meeting? https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting | 23:34 |
| anteaya | flashgordon: nice work on the graphite | 23:34 |
| clarkb | jeblair: fungi mordred ^ flaper87 would like to move marconi under the openstack org as the TC approved incubation (or whatever it is called) | 23:34 |
| jeblair | flaper87: we usually end up discussing such things then anyway, and it would be good if you could attend so we can work out scheduling | 23:34 |
| jeblair | flaper87: (just go ahead and add it to the wiki page with your irc nick) | 23:35 |
| flaper87 | jeblair: clarkb will do. Thanks guys! | 23:35 |
| flashgordon | anteaya: thanks turns it wasn't too bad to tinker with the URL | 23:36 |
| flaper87 | jeblair: clarkb just to be clear, AFAIU, everything will be reneamed in the database, so, no need to approve all patches (or block) before that happens, right ? | 23:36 |
| anteaya | flashgordon: it looks really pretty | 23:36 |
| flaper87 | I'd like to prepare things in advance | 23:36 |
| jeblair | flaper87: correct | 23:36 |
| flaper87 | jeblair: awesome, already added it to the agenda | 23:37 |
| flaper87 | thanks | 23:37 |
| Alex_Gaynor | jeblair: can I bribe you to review https://review.openstack.org/#/c/45440/ :) | 23:37 |
| clarkb | flaper87: the only major thing that changes are your git remotes | 23:37 |
| clarkb | everything else should shift over nicely | 23:37 |
| flaper87 | clarkb: got it! Thanks again | 23:38 |
| clarkb | lifeless: wrong window? | 23:38 |
| lifeless | clarkb: what is ? | 23:38 |
| clarkb | lifeless: there is a way to generate graphs from puppet, | 23:38 |
| lifeless | oh yes | 23:38 |
| lifeless | probably | 23:38 |
| lifeless | :) | 23:38 |
| flashgordon | anteaya: seeing the H3 bump is pretty neat | 23:38 |
| anteaya | but of a bump, yeah | 23:39 |
| clarkb | lifeless: http://docs.puppetlabs.com/guides/faq.html | 23:39 |
| flashgordon | especailly the review spike | 23:39 |
| anteaya | s/but/bit | 23:39 |
| anteaya | no kidding | 23:39 |
| clarkb | lifeless: I didn't realize it had to be done on the agent side, but you can get graphs of the node configs | 23:39 |
| jeblair | Alex_Gaynor: sure, it's a friday afternoon, but hey, flaper87 is around and he knows where to find you if it breaks something. :) | 23:39 |
| Alex_Gaynor | jeblair: it's cool, they pass :) | 23:39 |
| flaper87 | LOOOL | 23:39 |
| clarkb | Alex_Gaynor: out of curiousity how many of these just work vs need to be updated? | 23:40 |
| clarkb | Alex_Gaynor: I saw that hacking needed one patch | 23:40 |
| lifeless | clarkb: thats not what I meant | 23:40 |
| clarkb | lifeless: what sort of graph are you looking for? | 23:40 |
| Alex_Gaynor | clarkb: the hacking patch I uploaded was for py3k | 23:40 |
| lifeless | clarkb: I meant a graph where the nodes are ci-puppetmaster, puppet-dashboard, zuul etc | 23:40 |
| openstackgerrit | A change was merged to openstack-infra/config: Run the marconiclient tests under PyPy https://review.openstack.org/45440 | 23:41 |
| lifeless | clarkb: and the edges are 'uses service X' | 23:41 |
| Alex_Gaynor | clarkb: althe clients have been "just work so far", swift needed some help, I think marconi just worked /cc flaper87 | 23:41 |
| jeblair | flashgordon: re https://review.openstack.org/#/c/45501/1 what selection criteria did you use for the projects you added it to? | 23:41 |
| clarkb | lifeless: for that I don't think so. puppet itself isn't aware of the relationships between nodes as we use it | 23:41 |
| flaper87 | Alex_Gaynor: yup, no changes needed to marconi, it just worked | 23:41 |
| flaper87 | and I was very happy to get rid of eventlets dependency | 23:41 |
| lifeless | clarkb: given this is puppet's well known heel, I expected no :). But I thought i would ask :) | 23:41 |
| flaper87 | :D | 23:41 |
| *** vishious is now known as vishy | 23:42 | |
| clarkb | converting subunit to html is now under 30 seconds for neutron tests http://paste.openstack.org/show/45989/ | 23:43 |
| clarkb | Alex_Gaynor: lifeless ^ we are converting to v2 before creating the html file | 23:44 |
| lifeless | clarkb: cool | 23:44 |
| *** hemna is now known as hemnafk | 23:44 | |
| *** CaptTofu has joined #openstack-infra | 23:45 | |
| Alex_Gaynor | clarkb: think of all the nature we save with that un-wasted time :) | 23:46 |
| clarkb | Alex_Gaynor: I like to think of it as time to run MOAR tests :) | 23:48 |
| *** stevebaker_ has quit IRC | 23:50 | |
| *** stevebaker_ has joined #openstack-infra | 23:53 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!