*** olaph has quit IRC | 00:00 | |
*** larainema has quit IRC | 00:00 | |
*** olaph has joined #openstack-infra | 00:00 | |
*** larainema has joined #openstack-infra | 00:01 | |
dougwig | minwang2: looking | 00:02 |
---|---|---|
minwang2 | thanks! | 00:03 |
dougwig | minwang2: i need to wait for all of the jobs to complete, so i can see the logs. standby. | 00:04 |
greghaynes | SpamapS: aye, was a missing firewall rule after reboot | 00:05 |
dougwig | minwang2: actually, i don't. looking at your review, you're enabling octavia for ALL lbaas jobs, not just the octavia job. you have to key off the testenv that's passed in. | 00:05 |
minwang2 | can you explain why | 00:07 |
minwang2 | so what i want to do is to check neutron lbaas v2 tempest against octavia | 00:07 |
*** esmute_ has quit IRC | 00:09 | |
minwang2 | we are not testing octavia here, we are still testing neutron lbaas | 00:10 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add controller class for Infra Cloud https://review.openstack.org/209698 | 00:10 |
*** rguillebert has quit IRC | 00:11 | |
*** esmute_ has joined #openstack-infra | 00:12 | |
openstackgerrit | Merged openstack-infra/puppet-asterisk: Remove invalid comment https://review.openstack.org/204235 | 00:12 |
*** sputnik13 has quit IRC | 00:13 | |
dougwig | minwang2: let's switch to #openstack-lbaas | 00:13 |
minwang2 | ok | 00:13 |
*** gildub has joined #openstack-infra | 00:14 | |
*** otter768 has joined #openstack-infra | 00:14 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add controller class for Infra Cloud https://review.openstack.org/209698 | 00:15 |
*** r-daneel has quit IRC | 00:16 | |
*** MarkAtwo_ has joined #openstack-infra | 00:17 | |
*** annegentle has quit IRC | 00:18 | |
*** ashleighfarnham has quit IRC | 00:19 | |
*** otter768 has quit IRC | 00:19 | |
*** MarkAtwood has quit IRC | 00:19 | |
*** boris-42 has quit IRC | 00:20 | |
adam_g | is there a central docs repo somewhere for users wishing to stand up a CI pipeline similar to ours? | 00:21 |
asselin_ | adam_g, http://docs.openstack.org/infra/system-config/third_party.html | 00:22 |
asselin_ | http://docs.openstack.org/infra/system-config/running-your-own.html | 00:22 |
*** crc32 has quit IRC | 00:22 | |
adam_g | asselin, second is the one im looking for, thanks! | 00:23 |
openstackgerrit | Matthew Treinish proposed openstack-infra/elastic-recheck: WIP: Add support to filter results by failure test_ids https://review.openstack.org/209712 | 00:25 |
mtreinish | clarkb: ^^^ it was to interesting to wait until tomorrow to try | 00:25 |
mtreinish | although I haven't actually tried to run it or anything | 00:25 |
*** tsg has quit IRC | 00:33 | |
*** baoli has joined #openstack-infra | 00:34 | |
SpamapS | greghaynes: oh, what firewall rule? | 00:34 |
SpamapS | greghaynes: my bad for not saving that | 00:34 |
openstackgerrit | Merged openstack/os-testr: Set min pbr version in setup_requires https://review.openstack.org/209691 | 00:35 |
*** bapalm has joined #openstack-infra | 00:37 | |
*** thorst has joined #openstack-infra | 00:37 | |
greghaynes | SpamapS: dhcp, and then no rule for http to grab ipxe firmware | 00:37 |
greghaynes | SpamapS: I just -i brbm -j ACCEPT | 00:37 |
SpamapS | greghaynes: err.. careful | 00:37 |
*** thorst has quit IRC | 00:37 | |
greghaynes | hehe | 00:38 |
SpamapS | greghaynes: IIRC, Ironic listens w/ noauth | 00:38 |
SpamapS | greghaynes: so all 10.x boxes can probably wreak havoc on ironic with that rule. | 00:38 |
greghaynes | yes | 00:38 |
greghaynes | I only have the one host enrolled though | 00:39 |
greghaynes | I did mention that you would like that rule though ;) | 00:39 |
greghaynes | SpamapS: Oh, I think we should try and give crinkle access to these hosts? | 00:39 |
*** bapalm has quit IRC | 00:39 | |
greghaynes | SpamapS: I showed her what all is where | 00:40 |
*** gyee has quit IRC | 00:41 | |
*** btully has quit IRC | 00:41 | |
openstackgerrit | Morgan Fainberg proposed openstack/requirements: Cap keystoneclient at <2.0.0 https://review.openstack.org/209715 | 00:42 |
*** camunoz is now known as camunoz_away | 00:42 | |
*** tsekiyam_ has joined #openstack-infra | 00:45 | |
*** heyongli has joined #openstack-infra | 00:46 | |
*** mtanino has quit IRC | 00:46 | |
*** tsekiyama has quit IRC | 00:48 | |
*** tiswanso has joined #openstack-infra | 00:48 | |
*** baoli has quit IRC | 00:49 | |
*** tsekiyam_ has quit IRC | 00:50 | |
*** ivar-laz_ has joined #openstack-infra | 00:51 | |
openstackgerrit | Merged openstack-infra/project-config: networking-odl: Enable python3 job https://review.openstack.org/209212 | 00:52 |
*** ivar-lazzaro has quit IRC | 00:55 | |
*** ivar-laz_ has quit IRC | 00:56 | |
openstackgerrit | Merged openstack-infra/zuul: Fix bug with shared jobs in reconfiguration https://review.openstack.org/209686 | 00:56 |
*** bcourt has quit IRC | 00:56 | |
*** minwang2 has quit IRC | 01:00 | |
*** tiswanso has quit IRC | 01:01 | |
*** abitha has quit IRC | 01:02 | |
openstackgerrit | Vipul Sabhaya proposed openstack/requirements: Add cue and python-cueclient to projects.txt https://review.openstack.org/158013 | 01:03 |
*** baoli has joined #openstack-infra | 01:06 | |
*** puranamr has joined #openstack-infra | 01:07 | |
*** ybathia has quit IRC | 01:09 | |
*** tiswanso has joined #openstack-infra | 01:10 | |
*** tiswanso has quit IRC | 01:13 | |
*** tiswanso has joined #openstack-infra | 01:14 | |
*** annegentle has joined #openstack-infra | 01:14 | |
*** Sukhdev has quit IRC | 01:15 | |
*** gildub has quit IRC | 01:19 | |
ianw | greghaynes: what's the situation with the long host names? is that fixed yet? | 01:20 |
ianw | (well it's not fixed, but is it supposed to be :) | 01:21 |
*** dims_ has joined #openstack-infra | 01:21 | |
greghaynes | ianw: We chabged the nodepool hostname template IIRC | 01:21 |
ianw | greghaynes: http://logs.openstack.org/33/209633/2/check/gate-tempest-dsvm-centos7/b1c33cc//logs/devstacklog.txt.gz | 01:22 |
ianw | it causes issues for the centos job because apache tries to make a certficate, uses the hostname and it's too long, apache fails to install, devstakc is unhappy | 01:22 |
*** dims has quit IRC | 01:22 | |
clarkb | yes it should be fixed we dropped the slave.openstack.org | 01:23 |
clarkb | which gained us that many extra characters-1 | 01:23 |
greghaynes | ianw: I wonder if its getting fqdn elsewhere | 01:23 |
ianw | echo "devstack-centos7-1438784108.template.openstack.org.novalocal" | wc -c | 01:24 |
ianw | 61 | 01:24 |
ianw | maybe that's too big, let me find the bug | 01:24 |
greghaynes | yes, where is it getting that domain from | 01:24 |
greghaynes | because it shouldnt be that anymore | 01:24 |
clarkb | thats image build | 01:24 |
greghaynes | ah | 01:25 |
clarkb | which is different so maybe we need to fix that too? | 01:25 |
greghaynes | so I thought we fixed that in glean... | 01:25 |
*** dkalleg has quit IRC | 01:26 | |
*** alexsyip has quit IRC | 01:26 | |
*** sdake has joined #openstack-infra | 01:27 | |
greghaynes | although it shouldnt matter if the hostname isnt that | 01:27 |
greghaynes | such confusion | 01:27 |
greghaynes | http://git.openstack.org/cgit/openstack-infra/glean/commit/?id=e6e5322b884bc587364f6f025219122723d7545f | 01:29 |
greghaynes | yea, so that doubly shouldnt be happening on images :p | 01:29 |
*** sdake_ has joined #openstack-infra | 01:30 | |
*** MarkAtwo_ has quit IRC | 01:32 | |
StevenK | clarkb: Sorry, post-conference recovery. You/we probably need to work out a time that works with myself, camunoz_away and Daisy, and then approve that change while we're all watching. | 01:33 |
*** sdake has quit IRC | 01:34 | |
StevenK | clarkb: I'm tempted to bring up a test zanata server with current HEAD, then apply that change, re-run puppet and see what happens. | 01:34 |
clarkb | ya going to try hard to hit todays meeting | 01:34 |
clarkb | 1am local time but will try | 01:34 |
StevenK | Just ask the twins really nicely to wake you? :-P | 01:35 |
clarkb | exactly | 01:35 |
*** laughterwym has joined #openstack-infra | 01:36 | |
StevenK | clarkb: Maybe post to the mailing list? | 01:36 |
jroll | you have to ask for babies to wake you? | 01:36 |
*** sharikapongubala has quit IRC | 01:37 | |
*** warpc__ has quit IRC | 01:38 | |
greghaynes | its all about the timing ;) | 01:40 |
*** yamamoto has joined #openstack-infra | 01:46 | |
*** yamamoto has quit IRC | 01:47 | |
*** yamamoto has joined #openstack-infra | 01:47 | |
*** yamamoto has quit IRC | 01:49 | |
*** jogo has quit IRC | 01:49 | |
*** esmute_ has quit IRC | 01:50 | |
*** jogo has joined #openstack-infra | 01:50 | |
*** unicell has quit IRC | 01:52 | |
*** unicell has joined #openstack-infra | 01:53 | |
*** skylerberg has quit IRC | 01:53 | |
*** atuvenie has joined #openstack-infra | 01:55 | |
*** gildub has joined #openstack-infra | 01:55 | |
*** spzala has quit IRC | 01:57 | |
*** unicell has quit IRC | 01:58 | |
*** atuvenie_ has quit IRC | 01:59 | |
*** achanda has joined #openstack-infra | 02:00 | |
openstackgerrit | Merged openstack/diskimage-builder: Add element to disable cloud-init resizefs https://review.openstack.org/204263 | 02:01 |
*** dims has joined #openstack-infra | 02:03 | |
*** dims_ has quit IRC | 02:05 | |
*** dims_ has joined #openstack-infra | 02:06 | |
*** dims has quit IRC | 02:09 | |
*** btully has joined #openstack-infra | 02:09 | |
*** sdake_ has quit IRC | 02:09 | |
*** maxandersen has quit IRC | 02:10 | |
*** markvoelker has quit IRC | 02:11 | |
*** baoli has quit IRC | 02:12 | |
*** markvoelker has joined #openstack-infra | 02:12 | |
*** darrenc is now known as darrenc_afk | 02:12 | |
*** enikanorov has joined #openstack-infra | 02:12 | |
*** baoli has joined #openstack-infra | 02:12 | |
*** bharath has quit IRC | 02:13 | |
*** btully has quit IRC | 02:13 | |
*** chen12 has joined #openstack-infra | 02:15 | |
*** enikanorov_ has quit IRC | 02:15 | |
*** otter768 has joined #openstack-infra | 02:15 | |
chen12 | hello, can anyone review https://review.openstack.org/#/c/207050/ & https://review.openstack.org/#/c/209728/ | 02:15 |
*** angdraug has quit IRC | 02:17 | |
*** esmute_ has joined #openstack-infra | 02:17 | |
*** unicell has joined #openstack-infra | 02:18 | |
*** puranamr has quit IRC | 02:19 | |
*** BharatK has quit IRC | 02:19 | |
*** otter768 has quit IRC | 02:19 | |
*** dannywilson has quit IRC | 02:20 | |
*** sabeen1 has quit IRC | 02:21 | |
*** unicell1 has joined #openstack-infra | 02:22 | |
*** dims_ has quit IRC | 02:22 | |
*** unicell has quit IRC | 02:22 | |
*** tjones has joined #openstack-infra | 02:26 | |
*** tsg has joined #openstack-infra | 02:31 | |
*** claudiub has quit IRC | 02:34 | |
*** tsg has quit IRC | 02:36 | |
*** yamamoto has joined #openstack-infra | 02:39 | |
*** puranamr has joined #openstack-infra | 02:40 | |
openstackgerrit | Yanyan Hu proposed openstack-infra/project-config: Add functional test jobs for Senlin project https://review.openstack.org/209736 | 02:44 |
*** aukhan has joined #openstack-infra | 02:44 | |
*** BobBall_AWOL is now known as BobBall | 02:50 | |
*** Somay has joined #openstack-infra | 02:50 | |
*** stevemar has joined #openstack-infra | 02:50 | |
openstackgerrit | Merged openstack-infra/puppet-bugdaystats: Remove puppet-lint-numericvariable gem https://review.openstack.org/204350 | 02:50 |
openstackgerrit | Matthew Treinish proposed openstack-infra/elastic-recheck: WIP: Add support to filter results by failure test_ids https://review.openstack.org/209712 | 02:55 |
*** rfolco has quit IRC | 02:56 | |
openstackgerrit | Merged openstack-infra/puppet-bup: Remove puppet-lint-numericvariable gem https://review.openstack.org/204351 | 02:59 |
*** krtaylor has quit IRC | 02:59 | |
openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Don't run any tests on puppet-dashboard https://review.openstack.org/209740 | 03:01 |
openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Don't run any tests on puppet-dashboard https://review.openstack.org/209740 | 03:02 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add controller class for Infra Cloud https://review.openstack.org/209698 | 03:03 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: First stab at making things bifrosty https://review.openstack.org/208751 | 03:03 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Create playbook to puppet InfraCloud nodes https://review.openstack.org/209632 | 03:03 |
*** markvoelker has quit IRC | 03:04 | |
*** stevemar has quit IRC | 03:09 | |
*** stevemar has joined #openstack-infra | 03:09 | |
*** dingyichen has quit IRC | 03:10 | |
*** dingyichen has joined #openstack-infra | 03:11 | |
*** krtaylor has joined #openstack-infra | 03:12 | |
*** puranamr has quit IRC | 03:12 | |
*** tjones has quit IRC | 03:13 | |
*** stevemar has quit IRC | 03:13 | |
*** bharath has joined #openstack-infra | 03:13 | |
*** fedexo has joined #openstack-infra | 03:15 | |
openstackgerrit | Merged openstack-infra/puppet-cgit: Add better defaults for clone-prefix https://review.openstack.org/204245 | 03:18 |
*** bharath has quit IRC | 03:18 | |
*** minwang2 has joined #openstack-infra | 03:21 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add controller class for Infra Cloud https://review.openstack.org/209698 | 03:23 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Create playbook to puppet InfraCloud nodes https://review.openstack.org/209632 | 03:23 |
*** harlowja_at_home has joined #openstack-infra | 03:24 | |
*** dmorita has quit IRC | 03:25 | |
*** dmorita has joined #openstack-infra | 03:25 | |
*** baoli has quit IRC | 03:26 | |
*** doug-fish has quit IRC | 03:26 | |
*** doug-fish has joined #openstack-infra | 03:26 | |
*** fedexo has quit IRC | 03:26 | |
*** boris-42 has joined #openstack-infra | 03:27 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add controller class for Infra Cloud https://review.openstack.org/209698 | 03:27 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: First stab at making things bifrosty https://review.openstack.org/208751 | 03:27 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add openstack-modules.env https://review.openstack.org/209617 | 03:27 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Create playbook to puppet InfraCloud nodes https://review.openstack.org/209632 | 03:27 |
*** hemna has joined #openstack-infra | 03:30 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add controller class for Infra Cloud https://review.openstack.org/209698 | 03:30 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: First stab at making things bifrosty https://review.openstack.org/208751 | 03:30 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add openstack-modules.env https://review.openstack.org/209617 | 03:30 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Create playbook to puppet InfraCloud nodes https://review.openstack.org/209632 | 03:30 |
openstackgerrit | Merged openstack-infra/puppet-cgit: Ensure cgit dir is created after parent directory https://review.openstack.org/203867 | 03:32 |
*** tiswanso has quit IRC | 03:33 | |
openstackgerrit | Merged openstack-infra/puppet-elasticsearch: Add Gemfile and puppet 4 checks https://review.openstack.org/203886 | 03:33 |
*** puranamr has joined #openstack-infra | 03:34 | |
*** hemna has quit IRC | 03:34 | |
*** bpokorny has quit IRC | 03:34 | |
openstackgerrit | Merged openstack-infra/puppet-etherpad_lite: Fix warning about httpd module https://review.openstack.org/202761 | 03:34 |
*** marzif__ has joined #openstack-infra | 03:35 | |
*** darrenc_afk is now known as darrenc | 03:36 | |
*** dmorita has quit IRC | 03:42 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add controller class for Infra Cloud https://review.openstack.org/209698 | 03:42 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: First stab at making things bifrosty https://review.openstack.org/208751 | 03:42 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add openstack-modules.env https://review.openstack.org/209617 | 03:42 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Create playbook to puppet InfraCloud nodes https://review.openstack.org/209632 | 03:42 |
*** achanda has quit IRC | 03:44 | |
openstackgerrit | Merged openstack-infra/puppet-drupal: Add Gemfile and puppet 4 checks https://review.openstack.org/203881 | 03:45 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add controller class for Infra Cloud https://review.openstack.org/209698 | 03:46 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add controller class for Infra Cloud https://review.openstack.org/209698 | 03:48 |
nibalizer | Hey so I just fat-finger +a'd 206648 | 03:49 |
nibalizer | does leaving -2 on it mean that it won't land or is more action needed? | 03:49 |
nibalizer | clarkb: jhesketh ? | 03:50 |
*** fedexo has joined #openstack-infra | 03:51 | |
jhesketh | nibalizer: gerrit should reject the submit from zuul because its pre-reqs aren't met (needs verified and needs workflow) | 03:54 |
jhesketh | however, we'll find out in a minute ;-) | 03:54 |
*** pal has joined #openstack-infra | 03:55 | |
clarkb | correct -2 prevents tge merge as does breakinf any other req like removing the +a | 03:55 |
*** ayoung has quit IRC | 03:56 | |
jhesketh | nibalizer: looks fine. zuul's left a +2, but hasn't merged it | 03:56 |
nibalizer | okay | 03:57 |
nibalizer | thanks | 03:57 |
*** coolsvap|away is now known as coolsvap | 03:58 | |
*** fedexo has quit IRC | 03:59 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add controller class for Infra Cloud https://review.openstack.org/209698 | 03:59 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: First stab at making things bifrosty https://review.openstack.org/208751 | 03:59 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add openstack-modules.env https://review.openstack.org/209617 | 03:59 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Create playbook to puppet InfraCloud nodes https://review.openstack.org/209632 | 03:59 |
greghaynes | SpamapS: so, I got the .3 reloaded. Having some networking issues on it though. Do I need to be making an interface for tagged vlan 25 to talk via 15.x? | 03:59 |
*** Somay has quit IRC | 04:00 | |
*** harlowja_at_home has quit IRC | 04:03 | |
*** markvoelker has joined #openstack-infra | 04:04 | |
*** fedexo has joined #openstack-infra | 04:06 | |
openstackgerrit | Merged openstack-infra/puppet-gerritbot: Use instance variables in templates https://review.openstack.org/205263 | 04:06 |
*** markvoelker has quit IRC | 04:09 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit: Add Gemfile and puppet 4 checks https://review.openstack.org/203870 | 04:10 |
openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit: Use instance variables in templates https://review.openstack.org/203869 | 04:10 |
*** chen12 has quit IRC | 04:11 | |
*** chen12 has joined #openstack-infra | 04:11 | |
*** bharath has joined #openstack-infra | 04:15 | |
*** otter768 has joined #openstack-infra | 04:16 | |
*** yushiro has joined #openstack-infra | 04:17 | |
*** bharath has quit IRC | 04:19 | |
*** otter768 has quit IRC | 04:21 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add controller class for Infra Cloud https://review.openstack.org/209698 | 04:21 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: First stab at making things bifrosty https://review.openstack.org/208751 | 04:21 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add openstack-modules.env https://review.openstack.org/209617 | 04:21 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Create playbook to puppet InfraCloud nodes https://review.openstack.org/209632 | 04:21 |
*** puranamr has quit IRC | 04:22 | |
*** dmorita has joined #openstack-infra | 04:24 | |
*** stevemar has joined #openstack-infra | 04:24 | |
*** tsg has joined #openstack-infra | 04:25 | |
*** minwang2 has quit IRC | 04:25 | |
openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add swift to dsvm doc/unit-test skip https://review.openstack.org/209751 | 04:31 |
*** esmute_ has quit IRC | 04:32 | |
mordred | greghaynes: it is my understanding that you need to tell the interface to talk on vlan 25 | 04:35 |
greghaynes | hrm | 04:35 |
greghaynes | this is especially fun given that the host doesnt have connectivity or the vlan package | 04:36 |
*** garyk has quit IRC | 04:36 | |
*** BharatK has joined #openstack-infra | 04:36 | |
*** MarkAtwood has joined #openstack-infra | 04:37 | |
*** pal has quit IRC | 04:38 | |
greghaynes | mordred: aha! you are correct | 04:40 |
*** fedexo has quit IRC | 04:40 | |
*** annegentle has quit IRC | 04:41 | |
*** deepakcs has joined #openstack-infra | 04:42 | |
*** fedexo has joined #openstack-infra | 04:43 | |
openstackgerrit | Yushiro FURUKAWA proposed openstack-infra/infra-manual: Insert further details of the procedure https://review.openstack.org/209753 | 04:43 |
*** tsg has quit IRC | 04:43 | |
*** tsg has joined #openstack-infra | 04:44 | |
*** tjones has joined #openstack-infra | 04:44 | |
*** yfried has quit IRC | 04:46 | |
clarkb | the lack of untagged vlan bites again | 04:47 |
*** fedexo has quit IRC | 04:47 | |
*** monester has joined #openstack-infra | 04:48 | |
greghaynes | yeaa | 04:48 |
greghaynes | soo scping deb's onto the box | 04:49 |
StevenK | Been there, done that | 04:49 |
*** achanda has joined #openstack-infra | 04:50 | |
StevenK | "Oh great, the modules for the network card don't load. Let me build them on my laptop and copy them via USB key." | 04:50 |
*** abregman has joined #openstack-infra | 04:52 | |
*** nadya has joined #openstack-infra | 04:54 | |
*** btully has joined #openstack-infra | 04:54 | |
*** fedexo has joined #openstack-infra | 04:58 | |
*** MarkAtwood has quit IRC | 04:59 | |
*** harlowja_at_home has joined #openstack-infra | 05:00 | |
SpamapS | greghaynes: yes, 15.x is only on vlan25 | 05:00 |
*** MarkAtwood has joined #openstack-infra | 05:00 | |
*** monester has quit IRC | 05:04 | |
greghaynes | SpamapS: We should definitely have the vlan package in the image ;) | 05:05 |
*** minwang2 has joined #openstack-infra | 05:05 | |
StevenK | You can't see vlan using ip? | 05:06 |
StevenK | s/see/set/ | 05:06 |
greghaynes | hrm | 05:06 |
greghaynes | you might | 05:06 |
StevenK | ip link add link eth0 name eth0.1234 type vlan id 1234 | 05:07 |
*** tjones has quit IRC | 05:08 | |
*** bharath_ has joined #openstack-infra | 05:15 | |
*** pal has joined #openstack-infra | 05:16 | |
*** bharath_ has quit IRC | 05:20 | |
*** sergmelikyan has joined #openstack-infra | 05:21 | |
*** jkraj has joined #openstack-infra | 05:21 | |
*** camunoz_away is now known as camunoz | 05:23 | |
harlowja_at_home | ianw, if u interested, http://logs.openstack.org/60/209260/2/check/gate-anvil-rpms-dsvm-devstack-centos7/c42db75/console.html#_2015-08-06_01_19_45_369 (templates of spec files getting made), http://logs.openstack.org/60/209260/2/check/gate-anvil-rpms-dsvm-devstack-centos7/c42db75/console.html#_2015-08-06_01_19_30_550 (dependencies getting built automatically into rpms...) | 05:25 |
*** achanda has quit IRC | 05:25 | |
harlowja_at_home | *or anyone else that cares, that log is neat imho :-P | 05:25 |
harlowja_at_home | starts from http://logs.openstack.org/60/209260/2/check/gate-anvil-rpms-dsvm-devstack-centos7/c42db75/console.html#_2015-08-06_01_16_00_581 | 05:25 |
harlowja_at_home | git checkouts start @ http://logs.openstack.org/60/209260/2/check/gate-anvil-rpms-dsvm-devstack-centos7/c42db75/console.html#_2015-08-06_01_16_02_624 ... | 05:26 |
harlowja_at_home | finding dependencies in yum (to avoid building them) @ http://logs.openstack.org/60/209260/2/check/gate-anvil-rpms-dsvm-devstack-centos7/c42db75/console.html#_2015-08-06_01_17_18_583 ... | 05:27 |
harlowja_at_home | anyways | 05:27 |
harlowja_at_home | oh ya, same code builds venvs to @ http://logs.openstack.org/60/209260/2/check/gate-anvil-venv-bare-trusty/fe47818/ :-P | 05:28 |
harlowja_at_home | starting @ http://logs.openstack.org/60/209260/2/check/gate-anvil-venv-bare-trusty/fe47818/console.html#_2015-08-06_01_28_27_233 :-P | 05:28 |
*** yfried has joined #openstack-infra | 05:28 | |
ianw | harlowja_at_home: you do love your ascii art :) | 05:31 |
harlowja_at_home | haha | 05:31 |
*** achanda has joined #openstack-infra | 05:31 | |
*** yfried_ has joined #openstack-infra | 05:31 | |
harlowja_at_home | ianw, the cows make it the best :-P | 05:31 |
harlowja_at_home | the table creation like @ http://logs.openstack.org/60/209260/2/check/gate-anvil-rpms-dsvm-devstack-centos7/c42db75/console.html#_2015-08-06_01_16_01_565 is actually a pretty simple recursive algorithm | 05:32 |
*** yfried has quit IRC | 05:32 | |
harlowja_at_home | https://github.com/stackforge/anvil/blob/master/anvil/pprint.py | 05:32 |
harlowja_at_home | that 'somewhat simple' code, ha | 05:32 |
harlowja_at_home | but yes, happy cows like @ http://logs.openstack.org/60/209260/2/check/gate-anvil-venv-bare-trusty/fe47818/console.html#_2015-08-06_01_50_16_206 are good cows | 05:33 |
ianw | happy to have the cows and jobs working :) | 05:34 |
harlowja_at_home | ya, nearly working, the building from source rpm -> real rpm is busted, but i gotta investigate that locally | 05:35 |
harlowja_at_home | http://logs.openstack.org/60/209260/2/check/gate-anvil-rpms-dsvm-devstack-centos7/c42db75/console.html#_2015-08-06_01_21_38_957 | 05:35 |
*** k4n0 has joined #openstack-infra | 05:36 | |
*** harlowja_still_a has joined #openstack-infra | 05:36 | |
harlowja_still_a | arg, damn wirless | 05:36 |
harlowja_still_a | http://logs.openstack.org/60/209260/2/check/gate-anvil-rpms-dsvm-devstack-centos7/c42db75/console.html#_2015-08-06_01_21_37_406 | 05:36 |
harlowja_still_a | cffi something or other | 05:36 |
harlowja_still_a | probably missing a devel package | 05:36 |
harlowja_still_a | just gotta remember which one, ha | 05:37 |
ianw | hmm, do you need to copy the other log files out? | 05:39 |
harlowja_still_a | probably eventually, ha | 05:39 |
harlowja_still_a | its alot of log files though, ha | 05:39 |
harlowja_still_a | each rpmbuild --> its own log file.... | 05:39 |
*** harlowja_at_home has quit IRC | 05:39 | |
harlowja_still_a | * http://logs.openstack.org/60/209260/2/check/gate-anvil-rpms-dsvm-devstack-centos7/c42db75/console.html#_2015-08-06_01_20_22_732 (all go here) | 05:40 |
harlowja_still_a | but maybe, how's that done? | 05:40 |
harlowja_still_a | getting at '/home/jenkins/openstack/deps/output' would have all the goodness of what broke | 05:40 |
ianw | harlowja_still_a: see the scp publishers, to copy one directory should be straight-forward | 05:41 |
harlowja_still_a | k | 05:41 |
harlowja_still_a | let's see here | 05:42 |
*** yamahata has quit IRC | 05:43 | |
*** nadya has quit IRC | 05:50 | |
*** markvoelker has joined #openstack-infra | 05:51 | |
*** markvoelker has quit IRC | 05:56 | |
openstackgerrit | Joshua Harlow proposed openstack-infra/project-config: Add scp log extraction to anvil-jobs https://review.openstack.org/209763 | 05:56 |
harlowja_still_a | ianw, ok dokie | 05:56 |
harlowja_still_a | although should that be 'static.openstack.org' ? | 05:57 |
harlowja_still_a | not sure | 05:57 |
harlowja_still_a | for 'site: 'tarballs.openstack.org'' | 05:57 |
StevenK | clarkb: Your paste from your shell just makes me think of "MORBO IS PLEASED" | 05:57 |
*** jtomasek has quit IRC | 05:57 | |
ianw | harlowja_still_a: yeah, tarballs is not right, that where things like image outputs from builds go | 05:59 |
harlowja_still_a | hmmm | 05:59 |
harlowja_still_a | wherever u guys want it to go, i make it happen, lol | 06:00 |
openstackgerrit | Yanyan Hu proposed openstack-infra/project-config: Add functional test jobs for Senlin project https://review.openstack.org/209736 | 06:01 |
*** dims has joined #openstack-infra | 06:03 | |
*** fedexo has quit IRC | 06:05 | |
harlowja_still_a | ianw, switching to static.openstack.org then i guess? | 06:08 |
*** pal has quit IRC | 06:08 | |
*** nadya has joined #openstack-infra | 06:09 | |
*** Yanyan has joined #openstack-infra | 06:09 | |
*** vlaza has joined #openstack-infra | 06:09 | |
*** dims has quit IRC | 06:09 | |
harlowja_still_a | or maybe logs.openstack.org | 06:09 |
harlowja_still_a | lots of options , haha | 06:09 |
*** isaacb has joined #openstack-infra | 06:12 | |
ianw | ahh, ping jhesketh, he's the main log guy :) i'll watch and learn | 06:13 |
jhesketh | o/ | 06:15 |
jhesketh | harlowja_still_a, ianw: what's up? | 06:15 |
harlowja_still_a | jhesketh, soooo | 06:15 |
harlowja_still_a | anvil job produces rpmbuild logs placing them in a directory | 06:16 |
harlowja_still_a | ie http://logs.openstack.org/60/209260/2/check/gate-anvil-rpms-dsvm-devstack-centos7/c42db75/console.html#_2015-08-06_01_21_37_407 | 06:16 |
harlowja_still_a | butttt on failure (or success) it'd be really useful to have those logs for viewing proposes | 06:16 |
harlowja_still_a | so i made https://review.openstack.org/#/c/209763/ | 06:17 |
*** otter768 has joined #openstack-infra | 06:17 | |
harlowja_still_a | but not sure on the 'site' part | 06:17 |
harlowja_still_a | jhesketh, so thats where u come in, ha | 06:17 |
harlowja_still_a | ie what site / special sauce needed in that review to get 'Output for build being placed in /home/jenkins/openstack/deps/output/rpmbuild-python-cliff-1.10.1-0.el7.centos.src.rpm.log' into a useful place | 06:18 |
jhesketh | harlowja_still_a: ah okay | 06:18 |
*** ParsectiX has joined #openstack-infra | 06:18 | |
jhesketh | harlowja_still_a: you probably want logs.o.o | 06:18 |
harlowja_still_a | k | 06:18 |
jhesketh | take a look at another job uploading to logs (doesn't have to be a post job either) | 06:19 |
harlowja_still_a | target: 'tarballs/anvil/deps/output/' is ok? or something else? | 06:19 |
*** pal has joined #openstack-infra | 06:19 | |
jhesketh | harlowja_still_a: however, a better option would be to use the zuul swift uploader | 06:19 |
jhesketh | but that depends on what is in the output dir at the moment | 06:19 |
harlowja_still_a | i'm ok with that to | 06:19 |
harlowja_still_a | it will be 'openstack/deps/output/*' which will have a bunch of those files in it | 06:20 |
*** boris-42 has quit IRC | 06:20 | |
*** otter768 has quit IRC | 06:21 | |
*** e0ne has joined #openstack-infra | 06:21 | |
*** dmorita has quit IRC | 06:22 | |
jhesketh | harlowja_still_a: if they are all text then swift is the way to go | 06:22 |
jhesketh | harlowja_still_a: otherwise I lied and it should be static.openstack.org, something like http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml#n875 | 06:23 |
harlowja_still_a | ya, all text | 06:23 |
jhesketh | harlowja_still_a: in that case you could use the zuul-swift-upload-logs-with-console macro | 06:23 |
harlowja_still_a | hmm | 06:23 |
*** mrmartin has joined #openstack-infra | 06:24 | |
*** mrunge has joined #openstack-infra | 06:25 | |
openstackgerrit | Joshua Harlow proposed openstack-infra/project-config: Add better log + console extraction to anvil-jobs https://review.openstack.org/209763 | 06:25 |
harlowja_still_a | jhesketh, like ^ maybe? | 06:25 |
*** ashleighfarnham has joined #openstack-infra | 06:25 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/208820 | 06:28 |
*** yfried_ is now known as yfried|afk | 06:28 | |
jhesketh | harlowja_still_a: yep, that looks good to me :-) | 06:29 |
harlowja_still_a | cool | 06:29 |
harlowja_still_a | thx! | 06:29 |
*** yfried|afk is now known as yfried_ | 06:29 | |
harlowja_still_a | jhesketh, that will upload on failure or success (the scp jobs have a 'copy-after-failure: true' option that that one doesn't have) | 06:29 |
harlowja_still_a | (if u know) | 06:30 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove icehouse building for training-guides https://review.openstack.org/209776 | 06:30 |
jhesketh | harlowja_still_a: yes it should | 06:31 |
harlowja_still_a | cools | 06:31 |
*** nadya has quit IRC | 06:32 | |
openstackgerrit | Yushiro FURUKAWA proposed openstack-infra/infra-manual: Substitute from <projectname> to <repositoryname> https://review.openstack.org/209777 | 06:32 |
*** kushal has joined #openstack-infra | 06:33 | |
*** Trozz_ has joined #openstack-infra | 06:34 | |
*** ihrachyshka has joined #openstack-infra | 06:35 | |
*** yfried__ has joined #openstack-infra | 06:35 | |
*** yfried_ has quit IRC | 06:36 | |
*** harlowja_still_a has quit IRC | 06:37 | |
*** afazekas_ has joined #openstack-infra | 06:37 | |
mordred | greghaynes: I have an open todo list item to add grokking vlan information from config-drive to glean | 06:37 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove icehouse building for training-guides https://review.openstack.org/209776 | 06:39 |
*** marzif__ has quit IRC | 06:39 | |
mordred | greghaynes: since I'm at the beach and mostly useless ... if you wanted to do it - then we could pass in vlan25 at boot and whatnot | 06:39 |
*** che-arne has quit IRC | 06:42 | |
*** stevemar has quit IRC | 06:42 | |
*** jtomasek has joined #openstack-infra | 06:42 | |
mordred | greghaynes: https://review.openstack.org/#/c/167385/1/specs/liberty/approved/metadata-service-network-info.rst contains the spec for what the metadata in config-drive wants to look like | 06:43 |
*** minwang2 has quit IRC | 06:44 | |
mordred | greghaynes: unfortunately, the example decided to combine vlan and bonding, so reading it hurts the brain a little bit | 06:45 |
*** tsg has quit IRC | 06:45 | |
mordred | greghaynes: but best I can tell, a vlan on a non-bonded interface would just ahve the normal phy link defined and then the vlan link with vlan_link == the phy link defined | 06:46 |
StevenK | mordred: Like the example I posted with ip link add ? :-) | 06:51 |
*** scheuran has joined #openstack-infra | 06:52 | |
openstackgerrit | Monty Taylor proposed openstack-infra/glean: Add support for reading vlan information https://review.openstack.org/209784 | 06:54 |
mordred | StevenK: well, no - we want something to write teh vlan information properly into /etc/network/interfaces or the RH location when it's writing out the config files | 06:55 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove rally-jobs job group https://review.openstack.org/209786 | 06:55 |
mordred | StevenK: I mean, we DO want it to do the equivilent to your ip link add command :) | 06:55 |
*** sergmelikyan has quit IRC | 06:55 | |
mordred | TheJulia, greghaynes, StevenK, SpamapS: ^^ there is a VERY much non-working patch that adds a little bit of test fixture that should show what the input data from bifrost shoudl look like | 06:58 |
openstackgerrit | Monty Taylor proposed openstack-infra/glean: Add support for reading vlan information https://review.openstack.org/209784 | 06:59 |
mordred | (amended to link to the spec - because it took me a while to find it this time) | 06:59 |
mordred | and with that - I will go do laundry | 06:59 |
openstackgerrit | Merged openstack-infra/project-config: Add better log + console extraction to anvil-jobs https://review.openstack.org/209763 | 07:00 |
*** e0ne has quit IRC | 07:00 | |
*** yushiro has quit IRC | 07:01 | |
*** ifarkas has joined #openstack-infra | 07:02 | |
*** blogan has quit IRC | 07:03 | |
*** blogan has joined #openstack-infra | 07:04 | |
*** ashleighfarnham has quit IRC | 07:05 | |
*** ildikov has quit IRC | 07:07 | |
*** nadya has joined #openstack-infra | 07:07 | |
*** camunoz is now known as camunoz_gone | 07:07 | |
*** yushiro has joined #openstack-infra | 07:09 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove rally-jobs job group https://review.openstack.org/209786 | 07:09 |
*** zeih has joined #openstack-infra | 07:10 | |
*** e0ne has joined #openstack-infra | 07:11 | |
*** juggler_ has joined #openstack-infra | 07:14 | |
openstackgerrit | Steve Kowalik proposed openstack-infra/project-config: Add support for pulling translations from Zanata https://review.openstack.org/203928 | 07:15 |
*** juggler has quit IRC | 07:17 | |
*** yfried has joined #openstack-infra | 07:18 | |
*** claudiub has joined #openstack-infra | 07:20 | |
*** yfried__ has quit IRC | 07:21 | |
*** markus_z has joined #openstack-infra | 07:24 | |
*** ub has joined #openstack-infra | 07:26 | |
*** ildikov has joined #openstack-infra | 07:26 | |
*** e0ne has quit IRC | 07:26 | |
*** zeih has quit IRC | 07:27 | |
openstackgerrit | Witold Bedyk proposed openstack-infra/project-config: add gerrit groups for monasca-log https://review.openstack.org/208430 | 07:27 |
*** jschwarz has joined #openstack-infra | 07:27 | |
openstackgerrit | Merged openstack-infra/puppet-cgit: Use instance variables in templates https://review.openstack.org/203869 | 07:28 |
*** btully has quit IRC | 07:30 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove rally-jobs job group https://review.openstack.org/209786 | 07:31 |
*** witek has joined #openstack-infra | 07:35 | |
*** b10n1k has quit IRC | 07:37 | |
openstackgerrit | lyanchih proposed openstack/requirements: Bump oslo_versionedobjects to 6.0 https://review.openstack.org/209797 | 07:37 |
*** garyk has joined #openstack-infra | 07:40 | |
*** jcoufal has joined #openstack-infra | 07:45 | |
*** bradm has quit IRC | 07:48 | |
*** bradm has joined #openstack-infra | 07:48 | |
*** bookwar has quit IRC | 07:49 | |
*** bookwar has joined #openstack-infra | 07:49 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove rally-jobs job group https://review.openstack.org/209786 | 07:49 |
*** jlanoux has joined #openstack-infra | 07:50 | |
*** zeih has joined #openstack-infra | 07:52 | |
*** markvoelker has joined #openstack-infra | 07:52 | |
*** HeOS has quit IRC | 07:53 | |
*** sdake has joined #openstack-infra | 07:54 | |
*** dtantsur is now known as dtantsur|brb | 07:56 | |
*** markvoelker has quit IRC | 07:56 | |
*** fhubik has joined #openstack-infra | 07:57 | |
*** laughterwym has quit IRC | 07:58 | |
*** enikanorov has quit IRC | 07:59 | |
*** zeih has quit IRC | 07:59 | |
*** kiran-r has joined #openstack-infra | 08:10 | |
*** arxcruz has joined #openstack-infra | 08:10 | |
*** alexandrov has joined #openstack-infra | 08:11 | |
*** gildub has quit IRC | 08:12 | |
openstackgerrit | Steve Kowalik proposed openstack-infra/project-config: Add support for pulling translations from Zanata https://review.openstack.org/203928 | 08:13 |
*** cdent has joined #openstack-infra | 08:13 | |
*** achanda has quit IRC | 08:14 | |
*** jistr has joined #openstack-infra | 08:14 | |
*** achanda has joined #openstack-infra | 08:18 | |
*** otter768 has joined #openstack-infra | 08:18 | |
*** larainema has quit IRC | 08:18 | |
*** larainema has joined #openstack-infra | 08:18 | |
*** heyongli has quit IRC | 08:19 | |
*** heyongli has joined #openstack-infra | 08:19 | |
jamielennox | can i get build artifacts from jenkins jobs that have already failed without waiting for all the other build jobs to finish so that zuul picks it all up? | 08:21 |
*** e0ne has joined #openstack-infra | 08:22 | |
*** che-arne has joined #openstack-infra | 08:22 | |
*** dmellado has joined #openstack-infra | 08:22 | |
*** otter768 has quit IRC | 08:23 | |
*** Ala has joined #openstack-infra | 08:23 | |
*** sshnaidm has joined #openstack-infra | 08:25 | |
eantyshev | jamielennox: I reckon zuul writes preliminary results in debug log, you can search it | 08:26 |
jamielennox | that just gives me console though right | 08:26 |
jamielennox | i really need like devstacklog.txt | 08:26 |
jamielennox | and i don't want ot wait 20 minutes for the rest of the job to finish | 08:27 |
jamielennox | actually i think i need g-api.txt | 08:28 |
eantyshev | just debugged something in zuul recently, and seen reports like that: http://paste.openstack.org/show/411087/ | 08:29 |
*** larainema has quit IRC | 08:29 | |
*** achanda has quit IRC | 08:29 | |
*** larainema has joined #openstack-infra | 08:30 | |
eantyshev | probably, you can find logs link for completed builds there | 08:30 |
*** fhubik is now known as fhubik_afk | 08:30 | |
openstackgerrit | Merged openstack-infra/project-config: Adding swift3 to list of projects for particular ec2 job https://review.openstack.org/208535 | 08:31 |
eantyshev | if you are about seing devstacklog.txt of a running job, my way is to ssh into the slave and read it | 08:32 |
*** mfmcdonagh has joined #openstack-infra | 08:36 | |
*** mcdonagm has joined #openstack-infra | 08:36 | |
*** aviau has quit IRC | 08:37 | |
*** pal has quit IRC | 08:38 | |
*** gaurangt has joined #openstack-infra | 08:38 | |
*** HeOS has joined #openstack-infra | 08:38 | |
*** pal has joined #openstack-infra | 08:39 | |
*** fhubik_afk is now known as fhubik | 08:40 | |
*** achanda has joined #openstack-infra | 08:40 | |
*** e0ne has quit IRC | 08:41 | |
*** ihrachyshka has quit IRC | 08:43 | |
*** aviau has joined #openstack-infra | 08:43 | |
*** dmellado has quit IRC | 08:43 | |
*** dmellado has joined #openstack-infra | 08:44 | |
*** dingyichen has quit IRC | 08:46 | |
*** flepied has quit IRC | 08:47 | |
*** NithyaG has joined #openstack-infra | 08:48 | |
jamielennox | you can ssh into the jenkins slave? | 08:49 |
*** fhubik is now known as fhubik_afk | 08:50 | |
*** dmellado has quit IRC | 08:51 | |
*** achanda has quit IRC | 08:51 | |
*** dmellado has joined #openstack-infra | 08:51 | |
*** dmellado has quit IRC | 08:52 | |
*** dmellado has joined #openstack-infra | 08:52 | |
*** marzif__ has joined #openstack-infra | 08:54 | |
*** dmellado has quit IRC | 08:54 | |
*** dmellado has joined #openstack-infra | 08:55 | |
*** fhubik_afk is now known as fhubik | 08:55 | |
*** fhubik is now known as fhubik_afk | 08:55 | |
*** flepied has joined #openstack-infra | 08:55 | |
*** dmellado has quit IRC | 08:57 | |
*** yfried is now known as yfried|afk | 08:58 | |
*** dmellado has joined #openstack-infra | 08:58 | |
*** dmellado has quit IRC | 08:58 | |
*** dmellado has joined #openstack-infra | 08:58 | |
*** e0ne has joined #openstack-infra | 08:58 | |
*** sobersabre has joined #openstack-infra | 09:01 | |
*** jkraj has quit IRC | 09:04 | |
openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added new SF repository for Fuel Ironic plugin integration https://review.openstack.org/209112 | 09:05 |
openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added new SF repository for Fuel NSXV plugin integration https://review.openstack.org/209535 | 09:05 |
*** ashleighfarnham has joined #openstack-infra | 09:06 | |
*** Somay has joined #openstack-infra | 09:08 | |
*** fhubik_afk is now known as fhubik | 09:08 | |
*** ashleighfarnham has quit IRC | 09:10 | |
*** zeih has joined #openstack-infra | 09:15 | |
*** btully has joined #openstack-infra | 09:17 | |
*** yfried|afk is now known as yfried | 09:18 | |
*** monester has joined #openstack-infra | 09:19 | |
*** VivCheri has joined #openstack-infra | 09:20 | |
*** Somay has quit IRC | 09:21 | |
mescanef | hello, please review https://review.openstack.org/#/c/209535/ and https://review.openstack.org/#/c/209112/ | 09:21 |
mescanef | :-) | 09:21 |
*** btully has quit IRC | 09:22 | |
*** MarkAtwood has quit IRC | 09:22 | |
jokke_ | can someone boot that uvirtbot off from #openstack-meeting? | 09:24 |
*** yushiro has quit IRC | 09:25 | |
*** yamamoto has quit IRC | 09:26 | |
eantyshev | jamielennox, I am talking about my third-party CI | 09:28 |
*** yfried is now known as yfried|afk | 09:28 | |
*** Somay has joined #openstack-infra | 09:33 | |
*** jkraj has joined #openstack-infra | 09:40 | |
*** kushal has quit IRC | 09:41 | |
*** e0ne has quit IRC | 09:43 | |
*** kushal has joined #openstack-infra | 09:43 | |
*** yamamoto has joined #openstack-infra | 09:44 | |
*** zeih has quit IRC | 09:46 | |
*** deepakcs has quit IRC | 09:47 | |
*** mquin has quit IRC | 09:47 | |
*** aviau has quit IRC | 09:48 | |
*** dims has joined #openstack-infra | 09:49 | |
*** zeih has joined #openstack-infra | 09:49 | |
*** aviau has joined #openstack-infra | 09:50 | |
*** markvoelker has joined #openstack-infra | 09:53 | |
*** yfried|afk is now known as yfried | 09:53 | |
*** zeih has quit IRC | 09:54 | |
*** markvoelker has quit IRC | 09:57 | |
lifeless | jamespage: if you could follow up on https://github.com/testing-cabal/traceback2/pull/6 that would be good | 09:58 |
*** nagyz_ has joined #openstack-infra | 09:58 | |
jamespage | lifeless, I'll take another look - my fix was sceptical in the first place tbh | 09:59 |
*** e0ne has joined #openstack-infra | 09:59 | |
jlanoux | Hello. Could I have reviews on https://review.openstack.org/#/c/208481/ please? | 10:01 |
*** nagyz has quit IRC | 10:01 | |
*** nadya has quit IRC | 10:06 | |
ekarlso | oii gang | 10:10 |
ekarlso | does the gate use local.conf or localrc ? | 10:10 |
*** yfried is now known as yfried|afk | 10:11 | |
*** dtantsur|brb is now known as dtantsur | 10:15 | |
*** btully has joined #openstack-infra | 10:18 | |
*** otter768 has joined #openstack-infra | 10:18 | |
openstackgerrit | Kirill Zaitsev proposed openstack-infra/project-config: make gate-murano-dashboard-npm-run-lint voting https://review.openstack.org/209676 | 10:20 |
*** oomichi has quit IRC | 10:22 | |
*** btully has quit IRC | 10:22 | |
*** otter768 has quit IRC | 10:23 | |
*** Yanyan has quit IRC | 10:28 | |
*** fhubik is now known as fhubik_brb | 10:30 | |
*** yfried|afk is now known as yfried | 10:31 | |
*** pc_m has joined #openstack-infra | 10:31 | |
*** mwagner_lap has quit IRC | 10:39 | |
*** ihrachyshka has joined #openstack-infra | 10:39 | |
*** yfried is now known as yfried|afk | 10:41 | |
*** pal has quit IRC | 10:42 | |
*** mquin has joined #openstack-infra | 10:43 | |
*** gildub has joined #openstack-infra | 10:47 | |
*** doronshai has joined #openstack-infra | 10:48 | |
*** doronshai has quit IRC | 10:50 | |
*** pal has joined #openstack-infra | 10:50 | |
*** dims_ has joined #openstack-infra | 10:51 | |
*** e0ne has quit IRC | 10:52 | |
*** dims has quit IRC | 10:53 | |
*** markvoelker has joined #openstack-infra | 10:54 | |
*** e0ne has joined #openstack-infra | 10:54 | |
*** yfried|afk is now known as yfried | 10:55 | |
*** laughterwym has joined #openstack-infra | 10:57 | |
*** markvoelker has quit IRC | 10:58 | |
*** jkraj has quit IRC | 11:01 | |
*** fhubik_brb is now known as fhubik | 11:04 | |
clarkb | both | 11:06 |
*** sdake has quit IRC | 11:07 | |
*** pal has quit IRC | 11:07 | |
eantyshev | clarkb: I have another zuul review, which many people may be interested in: https://review.openstack.org/207094 | 11:09 |
*** MarkAtwood has joined #openstack-infra | 11:10 | |
*** pal has joined #openstack-infra | 11:15 | |
*** MarkAtwood has quit IRC | 11:15 | |
*** yamamoto has quit IRC | 11:16 | |
*** jkraj has joined #openstack-infra | 11:19 | |
*** vinayyadhav has joined #openstack-infra | 11:20 | |
*** vinayyadhav has quit IRC | 11:20 | |
*** vinayyadhav has joined #openstack-infra | 11:22 | |
*** spzala has joined #openstack-infra | 11:24 | |
*** thorst has joined #openstack-infra | 11:24 | |
openstackgerrit | Merged openstack-infra/project-config: Add Mistral gate that run unit tests and use postgresql https://review.openstack.org/207961 | 11:24 |
*** BharatK has quit IRC | 11:24 | |
*** gordc has joined #openstack-infra | 11:28 | |
openstackgerrit | Paul Michali proposed openstack-infra/project-config: Enable VPN DevStack plugin for neutron client https://review.openstack.org/209887 | 11:29 |
*** pc_m has quit IRC | 11:29 | |
*** hdd has joined #openstack-infra | 11:33 | |
*** Somay has quit IRC | 11:33 | |
*** gaurangt has left #openstack-infra | 11:34 | |
*** nadya has joined #openstack-infra | 11:35 | |
tobiash | 209686 | 11:38 |
*** fhubik is now known as fhubik_brb | 11:38 | |
*** dprince has joined #openstack-infra | 11:40 | |
*** e0ne has quit IRC | 11:41 | |
*** ub has quit IRC | 11:41 | |
*** fhubik_brb is now known as fhubik | 11:42 | |
*** e0ne has joined #openstack-infra | 11:44 | |
*** Somay has joined #openstack-infra | 11:47 | |
openstackgerrit | Joseph Lanoux proposed openstack-infra/project-config: Add non-voting job with ssh validation https://review.openstack.org/208481 | 11:51 |
*** pal has quit IRC | 11:52 | |
*** yamamoto has joined #openstack-infra | 11:55 | |
*** Somay has quit IRC | 11:56 | |
*** nelsnelson has quit IRC | 11:57 | |
openstackgerrit | Merged openstack-infra/zuul: Status: Use vertical-align for progress bar instead of margin https://review.openstack.org/170058 | 11:58 |
*** Somay has joined #openstack-infra | 11:58 | |
*** Somay has left #openstack-infra | 11:58 | |
*** vinay_yadhav has joined #openstack-infra | 11:59 | |
*** hdd has quit IRC | 12:00 | |
openstackgerrit | Lucas Alvares Gomes proposed openstack/diskimage-builder: Reduce the size of the ironic-agent ramdisk https://review.openstack.org/209902 | 12:02 |
*** yfried_ has joined #openstack-infra | 12:02 | |
*** hdd has joined #openstack-infra | 12:03 | |
*** vinayyadhav has quit IRC | 12:03 | |
*** yfried has quit IRC | 12:03 | |
*** vinay_yadhav has quit IRC | 12:04 | |
*** yfried__ has joined #openstack-infra | 12:05 | |
*** yfried_ has quit IRC | 12:08 | |
*** cburroughs has joined #openstack-infra | 12:12 | |
*** markvoelker has joined #openstack-infra | 12:16 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul: Support pagination in simplequery for Gerrit >=2.9 https://review.openstack.org/209906 | 12:17 |
jamielennox | is Depends-On handled for devstack patches? | 12:18 |
jamielennox | i say this because it doesn't appear so | 12:18 |
*** pc_m has joined #openstack-infra | 12:18 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul: Support pagination in simplequery for Gerrit >=2.9 https://review.openstack.org/209906 | 12:19 |
*** otter768 has joined #openstack-infra | 12:19 | |
*** unicell has joined #openstack-infra | 12:20 | |
*** unicell1 has quit IRC | 12:21 | |
*** mwagner_lap has joined #openstack-infra | 12:22 | |
jamielennox | actually - is Depends-On: supported for client library patches | 12:22 |
jamielennox | because it appears to work for patches attached to the server | 12:22 |
*** dims has joined #openstack-infra | 12:24 | |
*** bexelbie has joined #openstack-infra | 12:24 | |
*** otter768 has quit IRC | 12:24 | |
*** dims_ has quit IRC | 12:27 | |
fungi | jamielennox: depends-on will set up a logical dependency between changes, and in integration test jobs that know how to consume zuul refs for repos being tested it will also being the depended on change in as part of the test | 12:29 |
fungi | devstack-gate for example does consume zuul refs, but it depends on whether you're running a devstack-based job which is configured to consume that library from source or from release | 12:30 |
openstackgerrit | Merged openstack-infra/zuul: Status: Increase width of change-progress-row-left https://review.openstack.org/170059 | 12:30 |
jamielennox | fungi: so i've been trying to debug failure https://review.openstack.org/#/c/209351/ | 12:30 |
fungi | jamielennox: the majority of devstack-based jobs are configured to use released versions of libraries so that we avoid introducing fixes and then relying on those without first releasing them | 12:31 |
*** chen12 has quit IRC | 12:31 | |
jamielennox | i've got multiple depends-on trying to figure out what's going on | 12:31 |
jamielennox | the Depends-On that is linked to glance works, the depends-on for swiftclient and glance_store do not | 12:31 |
jamielennox | fungi: depends-on would seem to imply i want to LIBS_FROM_GIT though right? | 12:32 |
jamielennox | otherwise there's no way for me to test this stuff | 12:32 |
fungi | yeah, if you read the job setup logs, you'll likely see pip installing swiftclient and glance_store from pypi | 12:32 |
jamielennox | yep | 12:32 |
tobiash | hello, could I have reviews on https://review.openstack.org/#/q/status:open+project:openstack-infra/zuul+branch:master+topic:upload-pack-via-ssh,n,z please? | 12:32 |
jamielennox | so nothing i can do but wait for the library to be released | 12:32 |
jamielennox | ? | 12:32 |
fungi | jamielennox: there are some job templates, mostly only applied to the library projects themselves, which test the libraries from source | 12:32 |
fungi | but yeah, ask the library release team to expedite a release if there are pending bug fixes | 12:33 |
jamielennox | fungi: will do. thanks | 12:34 |
*** baoli has joined #openstack-infra | 12:35 | |
*** aysyd has joined #openstack-infra | 12:36 | |
*** hdd has quit IRC | 12:36 | |
*** olaph has quit IRC | 12:40 | |
*** bapalm has joined #openstack-infra | 12:44 | |
*** pblaho has quit IRC | 12:46 | |
*** pblaho has joined #openstack-infra | 12:46 | |
*** laughterwym has quit IRC | 12:46 | |
*** zul has joined #openstack-infra | 12:46 | |
*** laughterwym has joined #openstack-infra | 12:46 | |
*** baoli_ has joined #openstack-infra | 12:47 | |
*** abregman has quit IRC | 12:47 | |
*** baoli has quit IRC | 12:49 | |
*** hdd has joined #openstack-infra | 12:50 | |
*** afazekas_ has quit IRC | 12:50 | |
*** krtaylor has quit IRC | 12:50 | |
*** yamamoto has quit IRC | 12:50 | |
*** ogelbukh has joined #openstack-infra | 12:50 | |
*** yfried has joined #openstack-infra | 12:50 | |
*** mriedem_away has quit IRC | 12:53 | |
*** marzif__ has quit IRC | 12:53 | |
*** marzif__ has joined #openstack-infra | 12:54 | |
*** pc_m has quit IRC | 12:54 | |
*** yfried__ has quit IRC | 12:54 | |
*** bexelbie_ has joined #openstack-infra | 12:55 | |
*** che-arne has quit IRC | 12:55 | |
*** bexelbie has quit IRC | 12:57 | |
*** bexelbie_ is now known as bexelbie | 12:57 | |
*** olaph has joined #openstack-infra | 12:57 | |
*** pal has joined #openstack-infra | 12:57 | |
*** che-arne has joined #openstack-infra | 12:58 | |
*** bcourt has joined #openstack-infra | 12:59 | |
*** MarkAtwood has joined #openstack-infra | 13:00 | |
openstackgerrit | Jan Hruban proposed openstack-infra/infra-specs: Zuul github-integration spec. https://review.openstack.org/163637 | 13:00 |
*** yamamoto has joined #openstack-infra | 13:02 | |
*** rlandy has joined #openstack-infra | 13:02 | |
*** krtaylor has joined #openstack-infra | 13:03 | |
*** tobiash has quit IRC | 13:03 | |
*** tobiash has joined #openstack-infra | 13:03 | |
*** yamamoto has quit IRC | 13:04 | |
*** tobiash has quit IRC | 13:05 | |
*** MarkAtwood has quit IRC | 13:05 | |
*** tsg has joined #openstack-infra | 13:05 | |
*** pc_m has joined #openstack-infra | 13:06 | |
*** ashleighfarnham has joined #openstack-infra | 13:07 | |
*** hdd has quit IRC | 13:08 | |
*** yamamoto has joined #openstack-infra | 13:09 | |
*** yamamoto has quit IRC | 13:10 | |
*** gildub has quit IRC | 13:10 | |
*** jtomasek has quit IRC | 13:10 | |
*** yamamoto has joined #openstack-infra | 13:10 | |
*** dolphm has left #openstack-infra | 13:10 | |
*** tlian has joined #openstack-infra | 13:11 | |
*** kiran-r has quit IRC | 13:11 | |
*** ashleighfarnham has quit IRC | 13:12 | |
*** sergmelikyan has joined #openstack-infra | 13:15 | |
*** che-arne has quit IRC | 13:15 | |
*** hdd has joined #openstack-infra | 13:15 | |
*** hdd has quit IRC | 13:16 | |
*** k4n0 has quit IRC | 13:18 | |
*** rfolco has joined #openstack-infra | 13:18 | |
openstackgerrit | Victor Ryzhenkin proposed openstack-infra/project-config: Add opportunity to install muranoclient from change https://review.openstack.org/204159 | 13:18 |
*** jpeeler has quit IRC | 13:20 | |
openstackgerrit | yolanda.robla proposed openstack-infra/puppet-gerrit: Add module to handle welcome rsa key https://review.openstack.org/209929 | 13:27 |
openstackgerrit | Khai Do proposed stackforge/python-jenkins: Rework the examples https://review.openstack.org/207590 | 13:27 |
*** tiswanso has joined #openstack-infra | 13:27 | |
*** tobiash has joined #openstack-infra | 13:27 | |
openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/puppet-zuul: Add known_hosts class https://review.openstack.org/209930 | 13:27 |
*** amitgandhinz has joined #openstack-infra | 13:29 | |
*** btully has joined #openstack-infra | 13:29 | |
*** ldnunes has joined #openstack-infra | 13:29 | |
openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/puppet-openstackci: Reuse puppet-zuul known_hosts class https://review.openstack.org/209932 | 13:30 |
*** marcusvrn has joined #openstack-infra | 13:30 | |
*** mriedem has joined #openstack-infra | 13:31 | |
greghaynes | mordred: hah, usually being useless on a beach doesnt involve submitting patches for new features ;) | 13:31 |
*** dkranz has joined #openstack-infra | 13:31 | |
greghaynes | ah, just the test data updaating | 13:32 |
*** mestery has quit IRC | 13:32 | |
*** jpeeler has joined #openstack-infra | 13:33 | |
*** jpeeler has quit IRC | 13:33 | |
*** jpeeler has joined #openstack-infra | 13:33 | |
*** che-arne has joined #openstack-infra | 13:34 | |
*** pc_m has quit IRC | 13:36 | |
*** yfried is now known as yfried|afk | 13:37 | |
*** mestery has joined #openstack-infra | 13:38 | |
*** alivigni has joined #openstack-infra | 13:38 | |
Shrews | greghaynes: you don't give him enough credit. mordred can be useless from _anywhere_ | 13:38 |
*** alexandrov has quit IRC | 13:39 | |
*** Ala has quit IRC | 13:39 | |
*** ayoung has joined #openstack-infra | 13:39 | |
pabelanger | jeblair: cool. looking into patch now. Awesome that we can add a unit test to expose it | 13:40 |
*** yfried|afk is now known as yfried | 13:40 | |
*** serg_melikyan has joined #openstack-infra | 13:41 | |
*** sergmelikyan has quit IRC | 13:42 | |
*** mriedem has quit IRC | 13:43 | |
*** bknudson has joined #openstack-infra | 13:44 | |
*** olaph has quit IRC | 13:44 | |
*** mriedem has joined #openstack-infra | 13:46 | |
greghaynes | haah | 13:46 |
*** jswarren has joined #openstack-infra | 13:46 | |
openstackgerrit | yolanda.robla proposed openstack-infra/puppet-gerrit: Allow to specify git directory to run the mirror repack https://review.openstack.org/209938 | 13:46 |
*** olaph has joined #openstack-infra | 13:46 | |
openstackgerrit | Paul Belanger proposed openstack-infra/puppet-etherpad_lite: Add Gemfile and puppet 4 checks https://review.openstack.org/204242 | 13:46 |
*** Ala has joined #openstack-infra | 13:47 | |
yolanda | hi pabelanger, wanted to check with you... | 13:47 |
yolanda | we found some conflict between grafana dependency, camptocamp-archive | 13:47 |
yolanda | and puppetcommunity-archive | 13:47 |
yolanda | did you find the same? | 13:47 |
*** MarkAtwood has joined #openstack-infra | 13:49 | |
pabelanger | yolanda: not sure. What are you seeing? | 13:49 |
yolanda | pabelanger, to bfraser/grafana module has this dep | 13:50 |
yolanda | "dependencies": [ | 13:50 |
yolanda | { | 13:50 |
yolanda | "name": "camptocamp/archive", | 13:50 |
yolanda | "version_requirement": ">= 0.3.2 <2.0.0" | 13:50 |
yolanda | }, | 13:50 |
yolanda | and we also install in our modules the nanliu archive module | 13:50 |
yolanda | they have the same name | 13:50 |
yolanda | so it gave a conflict in our installs, if you want to bring the grafana dependency | 13:50 |
jswarren | hi gmann, I think https://review.openstack.org/#/c/208045/ is ready to go. | 13:51 |
pabelanger | yolanda: Hmm, right now we arn't actually using archive inside puppet-grafana, so not sure of the dependency issue you are running into. How are you installing the module? | 13:51 |
yolanda | pabelanger, we were installing from modules, not from source, so that was were we discovered the problem. I guess the grafana dep is not being installed, and just ignored , when installed from source? | 13:52 |
yolanda | pabelanger, and this will mean that if at some point, we need to use grafana features that use archive, we can have a problem | 13:52 |
*** hexlibris has joined #openstack-infra | 13:52 | |
yolanda | pabelanger, basically if you install the nanliu archive module, then install grafana, it cannot be installed because a module with same name already exysts | 13:53 |
*** jaypipes has quit IRC | 13:53 | |
pabelanger | yolanda: right, the only feature that uses it is the install_method. I'm actually change it to use apt-get in the next patchset. So, right now we can ignore the dependency upstream | 13:53 |
pabelanger | yolanda: https://review.openstack.org/#/c/209218/ is the change to install_method=repo | 13:54 |
yolanda | ah yes, saw that. Well, we need to be careful about it, and don't use archive features on grafana | 13:55 |
*** sigmavirus24_awa is now known as sigmavirus24 | 13:55 | |
*** sdake has joined #openstack-infra | 13:55 | |
pabelanger | right | 13:56 |
*** austin81 has joined #openstack-infra | 13:57 | |
*** isaacb has quit IRC | 13:57 | |
yolanda | pabelanger, do you think it's worth adding a note on modules.env grafana module, about it? | 13:57 |
yolanda | it exploded for us downstream, so it can be an issue at some point | 13:57 |
pabelanger | yolanda: no preference about the comment. If you see value, I have no issues. | 13:58 |
yolanda | yes, i think a reminder won't hurt and will make us remember that there is a hidden conflict there | 13:59 |
*** pal has quit IRC | 13:59 | |
pabelanger | yolanda: however you raise a valid issue, our dependency management in system-config and openstack-infra/puppet-* kinda stinks | 13:59 |
*** hexlibris has quit IRC | 13:59 | |
*** pal has joined #openstack-infra | 13:59 | |
*** olaph has quit IRC | 14:00 | |
yolanda | pabelanger, tell us about that, for us downstream is even worse :) | 14:00 |
yolanda | going to add that comment to modules.env, just as reminder | 14:01 |
*** r-daneel has joined #openstack-infra | 14:01 | |
*** pc_m has joined #openstack-infra | 14:01 | |
*** olaph has joined #openstack-infra | 14:01 | |
*** hexlibris has joined #openstack-infra | 14:01 | |
*** dkranz has quit IRC | 14:01 | |
*** pc_m has quit IRC | 14:02 | |
*** ParsectiX has quit IRC | 14:02 | |
*** MarkAtwood has quit IRC | 14:03 | |
*** fhubik has quit IRC | 14:03 | |
*** pc_m has joined #openstack-infra | 14:03 | |
*** zz_dimtruck is now known as dimtruck | 14:05 | |
*** MarkAtwood has joined #openstack-infra | 14:05 | |
openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Add a reminder about grafana and puppet-archive conflict https://review.openstack.org/209946 | 14:05 |
yolanda | pabelanger, so that's it | 14:05 |
openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for nova segfault unit test bug 1482230 https://review.openstack.org/209947 | 14:05 |
openstack | bug 1482230 in OpenStack Compute (nova) "LibvirtConnTestCase.test_clean_shutdown_first_time causes subunit segfault" [Undecided,New] https://launchpad.net/bugs/1482230 | 14:05 |
*** tiswanso has quit IRC | 14:05 | |
*** radez_g0n3 is now known as radez | 14:06 | |
*** tiswanso has joined #openstack-infra | 14:07 | |
*** pal has quit IRC | 14:08 | |
*** MarkAtwood has quit IRC | 14:09 | |
*** tsg has quit IRC | 14:10 | |
*** tvanderwiel has joined #openstack-infra | 14:11 | |
*** pal has joined #openstack-infra | 14:12 | |
*** sdake has quit IRC | 14:14 | |
openstackgerrit | Victor Sergeyev proposed openstack/requirements: Fix url regexp to proceed oslo-specific url's properly https://review.openstack.org/209432 | 14:14 |
*** vlaza has quit IRC | 14:16 | |
*** dkranz has joined #openstack-infra | 14:16 | |
*** wenlock has joined #openstack-infra | 14:16 | |
pabelanger | fungi: if you have a moment this morning, do you mind a review for: https://review.openstack.org/#/c/209135/ Plan to monitor the commit for puppet-jobs too | 14:17 |
*** kushal has quit IRC | 14:19 | |
*** otter768 has joined #openstack-infra | 14:20 | |
*** radez is now known as radez_g0n3 | 14:20 | |
*** radez_g0n3 is now known as radez | 14:20 | |
ekarlso | What's the appropriate way to alter tempest.conf if we need to in the gate ? | 14:20 |
*** tvanderwiel has left #openstack-infra | 14:21 | |
*** pal has quit IRC | 14:23 | |
*** otter768 has quit IRC | 14:25 | |
*** dims has quit IRC | 14:25 | |
*** dims has joined #openstack-infra | 14:26 | |
*** afazekas_ has joined #openstack-infra | 14:28 | |
*** bswartz has joined #openstack-infra | 14:29 | |
openstackgerrit | yolanda.robla proposed openstack-infra/puppet-gerrit: Move local replication directory and repack to module https://review.openstack.org/209954 | 14:29 |
openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for nova segfault unit test bug 1482230 https://review.openstack.org/209947 | 14:29 |
openstack | bug 1482230 in OpenStack Compute (nova) "LibvirtConnTestCase.test_clean_shutdown_first_time causes subunit segfault" [High,Confirmed] https://launchpad.net/bugs/1482230 | 14:29 |
*** EricGonczer_ has joined #openstack-infra | 14:29 | |
openstackgerrit | yolanda.robla proposed openstack-infra/puppet-gerrit: Move local replication directory and repack to module https://review.openstack.org/209954 | 14:30 |
*** baoli_ has quit IRC | 14:30 | |
*** yfried_ has joined #openstack-infra | 14:30 | |
greghaynes | ianw: SpamapS That sfdisk patch makes me really want to break partitioning out into a separate element | 14:31 |
*** stevemar has joined #openstack-infra | 14:31 | |
openstackgerrit | Lucas Alvares Gomes proposed openstack/diskimage-builder: Reduce the size of the ironic-agent ramdisk https://review.openstack.org/209902 | 14:31 |
greghaynes | ianw: SpamapS At least then we can say "automated partitioning probably sucks for you, make your own element if you care" | 14:31 |
*** Zhongjun has joined #openstack-infra | 14:32 | |
greghaynes | SpamapS: Also, I think the deploy image on the bastion has both cloud-init and glean on it | 14:32 |
openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Add a reminder about grafana and puppet-archive conflict https://review.openstack.org/209946 | 14:32 |
*** isaacb has joined #openstack-infra | 14:32 | |
*** yfried has quit IRC | 14:33 | |
openstackgerrit | Merged openstack-infra/project-config: Don't use sudo to install bundler gem for puppet jobs https://review.openstack.org/209135 | 14:34 |
*** dmorita has joined #openstack-infra | 14:34 | |
*** pal has joined #openstack-infra | 14:34 | |
*** pradk has joined #openstack-infra | 14:34 | |
pc_m | Question for infra... There is a commit (https://review.openstack.org/#/c/194635/) that I added a Depends-On: clause for a commit (https://review.openstack.org/#/c/209887/) in project-config, but it doesn't seem to be using the dependency. Am I missing something? I just did a recheck of 194635 wondering if maybe the cause was because 209887 had not completed test run yet? | 14:35 |
*** yfried__ has joined #openstack-infra | 14:35 | |
*** isaacb has quit IRC | 14:35 | |
*** minwang2 has joined #openstack-infra | 14:36 | |
fungi | pc_m: it doesn't work that way. depends-on only gets used in integration tests and the project-config repo isn't used by the integration test jobs you're configuring there (it's used to drive automation which configures the test infrastructure itself) | 14:37 |
*** yfried_ has quit IRC | 14:38 | |
fungi | pc_m: the net effect of your depends-on header is that 194635 won't be allowed to merge until 209887 successfully merges | 14:38 |
*** jasondot_ is now known as jasondotstar | 14:38 | |
fungi | but it won't allow you to see the results of 209887 before it's actually merged and applied to the infrastructure | 14:39 |
gordc | hi, if any devstack folks are available, can we get help on https://review.openstack.org/#/c/207949/ to unblock a feature. | 14:39 |
fungi | pc_m: it's one of the things we want to improve with zuul v3 (moving job definitions into the projects being tested, which in theory would allow you to self-test changes to your job configs) | 14:40 |
fungi | gordc: you might consider asking in #openstack-qa | 14:40 |
pc_m | fungi: Thanks for the explanation! | 14:40 |
gordc | fungi: cool cool. figured everyone was here :) will move there | 14:41 |
pc_m | fungi: 209887 adds a needed devstack plugin enable for the job, and I was hoping to test that it was correct (looked right). | 14:41 |
fungi | gordc: most of them are probably also in here, but devstack patches are more on-topic in the qa channel since it's a qa-controlled repo, so in theory they're more likely to see your request | 14:42 |
openstackgerrit | Austin Clark proposed openstack-infra/subunit2sql: Update API docs to include alternative db layer initialization https://review.openstack.org/209960 | 14:42 |
fungi | pc_m: you should be able to manually test it if you have an appropriate machine to clone and run devstack-gate on | 14:42 |
*** marzif__ has quit IRC | 14:43 | |
*** yamamoto has quit IRC | 14:43 | |
*** afazekas_ has quit IRC | 14:43 | |
fungi | pc_m: https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/README.rst#n95 (hopefully that's still current anyway) | 14:44 |
*** marzif__ has joined #openstack-infra | 14:44 | |
pc_m | fungi: Awesome! Didn't know how to do that. | 14:44 |
*** patrickeast has joined #openstack-infra | 14:44 | |
*** tsekiyama has joined #openstack-infra | 14:44 | |
*** kiran-r has joined #openstack-infra | 14:45 | |
*** annegentle has joined #openstack-infra | 14:45 | |
fungi | pc_m: we do try to make sure that any jobs we run in our test infrastructure can also be similarly run by individual developers, and do our best to maintain documentation in support of that | 14:46 |
openstackgerrit | yolanda.robla proposed openstack-infra/puppet-gerrit: Move local replication directory and repack to module https://review.openstack.org/209954 | 14:46 |
*** bexelbie has quit IRC | 14:46 | |
*** kurtmartin has joined #openstack-infra | 14:47 | |
*** olaph has quit IRC | 14:47 | |
*** xyang has joined #openstack-infra | 14:49 | |
*** yamamoto has joined #openstack-infra | 14:49 | |
*** tqtran-afk has joined #openstack-infra | 14:49 | |
mtreinish | fungi: so the patch from yesterday that fixed the if check in run-docs.sh doesn't look like it's taken effect. Does it need to wait for a nodepool build or something? | 14:52 |
fungi | mtreinish: yeah, if it merged after image updates started, then it won't be in effect yet | 14:52 |
fungi | it's a change to a script which is baked into our worker images each day | 14:52 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Add 'push' and 'tag' github webhook events. https://review.openstack.org/191207 | 14:52 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Support GitHub PR webhooks https://review.openstack.org/163117 | 14:52 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Fix job hierarchy bug. https://review.openstack.org/192457 | 14:52 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Add basic Github Zuul Reporter. https://review.openstack.org/191312 | 14:52 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Allow list values in template parameters. https://review.openstack.org/191208 | 14:52 |
*** e0ne has quit IRC | 14:52 | |
mtreinish | fungi: ok, thats what I figured it. I guess I'll play the waiting game some more | 14:54 |
*** kurtmartin has quit IRC | 14:54 | |
fungi | mtreinish: do you happen to know what time it merged? | 14:54 |
mtreinish | 12:01 eastern: https://review.openstack.org/#/c/209305/ | 14:55 |
*** dangers_away is now known as dangers | 14:55 | |
fungi | i make that 16:01 utc, so a couple hours after image updates had started | 14:57 |
*** e0ne has joined #openstack-infra | 14:57 | |
fungi | ftr, our image updates start at 14:14 utc daily | 14:58 |
*** mriedem has quit IRC | 14:58 | |
fungi | and take upwards of 8 hours to complete | 14:58 |
fungi | though most will be done in the next hour or so | 14:58 |
*** r-daneel has quit IRC | 14:58 | |
*** mriedem has joined #openstack-infra | 14:58 | |
*** jkraj has quit IRC | 14:58 | |
*** achanda has joined #openstack-infra | 14:59 | |
*** tqtran-afk is now known as tqtran | 14:59 | |
*** kiran-r has quit IRC | 14:59 | |
*** bapalm_ has joined #openstack-infra | 15:00 | |
*** MarkAtwood has joined #openstack-infra | 15:00 | |
*** r-daneel has joined #openstack-infra | 15:01 | |
*** bapalm has quit IRC | 15:01 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/elastic-recheck: Add support to filter results by failure test_ids https://review.openstack.org/209712 | 15:01 |
*** witek has quit IRC | 15:03 | |
*** olaph has joined #openstack-infra | 15:04 | |
*** jaypipes has joined #openstack-infra | 15:05 | |
*** tiswanso has quit IRC | 15:05 | |
*** tiswanso has joined #openstack-infra | 15:06 | |
*** baoli has joined #openstack-infra | 15:07 | |
*** kurtmartin has joined #openstack-infra | 15:08 | |
openstackgerrit | Merged openstack-infra/project-config: Move multinode dvr job to neutron check list. https://review.openstack.org/209165 | 15:08 |
*** mtanino has joined #openstack-infra | 15:09 | |
*** BrandonL08 has joined #openstack-infra | 15:09 | |
*** achanda has quit IRC | 15:09 | |
*** bpokorny has joined #openstack-infra | 15:10 | |
*** zul has quit IRC | 15:10 | |
*** krtaylor has quit IRC | 15:13 | |
*** Ala has quit IRC | 15:14 | |
*** gyee has joined #openstack-infra | 15:14 | |
*** patrickeast has quit IRC | 15:14 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add method to add flavor extra specs https://review.openstack.org/209983 | 15:17 |
*** patrickeast has joined #openstack-infra | 15:18 | |
*** angdraug has joined #openstack-infra | 15:18 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/elastic-recheck: Add suppress-notification to the slow devstack query https://review.openstack.org/209984 | 15:19 |
openstackgerrit | Merged openstack-infra/elastic-recheck: Track nova net dhcp failures https://review.openstack.org/209699 | 15:19 |
*** dannywilson has joined #openstack-infra | 15:20 | |
*** jgriffith has quit IRC | 15:21 | |
*** WyAt has quit IRC | 15:21 | |
mtreinish | fungi: can you do me a favor when you get a chance and check on logstash.o.o if subunit2sql-db-manage is running? I just pushed a release that contained a migration | 15:22 |
*** btran has quit IRC | 15:22 | |
mtreinish | I think that we set it up to background the migrations to get around the timeouts but it makes it tricky to see if they're actually running | 15:23 |
fungi | mtreinish: root 27236 0.3 1.7 185032 35072 ? S 15:20 0:00 /usr/bin/python /usr/local/bin/subunit2sql-db-manage --config-file /etc/subunit2sql.conf upgrade head | 15:23 |
mtreinish | ok, then it's doing its thing | 15:23 |
mtreinish | I guess we'll see how long it takes to add a bunch of indexes | 15:23 |
*** tonytan4ever has joined #openstack-infra | 15:23 | |
mtreinish | well assuming we don't run out of space again | 15:23 |
*** sputnik13 has joined #openstack-infra | 15:24 | |
*** jgriffith has joined #openstack-infra | 15:25 | |
mtreinish | fungi: any bets on how long: http://git.openstack.org/cgit/openstack-infra/subunit2sql/tree/subunit2sql/migrations/versions/1ff737bef438_add_indexes_on_common_search_fields.py#n30 will take? :) | 15:25 |
*** yfried has joined #openstack-infra | 15:25 | |
*** jgriffith is now known as Guest57802 | 15:25 | |
fungi | i never spin the wheel without a cocktail in hand | 15:27 |
Swanson | nodepool questions here? | 15:27 |
fungi | Swanson: this is the best place for them, sure | 15:27 |
*** scheuran has quit IRC | 15:29 | |
Swanson | Simple one. I keep getting an error resolving archive.ubuntu.com while creating a trusty image. Any idea what config I could have screwed up? It doesn't seem to be a problem on the host I'm doing this on. | 15:29 |
mtreinish | fungi: heh, sounds like a good reason to get a cocktail then | 15:29 |
*** devvesa has joined #openstack-infra | 15:29 | |
*** abitha has joined #openstack-infra | 15:29 | |
*** yfried__ has quit IRC | 15:30 | |
*** ihrachyshka has quit IRC | 15:30 | |
fungi | Swanson: snapshot-based or using diskimage-builder? | 15:30 |
*** abitha has quit IRC | 15:30 | |
*** sdake has joined #openstack-infra | 15:31 | |
mescanef | hello, please review https://review.openstack.org/#/c/209535/ and https://review.openstack.org/#/c/209112/ | 15:31 |
mescanef | SergeyLukjanov: ^^ :-) | 15:31 |
*** MarkAtwood_ has joined #openstack-infra | 15:31 | |
*** ashleighfarnham has joined #openstack-infra | 15:31 | |
Swanson | fungi: diskimage-builder. | 15:32 |
Swanson | fungi: I think. (<- should tell you the level I'm at.) | 15:32 |
*** abitha has joined #openstack-infra | 15:32 | |
*** Guest55 has joined #openstack-infra | 15:32 | |
fungi | Swanson: okay, so sounds like dns resolution may be misconfigured inside the chroot diskimage-builder is creating | 15:32 |
*** olaph has quit IRC | 15:32 | |
*** sshnaidm has quit IRC | 15:33 | |
fungi | Swanson: you can tell whether it's a snapshot or dib based on whether there's a base-image parameter or a diskimage parameter | 15:35 |
fungi | (base-image means you're building a snapshot from a template vm, diskimage means you're using diskimage-builder locally in a chroot on the nodepool server itself) | 15:35 |
*** sputnik13 has quit IRC | 15:36 | |
Swanson | fungi: diskimage. Looking at a yaml file for nodepool now. | 15:36 |
*** sabeen1 has joined #openstack-infra | 15:36 | |
*** dkranz has quit IRC | 15:37 | |
fungi | yep, so chances are there's an issue with resolv.conf in the chroot dib has created | 15:37 |
mestery | Good morning infra folks! Any chance I can get someone to populate these gerrit groups with me so I can pass them on to the infoblox folks? https://review.openstack.org/#/admin/groups/1010,members and https://review.openstack.org/#/admin/groups/1009,members | 15:38 |
*** yfried has quit IRC | 15:38 | |
*** spzala has quit IRC | 15:38 | |
fungi | Swanson: i _think_ we configure the images to expect to resolve through a resolver daemon listening on the loopback interface. in a chroot i believe that means it's going to try to hit the loopback interface of the nodepool server | 15:39 |
fungi | Swanson: do you have a locally-running dns resolver daemon on your nodepool server? | 15:39 |
Swanson | fungi: I will in a moment if I'm not. | 15:40 |
*** kiran-r has joined #openstack-infra | 15:40 | |
fungi | Swanson: see if `host archive.ubuntu.com 127.0.0.1` on your nodepool server works | 15:40 |
Swanson | fungi: This probably explains the transient error I saw fly by where it couldn't resolve the dns of the nodepool server. | 15:40 |
*** mpaolino has joined #openstack-infra | 15:41 | |
openstackgerrit | Merged openstack-infra/elastic-recheck: Add suppress-notification to the slow devstack query https://review.openstack.org/209984 | 15:41 |
Swanson | fungi: That looks to be it. | 15:41 |
fungi | Swanson: yeah, due to the unreliable nature of the dns resolvers in our service providers' networks, we run an unbound daemon on all our workers and also on our long-lived servers (including our nodepool server) | 15:41 |
*** krtaylor has joined #openstack-infra | 15:42 | |
fungi | but that does point out an interesting interaction/dependency for our dib setup that i hadn't considered before | 15:42 |
*** jaypipes has quit IRC | 15:43 | |
openstackgerrit | Lucas Alvares Gomes proposed openstack/diskimage-builder: Reduce the size of the ironic-agent ramdisk https://review.openstack.org/209902 | 15:43 |
fungi | mestery: done | 15:43 |
mestery | fungi: thank you very much! | 15:43 |
fungi | yw | 15:43 |
*** tongli has joined #openstack-infra | 15:44 | |
*** tiswanso has quit IRC | 15:44 | |
openstackgerrit | Claudiu Belu proposed openstack-infra/project-config: Adds oslo.windows repository https://review.openstack.org/209204 | 15:45 |
*** sputnik13 has joined #openstack-infra | 15:46 | |
*** Guest55 has quit IRC | 15:48 | |
*** BrandonL18 has joined #openstack-infra | 15:48 | |
jlanoux | Hello. May I have reviews on https://review.openstack.org/#/c/208481/ please? | 15:49 |
*** tiswanso has joined #openstack-infra | 15:49 | |
markus_z | I'm preparing a query for yesterday's Nova bug triage day. I use the data from http://status.openstack.org/bugday/ What's the timezone of that? | 15:49 |
*** dguerri` is now known as dguerri | 15:50 | |
*** btully has quit IRC | 15:50 | |
*** sputnik13 has quit IRC | 15:50 | |
*** dkranz has joined #openstack-infra | 15:50 | |
*** BrandonL08 has quit IRC | 15:51 | |
*** jgriffith has joined #openstack-infra | 15:52 | |
*** ivar-lazzaro has joined #openstack-infra | 15:52 | |
*** jaypipes has joined #openstack-infra | 15:56 | |
fungi | markus_z: looks like utc | 15:57 |
*** ivar-laz_ has joined #openstack-infra | 15:57 | |
markus_z | fungi: UTC+0? | 15:58 |
fungi | markus_z: i think so. for me at least the graph seems to be ending at almost 16:00 on the right-hand side, and it's almost 16:00 utc now | 15:59 |
*** ivar-lazzaro has quit IRC | 15:59 | |
markus_z | fungi: oh, stupid me, I should have seen that. Thank you! | 15:59 |
*** yamahata has joined #openstack-infra | 16:00 | |
*** pal has quit IRC | 16:00 | |
pabelanger | fungi: we seem to be launching less test nodes right now | 16:00 |
*** ihrachyshka has joined #openstack-infra | 16:00 | |
*** olaph has joined #openstack-infra | 16:00 | |
pabelanger | fungi: or graphite.o.o is acting up | 16:00 |
fungi | pabelanger: yep, i'm checking to make sure we don't have any jenkins masters going crazy, quota problems, et cetera | 16:01 |
fungi | rax-iad is still basically unusable. i'm trying to get frenetical support to read the request in the open ticket correctly and clean up the 72 nodes we have stuck in a pending deletion state there | 16:02 |
*** teran has joined #openstack-infra | 16:02 | |
*** rm_work is now known as rm_work|away | 16:02 | |
*** jlanoux has quit IRC | 16:02 | |
*** marzif__ has quit IRC | 16:03 | |
*** jschwarz_ has joined #openstack-infra | 16:03 | |
*** skolekonov has joined #openstack-infra | 16:03 | |
fungi | oh yeah, jenkins07 has tipped over into brokenness | 16:03 |
*** jschwarz has quit IRC | 16:04 | |
fungi | [Thu Aug 6 08:05:49 2015] Out of memory: Kill process 12933 (java) score 936 or sacrifice child | 16:04 |
*** olaph has quit IRC | 16:04 | |
fungi | looks like it's been dead, dead, deadski for 8 hours now | 16:05 |
*** ParsectiX has joined #openstack-infra | 16:05 | |
*** olaph has joined #openstack-infra | 16:05 | |
openstackgerrit | Matthew Treinish proposed openstack/os-testr: Handle incomplete subunit streams https://review.openstack.org/210005 | 16:06 |
fungi | i've cleaned up and restarted jenkins07 now. also jenkins01 looks like it's starting to head into unhappyville so i'll put it into prepare for shutdown | 16:06 |
*** hogepodge has quit IRC | 16:06 | |
*** hogepodge has joined #openstack-infra | 16:07 | |
fungi | 256 disassociated floating ips in hpcloud. starting to remove them now | 16:07 |
*** pblaho has quit IRC | 16:08 | |
*** geoffarnold has joined #openstack-infra | 16:09 | |
openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added new SF repository for Fuel Trove plugin integration https://review.openstack.org/210007 | 16:09 |
*** laughterwym has quit IRC | 16:11 | |
*** warpc__ has joined #openstack-infra | 16:11 | |
*** moravec has left #openstack-infra | 16:11 | |
*** jistr has quit IRC | 16:12 | |
*** kiran-r has quit IRC | 16:12 | |
*** ParsectiX has quit IRC | 16:12 | |
*** dtantsur is now known as dtantsur|afk | 16:12 | |
*** jgriffith has left #openstack-infra | 16:13 | |
*** minwang2 has quit IRC | 16:13 | |
*** sputnik13 has joined #openstack-infra | 16:14 | |
*** mpaolino has quit IRC | 16:14 | |
*** sdake has quit IRC | 16:14 | |
pabelanger | fungi: looking into statsd to see if we can graph the failure some how for floating IPs | 16:16 |
*** esmute_ has joined #openstack-infra | 16:16 | |
*** kurtmartin is now known as kmartin | 16:16 | |
*** unicell has quit IRC | 16:18 | |
*** minwang2 has joined #openstack-infra | 16:19 | |
*** unicell has joined #openstack-infra | 16:19 | |
*** moravec has joined #openstack-infra | 16:19 | |
*** unicell has quit IRC | 16:20 | |
*** otter768 has joined #openstack-infra | 16:21 | |
openstackgerrit | Davide Agnello proposed openstack-infra/project-config: Adding RALLY_SCENARIO env for Cue job https://review.openstack.org/201285 | 16:22 |
*** minwang2 has quit IRC | 16:23 | |
greghaynes | TheJulia: Odd thing I noticed with shade - it is making a dib image by default of elements debian vm simple-init | 16:24 |
greghaynes | TheJulia: That is going to have both cloud-init and simple-init, which is not so good | 16:24 |
greghaynes | TheJulia: er, not shade, with bifrost | 16:24 |
*** otter768 has quit IRC | 16:26 | |
greghaynes | TheJulia: Maybe the default should be debian-minimal? | 16:26 |
*** ybathia has joined #openstack-infra | 16:27 | |
*** mfmcdonagh has quit IRC | 16:28 | |
*** mcdonagm has quit IRC | 16:28 | |
*** wyatt88 has joined #openstack-infra | 16:29 | |
openstackgerrit | Paul Michali proposed openstack-infra/project-config: Enable VPN DevStack plugin for neutron client https://review.openstack.org/209887 | 16:30 |
*** serg_melikyan has quit IRC | 16:30 | |
*** sergmelikyan has joined #openstack-infra | 16:30 | |
openstackgerrit | Andrei V. Ostapenko proposed openstack-infra/project-config: Move from stackforge/magnetodb to openstack/magnetodb https://review.openstack.org/203524 | 16:30 |
openstackgerrit | Andrei V. Ostapenko proposed openstack-infra/project-config: Changes jobs description for MagnetoDB https://review.openstack.org/204478 | 16:30 |
openstackgerrit | Dawid Malinowski proposed openstack-infra/jenkins-job-builder: Add trigger-with-no-params for join-trigger https://review.openstack.org/206271 | 16:32 |
*** enikanorov2 has joined #openstack-infra | 16:32 | |
*** patrickeast has quit IRC | 16:32 | |
*** cdent has quit IRC | 16:33 | |
openstackgerrit | Paul Michali proposed openstack-infra/project-config: Enable VPN DevStack plugin for neutron client https://review.openstack.org/209887 | 16:35 |
sdague | fungi: is there a way to check what's up with the unit test images wrt a libvirt update | 16:36 |
sdague | because nova unit tests seem to all be segfaulting now | 16:36 |
*** nadya has quit IRC | 16:37 | |
*** ildikov has quit IRC | 16:38 | |
annegentle | Hey TC members flaper87 sdague dhellmann ttx jeblair russellb lifeless dhellmann mordred jaypipes I'm still drafting the next TC blog post at https://etherpad.openstack.org/p/next-tc-blog-post, but I have to drive four hours tonight and be offline tomorrow, so I will need someone else to do the actual posting to make sure it goes out tomorrow. | 16:38 |
annegentle | Can anyone already post to the blog who can take on the finalizing and copy/paste/post step? | 16:38 |
*** annegentle has quit IRC | 16:38 | |
jaypipes | annegentle: I cannot post to the blog. | 16:38 |
fungi | sdague: what do you mean by "what's up with the unit test images?" | 16:39 |
fungi | sdague: as in what version of libvirt they have installed? | 16:39 |
*** dguerri is now known as dguerri` | 16:40 | |
*** yamamoto has quit IRC | 16:42 | |
sdague | fungi: yeh | 16:42 |
sdague | and if it changed recently | 16:42 |
fungi | sdague: looks like it's been nearly a month since the ubuntu packages for libvirt changed in trusty | 16:42 |
sdague | we're getting a segfault on all our unit test runs now | 16:42 |
*** puranamr has joined #openstack-infra | 16:42 | |
sdague | in libvirt | 16:42 |
clarkb | check python libvirt | 16:43 |
*** serg_melikyan has joined #openstack-infra | 16:43 | |
clarkb | or is it libvirt pythob? | 16:43 |
*** unicell has joined #openstack-infra | 16:43 | |
*** sergmelikyan has quit IRC | 16:43 | |
*** tonytan4ever has quit IRC | 16:43 | |
sdague | actually, this is weirder, hold on | 16:44 |
fungi | i don't see the python package for it listed in the freeze | 16:44 |
clarkb | yup uploaded on the 4th | 16:44 |
fungi | what's the package called? | 16:45 |
openstackgerrit | li,chen proposed openstack-infra/project-config: A Devstack-plugin that installs a HDFS backend https://review.openstack.org/207050 | 16:45 |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Listing flavors should pull all flavors https://review.openstack.org/210020 | 16:46 |
clarkb | libvirt-python | 16:46 |
fungi | odd it doesn't show up in the freeze at all | 16:46 |
fungi | or else my browser's having trouble searching in the job log | 16:46 |
clarkb | its possible it isnt installed | 16:47 |
*** arxcruz has quit IRC | 16:47 | |
*** btully has joined #openstack-infra | 16:48 | |
clarkb | I know nova unittests wanted to fakevirt (doesnt explain libvirt segfaults though) | 16:48 |
*** patrickeast has joined #openstack-infra | 16:48 | |
Swanson | fungi: Thanks for the help. This looks happier. Wish it looked faster but things are getting resolved now. | 16:48 |
*** vahidh has quit IRC | 16:48 | |
fungi | Swanson: diskimage-builder caches a lot of stuff, so subsequent runs should go much faster | 16:48 |
*** ParsectiX has joined #openstack-infra | 16:48 | |
Swanson | fungi: Cool. My original concern was that the "intelligent" firewalls around here were shutting me down. So this is all good. | 16:50 |
openstackgerrit | Matthew Treinish proposed openstack/os-testr: Handle incomplete subunit streams https://review.openstack.org/210005 | 16:50 |
fungi | sdague: i take it you're unable to reproduce locally | 16:52 |
*** btully has quit IRC | 16:52 | |
sdague | honestly, I haven't gotten quite that far yet, mriedem was poking at it | 16:52 |
pabelanger | nibalizer: I think we are finally ready for https://review.openstack.org/#/c/205696/ to land | 16:53 |
*** patrickeast has quit IRC | 16:53 | |
fungi | seems like it shouldn't be related at all to the libvirt-python release earlier this week (not recent enough, also not used afaict) | 16:53 |
sdague | yeh | 16:53 |
* krotscheck is around if anyone wants to help land https://review.openstack.org/#/c/199707/ | 16:55 | |
*** patrickeast has joined #openstack-infra | 16:55 | |
jeblair | sdague: in 199091 is this correct: you are asking grenade to run devstack on the subnode after running the initial devstack setup on the main node, and before it runs the upgrade. | 16:56 |
sdague | jeblair: yes | 16:56 |
*** aukhan has quit IRC | 16:56 | |
sdague | that ensures that we bring up the workers after rabbit is up on the controller | 16:57 |
mriedem | fungi: i reproduced locally | 16:57 |
mriedem | testing a change now | 16:57 |
fungi | mriedem: so it's specifically nova.tests.unit.virt.libvirt.test_driver.LibvirtConnTestCase.test_clean_shutdown_no_wait triggering a segfault in the interpreter? | 16:57 |
nibalizer | pabelanger: what do you think about putting a #date comment on the remove_module line so that those don't pile up and we can remove it in a month or something | 16:57 |
mriedem | fungi: appears that way | 16:57 |
mriedem | fungi: thing is we shouldn't actually be using python-libvirt anywhere | 16:57 |
mriedem | so that could be something else too, still looking | 16:57 |
mriedem | i found one dumb thing to remove and test anyway | 16:58 |
jeblair | sdague: i was asking myself why do something like that, involving a hook in grenade, rather than in d-g. but now i understand that generally you want grenade to handle the entire sequencing of devstack + grenade, and also it gives you fine grained control over things like what you just suggested (rabbit) | 16:58 |
mriedem | this https://github.com/openstack/nova/blob/master/nova/tests/unit/virt/libvirt/test_driver.py#L539 | 16:58 |
jeblair | sdague: which is fine -- i don't have a desire for d-g to be more complicated, i just wanted to make sure i understood. :) | 16:58 |
sdague | right, because honestly, once the subnodes get brought up, we never want to touch them again. So doing just that one action point sets up exactly the scenario we want to test | 16:58 |
jeblair | sdague: cool; want me to aprv? | 16:59 |
sdague | jeblair: that would be awesome | 16:59 |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Remove color output from puppet apply https://review.openstack.org/210030 | 16:59 |
*** minwang2 has joined #openstack-infra | 16:59 | |
sdague | it's got an experimental job in d-g, it appears to be working as designed. I read the logs pretty carefully after the success run | 16:59 |
jeblair | sdague: cool, i'll work down the stack with +2s then +3. | 16:59 |
sdague | sounds good | 16:59 |
sdague | the other 2 are basically refactorings, mostly to make this patch easier to review | 17:00 |
*** minwang2 has quit IRC | 17:00 | |
*** amitgandhinz has quit IRC | 17:00 | |
SpamapS | greghaynes: so.. vlan in the images.. actually.. ovs is the one we have to use. | 17:01 |
SpamapS | greghaynes: unless you figure out how to use linuxbridge. :) | 17:01 |
jeblair | krotscheck: i'd be happy to; though i'm the only +2 on that so far. perhaps clarkb or fungi could give another +2 while i'm reviewing sdague's patch, and then i can do the legwork when complete. | 17:01 |
krotscheck | jeblair: That'd be spectacular. | 17:01 |
*** bapalm_ has quit IRC | 17:01 | |
* krotscheck casually points clarkb and fungi at https://review.openstack.org/#/c/199707/ | 17:02 | |
jeblair | krotscheck: also, istr having some questions about the change with the actual application of that, but i haven't checked back to see if you have responded | 17:02 |
*** mwagner_lap has quit IRC | 17:02 | |
greghaynes | SpamapS: oy | 17:03 |
krotscheck | jeblair: Long story short on that response - the `npm run [thing]` command is much like tox -e venv [thing] | 17:03 |
krotscheck | It's entirely customizable. | 17:03 |
*** skolekonov has quit IRC | 17:03 | |
krotscheck | To the point where rm -rf * is actually an option. | 17:03 |
jeblair | krotscheck: that could be a problem then. 'rm -rf *' is annoying but less of a worry.. 'cat /path/to/$CREDENTIALS' is much more of one | 17:04 |
greghaynes | SpamapS: im about to try redeploying all the nodes from the .3 host | 17:04 |
greghaynes | all the nodes but .2 and .3, that is | 17:04 |
jeblair | krotscheck: for equivalent things in python and java, we have developed ways of uploading things that are not at all customizable | 17:05 |
TheJulia | greghaynes: i was thinking debian-minimal, need to see if it working at the moment since it was broken when i was last messing with it | 17:05 |
mriedem | fungi: https://review.openstack.org/#/c/210036/ | 17:05 |
*** gyee has quit IRC | 17:05 | |
krotscheck | jeblair: Hrm. I see that. Can you give me an example of the python thing? | 17:05 |
SpamapS | greghaynes: actually... linuxbridge is exactly what we want. | 17:05 |
* SpamapS is reading | 17:05 | |
greghaynes | SpamapS: it is | 17:06 |
jeblair | krotscheck: in python, we run the build step, which is customizable, on a standard throwaway node, and have jenkins scp it to tarballs.o.o. then we run the upload step as a second job on the proposal node that downloads the thing that was just uploaded to tarballs.o.o, and then, uploads it to pypi. | 17:06 |
greghaynes | SpamapS: The only question is how easily we can configure neutron to use it with provider networking | 17:06 |
*** rockyg has joined #openstack-infra | 17:06 | |
jeblair | krotscheck: so that upload step is fixed with code we entirely control -- so the only code that runs on the proposal slave is essentially 'download tarball from A upload tarball to B' | 17:06 |
krotscheck | jeblair: Let me dig into that, I _think_ that's possible. | 17:07 |
SpamapS | greghaynes: well if we're using linuxbridge, IIRC, we'll be fine, because it's just going to bridge taps onto our vlan25. | 17:07 |
krotscheck | And it makes sense. | 17:07 |
krotscheck | And yes, cat does in fact expose things. | 17:07 |
*** minwang2 has joined #openstack-infra | 17:07 | |
SpamapS | greghaynes: no vlan knowledge necessary. Just put the vms on the 15.x network. Done. | 17:07 |
*** jschwarz_ has quit IRC | 17:08 | |
jeblair | krotscheck: at one point, we even wrote our own little script to do the XMLRPC needed for a pypi upload, but now we do it with twine, which is an upstream tool that is purpose-built for uploading things to pypi | 17:08 |
jeblair | krotscheck: cool, yeah, if you can separate build/upload, we can do something similar | 17:08 |
*** garyk has quit IRC | 17:08 | |
greghaynes | SpamapS: yea, that should be doable with ovs too | 17:08 |
greghaynes | SpamapS: but I am definitely all for linuxbridge | 17:08 |
*** devvesa has quit IRC | 17:09 | |
jeblair | krotscheck: having said all that, we don't need to block https://review.openstack.org/#/c/199707/ on that; we can continue laying groundwork there | 17:09 |
krotscheck | jeblair: Yeah, but the followup patch with the publish job is already +2A &dependent. | 17:09 |
krotscheck | Lemme go make sure that doesn't land. | 17:09 |
jeblair | krotscheck: oh, good, yes thanks. | 17:09 |
SpamapS | greghaynes: our use case is really anti-ovs. | 17:10 |
krotscheck | jeblair: Done. | 17:10 |
SpamapS | greghaynes: we never want tenant isolation. | 17:10 |
SpamapS | greghaynes: and we never want soft routers | 17:10 |
SpamapS | until we do | 17:10 |
SpamapS | and then DOH | 17:10 |
*** ParsectiX has quit IRC | 17:10 | |
greghaynes | SpamapS: yep, I think that is why we were being told to just do provider networking | 17:11 |
mrmartin | fungi: the new ask.o.o site seems to be up now, but the theme is a bit broken. The staging site is using the feature/development branch, meanwhile the production one is tied to master branch. What is the proper process to merge the dev branch into master? | 17:11 |
mrmartin | Do we have a guide for that somewhere? | 17:11 |
fungi | mrmartin: http://docs.openstack.org/infra/manual/drivers.html#merge-commits | 17:12 |
*** sobersabre has quit IRC | 17:12 | |
*** ParsectiX has joined #openstack-infra | 17:12 | |
*** spzala has joined #openstack-infra | 17:12 | |
mrmartin | fungi: thank you, I'm trying to merge the branches | 17:12 |
* greghaynes enrolls all the nodes and hopes the world doesnt explode | 17:13 | |
*** chlong has quit IRC | 17:14 | |
SpamapS | greghaynes: enroll or deploy? | 17:15 |
*** ildikov has joined #openstack-infra | 17:15 | |
SpamapS | enroll is like meh :) | 17:15 |
greghaynes | well, just did deploy | 17:15 |
greghaynes | 46 nodes | 17:15 |
SpamapS | oh fantastic | 17:15 |
greghaynes | well see what happens... | 17:15 |
greghaynes | I gave bastion01 a static ip on the 10.10.16 network btw, one above bastion00 | 17:16 |
*** mrunge has quit IRC | 17:16 | |
pabelanger | fungi: could you point me towards a project that is using bindep right now? | 17:16 |
SpamapS | btw trying to find docs on linuxbridge is really hard | 17:16 |
SpamapS | everything is ovs | 17:16 |
greghaynes | heh | 17:16 |
fungi | pabelanger: my wip patch for nova is https://review.openstack.org/164444 and the experimental bindep-nova-python27 job is using it and passing | 17:17 |
clarkb | spamaps wat | 17:18 |
*** serg_melikyan has quit IRC | 17:18 | |
fungi | pabelanger: the file needs trimming (i was playing with some additions/removals hence the comment lines) but it's a working example | 17:18 |
jeblair | sdague: naturally it's the simplest change, 206175, that's going to take me the most time to review :) | 17:18 |
clarkb | ovs has no docs beyond man pages for commands that dont actualky tell what they are for or why they exist | 17:18 |
*** Somay has joined #openstack-infra | 17:18 | |
*** Somay has quit IRC | 17:19 | |
greghaynes | clarkb: the commands are for ctling ;) | 17:19 |
SpamapS | clarkb: I'm not talking about the actual tech underlying things. | 17:19 |
SpamapS | clarkb: the way to tell OpenStack how to use these technologies and configure them. | 17:19 |
SpamapS | ovs is the leader, so every single manual just assumes it. | 17:20 |
minwang2 | can someone help to take a look at this patch https://review.openstack.org/#/c/209675/2 | 17:20 |
pabelanger | fungi: cool, thanks. Will get me started on testing | 17:20 |
SpamapS | there's no good "this is why you would want linuxbridge and this is how to make it just attach all the vms to a physical network" | 17:20 |
*** dmorita has quit IRC | 17:20 | |
krotscheck | jeblair: Ya know, I wonder whether that vulnerability occurred to the travis people.... | 17:20 |
greghaynes | yea, thats my fear - linuxbr might only really be a known quantity with nova-net | 17:21 |
fungi | pabelanger: some things are not nailed down yet, for example it may make sense to tag some of those for a "test" profile rather than to the default profile depending on whether they're needed by things in requirements.txt or just by things in test-requirements.txt | 17:21 |
clarkb | SpamapS we have devstack tempest jobs for it now | 17:21 |
SpamapS | greghaynes: Rackspace migrated all of their managed private clouds to linuxbridge+neutron | 17:21 |
*** ParsectiX has quit IRC | 17:21 | |
*** austin81 has left #openstack-infra | 17:21 | |
clarkb | so canwork back from that | 17:21 |
greghaynes | SpamapS: hah, so *someone* knows how | 17:22 |
SpamapS | clarkb: yes, there's plenty of examples. I just would love some understanding. | 17:22 |
greghaynes | oh, ok, win | 17:22 |
pabelanger | fungi: is [platform:ubuntu] valid? Or do I need to specifiy the release? | 17:23 |
SpamapS | greghaynes: when you brought up vlan25, did you lose the 10.10 network? | 17:23 |
greghaynes | SpamapS: no | 17:23 |
*** yamahata has quit IRC | 17:24 | |
greghaynes | SpamapS: I have eth2 with 10 net on it, eth2.25 with 15.x | 17:24 |
*** yamahata has joined #openstack-infra | 17:24 | |
SpamapS | greghaynes: ah, I cant hit the IP for it from the old bastion | 17:25 |
pabelanger | fungi: looks to be | 17:25 |
greghaynes | SpamapS: 10.10.16.131? | 17:25 |
SpamapS | greghaynes: oh I was doing it wrong | 17:26 |
SpamapS | greghaynes: can you ssh-import-id my keys on the bastions? clint-fewbar | 17:27 |
greghaynes | yerp | 17:27 |
SpamapS | I want to spy ;) | 17:27 |
*** ifarkas has quit IRC | 17:27 | |
greghaynes | SpamapS: done, user ubuntu | 17:27 |
jeblair | sdague: +3s all around | 17:28 |
greghaynes | SpamapS: looks like deploys failed | 17:28 |
sdague | jeblair: thanks | 17:29 |
openstackgerrit | Merged openstack/os-testr: Handle incomplete subunit streams https://review.openstack.org/210005 | 17:29 |
greghaynes | SpamapS: heh, I think I didnt add the ilo net | 17:29 |
*** achanda has joined #openstack-infra | 17:30 | |
fungi | pabelanger: yeah, though using platform:ubuntu would be mostly a means of differentiating it from package names for other platform:dpkg based distros | 17:30 |
SpamapS | greghaynes: you have to route through .129 | 17:31 |
greghaynes | yerp | 17:31 |
SpamapS | greghaynes: we should probably add that static route to our bifrost manifest | 17:31 |
*** olaph has quit IRC | 17:32 | |
fungi | pabelanger: since the package names on debian, ubuntu and other debian derivatives are typically identical it usually doesn't make sense unless you're referring to specific releases of a given distro | 17:32 |
clarkb | or put an interface on that network (nice for ilo to avoid router fails) | 17:32 |
SpamapS | clarkb: that's not an option we get. | 17:32 |
clarkb | :( | 17:32 |
mrmartin | fungi: this is the output of master merge, it was rejected at the end. What am I doing wrong? http://paste.openstack.org/show/411218/ | 17:33 |
SpamapS | Some kind of policy against provisioning networks being directly attached to workloads. | 17:33 |
*** sdake has joined #openstack-infra | 17:33 | |
clarkb | even on the bastion? | 17:34 |
clarkb | wow | 17:34 |
SpamapS | yep. Bastion just gets let through the router. | 17:34 |
fungi | mrmartin: checked the acl to make sure it's set to allow your release group to push merge commits? | 17:34 |
*** baoli has quit IRC | 17:34 | |
fungi | mrmartin: per the document i linked | 17:34 |
SpamapS | clarkb: in theory thats how it works. In practice they seem to be letting the whole /25 through. | 17:34 |
clarkb | ha | 17:34 |
SpamapS | clarkb: not a fact I'm going to alert them of. :) | 17:34 |
mrmartin | checking now | 17:34 |
*** salv-orlando has quit IRC | 17:35 | |
fungi | mrmartin: oh! "change 179472 closed" implies you're trying to push an altered version of an already merged change | 17:35 |
SpamapS | to be fair.. ilos' are really fragile | 17:35 |
SpamapS | I'd take steps to control the number of hosts that can access them too. | 17:35 |
*** baoli has joined #openstack-infra | 17:35 | |
fungi | mrmartin: i am trying now to determine how that's coming about | 17:36 |
mrmartin | I did a total fresh clone of git repo | 17:36 |
*** funzo has quit IRC | 17:36 | |
*** skylerberg has joined #openstack-infra | 17:36 | |
clarkb | SpamapS ya I would allow just the bastions but do so from l2 | 17:37 |
mrmartin | fungi: anyway the feature/development seems to be 4 commits ahead of master branch | 17:37 |
fungi | mrmartin: oh! i see. the merge ended up being a fast-forward since the branches didn't both diverge | 17:37 |
greghaynes | SpamapS: hrm, 6 nodes ended up in a funky state when I tried to delete | 17:37 |
fungi | mrmartin: so your commit --amend is altering the new branch tip which isn't a new merge commit at all | 17:38 |
fungi | i wonder what a good workaround is for this | 17:38 |
greghaynes | SpamapS: I wonder if those are nodes with stuck ilos | 17:38 |
*** ivar-laz_ has quit IRC | 17:39 | |
SpamapS | clarkb: any particular reason you'd want to exert control at l2? I mean, l3's are a lot simpler to think about. | 17:39 |
fungi | mrmartin: possibly just resetting the master branch tip to the same as the current development branch is in order | 17:39 |
*** puranamr has quit IRC | 17:39 | |
fungi | jeblair: clarkb: ^ opinions? | 17:39 |
clarkb | SpamapS routers are less reliable than switches | 17:39 |
clarkb | and I hate getting someone in a closet/dc over the phone that I have seen in perso to find the hosts and fix them | 17:40 |
clarkb | *have never seeb | 17:40 |
SpamapS | clarkb: I can't refute that. But I think they're still quite a bit more reliable as the ilos themselves, so that difference is somewhat mitigated. | 17:40 |
greghaynes | SpamapS: ok, redeploying... | 17:41 |
clarkb | huh I never had issues with ilo (but I did have to use IE and c# app thing) | 17:41 |
mrmartin | fungi: what is strange for me, that we don't have any other changes in master branch since the feature/development was created. | 17:41 |
jeblair | fungi, mrmartin: i'm afraid i still don't quite understand what mrmartin is trying to do | 17:41 |
SpamapS | clarkb: anyway, interesting thoughts. Maybe some day we'll get a rack with a bare TOR switch and we can really play. :) | 17:41 |
*** akshai has joined #openstack-infra | 17:41 | |
mrmartin | jeblair: I want to merge the feature/development branch into master at openstack-infra/askbot-theme repo | 17:42 |
fungi | jeblair: merge a feature branch into master, when there have been no new changes to master | 17:42 |
*** alexpilotti has joined #openstack-infra | 17:42 | |
jeblair | ah, and just found http://paste.openstack.org/show/411218/ | 17:42 |
* jeblair thinks some more | 17:42 | |
SpamapS | clarkb: I've never let anything in prod rely on ilos being available. They've failed me so many times at the worst possible moment.. | 17:42 |
greghaynes | clarkb: heh, so thers a handful of boxes in our rack where the ilo's are suck in a state that requires somene to physically go up to them and poke with a stick | 17:42 |
fungi | resetting master to the feature branch commit should be safe since it's ff-able | 17:42 |
clarkb | neat | 17:42 |
*** yamamoto has joined #openstack-infra | 17:42 | |
greghaynes | because these ilo's just do that when you talk too quickly to them | 17:42 |
jeblair | fungi, mrmartin: you probably want to force git to create a merge commit | 17:42 |
SpamapS | yep | 17:42 |
jeblair | fungi, mrmartin: there's an option for that | 17:43 |
clarkb | oh we did have to fast ethernet all our ilos | 17:43 |
clarkb | no gigabit | 17:43 |
SpamapS | clarkb: ^ what greghaynes said. It's o_O given the role the thing is supposed to be playing. | 17:43 |
fungi | jeblair: oh! thanks, had no idea that was possible | 17:43 |
jeblair | fungi, mrmartin: --no-ff | 17:43 |
*** ivar-lazzaro has joined #openstack-infra | 17:43 | |
*** marcusvrn has quit IRC | 17:43 | |
*** puranamr has joined #openstack-infra | 17:43 | |
greghaynes | SpamapS: \O/ most are in wait callback | 17:43 |
jeblair | fungi, mrmartin: so maybe: git merge --no-ff origin/feature/development | 17:43 |
*** markvoelker has quit IRC | 17:44 | |
mrmartin | and can I push that to gerrit at the end? | 17:44 |
SpamapS | greghaynes: woot | 17:44 |
*** pvaneck has joined #openstack-infra | 17:44 | |
SpamapS | greghaynes: when we get those poked with sticks, lets also get them firmware-upgraded. | 17:44 |
SpamapS | greghaynes: I seem to recall that solved many problems. | 17:45 |
openstackgerrit | Joshua Harlow proposed openstack-infra/project-config: Ensure 'libffi-devel' is installed so that python-cffi can build https://review.openstack.org/210058 | 17:45 |
SpamapS | and is a constant running theme in HP hardware. :) | 17:45 |
harlowja | ianw fungi https://review.openstack.org/#/c/210058/ if u get a chance, seems thats needed to avoid http://logs.openstack.org/03/209203/1/check/gate-anvil-rpms-dsvm-devstack-centos7/18588d9/output/py2rpm-cffi-1.1.2.tar.gz.log | 17:45 |
*** jcoufal has quit IRC | 17:45 | |
SpamapS | It would be pretty amazing if some company came out with a line of OpenCompute hardware that was also mostly open-source firmware. | 17:45 |
*** mwagner_lap has joined #openstack-infra | 17:45 | |
fungi | mrmartin: looks like http://git.openstack.org/cgit/openstack-infra/project-config/tree/gerrit/acls/openstack-infra/askbot-theme.config needs to be updated with the addition documented at http://docs.openstack.org/infra/manual/drivers.html#merge-commits | 17:45 |
mrmartin | fungi: so a git push gerrit at the end? | 17:45 |
SpamapS | System76: I'm looking at you. | 17:46 |
*** garyk has joined #openstack-infra | 17:46 | |
fungi | mrmartin: yeah, repeat the same steps as before, but just add the --no-ff to your git merge command | 17:46 |
mrmartin | fungi, ok, I'm doing the project-config patch first | 17:47 |
fungi | mrmartin: and it's `git review -R` per the documentation, not push | 17:47 |
*** yamamoto has quit IRC | 17:47 | |
*** amitgandhinz has joined #openstack-infra | 17:48 | |
greghaynes | SpamapS: now I kind of want to do this in hp2 just so I can boot 150ish nodes with ironic ;) | 17:48 |
greghaynes | oh hey, some are going active | 17:49 |
jroll | SpamapS: like openpower? :) | 17:49 |
SpamapS | greghaynes: lets dooo it | 17:49 |
jroll | but it's not x86 etc etc | 17:49 |
SpamapS | jroll: I'm fine with a different cpu | 17:49 |
SpamapS | jroll: did not know there was an openpower | 17:49 |
clarkb | jroll how fast does qemu run in iy:P | 17:49 |
jroll | heh | 17:50 |
*** cody-somerville has quit IRC | 17:50 | |
jroll | SpamapS: yeah, the goal is open firmware etc | 17:50 |
SpamapS | I'm so meh on power though | 17:50 |
jroll | yeah... | 17:50 |
jroll | I think it's going to be a chicken/egg thing | 17:50 |
SpamapS | but really there's no reason you couldn't do the same thing with pc firmware, and I wonder why thats not happening? | 17:51 |
mtreinish | jroll: I was thinking it's more like a dead chicken :) | 17:51 |
*** yfried has joined #openstack-infra | 17:51 | |
clarkb | SpamapS intel? | 17:51 |
jroll | SpamapS: yeah, dunno, maybe nobody has the capital or the cares | 17:51 |
notmyname | is there a documented "here's how to report and patch a security bug in openstack" document somewhere? | 17:51 |
SpamapS | jroll: bingo. :-P | 17:51 |
sdague | dstufft: pypi down? | 17:52 |
clarkb | notmyname yes https://security.openstack.org | 17:52 |
mtreinish | SpamapS: I thought there were open firmware projects out there | 17:52 |
notmyname | clarkb: thanks | 17:52 |
SpamapS | But I could see a future where people are running containers inside vms on baremetal and going "why don't we just run this on baremetal?" and somebody goes "we don't have enough control between the firmware and container" and then somebody else says "what if we did?" and it happens. | 17:52 |
dstufft | sdague: appears so | 17:52 |
fungi | notmyname: there's a specific section on that page i would link but my internet connection is acting up at the moment | 17:52 |
SpamapS | mtreinish: there are. some. I want a box, a GOOD box, with all of it open. | 17:53 |
fungi | or maybe rackspace's networks are acting up | 17:53 |
mtreinish | SpamapS: I think coreboot was one of the bigger ones | 17:53 |
*** cody-somerville has joined #openstack-infra | 17:53 | |
*** markus_z has quit IRC | 17:53 | |
jroll | SpamapS: or a world where someone has a baremetal cloud that they don't want to get pwned and they make it happen :P | 17:53 |
sdague | dstufft: that wasn't even a gate thing, I was trying to do a 'pip search pbr' | 17:53 |
*** enikanorov2 has quit IRC | 17:53 | |
SpamapS | jroll: really thats the same thing. :) | 17:53 |
jroll | ya | 17:53 |
SpamapS | jroll: so, get 'er done | 17:53 |
openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Update query for nova seg fault bug 1482230 https://review.openstack.org/210066 | 17:53 |
sdague | I think that might mean it's time for a break | 17:53 |
openstack | bug 1482230 in OpenStack Compute (nova) "LibvirtConnTestCase.test_clean_shutdown_first_time causes subunit segfault" [High,In progress] https://launchpad.net/bugs/1482230 - Assigned to Matt Riedemann (mriedem) | 17:53 |
notmyname | clarkb: fungi: do you know where those docs are managed? there's 2 important things I don't see there that should be (that gerrit is NOT the place for security patches and how to format a patch for review in launchpad) | 17:54 |
notmyname | I'd like to patch it | 17:54 |
jroll | SpamapS: send dev resources pls :P | 17:54 |
jroll | SpamapS: unless you want to end up with firmware written in python | 17:54 |
openstackgerrit | Marton Kiss proposed openstack-infra/project-config: Enable pushMerge commits for askbot-theme repo https://review.openstack.org/210067 | 17:54 |
dstufft | sdague: ``pip install`` probably works fine | 17:54 |
fungi | notmyname: in the openstack/ossa repo at the moment, though it'll likely get split out to a separate openstack/security-site repo later | 17:54 |
dstufft | search doesn't have as much caching | 17:54 |
dstufft | :/ | 17:54 |
dstufft | https://status.python.org/incidents/nqw6dm4cyjky | 17:54 |
mrmartin | fungi: ^^^ | 17:54 |
*** SumitNaiksatam has joined #openstack-infra | 17:54 | |
fungi | mrmartin: thanks. as soon as i stop failing to reach review.openstack.org i'll have a look | 17:55 |
*** jgriffith has joined #openstack-infra | 17:56 | |
mrmartin | great, thhnx | 17:56 |
fungi | unfortunately it's breaking gertty _and_ my browser | 17:56 |
*** zul has joined #openstack-infra | 17:56 | |
clarkb | fungi try ipv4 | 17:56 |
*** bharath has joined #openstack-infra | 17:56 | |
fungi | i'm going to have to i'm afraid | 17:57 |
clarkb | the ipv6 pipes have been trouble for me recebtly | 17:57 |
clarkb | lots of -4s in commands | 17:57 |
fungi | whatever this is, it just started in the past hour | 17:57 |
greghaynes | SpamapS: Just ran into "iLO Advanced License required for this functionality." when I tried to TEXTCONS on an ilo :( | 17:57 |
*** patrickeast has quit IRC | 17:57 | |
jeblair | i'm on v4 and it wfm. i'll try from a 6. | 17:57 |
greghaynes | SpamapS: It appears we cant affort our own licenses | 17:57 |
fungi | it looks like i'm just experiencing massive ipv6 packet loss at the moment | 17:58 |
clarkb | oh this has been days of off and on packet loss overv6 for me | 17:58 |
mrmartin | greghaynes: try to get a trial license | 17:58 |
jeblair | 6wfm here | 17:58 |
fungi | jeblair: yeah, it may be my isp | 17:59 |
jeblair | greghaynes: neither can anyone else, so this is realistic. | 17:59 |
fungi | hrm, 26% packet loss. but i guess when you couple that with the lower mtu because my isp has a terrible idea of what ipv6 "support" looks like, i suppose that can be crippling | 18:01 |
*** kgiusti has joined #openstack-infra | 18:02 | |
*** kmartin has quit IRC | 18:03 | |
dstufft | sdague: should be back now | 18:03 |
*** HeOS has quit IRC | 18:04 | |
*** bapalm has joined #openstack-infra | 18:04 | |
*** sputnik13 has quit IRC | 18:05 | |
*** markvoelker has joined #openstack-infra | 18:05 | |
pabelanger | any infra-puppet-core mind approving: https://review.openstack.org/#/c/208446/ ? trivial change to fix fedora22 dibs | 18:05 |
*** sputnik13 has joined #openstack-infra | 18:05 | |
SpamapS | greghaynes: vsp works fine | 18:05 |
*** sputnik13 has quit IRC | 18:05 | |
*** sputnik13 has joined #openstack-infra | 18:06 | |
*** che-arne has quit IRC | 18:08 | |
*** liam__ has joined #openstack-infra | 18:09 | |
*** esmute_ has quit IRC | 18:09 | |
*** sputnik13 has quit IRC | 18:10 | |
sdague | dstufft: thanks! | 18:10 |
*** Zhongjun has quit IRC | 18:10 | |
openstackgerrit | Paul Belanger proposed openstack-infra/puppet-pip: Add Gemfile and puppet 4 checks https://review.openstack.org/210070 | 18:11 |
*** esmute_ has joined #openstack-infra | 18:12 | |
*** esmute_ has quit IRC | 18:13 | |
jeblair | armax: do you think you can look into this: https://review.openstack.org/209171 | 18:14 |
openstackgerrit | Merged openstack-infra/elastic-recheck: Update query for nova seg fault bug 1482230 https://review.openstack.org/210066 | 18:15 |
openstack | bug 1482230 in OpenStack Compute (nova) "LibvirtConnTestCase.test_clean_shutdown_first_time causes subunit segfault" [High,In progress] https://launchpad.net/bugs/1482230 - Assigned to Matt Riedemann (mriedem) | 18:15 |
armax | jeblair: looking | 18:15 |
*** spzala has quit IRC | 18:17 | |
*** esmute_ has joined #openstack-infra | 18:17 | |
*** angerson has joined #openstack-infra | 18:19 | |
*** esmute_ has quit IRC | 18:19 | |
*** liam__ has quit IRC | 18:20 | |
*** Sukhdev has joined #openstack-infra | 18:20 | |
*** liam__ has joined #openstack-infra | 18:20 | |
*** otter768 has joined #openstack-infra | 18:22 | |
angerson | Hey all, I'm getting a "cannot import name constants" error when running tox on Zuul (from gear import constants). Here's a full stack trace: http://paste.openstack.org/show/411229/ | 18:23 |
angerson | Any clues? | 18:23 |
akraminsky | Hello, I'm trying to find some upstream jobs that run the test_live_migration tempest test, but I can't seem to find one that doesn't skip it. Anyone know one? | 18:23 |
clarkb | angerson try tox -r to rebuild the venv.constants are relatively new iirc | 18:24 |
clarkb | akraminsky gate-tempest-dsvm-multinode-full and gate-tempest-dsvm-neutron-multinode-full | 18:24 |
akraminsky | clarkb: those get skipped too, SKIPPED: Block Live migration not configured for iSCSI | 18:25 |
*** esmute_ has joined #openstack-infra | 18:26 | |
clarkb | we test live migration it uses the built in libvirt block copying method | 18:26 |
clarkb | we do not test it with shared storage | 18:26 |
*** rockyg has quit IRC | 18:26 | |
*** sergmelikyan has joined #openstack-infra | 18:27 | |
*** otter768 has quit IRC | 18:27 | |
openstackgerrit | Marton Kiss proposed openstack-infra/askbot-theme: Standalone maintenance page for ask.o.o migration https://review.openstack.org/210073 | 18:27 |
clarkb | if someone were to have devstack set up shared storage we could likely test that too | 18:27 |
*** tqtran has quit IRC | 18:27 | |
*** liam__ has quit IRC | 18:28 | |
*** esmute_ has quit IRC | 18:28 | |
openstackgerrit | Marton Kiss proposed openstack-infra/askbot-theme: Standalone maintenance page for ask.o.o migration https://review.openstack.org/210073 | 18:28 |
akraminsky | clarkb: so which case does run the libvirt block copying method? | 18:28 |
jeblair | clarkb: https://review.openstack.org/199707 is ready for +3 if you have a sec | 18:28 |
*** davideag_ has joined #openstack-infra | 18:29 | |
clarkb | this one http://logs.openstack.org/18/188118/17/check/gate-tempest-dsvm-multinode-full/165e2de/console.html#_2015-08-06_16_59_16_213 | 18:29 |
angerson | clarkb: Same problem after tox -r. This appeared the first time I ran the tests. | 18:29 |
clarkb | jeblair looking | 18:29 |
notmyname | fungi: clarkb: https://review.openstack.org/210075 | 18:31 |
fungi | notmyname: thanks! | 18:32 |
clarkb | krotscheck jeblair is trusty npm/nodejs new enouvh? | 18:32 |
clarkb | its 0.6.somwthing iirc | 18:32 |
*** tiswanso has quit IRC | 18:32 | |
krotscheck | clarkb: That's the precise version. Trusty's new enough | 18:32 |
notmyname | fungi: turns out someone reported a sec bug in swift (invalid, fortunately) last night and then proposed the patch in the normal way. I had written something down before, but I'd love it to be in a more discoverable place :-) | 18:33 |
krotscheck | clarkb: fungi was nice enough to update the publishing slave 2 weeks ago. | 18:33 |
*** baoli has quit IRC | 18:33 | |
*** amitgandhinz has quit IRC | 18:33 | |
*** davideagnello has quit IRC | 18:33 | |
* krotscheck is having a hard time trying to figure out how to publish to NPM without leaving our credentials open to exposure. | 18:33 | |
jeblair | we should probably install npm on it though | 18:33 |
krotscheck | Because there's a prepublish and a postpublish command that can just run anything. | 18:33 |
*** tiswanso has joined #openstack-infra | 18:34 | |
clarkb | jeblair this change instalks nom | 18:34 |
clarkb | krotscheck curl! | 18:34 |
clarkb | its what we did before twine | 18:34 |
*** ayoung has quit IRC | 18:34 | |
krotscheck | clarkb: The protocol's not documented :/ | 18:35 |
clarkb | neither is pypis | 18:35 |
clarkb | had to read cheeseshop source to figure it out | 18:35 |
clarkb | was good fun | 18:35 |
*** amitgandhinz has joined #openstack-infra | 18:35 | |
*** Hal has joined #openstack-infra | 18:36 | |
*** btully has joined #openstack-infra | 18:36 | |
clarkb | as an alternative write a npmtwine | 18:36 |
*** Hal has quit IRC | 18:36 | |
clarkb | 199707 approved | 18:36 |
clarkb | angerson not sure then | 18:36 |
*** e0ne has quit IRC | 18:37 | |
angerson | clarkb: Darn. Thanks for assisting. | 18:37 |
*** mtreinish has quit IRC | 18:37 | |
clarkb | angerson double check the gear version installed in the virtualenv | 18:37 |
*** salv-orlando has joined #openstack-infra | 18:37 | |
*** esmute_ has joined #openstack-infra | 18:37 | |
*** baoli has joined #openstack-infra | 18:37 | |
*** mtreinish has joined #openstack-infra | 18:39 | |
*** spzala has joined #openstack-infra | 18:40 | |
akraminsky | clarkb: thanks for the help | 18:40 |
*** btully has quit IRC | 18:40 | |
*** esmute_ has quit IRC | 18:40 | |
*** gyee has joined #openstack-infra | 18:40 | |
angerson | clarkb: 0.5.8. | 18:41 |
clarkb | huh that should be new enough | 18:42 |
clarkb | jeblair ^ ideas | 18:42 |
*** monester has quit IRC | 18:44 | |
clarkb | akraminsky does that cover what you need? if not we need to setup shared storage on those test nodes which may be a bit of work if we can use cinder volume bacjed i stances | 18:44 |
*** funzo has joined #openstack-infra | 18:44 | |
*** salv-orlando has quit IRC | 18:44 | |
clarkb | we do not use config drive there so that isnt an issue | 18:44 |
clarkb | (becauae no live migration is supported with it apparebtly) | 18:45 |
*** puranamr has quit IRC | 18:45 | |
greghaynes | SpamapS: oh derp didnt make dhcp range big enough | 18:46 |
greghaynes | that is a nice problem to have though :) | 18:46 |
jeblair | angerson: running on osx? | 18:47 |
angerson | jeblair: Yep, Yosemite. | 18:47 |
jeblair | angerson: the geard server used by zuul uses edge polling which isn't supported on osx | 18:48 |
openstackgerrit | Merged openstack-infra/system-config: Added NPM Publishing credentials to pypi slave. https://review.openstack.org/199707 | 18:48 |
*** funzo has quit IRC | 18:49 | |
*** esmute_ has joined #openstack-infra | 18:49 | |
jeblair | angerson, clarkb: that's the first traceback, which is the cause of the subsequent ones | 18:49 |
angerson | jeblair: Any workarounds? | 18:49 |
angerson | Or should I do testing on Linux instead? | 18:50 |
pabelanger | jeblair: question about merge-mode in zuul. I _thought_ at one time infra was running in cherry-pick mode. Was curious why we didn't stick with it, or even use it today? | 18:50 |
jeblair | angerson: yeah, i think run tests on linux is the way to go | 18:50 |
angerson | jeblair: Alright, thanks for the help! | 18:50 |
jeblair | angerson: np, sorry for the inconvenience | 18:51 |
jeblair | pabelanger: it always rewrites commits which we found distasteful | 18:51 |
*** b10n1k has joined #openstack-infra | 18:51 | |
jeblair | pabelanger: and practially, that meant that workflows involving git branch -D don't work | 18:51 |
jeblair | (because your local commit never shows up in the repo) | 18:51 |
clarkb | it made rebase weird too | 18:52 |
clarkb | because it didnt see the common history | 18:52 |
pabelanger | right | 18:52 |
*** olaph has joined #openstack-infra | 18:53 | |
akraminsky | clarkb: I think that's what I was looking for | 18:53 |
*** baoli has quit IRC | 18:53 | |
clarkb | akraminsky perfect. the job is newish and not perfect but getting more robust all the time. just having a second node makes tge testing much more interrsting | 18:54 |
*** baoli_ has joined #openstack-infra | 18:54 | |
*** harlowja has quit IRC | 18:56 | |
*** nadya has joined #openstack-infra | 18:56 | |
*** mquin_ has joined #openstack-infra | 18:58 | |
*** mquin_ has quit IRC | 18:58 | |
*** pc_m is now known as pc_m_AWAY | 19:01 | |
*** mquin_ has joined #openstack-infra | 19:01 | |
*** pc_m_AWAY has quit IRC | 19:04 | |
*** achanda has quit IRC | 19:05 | |
*** achanda has joined #openstack-infra | 19:05 | |
*** mquin is now known as Guest32944 | 19:06 | |
*** mquin_ is now known as mquin | 19:06 | |
*** Guest32944 has quit IRC | 19:06 | |
*** puranamr has joined #openstack-infra | 19:06 | |
*** markstur has joined #openstack-infra | 19:07 | |
*** dahoo has joined #openstack-infra | 19:08 | |
*** dahoo is now known as jerryz | 19:08 | |
*** nadya has quit IRC | 19:08 | |
markstur | Hello Infra. In Manila our "manila-coverage" job no longer captures the cover/ directory and it looks like the same thing happened to barbican | 19:08 |
markstur | I was wondering if it is known problem or where I should file a bug | 19:08 |
*** annegentle has joined #openstack-infra | 19:09 | |
*** tonytan4ever has joined #openstack-infra | 19:09 | |
*** liam__ has joined #openstack-infra | 19:10 | |
*** kmartin has joined #openstack-infra | 19:11 | |
fungi | seems my internet issues are not limited to ipv6. everything dies one hop into my isp's network, sometimes for up to 15 minutes at a stretch | 19:11 |
fungi | i'm taking this as a sign i should do some unpacking for a bit | 19:12 |
*** teran has quit IRC | 19:13 | |
*** patrickeast has joined #openstack-infra | 19:14 | |
*** warpc__ has quit IRC | 19:18 | |
annegentle | dhellmann: ttx: or flaper87: any of you have an account for the OpenStack blog? I know Thierry does, maybe he can post tomorrow. | 19:21 |
clarkb | ttx is on vacation | 19:22 |
clarkb | fungi and I can ping foundation people if it helps | 19:22 |
clarkb | its the www site blog right? | 19:22 |
*** liam__ has quit IRC | 19:22 | |
clarkb | markstur please link an example change | 19:23 |
*** e0ne has joined #openstack-infra | 19:24 | |
markstur | clarkb, https://review.openstack.org/#/c/209852/ | 19:24 |
markstur | manila-coverage used to capture cover/ directory | 19:25 |
markstur | We made a change to report regression in coverage, but that seems to be unrelated. That's why I looked at barbican | 19:25 |
openstackgerrit | Marton Kiss proposed openstack-infra/project-config: Enable pushMerge commits for askbot-theme repo https://review.openstack.org/210067 | 19:25 |
*** jgriffith is now known as Guest69423 | 19:26 | |
markstur | clarkb, barbican example https://review.openstack.org/#/c/208688/ | 19:26 |
*** wyatt88 is now known as jgriffith | 19:26 | |
clarkb | I think I know the problem will need a little time to confirm | 19:27 |
markstur | clarkb, Awesome | 19:28 |
*** olaph has quit IRC | 19:29 | |
annegentle | pleia2: hey! Your session is right before mine at Grace Hopper! zomg wowsa! | 19:30 |
*** puranamr has quit IRC | 19:31 | |
*** baoli_ has quit IRC | 19:32 | |
openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for stable/juno large-ops osc dep bug 1482350 https://review.openstack.org/210095 | 19:32 |
openstack | bug 1482350 in OpenStack-Gate "gate-tempest-dsvm-large-ops fails in stable/juno due to uncapped dep problems with osc" [Undecided,Confirmed] https://launchpad.net/bugs/1482350 | 19:32 |
*** armax has quit IRC | 19:32 | |
*** baoli has joined #openstack-infra | 19:34 | |
openstackgerrit | Sebastien Badia proposed openstack-infra/project-config: scripts/copy_puppet_logs: Fix puppet beaker upgrade jobs https://review.openstack.org/210097 | 19:36 |
*** claudiub has quit IRC | 19:36 | |
annegentle | clarkb: I have an account but don't have much computer access tomorrow... I think I'll just have to plan on coffee shop stop to be sure | 19:36 |
clarkb | ok | 19:36 |
annegentle | I mean, it's Texas, there oughta be internet :) | 19:37 |
*** hemna_ has joined #openstack-infra | 19:37 | |
clarkb | are you sure? | 19:37 |
*** hemna__ has joined #openstack-infra | 19:37 | |
clarkb | I hear its lots of empty space | 19:37 |
clarkb | :) | 19:37 |
annegentle | :) | 19:37 |
annegentle | there's lots of crappy radio where I'm driving | 19:37 |
*** claudiub has joined #openstack-infra | 19:38 | |
*** hemna__ has quit IRC | 19:38 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Remove color output from puppet apply https://review.openstack.org/210030 | 19:38 |
jeblair | annegentle: you should write a country music song about driving around empty space with nothing but crappy radio | 19:39 |
annegentle | jeblair: lol | 19:39 |
*** boris-42 has joined #openstack-infra | 19:39 | |
*** fifieldt_ has joined #openstack-infra | 19:40 | |
*** minwang2 has quit IRC | 19:40 | |
mrmartin | jeblair: can you add me to the askbot-theme-release group in gerrit? | 19:41 |
jeblair | mrmartin: ack | 19:42 |
mrmartin | thnx | 19:42 |
jeblair | mrmartin: done | 19:42 |
*** fifieldt has quit IRC | 19:42 | |
mrmartin | awesome, thnx | 19:42 |
openstackgerrit | Marton Kiss proposed openstack-infra/project-config: Enable pushMerge commits for askbot-theme repo https://review.openstack.org/210067 | 19:43 |
*** angdraug has quit IRC | 19:46 | |
*** hemna_ is now known as hemna | 19:46 | |
*** olaph has joined #openstack-infra | 19:46 | |
*** salv-orlando has joined #openstack-infra | 19:47 | |
openstackgerrit | Merged openstack-infra/devstack-gate: simplify setup_localrc branch logic https://review.openstack.org/206175 | 19:48 |
openstackgerrit | Merged openstack-infra/devstack-gate: extract setup_multinode_connectivity https://review.openstack.org/206189 | 19:49 |
*** ayoung has joined #openstack-infra | 19:49 | |
mriedem | anyone know if pbr will allow a 1.0.1.1 version? | 19:50 |
mriedem | per semver i thought that wouldn't fly | 19:50 |
clarkb | it wont | 19:50 |
openstackgerrit | Merged openstack-infra/devstack-gate: grenade partial multinode support https://review.openstack.org/199091 | 19:50 |
*** puranamr has joined #openstack-infra | 19:50 | |
*** salv-orlando has quit IRC | 19:51 | |
openstackgerrit | Brant Knudson proposed openstack/requirements: python-openstackclient up to 1.0.4 https://review.openstack.org/210101 | 19:56 |
*** sergmelikyan has quit IRC | 19:57 | |
*** sergmelikyan has joined #openstack-infra | 19:57 | |
*** cburroughs has quit IRC | 19:57 | |
openstackgerrit | Matt Riedemann proposed openstack/requirements: python-openstackclient up to 1.0.4 https://review.openstack.org/210101 | 19:57 |
ryanpetrello | monty and other shade-related folks | 19:58 |
ryanpetrello | any idea when a new shade release may be coming to PyPI? | 19:58 |
ryanpetrello | I'd love to take advantage of https://github.com/openstack-infra/shade/commit/a9cf85b0cb8497757cce010e9d7accc2bf25ce06 :) | 19:58 |
ryanpetrello | mordred ^ | 19:58 |
*** dprince has quit IRC | 19:58 | |
BrandonL18 | Are there any core reviewers that can look at my code and merge it if possible? | 19:59 |
BrandonL18 | Two other people have already reviewed my code and +1'd it. | 19:59 |
BrandonL18 | https://review.openstack.org/#/c/206178/ | 19:59 |
BrandonL18 | It's for Jenkins Job Builder | 20:00 |
*** jamespage_ has joined #openstack-infra | 20:00 | |
*** monester has joined #openstack-infra | 20:02 | |
*** ivar-lazzaro has quit IRC | 20:04 | |
*** HeOS has joined #openstack-infra | 20:06 | |
*** ivar-lazzaro has joined #openstack-infra | 20:09 | |
*** ybathia_ has joined #openstack-infra | 20:09 | |
*** daemontool_ has joined #openstack-infra | 20:10 | |
*** akraminsky_ has joined #openstack-infra | 20:11 | |
*** VivCheri has quit IRC | 20:11 | |
*** wayneeseguin has quit IRC | 20:11 | |
*** ybathia has quit IRC | 20:11 | |
*** pradk has quit IRC | 20:11 | |
*** ybathia_ is now known as ybathia | 20:11 | |
*** achanda_ has joined #openstack-infra | 20:12 | |
*** kgiusti has quit IRC | 20:12 | |
*** achanda has quit IRC | 20:12 | |
*** akraminsky has quit IRC | 20:12 | |
*** marzif has quit IRC | 20:12 | |
*** minwang2 has joined #openstack-infra | 20:12 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add methods to set and unset flavor extra specs https://review.openstack.org/209983 | 20:12 |
*** pradk has joined #openstack-infra | 20:12 | |
clarkb | markstur: see http://logs.openstack.org/88/208688/3/check/barbican-coverage/bad0000/index.html its there because that index.html is served from swift | 20:13 |
*** wayneeseguin has joined #openstack-infra | 20:13 | |
clarkb | markstur: but the one without is served from apache itself looking at the on disk situation | 20:13 |
clarkb | markstur: I think the fix is to stop copying file sto disk and having apache serve them then you will get the swift hosted index.html. I will work on that change | 20:13 |
*** ivar-lazzaro has quit IRC | 20:14 | |
*** mquin has quit IRC | 20:14 | |
*** mquin_ has joined #openstack-infra | 20:15 | |
markstur | clarkb, Thanks! | 20:17 |
mtreinish | jeblair: where is the gertty bug tracker? (hopes it's not storyboard) | 20:17 |
*** marzif has joined #openstack-infra | 20:17 | |
mtreinish | turns out gertty explodes on gpg signed commits | 20:17 |
clarkb | mtreinish: ha | 20:18 |
fungi | mtreinish: also, storyboard | 20:18 |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add methods to set and unset flavor extra specs https://review.openstack.org/209983 | 20:19 |
fungi | mtreinish: see README.rst | 20:19 |
mtreinish | fungi: who reads READMEs? :) | 20:19 |
* fungi thinks you may have just answered your own question | 20:19 | |
*** Sukhdev has quit IRC | 20:20 | |
mtreinish | oh, the traceback is coming from GitPython | 20:20 |
fungi | mtreinish: i am willing to believe that gitpython doesn't grok signed commits | 20:22 |
jeblair | mtreinish: gitpython folks are really good/fast about merging bugfix patches | 20:22 |
fungi | supposedly support was added for them in gitpython 0.3.2 | 20:23 |
fungi | so might be more of a corner case | 20:23 |
*** dguerri` is now known as dguerri | 20:23 | |
mtreinish | jeblair: yeah, although I'm looking if it's been fixed upstream because gertty pins the version | 20:23 |
*** otter768 has joined #openstack-infra | 20:23 | |
mtreinish | fungi: oh, you beat me to it :) | 20:23 |
*** dims_ has joined #openstack-infra | 20:23 | |
mordred | ryanpetrello: very soon | 20:23 |
openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for stable/juno large-ops osc dep bug 1482350 https://review.openstack.org/210095 | 20:23 |
openstack | bug 1482350 in OpenStack-Gate "gate-tempest-dsvm-large-ops fails in stable/juno due to uncapped dep problems with osc" [Undecided,Confirmed] https://launchpad.net/bugs/1482350 | 20:23 |
fungi | >=0.3.2.RC1 should be getting at least 0.3.2 | 20:23 |
mordred | ryanpetrello: there's one outstanding patch I want in | 20:23 |
fungi | mtreinish: what version does pip freeze say you have? | 20:24 |
*** dims_ has quit IRC | 20:24 | |
*** btully has joined #openstack-infra | 20:24 | |
*** e0ne has quit IRC | 20:24 | |
mtreinish | fungi: oops you're right I was looking at the wrong terminal, the one with pip freeze output | 20:24 |
mtreinish | not the requirements output | 20:24 |
ryanpetrello | mordred: okay, sounds good | 20:24 |
ryanpetrello | thanks! | 20:24 |
mtreinish | fungi: pip freeze shows GitPython==0.3.2rc1 | 20:25 |
*** mrmartin has quit IRC | 20:25 | |
jeblair | mtreinish: i'm on 1.0.1. | 20:25 |
mordred | jeblair, clarkb, fungi, SpamapS: https://review.openstack.org/#/c/209514/ and the one that comes before it? | 20:25 |
mtreinish | yeah it might have just been a stale venv | 20:25 |
*** dims_ has joined #openstack-infra | 20:25 | |
mtreinish | it's been a while since I last tried gertty | 20:26 |
jeblair | mtreinish: have a signed commit handy i can look at? | 20:26 |
*** dims has quit IRC | 20:26 | |
mtreinish | it works after upgrade GitPython | 20:26 |
fungi | yeah, i'm running with 1.0.1 as well, looks like | 20:26 |
mtreinish | jeblair: 209712 | 20:27 |
fungi | so apparently when they say implemented in 0.3.2 they really mean 0.3.2 and not 0.3.2rc1 | 20:27 |
clarkb | mordred: which one? | 20:27 |
clarkb | oh that one, yay lag | 20:27 |
*** otter768 has quit IRC | 20:27 | |
fungi | mtreinish: yeah, i can browse that change without a problem | 20:28 |
jeblair | mtreinish: so... how does one typically discover a commit is signed? | 20:28 |
*** btully has quit IRC | 20:28 | |
mtreinish | jeblair: you've got to check it out locally and do a git show or git log with --show-signature | 20:28 |
*** rm_work|away is now known as rm_work | 20:28 | |
jeblair | mtreinish: i haven't signed your key | 20:29 |
fungi | or git show --show-signature | 20:29 |
mtreinish | jeblair: oh, well we can fix that at some point (I probably haven't signed yours either) | 20:30 |
clarkb | mordred: reviewing those now | 20:30 |
greghaynes | TheJulia: so, I am having a ton of fun with bifrost BTW :) | 20:30 |
*** jgriffith has quit IRC | 20:31 | |
clarkb | mordred: are you super afk or have time for a question? | 20:31 |
*** Guest69423 has quit IRC | 20:33 | |
mordred | clarkb: I'm totes here | 20:33 |
clarkb | mordred: comments on 208105 if you can look real quick | 20:33 |
clarkb | mordred: curious what yo uthink particular of the first non test comment | 20:34 |
*** tongli has quit IRC | 20:34 | |
*** jamespage_ has quit IRC | 20:34 | |
*** patrickeast has quit IRC | 20:35 | |
mordred | kk. looking | 20:35 |
mordred | SpamapS: you've seen the docs from sc68cal yeah? | 20:36 |
TheJulia | greghaynes: \o/.... or is that sarcastic \o/ ? | 20:36 |
TheJulia | :) | 20:37 |
openstackgerrit | Merged openstack-infra/elastic-recheck: Add a section to the readme about removing bug signatures https://review.openstack.org/204707 | 20:37 |
SpamapS | mordred: no, I'd appreciate a pointer though. | 20:37 |
mordred | clarkb: yah - I thought about adding a delete fails test case... | 20:37 |
greghaynes | TheJulia: no sarchasm | 20:37 |
mordred | clarkb: yes. we should log that. follow up patch? | 20:38 |
*** tonytan4ever has quit IRC | 20:39 | |
*** alivigni has quit IRC | 20:39 | |
*** patrickeast has joined #openstack-infra | 20:40 | |
openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Fix coverage report links on logs.o.o https://review.openstack.org/210114 | 20:40 |
clarkb | markstur: ^ | 20:40 |
clarkb | mordred: sure would you include that in the release? | 20:41 |
annegentle | can anyone recall how to delete a file from developer.openstack.org? I need to delete http://developer.openstack.org/api-ref-compute-v3.html and I don't have FTP to it. | 20:41 |
TheJulia | greghaynes: glad to hear it :) | 20:41 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add log message for when IP addresses fail https://review.openstack.org/210115 | 20:42 |
mordred | clarkb: yup ^^ there ya go | 20:42 |
*** minwang2 has left #openstack-infra | 20:42 | |
mordred | annegentle: do you have a quick link to 4b? | 20:42 |
mordred | annegentle: SpamapS is working on learning about provider-network/linuxbridge | 20:42 |
mordred | SpamapS: there is also a devstack flag for it now too | 20:42 |
mordred | sc68cal: if you're around, too, SpamapS may want to become you new best friend | 20:43 |
SpamapS | clarkb: haha, we just had a +2+A collision ;) | 20:43 |
annegentle | mordred: SpamapS: http://docs.openstack.org/networking-guide/deploy_scenario4b.html | 20:43 |
clarkb | SpamapS: bam | 20:43 |
greghaynes | That rolls over into a -2 right? | 20:43 |
annegentle | still sad it has a 4b :) | 20:44 |
clarkb | greghaynes: it becomes a +6 | 20:44 |
greghaynes | oh, straight to the top of the gate then | 20:44 |
greghaynes | :p | 20:44 |
mordred | SpamapS: annegentle beat sc68cal to being your new best friend | 20:44 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add controller class for Infra Cloud https://review.openstack.org/209698 | 20:44 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: First stab at making things bifrosty https://review.openstack.org/208751 | 20:44 |
SpamapS | and a +F4 | 20:44 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add openstack-modules.env https://review.openstack.org/209617 | 20:44 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Create playbook to puppet InfraCloud nodes https://review.openstack.org/209632 | 20:44 |
SpamapS | annegentle: thhhhannnkkkyouuuuuu | 20:44 |
greghaynes | oh h3y | 20:45 |
greghaynes | er, hey | 20:45 |
openstackgerrit | Terry Howe proposed openstack/os-testr: Convert file names to regular expressions https://review.openstack.org/203424 | 20:45 |
greghaynes | that doc looks like something we want | 20:45 |
*** funzo has joined #openstack-infra | 20:45 | |
SpamapS | greghaynes: http://docs.openstack.org/networking-guide/deploy_scenario4b.html is what we're doing I think. | 20:47 |
SpamapS | mordred: ^ | 20:47 |
SpamapS | jeblair: ^ | 20:47 |
greghaynes | yea | 20:47 |
*** claudiub has quit IRC | 20:47 | |
greghaynes | TheJulia: Bifrost question - I just made a new deploy image, if I want to push it out to some boxen what is the workflow for that | 20:47 |
greghaynes | will deploy-dynamic "just do it"? | 20:48 |
*** ihrachyshka has quit IRC | 20:48 | |
SpamapS | greghaynes: no | 20:48 |
clarkb | greghaynes: the Nike deployment? | 20:49 |
greghaynes | You know it | 20:49 |
mordred | SpamapS: yes | 20:49 |
*** funzo has quit IRC | 20:49 | |
jeblair | SpamapS: http://docs.openstack.org/infra/system-config/infra-cloud.html#networking agrees with you! | 20:49 |
jeblair | (it has a link to that page) | 20:50 |
*** bapalm has quit IRC | 20:50 | |
fungi | good ol' scenario 4b! | 20:50 |
SpamapS | haha I didn't realize that had been added. Doh | 20:50 |
*** dguerri is now known as dguerri` | 20:51 | |
TheJulia | greghaynes: it will pretty much just do it. Keep in mind you can customize your workflow to fit your needs. Checkout example-deploy-all-available-nodes.yaml | 20:51 |
greghaynes | oooo | 20:51 |
*** BrandonL18 has quit IRC | 20:52 | |
TheJulia | greghaynes: also, keep in mind, if it is already deployed, nothing is going to happen | 20:52 |
greghaynes | yea, I need do work up something to redeploy | 20:52 |
jeblair | so, at uc berkeley, before centralized mail, there was a machine called uclink, so you would be user@uclink.berkeley.edu. it got full, so new people ended up on anotheruser@uclink2.berkeley.edu. eventually they ended up with unfortunateuser@uclink4b.berkeley.edu before the wonders of centralized MXs were discovered. | 20:52 |
*** salv-orlando has joined #openstack-infra | 20:52 | |
jeblair | fungi: there's just something about "4b"... | 20:52 |
*** monester has quit IRC | 20:52 | |
SpamapS | greghaynes: set them to deleted... then re-run deploy. :) | 20:53 |
TheJulia | greghaynes: yeah... never quite sa down to do that yet. I might have a vict^H^H^Holunteer to help on supporting rebuild :) | 20:53 |
TheJulia | s/sa/sat/ | 20:53 |
greghaynes | fun fun | 20:53 |
clarkb | greghaynes: does the image build hostname still need debugging? I can probably dig into that today if so | 20:54 |
clarkb | *nodepool image build hostnames | 20:54 |
greghaynes | clarkb: I didnt actually look at the log to see what was going on | 20:54 |
greghaynes | ETOOMANYTHINGS | 20:54 |
*** dannywilson has quit IRC | 20:54 | |
greghaynes | got a link? | 20:54 |
clarkb | indeed you make cloud go | 20:54 |
SpamapS | greghaynes: regarding resizing /.. I think we should just make a playbook that plonks in an sfdisk command to resize / to 1100GB and runs resize2fs. Or we can put that in puppet, but I'm less inclined to have it in puppet since this is a "once ever in a box's lifetime" thing not "any time it's not right" | 20:54 |
*** dannywilson has joined #openstack-infra | 20:55 | |
clarkb | no ianw just mentioned that centos explodes on the hostname being too long when generating certs | 20:55 |
clarkb | I can proably dig it up in the logs | 20:55 |
*** mwagner_lap has quit IRC | 20:55 | |
greghaynes | SpamapS: oh, I was just doing resize2fs /dev/sda 1024G | 20:55 |
greghaynes | not even sfdisk | 20:55 |
greghaynes | since the config-drive is at the end of the disk | 20:55 |
SpamapS | greghaynes: true, it's not that horrible if we just leave the partition too big. | 20:55 |
greghaynes | yep | 20:55 |
SpamapS | greghaynes: I'm about to give up on making diskimage-builder put a /boot on | 20:55 |
greghaynes | but yes, just ansible do it | 20:55 |
clarkb | except sfdisk is crazy | 20:56 |
greghaynes | SpamapS: heh | 20:56 |
greghaynes | SpamapS: You want that so you can lvm? | 20:56 |
fungi | jeblair: still better than having a uucp address, or worse, one routed via a fidonet gateway | 20:56 |
clarkb | sectors containers -'s who knows! | 20:56 |
SpamapS | greghaynes: no I want that so I can make the rest of the disk / | 20:56 |
greghaynes | oh! | 20:56 |
greghaynes | yea, that is another way to solve that | 20:56 |
jeblair | clarkb: how many dockers per sector? | 20:56 |
clarkb | SpamapS: just dont do what ubuntu does and make /boot too tiny for more than 2 kernels | 20:56 |
fungi | jeblair: i think they're measured in parsecs | 20:56 |
clarkb | its so aggravating that the efi parittion is massive and has no data but /boot is tiny and has all the data | 20:57 |
openstackgerrit | Spencer Krum proposed openstack-infra/zuul: Log which repo zull references are created on https://review.openstack.org/210119 | 20:57 |
*** dkalleg has joined #openstack-infra | 20:57 | |
clarkb | (by default) | 20:57 |
SpamapS | Though I do love lvm as it lets me do clever things like a small ro /usr and noexec /var/lib/nova ... but who wants to micromanage these things, right? | 20:57 |
SpamapS | clarkb: inorite? | 20:57 |
fungi | clarkb: SpamapS: what bootloader are you stuck on that can't boot from lvm? | 20:57 |
greghaynes | fungi: we cant boot from 2TB without GPT is the issue | 20:58 |
fungi | ohhhh | 20:58 |
*** claudiub has joined #openstack-infra | 20:58 | |
greghaynes | just trying to find path of least resistence | 20:58 |
SpamapS | fungi: yeah, it's just a "numbers too big" issue. :-P | 20:58 |
fungi | right-o | 20:58 |
fungi | that _is_ an issue | 20:58 |
SpamapS | and actually making it GPT only is one thing I do want to try | 20:58 |
SpamapS | as that would be future-proofed and far simpler. | 20:58 |
fungi | yah | 20:59 |
greghaynes | making lvm with dib is on my list of things to hack on when I get some time | 20:59 |
greghaynes | because I like to lvm my things | 20:59 |
mordred | LVM == ossum | 20:59 |
SpamapS | In fact, I think ironic just needs tweaking to grok that GPT != uefi | 20:59 |
SpamapS | Because grub stage 1 is smart enough to go "oh, a GPT, I will boot that!" | 20:59 |
*** salv-orlando has quit IRC | 21:00 | |
clarkb | can ironic not uefi? | 21:00 |
*** EricGonczer_ has quit IRC | 21:00 | |
SpamapS | clarkb: it can! | 21:00 |
SpamapS | clarkb: but if it is not being told to uefi, it will freak out if there's no mbr | 21:00 |
clarkb | also we can use the freebsd bootloader with GPT instead of grub. Not sure why you want to though | 21:00 |
SpamapS | because it will try to add a config-drive with mbr only tools | 21:00 |
clarkb | SpamapS: gotcha | 21:01 |
SpamapS | it's entirely just a rigidity that isn't needed. | 21:01 |
openstackgerrit | devdatta-kulkarni proposed openstack-infra/project-config: Rename stackforge/solum -> openstack/solum https://review.openstack.org/201287 | 21:01 |
SpamapS | I have a near-term todo for that. | 21:01 |
clarkb | but iirc GPT + no uefi is how freebsd has done it for years now | 21:01 |
*** radez is now known as radez_g0n3 | 21:01 | |
SpamapS | clarkb: yeah, grub has supported that for along time too. | 21:02 |
SpamapS | a long | 21:02 |
SpamapS | clarkb: but.. distros and their funny "dual boot with stupid OS's" things.. ;) | 21:02 |
*** rfolco has quit IRC | 21:02 | |
SpamapS | we have no such desire. :) | 21:02 |
*** radez_g0n3 is now known as radez | 21:03 | |
SpamapS | some day I'd love for a distro to _JUST_ be for servers and always favor simple things that are just for servers. | 21:03 |
annegentle | jeblair: bwah ha ha finally read the 4b berkley email story ha ha ha | 21:03 |
* SpamapS waits for the BSD people to chime in | 21:03 | |
annegentle | so how do I delete a file from developer.openstack? | 21:03 |
clarkb | SpamapS: oh is that the motivation? (dual booting) | 21:04 |
fungi | SpamapS: i left my chimes in my other pands | 21:04 |
fungi | pants | 21:04 |
fungi | pandas? | 21:04 |
clarkb | its funny I had to boot windows not too long ago to fill out canadian visa paperwork for my mom. I almost forgot that my desktop could do that (don't worry it was airgapped from the internet for that operation) | 21:05 |
fungi | annegentle: via ftp | 21:05 |
annegentle | fungi: is it a separate server from docs.openstack? | 21:05 |
annegentle | fungi: maybe I don't have creds? | 21:05 |
*** tiswanso has quit IRC | 21:05 | |
fungi | annegentle: yeah, as far as i know cloudsites doesn't provide an easy way to have multiple fqdns for different docroots in a single site | 21:06 |
*** patrickeast has quit IRC | 21:06 | |
fungi | annegentle: creds will be different from docs.o.o but no recollection whether i sent you some when i originally created that one | 21:06 |
* fungi checks | 21:06 | |
*** mriedem is now known as mriedem_away | 21:07 | |
*** rm_work is now known as rm_work|away | 21:07 | |
annegentle | fungi: ok, I think I only have docs dot | 21:07 |
fungi | oh, right, i think you have to manage these from the "old" rackspace dashboard? | 21:07 |
fungi | ick | 21:07 |
annegentle | fungi: the docs dot ones, yes | 21:07 |
clarkb | fungi: I am glad you know all of this | 21:08 |
fungi | i think last time i tried it my browser was too new to allow me to connect | 21:08 |
fungi | giving it another shot now | 21:08 |
*** dannywilson has quit IRC | 21:08 | |
*** aysyd has quit IRC | 21:08 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/infra-manual: Recommend --no-ff on merges from feature to master https://review.openstack.org/210124 | 21:08 |
*** dannywilson has joined #openstack-infra | 21:08 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Update ATC and approvers scripts for deliverables https://review.openstack.org/210125 | 21:08 |
*** e0ne has joined #openstack-infra | 21:09 | |
*** yamamoto has joined #openstack-infra | 21:10 | |
*** patrickeast has joined #openstack-infra | 21:11 | |
*** ayoung has quit IRC | 21:11 | |
clarkb | greghaynes: from a snapshot log we definitely run ./prepare_node.sh bare-centos6-1438784043.template.openstack.org | 21:12 |
clarkb | ya thats a different name than the slave host names | 21:13 |
fungi | aha! it was https://manage.rackspacecloud.com/ | 21:13 |
fungi | that took some searching | 21:13 |
*** ldnunes has quit IRC | 21:13 | |
clarkb | greghaynes: ianw will work on a fix similar to how we fixed the slave hostname issue | 21:13 |
*** BrandonL08 has joined #openstack-infra | 21:15 | |
*** dkranz has quit IRC | 21:15 | |
*** e0ne has quit IRC | 21:16 | |
*** annegentle has quit IRC | 21:18 | |
*** sergmelikyan has quit IRC | 21:19 | |
*** sergmelikyan has joined #openstack-infra | 21:19 | |
*** yamamoto has quit IRC | 21:19 | |
openstackgerrit | Merged openstack-infra/shade: Throw an exception on a server without an IP https://review.openstack.org/208105 | 21:19 |
*** beisner is now known as beisner-afk | 21:19 | |
openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Shorten template hostname https://review.openstack.org/210127 | 21:20 |
clarkb | greghaynes: ianw ^ | 21:20 |
openstackgerrit | Merged openstack-infra/shade: Be consistent with accessing server dict https://review.openstack.org/209514 | 21:20 |
*** radez is now known as radez_g0n3 | 21:20 | |
*** SumitNaiksatam has quit IRC | 21:22 | |
*** beisner-afk is now known as beisner | 21:22 | |
*** markvoelker has quit IRC | 21:22 | |
*** armax has joined #openstack-infra | 21:22 | |
*** reed_ has joined #openstack-infra | 21:23 | |
mordred | Shrews: hrm. I'm torn on your flavors patch | 21:23 |
mordred | Shrews: because for non-admin users, "is_public" should default to true, but for admin users is_public should default to false | 21:24 |
mordred | Shrews: perhaps an override of the method with different default behaviors in operatorcloud? | 21:24 |
*** patrickeast has quit IRC | 21:24 | |
mordred | (I don't want to fall in to the trap of making a tool that is friendly to operators at the expense of doing what an end user expects) | 21:25 |
*** bswartz has quit IRC | 21:25 | |
*** btully has joined #openstack-infra | 21:25 | |
*** dguerri` is now known as dguerri | 21:26 | |
mordred | Shrews: also - bonghits on the second patch | 21:26 |
*** patrickeast has joined #openstack-infra | 21:27 | |
*** dguerri is now known as dguerri` | 21:28 | |
Shrews | mordred: ahoy | 21:29 |
*** EricGonczer_ has joined #openstack-infra | 21:29 | |
*** btully has quit IRC | 21:29 | |
Shrews | mordred: perhaps i don't understand flavors. testing on devstack, i created a private flavor as admin, yet the demo user was not able to see this, even when requesting all flavors | 21:31 |
mordred | Shrews: OH! | 21:33 |
Shrews | mordred: so the behavior is as you outlined. | 21:33 |
mordred | Shrews: well, then. in that case, you understand them better than I do | 21:33 |
mordred | Shrews: and I agree with your patch | 21:33 |
fungi | do we have a good way to identify the creation date and time for the diskimage from which a nodepool node was booted? | 21:34 |
*** cburroughs has joined #openstack-infra | 21:34 | |
fungi | i'm looking for a file which would be created by dib and not subsequently updated during/after boot | 21:34 |
*** harlowja has joined #openstack-infra | 21:34 | |
*** EricGonczer_ has quit IRC | 21:35 | |
clarkb | fungi: the node boot process should write the image uuid to /etc/nodepool | 21:35 |
fungi | yeah, i'm saying what if i don't trust the uuid to image creation mappingh | 21:35 |
fungi | trying to figure out if nodepool is really uploading updated diskimages, or just believes it is | 21:36 |
clarkb | oh if yo don't trust that then do a nova show on the instance | 21:36 |
clarkb | that includes the image nova thinks it was booted from | 21:36 |
fungi | which at least rules out everything except nodepool successfully uploading the wrong image | 21:37 |
fungi | though /etc/apt/sources.list has a current creation time, and i don't think we tweak that with a ready script, right? | 21:38 |
*** dannywilson has quit IRC | 21:39 | |
*** harlowja has quit IRC | 21:39 | |
clarkb | we may for fixing the security location from local cloud to ubutun proper | 21:39 |
*** harlowja has joined #openstack-infra | 21:39 | |
jeblair | mordred, clarkb, fungi: i need another brain on the nodepool instance-reuse problem. i've been staring at it for 2 days and have yet to figure out a way to reproduce, or anything that could be wrong. | 21:39 |
jeblair | here are the log entries: http://paste.openstack.org/show/411583/ | 21:39 |
*** angdraug has joined #openstack-infra | 21:39 | |
jeblair | i annotated them with 'A' and 'B' to indicate which threads are emitting them | 21:39 |
*** dannywilson has joined #openstack-infra | 21:40 | |
*** bswartz has joined #openstack-infra | 21:40 | |
jeblair | http://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/nodepool.py#n2438 | 21:40 |
fungi | jeblair: is there a lock around the database updates, or any (negative) query caching, that could cause nodepool's alien cleanup not to see the addition? | 21:40 |
*** BrandonL08 has quit IRC | 21:41 | |
jeblair | the only way that sequence can happen is if thread B, the cleanup thread, can't find the database record for the node -- that line 2438 ^ | 21:41 |
jeblair | fungi: not to my knowledge -- we're using mysql with sqlalchemy. each thread should have a thread-local session attached to its transaction. and while sqlalchemy will return an existing object from the session if you request it by id, i do not believe it performs any kind of negative caching related to that. so if the object didn't already exist in the cleanup thread session, it should hit the db and see it. | 21:43 |
fungi | it looks like the launcher knows the name and uuid as early as 14:58:23,581 and then the cleanup spots it at 15:03:16,571... nearly 5 minutes have elapsed, so that's pretty stale | 21:43 |
jeblair | and we know it's in the database because it's actually the _main_ thread (not represented here) that creates the record originally, and then a newly-created launch thread (thread A here) does a db lookup in its own session to retrieve the record | 21:44 |
*** b10n1k has quit IRC | 21:44 | |
jeblair | so "Launching node id: 4117507" can be interpreted as "thread A just successfully retrieved the node record by ID from the database" | 21:45 |
*** zul has quit IRC | 21:45 | |
fungi | though at that stage the uuid column is still empty for that row, yeah? | 21:45 |
jeblair | correct | 21:45 |
*** mquin_ is now known as mquin | 21:45 | |
fungi | presumably it's written several seconds later once it's known? | 21:46 |
jeblair | fungi: oops, i lied, it's the "creating server" line that indicates a successful lookup; 'launching node' happens right before the lookup. | 21:47 |
fungi | if the periodic cleanup queries the nova list and sees the uuid before it's updated in nodepool's db, would that mark it as an alien? | 21:47 |
jeblair | fungi: and then the uuid column is written to (and a commit issued) by the 'waiting for server' line. | 21:47 |
*** claudiub has quit IRC | 21:48 | |
fungi | would have to be a _very_ tight race between nova list and nova boot i guess | 21:48 |
*** tiswanso has joined #openstack-infra | 21:48 | |
jeblair | fungi: we actually query by the nodepool id in the metadata, so the uuid column doesn't matter at that point | 21:48 |
jeblair | fungi: the nova uuid will be used to delete the instance if there is not a match, but we don't use it until we decide to delete it; we operate entirely on metadata | 21:48 |
fungi | oh, there goes that theory | 21:50 |
lifeless | mriedem_away: pbr's versioning is all three-component semver at this point; we can change that but lets do so with some discussion (a spec) since its so wide-impact | 21:51 |
*** tiswanso has quit IRC | 21:52 | |
ianw | clarkb: "greghaynes: ianw will work on a fix similar to how we fixed the slave hostname issue" <- was that saying you want me to do something? | 21:53 |
*** armax has quit IRC | 21:53 | |
greghaynes | ianw: heh, I think clarkb already did it | 21:53 |
ianw | oh, ok, just catching up here :) | 21:54 |
clarkb | sorry your nick was missing the : too | 21:54 |
*** armax has joined #openstack-infra | 21:54 | |
clarkb | I was saying I will fix it and making sure you saw that I would | 21:54 |
*** reed_ has quit IRC | 21:54 | |
clarkb | jeblair: let me look | 21:54 |
clarkb | but my brain is probably not up for debugging thread races right now | 21:55 |
*** zul has joined #openstack-infra | 21:55 | |
*** thorst has quit IRC | 21:55 | |
clarkb | jeblair: leak checking queries nova directly then compares against the db. so could this just be the launch node thred hasn't committed to the db by the time the leak checker grabs from the db? | 21:56 |
clarkb | jeblair: I wouldn't be surprised if leak checking grabbed a db listing firs,t then a nova listing, then compared which would be a race | 21:56 |
*** BrandonL08 has joined #openstack-infra | 21:57 | |
*** SumitNaiksatam has joined #openstack-infra | 21:57 | |
clarkb | looks like it gets a session then lists the hosts from nova. That would be in its own transaction right? so wouldn't see updates from the launch node thread? | 21:58 |
openstackgerrit | Merged openstack/os-testr: Convert file names to regular expressions https://review.openstack.org/203424 | 21:58 |
*** salv-orlando has joined #openstack-infra | 21:59 | |
*** pradk has quit IRC | 22:00 | |
lifeless | Nakato: how goes the tox constraints stuff? Do you need any support? | 22:01 |
*** ivar-lazzaro has joined #openstack-infra | 22:03 | |
*** HeOS has quit IRC | 22:04 | |
jeblair | clarkb: i would expect it to see those updates....oh... so maybe this is a mysql question... | 22:04 |
*** HeOS has joined #openstack-infra | 22:04 | |
jeblair | clarkb, fungi: where sometimes operations inside the cleanup thread cause it not to see data from the other thread... which probably relates to when sqlalchemy does it's implicit begin transaction, which may be what i was missing in my attempted reproduction... | 22:05 |
*** rlandy has quit IRC | 22:06 | |
akraminsky_ | clarkb, trying to run those tempest tests and am running into this error "libvirtError: unsupported configuration: guest and host CPU are not compatible: Host CPU does not provide required features: ssse3, vme" have you ran into something like this? It looks like its an issue with the bios. | 22:06 |
*** marzif has quit IRC | 22:07 | |
jeblair | clarkb, fungi: i know that in one case, i started with a query for the node id before it was created, but still it showed up in the same thread after it was created, but maybe that's not enough | 22:07 |
clarkb | akraminsky_: its not a bios issue, it has to do with having different cpu types across nodes. We ran into it and deal wiht it by having devstack write out a custom qemu cpu type | 22:07 |
clarkb | akraminsky_: I think its call devstack64 or something like that | 22:07 |
*** gordc has quit IRC | 22:08 | |
*** salv-orlando has quit IRC | 22:08 | |
asselin_ | clarkb, hi, I'm working a bit with akraminsky_ on this. I see you wrote this script: tools/cpu_map_update.py | 22:11 |
asselin_ | . Is that what you're referring to? | 22:11 |
clarkb | asselin_: yes | 22:12 |
clarkb | asselin_: it writes out a bare minimum amd64 cpu type that works across hpcloud and rax | 22:12 |
*** cburroughs has quit IRC | 22:13 | |
clarkb | asselin_: I believe it will work on any amd64 cpu as long as you haven't disabled a weird set of features | 22:13 |
asselin_ | clarkb, ok we'll take a look. Still very odd that we would run into this since all our hardware/images/nodes should be the same | 22:13 |
clarkb | as its pretty minimal | 22:13 |
*** teran has joined #openstack-infra | 22:14 | |
*** armax has quit IRC | 22:15 | |
*** amitgandhinz has quit IRC | 22:16 | |
*** patrickeast has quit IRC | 22:17 | |
*** sergmelikyan has quit IRC | 22:17 | |
*** tiswanso has joined #openstack-infra | 22:18 | |
jeblair | clarkb: i just verified that our database is configured to use the default isolation level of repeatable-read. :) | 22:19 |
*** yamamoto has joined #openstack-infra | 22:19 | |
ianw | https://review.openstack.org/#/c/210030/2 (Remove color output from puppet apply) <- you'd think puppet could figure this out with isatty() ... | 22:23 |
*** abitha has quit IRC | 22:23 | |
*** bknudson has quit IRC | 22:23 | |
*** otter768 has joined #openstack-infra | 22:24 | |
clarkb | jeblair: so if that session is one transaction it won't see any updates because it has a snapshot created by the first read? | 22:24 |
*** yamamoto has quit IRC | 22:25 | |
*** abitha has joined #openstack-infra | 22:26 | |
*** patrickeast has joined #openstack-infra | 22:27 | |
jeblair | clarkb, fungi: and now i know why i can't repro locally -- wrong engine. thank you! i knew this was one of those things i just needed to talk about to see the obvious thing. :) | 22:27 |
clarkb | jeblair: you were myisam? | 22:27 |
*** abitha has quit IRC | 22:27 | |
*** abitha has joined #openstack-infra | 22:28 | |
*** otter768 has quit IRC | 22:28 | |
openstackgerrit | min wang proposed openstack-infra/project-config: New jobs for neutron-lbaasv2 tempest tests https://review.openstack.org/210141 | 22:30 |
openstackgerrit | min wang proposed openstack-infra/project-config: New jobs for neutron-lbaasv2 tempest tests https://review.openstack.org/210141 | 22:31 |
jeblair | clarkb: yep | 22:32 |
*** stevemar has quit IRC | 22:33 | |
jeblair | clarkb: and reproduced! :) | 22:34 |
*** tiswanso has quit IRC | 22:34 | |
clarkb | jeblair: woot | 22:34 |
openstackgerrit | Joshua Harlow proposed openstack-infra/project-config: Disable venv anvil VERBOSE setting https://review.openstack.org/210142 | 22:35 |
*** zul has quit IRC | 22:35 | |
openstackgerrit | Merged openstack-infra/project-config: Remove color output from puppet apply https://review.openstack.org/210030 | 22:35 |
*** sergmelikyan has joined #openstack-infra | 22:36 | |
clarkb | jeblair: after an initial look at code I don't have great ideas for fix. Maybe set transaction read level on that specific session to something a bit more ready? | 22:36 |
*** crc32 has joined #openstack-infra | 22:37 | |
*** asselin__ has joined #openstack-infra | 22:37 | |
*** puranamr has quit IRC | 22:38 | |
openstackgerrit | Ian Wienand proposed openstack-infra/project-config: scripts/copy_puppet_logs: Create LOG_DIR https://review.openstack.org/210097 | 22:39 |
*** asselin has quit IRC | 22:39 | |
openstackgerrit | Merged openstack-infra/shade: Add log message for when IP addresses fail https://review.openstack.org/210115 | 22:39 |
dkalleg | Hey clarkb: Me again :) I've tried running my test on a devstack that I stacked with the local.sh that Jenkins used and the test still passed on my env. I'm having trouble printing console logs. When doing the rest call to servers/<instance id>/action , i get an exception saying my instance could not be found. | 22:40 |
clarkb | dkalleg: is the test automatically cleaning it up after failure? you may need to catch the fail, do the console log, then do that clenaup | 22:40 |
dkalleg | clarkb: yes it does auto cleanup. The exception is while trying to get the console log. | 22:42 |
*** marzif has joined #openstack-infra | 22:42 | |
dkalleg | clarkb: I've been debugging for nearly two days with trial and error and waiting 2-5 hours for results from Jenkins. How much effort goes behind keeping a Jenking VM around for me to ssh into? | 22:43 |
clarkb | dkalleg: its less the effort involved and more the fact that this indicates your tests have a bug in logging | 22:43 |
clarkb | dkalleg: we want to make your tests debuggable and not just hop on the VM every time it fails | 22:43 |
*** asselin__ has quit IRC | 22:43 | |
dkalleg | clarkb: I certainly understand trying to keep it to a min. So what else do you recommend I check before we deem it necessary? | 22:44 |
clarkb | dkalleg: definitely get the console log so we can see if VM boots are failing | 22:44 |
dkalleg | I provision a cluster, get the cluster id, then loop over each node in the cluster, restfully calling to get the console log, then the env returns saying it doesn't know about my vms | 22:44 |
clarkb | you might also look at the tempest scenario tests as they pull ocnsole logs on failures | 22:45 |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Fix erroneously deleting non-leaked instances https://review.openstack.org/210149 | 22:45 |
jeblair | clarkb: ^ | 22:45 |
clarkb | jeblair: I hvae to go feed a baby but will look as soon as Ican | 22:45 |
*** sharikapongubala has joined #openstack-infra | 22:45 | |
clarkb | dkalleg: those logs are very important in any case where you need the VM to do more than just boot | 22:45 |
clarkb | dkalleg: that is why tempest grabs them for debugging | 22:46 |
*** stevemar has joined #openstack-infra | 22:47 | |
krotscheck | jeblair: I'm in conversation with npm right now, hopefully something will come of it. Best I can tell, we'll have to write our own publishing client. | 22:47 |
dkalleg | clarkb: I think we're having a disconnect. I agree the console logs would be a huge help. I'm using a framework that existed for 6+ months to request for those logs. I'm inclined to believe the request for console logs is sound. | 22:47 |
krotscheck | jeblair: PErsonally I'd love to have a --no-lifecycle option to npm publish, but we won't be able to use that until the distros catch up. | 22:47 |
clarkb | dkalleg: ok then lets get that working first | 22:48 |
dkalleg | clarkb: so what are you recommending | 22:48 |
clarkb | dkalleg: because I have a hunch it will point out the problem | 22:48 |
*** sharikapongubala has quit IRC | 22:48 | |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Remove terminated image/instance delete threads https://review.openstack.org/210150 | 22:48 |
dkalleg | clarkb: I'm convined that console logs would point out the problem | 22:48 |
jeblair | clarkb: also noticed that ^ | 22:49 |
openstackgerrit | Terry Howe proposed openstack/os-testr: Make use of argparse groups and add some tests https://review.openstack.org/210151 | 22:49 |
clarkb | dkalleg: ok then lets get that working, should be able to look at tempest to see how they do it | 22:49 |
clarkb | dkalleg: look a tthe scenario tests that boot a VM and ssh into it, on failures they dump the console log | 22:49 |
*** sharikapongubala has joined #openstack-infra | 22:50 | |
*** dims_ has quit IRC | 22:50 | |
jeblair | krotscheck: cool, thanks. good thing we like writing code! :) | 22:50 |
*** markvoelker has joined #openstack-infra | 22:50 | |
krotscheck | jeblair: We're going to have a chicken/egg problem though. Can't publish to npm without npm tool. Can't have npm tool without being able to publish. DOH | 22:51 |
krotscheck | :D | 22:51 |
clarkb | krotscheck: unless you use curl | 22:51 |
*** sharikapongubala has quit IRC | 22:51 | |
clarkb | krotscheck: and I am dead serious about that, worked great for pypi | 22:51 |
krotscheck | clarkb: I do not trust the stability of the npm registry enough to rely on curl. | 22:51 |
krotscheck | Or, well, the stability of their api. | 22:51 |
clarkb | krotscheck: well thats an issue with any tool | 22:52 |
jeblair | that wouldn't be solved by writing another tool, right? unless you aim to get them to maintain it in sync with their api. | 22:52 |
krotscheck | clarkb: True. But why worry when you can jsut make someone else do the work? https://github.com/npm/npm-registry-client | 22:52 |
*** alexpilotti has quit IRC | 22:52 | |
krotscheck | jeblair: There's already a library that does it, we'd just have to write a wrapper | 22:52 |
jeblair | krotscheck: ah nice | 22:52 |
krotscheck | Yep. Especially since that's what npm uses. | 22:53 |
dkalleg | clarkb: I'm making modifications to an integraion test that boots 3 vm's and would get console logs in certain error cases. I made a change to have it follow the same process but with or without failures. | 22:53 |
jeblair | krotscheck: (though, considering npm is in distros, etc, i'd hope they maintain backwards compat with their api for quite some time) | 22:53 |
krotscheck | jeblair: That's.... an excellent point. | 22:54 |
krotscheck | I hope so too. | 22:54 |
*** baoli has quit IRC | 22:54 | |
*** sharikapongubala has joined #openstack-infra | 22:54 | |
dkalleg | clarkb: If it helps, I've made changes to how this test tries to create a cluster: https://github.com/openstack/cue/blob/master/tests/integration/api/v1/clusters/test_clusters.py | 22:55 |
*** funzo has joined #openstack-infra | 22:55 | |
*** EricGonczer_ has joined #openstack-infra | 22:56 | |
asselin_ | nibalizer, you around to discuss https://review.openstack.org/#/c/199674/7/manifests/init.pp ? | 22:57 |
*** alexpilotti has joined #openstack-infra | 22:58 | |
*** funzo_ has joined #openstack-infra | 22:58 | |
jhesketh | Morning | 23:00 |
*** funzo has quit IRC | 23:00 | |
clarkb | jhesketh morning. there are comments on your change to set os-loganalyze filters, can you read them? | 23:00 |
*** marzif has quit IRC | 23:01 | |
krotscheck | jeblair: Any opinions on what a custom npm publish tool might be called? "openstack-npm-publish" seems meh. | 23:01 |
jhesketh | clarkb: cool, will do | 23:01 |
clarkb | at least one needs to ve addressed for sure | 23:01 |
nibalizer | asselin_: not really sorry | 23:02 |
*** funzo_ has quit IRC | 23:03 | |
asselin_ | nibalizer, ok, will leave comments then | 23:03 |
asselin_ | nibalizer, going on vacation. back next week | 23:03 |
*** erlon has quit IRC | 23:03 | |
mmmpork | hey folks, i'm assuming that someone else probably needs to +1 my addition of myself to stackalytics? | 23:03 |
mmmpork | https://review.openstack.org/#/c/210111/ | 23:03 |
nibalizer | asselin_: okay have fun | 23:04 |
*** EricGonc_ has joined #openstack-infra | 23:04 | |
asselin_ | nibalizer, thanks | 23:04 |
Clint | mmmpork: you need +2 and +A from https://review.openstack.org/#/admin/groups/183,members | 23:04 |
nibalizer | huh | 23:04 |
nibalizer | mmmpork: I wonder if someone needs to do a big patch to stackalytics to rename HP Development to HPE ? | 23:04 |
greghaynes | hah | 23:05 |
mmmpork | taking into account all of the "HP" variations? | 23:05 |
Clint | nibalizer: i was wondering the same thing | 23:05 |
Clint | plus the email addresses | 23:05 |
jeblair | krotscheck: s/openstack-// ? | 23:05 |
*** radez_g0n3 is now known as radez | 23:06 | |
*** sharikapongubala has quit IRC | 23:06 | |
*** EricGonczer_ has quit IRC | 23:07 | |
krotscheck | jeblair: Already taken. | 23:07 |
krotscheck | jeblair: npm-publish-tarball | 23:07 |
krotscheck | I'll run with that. | 23:07 |
clarkb | npmtwine | 23:07 |
*** abitha has quit IRC | 23:07 | |
*** patrickeast has quit IRC | 23:08 | |
*** sharikapongubala has joined #openstack-infra | 23:08 | |
*** sc68cal has quit IRC | 23:09 | |
*** dims_ has joined #openstack-infra | 23:10 | |
openstackgerrit | Sukhdev Kapur proposed openstack-infra/irc-meetings: Adding details to ironic_neutron meeting https://review.openstack.org/210154 | 23:10 |
krotscheck | clarkb: We can go with a theme. Instead of twine, call it rope? | 23:11 |
clarkb | sure dstufft may have more info on the twine name | 23:11 |
*** wenlock has quit IRC | 23:12 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add controller class for Infra Cloud https://review.openstack.org/209698 | 23:12 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: First stab at making things bifrosty https://review.openstack.org/208751 | 23:12 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add openstack-modules.env https://review.openstack.org/209617 | 23:12 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Create playbook to puppet InfraCloud nodes https://review.openstack.org/209632 | 23:12 |
*** btully has joined #openstack-infra | 23:13 | |
*** bswartz has quit IRC | 23:13 | |
openstackgerrit | Merged openstack-infra/nodepool: Shorten template hostname https://review.openstack.org/210127 | 23:14 |
*** sc68cal has joined #openstack-infra | 23:14 | |
*** vmbrasseur has joined #openstack-infra | 23:15 | |
mtreinish | clarkb: when you get a chance I pushed up the subunit2sql elastic-recheck crossover episode: https://review.openstack.org/209712 | 23:16 |
*** r-daneel has quit IRC | 23:17 | |
*** atuvenie has quit IRC | 23:17 | |
*** atuvenie has joined #openstack-infra | 23:17 | |
*** btully has quit IRC | 23:17 | |
*** jgriffith has joined #openstack-infra | 23:19 | |
*** mriedem has joined #openstack-infra | 23:21 | |
*** kmartin has quit IRC | 23:22 | |
*** mriedem_away has quit IRC | 23:23 | |
*** kurtmartin has joined #openstack-infra | 23:23 | |
*** kurtmartin has quit IRC | 23:24 | |
*** stevemar has quit IRC | 23:25 | |
*** Daviey has quit IRC | 23:25 | |
*** Daviey has joined #openstack-infra | 23:26 | |
*** salv-orlando has joined #openstack-infra | 23:27 | |
openstackgerrit | min wang proposed openstack-infra/project-config: Set octavia gate for neutron-lbaasv2 tempest test https://review.openstack.org/210141 | 23:30 |
*** jgriffith has quit IRC | 23:31 | |
*** morganfainberg is now known as morgan_503 | 23:31 | |
*** yushiro has joined #openstack-infra | 23:31 | |
yushiro | sdague, ping | 23:32 |
*** dangers is now known as dangers_away | 23:33 | |
*** bknudson has joined #openstack-infra | 23:35 | |
*** crc32 has quit IRC | 23:35 | |
gmann | jswarren: sure will look today. | 23:37 |
jswarren | gmann: thanks | 23:37 |
gmann | jswarren: np! | 23:37 |
*** sdake has quit IRC | 23:38 | |
*** bharath has quit IRC | 23:38 | |
*** camunoz_gone is now known as camunoz | 23:39 | |
*** btully has joined #openstack-infra | 23:41 | |
clarkb | ok I am back | 23:43 |
clarkb | jeblair: will review those changes now and try to get to mtreinish's change | 23:43 |
*** sharikapongubala has quit IRC | 23:47 | |
*** sharikapongubala has joined #openstack-infra | 23:49 | |
*** BrandonL08 has quit IRC | 23:49 | |
*** Sukhdev has joined #openstack-infra | 23:53 | |
*** dannywil_ has joined #openstack-infra | 23:54 | |
*** sharikapongubala has quit IRC | 23:54 | |
clarkb | mtreinish: just noting I am happy you chose to use pymysql as it makes updated the existing e-r install easier :) | 23:55 |
*** sharikapongubala has joined #openstack-infra | 23:56 | |
*** puranamr has joined #openstack-infra | 23:56 | |
*** dimtruck is now known as zz_dimtruck | 23:57 | |
fungi | clarkb: jeblair: not really around, approaching bedtime, but those two nodepool fixes lgtm. good find! | 23:57 |
clarkb | bedtime? I know fungi better than that | 23:57 |
*** dannywilson has quit IRC | 23:57 | |
*** ashleighfarnham has quit IRC | 23:57 | |
mtreinish | clarkb: heh, yep | 23:58 |
*** dannywil_ has quit IRC | 23:58 | |
*** alexpilotti has quit IRC | 23:58 | |
*** tsg has joined #openstack-infra | 23:59 | |
*** dingyichen has joined #openstack-infra | 23:59 | |
*** funzo has joined #openstack-infra | 23:59 | |
*** achanda has joined #openstack-infra | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!