NobodyCam | devananda: 124610 failing py 26 & 27 with ironic.tests.conductor.test_managerNon-zero exit code (2) from test listing. | 00:01 |
---|---|---|
*** mikedillion has quit IRC | 00:04 | |
*** marcoemorais has joined #openstack-ironic | 00:07 | |
*** mikedillion has joined #openstack-ironic | 00:08 | |
*** igordcard has quit IRC | 00:11 | |
*** todd_dsm has joined #openstack-ironic | 00:23 | |
openstackgerrit | Josh Gachnang proposed a change to openstack/ironic-python-agent: Add command metrics to IPA API https://review.openstack.org/119981 | 00:23 |
openstackgerrit | A change was merged to openstack/ironic: Add "affinity" tracking to nodes and conductors https://review.openstack.org/124493 | 00:23 |
*** todd_dsm has quit IRC | 00:24 | |
*** chuckC_ has quit IRC | 00:26 | |
jroll | devananda: so uh | 00:31 |
jroll | SystemError: Cannot compile 'Python.h'. Perhaps you need to install python-dev|python-devel. | 00:32 |
jroll | ... it's installed. | 00:32 |
jroll | devananda: so what specifically needs to be tested | 00:36 |
*** ChuckC has quit IRC | 00:36 | |
NobodyCam | got to a jenkins issue I get py27: commands succeeded congratulations :) | 00:45 |
jroll | holy shit, I got it working | 00:45 |
NobodyCam | jroll: nice! worth putting the steps on an ether pad | 00:47 |
jroll | NobodyCam: you know what needs to be tested with this hashring patch? iirc it's deploy a node, drop that node's conductor, wait for periodic task to run take_over, reboot the node | 00:47 |
jroll | NobodyCam: no, not worth it, it was fighting with debian/apt/pip stupidity | 00:47 |
NobodyCam | I was thinking more of the how to setup a multi conduvctor devstack ironic | 00:48 |
NobodyCam | :-p | 00:48 |
jroll | ha | 00:48 |
jroll | just point it at the right rabbit/mysql and it's fine | 00:49 |
NobodyCam | nice! | 00:49 |
*** marcoemorais has quit IRC | 00:49 | |
rloo | jroll: yes, I think that'd be a good test of the takeover stuff. | 00:50 |
jroll | raise exception.SSHCommandFailed(cmd=cmd_to_exec) | 00:50 |
jroll | SSHCommandFailed: Failed to execute command via SSH: /usr/bin/virsh --connect qemu:///system start baremetalbrbm_0. | 00:50 |
jroll | ughhhhhhhhhhhhh | 00:50 |
rloo | eek. | 00:51 |
jroll | rloo: ok | 00:51 |
NobodyCam | jroll use ipmi driver not ssh | 00:51 |
jroll | NobodyCam: I'm running with VMs in devstack | 00:52 |
rloo | i'm going to sign off. taking tomorrow off. so 'talk' to you all on Monday. I expect to see an RC1 candidate waiting for me ;) | 00:52 |
jroll | nn rloo | 00:52 |
NobodyCam | have a good night rloo :) | 00:52 |
NobodyCam | what about friday | 00:52 |
NobodyCam | :-p | 00:52 |
*** rainya has quit IRC | 00:53 | |
rloo | what about it? Fridays are nice days. I don't work on Fridays ;) | 00:53 |
* NobodyCam just assumed ^^^ :-p | 00:53 | |
NobodyCam | must be nice :) :-p | 00:53 |
NobodyCam | have a great long weekend rloo | 00:54 |
* jroll restacks because wtf | 00:54 | |
*** rloo has quit IRC | 00:55 | |
jroll | OH, need the private key on the other conductor | 00:58 |
jroll | duh | 00:59 |
jroll | that's an interesting point, the private key needs to be at the same path on both conductors | 00:59 |
*** mikedillion has quit IRC | 01:08 | |
*** ChuckC has joined #openstack-ironic | 01:09 | |
*** chuckC_ has joined #openstack-ironic | 01:11 | |
jroll | yesssssss, got it to work, I think | 01:42 |
* jroll nova reboot | 01:42 | |
jroll | weird, rabbit timeouts | 01:47 |
jroll | ugh, it's not actually pxe booting | 01:57 |
jroll | neutron knows the tftp-server to give it | 02:00 |
jroll | the files exist on the second conductor host (e.g. the takeover worked) | 02:01 |
jroll | but the node doesn't actually pxe boot, what the heck | 02:01 |
jroll | might be network issues | 02:01 |
jroll | anyhow, devananda, I think this works correctly | 02:02 |
* jroll tests this theory | 02:02 | |
jroll | boom | 02:08 |
jroll | let conductor one take back over, boots fine | 02:09 |
* jroll gerrit review | 02:09 | |
*** mitz_ has quit IRC | 02:11 | |
*** eghobo has quit IRC | 02:11 | |
*** nosnos has joined #openstack-ironic | 02:14 | |
jroll | devananda: left a review on https://review.openstack.org/#/c/124610/ | 02:16 |
jroll | devananda: I think it's good to go | 02:16 |
* jroll -> home | 02:16 | |
*** mitz_ has joined #openstack-ironic | 02:18 | |
JayF | jroll: you can't dhcp over the internet, or servicenet either for that matter | 02:28 |
JayF | jroll: so yeah; that last step not clicking was just environmental | 02:29 |
*** openstackgerrit has quit IRC | 03:08 | |
*** pcrews has quit IRC | 03:10 | |
*** openstackgerrit has joined #openstack-ironic | 03:11 | |
*** openstackgerrit has quit IRC | 03:18 | |
*** openstackgerrit has joined #openstack-ironic | 03:19 | |
*** nosnos has quit IRC | 03:29 | |
*** nosnos has joined #openstack-ironic | 03:30 | |
*** nosnos has quit IRC | 03:34 | |
*** rushiagr_away is now known as rushiagr | 04:12 | |
*** todd_dsm has joined #openstack-ironic | 04:13 | |
*** nosnos has joined #openstack-ironic | 04:19 | |
*** todd_dsm has quit IRC | 04:51 | |
*** harlowja is now known as harlowja_away | 05:00 | |
*** todd_dsm has joined #openstack-ironic | 05:53 | |
*** todd_dsm has quit IRC | 06:27 | |
*** ifarkas has joined #openstack-ironic | 06:50 | |
*** dtantsur|afk is now known as dtantsur | 07:00 | |
dtantsur | Morning Ironic | 07:00 |
*** athomas has joined #openstack-ironic | 07:11 | |
*** jcoufal has joined #openstack-ironic | 07:29 | |
*** jistr has joined #openstack-ironic | 07:42 | |
*** romcheg has joined #openstack-ironic | 07:43 | |
*** viktors|afk is now known as viktors | 07:47 | |
*** mitz_ has quit IRC | 07:53 | |
*** mitz_ has joined #openstack-ironic | 07:55 | |
*** takada_ has joined #openstack-ironic | 07:55 | |
*** takada_ is now known as takadayuiko | 07:56 | |
*** MattMan has quit IRC | 07:57 | |
*** MattMan has joined #openstack-ironic | 07:58 | |
*** lsmola has joined #openstack-ironic | 08:02 | |
*** andreykurilin_ has joined #openstack-ironic | 08:11 | |
*** lucasagomes has joined #openstack-ironic | 08:15 | |
dtantsur | are our py2[67] jobs broken? | 08:17 |
*** takadayuiko has quit IRC | 08:19 | |
*** yuanying has quit IRC | 08:23 | |
*** rushiagr is now known as rushiagr_away | 08:27 | |
*** rushiagr_away is now known as rushiagr | 08:33 | |
openstackgerrit | Lucas Alvares Gomes proposed a change to openstack/ironic: Add periodic task to rebuild conductor local state https://review.openstack.org/124610 | 08:36 |
*** yuanying has joined #openstack-ironic | 08:39 | |
*** andreykurilin_ has quit IRC | 08:39 | |
*** takada has joined #openstack-ironic | 08:45 | |
*** takada is now known as takadayuiko | 08:46 | |
*** greghaynes has quit IRC | 08:48 | |
*** greghaynes has joined #openstack-ironic | 08:51 | |
*** xuhaiwei__ has joined #openstack-ironic | 08:54 | |
*** xuhaiwei__ has quit IRC | 08:54 | |
*** pensu has joined #openstack-ironic | 08:54 | |
*** lazy_prince has quit IRC | 09:17 | |
lucasagomes | dtantsur, :/ idk yeah I see they r not "running" | 09:19 |
lucasagomes | or the results are getting lost | 09:19 |
lucasagomes | wondering if other projects that's happening too | 09:19 |
lucasagomes | lemme check | 09:19 |
*** rushiagr is now known as rushiagr_away | 09:23 | |
*** romcheg1 has joined #openstack-ironic | 09:27 | |
*** romcheg has quit IRC | 09:27 | |
lucasagomes | odd :/ it seems to affect the hash ring patch | 09:29 |
lucasagomes | only* | 09:29 |
openstackgerrit | A change was merged to openstack/ironic: Add a call to management.validate(task) https://review.openstack.org/125387 | 09:33 |
*** derekh has joined #openstack-ironic | 09:40 | |
*** pelix has joined #openstack-ironic | 09:51 | |
*** rushiagr_away is now known as rushiagr | 09:58 | |
*** dprince has joined #openstack-ironic | 10:02 | |
*** killer_prince has joined #openstack-ironic | 10:08 | |
*** killer_prince is now known as lazy_prince | 10:09 | |
*** nosnos has quit IRC | 10:50 | |
*** nosnos has joined #openstack-ironic | 10:51 | |
openstackgerrit | Ghe Rivero proposed a change to openstack/python-ironicclient: Bump hacking version https://review.openstack.org/125594 | 10:54 |
*** nosnos has quit IRC | 10:55 | |
*** dlaube has quit IRC | 11:00 | |
openstackgerrit | Lucas Alvares Gomes proposed a change to openstack/ironic: Add periodic task to rebuild conductor local state https://review.openstack.org/124610 | 11:04 |
*** takadayuiko has quit IRC | 11:07 | |
*** Haomeng|2 has joined #openstack-ironic | 11:11 | |
*** Haomeng has quit IRC | 11:11 | |
openstackgerrit | Ghe Rivero proposed a change to openstack/python-ironicclient: Bump hacking version https://review.openstack.org/125594 | 11:13 |
*** smoriya has quit IRC | 11:20 | |
*** dprince has quit IRC | 11:30 | |
*** todd_dsm has joined #openstack-ironic | 11:44 | |
*** dprince has joined #openstack-ironic | 11:55 | |
*** pensu has quit IRC | 12:36 | |
*** sambetts has joined #openstack-ironic | 12:40 | |
*** romcheg1 has left #openstack-ironic | 12:42 | |
openstackgerrit | A change was merged to openstack/python-ironicclient: Bump hacking version https://review.openstack.org/125594 | 12:46 |
*** linggao has joined #openstack-ironic | 13:07 | |
*** lazy_prince has quit IRC | 13:14 | |
*** lazy_prince has joined #openstack-ironic | 13:15 | |
*** sabah has joined #openstack-ironic | 13:15 | |
*** rakesh_hs has joined #openstack-ironic | 13:16 | |
*** todd_dsm has quit IRC | 13:38 | |
*** subah has joined #openstack-ironic | 13:38 | |
*** igordcard has joined #openstack-ironic | 13:39 | |
*** sabah has quit IRC | 13:40 | |
*** r-daneel has joined #openstack-ironic | 13:45 | |
*** rakesh_hs has quit IRC | 13:48 | |
*** todd_dsm has joined #openstack-ironic | 13:56 | |
*** todd_dsm has quit IRC | 13:56 | |
lucasagomes | pretty quiet here today | 14:08 |
*** subah has quit IRC | 14:17 | |
*** shikui_ has quit IRC | 14:18 | |
NobodyCam | Good Morning Iromoic | 14:26 |
sambetts | Afternoon! | 14:26 |
NobodyCam | :) | 14:27 |
NobodyCam | I was making coffee | 14:27 |
NobodyCam | morning lucasagomes | 14:27 |
NobodyCam | Morning sambetts | 14:27 |
lucasagomes | NobodyCam, morning! | 14:28 |
lucasagomes | sambetts, afternoon :) | 14:28 |
NobodyCam | lucasagomes: ya kiinda slow | 14:30 |
lucasagomes | NobodyCam, heh yeah... I got distract in other stuff, gotta start looking at what is causing that py26,27 errors in the take_over periodic task patch | 14:31 |
lucasagomes | 124610 | 14:31 |
lucasagomes | NobodyCam, btw, have u seem some error like that before? | 14:33 |
*** pcrews has joined #openstack-ironic | 14:36 | |
*** datajerk has joined #openstack-ironic | 14:40 | |
*** rainya has joined #openstack-ironic | 14:41 | |
NobodyCam | lucasagomes: I was looking at that lastnight | 14:41 |
*** romcheg1 has joined #openstack-ironic | 14:41 | |
NobodyCam | it passes for me locally | 14:41 |
lucasagomes | NobodyCam, yup, same here | 14:41 |
lucasagomes | and I've tried with fresh envs | 14:41 |
NobodyCam | got to a jenkins issue I get py27: commands succeeded congratulations :) | 14:41 |
lucasagomes | even started a new vm with a fresh os | 14:42 |
NobodyCam | thats what I did | 14:42 |
lucasagomes | still it doesn't fail :/ | 14:42 |
NobodyCam | i did do fresh os, i did fresh clone and tox | 14:42 |
lucasagomes | yeah | 14:43 |
lucasagomes | super odd hmm... by the logs I only can see some import error problem | 14:43 |
lucasagomes | I found it | 14:43 |
lucasagomes | http://blog.nemebean.com/content/debugging-syntax-and-import-errors-openstack-unit-tests | 14:43 |
lucasagomes | which looked related but I ran that discover command | 14:43 |
lucasagomes | and it didn't fail | 14:43 |
*** datajerk1 has quit IRC | 14:44 | |
lucasagomes | tl;dr $.tox/venv/bin/python2.7 -m testtools.run discover ironic/tests/ | 14:44 |
*** tteggel has quit IRC | 14:44 | |
lucasagomes | it shows some errors and all, but nothing related to import or that I could link with that error we are having in gate | 14:44 |
lucasagomes | NobodyCam, I will attempt to move the decorator out of the class and add to the methods instead to see | 14:45 |
*** tteggel has joined #openstack-ironic | 14:46 | |
openstackgerrit | Lucas Alvares Gomes proposed a change to openstack/ironic: Add periodic task to rebuild conductor local state https://review.openstack.org/124610 | 14:47 |
NobodyCam | awesome TY lucasagomes | 14:51 |
lucasagomes | NobodyCam, let's see idk if that's going to solve, the thing is, I can't reproduce it locally | 14:52 |
NobodyCam | usaly when I see an error like that is a missing colon or somehting that prevents the file from importing | 14:52 |
lucasagomes | so I'm trying to make some assumptions | 14:52 |
lucasagomes | yeah | 14:52 |
lucasagomes | that would probably be detect by the flake8 check and all | 14:52 |
lucasagomes | or even fail in devstack | 14:52 |
lucasagomes | :( | 14:53 |
lucasagomes | but this one no >.<' | 14:53 |
NobodyCam | yea really strang | 14:53 |
NobodyCam | strange even | 14:53 |
*** jrist has quit IRC | 14:53 | |
NobodyCam | going to pop out for morning smoke and mr zuul watching | 14:54 |
lucasagomes | yeah | 14:55 |
lucasagomes | should pass or fail soon | 14:55 |
lucasagomes | NobodyCam, same :( | 15:00 |
NobodyCam | gah | 15:00 |
dtantsur | NobodyCam, sambetts, morning/afternoon | 15:02 |
NobodyCam | morning dtantsur :) | 15:02 |
NobodyCam | lucasagomes: could it be : py27 runtests: PYTHONHASHSEED='1568384127' <- /me thought we fixed hash seed issue | 15:02 |
dtantsur | hmm, I remember fixing it as well | 15:05 |
lucasagomes | yeah we seem to set it in the env | 15:05 |
lucasagomes | [testenv:venv] | 15:05 |
lucasagomes | setenv = PYTHONHASHSEED=0 | 15:05 |
lucasagomes | the thing is, before I added the tests that patch was passing | 15:06 |
lucasagomes | well | 15:06 |
lucasagomes | hmm | 15:06 |
lucasagomes | I mean because of import error :/ | 15:06 |
NobodyCam | where is the subunit.run file | 15:06 |
lucasagomes | lemme try to set the PYTHONHASHSEED and run ir locally | 15:06 |
devananda | morning, all | 15:12 |
NobodyCam | good morning devananda | 15:12 |
NobodyCam | so this 124610 is a reall bugger | 15:13 |
*** ifarkas has quit IRC | 15:14 | |
devananda | hmm, k | 15:14 |
dtantsur | devananda, morning | 15:15 |
lucasagomes | devananda, morning | 15:15 |
NobodyCam | it passes for both lucas an myself | 15:17 |
NobodyCam | locally | 15:17 |
devananda | 2014-10-02 11:13:59.816 | du: cannot access ‘./subunit_log.txt’: No such file or directory | 15:17 |
lucasagomes | yeah there's something odd going on there :/ | 15:17 |
devananda | wtf? | 15:18 |
lucasagomes | devananda, there's an import error also up on that output | 15:18 |
devananda | 2014-10-02 11:13:59.135 | ironic.tests.conductor.test_managerNon-zero exit code (2) from test listing. | 15:18 |
lucasagomes | I sent an email to the list, but no feedback still :/ | 15:18 |
NobodyCam | thats the error I saw | 15:18 |
lucasagomes | devananda, yeah, it was important ironic.common.keystone before on test_manager.py | 15:19 |
NobodyCam | if I run the subunit.run --list locally it exits with 0 | 15:19 |
lucasagomes | so i removed that important modified the mock and failed the same way.... tried to move the decorators from the class level to the methods to see if it was some evaluation problem | 15:19 |
lucasagomes | same :/ | 15:19 |
lucasagomes | so | 15:19 |
lucasagomes | s/imporatnt/import/ | 15:20 |
devananda | lucasagomes: have you reproduced the error locally? | 15:21 |
*** viktors is now known as viktors|afk | 15:21 | |
lucasagomes | devananda, nop, tried it | 15:22 |
lucasagomes | even with a fresh OS install | 15:22 |
lucasagomes | of ubuntu trusty | 15:22 |
devananda | :-/ | 15:22 |
* devananda pokes infra | 15:22 | |
lucasagomes | I feel like submitting another patch-set removing the tests from test_manager.py and see if it passes... if so add only the base class and the setUp method see if it passes... | 15:25 |
lucasagomes | and then start poking from there | 15:25 |
NobodyCam | lucasagomes: hummm maybe poke first then remove ..lol | 15:25 |
devananda | lucasagomes: can you revert this patch set back to what it "should" be, then do that in a separate one? | 15:26 |
lucasagomes | devananda, sure... yeah lemme do it | 15:26 |
devananda | thanks | 15:27 |
openstackgerrit | Lucas Alvares Gomes proposed a change to openstack/ironic: Add periodic task to rebuild conductor local state https://review.openstack.org/124610 | 15:27 |
openstackgerrit | Lucas Alvares Gomes proposed a change to openstack/ironic: THIS IS A TEST. ( . will prevent pep8 :) ) https://review.openstack.org/125676 | 15:30 |
*** jrist has joined #openstack-ironic | 15:30 | |
*** athomas has quit IRC | 15:34 | |
lucasagomes | let's see | 15:35 |
* NobodyCam is watching | 15:37 | |
* devananda rebuilds venv | 15:37 | |
NobodyCam | so folks talking about moving back to myspace....lol | 15:38 |
lucasagomes | hah myspace?! | 15:39 |
lucasagomes | no pls :P | 15:39 |
lucasagomes | gate is a bit slower now | 15:39 |
NobodyCam | lucasagomes: hearing a lot of chatter about folks quite upset at facebook is making them use thier birth name. | 15:40 |
lucasagomes | NobodyCam, ic! well diaspora ! | 15:40 |
NobodyCam | we know someone who actually leagally changed their name and face book is making them change the account name | 15:41 |
NobodyCam | back to their birth name | 15:41 |
lucasagomes | hah ouch | 15:41 |
lucasagomes | yeah names are pretty confusing | 15:41 |
lucasagomes | I've a confusing story with names, because I've 2 diff names one in europe and one in brazil | 15:42 |
lucasagomes | my grandad changed his name when he went to brazil, and then when my family claimed the spanish citizenship again we got our "real" name back | 15:42 |
lucasagomes | but in brazil the legal one is the fake one | 15:42 |
lucasagomes | it's pretty odd | 15:43 |
NobodyCam | :-p | 15:44 |
NobodyCam | 26 running now | 15:45 |
lucasagomes | o/ | 15:45 |
*** jcoufal has quit IRC | 15:45 | |
devananda | lucasagomes: fwiw, chattnig with -infra folks about this issue | 15:47 |
* lucasagomes joins #-infra | 15:48 | |
openstackgerrit | Thierry Carrez proposed a change to openstack/ironic: Open Kilo development https://review.openstack.org/125693 | 15:50 |
lucasagomes | removing the tests works | 15:52 |
lucasagomes | will add only the base class | 15:52 |
NobodyCam | 124610 fail | 15:52 |
NobodyCam | 125676 pass | 15:52 |
lucasagomes | NobodyCam, that's the original one, 125676 is the test one | 15:52 |
NobodyCam | ^^ with py26 | 15:52 |
openstackgerrit | Lucas Alvares Gomes proposed a change to openstack/ironic: THIS IS A TEST. https://review.openstack.org/125676 | 15:53 |
NobodyCam | lucasagomes: puttng things baack pice by pice? | 15:54 |
lucasagomes | NobodyCam, yeah, see if I can isolate the problem | 15:54 |
NobodyCam | ack :) | 15:54 |
lucasagomes | NobodyCam, tho I will have to leave pretty soon :( | 15:55 |
NobodyCam | :( | 15:55 |
NobodyCam | lucasagomes: if you leave before we get this sorted. are you good with 124610 as is (once tests actually pass) | 15:57 |
lucasagomes | NobodyCam, yes | 15:58 |
NobodyCam | :) | 15:58 |
*** christop2eraedo is now known as christopheraedo | 16:02 | |
devananda | lucasagomes: think clark found the problem | 16:02 |
*** dlaube has joined #openstack-ironic | 16:02 | |
lucasagomes | devananda, yea was looking infra | 16:03 |
lucasagomes | right so it's the import context | 16:03 |
NobodyCam | lol really | 16:03 |
NobodyCam | rebase | 16:03 |
lucasagomes | :/ | 16:03 |
lucasagomes | seems so | 16:03 |
devananda | yup | 16:04 |
devananda | git checkout master && git reset --hard origin/master && git review -x 124610 && git rebase origin/master | 16:04 |
devananda | NOW i'm getting the error | 16:04 |
lucasagomes | so another review have removed the import context | 16:04 |
lucasagomes | and we are using it in the mock | 16:04 |
lucasagomes | gosh! whats the probability of that happens again | 16:05 |
devananda | 85b3f48eb946c198887aed9bfe89d7892746b9d9 | 16:06 |
devananda | that commit from vdrak | 16:06 |
lucasagomes | yeah | 16:06 |
lucasagomes | devananda, aight! good it's sorted | 16:06 |
lucasagomes | I will have to go | 16:06 |
NobodyCam | have a good night lucasagomes | 16:07 |
lucasagomes | devananda, thanks for talking to the guys on -infra | 16:07 |
*** hemna has joined #openstack-ironic | 16:08 | |
openstackgerrit | Devananda van der Veen proposed a change to openstack/ironic: Add periodic task to rebuild conductor local state https://review.openstack.org/124610 | 16:09 |
lucasagomes | aight good night everybody! | 16:10 |
openstackgerrit | Devananda van der Veen proposed a change to openstack/ironic: Make hash ring mapping be more consistent https://review.openstack.org/118932 | 16:10 |
*** lucasagomes has quit IRC | 16:10 | |
NobodyCam | do we still have cores around to land ^^^^^ | 16:12 |
devananda | so, if we can land those two patches, we'll close 3 bugs | 16:12 |
devananda | the only RC bug left then will be https://bugs.launchpad.net/ironic/+bug/1367182 | 16:12 |
devananda | Shrews, jroll: around? 124610 should be landable now - I believe I've fixed the py27 import error | 16:13 |
* NobodyCam reviews it now | 16:13 | |
devananda | NobodyCam: and 118932 already has 2 +2. I'm adding a +A even though it won't merge until the previous one does | 16:13 |
jroll | morning ironic :) | 16:15 |
NobodyCam | ack :) | 16:15 |
NobodyCam | morning jroll | 16:15 |
jroll | devananda: I +2'd 124610 last night, gertty didn't sync right | 16:16 |
openstackgerrit | Jim Rollenhagen proposed a change to openstack/ironic-python-agent: Force heartbeat immediately after async command completes https://review.openstack.org/125464 | 16:16 |
jroll | will double check | 16:16 |
openstackgerrit | Jim Rollenhagen proposed a change to openstack/ironic-python-agent: Use poll instead of threading.Event in heartbeat thread https://review.openstack.org/113343 | 16:16 |
devananda | jroll: I pushed a fix to it just now for the import error | 16:17 |
NobodyCam | devananda: are there any plans to revisit the per driver creditials stuff.. _update_ipmi_properties seems like a hackish fix | 16:17 |
devananda | NobodyCam: it's a totally hackish fix | 16:17 |
jroll | devananda: yep, reviewing | 16:17 |
NobodyCam | then I'm good with it | 16:18 |
NobodyCam | jroll: are you reviewing too | 16:18 |
jroll | yes | 16:19 |
* devananda adds "standardized authentiation info" to summit gDoc | 16:19 | |
jroll | rebase is messing with me tho | 16:19 |
jroll | devananda: eh? | 16:19 |
devananda | jroll: https://docs.google.com/spreadsheets/d/1XBKdeDeGfaRYaThjIIoYRwe_zPensECnxsKUuqdoVmQ/edit#gid=0 | 16:19 |
jroll | +2'd 124610 | 16:20 |
* jroll waits to see what this means | 16:20 | |
NobodyCam | devananda: +++++ | 16:20 |
NobodyCam | devananda: 124704 now has two +2's I did not +a as I thought jroll was reviewing | 16:21 |
jroll | ah, I see | 16:21 |
jroll | oh, I was looking at 124610 :P | 16:21 |
jroll | NobodyCam: I don't care about ilo creds so much, go ahead without me if you'd like | 16:22 |
NobodyCam | landing | 16:22 |
NobodyCam | 124704 on its way down | 16:22 |
NobodyCam | I will +a 124610 as soon as it passes tests | 16:23 |
NobodyCam | so thats it. we will be able to cut RC! | 16:23 |
dtantsur | calling it a day, buy! | 16:24 |
*** dtantsur is now known as dtantsur|afk | 16:24 | |
NobodyCam | thought 124610 may require another rebase as 124704 also changes test_manager | 16:24 |
NobodyCam | night dtantsur|afk :) | 16:24 |
jroll | NobodyCam: we still have a patch on top of the hashring periodic thing, yes | 16:25 |
jroll | ? | 16:25 |
*** jasondotstar has joined #openstack-ironic | 16:25 | |
devananda | jroll: yes. one more, but i've already approved it | 16:25 |
devananda | jroll: to stabilize the ring distribution | 16:25 |
NobodyCam | jroll: 118932 but its approved | 16:26 |
jroll | ah, ok | 16:26 |
*** romcheg1 has quit IRC | 16:26 | |
jroll | cool, thanks :) | 16:26 |
devananda | dtantsur|afk: cheers! have a good evening | 16:26 |
*** derekh has quit IRC | 16:34 | |
NobodyCam | two more voting jobs to go :-p | 16:34 |
NobodyCam | yuriyz: are you in channel? | 16:40 |
*** rainya has quit IRC | 16:42 | |
*** jistr has quit IRC | 16:45 | |
*** lsmola has quit IRC | 16:48 | |
*** ramineni has joined #openstack-ironic | 16:56 | |
*** marcoemorais has joined #openstack-ironic | 16:57 | |
NobodyCam | 124610 +a'd | 16:57 |
NobodyCam | devananda: everything needed for RC should now be approved | 16:57 |
NobodyCam | merged is another story :-p | 16:58 |
NobodyCam | brb | 17:01 |
devananda | awesome | 17:04 |
* devananda watches | 17:04 | |
*** jrist has quit IRC | 17:10 | |
openstackgerrit | A change was merged to openstack/python-ironicclient: Small fixes for utils/{common_filters,common_params_for_list} https://review.openstack.org/124040 | 17:13 |
*** harlowja_away is now known as harlowja | 17:14 | |
*** rainya has joined #openstack-ironic | 17:26 | |
*** igordcard has quit IRC | 17:28 | |
*** ndipanov has quit IRC | 17:32 | |
*** lazy_prince is now known as killer_prince | 17:37 | |
adam_g | uhm http://logs.openstack.org/00/125700/1/check/check-tempest-dsvm-ironic-pxe_ssh-nv/13ee2e5/logs/devstacklog.txt.gz#_2014-10-02_16_51_59_650 | 17:46 |
*** rainya has quit IRC | 17:46 | |
*** pensu has joined #openstack-ironic | 17:51 | |
*** rainya has joined #openstack-ironic | 17:52 | |
devananda | eh?? | 17:54 |
*** pelix has quit IRC | 17:56 | |
devananda | adam_g: logstash shows that starting within the last 2 hours | 17:56 |
devananda | adam_g: with 19 occurrences | 17:57 |
adam_g | devananda, yeah.. | 17:57 |
devananda | I have to jump on a call. can you dig into it? | 17:57 |
adam_g | yeah, lookin | 17:57 |
devananda | bad time for a gate blocking bug | 17:57 |
devananda | we're trying to land the last 2 patches to cut RC1 | 17:57 |
adam_g | not sure if something in devstack/nodepool changed or the ubuntu package dependency chain changed. qemu-utils is not being installed | 17:57 |
openstackgerrit | A change was merged to openstack/ironic: Add periodic task to rebuild conductor local state https://review.openstack.org/124610 | 18:00 |
NobodyCam | one down ^^^ | 18:04 |
NobodyCam | devananda: we need to land a total of three patches no? | 18:04 |
adam_g | the failure looks isolated to HP cloud, there was a passing case that happened after failures started so it may not be entirely blocking (yet) | 18:06 |
*** jrist has joined #openstack-ironic | 18:07 | |
*** sambetts has quit IRC | 18:08 | |
NobodyCam | adam_g: is this what your seeing? http://logs.openstack.org/04/124704/4/gate/gate-tempest-dsvm-ironic-pxe_ssh/b208e6d/logs/devstacklog.txt.gz#_2014-10-02_16_42_48_338 | 18:10 |
NobodyCam | yep | 18:10 |
*** pensu has quit IRC | 18:25 | |
adam_g | https://review.openstack.org/#/c/125732/ | 18:25 |
adam_g | hopefully that fixes it. it turns out the nodepool images were alwasys built from cloud providers ubuntu images, but today have switced to custom images built via DIB | 18:26 |
adam_g | that doesn't explain it entirely, but i can imagine that causing unforeseen problems | 18:26 |
Shrews | adam_g: eh? do you know if this was announced on the ML? seems like a huge change to make w/o some warning | 18:29 |
* Shrews searches ML archive | 18:30 | |
*** tatyana has joined #openstack-ironic | 18:32 | |
adam_g | Shrews, it might have been? ive been following chatter in -infra about it for the last few weeks | 18:33 |
Shrews | JoshNang: I just left some comments on one of your IPA reviews. Feel free to tell me I'm stupid. I'm trying to become more familiar with that code. | 18:35 |
JoshNang | Shrews: thanks! | 18:36 |
JoshNang | i'll take a look at em | 18:36 |
*** marcoemorais has quit IRC | 18:39 | |
*** marcoemorais has joined #openstack-ironic | 18:39 | |
*** marcoemorais has quit IRC | 18:39 | |
*** marcoemorais has joined #openstack-ironic | 18:40 | |
*** marcoemorais has quit IRC | 18:40 | |
*** marcoemorais has joined #openstack-ironic | 18:41 | |
* NobodyCam is going to hit hte road for lunch. prob a extra 1/2 hour to hour extra lunch time | 18:41 | |
*** tatyana has quit IRC | 18:53 | |
devananda | adam_g: is there a bug open for this? | 19:00 |
* devananda recheck-grinds two remaining release blocking patches | 19:00 | |
adam_g | devananda, https://review.openstack.org/#/c/125732/ | 19:01 |
*** rushiagr has quit IRC | 19:01 | |
adam_g | watching that run, its gotten further along, i think its the fix | 19:01 |
* devananda +1's it anyway | 19:02 | |
adam_g | that is, devstack ran and its into its tempest tests | 19:02 |
devananda | adam_g: so we have two patches left in the RC blocking list | 19:02 |
adam_g | devananda, which ? | 19:02 |
adam_g | nvm, i found them | 19:03 |
*** jrist has quit IRC | 19:03 | |
devananda | it's some great timing :) | 19:03 |
*** marcoemorais has quit IRC | 19:03 | |
devananda | https://review.openstack.org/118932 and https://review.openstack.org/124704 | 19:03 |
*** marcoemorais has joined #openstack-ironic | 19:03 | |
*** marcoemorais has quit IRC | 19:03 | |
*** marcoemorais has joined #openstack-ironic | 19:04 | |
*** marcoemorais has quit IRC | 19:04 | |
*** marcoemorais has joined #openstack-ironic | 19:04 | |
*** marcoemorais has quit IRC | 19:04 | |
*** marcoemorais has joined #openstack-ironic | 19:05 | |
*** marcoemorais has quit IRC | 19:05 | |
*** marcoemorais has joined #openstack-ironic | 19:06 | |
*** rushiagr has joined #openstack-ironic | 19:19 | |
devananda | heading into the office in a bit, will keep an eye on the gates as I can | 19:20 |
Shrews | 124704 already has a failure | 19:26 |
*** jasondotstar has quit IRC | 19:32 | |
*** jrist has joined #openstack-ironic | 19:32 | |
adam_g | https://review.openstack.org/#/c/125732/ passed | 19:52 |
adam_g | only 13 patches in the gate | 19:53 |
*** ryanpetrello has quit IRC | 20:00 | |
* Shrews reverifies 124704 | 20:11 | |
*** shikui_ has joined #openstack-ironic | 20:12 | |
*** rushiagr is now known as rushiagr_away | 20:23 | |
*** rushiagr_away is now known as rushiagr | 20:23 | |
*** ryanpetrello has joined #openstack-ironic | 20:27 | |
*** dprince has quit IRC | 20:28 | |
*** marcoemorais1 has joined #openstack-ironic | 20:31 | |
*** marcoemorais1 has quit IRC | 20:31 | |
*** marcoemorais1 has joined #openstack-ironic | 20:32 | |
*** marcoemorais has quit IRC | 20:34 | |
*** linggao has quit IRC | 20:43 | |
*** igordcard has joined #openstack-ironic | 20:49 | |
*** rushiagr is now known as rushiagr_away | 20:53 | |
*** marcoemorais1 has quit IRC | 20:55 | |
*** HenryG has quit IRC | 20:55 | |
*** marcoemorais has joined #openstack-ironic | 21:02 | |
devananda | failing again | 21:05 |
devananda | and we're nto getting merge comments in IRC now? | 21:05 |
Shrews | devananda: i rechecked both | 21:08 |
*** andreykurilin_ has joined #openstack-ironic | 21:13 | |
adam_g | do ironic/nova/etc patches in the gate queue pull in devstack changes ahead of it? | 21:23 |
adam_g | https://review.openstack.org/#/c/125732/ is about to finish | 21:26 |
devananda | "ahead of it" ? | 21:26 |
adam_g | devananda, as in, patch D gets tested with A, B, C, D | 21:28 |
*** andreykurilin_ has quit IRC | 21:29 | |
adam_g | but those ironic patches aren't even in the gate queue yet | 21:30 |
devananda | adam_g: afaik we do not yet support cross-project branch testing | 21:30 |
adam_g | UGH | 21:31 |
adam_g | gate-tempest-dsvm-postgres-full: FAILURE | 21:31 |
devananda | yep | 21:32 |
devananda | :( | 21:32 |
*** marcoemorais has quit IRC | 21:35 | |
*** marcoemorais has joined #openstack-ironic | 21:36 | |
*** marcoemorais has quit IRC | 21:37 | |
*** marcoemorais has joined #openstack-ironic | 21:38 | |
*** marcoemorais has quit IRC | 21:38 | |
*** marcoemorais has joined #openstack-ironic | 21:38 | |
*** hemna has quit IRC | 21:38 | |
*** hemna has joined #openstack-ironic | 21:39 | |
*** corvus has quit IRC | 21:40 | |
*** corvus has joined #openstack-ironic | 21:41 | |
adam_g | ... reverified | 21:47 |
*** hemna has quit IRC | 21:53 | |
*** hemna has joined #openstack-ironic | 21:57 | |
*** rainya has quit IRC | 22:06 | |
*** krtaylor is now known as krtaylor_away | 22:19 | |
devananda | reverified again | 22:19 |
*** hemna has quit IRC | 22:35 | |
adam_g | https://review.openstack.org/#/c/125732/ back in the gate queue | 22:53 |
*** nosnos has joined #openstack-ironic | 23:06 | |
*** HenryG has joined #openstack-ironic | 23:10 | |
*** igordcard has quit IRC | 23:37 | |
*** rainya has joined #openstack-ironic | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!