Thursday, 2014-09-11

openstackgerritJosh Gachnang proposed a change to openstack/ironic-python-agent: Add verification support to the agent  https://review.openstack.org/12062700:08
*** harlowja_ has quit IRC00:25
*** yuanying has quit IRC00:25
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Updated from global requirements  https://review.openstack.org/12063700:25
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic-python-agent: Updated from global requirements  https://review.openstack.org/11405800:25
*** yuanying has joined #openstack-ironic00:25
*** dlaube has quit IRC00:25
*** harlowja has joined #openstack-ironic00:28
*** dlaube has joined #openstack-ironic00:30
openstackgerritOpenStack Proposal Bot proposed a change to openstack/python-ironicclient: Updated from global requirements  https://review.openstack.org/12065100:31
jrolldevananda: around?00:35
jroll.b 800:36
jrolloops00:36
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Add docstrings for agent.py  https://review.openstack.org/12066000:41
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Add docstrings for api/ tree  https://review.openstack.org/12066100:41
jrollwhee.00:41
*** Haomeng has quit IRC00:42
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Add docstrings for api/ tree  https://review.openstack.org/12066100:44
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Add docstrings for agent.py  https://review.openstack.org/12066000:44
*** Haomeng has joined #openstack-ironic00:45
openstackgerritJay Faulkner proposed a change to openstack/ironic-python-agent: Improve docstrings for cmd/agent.py  https://review.openstack.org/12066200:46
openstackgerritJay Faulkner proposed a change to openstack/ironic-python-agent: Improve/add docstrings for CommandResult classes  https://review.openstack.org/12066300:46
JayFrloo: ^ especially relevant to your interests :) although we still have a long way to go00:46
JayFIronic folk ^^ please look over these and review them. I have a strong preference for people who haven't worked much with IPA to review the docstrings to ensure they're clear and complete.00:47
jrollIPA folk, quick review :) https://review.openstack.org/#/c/120586/400:47
NobodyCamJayF: can I loo it over in the morning00:48
JayFNo rush whatsoever00:48
JayFwe're just going through these adding docstrings00:48
NobodyCam:)00:48
*** dlaube has quit IRC01:31
*** Hefeweizen has quit IRC01:33
*** rainya has quit IRC01:42
*** rainya has joined #openstack-ironic01:43
*** nosnos has joined #openstack-ironic01:47
*** scubacuda has quit IRC01:47
rlooJayF: Thanks. I was looking for bedtime reading ;)01:47
*** Nisha has quit IRC01:58
*** killer_prince is now known as lazy_prince02:05
*** rloo has quit IRC02:09
*** rainya has quit IRC02:31
*** rainya has joined #openstack-ironic02:36
openstackgerritMotohiro Otsuka proposed a change to openstack/ironic: Search line with awk itself and avoid grep  https://review.openstack.org/11896602:43
*** ramineni has joined #openstack-ironic02:44
*** rushiagr_away is now known as rushiagr02:53
ramineniJayF: Hi03:03
*** lazy_prince is now known as killer_prince03:04
*** rushiagr is now known as rushiagr_away03:14
*** Poornima has joined #openstack-ironic03:29
*** rushiagr_away is now known as rushiagr03:46
*** harlowja is now known as harlowja_away04:05
*** krtaylor has joined #openstack-ironic04:11
*** rainya has quit IRC04:29
*** Poornima has quit IRC04:31
*** HenryG is now known as HenryG_zzzz04:40
*** rakesh_hs has joined #openstack-ironic04:49
*** chuckC has quit IRC04:57
*** Poornima has joined #openstack-ironic04:57
*** pcrews has quit IRC05:07
*** chuckC has joined #openstack-ironic05:27
*** killer_prince is now known as lazy_prince05:36
*** jcoufal has joined #openstack-ironic05:59
*** nikunj2512 has joined #openstack-ironic06:04
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Imported Translations from Transifex  https://review.openstack.org/12070106:12
*** Nisha has joined #openstack-ironic06:23
*** k4n0 has joined #openstack-ironic06:34
*** ccit has joined #openstack-ironic06:41
*** ccit has quit IRC07:09
*** takadayuiko has joined #openstack-ironic07:09
*** dtantsur|afk is now known as dtantsur07:12
dtantsurMorning Ironic07:12
*** todd_dsm has joined #openstack-ironic07:12
openstackgerritA change was merged to openstack/ironic-specs: Add RSS feed  https://review.openstack.org/12051607:13
openstackgerritA change was merged to openstack/ironic-specs: Remove templates from toctrees  https://review.openstack.org/12051707:13
openstackgerritA change was merged to openstack/ironic-specs: Use the current date for the copyright statement  https://review.openstack.org/12051807:13
*** ifarkas has joined #openstack-ironic07:14
openstackgerritYuiko Takada proposed a change to openstack/python-ironicclient: Add unit tests for "ironic node-delete" shell cmd  https://review.openstack.org/12071007:22
*** notq has quit IRC07:24
*** ndipanov has joined #openstack-ironic07:33
*** jistr has joined #openstack-ironic07:39
*** faizan has joined #openstack-ironic07:44
*** jcoufal has quit IRC07:46
*** faizan has quit IRC07:46
*** bluex-pl has joined #openstack-ironic07:55
*** andreykurilin has joined #openstack-ironic07:56
*** ifarkas has quit IRC08:00
*** ifarkas has joined #openstack-ironic08:01
*** MattMan has joined #openstack-ironic08:12
*** lucasagomes has joined #openstack-ironic08:20
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Add list_by_node_id() to Port object  https://review.openstack.org/12042208:26
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Remove the objectify decorator  https://review.openstack.org/12048908:26
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Add reserve() and release() to Node object  https://review.openstack.org/12048808:26
*** derekh has joined #openstack-ironic08:29
*** athomas has joined #openstack-ironic08:30
*** igordcard has joined #openstack-ironic08:30
openstackgerritSzymon Wróblewski proposed a change to openstack/ironic-python-agent: Enhance decorators in agent and automate creation of command_map  https://review.openstack.org/11752908:49
*** viktors|afk is now known as viktors08:53
*** andreykurilin has quit IRC08:55
*** chenglch|2 has joined #openstack-ironic09:04
*** dtantsur is now known as dtantsur|afk09:07
*** andreykurilin has joined #openstack-ironic09:08
*** bluex-pl has quit IRC09:19
*** notq has joined #openstack-ironic09:19
*** jcoufal has joined #openstack-ironic09:20
openstackgerritA change was merged to openstack/ironic: Search line with awk itself and avoid grep  https://review.openstack.org/11896609:22
*** athomas has quit IRC09:30
*** athomas has joined #openstack-ironic09:39
*** pensu has joined #openstack-ironic09:40
*** pelix has joined #openstack-ironic09:52
*** faizan has joined #openstack-ironic09:58
*** yuanying has quit IRC10:00
*** rakesh_hs2 has joined #openstack-ironic10:06
*** rakesh_hs has quit IRC10:06
*** d0ugal has quit IRC10:08
*** d0ugal has joined #openstack-ironic10:08
*** Nisha has quit IRC10:09
*** athomas_ has joined #openstack-ironic10:17
*** athomas has quit IRC10:20
*** chenglch|2 has quit IRC10:20
*** Mike_D_wk has joined #openstack-ironic10:33
*** takadayuiko has quit IRC10:41
*** athomas_ has quit IRC10:43
*** athomas has joined #openstack-ironic10:43
*** athomas has quit IRC10:46
*** nikunj2512 has quit IRC10:47
pensuHi all, could you please share your views on this: http://lists.openstack.org/pipermail/openstack-dev/2014-September/045702.html10:48
lucasagomespensu, hi there, just answered that10:53
lucasagomespensu, basically docker.io is not present in precise :( and the -infra team is now using Trusty in gate10:54
lucasagomesso it won't be a problem10:54
pensulucasagomes: thanks....:)10:55
lucasagomeswe def could try to make the devstack+ironic work on precise thou (for e.g just try install docker if the IPA driver is enabled)10:55
lucasagomespensu, if you think that's a problem, please file a bug about it and we can take a look10:55
pensulucasagomes: so basically I am supposed to try that guide with trusty not precise, right?10:56
lucasagomespensu, yeah, that's the version it's being tested on gate10:56
pensulucasagomes: yeah, I did install docker separately on precise...10:56
pensulucasagomes: but I guess the problem is that it is looking for 'docker.io'.....not sure where to get it..10:56
lucasagomespensu, I see... yeah but that would require you to tweak the devstack as well10:57
lucasagomespensu, e.g remove the docker.io line from files/apts/ironic10:57
lucasagomesthat would make devstack stop trying to install it10:57
pensulucasagomes: hmmm.....that could work, let me try it....but won't it be a problem again when devstack try to use it....10:58
pensulucasagomes: I mean if it is trying to install docker.io, it will also try to use docker.io, right?10:58
lucasagomespensu, so docker will only be used if you are testing IPA10:58
lucasagomesthe IPA driver (which is not the default)10:58
lucasagomesafaiui10:58
lucasagomespensu, not by default... that's why I think that, a fix for it would to have that conditional == for e.g just try install docker if the IPA driver is enabled10:59
pensulucasagomes: sounds good.....let me check, I will get back to you...thanks again....:)10:59
lucasagomespensu, no worries, yvw10:59
*** yuanying has joined #openstack-ironic11:00
*** athomas has joined #openstack-ironic11:03
*** yuanying has quit IRC11:05
*** ramineni has quit IRC11:08
*** rakesh_hs has joined #openstack-ironic11:09
*** rakesh_hs2 has quit IRC11:09
*** Haomeng has quit IRC11:21
*** yuanying has joined #openstack-ironic11:21
*** Haomeng has joined #openstack-ironic11:26
*** dtantsur|afk is now known as dtantsur11:26
*** yuanying has quit IRC11:27
*** pensu has quit IRC11:50
NobodyCamGoood Morning Ironic says the zombe walking in the door12:09
openstackgerritRakesh H S proposed a change to openstack/python-ironicclient: fixes help string for driver-list  https://review.openstack.org/12076412:10
*** dprince has joined #openstack-ironic12:14
lucasagomesmorning NobodyCam12:18
openstackgerritRakesh H S proposed a change to openstack/python-ironicclient: handles keyboard interrupt  https://review.openstack.org/12076712:21
*** nosnos has quit IRC12:22
*** aswadr has joined #openstack-ironic12:22
*** nosnos has joined #openstack-ironic12:22
*** yuanying has joined #openstack-ironic12:23
NobodyCammorning lucasagomes12:25
NobodyCamlucasagomes:  gots a second to take a look at : https://wiki.openstack.org/wiki/Ironic/NovaBaremetalIronicMigration12:26
*** nosnos has quit IRC12:27
lucasagomesNobodyCam, sure, btw wanted to talk to you about the proxy thing as well12:29
lucasagomesNobodyCam, are u planning to add unittest to it?12:29
*** ramineni has joined #openstack-ironic12:29
NobodyCamlol do i have to, do they actually want it12:29
NobodyCamI have yet to check the ml12:30
lucasagomesNobodyCam, yeah seems so dan smith was talking about it there12:30
dtantsurNobodyCam, morning :) aren't you early today?12:32
NobodyCammorning dtantsur , yep one of hte "kids" is not feeling well so its been up and down all night, this time I just made coffee and forgot about the down bits12:34
dtantsuroh sorry to hear :(12:35
NobodyCam:( how to hear back from the the vet today :(12:35
NobodyCams/how/hope.12:35
NobodyCamso tempest tests too12:36
NobodyCamugggg12:36
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Make the context parameter of create() mandatory on Objects  https://review.openstack.org/12077312:37
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: _from_db_object() to set the context to the RPC objects  https://review.openstack.org/12077412:37
NobodyCami was thinking about unit test to see if the calls where in fact made, but temptest12:37
NobodyCamI have not messed with tempest12:37
*** pensu has joined #openstack-ironic12:38
lucasagomesNobodyCam, no tempest I think12:38
lucasagomesdan smith was against it, and I don't see reason for that as well12:38
lucasagomeswell sean said something about it, but really? I think we may be able to push back on tempest12:39
NobodyCamother then the test, did you see anything needing changing on the code?12:40
lucasagomesNobodyCam, nop, since my last review12:41
lucasagomeslemme look the last patch changes12:41
*** rloo has joined #openstack-ironic12:44
*** Poornima has quit IRC12:48
NobodyCamdtantsur: while I'm can I get your thoughts on the migratation wiki thing: https://wiki.openstack.org/wiki/Ironic/NovaBaremetalIronicMigration12:53
* dtantsur is looking12:53
NobodyCamhumm /me needs more coffee12:53
NobodyCampoors second cup, 6 more and I'll be good to go12:54
lucasagomesNobodyCam, posted some nits in the patch, no vote... see what you think12:54
NobodyCamack12:54
lucasagomesNobodyCam, also lemme know if I can help with the unittests thing12:54
lucasagomesI would glad help with that12:54
NobodyCamlooking.. Oh I always need help with tests...12:55
* NobodyCam usaly writes poor tests12:55
dtantsurNobodyCam, "Deploy-ironic kernel and ramdisk built (DIB)" maybe some link here? or is it supposed to be obvious?12:55
*** HenryG_zzzz is now known as HenryG12:55
lucasagomesNobodyCam, ack, I will work on that unittest then12:55
dtantsurNobodyCam, IMO "Deploy-ironic kernel and ramdisk built (DIB)" and " Empty Ironic database exists" should be in "High Level Walk Through" with appropriate commands12:56
*** yuanying has quit IRC12:56
dtantsurNobodyCam, nova flavor-key baremetal set "baremetal:deploy_kernel_id"="$dkid"  <-- are we suggesting deprecated behavior? may make sense, but at least we need a note12:57
NobodyCamlucasagomes: awesome Thank you.. I'll agree with your comments and will get those pushed up12:57
lucasagomesNobodyCam, ack... I'll give the unittests a first stab here12:58
NobodyCamdtantsur: good catch will add build K&R and creating DB12:59
lucasagomesNobodyCam, btw, will add another comment about the exception we are raising there12:59
lucasagomesfrom webob12:59
openstackgerritSyed Ismail Faizan Barmawer proposed a change to openstack/ironic: Add uefi boot mode support in IloVirtualMediaIscsiDeploy  https://review.openstack.org/11656113:00
lucasagomesNobodyCam, oh no, forget... thought other contrib modules where using nova exceptions instead13:00
NobodyCamdtantsur: ahh thats just some code I had in my snibits file I tossed up there13:00
NobodyCamsnippet even13:01
NobodyCamI got that execption from that file it self13:02
NobodyCamdidn't want to make "MAJOR" change13:02
openstackgerritDerek Higgins proposed a change to openstack/ironic: Revert "Search line with awk itself and avoid grep"  https://review.openstack.org/12078313:12
*** Ugallu has joined #openstack-ironic13:13
dtantsurone more proof we need tripleo ci voting ^^^13:16
derekhlucasagomes: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/elements/testenv-worker/bin/ci_commands13:16
dtantsurderekh, is problem in 'grep' command?13:17
rlooI think we broke tripleo ci once before in a similar fashion :-(13:18
derekhdtantsur: yup, we have tight rules on what commands can be run over ssh, so the test environments have to be updated to allow any new commands to be run13:18
NobodyCammorning rloo13:18
derekhrloo: yup, this is the second time13:18
*** linggao has joined #openstack-ironic13:19
NobodyCamand derekh13:19
rloosorry derekh13:19
rloobonjour NobodyCam et tous les autres Ironickers13:19
NobodyCamkey13:19
NobodyCams/key/kay/13:19
NobodyCamheheheh13:19
derekhrloo: no prob at all these things happen, once we have a new regex in http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/elements/testenv-worker/bin/ci_commands I can do a redeploy,13:20
openstackgerritSyed Ismail Faizan Barmawer proposed a change to openstack/ironic: Add uefi boot mode support in IloVirtualMediaIscsiDeploy  https://review.openstack.org/11656113:20
derekhbut unfortunatly that takes down CI for about an hour (assuming it all goes well)13:20
rlooderekh: so you need us to undo that change?13:21
NobodyCamlucasagomes: ok comments addresses13:21
NobodyCamaddressed even13:21
lucasagomesNobodyCam, https://review.openstack.org/#/c/120783/13:22
lucasagomesbroke TripleO CI13:22
derekhrloo: ideally yes, then we add the new command into the list of approved command, then I'll reploy testenvs and finally remerge the change13:22
*** dlaube has joined #openstack-ironic13:22
rlooderekh: ok, approved by us humans. Pray to Jenkins now ;)13:24
NobodyCamlol :( so someone tried to fix that command mess :(13:24
NobodyCamgah your quick rloo13:24
NobodyCamlol13:24
NobodyCam:)13:24
rlooNobodyCam:  ;)13:24
derekhlucasagomes: rloo thanks13:25
lucasagomesderekh, yvw, sorry for breaking you guys13:25
rlooso derekh, every time we add/change an ssh command, we ought to ...? inform you guys, or submit a tripleo patch to ...?13:26
NobodyCamrloo: infra locks down the ssh command that can be run13:27
derekhrloo: submit a patch to https://github.com/openstack-infra/tripleo-ci/blob/master/elements/testenv-worker/bin/ci_commands#L64-L71 , once merged we have to redeploy test envs, then you can make the change13:27
rlooderekh: so ideally, you want us to do the patch to openstack-infra. by 'we have to redeploy', that means tripleo folks or infrra folks?13:28
derekhrloo: tripleo folks13:29
rlooderekh: ok, so 1. patch to openstack-infra; 2. ask tripleo via irc? to redeploy test envs; 3. land patch-that-has-ssh-command13:30
*** pcrews has joined #openstack-ironic13:31
derekhrloo: yup, thats pretty much it, unfortunately we can't loosen up the "allowed" commands too much, because we're give out root to a rack of baremetal machine's and gotta be careful nothing malicious is run13:31
rloothx derekh13:33
derekhrloo: no prob at all, thanks back :-)13:34
dtantsurfolks what do we need to make this build stable and voting?13:34
rloolucasagomes, NobodyCam, etc: so on the ironic side, do we ask the person that submitted the patch, to go through the process of submitting an infra patch etc?13:34
lucasagomesrloo, hmm yeah, or we could do that13:35
lucasagomesrloo, I'm core on tripleo CI13:35
lucasagomesso I can +2 it and merge it easier there13:35
lucasagomesto make easier to get it merged there*13:36
rloolucasagomes: so it seems like the process is a bit more involved. First, someone submits the ironic patch, after it gets 2 +2s (but before approving), the other stuff needs to be done, then the ironic patch can be approved.13:36
lucasagomesrloo, exactly, the ideal would to be the TripleO voting for us13:36
lucasagomesrloo, so if it's broken we couldn't merge the patch anyway13:37
lucasagomesrloo, after the patch merge on tripleO CI the test env needs to be rebuilt13:37
rloolucasagomes: right. if it is voting we'll know it will break. but we'll still need to do the song-and-dance.13:37
NobodyCamwe just need to keep that in mind when reviewing patches that attempt to alter any of (virsh) the ssh commands13:37
openstackgerritA change was merged to openstack/ironic: Add list_by_node_id() to Port object  https://review.openstack.org/12042213:37
lucasagomesrloo, yeah :(13:37
rlooso lucasagomes, if an infra patch is submitted, you can +2 it, so you shouldn't submit it, right?13:38
lucasagomesNobodyCam, +1, we broke it once in the past (in the midcycle after I added get_boot_device to virsh heh)13:38
lucasagomesrloo, yeah, tripleo-ci more specifically.13:38
lucasagomesrloo, do you think it's cool to one of us to submit the patch there instead of the author?13:39
rloolucasagomes: honestly. I'd prefer that the author did it. Well, really honestly, as long as I don't have to do it ;)13:40
rloolucasagomes: I'm almost positive that the author would love someone else to do it ;)13:40
lucasagomesrloo, heh right, I dunno the author IRC name13:40
NobodyCamlucasagomes: I would say yes, as not all dev know how the CI system works, so they just don't know to make the change there too, and some dev and not in channel to tell them to do it13:40
rloolucasagomes: cuz if I were the author, I would not care to do it!13:41
lucasagomesNobodyCam, yeah13:41
rloolucasagomes: especially since it has to be done after we've OK'd their ironic change.13:41
NobodyCamif we want the change, I'm ok with making the CI change13:41
lucasagomesrloo, NobodyCam yeah you guys are right... alright, so maybe we should do it13:41
lucasagomesNobodyCam, I think it's a cool change, it's not important but well fix a bug targeting RC13:42
rlooah, NobodyCam, are you volunteering to do the tripleo-ci patch?13:42
NobodyCamthe patch? we need a patch, we are reverting the ssh change?13:42
lucasagomesNobodyCam, yeah, we are reverting it until we fix in TripleO13:42
rloocuz I was thinking of doing it but wondering... when the tripleoCI patch is done, it has to support both ssh commands, and then after the ironic patch is merged, do another tripleoci patch to unsupport the original ssh command?13:43
lucasagomesNobodyCam, so having a patch to the CI would be cool so we can re-revert it13:43
*** Haomeng has quit IRC13:43
lucasagomesrloo, yup, pretty much13:43
NobodyCamahhh13:43
lucasagomesbut the second one doesn't require the env to be rebuilt13:43
lucasagomessecurity people security heh13:43
rlooNobodyCam: you still want to volunteer for this?13:44
NobodyCamI've patched that file before :-p13:44
*** igordcard has quit IRC13:44
lucasagomesNobodyCam, ta much13:45
* NobodyCam is not sure he is awake enough to hack regex commands atm, but will look ina bit13:45
lucasagomesderekh, do you have the exact command that needs to be whitelisted handy?13:45
* lucasagomes goes to the logs13:45
rloothx NobodyCam!13:46
derekhlucasagomes: looks like this is it13:46
derekh/usr/bin/virsh --connect qemu:///system dumpxml baremetalbrbm1_6 | awk -F "'" '/mac address/{print $2}'| tr -d ':'13:46
lucasagomesderekh, ta much13:46
lucasagomesNobodyCam, ^13:46
lucasagomeswe probably need a regex for that baremetalbrbm*13:47
rloolucasagomes, NobodyCam: I think you can use [a-z0-9_]+13:49
lucasagomesyup13:49
rloocuz that's what is being used now in the ci_commands file ;)13:49
*** Haomeng has joined #openstack-ironic13:50
derekhNobodyCam: to test the ci_commands regex you can add something like this to you authorized_keys for the ssh user13:52
derekhno-port-forwarding,no-agent-forwarding,no-X11-forwarding,command="/usr/local/bin/ci_commands" ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdWrAPZ/RcOE9gWFmww8MUs8bcmpKvqn+R6WKB9uWuFAMJeXHDoS9zTcCIA5pYXcsNmrbY5Wh/FfcYldeiLTcFb8CCE3SLSdEB8bbpLR6ibEXJ0jh4VgyTXkT7fjSa19ztwYSz9DGJuHxQ+R1B3MP+eGeiq+sRfI6yicnvz2KljWYWOtGX0rAJAuUaoj4kRHSwRxvmQk3fz1Kmxzp/zLWj3b0+J75PmRixf8/cF2laHwDzCJZYosKqXHDnjr9AeNZP6eoJ/n8pglc+oezCvB/QkAJR8MhKQKG/wEp5fJEdMcuO1RH/cCaPnNy9aPd4M13:52
derekhWT4yTXeW67rH/YkyS8Xf0Wz13:52
*** yuanying has joined #openstack-ironic13:53
NobodyCamderekh: yep been there done that... I think this is actually the thrid time we may have done this to TripleO :(13:55
NobodyCamthis was the first time : https://github.com/openstack-infra/tripleo-ci/commit/532d56eac6cc4d95af2d94468c3273cd7ecf03bb#diff-e3e229c6b06324b3713822ab4e32b09413:56
derekhNobodyCam: I forgot about that one13:57
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Add docstrings for agent.py  https://review.openstack.org/12066013:58
jrollmorning ironic :)13:58
NobodyCammorning jroll13:58
jrolloh, we broker tripleo, fun :(13:59
jrollbroke*13:59
rloomorning jroll13:59
NobodyCamwe're selling tripleo13:59
NobodyCamlol13:59
jrollderekh: is there a way to whitelist any virsh call?13:59
jrollNobodyCam: eH?13:59
jrolloh13:59
jrolllol13:59
NobodyCambroker13:59
NobodyCamlol13:59
jrollyeah13:59
NobodyCamsorry /me has had very little sleep13:59
NobodyCamstepping out for a somke then I get a patch for ci ready14:00
jrollno worries14:02
derekhjroll: Maybe, or possibly a subset of them, we still have to filter what its piped into14:03
jrollyeah14:03
* jroll does a thing14:03
jrolloh, wtf, NobodyCam already has a comment in here14:04
jrollreviewers need to read da comments :(14:04
NobodyCami have a comment?14:05
lucasagomesjroll, heh I think the idea of whitelisting is not allow _any_ calls :)14:05
NobodyCamwhere14:05
lucasagomestho yeah, virsh should be problematic... but ah "virsh --help && rm -rf /" yeah :)14:05
jrolllucasagomes: right14:05
jrollNobodyCam: https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/ssh.py#L149-15214:06
lucasagomess/should/shouldn't/14:06
jrollyeah, security is hard :P14:06
NobodyCamoh doh14:07
NobodyCamlol14:07
jrollI really wish tripleo CI was built on each run like devstack14:07
rloothx for the comment NobodyCam! ;)14:07
jrollderekh: what's the level of effort required to rebuild your CI environment, out of curiousity?14:08
*** andreykurilin has quit IRC14:08
*** andreykurilin_ has joined #openstack-ironic14:08
derekhjroll: If I build a new test env image it would be about a day, but some something like this I would take an existing known "good" image and mount/edit the ci_commands file, then redeploy (should be around a hour or so if all goes well)14:10
NobodyCamjroll: I don't know the effort but it takes infra at least a day14:10
jrollwow14:10
jrollwhat is it that takes a day?14:10
jrollthat seems a little absurd14:11
NobodyCamthat the node pool stuff no?14:11
jrollI mean14:11
jrollI can't imagine a system that takes a day to deploy14:11
NobodyCamthey use nova baremetal ...lol14:12
derekhjroll: the image build / deploy is fairly quick, but there are always regressions as its not a code path that is exercised often14:12
NobodyCamj/k14:12
jrolllike, it takes us less than that to deploy a 40k node cloud14:12
jrollderekh: I see... if that was part of the CI job, it would get tested many times a day :)14:12
derekhjroll: yup, its on the list14:13
derekhjroll: that list that keeps getting longer...14:13
NobodyCamok I'm thinking to patches on to add a new regex for the new ssh command and one to remove the old one,14:13
*** chuckC has quit IRC14:13
NobodyCamgah... two patches one ...14:13
jrollderekh: ok, I just wanted to make sure "deploy as little as possible" wasn't an explicit design decision14:14
jrollNobodyCam: +114:14
jrollanyone up for a quick IPA review? https://review.openstack.org/#/c/120586/14:18
*** Haomeng has quit IRC14:18
Shrewsjroll: looking14:20
jrollShrews: this comes with a disclaimer that we need to refactor our exceptions in general :|14:21
Shrewsack14:21
*** Haomeng has joined #openstack-ironic14:22
Shrewsjroll: lgtm14:22
jrollyay14:22
jrollthanks14:26
Shrewsjroll: i really should spend some time with IPA at some point14:26
jrollyou all should :P14:26
* jroll wants to make it the default driver in kilo14:27
*** yuanying has quit IRC14:27
lucasagomesNobodyCam, but on ur proxy patch14:27
lucasagomesbug14:27
lucasagomesadded a comment14:27
* lucasagomes can fix it if needed no worried14:27
lucasagomesworries*14:27
lucasagomesNobodyCam, I will put up a new patch set fixing it + adding tests14:28
Shrewsrloo: is your ironicclient bash-completion change supposed to mash the output up as one long line?14:28
rlooShrews: my change shouldn't have modified what it did. but yes, bash-completion puts the stuff all on one line.14:29
rlooShrews: similar to nova bash-completion.14:29
openstackgerritA change was merged to openstack/ironic-python-agent: Fix exception that is not properly raised  https://review.openstack.org/12058614:29
* Shrews tries nova14:29
rlooShrews: I never use that command, but the docs folks have a script that uses it to get the subcommands, to generate the CLI docn.14:30
NobodyCamlucasagomes: good catch... I was still mostly asleep on that rev14:30
NobodyCambrb walkies again14:30
lucasagomesNobodyCam, no bothers :)14:31
Shrewsrloo: ah, ok. i was questioning the usefulness of that, but that makes sense. Perhaps we should note that in the commit msg?14:31
rlooShrews: note what? that the response is all on one line?14:31
Shrewsrloo: how it is used by docs14:31
rlooShrews: it is mentioned in the bug. but the work of adding bash-completion was in another patch.14:32
Shrewsrloo: ah! i missed the bug line in gerrit. hidden next to the commit-id14:33
* Shrews wishes gerrit did a better job of highlighting those14:33
rlooShrews: those bugs like to hide...14:33
jrolllucasagomes: do you think we should have direct tests for reserve() and release()? https://review.openstack.org/#/c/120488/214:38
openstackgerritDmitry Tantsur proposed a change to openstack/ironic: EXPERIMENTAL Implement hardware discovery in PXE driver  https://review.openstack.org/11003114:38
lucasagomesjroll, it's mostly calling the db methods (which has tests) but I can add it if you think it's important14:39
jrollmeh, I don't know that it is14:39
* jroll looks one more time14:40
rloodtantsur: checking, you don't like str1+str2+str3 (vs ''.join(strs)), but str1+str2 is OK?14:41
dtantsurrloo, right. I don't think I'm alone in it :)14:41
rloodtantsur: ok, I see a couple more places where that hasn't been changed.14:42
jrolllucasagomes: found some other things, so might as well add tests while you're there14:42
lucasagomesjroll, ack will do14:43
lucasagomesdtantsur, about making the context mandatory... all RPC methods needs the first parameter to be the context14:44
lucasagomesdtantsur, and on the create the following patch is making use of the context to form the object14:44
dtantsurlucasagomes, can't we fix the decorator instead of inventing ugly code?14:44
lucasagomesdtantsur, that base.py for object is copied from nova14:45
lucasagomeswe want to oslofy it at some point14:45
lucasagomesas it's mandatory for nova, I think we should not divert from it14:45
lucasagomesotherwise it will make it super hard in the future to put it into oslo14:45
dtantsurlucasagomes, it it from oslo? otherwise I don't see any problems changing it14:45
lucasagomesdtantsur, it's from nova14:46
dtantsurwell, then we should assure that proper change lands to oslo14:46
lucasagomeswe have been using their object-like14:46
lucasagomesit's not in oslo14:46
dtantsurthen we can change it :)14:46
jrollwhat's the problem with having the context mandatory?14:46
lucasagomesdtantsur, on that create() the context have to be mandatory14:47
dtantsurjroll, it's already set on the same object14:47
lucasagomesthen on the next sync with nova we can get rid of the context on the other methods14:47
lucasagomeslike detroy14:47
lucasagomesdestroy14:47
dtantsurlucasagomes, why not use self.context?14:47
lucasagomesdtantsur, https://github.com/openstack/nova/blob/master/nova/objects/base.py#L166-L20814:47
lucasagomesbut first I need to have all objects with a context inside it14:47
lucasagomesso I can do that ^14:47
lucasagomesdtantsur, there's no self.context14:47
jrollright, it's not set on the object14:48
* lucasagomes double check14:48
lucasagomesyeah there's no self.context14:48
NobodyCamlucasagomes: I think this will do what we are looking for: https://review.openstack.org/#/c/12079914:48
lucasagomesjroll, that's the idea of all the patches, to make sure all objects has a context14:48
dtantsurlucasagomes, https://github.com/openstack/ironic/blob/master/ironic/objects/base.py#L20614:48
jrolllucasagomes: right, I'm asking dtantsur why there's a problem with mandatory context14:48
dtantsurok sorry it's _context14:49
jrollright, but14:49
lucasagomesdtantsur, yeah... exactly and that's what I'm trying to make mandatory14:49
jrollif it isn't passed to create()14:49
jrollit will be None14:49
jrolland then we won't have it later when we need it14:49
dtantsurif you pass None to ctor - yes14:49
dtantsurbut you don't14:49
lucasagomesjroll, yup14:49
jrollright now you can14:50
jrolland that sucks14:50
jrollthis is fixing that14:50
dtantsurthen let's drop it from c-tor14:50
lucasagomesyeah... exactly before objects was malformed with no context14:50
jrollassuming ctor is create?14:50
jrollwait14:50
jrollwhat is c-tor14:50
dtantsurno, it's not14:50
dtantsur__init__14:50
jrolloh, constructor14:51
jrolldunno if we call that directly14:51
jroll(or just from create())14:51
jrolland if we drop it from __init__, then we'll never get a context, right?14:51
dtantsurfolks, please have a look at the code :-/14:51
dtantsurhttps://review.openstack.org/#/c/120773/1/ironic/api/controllers/v1/node.py14:51
dtantsurlines 751-75314:51
NobodyCamderekh: fyi: https://review.openstack.org/#/c/12079914:52
lucasagomeswe form objects using the constructor... but that doesnt save it to the db14:52
jrollsorry, multitasking with an omelette :|14:52
dtantsurcontext is now passed twice14:52
lucasagomescreate() creates to the db14:52
dtantsurlucasagomes, ^^^14:52
lucasagomesdtantsur, will take a look14:52
jrolloh, hm14:52
lucasagomeshmm I will take another look14:53
jrollyeah, read this wrong14:53
lucasagomesI was trying to make nova-ish14:53
lucasagomeshttps://github.com/openstack/nova/blob/master/nova/objects/block_device.py#L9314:53
lucasagomesdtantsur, cheers, will take a look at it14:53
dtantsurok :)14:53
jrolllucasagomes: yeah, maybe make it mandatory for __init__14:54
derekhNobodyCam: thanks, will look it over in a little bit, just gotta finished something first14:54
lucasagomesjroll, ack, will look into it14:55
lucasagomesdtantsur, jroll cheers14:55
jrollcool :) thanks dtantsur14:55
dtantsurnp)14:56
jroll(for bringing this up)14:56
lucasagomesNobodyCam, tests added https://review.openstack.org/12043314:56
NobodyCamlucasagomes: w00 h0014:59
NobodyCamty14:59
lucasagomesno bothers :)14:59
*** chuckC has joined #openstack-ironic15:00
*** k4n0 has quit IRC15:01
ramineniJayF : Hi15:02
jrollramineni: don't think jay is online yet, is there something maybe I can help you with?15:03
raminenijroll , hi , ya15:03
raminenijroll , we would like to submit script for building iso from kernel and initrd , how should we go about it?15:03
raminenijroll , can be part of ironic or dib?15:04
jrollramineni: for ironic PXE driver or for IPA?15:04
raminenijroll , it's generic, even for iloiscsidriver , so that user can make use of it , even for building iso if required15:06
jrollok, for iloiscsi driver, should go in DIB I think15:07
raminenijroll, is it not same , if its for ipa ?15:07
jrollIPA repo holds IPA build scripts right now15:07
openstackgerritA change was merged to openstack/ironic: Revert "Search line with awk itself and avoid grep"  https://review.openstack.org/12078315:08
jrollbut you could also do it in DIB15:08
jrolldoesn't matter much either way15:08
jrollif DIB helps you build the ISO, do it there15:08
jrollderekh: that revert landed15:08
*** jcoufal has quit IRC15:08
*** andreykurilin_ is now known as andreykurilin15:08
derekhjroll: ok, thanks15:09
openstackgerritRakesh H S proposed a change to openstack/python-ironicclient: ironic client to use os_region_name if provided  https://review.openstack.org/12080715:10
raminenijroll , ok, thanks15:11
jroll:)15:12
NobodyCamlucasagomes: great tests TY15:15
lucasagomesNobodyCam, yw15:15
lucasagomeshope that's enough to satisfy the nova ppl15:15
NobodyCamwill see, I still half beleive they end up not wanting lol...15:16
lucasagomesNobodyCam, yea15:16
NobodyCams/they/they'll/15:16
jrollugh, Shrews, still dunno what to do about this rebuild test with IPA :(15:19
lucasagomesat least it shows good faith from our part15:20
lucasagomesthat's alright15:20
Shrewsjroll: with IPA, what is ephemeral size set to? 0 or N/A?15:21
jrollwe don't support ephemeral yet :(15:22
NobodyCamlucasagomes: ++15:22
Shrewsjroll: i know, but what is in the flavor?15:22
jrolloh uh15:22
jrollright now we share flavors15:22
jrollso I guess I could change that15:22
jrollyay, more devstack changes to push through :(15:22
lucasagomesNobodyCam, you know if they want it merged till tuesday?15:22
lucasagomesbecause next tuesday is the final decision15:22
lucasagomeswhether we integrate or not right?15:23
Shrewsjroll: oh, so the ephemeral size is ignored by IPA then?15:23
NobodyCami'm not sure.15:23
*** yuanying has joined #openstack-ironic15:23
jrolloh, just need to set the variable, hm15:23
jrollShrews: yeah, that's probably not ideal either15:23
NobodyCamwe have it if they want it15:23
NobodyCamI believe that is the last bit of code we need15:23
jrolland default size is 015:23
Shrewsjroll: yeah, so if you set the variable (when using IPA) to zero, then change the test to skip the verify_partition stuff if it's zero...15:23
NobodyCamwhats left now is just docs I think15:24
jrollShrews: yeah, ok15:24
jrollthis makes more sense now15:24
jrollty15:24
Shrewsjroll: and skip the test file create... and existence after rebuild....15:24
Shrewsheck, i wonder if it's even worth testing rebuild at that point....15:24
NobodyCamoh question... do we have command line examples of the migration script?15:24
*** rakesh_hs has quit IRC15:25
jrollShrews: right, probably not15:25
jrollShrews: if IPA supports rebuild right now, it's by accident :P15:25
jrollShrews: is #openstack-qa the channel to bug people about tempest changes?15:25
Shrewsyeah15:26
jrollcool15:26
*** rainya has joined #openstack-ironic15:26
* jroll will put these up later today15:26
lucasagomesNobodyCam, yeah fingers crossed15:27
jrollShrews: I'll try to keep the rebuild test in there though :P15:27
Shrewsjroll: yeah, i think that should be tested even w/o ephemeral15:27
jrollagree15:28
Shrewsnow that i think about it15:28
Shrewsjroll: so, one thing you could do is add a compute_feature for rebuild and check that *inside* the test:  if CONF.compute_feature.rebuild:  ...15:31
Shrewsyou'd have to set that feature to False when using IPA15:31
*** rainya has quit IRC15:31
jrollShrews: meh :/15:31
jrollShrews: I don't see why rebuild wouldn't work, should be fine15:32
Shrewsjroll: oh, i thought you said that's not supported with IPA15:32
jrollI'm not sure if it is15:32
jrollI think if it's not, it should be15:32
Shrews++15:32
jrollbecause from the deploy driver perspective, it's just a deploy15:32
jrollrebuild just checks some extra things15:32
jrollbefore deploying15:33
*** rainya has joined #openstack-ironic15:33
jrollShrews: https://review.openstack.org/12081415:35
*** todd_dsm has quit IRC15:36
Shrewsjroll: you need to move the test file creation under the if15:39
Shrewswell, you *should*, logically15:39
jrollah, yeah15:39
jrollthanks15:39
jrollShrews: probably fine to leave preserve_ephemeral=True, yes?15:40
openstackgerritSyed Ismail Faizan Barmawer proposed a change to openstack/ironic: Support for setting boot mode in pxe_ilo driver  https://review.openstack.org/11857815:40
Shrewsjroll: hrm, good question15:41
jrollfrom ironic's perspective, it's fine15:41
jrollI think15:41
* jroll looks again15:41
jrollah yeah15:41
jrollthat's just an instance_info thing15:41
* Shrews wonders what the disk partitioning code does for that case....15:42
* Shrews looks15:42
*** todd_dsm has joined #openstack-ironic15:43
openstackgerritDmitry Tantsur proposed a change to openstack/ironic: EXPERIMENTAL Implement hardware discovery in PXE driver  https://review.openstack.org/11003115:43
jrollShrews: updated because doing it right today15:43
jroll:P15:43
*** lazy_prince is now known as killer_prince15:43
Shrewsjroll: comment needs updated  :-P15:45
Shrews# Rebuild and preserve the ephemeral partition15:45
jrollugh15:45
jrollthanks15:45
jrollupdated15:45
*** jistr has quit IRC15:47
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Add docstrings for api/ tree  https://review.openstack.org/12066115:49
* jroll afk for a bit15:51
*** andreykurilin has quit IRC15:51
*** ifarkas has quit IRC15:51
openstackgerritSyed Ismail Faizan Barmawer proposed a change to openstack/ironic: Support for setting boot mode in pxe_ilo driver  https://review.openstack.org/11857815:52
NobodyCambrb... /me runs to cornor store for a pack of smokes...15:55
dtantsurcalling it a day, see you tomorrow15:55
*** dtantsur is now known as dtantsur|afk15:55
openstackgerritSyed Ismail Faizan Barmawer proposed a change to openstack/ironic: Support for setting boot mode in pxe_ilo driver  https://review.openstack.org/11857815:55
*** yuanying has quit IRC15:57
*** faizan has quit IRC15:59
*** aswadr has quit IRC16:03
NobodyCamnight dtantsur|afk16:03
lucasagomesdtantsur|afk, g'night16:18
*** rushiagr is now known as rushiagr_away16:21
*** rwsu has quit IRC16:24
*** ndipanov is now known as ndipanov_gone16:24
*** rwsu has joined #openstack-ironic16:29
JayFramineni: you pinged me?16:31
JayFjroll: ramineni: I would prefer any DIB elements created to build IPA to go under imagebuild/ in the IPA repo16:32
JayFjroll: ramineni: AFAICT, the only repo for DIB elements is 'tripleo-elements" and while the existing Ironic pxe ramdisk is there, I don't think it makes sense to continue overloading that repo16:33
*** rwsu has quit IRC16:33
JayFjroll: ramineni: might be valuable do do something like write the library for dib to build ISOs, then put a minimal set of stuff in IPA imagebuild/ that utilizes that to build the image16:34
*** rainya has quit IRC16:35
*** rwsu has joined #openstack-ironic16:35
openstackgerritA change was merged to openstack/python-ironicclient: Add 'bash-completion' to 'ironic help' response  https://review.openstack.org/12012216:38
*** killer_prince is now known as lazy_prince16:39
derekhNobodyCam: regex lgtm, just looking for a small comment then I'm happy16:40
derekhNobodyCam: gotta grab a train will check it later16:40
*** derekh has quit IRC16:40
lucasagomesok folks I'll call it a day too16:40
lucasagomesgotta take the train back home yet16:40
lucasagomeshave a good night everybody!16:40
*** lucasagomes has quit IRC16:41
*** r-daneel has joined #openstack-ironic16:45
*** rushiagr_away is now known as rushiagr16:46
openstackgerritA change was merged to openstack/python-ironicclient: handles keyboard interrupt  https://review.openstack.org/12076716:46
jrollJayF: +116:48
jrollsounds reasonable16:49
*** yuanying has joined #openstack-ironic16:53
*** lazy_prince is now known as killer_prince16:58
*** rainya has joined #openstack-ironic17:00
*** harlowja_away is now known as harlowja17:09
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Updated from global requirements  https://review.openstack.org/12063717:14
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic-python-agent: Updated from global requirements  https://review.openstack.org/11405817:14
*** athomas has quit IRC17:16
*** athomas has joined #openstack-ironic17:17
*** athomas has quit IRC17:18
openstackgerritOpenStack Proposal Bot proposed a change to openstack/python-ironicclient: Updated from global requirements  https://review.openstack.org/12065117:20
*** yuanying has quit IRC17:27
openstackgerritJosh Gachnang proposed a change to openstack/ironic-python-agent: Add verification support to the agent  https://review.openstack.org/12062717:42
openstackgerritJosh Gachnang proposed a change to openstack/ironic-python-agent: Add versioning to Agent decommission  https://review.openstack.org/10685917:43
openstackgerritJosh Gachnang proposed a change to openstack/ironic-python-agent: Adding support for decommissioning  https://review.openstack.org/10437917:43
*** rainya has quit IRC17:44
*** wanyen has joined #openstack-ironic17:44
*** openstackgerrit has quit IRC17:46
*** rainya has joined #openstack-ironic17:47
*** pelix has quit IRC17:47
*** openstackgerrit has joined #openstack-ironic17:48
*** ramineni has quit IRC18:03
*** rushiagr is now known as rushiagr_away18:09
*** rushiagr_away is now known as rushiagr18:14
*** yuanying has joined #openstack-ironic18:23
*** mikedillion has joined #openstack-ironic18:27
*** mikedillion has quit IRC18:30
devanandao/18:37
Shrews\o18:37
*** Ugallu has quit IRC18:39
NobodyCammorning devananda18:44
NobodyCamok I think thats it for all the conf calls this morning18:52
*** yuanying has quit IRC18:57
*** rushiagr is now known as rushiagr_away19:00
* NobodyCam had some errands to run... back a bit... will have phone with me if I am needed19:03
*** bigjools has quit IRC19:03
*** dprince has quit IRC19:05
*** russellb has quit IRC19:05
*** JayF has quit IRC19:06
*** adam_g has quit IRC19:06
*** pensu has quit IRC19:06
*** russellb has joined #openstack-ironic19:07
* devananda lunches19:12
*** Guest75250 has quit IRC19:14
*** russellb has quit IRC19:15
*** jroll has quit IRC19:19
*** dprince has joined #openstack-ironic19:20
*** JayF has joined #openstack-ironic19:33
*** stevebaker has quit IRC19:33
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Updated from global requirements  https://review.openstack.org/12063719:40
*** ryanpetrello has quit IRC19:44
*** ryanpetrello has joined #openstack-ironic19:44
*** ryanpetrello is now known as ryanpetre19:44
*** mgagne has joined #openstack-ironic19:51
*** jroll has joined #openstack-ironic19:51
*** bigjools has joined #openstack-ironic19:52
*** yuanying has joined #openstack-ironic19:53
*** jjmanzer has joined #openstack-ironic19:59
jjmanzerlearning about ironic here, I am a network automation guy and I wanted to know how/if ironic would actually talk to switches like cisco/arista gear to provision bare metal servers.20:00
jrolljjmanzer: hey :)20:02
jjmanzerhello:)20:02
jrollit didn't make it upstream this cycle, but us folks at rackspace have done some work on that front20:03
jrollas far as isolating provisioning networks from tenant networks etc20:03
jjmanzeris mapping of the local l2 topology done? i.e. does it notice that if a VLAN is needed for a server, that it might need to be added to the uplinks/downlinks between access and distribution layer?20:04
jrollit's actually just some neutron code to talk to real switches, and ironic just tells it to switch vlans20:04
jjmanzerahh so do a 'switch trunk vlan allowed ...' on a certian port?20:04
jrollyeah, that's all on the neutron side iirc20:04
jrollyep20:04
jjmanzerso if i want to use my own port_provision app that I wrote and exposed through a REST/JSON API how might I link that in?20:05
jjmanzerour network is somewhat complicated so lots of provision logic is needed hence the port_provision app20:05
jrollright, so20:05
jrolllike I said, this isn't upstream yet20:06
jrollI'd like to make that layer pluggable20:06
jrollso you could write your own little plugin or whatever to talk to your app20:06
jrollinstead of neutron20:06
jjmanzeris ironic primarily about the baremetal server side of thing? get it booted, OS installed that kind of thing? I'm still feeling my way around here. I will check out neutron as well20:07
jrollyes, exactly. neutron is for controlling networks20:11
jjmanzertyvm20:12
Shrewshttps://gigaom.com/2014/09/11/hp-buys-eucalyptus-as-cloud-consolidation-commences-for-real/20:13
Shrewsand i have no idea what this means, fwiw20:13
jrollhuh.20:14
rlooShrews: hmm20:22
*** yuanying has quit IRC20:26
* NobodyCam is back20:27
*** wanyen has quit IRC20:30
*** dprince has quit IRC20:30
*** wanyen has joined #openstack-ironic20:30
*** andreykurilin has joined #openstack-ironic20:37
wanyennew patches for uefi support for iLO virtual media iscsi and pxe-ilo driver were uploaded this morning https://review.openstack.org/#/c/116561/ and https://review.openstack.org/#/c/118578/.  Please review them so that we can address as many comments as possible in our next patch.  FFE for these two submissions is 09/12. Thanks!20:37
*** igordcard has joined #openstack-ironic20:41
jrollwanyen: just uploaded some comments I made this morning that didn't sync20:41
wanyenjroll, thanks! we will take a look at your comments and address them in the next patch.20:43
jrollthanks :)20:44
jrollit looks pretty close20:44
*** linggao has quit IRC20:45
*** rainya_ has joined #openstack-ironic20:48
openstackgerritA change was merged to openstack/python-ironicclient: Add sort_key and sort_dir parameters to *-list  https://review.openstack.org/11455520:48
*** rainya has quit IRC20:48
openstackgerritA change was merged to openstack/python-ironicclient: List resources with detail  https://review.openstack.org/11982520:53
*** rainya_ has quit IRC20:54
NobodyCamhumm anyone happen to have seen this error b4? http://logs.openstack.org/33/120433/7/check/gate-nova-python26/df2f742/console.html#_2014-09-11_16_48_15_93520:55
*** stevebaker has joined #openstack-ironic20:55
jrollnope20:56
jrollthat's weird20:56
NobodyCamya20:57
NobodyCamlooks like its comming up on a recheck too20:57
NobodyCamso now comes the BUG hunt phase20:57
jroll"site:bugs.launchpad.net" ftw20:59
NobodyCam:-p20:59
openstackgerritRuby Loo proposed a change to openstack/ironic: Remove bypassing of H302 for gettextutils markers  https://review.openstack.org/12091021:07
*** rainya has joined #openstack-ironic21:22
*** yuanying has joined #openstack-ironic21:23
*** ChuckC_ has joined #openstack-ironic21:24
*** adam_g has joined #openstack-ironic21:27
*** adam_g has joined #openstack-ironic21:27
* NobodyCam cannt take it any more ... I need to reboot... brb21:30
openstackgerritSyed Ismail Faizan Barmawer proposed a change to openstack/ironic: Add uefi boot mode support in IloVirtualMediaIscsiDeploy  https://review.openstack.org/11656121:35
*** wanyen has quit IRC21:43
NobodyCamupdate done! /me is back21:48
openstackgerritSyed Ismail Faizan Barmawer proposed a change to openstack/ironic: Add uefi boot mode support in IloVirtualMediaIscsiDeploy  https://review.openstack.org/11656121:48
NobodyCamslagle: Ty for recheck on 120433 :)21:50
*** rainya has quit IRC21:51
*** rainya has joined #openstack-ironic21:52
NobodyCamdoh darn tab... sorry slagle ping was for sdague :-p21:53
*** yuanying has quit IRC21:56
openstackgerritKyle Stevenson proposed a change to openstack/ironic: Add implementation of pluggable distributed sync  https://review.openstack.org/11514822:04
*** andreykurilin has quit IRC22:14
openstackgerritgreghaynes proposed a change to openstack/ironic: Add conductor_hostname property to nodes  https://review.openstack.org/10968822:25
greghaynesok, I am in need of advice on how to remove the # TODO I added on https://review.openstack.org/#/c/109688/12/ironic/api/controllers/v1/node.py22:26
greghaynesthat is a pretty nasty thing to do, but im having a hard time finding where else I could put that code... digging into rpcapi (which is where the hash ring manager currently lives) seems nasty and not necessary22:26
openstackgerritSyed Ismail Faizan Barmawer proposed a change to openstack/ironic: Support for setting boot mode in pxe_ilo driver  https://review.openstack.org/11857822:27
NobodyCamoh ouch22:31
openstackgerritKyle Stevenson proposed a change to openstack/ironic: Add implementation of ZooKeeper SyncManager  https://review.openstack.org/11757622:34
greghaynesNobodyCam: That doesnt sound good :(22:34
greghaynesIm up for adding another patch to pull the hash ring manager out of rpcapi if that sounds sane... just wanted some other input before I start charging ahead22:35
NobodyCamgreghaynes: where is it going to go22:36
*** jjmanzer has quit IRC22:36
greghaynesyep, that is the question22:36
*** openstackgerrit has quit IRC22:38
*** openstackgerrit_ has joined #openstack-ironic22:39
*** openstackgerrit_ is now known as openstackgerrit22:40
greghaynesthis is one of those things where in $other_language I would just say "clearly we just need a singleton"22:40
devanandagreghaynes: why is this being python mean a singleton not the right answer?22:45
greghaynesIt doesnt, I just have noticed that pattern being more frowned upon in python land22:46
devanandagreghaynes: we need a process-wide lock when creating singletons, due to greenthreads, but otherwise, I don't have a problem with them22:47
greghaynessweet22:47
greghaynesIll play with that, then22:47
NobodyCamwhere is check-grenade-dsvm-ironic-sideways ?22:48
devanandagreghaynes: this is an API change - https://review.openstack.org/#/c/109688/1222:49
devanandagreghaynes: without a blueprint/spec, and after feature freeze22:49
devanandagreghaynes: the data model change is one thing -- risky this late, but maybe justifiable. the REST API change is raising red flags for me22:50
greghaynesok, I think the REST part can get pulled out22:50
greghaynesalso, I wont be offended if it doesnt go in until k22:51
devanandagreghaynes: I don't see why the REST change is related to the bug fix at all22:51
devanandathere are two problems I see with the hash ring: rebalancing (what this patch starts) and redistribution percentage (which Nejc was working on, i think?)22:52
*** rainya has quit IRC22:52
greghaynesAgreed, that part of it isnt needed22:52
greghaynesthe redistribution patch lifeless posted22:52
*** rainya has joined #openstack-ironic22:53
greghayneshttps://review.openstack.org/#/c/118932/22:53
*** yuanying has joined #openstack-ironic22:53
devanandaah, right22:53
lifelessdevananda: I don't think we can land the redistribution fix patch until rebalancing is landed22:54
lifelessdevananda: so we should get rebalancing in place, which we know will do too much work at first; then land the redistribution patch straight after, which will fix the amount of work.22:54
lifelessgreghaynes: oh!22:55
lifelessgreghaynes: we need to make sure that the column add in your patch either sets everything NULL and assumes NULL=needs rebalancing22:55
lifelessgreghaynes: or22:55
*** athomas has joined #openstack-ironic22:55
lifelessgreghaynes: we need to populate it with the /old/ hash algorithm, otherwise folk will end up with the right eventual host, but the content still on the old one22:55
greghaynesNULL sounds like the way to go22:56
greghaynesLess code to perform less operations22:57
jrollyes, NULL is the right thing to do22:58
jrollyou'll need to restart conductors when deploying this change anyhow22:58
lifelessgreghaynes: and so the rebalance code probably needs to be smart enough to check disk and make it roughly a no-op if everything is already in place22:58
jrollwhich would cause a rebalance22:58
lifelessjroll: that won't cause a rebalance22:58
jrollrolling restart of conductors won't rebalance?22:59
lifelessjroll: a conductor that misses a checkpoint will22:59
jrollah, true22:59
jrollregardless22:59
lifelessjroll: rolling shouldn't miss checkpoints22:59
jrollas someone running ironic in production22:59
jrolla rebalance on this deploy would be ok with me22:59
jrollnot optimal, but ok22:59
lifelesssure22:59
lifelessthanks22:59
JayFjroll: we also use IPA22:59
jrollah fffffff22:59
JayFjroll: which conductor is attached to a node matters significantly less22:59
jrollyeah22:59
lifelessit will be fine22:59
jrolland rebalance less expensive for us23:00
lifelessgreg is working with non-IPA Ironic deploys, I'm sure he'll test well :)23:00
jrollread: not expensive23:00
jrollheh23:00
jrollok23:00
greghayneshaha23:00
lifelessrebalance onto the same node should be nearly free.23:00
*** rainya has quit IRC23:00
devanandalifeless: i believe a rolling restart /will/ rebalance everythign today, because ironic/common/service will call self.manager.del_host() which will unregister the conductor23:02
devanandaI think we need a HUP handler to avoid that23:02
jrollah, right. that sounds reasonable23:03
jrollI mean23:03
jrollshutting down a conductor should maybe trigger things23:03
jrollso you don't need to wait $timeout for it to failover and whatnot23:03
devanandajroll: it triggers manager.del_host()23:03
* jroll looks23:04
jrolldevananda: I think that's okay behavior23:04
russell_hthat doesn't actually trigger a rebalance in other conductors today though does it?23:04
devanandarussell_h: there's no mechanism today to *trigger* a rebalance23:05
russell_hright23:05
jrollunless you explicitly want a restart to *not* rebalance; with the caveat that it will take $timeout for rebalancing to happen if a conductor gets killed23:05
lifelessunregistering the conductor is bad23:06
lifelessbecause it changes the ring shape immediately23:06
devanandarussell_h: the API service, aiui, models the hash ring at every request23:06
lifelessa rolling deploy shouldn't cause a whole bunch of churn - regardless of driver23:06
lifelessdevananda: there's a cache in there I believe23:06
russell_hnope23:06
russell_hthere should be, but there isn't23:06
devanandaso unregistering the conductor immediately changes the ring appearance and the routing of messages23:07
lifelessrussell_h: class HashRingManager(object):23:07
lifelessrussell_h: is that object constructed per request?23:07
russell_hlifeless: yeah23:07
lifelesswell nuts23:07
russell_hIIRC I originally instantiated one that was shared across requests23:07
lifelessanyhow23:07
russell_hand would periodicially refresh23:08
lifelessits really bad in that case23:08
lifelessbecause two requests for node X23:08
lifelesswhich hash onto conductor Y normally23:08
devanandalifeless: HashRingManager is instantiated within RPCAPI, which in turn is instantuated by api/hooks.py for every request23:08
devananda:(23:08
lifelesscan be split onto different conductors, if a third conductor comes/goes.23:08
russell_hbut we felt like we didn't fully understand our consistency model at the time, so I was asked to remove it to preserve existing behavior23:08
lifelessrussell_h: ack23:08
devanandaI don't see a singleton or module-scoped instance caching it anywhere23:08
devanandabut maybe i'm missing it23:08
lifelessso I think its pretty important that we differentiate between things restarting and things failing by going away permanently23:09
devanandarussell_h: ah, right. i recall that now23:09
lifelesse.g. I'd like conductors to never unregister.23:09
lifelesslet operators delete them23:09
devanandalifeless: differentiate between ... ++ ; operators delete them --23:09
russell_hlifeless: do you want a distinction between a conductor being "registered" and it being "active"?23:10
lifelessdevananda: note that operators deleting doesn't imply operators having to care about failover stuff23:10
lifelessrussell_h: exactly.23:10
russell_h(where active is probably a terribly overloaded term)23:10
lifelessrussell_h: 'has checkpointed within X seconds' <- registered and alive23:10
russell_hright23:10
lifelessrussell_h: 'has checkpointed more than X seconds' <- registered and not alive23:10
* devananda has no brainsugar left and needs food, bbl23:11
lifelessif it isn't alive we can remove it from the hash ring *in the new implementation*.23:11
lifeless[because the new implementation uses hashed partitions, it won't destablise things to do so].23:11
russell_hbut given that the conductor currently (according to devananda, I haven't verified) deletes itself on a graceful shutdown23:12
russell_his there much point in adding code to make the old hash ring less broken instead of just going to the new one?23:13
russell_hthe old one is super broken at this point23:13
russell_hlike if a conductor dies, there is no auto-rebalancing23:13
russell_hfor that matter, in order to start multiple conductors you have to do multiple passes at it23:14
russell_hstart them each up23:14
russell_hthen go back and restart them23:14
russell_h(thats not specific to the hash ring, but rather how the conductor uses it)23:14
*** Guest54173 is now known as antonym23:15
*** antonym is now known as Guest3565523:15
lifelessrussell_h: you raise good points, I need to cogitate.23:18
lifelessrussell_h: and context switch, sorry.23:18
lifelessrussell_h: I don't see how restarting can help23:18
lifelessrussell_h: because of the deleting behaviour23:19
lifelessrussell_h: we need to refresh the rings without restarting, because restarting deletes the conductor which means restarting two nodes at once is a race23:19
lifelessrussell_h: which is bad news for ops.23:19
lifelessrussell_h: so - I think its worth making things more stable, how we do that - sure.23:19
*** athomas has quit IRC23:26
*** r-daneel has quit IRC23:33
russell_hlifeless: yeah, my brain is pretty fried at this point.23:36
russell_hthe restarting thing helps when done serially, because the conductor notices its peers23:36
russell_hso say I start 3 conductors23:36
russell_hconductor 0 builds a hash ring where it owns every node23:36
chuckCusing http://docs.openstack.org/developer/ironic/dev/dev-quickstart.html#deploying-ironic-with-devstack to try ironic/devstack for the first time, I see stack.sh fail because of a bad url: http://tarballs.openstack.org/ironic-python-agent/coreos/files/coreos_production_pxe-oem.cpio.gz23:36
russell_hconductor 1 builds a hash ring where it owns some random 1/2 of the nodes23:36
chuckCIs something wrong or missing in the doc, or should I fix devstack?23:36
russell_hand conductor 2 builds a hash ring where it owns some random 1/3 of the nodes23:37
russell_hwhen I restart conductor 0, it unregisters itself on shutdown, re-registers itself on startup, then rebuilds the hash ring23:37
russell_hand now believes it owns a different 1/3 of the nodes than conductor 223:37
jrollchuckC: looking23:38
russell_hrestart conductor 1, it does the same thing, and now everything is good23:38
*** dlaube has quit IRC23:38
chuckCjroll: thanks23:38
russell_h(until a conductor dies, then you're boned)23:38
jrollchuckC: can you paste the error?23:38
russell_hwe actually had a conductor die in production, and for absurd reasons we didn't notice for days23:38
* chuckC looking23:39
russell_hbecause the API rebuilds the hashring on every request23:39
jrollchuckC: never mind23:39
JayFchuckC: there's a fix for that url23:39
russell_hand conductors actually will handle any request they receive, regardless of whether they own the node23:39
jrollI thought that was correct in devstack, wth23:39
JayFchuckC: http://tarballs.openstack.org/ironic-python-agent/coreos/files/coreos_production_pxe_image-oem.cpio.gz23:39
JayFchuckC: is the correct url23:39
russell_hso all you really lose is periodic tasks23:39
JayFchuckC: and should be correct in devstack master, if not please let us know and we'll stab at it again23:39
russell_hwhich still sucks23:39
jrollchuckC: I'm going to throw up a fix to devstack, but for now set in localrc: IRONIC_AGENT_RAMDISK_URL=http://tarballs.openstack.org/ironic-python-agent/coreos/files/coreos_production_pxe_image-oem.cpio.gz23:40
NobodyCamadam_g: happen to be around?23:40
jrollJayF: I thought it was but it's not :(23:40
chuckCjroll: ok.  I had already coded the fix, but wasn't sure if something in the doc might have been involved23:41
JayFI swear we merged a patch that fixed that <.<23:41
jrollchuckC: nah, it's devstack code, but I swear I double-checked that :(23:41
jrollI did too23:41
JayFlet me see if I has it23:41
JayFI don't have a patchset up for it23:43
JayFwth23:43
JayFthanks for reporting this chuckC23:43
JayFnow to go find what leprechaun ate our patchset23:43
chuckCJayF: np23:43
JayFjroll: you going to put the fix back up? I'd appreciate it as I'm in cloud-init hell right now23:43
jrollyep23:43
*** rainya has joined #openstack-ironic23:47
*** rainya has quit IRC23:47
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Add docstrings for agent.py  https://review.openstack.org/12066023:51
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Add docstrings for api/ tree  https://review.openstack.org/12066123:53
*** igordcard has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!