Wednesday, 2014-04-09

*** stevehuang has quit IRC00:00
*** newell_ has quit IRC00:00
devanandajroll: looks like https://review.openstack.org/#/c/81919/ is failing now00:03
JoshNangdevananda: looks like the mem bug, at least for py2600:07
devanandaugh00:10
jrollI agree00:14
*** rloo has quit IRC00:18
openstackgerritJosh Gachnang proposed a change to openstack/ironic: Add configdrive generation to Nova driver  https://review.openstack.org/8619200:21
*** matsuhashi has joined #openstack-ironic00:31
*** killer_prince has quit IRC00:52
*** derekh has quit IRC00:53
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Change driver URL from teeth to agent  https://review.openstack.org/8620100:53
*** matsuhashi has quit IRC00:56
*** lazy_prince has joined #openstack-ironic00:59
*** lazy_prince is now known as killer_prince00:59
*** matsuhashi has joined #openstack-ironic01:05
*** hemna_ has quit IRC01:08
*** bigjools has quit IRC01:11
NobodyCamshould a change like this https://review.openstack.org/#/c/85529/4/ironic/openstack/common/log.py not give debug logs in the gate jobs01:12
*** bigjools has joined #openstack-ironic01:13
*** bigjools has joined #openstack-ironic01:13
*** ilives has joined #openstack-ironic01:24
*** eghobo has quit IRC01:28
*** nosnos has joined #openstack-ironic01:29
*** datajerk has joined #openstack-ironic01:29
*** datajerk has quit IRC01:33
*** datajerk has joined #openstack-ironic01:38
*** jgrimm has quit IRC02:06
*** jgrimm has joined #openstack-ironic02:18
*** coolsvap has joined #openstack-ironic02:33
*** lazy_prince has joined #openstack-ironic02:44
*** datajerk has quit IRC02:57
*** matsuhashi has quit IRC03:12
*** harlowja is now known as harlowja_away03:12
*** coolsvap has quit IRC03:12
*** lazy_prince has quit IRC03:14
*** eghobo has joined #openstack-ironic03:19
*** nosnos has quit IRC03:26
*** coolsvap1 has joined #openstack-ironic03:27
*** coolsvap1 has quit IRC03:27
*** coolsvap has joined #openstack-ironic03:28
*** datajerk has joined #openstack-ironic03:58
*** lazy_prince has joined #openstack-ironic04:00
*** sseago_ has quit IRC04:21
*** matsuhashi has joined #openstack-ironic04:24
*** nosnos has joined #openstack-ironic04:25
*** sabah has joined #openstack-ironic04:33
*** matsuhashi has quit IRC04:42
*** ironman_ has quit IRC04:47
*** matsuhashi has joined #openstack-ironic04:50
*** lazy_prince has quit IRC05:01
*** sabah has quit IRC05:25
*** datajerk has quit IRC05:28
*** vkozhukalov has joined #openstack-ironic05:39
*** pradipta_away is now known as pradipta05:51
openstackgerritJenkins proposed a change to openstack/ironic: Imported Translations from Transifex  https://review.openstack.org/8395606:07
*** sirushti has quit IRC06:08
*** _sirushti has joined #openstack-ironic06:09
*** _sirushti is now known as sirushti06:09
*** killer_prince has quit IRC06:13
*** lazy_prince has joined #openstack-ironic06:13
*** lazy_prince is now known as killer_prince06:13
*** max_lobur has joined #openstack-ironic06:17
*** eghobo has quit IRC06:22
*** adam_g has quit IRC06:41
*** max_lobur has quit IRC06:43
*** adam_g has joined #openstack-ironic06:58
*** adam_g has quit IRC06:58
*** adam_g has joined #openstack-ironic06:58
*** yuriyz has joined #openstack-ironic07:03
*** yuriyz has quit IRC07:06
*** mrda is now known as mrda_away07:18
*** yuriyz has joined #openstack-ironic07:28
*** datajerk has joined #openstack-ironic07:29
*** matsuhashi has quit IRC07:29
*** coolsvap is now known as coolsvap_away07:30
*** matsuhashi has joined #openstack-ironic07:31
*** sabah has joined #openstack-ironic07:32
*** datajerk has quit IRC07:33
dtantsurmorning Ironic07:34
*** matsuhashi has quit IRC07:35
*** coolsvap_away is now known as coolsvap07:41
*** matsuhashi has joined #openstack-ironic07:49
Mikhail_D_wkMorning dtantsur :)07:57
Mikhail_D_wkMorning all! :)07:57
*** datajerk has joined #openstack-ironic08:02
*** jistr has joined #openstack-ironic08:02
*** sabah has quit IRC08:06
*** datajerk has quit IRC08:06
*** sseago has joined #openstack-ironic08:06
*** romcheg has joined #openstack-ironic08:14
*** Mikhail_D_ltp has joined #openstack-ironic08:23
*** rameshg87 has joined #openstack-ironic08:23
*** rushiagr has joined #openstack-ironic08:23
rushiagrHello folks08:24
rushiagrI was trying to setup Ironic with Devstack using the docs08:24
rushiagrbut I wasn't able to ..08:24
rushiagrhere are the devstack logs08:25
rushiagrhttp://paste.openstack.org/show/75390/08:25
rushiagrand here is the error from ir-cond screen08:26
rushiagrhttp://paste.openstack.org/show/75391/08:26
rushiagrstrangely, errors at both the places seem unrelated08:26
*** datajerk has joined #openstack-ironic08:26
*** Mikhail_D_ltp has quit IRC08:29
dtantsurhttp://paste.openstack.org/show/75391/  <-- it's ok, error is in the first and I have never seen it :(08:29
*** datajerk has quit IRC08:30
yuriyzmorning Ironic08:32
*** lucasagomes has joined #openstack-ironic08:34
rameshg87rushiagr: i just checked the code of seamicro08:34
yuriyzrushiagr, there is a fix already https://review.openstack.org/#/c/85388/08:34
rameshg87rushiagr: it might be because this might be missing on your system https://github.com/seamicro/python-seamicroclient08:34
yuriyzbut this only for seamicro drivers now08:35
rameshg87rushiagr: if you are not going to use the seamicro driver, you can ignore that error as well :-)08:35
yuriyzyes, all others can work :)08:36
rushiagrI just wanted to use ironic apis with devstack. I don't want to use any drivers :)08:36
rameshg87rushiagr: then you can go ahead and ignore the error :-)08:36
*** martyntaylor has joined #openstack-ironic08:36
rushiagrbut it seemed like the stack.sh script exited out abruptly..08:37
rushiagrit said ' Failed to define network from /dev/fd/63"08:38
rushiagr"XML error: unexpected virtualport type -1"08:38
openstackgerritVladimir Kozhukalov proposed a change to openstack/ironic-python-agent: Added lvm partitioner  https://review.openstack.org/8567208:40
dtantsurlucasagomes, hi. Re: https://review.openstack.org/#/c/84396/4 weren't you expected to add some tests there? Sorry if I got something wrong :)08:40
lucasagomesdtantsur, yeah, well... I still dunno weather that tests should go there or not (it was basically requested me to test parted other than our code itself)08:41
lucasagomesdtantsur, yesterday I was trying to push a milestone-proposed patch for that change08:42
lucasagomesand ended up updating the old patch08:42
lucasagomescause we were experimenting how to push to the mp branch, and we didn't know hw to do it08:42
dtantsurlucasagomes, I am not sure either. The code is quite simple and I expect gparted to work...08:42
lucasagomesdtantsur, yeah08:43
lucasagomessame here08:43
openstackgerritVladimir Kozhukalov proposed a change to openstack/ironic-python-agent: Added lvm partitioner  https://review.openstack.org/8567208:43
dtantsuranyway for future changes (like in your other patches) it would be nice to have such tests, I don't remember whether you have them08:44
lucasagomesdtantsur, no I don't have tests partitioning a file08:45
lucasagomesjust checking whether the commands that parted will execute are the expected commands08:45
lucasagomesthings like that08:45
dtantsurlucasagomes, I'd recommend you add them, so that we don't break partitioning at some point08:46
lucasagomesdtantsur, ack, there's more to consider as well08:46
dtantsurit would be helpful e.g. to test against new versions of gparted08:46
lucasagomeslike creating a sparse file before partitioning08:46
lucasagomesis fs dependent08:46
lucasagomesthings like that08:46
dtantsurlucasagomes, I thing we can just skip the test if we can't create a sparse file08:47
lucasagomesyeah that's a valid conditional08:47
dtantsurmost Linux fs support it somehow anyway08:47
lucasagomesyup08:47
lucasagomesI will give it a go08:47
dtantsurshould I put these considerations as review comments?08:48
lucasagomeshmm sure thanks08:49
agordeevrushiagr: hey hey, just update libvirt to 1.1.x+ to get rid of "unexpected virtualport"08:51
agordeevmorning Ironic08:51
*** coolsvap is now known as coolsvap|afk08:52
agordeevrushiagr: < https://review.openstack.org/#/c/70348/18/tools/ironic/templates/brbm.xml08:53
openstackgerritVladimir Kozhukalov proposed a change to openstack/ironic-python-agent: Added disk partitioner  https://review.openstack.org/8616309:01
*** datajerk has joined #openstack-ironic09:02
*** coolsvap|afk is now known as coolsvap09:05
*** datajerk has quit IRC09:06
*** max_lobur has joined #openstack-ironic09:07
*** overlayer has joined #openstack-ironic09:09
*** max_lobur1 has joined #openstack-ironic09:09
dtantsuragordeev, morning09:12
*** max_lobur has quit IRC09:13
dtantsurGuys, can we have some review progress with https://review.openstack.org/#/c/84497/ ? I think this one is _really_ critical.09:15
agordeevdtantsur: afair, it's good practice to add unittests for what being fixed. Would you like to add them?09:22
Mikhail_D_wkagordeev: Morning :)09:22
agordeevdtantsur, Mikhail_D_wk morning guys!09:22
dtantsuragordeev, well... It makes sense, not sure it's easy/doable. lucasagomes ^^^ ?09:23
dtantsur(I can try adding if you don't have time for it)09:23
*** datajerk has joined #openstack-ironic09:24
agordeevdtantsur: the reason is when the bug had been fixed and you add unittests that checks that bug was truly eliminated and won't come back in the future patches09:25
lucasagomesagordeev, dtantsur yeah makes sense to add tests09:25
lucasagomesbefore we couldn't run tests on the driver in the ironic tree09:26
lucasagomesbut we merged a patch this week that allows it09:26
dtantsurlucasagomes, will you? If you don't have time I can try (not sure how easy it is though...)09:26
lucasagomesdtantsur, if u want to give it a go, np to me09:26
lucasagomesdtantsur, u can add ur self as co-author there09:27
dtantsurlucasagomes, ok, let me try :)09:27
lucasagomesack09:27
*** datajerk has quit IRC09:28
romchegMorning lucasagomes agordeev dtantsur Mikhail_D_wk!09:30
lucasagomesromcheg, morning09:30
dtantsurmordred, romcheg09:30
dtantsur* morning Oo09:30
dtantsurthat was a strange misprint09:30
romchegI always hit tab when writing a first word :)09:31
dtantsur:)09:31
*** dtantsur is now known as dtantsur|lunch09:31
agordeevromcheg: morning09:33
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: IPMITool to use the new ManagementInterface  https://review.openstack.org/8609209:37
*** athomas has joined #openstack-ironic09:37
*** lucasagomes_ has joined #openstack-ironic09:43
*** matsuhas_ has joined #openstack-ironic09:45
*** lucasagomes has quit IRC09:45
*** matsuhashi has quit IRC09:45
*** matsuhas_ has quit IRC09:45
*** matsuhashi has joined #openstack-ironic09:46
*** datajerk has joined #openstack-ironic10:02
*** datajerk has quit IRC10:07
*** martyntaylor has quit IRC10:11
*** matsuhashi has quit IRC10:12
*** martyntaylor has joined #openstack-ironic10:13
*** athomas has quit IRC10:15
*** matsuhashi has joined #openstack-ironic10:16
*** athomas has joined #openstack-ironic10:21
*** datajerk has joined #openstack-ironic10:22
lucasagomes_GheRivero, ping re: 8606310:26
*** datajerk has quit IRC10:26
lucasagomes_GheRivero, I was thinking about adding a file like common/states.py to the boot devices10:26
lucasagomes_and then one method to the interface to get a list of supported boot devices for that giving node10:26
*** lucasagomes_ is now known as lucasagomes10:27
lucasagomesso if drivers has a new boot device not listed there, they can add it to the mapping (common/boot_devices.py) and return it in the supported lists10:27
GheRiverolucasagomes: sounds good. I like it. is the 'sanitazion' also goind there? (pxe vs net)10:30
lucasagomesGheRivero, yeah, so we can have like boot_devices.DISK10:30
lucasagomesand in the IPMI driver boot_devices.DISK is mapped internally to 'disk'10:31
lucasagomesand the seamicro is mapped to 'hd0'10:31
lucasagomesfor e.g10:31
GheRivero+110:31
lucasagomesGheRivero, ack, thanks for the comment there I will add another comment and update the patch10:31
*** derekh has joined #openstack-ironic10:32
*** coolsvap is now known as coolsvap|afk10:38
*** eloib_ has quit IRC10:39
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Add ManagementInterface  https://review.openstack.org/8606310:49
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: IPMITool to use the new ManagementInterface  https://review.openstack.org/8609210:49
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Add ManagementInterface  https://review.openstack.org/8606310:52
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: IPMITool to use the new ManagementInterface  https://review.openstack.org/8609210:52
*** matsuhashi has quit IRC11:05
*** matsuhashi has joined #openstack-ironic11:05
*** sabah has joined #openstack-ironic11:08
*** soren has joined #openstack-ironic11:12
*** sabah has quit IRC11:12
*** dtantsur|lunch is now known as dtantsur11:13
*** matsuhashi has quit IRC11:19
*** datajerk has joined #openstack-ironic11:20
*** datajerk has quit IRC11:24
rushiagragordeev: thanks. libvirt was not installed actually. IDK why :/11:27
*** lucasagomes is now known as lucas-hungry11:32
*** matsuhashi has joined #openstack-ironic11:36
*** matsuhashi has quit IRC11:39
*** pradipta is now known as pradipta_away11:51
*** pradipta_away is now known as pradipta11:53
*** pradipta is now known as pradipta_away11:54
*** rameshg87 has left #openstack-ironic11:54
*** yuriyz has quit IRC11:55
*** Alexei_987 has joined #openstack-ironic11:56
*** coolsvap|afk is now known as coolsvap11:57
*** datajerk has joined #openstack-ironic12:02
*** yuriyz has joined #openstack-ironic12:03
*** datajerk has quit IRC12:06
*** datajerk has joined #openstack-ironic12:18
*** datajerk has quit IRC12:23
NobodyCamgood morning Ironic From roswell12:38
agordeevNobodyCam: morning12:38
NobodyCam:) morning agordeev :)12:39
ShrewsNobodyCam: morning. where to next?12:41
NobodyCammorning Shrews here for the day. actually going to take a bit of time today to explor roswell, Going to board the kids (dogs) for a few hours and do the rosewell tourist stuff12:44
*** linggao has joined #openstack-ironic12:45
openstackgerritDmitry Tantsur proposed a change to openstack/ironic: Implement caching for master images  https://review.openstack.org/8538712:45
NobodyCamhttp://www.tripadvisor.com/Attractions-g47182-Activities-Roswell_New_Mexico.html12:46
*** jdob has joined #openstack-ironic12:50
NobodyCambut my question is why is this change not giving me debug logs in the gate jobs https://review.openstack.org/#/c/85529/4/ironic/openstack/common/log.py12:53
lucas-hungrymorning NobodyCam12:53
*** lucas-hungry is now known as lucasagomes12:53
NobodyCammorning lucasagomes :)12:53
*** rloo has joined #openstack-ironic12:58
yuriyzmorning NobodyCam12:58
NobodyCammorning yuriyz :)12:58
NobodyCamoh brb coffee is ready and quick morning walkies12:59
*** jbjohnso_ has joined #openstack-ironic13:02
*** datajerk has joined #openstack-ironic13:02
*** rloo has quit IRC13:03
*** rloo has joined #openstack-ironic13:03
NobodyCamwow that was quick... hehehe its cold out side13:04
agordeevjroll: JayF hey. I'm trying to move execute_command into utils and hitting the import loop issue again. https://review.openstack.org/#/c/85412/3/ironic_python_agent/flow.py The circular import happens among errors, base, utils13:05
NobodyCamlucasagomes: yuriyz: can you think of why I would not be getting debug logs with the change I pasted above?13:06
*** datajerk has quit IRC13:07
openstackgerritAleksandr Gordeev proposed a change to openstack/ironic-python-agent: Add FlowExtension  https://review.openstack.org/8541213:07
lucasagomesNobodyCam, hmmm in the ironic.conf debug = True?!13:09
lucasagomesmaybe some function is setting it to false in the config?13:09
NobodyCamconf should be comming from https://github.com/openstack/tripleo-image-elements/blob/master/elements/ironic/os-apply-config/etc/ironic/ironic.conf13:10
NobodyCamwhich has no debug in it13:10
lucasagomeshmmm13:11
lucasagomesodd13:11
NobodyCamoddly this: https://review.openstack.org/#/c/85101/2/elements/ironic/os-apply-config/etc/ironic/ironic.conf will give debug logs13:11
NobodyCamhowever I can set a dep on a cross project patch13:11
NobodyCams/can/can not/13:12
* NobodyCam needs to drink the coffee13:12
lucasagomesyeah it really sucks to not be able to do that13:13
lucasagomesbut thinking idk why that doesn't give u debug logs13:13
lucasagomesit should13:13
lucasagomesgotta dig more into it to see if I can find something13:13
lucasagomesbut looking at it, looks alright13:13
*** nosnos has quit IRC13:14
NobodyCamya this is what I am getting in the gate logs: http://paste.openstack.org/show/IU0VfTamSMxbRuWSB3Wp/13:15
*** coolsvap is now known as coolsvap|afk13:18
*** coolsvap|afk is now known as coolsvap13:20
*** coolsvap is now known as coolsvap|afk13:22
lucasagomesyeah no debug13:23
*** matty_dubs|gone is now known as matty_dubs13:26
NobodyCammorning matty_dubs :)13:27
NobodyCamnode looks like it added correctly : http://logs.openstack.org/29/85529/4/check-tripleo/check-tripleo-ironic-undercloud-precise/8b381ba/console.html#_2014-04-09_00_11_52_93513:30
*** killer_prince has quit IRC13:34
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: SeaMicro to use the new ManagementInterface  https://review.openstack.org/8632813:42
openstackgerritChris Krelle proposed a change to openstack/ironic: Fix for tripleO undercloud gate tests  https://review.openstack.org/8552913:46
NobodyCamok really hacky attempt to get debug logs13:46
lucasagomesNobodyCam, maybe it's better to set a -2 on that review? so it would prevent it from being update13:47
lucasagomesbeing merged*13:48
lucasagomesbut you still could send new patch-sets to it13:48
NobodyCamnot sure -2 will get tested.. WIP ok?13:48
lucasagomesNobodyCam, sure13:48
lucasagomeshmm idk as well lemme check the -2 ting13:49
lucasagomesthing13:49
NobodyCamwip set13:49
lucasagomesNobodyCam, -2 still testing it13:50
lucasagomeshttps://review.openstack.org/#/c/78787/13:50
lucasagomesI saw it when deva -2'd that patch13:50
lucasagomesthen I sent a new review and tests were trigged13:50
lucasagomesbut anyway, wip is good enough13:50
NobodyCam:)13:50
NobodyCamI'm watching it in zuul13:51
agordeevJayF: jroll nevermind, i'd found the solution13:56
matty_dubsOh, a belated good morning, NobodyCam -- I fail at IRC today13:57
NobodyCamits all good matty_dubs :)13:57
*** datajerk has joined #openstack-ironic14:02
openstackgerritAleksandr Gordeev proposed a change to openstack/ironic-python-agent: Resolve circular import, introduce ExecuteCommandMixin  https://review.openstack.org/8634114:16
openstackgerritAleksandr Gordeev proposed a change to openstack/ironic-python-agent: Add FlowExtension  https://review.openstack.org/8541214:16
NobodyCamlucasagomes: wow no test cheanges needed for 8439614:20
lucasagomesNobodyCam, yeah, sfdisk is not being tested in trunk heh14:21
lucasagomesNobodyCam, usually the tests just mock the make_partitions func14:21
lucasagomesI can add some tests to that14:22
lucasagomesbut urgh, I'm thinkin about the tests on a sparse file, and it sucks14:22
lucasagomeswhat will sucks more will be to parse the output to read the part table14:22
lucasagomes-.-14:22
NobodyCami would have thought we should at least test that it is called14:23
lucasagomesNobodyCam, +114:23
NobodyCam>.<14:23
lucasagomeslemme add some tests to it14:24
NobodyCamwant to add a test to just check that it is called? and I'll +214:24
NobodyCam:)14:24
lucasagomesNobodyCam, will do14:24
NobodyCamas it is going to be back ported maight be worth it :)14:24
NobodyCam*might14:24
lucasagomes+1 I will update both reviews14:25
NobodyCamyou da man :) :-p14:25
*** saju_m has joined #openstack-ironic14:26
lucasagomesNobodyCam, :D, btw so ur going to have ur RV in atlanta? I really want to see it if possible14:27
NobodyCamsure :)14:27
NobodyCamand meet the kids :)14:28
matty_dubsOoh, nice! You'll have to organize a tour group or something. ;)14:29
NobodyCamLOL :)14:29
lucasagomesNobodyCam, hah awesome!14:29
lucasagomeslol14:29
lucasagomesmatty_dubs, +114:29
devanandamorning, all14:32
lucasagomesmorning devananda14:32
romchegMorning guys!14:33
dtantsurdevananda, morning14:33
NobodyCammorning romcheg :)14:33
NobodyCammornig devananda :)14:33
NobodyCammorning dtantsur14:34
agordeevdevananda: morning14:34
GheRiveromorning Ironic!14:36
NobodyCammorning GheRivero14:36
devanandalucasagomes: adding tests to 84396 and 86179 ?14:36
lucasagomesdevananda, yeah14:36
lucasagomesdoing it right now14:36
devanandaawesome14:38
devanandarloo: hi! I just noticed https://review.openstack.org/#/c/84545/2 and that it didn't "build" into the claimed location14:43
devanandarloo: this is because python-ironicclient does not have a doc build hook in -infra14:43
rloodevananda: #@%#. I didn't even notice!14:44
rloodevananda: what does it mean, it "doesn't have a doc build hook in -infra"?14:44
devanandarloo: he requested URL /developer/python-ironicclient/ was not found on this server14:44
devanandawoops14:44
rloodevananda: how did you notice it? the review it self says it merged?14:45
devanandayea, but click the link14:45
devanandait's not there14:45
devanandaand jenkins tests dont show a doc build tset14:45
devanandatest14:45
rlooha ha. (sort of.)14:45
devanandarloo: is there a precedent for other projects' clients to have a similar and separate doc page?14:45
rlooyes14:46
*** jgrimm has quit IRC14:46
devanandagreat14:46
rlooeg: glance http://docs.openstack.org/developer/python-glanceclient/14:46
devanandahere's what's missing14:46
devanandahttp://git.openstack.org/cgit/openstack/ironic/tree/setup.cfg#n4714:46
rlooit's missing an upload_sphinx?14:47
*** coolsvap|afk is now known as coolsvap14:48
NobodyCambbt.. brb14:48
devanandahttp://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml#n126614:48
devanandahttp://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml#n76914:49
devanandarloo: specifically, around L1266, it needs a openstack-client-publish-jobs14:50
rloodevananda: ok, in a template section. what about the other stuff in template: that other projects have?14:51
devanandarloo: sorry, still waitingn for coffee to kick in -- it seems to have the build_sphinx, but it isn't getting called, and i suspect it's the missing openstack-client-publish-jobs14:52
devanandarloo: the good folks in -infra know all and tell all :)14:52
linggaomatty_dubs and NobodyCam, good morning. I found where the problem was. I added an extra pair of quotes when passing the ipmi command to shellinaboxd.14:52
rloodevananda: I notice that python-glanceclient has an 'upload_sphinx' in their setup.cfg.14:52
rloodevananda: I'll poke around and check with -infra.14:53
linggao matty_dubs and NobodyCam, that's why it worked manually but not in the subproces.14:53
devanandarloo: thanks! also, thanks!14:53
rloodevananda: thank YOU for noticing ;)14:54
NobodyCamlinggao: ahh doh14:54
NobodyCam:)14:54
NobodyCamthats always tuff to spot14:54
linggaoNobodyCam, yes. :(14:56
*** saju_m has quit IRC14:58
matty_dubslinggao: Ah, subtle!14:59
linggao:)15:00
NobodyCamok bbiafm15:01
jrollagordeev: I hate circular imports :(15:03
jrollmorning ironic!15:03
agordeevjroll: morning!15:08
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Replace sfdisk with parted  https://review.openstack.org/8439615:08
jroll:)15:08
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Replace sfdisk with parted  https://review.openstack.org/8439615:09
* devananda tests the MP changes for parted15:12
devanandahttps://review.openstack.org/#/c/86179/15:13
*** ilives has quit IRC15:13
devananda*again15:13
lucasagomesheh will add tests to it15:14
*** shausy has joined #openstack-ironic15:15
NobodyCammornig jroll :)15:15
jrollmorning NobodyCam :)15:15
devanandalucasagomes: looks ilke the tripleo-ironic-seed test on that failed, but i think it was an error downloading a package15:16
lucasagomesdevananda, yeah something was going on yesterday and it was failing pretty soon15:16
lucasagomesonce I update the tests it will trigger the test again15:16
lucasagomesupdated15:17
lucasagomeslet's see15:17
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Better check for available nodes  https://review.openstack.org/8468715:23
*** shausy has quit IRC15:24
*** jgrimm has joined #openstack-ironic15:24
*** overlayer has quit IRC15:30
devanandahmmm, this is neat: http://activity.openstack.org/data/display/OPNSTK2/ironic15:31
* NobodyCam clicks15:33
*** newell_ has joined #openstack-ironic15:33
NobodyCamneet-o15:33
NobodyCamneat-0 even15:34
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Better check for available nodes  https://review.openstack.org/8468715:34
lucasagomesoh wow nice15:34
openstackgerritDmitry Tantsur proposed a change to openstack/ironic: Fix Nova rescheduling tear down problem  https://review.openstack.org/8449715:35
dtantsurlucasagomes, ^^^15:35
lucasagomesdtantsur, :D will take a look, cherios15:35
lucasagomescheerios*15:35
dtantsurBtw I do think tests there need some refactoring, e.g. to use @mock.patch or with mock.patch instead of long lines of .start() ... addClanup(mock.stop)15:36
dtantsurlucasagomes, also, did I use co-authored tag correctly? I'm confused it didn't turn into a neat link :)15:37
lucasagomesdtantsur, the tag seems grand15:38
lucasagomesCo-Authored-By: name <name@example.com>15:38
dtantsurcool!15:38
lucasagomesdtantsur, yeah the refactor is very needed, I think that we didn't know about the @mock decorator when i was writing the tests for the driver15:39
lucasagomesI remember that in the volume driver I added tests with the decorator15:39
* lucasagomes looks the reviews in nova15:39
dtantsurlucasagomes, and btw we already have https://review.openstack.org/#/c/73223/ and https://review.openstack.org/#/c/73256/ in progress15:39
lucasagomesdtantsur, yeah15:40
*** mdickson has quit IRC15:40
russell_hagordeev: is the ExecuteCommandMixin stuff you added just to work around the circular imports, or do you imagine wanting to add this functionality to other classes as well?15:40
lucasagomesheh yeah the nova driver doesn't use any @mock.patch15:40
lucasagomeshttps://review.openstack.org/#/c/51328/ :(15:40
lucasagomesbut the volume does https://review.openstack.org/#/c/71026/15/nova/tests/virt/ironic/test_volume_driver.py15:41
dtantsurlucasagomes, would be nice to do before merging15:41
lucasagomes+115:41
dtantsurmaybe I'll just create a dependent review request for this change tomorrow, and then we sync it into https://review.openstack.org/#/c/51328/15:42
*** dkehn_ is now known as dkehnx15:43
*** stevehuang has joined #openstack-ironic15:44
dtantsuragordeev, I've added tests to https://review.openstack.org/#/c/84497/ as you requested :)15:45
russell_hagordeev: oh, you answered this in your commit message, nevermind15:47
devanandalucasagomes: not sure where it's coming from (possibly something I did wrong) but testing of the MP branch, i'm getting an instance with disk specs != the nova flavor15:50
lucasagomesdevananda, scheduling problem?15:51
lucasagomesdevananda, are the exact match filters enabled?15:51
devanandalucasagomes: there's only 1 node enrolledin ironic, and only one flavor in nova15:52
*** mdickson has joined #openstack-ironic15:52
*** eghobo has joined #openstack-ironic15:52
devanandalucasagomes: ah, this might be the "it creates 1GB of swap no matter what" thing?15:52
devanandalucasagomes: though i didnt know we had such a thing15:53
lucasagomesit creates 1mb swap no matter what15:53
devananda/dev/vda2       1305+   1305-      1-      1024   82  Linux swap / Solaris15:53
devanandathat's not 1mb15:53
openstackgerritAleksandr Gordeev proposed a change to openstack/ironic-python-agent: Add FlowExtension  https://review.openstack.org/8541215:54
openstackgerritAleksandr Gordeev proposed a change to openstack/ironic-python-agent: Resolve circular import, introduce ExecuteCommandMixin  https://review.openstack.org/8634115:54
devanandawait, yes it is15:54
devanandanvm :)15:54
lucasagomesheh15:54
yuriyzlucasagomes, please look at https://review.openstack.org/#/c/85086/ I want try +2 :)15:55
lucasagomesyeah check the size unit of that output15:55
lucasagomesyuriyz, hah ack will do15:55
lucasagomesyuriyz, cheers for the suggestion I will fix it quickly15:55
devanandalucasagomes: so sfdisk -u option isn't working in cirros ...15:55
lucasagomesdevananda, I think cirros uses busybox15:56
lucasagomesso it's kinda limited types of commands15:56
lucasagomesnot sure15:56
openstackgerritAleksandr Gordeev proposed a change to openstack/ironic-python-agent: Add FlowExtension  https://review.openstack.org/8541215:56
openstackgerritAleksandr Gordeev proposed a change to openstack/ironic-python-agent: Resolve circular import, introduce ExecuteCommandMixin  https://review.openstack.org/8634115:56
lucasagomesbtw, yuriyz rloo Haomeng, congrats!15:56
lucasagomesgreat to have you guys in the core team :)15:56
yuriyzthanks15:56
rloothx lucasagomes!15:56
devanandasfdisk -u M -s /dev/vda215:56
devananda102415:56
devanandathat's really blocks, not MB15:57
devanandaheh15:57
devanandaok, mystery solved15:57
lucasagomes:D15:57
*** vkozhukalov has quit IRC15:58
NobodyCamlol still no debug logging grrrrrrrr :-p15:59
*** datajerk has quit IRC16:00
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: JsonPatch add operation on existing property  https://review.openstack.org/8508616:02
lucasagomesyuriyz, ^ here it go :D fixed and rebased16:02
NobodyCamhuh... Can not change instance association while node 172834f2-95a6-4658-9f97-2884c3281ba6 is in power state power on.16:04
devanandalucasagomes: http://paste.openstack.org/show/75429/16:06
NobodyCamok now I really need to see what up. lucasagomes question this https://review.openstack.org/#/c/85529/5/ironic/conductor/manager.py should power off a node if its on when it added?16:06
NobodyCamdevananda: also ^^^16:06
devanandaNobodyCam: hmm, interesting question. if we add a node, which is ON, and the conductor discovers that, which it should, we should still be able to manually power it off16:07
devanandaNobodyCam: try ironic node-set-power-state UUID off16:07
NobodyCamthis is in the gate tests16:07
devanandaNobodyCam: i dont thin that should be automatic16:07
* lucasagomes looking16:07
devanandaNobodyCam: yea, i get that tripleo leaves things running between tests - -to me, that's a bug in tripleo16:08
devanandaNobodyCam: it's starting each round of tests in a dirty environment16:08
NobodyCamya... ok I'll dig in when I get back16:08
devanandaNobodyCam: and then not handling the situation it created. that's not a bug in ironic - -it's a deficiency in the test tooling that can't handle the situation it is creating16:08
devanandalifeless: ^ thoughts?16:08
lucasagomeshmm the seed vm depploys the undercloud and then tear it down16:09
lucasagomesI mean at least it should turn it off16:09
lucasagomesafter the tests16:09
*** datajerk has joined #openstack-ironic16:10
lucasagomesunless we have a periodic task in Ironic that would turn the node off if it's not deployed or not in maintenance mode16:10
devanandalucasagomes: we have sync power state16:11
devanandabut the issue is that on the next run of seed, the node is still powered on but has no prior state in the DB16:11
devanandaso when it is first covered by the sync power state periodic task, its state is recorded in the db for the first time16:11
lucasagomesdevananda, thats ur cirros image?16:12
devanandathat patch is proposing that any node without a prior known state should be forced OFF, which I disagree with16:12
devanandalucasagomes: yea16:12
devanandalucasagomes: that paste is weird, no?16:12
lucasagomesdevananda, yeah I think it's a tripleo problem as well, it's not turning the nodes off after the tests16:12
lucasagomesas I think it should16:12
devanandalucasagomes: i deployed cirros to a VM with the default flavor, then deleted the instance, changed the flavor, and deployed a new instance16:12
devanandalucasagomes: to see what parted would do16:12
devanandaold flavor: root:10, swap:null, eph:null16:13
lucasagomesdevananda, right, yeah looks a bit misaligned16:13
devanandanew flavor: root:5gb, swap:2mb, eph:1gb16:13
lucasagomesdevananda, I can't see the ephemeral there tho16:13
devanandaright16:14
lucasagomesohhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh I see16:14
lucasagomesthe driver is not passing the ephemeral to ironic16:14
lucasagomesjust like it wasn't passing the swap16:14
* lucasagomes checks the maps16:14
devanandaah16:14
lucasagomeshttps://github.com/openstack/ironic/blob/master/ironic/nova/virt/ironic/ironic_driver_fields.py16:15
*** lsmola has quit IRC16:15
lucasagomesno ephemeral16:15
devanandalucasagomes: yep. no ephemeral in driver_info16:15
lucasagomesdevananda, you can set it directly in ironic to test16:15
lucasagomespxe_ephemeral_gb and pxe_ephemeral_format16:15
lucasagomespxe_ephemeral_gb=1 pxe_ephemeral_format=ext416:16
lucasagomesfor e.g16:16
*** martyntaylor has quit IRC16:16
lucasagomesif u want to preserve it accross deployments u can do a pxe_preserve_ephemeral=true16:16
lucasagomesok lemme fix it in the driver and test passing ephemeral16:16
lucasagomesI always test it but my scripts are adding it to ironic directly16:16
lucasagomes:(16:17
lifelessdevananda: ?16:17
devanandalifeless: hi! was pinging you re: tripleo undercloud failure due to nodes being left powered on between test runs16:17
devanandalifeless: NobodyCam posted a potential fix that would cause ironic to force newly enrolled nodes OFF, rather than discovering their actual state, which I don't think we should do16:18
lifelessdevananda: we power them off at the strt of the run16:19
devanandalucasagomes: seems like we're really pushing this feature far too late, yanno?16:19
lifelessdevananda: but I like nobodycams patch16:19
lucasagomesdevananda, :(16:19
lucasagomesdevananda, yeah16:19
lifelessdevananda: I was given a rack to bring up in useast; all the machines were on.16:20
lifelessdevananda: I had to write a script to power them off16:20
lifelessdevananda: btw powering them off is consistent with the power discussion we had a week or two back which was:16:20
lifeless - if there is an instance, nova determines desired state16:20
lifeless - if the node is in maintenance, admin determines desired state16:20
*** datajerk has quit IRC16:21
lifeless - if ironic wants the node on (e.g. to inventory) then its on16:21
lifeless - otherwise it is off16:21
lifelessdevananda: unless you're proposing create-node should create it in mainenance by default16:21
lucasagomesoh no... lifeless I think it's fine to the auto-discovery to create it in maintenance mode, but it shouldn't be the default behavior for node-create16:22
lifelesslucasagomes: I don't either :)16:22
lifelessNobodyCam: see tripleo-incubator/scripts/boot-seed-vm line 14616:23
*** lazy_prince has joined #openstack-ironic16:25
devanandalifeless: hm. right. so i'm thinking of the situation where an admin enrolls a bunch of nodes by eg. digestign a factory manifest, and the nodes suddenly power off16:25
devanandalifeless: without any log message or notice16:26
*** lazy_prince is now known as killer_prince16:26
lifelessdevananda: and the admin goes 'fuck yeah, automation'16:26
devanandalifeless: heh16:26
jrollheh16:27
jrolland then /b 1216:27
jrolloops >.>16:28
lucasagomesdevananda, force_power_state_during_sync could be disabled if the admins want16:29
lucasagomesso it won't try to power off/on the node16:29
lucasagomeswill update the db with the current state instead16:29
devanandalifeless: following this a step further, ironic should then refuse to turn on a node that is not either assoiated to an instance or in maintenance mode?16:31
devananda*do you think that16:31
lifelessdevananda: or being turned on by ironic itself16:31
lifelessdevananda: e.g. to inventory/firmware/whatever16:31
devanandaright -- for internal reasons, eg. discovery16:31
lifelessdevananda: and yes, I d othink that16:31
devanandaeg, right now, a user can simply say "ironic node-set-power-state UUID on"16:31
devanandak16:31
lifelessdevananda: I hadn't realised I thought that until you pointed it out :)16:32
lifelessbut you can't turn on a libvirt domain that doesn't exist :)16:32
lifelessdevananda: you *could* make node-set-power-state UUID on set maintenance mode on automatically16:32
devanandait's the conclusion of this approach. ironic pwns your hardware and you can't turn it on unless $things16:32
russell_hagordeev: could you pass the extension manager into the constructor?16:34
*** datajerk has joined #openstack-ironic16:34
* russell_h is on his phone on a train, will be available for real in 20m16:35
*** killer_prince has quit IRC16:37
*** shausy has joined #openstack-ironic16:39
*** martyntaylor has joined #openstack-ironic16:40
JayFWhat about for people who want nodes power state to remain on in order to facilitate quick deployment?16:40
JayFFor example, we wanted to have the agent idle waiting for deploy requests so it didn't take two full power cycles to deploy a workload to a piece of metal16:40
JayFIt seems like an always-off-by-default approach would prevent that?16:40
*** vkozhukalov has joined #openstack-ironic16:41
jrollJayF: I still (think) I agree that when a node is first registered with ironic, it should be powered off16:42
*** ndipanov has quit IRC16:42
jrollJayF: and I'm looking into working around the other bits like "node needs to be off to kick a deploy"16:43
JayFCool, that obliterates my concern16:43
jroll:)16:43
*** overlayer has joined #openstack-ironic16:48
*** harlowja_away is now known as harlowja16:49
*** overlayer has quit IRC16:50
*** yuriyz has quit IRC16:52
devanandalucasagomes: even after delete & recreate with the same (second) flavor, it's still got CHS mismatch16:53
lucasagomesdevananda, yeah it will create the partitions on the same offset.. hmm wondering if it's the optimal option that is causing it16:54
lucasagomesparted -a optimal16:54
lucasagomesdevananda, what's the output of the sfdisk -d /dev/vda?16:57
lucasagomeswould be nice to see the parted /dev/vda print as well but I think there's no parted on cirros16:59
devanandalucasagomes: http://paste.openstack.org/show/75433/16:59
devanandayea, no parted16:59
*** Alexei_987 has quit IRC17:02
*** lazy_prince has joined #openstack-ironic17:03
russell_hagordeev: so IRC on phones sucks. Not sure if what I said came through, could we instantiate the appropriate extension manager and pass it in to the constructor?17:03
russell_hinstantiate it prior to calling the constructor that is17:03
*** lazy_prince is now known as killer_prince17:04
*** epim has joined #openstack-ironic17:06
lucasagomesdevananda, the fdisk -l seems pretty clear... idk if that alignment is harmful or not17:07
lucasagomesbut maybe we should use -a cylinder instead of -a optimal17:07
lucasagomesto round it to cylinders17:07
devanandalemme patch that and try17:07
lucasagomesdevananda, ack17:07
lucasagomesthanks17:07
* devananda gets food and moves outside17:09
*** derekh has quit IRC17:10
*** jistr has quit IRC17:13
*** athomas has quit IRC17:16
*** coolsvap is now known as coolsvap|afk17:18
devanandalucasagomes: didn't fix it. here's the cmd run: parted -a cylinder -s /dev/disk/by-path/ip-10.0.0.8:3260-iscsi-iqn-33cf7940-17:20
devananda75f5-4dde-b940-17b7d58b32bf-lun-1 -- mklabel msdos unit MiB mkpart primary  1 5121 mkpart primary linux-swap 5121 512317:21
*** pradipta_away is now known as pradipta17:21
devanandathough the result is slightly different17:22
*** dwalleck has joined #openstack-ironic17:23
lucasagomesdevananda, right I got dig more into it17:23
devanandai'm not sure what problems this may cause17:24
lucasagomesyeah, that's my concern as well17:24
lucasagomesthere's no overlap on the partitions which is good17:24
lucasagomesmissaligment can affect performance17:24
*** athomas has joined #openstack-ironic17:27
*** dwalleck has quit IRC17:27
*** overlayer has joined #openstack-ironic17:30
*** eguz has joined #openstack-ironic17:32
devanandacomstud: hi! are you going to follow up on rloo's suggestion on https://review.openstack.org/#/c/84822/1/ironic/api/controllers/v1/node.py ?17:34
devanandacomstud: i'm fine merging this, just dont want the suggestion to get lost17:35
*** epim has quit IRC17:36
*** eghobo has quit IRC17:36
openstackgerritJim Rollenhagen proposed a change to openstack/ironic: Add lookup method to vendor mapping  https://review.openstack.org/8640217:36
*** martyntaylor has left #openstack-ironic17:38
*** shausy has quit IRC17:40
*** shausy has joined #openstack-ironic17:40
openstackgerritA change was merged to openstack/ironic: JsonPatch add operation on existing property  https://review.openstack.org/8508617:45
*** overlayer has quit IRC17:47
Shrewsrloo: ping17:48
rloohi Shrews17:48
Shrewsrloo: hi! quick question on your review 8510717:49
Shrewsrloo: there are several instances where you use 'ironic' rather than 'Ironic' when referring to the service (e.g.: 'ironic endpoint'). is that on purpose?17:49
rlooShrews. you caught me. Well, not really on purpose. I can't remember when to use which.17:50
devanandacomstud: looks like 84573 needs a rebase17:50
rlooShrews. there is docn somewhere I believe, about when to capitalize.17:50
rlooShrews. do you know?17:50
Shrewsrloo: My personal opinion is that we should capitalize always when referring to the service itself.17:51
devanandacomstud: actually, it's a real pep8 error. and i suspect it'll need a rebase too17:51
rlooShrews. ok. let me see if I can find the docn on it.17:51
lucasagomesright I'm done for the day have a good night everyone17:51
lucasagomesdevananda, I will investigate more tomorrow17:51
devanandalucasagomes: fwiw, the CHS offset issue isn't present when using sfdisk17:52
lucasagomesdevananda, but I couldn't find anything really relevant to say it's harmful17:52
lucasagomesdevananda, yeah tried that as well17:52
lucasagomesbut it fails if you try to partition with the same inputs you had there17:52
devanandalucasagomes: yea. swap = 2mb kills it17:53
devanandaheh17:53
rlooShrews: https://wiki.openstack.org/wiki/Documentation/Conventions#Service_and_project_names17:53
devanandalucasagomes: seems like it fails with swap > 1024 sectors, not 1024 MB17:53
lucasagomesdevananda, http://paste.openstack.org/show/75437/17:53
lucasagomesyeah17:53
lucasagomesso sfdisk is doing something wrong I just can't figure out why17:53
rlooShrews: My eyes glaze over reading "Generally the capitalization of the project team names like swift is lowercase. When used as a command-line-client name, lowercase is best. When used for the team or project name, typically it's not necessary to capitalize. "17:54
lucasagomesdevananda, good reading http://www.ibm.com/developerworks/linux/library/l-4kb-sector-disks/17:54
Shrewsrloo: interesting! thanks for that. apparently my preference contradicts the standard   :)17:55
lucasagomesdevananda, so, idk the misalignment that sfdisk is showing might impact in performance but I think it's not a problem17:55
devanandalucasagomes: yes, a lot of the perf tuning I did while at percona was based on disk sector size and offset alignment17:55
rlooShrews: I don't actually know if those conventions apply to developer docn ;)17:55
lucasagomesdevananda, yeah17:55
lucasagomesdevananda, also, partioning with >=8GB seems to not cause that misaligment showed by sfdisk17:56
lucasagomessudo parted -a cylinder -s /dev/vdb -- mklabel msdos unit MiB mkpart primary  1 $((5*1024+1)) mkpart primary linux-swap $((5*1024+1)) $((5*1024+3)17:56
lucasagomes5 is the number of GB17:56
openstackgerritRussell Haering proposed a change to openstack/ironic: Version agent lookup payloads  https://review.openstack.org/8522817:56
JoshNanghey guys, how do i run the tests for the nova driver?17:56
*** epim has joined #openstack-ironic17:57
*** epim has quit IRC17:57
lucasagomesdevananda, I will investigate it more tomorrow17:58
*** lucasagomes is now known as lucas-dinner17:58
lucas-dinnernight devananda NobodyCam rloo JoshNang Shrews etc...17:58
JoshNangg'night lucas-dinner!17:58
devanandalucasagomes: g'night! i'll keep looking into it as i also dig through the review backlog :)17:59
rloog'night lucas-dinner!17:59
lucas-dinnerdevananda, ack, thanks! lemme know by gtalk or email if you find something so I can continue in the morning17:59
ShrewsJoshNang: they should run automatically under the py26 and py27 tests now17:59
Shrewslucas-dinner: night!18:00
*** datajerk has quit IRC18:00
JoshNangShrews: was that a recent (last couple days) change? i have a test that's first line is "raise Exception()" but passes all tests18:00
ShrewsJoshNang: yes, very recent18:00
JoshNangkk thanks!18:00
*** epim has joined #openstack-ironic18:02
rloodevananda: fyi, this *should* fix the ironicclient docn: https://review.openstack.org/#/c/86390/18:03
*** datajerk has joined #openstack-ironic18:03
devanandarloo: nice cleanup of the layout.yaml section18:11
devanandarloo: while you're touching that, what do you think about template "name: check-requirements" ?18:12
rloodevananda: thx. btw, do you know what the check-requirements does? I noticed that ironic had it, but was too lazy to look into it.18:12
rloodevananda: i was just going to ask you about that.18:12
devanandaheh18:12
rloodevananda. so I should, or you are asking me if I know whether we should or not?18:13
devanandarloo: i believe it should be there18:13
devanandarloo: it enforces common versions of things in rquirements.txt18:14
devanandaand test-requirements.txt18:14
rloodevananda: ok then, I'll add it in to the same review.18:14
devanandathanks!18:14
devanandaJoshNang: you probably need to invoke the test suite with "tox -epy27", from outside the venv18:15
devanandaJoshNang: or if you want to run just the nova unit tests, do what tox is doing directly...18:15
devanandasomething like   bash -c "TESTS_DIR=./ironic/nova/tests/ python setup.py testr --slowest --testr-args='{posargs}'"18:15
JoshNangdevananda: thanks! not sure why it wasn't work yesterday. heh i never run it inside a venv...it usually decided to rebuild the venv first then18:16
devananda(but just running tox is better)18:16
devanandayea18:17
*** Mikhail_D_ltp has joined #openstack-ironic18:19
openstackgerritJosh Gachnang proposed a change to openstack/ironic: Adding a reference driver for the agent  https://review.openstack.org/8479518:22
openstackgerritJim Rollenhagen proposed a change to openstack/ironic: Add lookup method to agent vendor mappings  https://review.openstack.org/8640218:31
openstackgerritJim Rollenhagen proposed a change to openstack/ironic: Add lookup method to agent vendor mappings  https://review.openstack.org/8640218:33
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Use configurable driver name in lookup URL.  https://review.openstack.org/8620118:34
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Use configurable driver name in lookup URL.  https://review.openstack.org/8620118:35
rlooIn Monday's meeting, someone was asking about devstack/ironic/fedora? Here's the etherpad I mentioned: https://etherpad.openstack.org/p/jjWcLDThTK18:37
rloobut I don't recall who wrote it and I don't know how up-to-date it is.18:38
*** max_lobur1 has quit IRC18:42
openstackgerritA change was merged to openstack/ironic: Fix self.fields on API Node object  https://review.openstack.org/8482218:44
openstackgerritJim Rollenhagen proposed a change to openstack/ironic: Add version 1 of agent payload  https://review.openstack.org/8617318:48
openstackgerritA change was merged to openstack/ironic: Sync base object code with Nova's  https://review.openstack.org/8485918:49
*** datajerk has quit IRC18:50
*** epim has quit IRC18:55
*** epim has joined #openstack-ironic18:59
*** pradipta is now known as pradipta_away19:05
*** epim has quit IRC19:05
*** shausy has quit IRC19:10
NobodyCamme is almost back19:12
openstackgerritJarrod Johnson proposed a change to stackforge/pyghmi: Allow pyghmi to send break over IPMI SOL  https://review.openstack.org/8642519:13
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Use configurable driver name in lookup URL  https://review.openstack.org/8620119:17
NobodyCamlifeless: line 146 is "fi" ????19:18
openstackgerritJarrod Johnson proposed a change to stackforge/pyghmi: Allow pyghmi to send break over IPMI SOL  https://review.openstack.org/8642519:20
*** derekh has joined #openstack-ironic19:29
*** epim has joined #openstack-ironic19:29
openstackgerritA change was merged to stackforge/pyghmi: Allow pyghmi to send break over IPMI SOL  https://review.openstack.org/8642519:31
*** openstackgerrit has quit IRC19:34
*** datajerk has joined #openstack-ironic19:36
*** Mikhail_D_ltp has left #openstack-ironic19:36
russell_hagordeev: I think we can probably drop the command_name thing19:36
russell_hagordeev: at one point we were constructing the command result object inside the actual handler, so we needed the name19:37
russell_hI'm not sure if we still do that anywhere19:37
devanandaShrews: this - return self._multi_getattr(client, method)(*args) - do you think it may obfuscate dependency issues if/when the ironicclient library changes?19:37
russell_hagordeev: yeah, pretty sure that can go, the async_command decorator has obviated the need for it19:38
devanandaShrews: eg, it'll raise AttributeError, but that's not handled anywhere afaict19:38
russell_hagordeev: wait, wrong guy, sorry19:39
Shrewsdevananda: if it raises that exception, then either it's a programmer error (that should never be merged) or the api has changed in an incompatible way19:40
Shrewsdevananda: i'm not crazy about the whole using-strings-for-the-call thing either, but it's what nova does. i can't come up with a better way19:40
devanandaShrews: heh19:41
russell_hvkozhukalov: ^ see what I was saying to agordeev, that was meant for you19:41
comstuddevananda: ok. ya, i have some follow up stuff, I need to push new versions for them all19:41
lifelessNobodyCam: yes, but look at the code block :)19:42
*** openstackgerrit has joined #openstack-ironic19:42
devanandaShrews: so "api has changed in an incompatible way" -- why we'll eventually need upgrade testing, too19:43
NobodyCamlifeless: yes. we looking at that19:43
lifelessNobodyCam: it turns off the instances, no ? OH - I see, we don't for ironic. right, because Ironic is meant to ;)19:43
devanandalifeless: re the sfdisk/parted discussion, if you have a moment, does http://paste.openstack.org/show/75433/ raise any red flags for you?19:44
devanandalifeless: i'm curious what your take on the CHS mismatch is19:45
vkozhukalovrussell_h: no, I don't think so, it is certainly not for me, I just suggested how we can deal with uninitialized ext_mgr19:46
NobodyCamdevananda: I see your comments on the fix undercloud patch.. if I read correctly you are okay with the power off if it is logged? (i was planning to remove all the debug stuff from the patch)19:46
*** max_lobur has joined #openstack-ironic19:46
russell_hvkozhukalov: I must be totally losing it :)19:47
russell_hvkozhukalov: wait, I'm still sane. Maybe. I'm talking about this: https://review.openstack.org/#/c/85412/7/ironic_python_agent/flow.py,unified19:47
vkozhukalovrussell_h: ahh, yes. I just saw that my Pycharm fades this argument 'command_name' in all methods where it appears19:49
devanandaNobodyCam: yes. it's a reasonable option to enable, but needs to be clearly doc'd (both in the option string and in our eventual deployer docs) and logged19:49
vkozhukalovrussell_h: so, it seems not to be needed at all19:50
devanandaNobodyCam: it'd be helpful to also stick a DocImpact flag in the commit message19:50
devanandaNobodyCam: so we can start grepping our git logs for things that need to be called out at release doc time19:50
NobodyCamdevananda: ack let me rework that patch19:51
russell_hvkozhukalov: right, before we had this decorator we had to construct some object inside those methods which needed the command name19:51
russell_hvkozhukalov: we kept it in the signature for consistency, but IMO we can kill it now19:51
russell_hvkozhukalov: I'll reply to the change19:51
vkozhukalovrussell_h: thx19:52
lifelessdevananda: CHS?19:53
lifelessdevananda: you know thats entirely legacy these days right?19:54
lifelessdevananda: oh, I see the errors19:54
lifelessdevananda: yes, badish partition table19:54
devanandalifeless: clearly, it's a VM i'm working with. but that :)19:54
devanandaso this is easy to reproduce with lucas' parted patch by simply deploying again to a node, with a flavor that has a different root_gb than the previos instance19:55
lifelesshahaha :(. parted.19:56
devanandaright19:56
devanandalifeless: in tjhe tripleoci cloud, are you creating any instances with nova-bm that have non-zero swap partitions?20:00
devanandalifeless: cause i dont see any diference in the sfdisk cmds for novabm and ironic, which suggests that https://bugs.launchpad.net/ironic/+bug/1297925 should apply to nova too20:00
lifelessdevananda: it does, and we're not.20:02
devananda:(20:03
lifelessfrankly I'd just list it as a known defect and focus on other stuff :)20:03
devanandai had hoped this patch fixed it, which would have been nice ...20:03
devanandabut now i suspect this issue with parted applies to all of lucas' parted work on master, too, not just the backport20:04
devanandaso, yea20:04
lifelessI missed 'partition twice' as a test fo rthe test matric.20:05
lifelessdammit20:05
*** eguz has quit IRC20:07
*** eghobo has joined #openstack-ironic20:07
devananda?20:08
lifelessdevananda: when I reviewed the parted patch20:08
devanandaah20:08
devanandaheh20:08
lifelessI described a test matrix we needed20:08
lifelessI didn't think to say 'oh and make sure it edits correctly'20:08
lifelessbecause we're not *meant* to be editing20:08
devananda+ partition again with a different partition table20:08
devanandawell, it doesn't need to "edit" -- it should erase & create new20:09
devanandabut it should do that without errors20:09
lifelessright20:09
devanandawhich it doesn't :(20:09
openstackgerritRuby Loo proposed a change to openstack/python-ironicclient: Documentation for contributors  https://review.openstack.org/8509620:11
russell_hjroll: https://review.openstack.org/#/c/85228/20:11
* jroll looks20:14
jrolllgtm20:15
*** openstackstatus has quit IRC20:15
*** openstackstatus has joined #openstack-ironic20:16
*** athomas has quit IRC20:23
*** romcheg has quit IRC20:31
*** epim has quit IRC20:32
*** harlowja is now known as harlowja_away20:36
devanandaanyone else care to give https://review.openstack.org/#/c/84497/ a review?20:36
devanandabackport potential, fixes an issue where you cant delete a nova instance that previously failed to deploy20:37
jrolloh hey, I have that issue20:39
* jroll takes a look20:39
openstackgerritJosh Gachnang proposed a change to openstack/ironic: Adding swift temp url support  https://review.openstack.org/8139120:44
*** max_lobur1 has joined #openstack-ironic20:46
*** max_lobur has quit IRC20:47
devanandalol. just spotted this: man sfdisk ...  BUGS: there are too many options.20:48
openstackgerritChris Krelle proposed a change to openstack/ironic: Fix for tripleO undercloud gate tests  https://review.openstack.org/8552920:49
*** romcheg has joined #openstack-ironic20:49
*** linggao has quit IRC20:50
*** jistr has joined #openstack-ironic20:50
NobodyCamdevananda: how the log message look in manager.. also changes help string and added DocImpact20:53
*** jdob has quit IRC20:54
*** harlowja_away is now known as harlowja20:55
*** mrda_away is now known as mrda20:55
NobodyCammorning mrda :-p20:55
openstackgerritVladimir Kozhukalov proposed a change to openstack/ironic-python-agent: Added lvm partitioner  https://review.openstack.org/8567220:56
mrdaMorning NobodyCam20:57
mrdaand everyone else :)20:57
devanandaNobodyCam: help string is better. but the log is not doing what I suggested // think it should20:58
*** BadCub01 has joined #openstack-ironic20:58
devanandaNobodyCam: do you see any reason not to log a different message based on whether force-node-power-state is set?20:58
NobodyCamI wrote that like tree times and it just didn't look right to me20:59
devanandavkozhukalov: lvm in the agent? jroll ??20:59
NobodyCamthree even21:00
devanandamaybe my surprise is a surprise to you, but managing LVM seems to be stepping outside of "provisioning"21:00
devanandaand into the responsibilities of the tenant21:00
jrolldevananda: hey21:01
*** jistr has quit IRC21:01
*** epim has joined #openstack-ironic21:01
NobodyCamI can make the log different based on force_power_state_during_sync21:01
jrolldevananda: does nova allow for things like this? (thinking no)21:01
openstackgerritVladimir Kozhukalov proposed a change to openstack/ironic-python-agent: Added disk partitioner  https://review.openstack.org/8616321:01
jrolldevananda: I can see it *almost* fitting but I'm not sure21:01
devanandajroll: i believe nova uses lvm to provide functionality outside of an instance (eg, instance snapshotting)21:04
devanandajroll: but it's not mucking around inside the instance with lvm21:04
vkozhukalovdevananda: why not? what if I want image to be copied on lv partition not on a plain one?21:04
jrolldevananda: ok, hmm21:05
*** derekh has quit IRC21:05
devanandaside note, are you guys using """ for file headers instead of # ???21:09
devanandaeg, https://review.openstack.org/#/c/86163/3/ironic_python_agent/disk_partitioner.py21:09
devanandawont that show up in the doc builds, which you *dont* want?21:10
openstackgerritChris Krelle proposed a change to openstack/ironic: Fix for tripleO undercloud gate tests  https://review.openstack.org/8552921:10
jrollso, we originally used """21:10
NobodyCamdevananda: ^^??21:10
jrollwe've been (slowly) moving away from that21:10
jrollI thought we got rid of them but /me will doublecheck21:10
JoshNangthere's probably still a few21:10
devanandaright, so vkozhukalov's patches are adding more21:11
devanandai just commented21:11
jrolloh wow, there's still plenty in the agent21:11
devanandaheh21:11
jrollI'll take care of that21:11
devanandaso yea, ya'll should move away from that, and add some sphinx docs too :)21:11
devananda(eventually)21:12
jrollindeed21:12
*** eghobo has quit IRC21:12
NobodyCamdoh21:12
jbjohnso_woo I can send break like crazy from CLI now21:13
openstackgerritChris Krelle proposed a change to openstack/ironic: Fix for tripleO undercloud gate tests  https://review.openstack.org/8552921:13
jbjohnso_one day I'll get up the bother to bestow that gift unto the javascript client somehow21:13
NobodyCamjbjohnso_: sounds like a dos attack waiting to happen21:13
NobodyCamlol21:13
jbjohnso_NobodyCam, I mean 'send break'21:13
vkozhukalovdevananda: so, what about lvm? I think it is critical for us to have lvm and md functionality in the agent21:14
jbjohnso_NobodyCam, aka 'hurray, a way to request a stack trace from moderately hung kernel'21:14
devanandavkozhukalov: how will the partition type (lv, msdos, gpt, etc) be determined?21:14
*** openstackstatus has quit IRC21:14
jbjohnso_devananda, fyi, there is something of a scary bomb in the TianoCore EFI implementation with respect to partition tables21:15
jbjohnso_devananda, if something that is GPT today gets touched by something that isn't GPT but yet doesn't *completely* eradicate all bits of the GPT MBR...21:15
jbjohnso_devananda, TianoCore helpfully decides 'oh, you must not have meant that, here, let me overwrite your superblock with a GPT'21:16
russell_hdevananda: vkozhukalov: IMO we need to standardize a deploy api ASAP21:16
jbjohnso_hilarity ensues21:16
russell_htoday the API is something like "lol ask the driver"21:16
vkozhukalovdevananda: it should be completely data driven (json)21:16
russell_hwhich pushes these sorts of questions down to the implementation21:17
devanandaNobodyCam: better. one nit, commented21:17
NobodyCam:)21:17
jrolldevananda: no copyright on empty files, right?21:17
devanandajroll: right21:18
jrollthanks21:18
vkozhukalovrussell_h: yes, it should be like "lol ask the driver", i believe everyone wants to have their own deployment scenario, that is why agordeev is working on flow driver21:18
jbjohnso_empty files are precious intellectual property21:18
devanandarussell_h: demonstrate the API, at the very least21:18
devanandarussell_h: doubtless it'll take at least a little time for folks to hammer on it and figure out how things fit into it21:19
NobodyCamahh good catch fixing now21:19
devanandarussell_h: as there are multiple use cases for the agent21:19
openstackgerritVladimir Kozhukalov proposed a change to openstack/ironic-python-agent: Added disk partitioner  https://review.openstack.org/8616321:19
*** openstackstatus has joined #openstack-ironic21:22
russell_hvkozhukalov: I've been led to believe that the broader openstack community isn't going to be very receptive to having drivers expose different APIs21:22
devanandajroll: now taht instance_info is available in ironic, plans to migrate nova.virt.ironic and ironic.drivers.modules.pxe to use it?21:23
*** jbjohnso_ has quit IRC21:23
devanandajroll: also, https://review.openstack.org/#/c/85131/2 looks like it probably depends on other work. is this dependency not strict and therefor not represented in gerrit?21:23
russell_hvkozhukalov: for example, Nova doesn't have different APIs for different virt drivers21:24
russell_hvkozhukalov: it abstracts the problem such that many drivers can implement the same API21:24
*** romcheg has quit IRC21:25
devanandarussell_h: exactly21:25
*** epim has quit IRC21:25
jrolldevananda: yes, I can migrate those21:25
jrolldevananda: on that review, things won't break if the agent driver doesn't exist21:25
jrolldevananda: if that's what you mean by "not strict"21:26
devanandawhether partitioning is done by software in the agent (lvm, parted, etc) or in the PXE driver (over an iSCSI conenction) or out-of-band (eg, via some iLO magic) or what ever... the API neesd to be the same21:26
*** notq has quit IRC21:26
devanandajroll: exactly. ok. but for things that don't make sense in isolation (eg, there are a bunch of related but not linearly-dependent patches) could you21:27
JoshNanganyone run into the doc gate check quitting with "IOError: [Errno 28] No space left on device"? http://logs.openstack.org/91/81391/9/check/gate-ironic-docs/e4b16d4/console.html21:27
vkozhukalovrussell_h: I did not mean we can have different APIs for drivers, well defined API does not contradict with sending many different parameters to many different drivers21:27
devanandajroll: tag the later ones as WIP, with a comment pointing to the earlier ones?21:27
devanandajroll: that'll help me when i'm reviewing to find the head of the changesets21:27
devanandajroll: also using a consistent topic is really great21:27
devanandaeg, i can search for related patches like this: https://review.openstack.org/#/q/status:open+project:openstack/ironic+branch:master+topic:add-agent-virt-fields,n,z21:28
vkozhukalovrussell_h: I mean POST + json, that is exactly what we disscussed in sunnyvale21:28
devanandaif they all have the same topic, it's super helpful21:28
devanandavkozhukalov: sure it does. if the client has to send different parameters based on the back-end impilementation, the abstraction is lost21:28
devanandavkozhukalov: imagine if you had to issue a completely different set of aprameters to "nova boot" if the back end was libvirt or xen....21:29
vkozhukalovrussell_h:  good example is patching driver_info in ironic, i can set almost anything there, how does it break the abstract of well defined API?21:30
devanandaJoshNang: nice... just "recheck no bug" on that patachset21:30
devanandavkozhukalov: it does. heh. the whole driver_info usage today is a broken abstraction :)21:30
devanandavkozhukalov: this is why we're movign that to instance_info21:30
JoshNang:) thanks21:31
devanandavkozhukalov: all fields in instance_info will be standardized, and used to determine things like partition layout and size21:31
devanandavkozhukalov: whereas the driver_info should be set only once, by the operator, so that ironic is able to control the hardware21:31
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Use # instead of """ for copyright blocks  https://review.openstack.org/8645521:32
jrolldevananda: sure, do you want me to fix the existing reviews as well?21:34
vkozhukalovdevananda: ok, I see your point. I'll think of it and will suggest something. but what I really need to know right now is - Does having lvm contradicts with ironic at all and it's use cases? I'm asking because it is very very critical for comprehensive deployments21:34
vkozhukalovdevananda: if I can not have lvm in agent, so I doubt if it is useful for me at all.21:35
devanandajroll: if you don't mind, i think that'll help make it a bit clearer to me (and other reviewers)21:36
*** epim has joined #openstack-ironic21:36
jrollsure21:37
devanandajroll: since you have a lot of related patche up, and it's nto clear from gerrit how they're related21:37
jrollyep21:38
jrollnp21:38
devanandavkozhukalov: how do you plan on / need to use lvm?21:38
*** datajerk has quit IRC21:38
devanandavkozhukalov: particularly, after ironic has deployed an instance to a node, why does it matter if it was with lvm or gpt style partition?21:39
openstackgerritChris Krelle proposed a change to openstack/ironic: Fix for tripleO undercloud gate tests  https://review.openstack.org/8552921:40
vkozhukalovdevananda: for example, I want to be able to have huge partition which consists of many hard drives. I use lvm for that.21:40
openstackgerritMichael Davies proposed a change to openstack/ironic: Handling validation in conductor consistently  https://review.openstack.org/8437421:40
*** max_lobur1 has quit IRC21:42
devanandavkozhukalov: some of my concern is that lvm is generally used from *within* a host on an ongoing basis to manage volume groups21:42
devanandavkozhukalov: it's significantly more user-facing than, say, md or MegaRaid, and its use often extends long after provisioning the system is complete21:43
devanandawhereas building the RAID and creating a partition table are clearly prerequisites to putting the OS on it, and part of "provisioning"21:44
devanandamanaing LV groups is not21:44
devananda*managing21:44
* NobodyCam reads MegaRaid and runs to the corner and cowers21:45
devanandavkozhukalov: so how do we separate "build the RAID" from "manage logical volume groups" ?21:45
devanandahaha21:45
*** datajerk has joined #openstack-ironic21:45
NobodyCam:)21:46
devanandasorry, NobodyCam. I had allll kinds of fun doing performance tuning of those cards later ;)21:46
vkozhukalovdevananda: ok, imaging i have 1G 2 hard drives, my OS just won't fit such a small disk, but having lvm allows me to solve this issue21:46
NobodyCam:) i can bet21:46
NobodyCamthou I wouldn't use the excat word "fun"21:47
devanandavkozhukalov: sure. why not use mdadm?21:47
russell_hdevananda: can't images with lvm partitions on them?21:47
russell_her, can't you have21:47
devanandarussell_h: at the moment, ironic only spports partition images21:48
devanandarussell_h: when we haev support for whole disk images, sure, it's possible21:48
devanandarussell_h: actually THAT would be ok, from ironic's POV, since it is just putting the requested image on disk21:49
russell_hright21:49
NobodyCamoh poop.. forgot to regen the conf sample21:49
devanandamy concern is conflating the scope of ironic into user space by saying "we'll create LVM stuff for you. oh, but you're on your own after that, since ironic won't manage the PV/LV groups, snapshots, etc"21:50
*** datajerk has quit IRC21:50
devanandathen we get two more problems21:50
vkozhukalovdevananda: I can't see the difference between lvm and md according to the case when user want to shoot his own leg21:50
devanandauser changes something in the PV, then redeploys their node, but the partition table is different21:50
vkozhukalovdevananda: both those tools are of the same kind21:50
devanandaor, user asks why ironic created an LVM group but then refuses to manage it21:51
devanandavkozhukalov: no, they're not. LVM does *a lot* more than mdadm21:51
devanandaunless mdadm gained a whole lot of features while i wasn't looking21:51
russell_hdevananda: the same is sort of true of mdadm though, right? As far as managing it post-deployment21:51
devanandaactually21:51
russell_hlike Ironic is never going to rebuild your raid21:51
devanandaright21:52
devanandathey're both softwre layer raids21:52
devanandawe can write some aspects of it to the partition table, but if the OS doesn't honor that, what's the point?21:52
vkozhukalovdevananda: ok, should we make filesystem? they also do a lot more than just storing inodes21:52
russell_hI'm not super opinionated on this and I'm all about reducing scope, but I can sort of see an argument for LVM21:52
vkozhukalovdevananda: ok, bad example, filesystem is a part of image21:53
russell_hvkozhukalov: beyond dropping an image onto the node, IMO Ironic shouldn't touch filesystems21:53
jrollJoshNang: can you mark this WIP with a pointer to the dependent patches in a comment? https://review.openstack.org/#/c/84795/21:55
*** epim has quit IRC21:56
JoshNangjroll: yup. didn't realize it lost WIP status with new patch sets21:56
*** datajerk has joined #openstack-ironic21:57
jrolldevananda: once that one is marked, all of the agent-related patches should have dependencies pointed at in the "depends on" section or a WIP comment21:58
devanandaso w.r.t. mdadm, i was thinking initially of "fake raid" systems where there is still hardware assistance in mapping the drives together, but no raid acceleration21:58
devanandai dont see how ironic can deploy any purely software raid solution, without being very tightly coupled to the image that is being deployed21:59
devanandarussell_h: re: "ironic is never going torebuild your raid" -- well. if it's a hardware raid controller, ironic _should_ be able to rebuild it, change raid level, etc22:02
JoshNangbut it wouldn't be able to rebuild a software raid22:03
russell_hdevananda: sure, I meant mdadm22:03
JoshNangheh22:03
russell_hdevananda: but IMO that is OK22:03
russell_hdevananda: like we're dropping an image onto a disk, but that doesn't imply we're going to upgrade packages for you22:04
JayFWe create a starting point for a person/automation to put a workload on the system, and until the tenant gives it back up, it's their responsibility, right?22:04
JayFif that starting point involves LVM, or MD RAID, how does that imply anything different?22:05
russell_hIMO, unless explicitly stated otherwise, it should be implied that between the time a deploy completes and the time you destroy it, Ironic isn't going to manage your server at all22:05
JayFwith maybe the exception that you have to be using an image that supports it22:05
devanandarussell_h: right22:06
devanandaJayF: how is that determined?22:06
JayFdevananda: how is what? if the image supports it?22:06
devanandaJayF: how does ironic know that it should use mdadm, or lvm, or not, for a given image?22:06
devanandaJayF: by comparison, if the hardware has a hw raid card that IPA can configure, and the user has requested (eg, via cinder, or an as-yet-unknown API) that a RAID5 be built, then ironic should do that before putting the image down22:07
devanandaand that RAID is idnependent of the image22:07
devanandabut if I take taht same image, and put it into a partition created on top of LVM, what happens?22:08
devananda(that's sort of not a rhetorical question)22:08
JayFI don't know the direct answer to your question, but there are already implicit requirements in images -- for instance, you can't deploy a RHEL5 image to a machine that has hardware too new for RHEL5 to work -- which is a problem unique to Ironic vs other nova drivers, correct?22:08
devanandaJayF: driver issues are, IMO, fairly well understood -- and addressed by disk-image-builder22:09
JayFIsn't this similarly a driver issue though? In the case of mdadm/lvm, if it's configured properly, the only difference is having the relevant packages installed and baked into the initramfs (which most distros do for you)22:10
JayFI'm just trying to figure out where the line is, and how those problems are already being solved.22:11
devanandawill the system's firstboot / init scripts detect the LV group and configure itself appropriately?22:12
JayFI can't speak for every distribution/image, but generally speaking, yes22:12
devanandamaybe -- i haven't tested it, but that's only half of my concern22:12
devanandathe other half is scope22:12
JayFsame for MD, if the raid has the superblocks configured properly22:12
JayFI don't personally have a desire to do this, just want to understand why not22:13
devanandaLVM, in my experience, is typically managed -- and frequently changed -- post install of the OS22:13
devanandalet's imagine a user does this22:13
JayFHeh. Mine has been actually almost exactly the opposite. It's configured at install time and not touched anymore.22:13
devananda- request node with 1TB disk and a 100GB root partition22:14
devananda- ironic delivers taht22:14
devanandaactually, nvm22:14
devanandathat line breaks down regardless of whether its LVM or something else22:15
JayFI especially don't see the difference between hardware raid vs software raid+lvm22:15
devanandaJayF: how about - i can put a windows image on a hardware raid, but not on a software raid+lvm22:16
JayFThat's a good reason; but what about GPT vs MBR at that point?22:16
JayFhmm. I guess that isn't a valid argument *now* because windows supports both22:17
JayFSo using 'can this work for linux and windows' as a guideline really knocks a few things out of scope, and helps me understand where the line is.22:17
JayFAlthough it's sad to think we'll lose the ability to do some things because Windows can't do it, it's a reasonable place to draw the line. I get it, thanks.22:18
russell_heven if we accept that as where we draw the line right now, we should try to design an API that can be extended to move the line later22:19
devanandaJayF: or how about "do my preprovisioning steps depend on whether it's a RHEL, Debian, or XXX" image?22:19
vkozhukalovdoes nova supports lxc as a hypervisor? does windows supports lxc as a hypervisor?22:19
russell_hlike, I don't think I've ever used hardware RAID in my life22:19
JayFrussell_h: you've used servers that had hardware raid, for sure. I managed them :P22:19
russell_hit'd be a shame for Ironic not to support software raid22:19
devanandarussell_h: that's exactly the point -- you used it transparently.22:20
devanandavkozhukalov: your question doesn't make sense. are you comparing nova to windows?22:20
russell_hJayF: sure, and I regretted everything about that experience ;)22:20
russell_hJayF: except the part where you managed them, of course22:20
JayFhaha22:20
vkozhukalovdevananda: no, I just want to say that it is not a valid argument if windows does not support lvm22:20
russell_hI would have killed to just have generic hardware and software raid22:21
russell_hand not have these clowns trying to pitch me different models of crap at every turn22:21
devanandavkozhukalov: a better argument would be, "if an image can run on nova+kvm, should we assume it will also run on nova+xen"22:22
vkozhukalovdevananda: ok, why not nova+kvm and nova+lxc ?? the same question about comparing nova + kvm and nova + BM.22:23
vkozhukalovdevananda: bm is not a hypervisor, it is a real world22:23
JayFIf you got a Windows image to run in lxc, I'd be really impressed. :P22:23
devanandavkozhukalov: um, I think the same image DOES work for nova+kvm and nova+xen and nova+ironic :)22:24
devanandavkozhukalov: ironic functions very similarly to a hypervisor22:25
devanandavkozhukalov: and it should, IMO, not reach into the user / tenant environment. I know you guys wanted to have an agent always running inside the tenant environment22:26
devanandavkozhukalov: adding LVM support to Ironic and then using an in-guest agent to manage that is really neat stuff22:26
devanandaand I think would be super useful22:26
devanandabut22:26
devanandai think that breaks out of the scope for ironic22:27
devanandaon the other hand, providing software raid AND hardware raid pre-provisioning, underneath a single abstraction22:27
devanandais really an awesome thing22:27
devanandaand maybe within the scope of Ironic ... but it's a slippery slope ...22:27
JayFI think a good middle ground would be yes, but probably not now22:28
devanandahow much does this make ironic depend on the *content* of the image?22:28
vkozhukalovdevananda: ok, I remember you wrote in one of blueprints where we discussed discovering that we can not discovery hardware via IPMI or something like and we need to do that from inside ramdisk OS. do you see the difference? i always can discover Virtual machine configuration outside of it, but it does not work for BM.22:28
JayFdevananda: I'd argue that the hardware /already/ depends on the content of the image.22:28
devanandaJayF: yes, but *ironic* does not22:28
devanandaJayF: the operator knows what hardware they have and provides a reasonable image to ironic that supports (eg has the right drivers) for that hardware22:28
devanandaJayF: ironic doesn't inject new drivers into the image22:29
devananda(yea, someone suggested that a while back)22:29
NobodyCamieek22:29
*** radsy has joined #openstack-ironic22:29
NobodyCamwe should never crack open a image22:29
*** openstack has joined #openstack-ironic22:34
* NobodyCam goes back to reading the scroll back22:34
devanandaJayF: it's possible, with extra image metadata22:34
russell_hdevananda: it seems like almost regardless, if you want to configure RAID, you'd need to either allow the user to pass in some specification or have it hardcoded on a per-hardware basis22:34
JayFdevananda: I don't know -- but I do think it's valuable to reconsider if we should declare s/w raid and lvm out of scope. Although 'later' would be a good answer for me as well :)22:35
*** matty_dubs is now known as matty_dubs|lunch22:35
JayFrussell_h: that's basically what I was thinking, yeah22:35
*** matty_dubs|lunch is now known as matty_dubs|gone22:35
*** datajerk has quit IRC22:35
russell_hdevananda: in either case, as you say, the operator will need to supply an appropriate image22:35
NobodyCamJayF:  russell_h: devananda: we could have unconf talk about it?22:36
jrollreviews already exist in gerrit for this stuff, I'd prefer not to let them hang for over a month22:36
NobodyCamack22:37
devanandaone thing that'll go a long way for me - -demonstrate that the same image works with and without an LVM raid22:38
*** jgrimm has quit IRC22:38
russell_hperhaps vkozhukalov could put up a blueprint describing how this would look to a user22:39
vkozhukalovyes I'll do that22:40
russell_hie, does this require some sort of specification at deploy time, or does the operator need to somehow hardcode RAID configurations22:40
russell_hand if you specify it at deploy time, what does it look like22:40
russell_hincluding both the JSON and considerations about interactions with images22:40
devanandathat ^ goes back to "we need to start spec'ing a common API for all the agent stuffs"22:40
russell_hyeah :)22:40
russell_hI just like looking at JSON22:41
devanandaand that I believe that aPI needs to abstract the particular implementation details22:41
russell_hright22:41
devanandaeg, whether it's hardware or software raid, the user interaction, the nova-> ironic messages, all need to be the same22:41
devanandaas another tangent22:42
devanandaall the performance tuning for AWS users that I did22:42
devanandathey all used RAID on top of EBS22:43
russell_hyeah22:43
devanandanormal workflow: request instance with small root partition. attach larger storage system(s). build LVM on top of that.22:43
devanandaand folks already want to attach cinder volumes to Ironic nodes22:44
devanandaand they will then LVM on top of those22:44
russell_hright, IMO Ironic should focus on the root partition, like I don't want to be raiding together data disks and shit22:44
devanandasure, but22:44
devanandanow teh user has two different tools that create(d) their LVM groups22:44
devanandathus my sense that it's a layer violation22:45
JayFAn LVM group is an LVM group though?22:45
JayFWhat does it matter who or what created them for the root disk vs the data disk[s]?22:45
devanandahow would it look if you requested an AWS instance and it came with an LVM group already?22:45
devanandai'm sort of comparing apples to oranges ... i know ...22:46
JayFIt'd look especially bad because I'd be a Racker using AWS ;)22:46
devanandaJayF: hah!22:46
JayFbut I'd enjoy the ability to call the API for the Rackspace Cloud, request LVM root, and get it22:46
JayFand then would have my OS-level config management setup LVM on the data drive22:46
pquernajust to throw out how i tend to view this as a layering violation22:47
pquernalike, what happens when my OS is windows22:47
pquernais the api going to support its software raiding ntfs stuff?22:47
devananda:)22:47
JayFpquerna: but what if a user wants to automatically deploy images on baremetal on software raid? They just can't? Or is there some other layer that would handle this?22:48
pquernai'm not sure.22:48
pquernai just view doing a 'ton' of things in this space as.... scary.22:48
pquernathere probally is a minimal ammount that is needed22:49
pquernaand maybe some way to make plugins22:49
pquernabut the 'baseline' should stive to be simple22:49
pquernaand maybe that means, root device is just the glance image DD'ed over22:49
pquernathen once the OS boots, it can mess with stuff22:49
pquernanow, that only gets messy if you want a root raid5/10/022:50
pquernaor ZFS or something of that kind22:50
pquernaand LVM22:50
pquernaright, so its a mess22:50
comstudmm zfs, let's do it.22:50
devanandammm, btrfs22:50
pquernaright, and that.22:50
pquernaand windows software raid22:50
pquernaman, thats a big ass matrix already22:50
pquernai'm liking DD to root device only by default :x22:51
devanandaright. so. when the line was "ironic does HARDWARE things", it was much clearer. why aren't we sticking to that again?22:51
comstudi think you build the images how you want them22:51
comstudhave an LVM image if you really want22:51
comstudand a non-LVM image22:51
devanandacause supporting hp, ibm, dell, amd, etc... isn't nearly a complex enough matrix already ;)22:51
pquernaso, the 'line' for hardware in this case, is a way for a plugin, to execute megaraid-blahblah22:52
pquernaas part of its build for a flavor22:52
devanandathe "prepare the hardware to be suitable for this flavor" line22:52
pquernabut all the formatting, expanding of partitions, making /var 10gb instead of 80gb, is up to the image22:52
devanandawhich could include HW raid, change BIOS setting, flash firmware...22:53
pquernaits a bummer about hw raid.22:53
*** datajerk has joined #openstack-ironic22:54
pquernai guess, the one case i'd like to understand is this: would you ever flash firmware differently22:54
pquernabased on the Image ID?22:54
devanandapquerna: the question that vkozhukalov and jayf have raised is, should that plugin to support megaraid also support a plugin for lvm22:54
pquernaor is hw raid just this one exception22:54
devanandapquerna: based on image? no. based on flavor? yes.22:54
pquernaright, based on flavor i'm all in on.22:55
pquernabut based on the image || create params, we are saying, yeah, maybe run megaraid in two possible configs raid10 root or raid5 root, as an example22:55
pquernaare those options of raid5 || raid10 part of the properties of the flavor?22:55
devanandathey could be22:56
pquernaso, maybe its really, flavors can have a couple 'enum' choices22:56
pquernalike,  flavor Blah has disk_layout: raid10,raid522:56
devananda"swift-flavor" might be JBOD. "trove-flavor" might be RAID1022:56
devanandaright22:56
openstackgerritJosh Gachnang proposed a change to openstack/ironic: Add configdrive generation to Nova driver  https://review.openstack.org/8619222:57
openstackgerritJosh Gachnang proposed a change to openstack/ironic: Add agent fields to virt driver  https://review.openstack.org/8513122:57
devanandawell, i was expecting more that a flavor expresses a single set of configs22:57
pquernahmm22:57
pquernai'd expect it would be more like:  big-disk-flavor-type: disk_layout: JBOD|RAID10     .... create(image_id=$swift_image, disk_layout=JBOD)22:58
pquernathen the agent just gets a create like normal, if a plugin is loaded that understands disk_layout for megaraid, it hooks in, executes megaraid22:59
devanandapquerna: the current expectation is that flavor == hardware profile22:59
pquernaright22:59
pquernaah, i see22:59
pquernahrm.22:59
pquernaso a flavor would imply _all_ hw settings23:00
devanandaright23:00
pquernaare you suggesting that you could have multiple flavor..... types on a node?23:00
pquernaand there is a 'change flavor type' command to the agent?23:00
pquerna(just thinking in irc here)23:00
devanandaoh23:00
devanandanot exactly23:00
devanandai'm thinking that multiple flavors could be matched to the same node23:00
devanandaand when the user requests flavor X and image Y, that any available node which _can_ match flavor X is chosen, and udpated if necessary23:01
devanandaand then image Y written to it23:01
devanandawhereas a node N could be matched by flavor A and B, and the difference might be A {'disk layout': JBOD, 'vt': off} and B {'disk layout': RAID10, 'vt': on}23:02
pquernai mean, seems good.  not sure about how you want to exress that node N can be flavor A or B.23:02
devanandabut otherwise bothflavors might have the same cpu/ram/disk properties23:03
devanandaextra specs23:03
pquernafeels scary23:03
devanandacurrently scheduler matches on both capabilities (cpu/ram/disk) and extra specs23:03
pquernalike its just random/key/value stuff23:03
devanandayep23:03
pquernahave i ever mentioned how much i had json fields.23:03
pquernalemme find a gif to express it23:03
russell_hno23:03
pquernas/had/hate/23:04
devanandaheh23:04
russell_hlet me find an email where you told me to make something a JSON field23:04
* russell_h probably has hundreds23:04
devanandaso it's a stunningly beautiful afternoon outside and i haven't stepped away from this laptop for the last 9 hours23:04
pquernahttp://i.imgur.com/vy3IXHz.gif23:04
pquernai think thats about it for jsonfields23:04
devanandathanks for the very good discussion, everyone23:12
devanandalet's keep it going (later). it's probably worth a move to the ML at this point23:12
openstackgerritA change was merged to openstack/ironic: Fix seamicro power.validate() method definition  https://review.openstack.org/8567523:15
*** datajerk has quit IRC23:22
NobodyCamwoo hoo /me finally get tests running on os x23:22
devanandarussell_h: https://review.openstack.org/#/c/84142/ and https://review.openstack.org/#/c/84814/223:23
devanandarussell_h: looks like yuriy's patch directly overlaps yours. can yhou comment?23:23
russell_hdevananda: yep, thanks23:24
russell_hdevananda: I'm alright with either merge order, although I believe that Yuriy's patch is a strict superset of mine23:26
russell_hso if we think mine is good to go we should just pull the trigger23:26
devanandasuperset? you mean subset?23:26
russell_her23:26
russell_hyes23:26
russell_hif we think mine needs more love, lets merge his, its a trivial rebase23:26
* russell_h comments23:26
devanandaooh23:27
devanandaone thing your patch is missing23:27
devanandatest_responsible_for_node23:27
russell_htrue that23:28
russell_hok, lets merge Yuriy's then, I'll rebase on top23:28
devanandak23:28
openstackgerritChris Krelle proposed a change to openstack/ironic: Fix for tripleO undercloud gate tests  https://review.openstack.org/8552923:29
*** lucas-dinner has quit IRC23:29
JoshNangso i broke a couple tempest test trying to fix the db details leak bug https://review.openstack.org/#/c/73121/. where do i go to fix those? i'm not too familiar with how temptest works.23:29
adam_gShrews, you still able to reproduce that test suite deadlock on demand?23:30
devanandaok, /me really goes for a walk23:30
devanandaalso have dinner plans, so i'm probably done for the day ... we'll see... might hop on later23:30
JoshNanghave a good night!23:30
adam_gdevananda, cheers23:31
NobodyCamhave a good night devananda23:31
*** datajerk has joined #openstack-ironic23:38
* NobodyCam wanders away too.. will check on test in a while23:40
*** vkozhukalov has quit IRC23:41
openstackgerritAdam Gandelman proposed a change to openstack/ironic: Cleanup running conductor services in tests  https://review.openstack.org/8647323:54
adam_gShrews, ^ give that a shot if so..23:54
adam_gthats an unimpressive diff considering how long it took to track down. :)23:55
openstackgerritRuby Loo proposed a change to openstack/python-ironicclient: Adds documentation for ironicclient API  https://review.openstack.org/8510723:57
JoshNangadam_g: is that for the mem leak bug?23:57
adam_gJoshNang, yeah23:57
JoshNangif that fixes it, you'll be my hero23:57
adam_gJoshNang, give it a shot23:57
adam_gfixes it for me23:57
JoshNangkk. its been very sporadic for me23:58
JoshNangi'll test it out23:58
adam_gJoshNang, i was able to reproduce 100% by running discover manually in the venv23:58
adam_gdiscover -t ./ ./ironic/tests/23:58
jrollwow23:59
jrollnice find, adam_g23:59
*** killer_prince has quit IRC23:59
adam_gJoshNang, but yeah--i could see how it wouldbe sporatic depending on how fast the tests run + when conductor services start up + when periodic tasks pop23:59
adam_gjroll, :)23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!