Monday, 2018-12-03

*** hwoarang has quit IRC02:03
*** hwoarang has joined #openstack-ironic02:04
openstackgerritMerged openstack/python-ironic-inspector-client master: Follow-up check-errors flag  https://review.openstack.org/62055802:18
*** hshiina has joined #openstack-ironic02:32
openstackgerritKaifeng Wang proposed openstack/ironic-inspector master: introspection data backend: implements db  https://review.openstack.org/58393002:35
*** coreywright has quit IRC02:39
*** coreywright has joined #openstack-ironic02:56
openstackgerritKaifeng Wang proposed openstack/ironic-inspector master: introspection data backend: plugin layer  https://review.openstack.org/51455203:01
*** hamzy__ is now known as hamzy03:36
*** hwoarang has quit IRC05:10
*** hwoarang has joined #openstack-ironic05:11
*** gkadam has joined #openstack-ironic05:45
*** skazi has quit IRC06:01
*** hwoarang has quit IRC06:01
*** hwoarang has joined #openstack-ironic06:03
openstackgerritparesh sao proposed openstack/ironic master: OOB RAID implementation for ilo5 based HPE Proliant servers.  https://review.openstack.org/55566406:23
*** arne_wiebalck_ has joined #openstack-ironic06:41
openstackgerritKaifeng Wang proposed openstack/ironic-inspector master: introspection data backend: plugin layer  https://review.openstack.org/51455206:43
*** arne_wiebalck_ has quit IRC06:46
*** skazi has joined #openstack-ironic06:51
*** rcernin has quit IRC06:57
*** skazi has quit IRC06:59
*** skazi has joined #openstack-ironic07:11
*** dnuka has joined #openstack-ironic07:13
dnukaGood morning ironic :)07:13
*** diga has joined #openstack-ironic07:16
*** adrianc has joined #openstack-ironic07:24
*** pcaruana has joined #openstack-ironic07:25
*** rpittau has joined #openstack-ironic07:59
rpittaugood morning ironic o/07:59
etingofgood chilly Monday morning everyone o/08:01
dnukamorning etingof o/08:02
dnukamorning rpittau o/08:03
*** diga has quit IRC08:03
rpittauhey dnuka good morning :)08:03
*** e0ne has joined #openstack-ironic08:04
*** dnuka has quit IRC08:14
*** jtomasek has joined #openstack-ironic08:15
*** jtomasek has quit IRC08:15
*** jtomasek has joined #openstack-ironic08:16
*** sri_ has quit IRC08:24
*** dnuka has joined #openstack-ironic08:43
*** dougsz has joined #openstack-ironic08:46
*** luzC has quit IRC08:56
*** dnuka has quit IRC08:58
*** luzC has joined #openstack-ironic09:01
*** moshele has joined #openstack-ironic09:05
openstackgerritDigambar proposed openstack/ironic master: Fix OOB introspection to use pxe_enabled flag in idrac driver  https://review.openstack.org/61795109:30
*** diga has joined #openstack-ironic09:31
*** sri_ has joined #openstack-ironic09:31
*** dnuka has joined #openstack-ironic09:37
*** skazi has quit IRC09:50
*** derekh has joined #openstack-ironic09:57
*** skazi has joined #openstack-ironic10:02
dtantsurmorning ironic10:07
dnukagood morning dtantsur :)10:08
rpittaumorning dtantsur :)10:10
dtantsur\o10:14
openstackgerritDmitry Tantsur proposed openstack/metalsmith master: [WIP] Completely switch to openstacksdk  https://review.openstack.org/61955810:16
openstackgerritDmitry Tantsur proposed openstack/metalsmith master: [WIP] Completely switch to openstacksdk  https://review.openstack.org/61955810:19
dtantsurrpittau: congrats on getting https://review.openstack.org/#/c/620634/ merged! :) could you backport it to rocky (and if needed queens)?10:20
patchbotpatch 620634 - ironic - Avoid cpu_arch None values in iscsi deployments (MERGED) - 4 patch sets10:20
rpittaudtantsur, thanks! :) I will do it10:21
openstackgerritDmitry Tantsur proposed openstack/ironic-tempest-plugin master: Replace Ocata jobs with Rocky  https://review.openstack.org/62153710:25
*** tssurya has joined #openstack-ironic10:26
openstackgerritRiccardo Pittau proposed openstack/ironic stable/rocky: Avoid cpu_arch None values in iscsi deployments  https://review.openstack.org/62153910:44
rpittaudtantsur, doesn't look like we'll need that backported to queens, but please double-check if you have a minute10:55
dtantsurI expected that, I think the multi-arch code landed in rocky10:56
*** priteau has joined #openstack-ironic10:56
*** rpittau has quit IRC10:57
*** rpittau_ has joined #openstack-ironic10:57
*** adrianc has quit IRC11:02
*** rpittau_ has quit IRC11:03
openstackgerritRiccardo Pittau proposed openstack/ironic stable/rocky: Avoid cpu_arch None values in iscsi deployments  https://review.openstack.org/62153911:03
*** rpittau_ has joined #openstack-ironic11:03
*** diga has quit IRC11:06
*** rpittau_ has quit IRC11:09
*** rpittau__ has joined #openstack-ironic11:09
openstackgerritRiccardo Pittau proposed openstack/ironic stable/rocky: Avoid cpu_arch None values in iscsi deployments  https://review.openstack.org/62153911:10
*** rpittau__ has quit IRC11:14
*** rpittau_ has joined #openstack-ironic11:14
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Add memoization to expensive emulator calls  https://review.openstack.org/61275811:14
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Add configuration file to sushy-emulator  https://review.openstack.org/61617811:17
*** skazi has quit IRC11:17
*** skazi has joined #openstack-ironic11:30
*** skazi has quit IRC11:30
*** arne_wiebalck has quit IRC11:31
*** arne_wiebalck has joined #openstack-ironic11:32
*** adrianc has joined #openstack-ironic11:34
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Limit instances exposure  https://review.openstack.org/61651611:35
*** adrianc has quit IRC11:39
*** adrianc has joined #openstack-ironic11:39
*** hamzy_ has joined #openstack-ironic11:42
*** hamzy has quit IRC11:42
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Add configurable libvirt firmware  https://review.openstack.org/62060511:45
*** dnuka has quit IRC11:45
* etingof finally makes some sense of his web of patches11:46
*** rpittau_ has quit IRC11:48
*** robbbe has joined #openstack-ironic11:58
*** rpittau has joined #openstack-ironic12:00
* rpittau hopes his internet connection will stay stable for more than 30 minutes in a row12:04
jrollmorning ironic12:27
rpittauhey jroll :)12:28
jroll\o rpittau12:28
openstackgerritDmitry Tantsur proposed openstack/metalsmith master: [WIP] Completely switch to openstacksdk  https://review.openstack.org/61955812:29
*** bfournie has quit IRC12:37
*** dnuka has joined #openstack-ironic12:39
*** MattMan_ has quit IRC12:59
*** MattMan_ has joined #openstack-ironic13:00
*** rh-jelabarre has joined #openstack-ironic13:06
dtantsurmorning jroll13:18
jrollmorning dtantsur \o13:18
dnukahi jroll o/13:19
jrollhi dnuka :)13:19
*** bfournie has joined #openstack-ironic13:24
*** jroll has quit IRC13:38
*** jroll has joined #openstack-ironic13:38
*** rpittau_ has joined #openstack-ironic13:56
*** rpittau has quit IRC13:59
openstackgerritDebayan Ray proposed openstack/sushy master: Add foundation for supporting Redfish OEMs  https://review.openstack.org/46382913:59
*** jcoufal has joined #openstack-ironic14:02
*** rloo has joined #openstack-ironic14:05
*** jcoufal has quit IRC14:07
*** rpittau_ is now known as rpittau14:07
*** robbbe has quit IRC14:08
*** robbbe_ has joined #openstack-ironic14:08
*** jcoufal has joined #openstack-ironic14:11
*** jcoufal has quit IRC14:17
*** jcoufal has joined #openstack-ironic14:19
TheJuliagood morning everyone14:20
etingofgood morning TheJulia o/14:22
etingofmorning turns brighter these days with the first sip of espresso14:24
rpittaumorning TheJulia :)14:24
dtantsurmorning TheJulia14:27
dtantsuretingof: morning was much brighter in Barcelona, Berlin is beyond help in this regard :)14:27
dnukagood morning TheJulia :)14:27
*** SteelyDan is now known as dansmith14:28
* etingof thinks of double espresso for dtantsur 14:28
dtantsuralready done :)14:29
*** skazi has joined #openstack-ironic14:32
*** arne_wiebalck_ has joined #openstack-ironic14:34
*** moshele has quit IRC14:46
*** leakypipes is now known as jaypipes14:48
*** kaifeng has joined #openstack-ironic14:53
TheJuliathe daystar also rising while having espresso helps a lot :)14:54
*** stendulker has joined #openstack-ironic14:57
*** hshiina_ has joined #openstack-ironic14:57
TheJuliamgoddard: are there any tenks changes you wish to raise visibility to?14:59
hjensasgood morning. (Actually it's already dark again.)15:00
TheJuliaHow much sunlight do you get per day there?15:00
dtantsursunlight?15:01
*** beekneemech is now known as bnemec15:01
dtantsuralso, meeting?15:01
TheJuliaYes, you know this thing where photos bombard the ground?15:01
TheJuliaOh yes!15:01
TheJulia#startmeeting ironic15:01
TheJuliao/15:01
openstackMeeting started Mon Dec  3 15:01:39 2018 UTC and is due to finish in 60 minutes.  The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
*** openstack changes topic to " (Meeting topic: ironic)"15:01
openstackThe meeting name has been set to 'ironic'15:01
dtantsuro/15:01
jrolloh, that time already15:01
jroll\o15:01
stendulkero/15:01
dnukao/15:01
rpiosoo/15:01
kaifengo/15:01
TheJulia\o15:01
bdoddo/15:02
rpittauyay my first official ironic meeting o/15:02
TheJuliaI kind of lost track of time since I've been going through outstanding patches and making lists15:02
TheJuliaNo, not making lists as in the holiday kind of lists.15:02
* TheJulia loads the agenda15:02
hshiina_o/15:02
TheJuliaOur agenda can be found on the wiki as always.15:03
TheJulia#link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting15:03
rlooo/15:03
hjensaso/15:03
TheJulia#topic Announcements/Reminders15:03
*** openstack changes topic to "Announcements/Reminders (Meeting topic: ironic)"15:03
*** baha has joined #openstack-ironic15:03
TheJulia#Info Following up on the clean/deploy steps action item to schedule a meeting. A doodle was posted. Please submit a time as the available times are coming up soon.15:03
TheJulia#link https://doodle.com/poll/yan4wyvztf7mpq4615:04
*** skazi has quit IRC15:04
TheJuliaOne other announcement that I have. I've proposed kaifeng for ironic-core. The post can be found on the mailing list. Based on the replies I think congratulations is in order.15:05
TheJulia#info kaifeng has been proposed for ironic-core15:05
jroll++15:06
TheJuliaDoes anyone have anything they would like to announce?15:06
dtantsurkaifeng++ congrats!15:06
rpittaucongrats kaifeng15:07
TheJuliaOut of curiosity, does anyone have vacations coming up that the community should be aware of or that we should focus on your feature code sooner rather than later?15:07
stendulkerCograts Kaifeng!!15:07
hjensaskaifeng++ thanks for past and future reviews!15:07
jrollTheJulia: I'll be out most of january, exact dates TBD :)15:08
rpiosokaifeng: Well deserved :)15:08
TheJuliajroll: ack ack :)15:08
jrollcan be summoned if needed though15:08
kaifengI don't know what I should say, but I really grateful for all of you :)15:08
TheJuliaOkay well, if there is nothing else to announce, I think we should proceed directly to subteam status updates.15:09
TheJuliakaifeng: :)15:09
dtantsurTheJulia: I'm out since 17 Dec and till Jan15:09
TheJuliakaifeng: smiling helps :)15:09
TheJuliadtantsur: ack15:09
TheJulia#topic subteam status updates15:09
*** openstack changes topic to "subteam status updates (Meeting topic: ironic)"15:09
TheJulia#link https://etherpad.openstack.org/p/IronicWhiteBoard15:09
TheJuliaStarting around line 225 at present15:10
TheJuliamjturek is not here :(15:12
rlooTheJulia: do we know who is working on the ugprade checker, the TODO (L244)?15:12
TheJuliahamzy_: o/15:12
TheJuliarloo: I believe that was going to fall to me if nobody does anything else on it15:12
rlooTheJulia: so you'd like a volunteer? I'll mention that.15:13
TheJuliaI was going to ask you if you could take a look because I think we have the code and just need to call our sanity checking logic15:13
rlooTheJulia: heh, are we in a hurry for that? I can do it, next year?15:13
dtantsurjust to highlight two big API specs that landed recently:15:13
TheJuliarloo: next year should be fine15:13
dtantsur#link http://specs.openstack.org/openstack/ironic-specs/specs/not-implemented/expose-conductor-info.html15:13
rlooTheJulia: okey dokey15:13
dtantsur#link http://specs.openstack.org/openstack/ironic-specs/specs/not-implemented/allocation-api.html15:13
*** cdearborn has joined #openstack-ironic15:13
dtantsurI haven't seen many reviews on them except for ppl who approved them, so I think I could post the link here15:13
*** adrianc has quit IRC15:14
TheJuliadtantsur: thanks! While not goals, They are asks we've been getting so \o/15:14
TheJuliadtantsur: do you want to begin tracking specific patches?15:14
dtantsurthe conductor API is worth tracking, the patches are up15:15
dtantsurI haven't got any patches for the allocation API, it's on my TODO list for this week15:15
TheJuliastendulker: Have you heard from shekar regarding the dhcp-less l3 virtual media boot work?15:15
stendulkerTheJulia: No15:16
TheJulia:(15:16
*** sthussey has joined #openstack-ironic15:16
stendulkerTheJulia: But in PTG he was saying the code is ready and he would raise review once his CI is up15:16
dtantsur#link https://review.openstack.org/#/q/topic:1724474 conductor API patches15:16
rlooTheJulia: wrt IPXE/PXE split (L268). Is it done after that 621416 lands?15:16
TheJuliaetingof: hshiina_: have either of you heard from mkrai?15:16
etingofTheJulia, I do not think so15:17
TheJuliarloo: I feel like done done really unless we feel we need a ton more docs. :\15:17
dtantsurwe always feel we need a ton more docs15:17
hshiina_TheJulia, i don't, either15:17
TheJuliadtantsur: true-ish... :(15:17
rlooTheJulia: ok, so done w/o that pr. after this meeting, let's delete that then. similar for enhanced checksum support. And thx!!!15:17
*** skazi has joined #openstack-ironic15:18
TheJuliaShould we add a rolling "things to write docs for" list?15:18
*** adrianc has joined #openstack-ironic15:18
TheJuliaor "more docs"15:18
TheJuliasince we've done the bare minimum, we could do better...15:18
rloonot sure, we don't have a good track record of 'just' writing docs after the fact.15:19
TheJuliayeah15:19
rloothe most assured way of docs is to not say a feature is complete until the docs are done.15:19
dtantsuryep15:19
TheJuliaJust so everyone is aware, the neutron events spec merged15:19
jrollindeed15:19
dtantsurwe also need people who are NOT ironic developers to provide consistent feedback15:19
TheJuliadtantsur: ++15:19
rloo++++ for neutron events. (it was on my list to look at this week so even more +++)15:19
dtantsur#link http://specs.openstack.org/openstack/ironic-specs/specs/not-implemented/synchronize-events-with-neutron.html neutron events spec15:20
TheJuliarloo: you might want to check-in with vdrok re code15:20
rlooTheJulia: ok15:20
TheJuliadtantsur: re federation, I feel like it might be good to have another call soon, but maybe after the holidays to further discuss15:20
dtantsur++15:20
TheJuliaafter?15:21
dtantsuryep15:21
TheJuliaokay15:21
dtantsurand.. I don't think we have a lot of interest in ironic-level federation15:21
dtantsurso it may be a short call :)15:21
TheJuliaI would mostly concur with that, at the same time I think the folks who feel they need very strong federation will be appearing after the new year to discuss it15:21
* TheJulia hopes15:21
TheJuliaI'm good with status updates. I seem to have a number of emails to send  :(15:22
* dtantsur is good as well15:23
TheJuliaOn to priorities for the next week?15:24
rloofor whatever reason, i thought some nova spec got merged, that we were interested in15:24
jrollconductor grouping15:24
TheJuliarloo: I already deleted it from the priority list since it merged early last week15:24
rloojroll: thx that was it15:24
jroll:)15:24
jrollTheJulia: oh, do we want to leave it on for the code?15:25
TheJuliaSince we're drifting towards priorities :)15:25
rloo(i was looking at the 'Nova deployment state callback...)15:25
TheJulia#topic Priorities for the coming week15:25
*** openstack changes topic to "Priorities for the coming week (Meeting topic: ironic)"15:25
TheJuliajroll: if code is posted, by all means add it back :)15:25
jrollok15:25
jrolls/if/when :)15:25
TheJulia:)15:25
TheJulia#link https://etherpad.openstack.org/p/IronicWhiteBoard15:25
TheJuliaStarting around line 10715:25
TheJuliaFirst, time to remove merged things15:26
dtantsurmgoddard: any plans to update the deploy templates spec this week?15:26
dtantsurTheJulia: I think you can also remove stuff that only needs to get through the CI (like protected instances)15:26
TheJuliadtantsur: it helps me track in the mean time :\15:27
TheJuliasince CI is a mess right now15:27
dtantsurah, ok15:27
dtantsurI've seen messier CI's :)15:27
TheJuliawhoever is adding the neutron backports, I've already got a link for it15:27
TheJulialine 16015:28
TheJuliaI feel like the CI happier kind of stuff needs higher priorities this week15:29
dtantsuryeah15:30
TheJuliaWe've been seeing a lot of intermittent node speed related failures, timing kind of stuff. :(15:30
jrollthat is a *lot* of priority for one week15:30
TheJuliaa lot of it already has +2s15:30
jrollok15:31
TheJuliaand the ipv6 one is mostly a big release note15:32
TheJulia:(15:32
TheJuliaI'm good with the list for this week. I went ahead and added a note to the ones that are from last week that are approved that are just being tracked at the moment.15:32
TheJuliaI'll delete them once they merge15:33
rloocan we delete the crossed off nova conductor_group support? (L176)15:33
TheJuliajroll: ?15:33
rloowe can add back when there's code.15:33
TheJulia++15:33
jrollit definitely is not a weekly priority :P15:34
jrollkill it15:34
rloo:)15:34
TheJuliaShall we move on to discussion?15:35
etingofwe got sushy-tools twice in the list I think15:35
TheJuliaoh, yup15:35
* TheJulia fixes15:35
* TheJulia hears crickets15:37
TheJulia#topic Discussion15:37
*** openstack changes topic to "Discussion (Meeting topic: ironic)"15:37
TheJuliaWe have one discussion item for today.15:37
TheJuliaDo we continue with coreos ci testing?15:37
jrollmy primary reason for keeping it, is that it's the only ramdisk that looks like something folks could run in production15:38
derekhHow long has it been broken?15:38
dtantsurdoes it still look like that though?15:39
TheJuliaderekh: Not broken as much as they are slightly unreliable15:39
derekhTheJulia: ack, ok15:39
jrolldtantsur: I think so, why not?15:39
TheJuliaIn terms of how long they take to unpack15:39
dtantsurwe haven't updated it in a long while, we don't gate against it15:40
TheJuliaderekh: tl;dr if we hit a slow node and it takes 8+ minutes to unpack ipa, then the deployment fails15:40
derekhgothca15:40
TheJuliaThey did work on November 26th15:40
TheJuliaI guess I'm wondering if it makes sense for us to keep them working. Every time we try to update to a newer coreos it becomes a bit of a headache as well because the images just seem to grow :(15:41
jrollright, so in my ideal world, we'd have something smaller but production-ready that we test against, probably from DIB15:42
TheJuliaI do concur with jroll, it is the only thing that we have that looks like something someone would run in production. Bifrost does do a Debian dib build, but that is sometimes as unreliable with package downloads as anything else.15:42
dtantsurwe have RDO images, like master ones in https://images.rdoproject.org/master/rdo_trunk/current-tripleo/15:43
dtantsurthough they're pretty bloated15:43
TheJuliaI think debian-minimal is ~226MB and we could remove some cruft most likely15:43
* TheJulia feels like more thought is required15:43
jrollcoreos master is 464MB15:44
TheJuliawow15:44
sambetts|afknot really here, but I think the buildroot idea for IPA was a good one15:44
TheJulia464MB means.... 2.5-3GB minimum memory footprint?!?15:44
dtantsur464M WOW it's bigger than RDO images15:44
dtantsurand RDO images contain a lot of additional stuff (like python-hardware for discovery of everything)15:45
rpittauwow coreos that big?15:45
jrollI'd be open to doing CI on the RDO images15:45
TheJuliaI would as well.15:45
TheJuliaAnyone want to volunteer to make the ironic/devstack/lib/ironic changes and try to spin up a job in ironic-python-agent ?15:46
hjensasRDO image is 284M .. tar? (Is it not compressed?)15:46
derekhTheJulia: I'll take a look if nobody else is interested15:47
TheJuliahjensas: it is compressed, but not by much15:47
TheJulia291.7MB is the ramdisk image size15:47
TheJuliaThat is still ~1.5GB of ram15:47
dtantsuryeah, better 215:47
TheJuliaderekh: That would be awesome15:48
* TheJulia feels that discussion on this is done15:48
TheJulia#topic Open Discussion15:48
*** openstack changes topic to "Open Discussion (Meeting topic: ironic)"15:48
TheJuliaDoes anyone have anything they would like to discuss this morning?15:48
* jroll does not15:49
jrollthank you derekh!15:49
derekhjroll: no prob15:49
TheJuliaWell then, I hope everyone has a wonderful week if we have nothing else to discuss today15:50
* dtantsur has nothing15:50
rloocrickethanks15:51
TheJuliao/15:52
TheJulia#endmeeting15:52
*** openstack changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/ironic/ | Bugs: https://storyboard.openstack.org/#!/project_group/75 | Contributors are generally present between 6 AM and 12 AM UTC, If we do not answer, please feel free to pose questions to openstack-dev mailing list."15:52
openstackMeeting ended Mon Dec  3 15:52:06 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:52
openstackMinutes:        http://eavesdrop.openstack.org/meetings/ironic/2018/ironic.2018-12-03-15.01.html15:52
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/ironic/2018/ironic.2018-12-03-15.01.txt15:52
openstackLog:            http://eavesdrop.openstack.org/meetings/ironic/2018/ironic.2018-12-03-15.01.log.html15:52
dtantsurTheJulia: https://review.openstack.org/#/c/621537/15:52
patchbotpatch 621537 - ironic-tempest-plugin - Replace Ocata jobs with Rocky - 1 patch set15:52
dtantsurand I think we should start making some of these non-voting.. because we also need a new API job, and it's just too many of them15:52
*** cdearborn has quit IRC15:53
TheJuliaNew API job for what specifically?15:55
TheJuliaBetter question, what requires an entirely new integration scenario?15:55
*** jhesketh has quit IRC15:55
*** skazi has quit IRC15:55
sambetts|afkTheJulia: whats the link to the CI watch page? I think I fixed the Cisco CI after the placement repo was missing, but I wanted to double check it has been voting correctly15:56
*** skazi has joined #openstack-ironic15:56
TheJuliasambetts|afk: one moment (btw, it is)15:56
TheJuliahttp://ciwatch.mmedvede.net/project?project=ironic&time=7+days15:56
*** jhesketh has joined #openstack-ironic15:57
sambetts|afk\o/ thats great to see/hear15:57
*** cdearborn_ has joined #openstack-ironic15:57
*** stendulker has quit IRC15:57
*** cdearborn_ is now known as cdearborn15:57
dtantsurTheJulia: the API tests with fake stuff. we only run a master job on the tempest plugin.15:58
* TheJulia sighs16:00
*** yolanda has joined #openstack-ironic16:01
TheJuliaI think it is reasonable to mark pike16:01
TheJuliaqueens enters extended maintenance in ~10 months16:02
TheJuliaPike enters extended maintenance in ~4 months16:03
dtantsurrloo: I think you can life your -2 from https://review.openstack.org/#/c/514552/ now16:03
patchbotpatch 514552 - ironic-inspector - introspection data backend: plugin layer - 25 patch sets16:03
dtantsur* lift16:03
rloodtantsur: thx, forgot about that.16:04
*** gyee has joined #openstack-ironic16:04
*** hshiina_ has quit IRC16:08
*** arne_wiebalck_ has quit IRC16:11
*** kaifeng has quit IRC16:13
*** dnuka has quit IRC16:15
*** dtantsur is now known as dtantsur|afk16:17
dtantsur|afko/16:17
openstackgerritDmitry Galkin proposed openstack/ironic master: Fix node exclusive lock not released on console start/restart.  https://review.openstack.org/60381216:22
*** arne_wiebalck_ has joined #openstack-ironic16:25
*** arne_wiebalck_ has quit IRC16:31
TheJuliao/ arne_wiebalck16:36
arne_wiebalckTheJulia: o/16:36
TheJuliahow goes the bare metal fleet?16:36
arne_wiebalckTheJulia: Quite well: I’m tryig to bring the first nodes with Ironic managed s/w RAID-10 into production :)16:37
TheJuliaOhhhhh :)16:37
arne_wiebalckTheJulia: Need to iron out little things like Ironic using “1+0” which md uses “10” …16:38
arne_wiebalckTheJulia: s/which/while16:39
TheJuliaheh16:39
TheJuliayeah, that would do it16:39
*** trown is now known as trown|lunch16:41
*** e0ne has quit IRC16:48
NobodyCamGood Morning Ironic'ers17:04
rpittauhey TheJulia please if you have a minute https://review.openstack.org/#/c/621539/17:08
patchbotpatch 621539 - ironic (stable/rocky) - Avoid cpu_arch None values in iscsi deployments - 3 patch sets17:08
rpittaumorning NobodyCam :)17:09
*** mkrai has joined #openstack-ironic17:09
NobodyCammorning rpittau :) happy Monday17:09
rpittauhappy Monday! Almost gone here NobodyCam :)17:10
NobodyCam:) lucky, We're just getting started here :}17:10
*** baha has quit IRC17:13
openstackgerritMerged openstack/ironic master: Expose conductors: db and rpc  https://review.openstack.org/61968317:15
*** mkrai has quit IRC17:17
TheJuliagood morning17:20
NobodyCam:) \o17:21
rpittaubye o/17:26
*** rpittau has quit IRC17:26
*** baha has joined #openstack-ironic17:32
*** adrianc has quit IRC17:35
*** moshele has joined #openstack-ironic17:36
*** adrianc has joined #openstack-ironic17:38
openstackgerritIlya Etingof proposed openstack/sushy master: Add System<->Manager linkage  https://review.openstack.org/62166317:49
*** moshele has quit IRC17:51
* etingof got his eyes crossed after staring at the Python code all day long17:52
TheJuliaThat happens17:55
*** derekh has quit IRC18:02
*** e0ne has joined #openstack-ironic18:03
*** moshele has joined #openstack-ironic18:07
*** robbbe_ has quit IRC18:10
*** moshele has quit IRC18:15
*** dsneddon has joined #openstack-ironic18:19
*** dougsz has quit IRC18:22
*** HardCase has joined #openstack-ironic18:43
*** vabada has quit IRC18:43
*** arne_wiebalck has quit IRC18:44
HardCaseHey guys, need some help understanding an issue.  I ran a clean on my 3 ceph nodes and now /dev/sda on each server is giving I/O errors.  Would like to understand if I did something wrong.  Any thoughts?18:44
mgoddardTheJulia: dtantsur|afk: sorry to miss the meeting earlier, in meetings with clients. I didn't get to update the deploy templates spec last week, I'll do my best to make it happen this week18:47
TheJuliaHardCase: SSDs?18:47
*** tssurya has quit IRC18:47
TheJuliaHardCase: What version of ironic?18:48
HardCaseThey are spinning disks18:48
HardCaselet me see, 1 sec18:48
TheJuliaWhat kind of spinning disks, is secure erase enabled on them?18:48
HardCaseSo python2-ironicclient = v2.2.118:50
HardCaseChecking the disk model, I don't know if secure erase is enabled on them or not but I'll check18:51
TheJuliaIt sounds like maybe secure erase got started and aborted.... you might need to try to manually unlock them.  :\18:51
HardCaseAhHaH!  That might make sense, IIRC I do think the wipe was interrupted partway through.  Have any advice for manually unlocking them?18:52
TheJuliaohhh.. ouch18:53
TheJuliaSo.... you migh tbe able to try and re-wipe them manually18:53
*** adrianc has quit IRC18:54
TheJuliaempty password string, you might be able to move them out of that security state. tl;dr this is a bad state for drives to be in and is the HUGE risk with secure wipe/secure erase18:54
HardCaseThis is exceptionally helpful information and I am willing to bet, based on the symptoms that this is precisely what happened.  So now my question, is aside from ensuring that a wipe is uninterrupted, is there another step I can or should have taken to prevent this?18:56
*** adrianc has joined #openstack-ironic18:58
*** adrianc has quit IRC18:58
*** trown|lunch is now known as trown|outtypewww18:59
*** adrianc has joined #openstack-ironic19:02
*** e0ne has quit IRC19:04
*** adrianc has quit IRC19:06
*** adrianc_ has joined #openstack-ironic19:15
openstackgerritAija Jaunteva proposed openstack/sushy master: Cleanup JsonDataReader name  https://review.openstack.org/61389219:16
*** e0ne has joined #openstack-ironic19:17
*** priteau has quit IRC19:20
*** amotoki has quit IRC19:21
*** amotoki has joined #openstack-ironic19:23
*** adrianc_ is now known as adrianc19:25
TheJuliaHardCase: I guess it goes back to what caused them to be interrupted19:31
TheJuliaATA secure erase is one of those things you just can't interrupt safely for the device19:31
*** adrianc_ has joined #openstack-ironic19:31
TheJuliaour unlock code in ironic-python-agent is more-so geared to try and unlock the disk if we somehow left it in a lower security mode before rebooting19:32
* TheJulia wonders if trying to re-clean could unlock them :\19:32
HardCaseOk and that makes perfect sense now that I know that this is what the 'wipe' was doing.19:32
* TheJulia suspects they would never make it that far19:33
HardCaseThat is interesting, I am wondering the same thing, should I try to run a clean again and if that would take care of it ... deep thoughts ...19:33
HardCaseI think for now, I am going to try and unlock them with hdparm and see if I can unlock them that way.  But a solid lesson learned for me here.19:34
TheJuliaIt really wouldn't hurt to try. It sounds like your on Rocky which means we've got the improved/fixed logic, I just have no idea if the rest of the code will even consider the disk valid enough in the security restricted state to be considered a disk19:34
TheJulia++ unlocking19:34
HardCaseI'm running TripleO Queens release but I could give it a go and see19:35
*** adrianc_ has quit IRC19:35
*** adrianc_ has joined #openstack-ironic19:36
HardCaseSo when a clean is initiated, does it wipe all drives installed on the server or just the root_drive?19:36
TheJuliaHardCase: in rocky, we had a few fixes for secure erase to put some better guard rails in and try to prevent us from secure erasing with a pass-through in place19:38
*** adrianc_ has quit IRC19:38
TheJuliaHardCase: it should wipe all drives, in queens and rocky it does it one disk at a time19:38
TheJuliain master branch which will be stein, it _can_ do it concurrently but you have to opt in to that19:38
TheJuliaeach disk would be evaluated individually19:39
*** tssurya has joined #openstack-ironic19:41
HardCaseExcellent, thank you much for all of your help.19:48
*** robbbe has joined #openstack-ironic19:48
*** e0ne has quit IRC19:51
*** e0ne has joined #openstack-ironic19:52
*** e0ne has quit IRC20:02
*** e0ne has joined #openstack-ironic20:03
*** e0ne has quit IRC20:10
*** luzC has quit IRC20:17
*** e0ne has joined #openstack-ironic20:17
*** munimeha1 has joined #openstack-ironic20:19
*** e0ne has quit IRC20:21
*** luzC has joined #openstack-ironic20:22
*** e0ne has joined #openstack-ironic20:42
*** e0ne has quit IRC20:42
*** priteau has joined #openstack-ironic21:19
*** dsneddon has quit IRC21:32
*** jcoufal has quit IRC21:37
*** priteau has quit IRC21:41
*** robbbe has quit IRC21:43
*** bfournie has quit IRC22:05
openstackgerritMerged openstack/ironic stable/rocky: Avoid cpu_arch None values in iscsi deployments  https://review.openstack.org/62153922:06
openstackgerritMerged openstack/ironic-tempest-plugin master: Add API tests for protected nodes  https://review.openstack.org/61301422:06
*** baha has quit IRC22:15
*** dsneddon has joined #openstack-ironic22:16
*** rcernin has joined #openstack-ironic22:18
*** pcaruana has quit IRC22:18
*** priteau has joined #openstack-ironic22:27
*** priteau has quit IRC22:29
*** irclogbot_1 has quit IRC22:47
*** rh-jelabarre has quit IRC22:54
*** rh-jelabarre has joined #openstack-ironic22:57
*** rh-jelabarre has quit IRC23:02
*** irclogbot_1 has joined #openstack-ironic23:08
*** jtomasek has quit IRC23:10
*** cdearborn has quit IRC23:12
*** tssurya has quit IRC23:23
*** Chaserjim has joined #openstack-ironic23:27
*** gkadam has quit IRC23:48

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!