*** Marga_ has joined #openstack-ironic | 00:01 | |
*** Marga_ has quit IRC | 00:02 | |
*** Marga_ has joined #openstack-ironic | 00:03 | |
*** Marga_ has quit IRC | 00:03 | |
*** Marga_ has joined #openstack-ironic | 00:03 | |
openstackgerrit | Jay Faulkner proposed openstack/ironic: Make agent driver always PXE before cleaning https://review.openstack.org/263842 | 00:04 |
---|---|---|
*** suro-patz has quit IRC | 00:06 | |
*** garthb has quit IRC | 00:15 | |
openstackgerrit | John L. Villalovos proposed openstack/ironic: Add a deprecated_reason for periodic_config https://review.openstack.org/301984 | 00:21 |
jlvillal | thiagop: ^^^^ | 00:22 |
openstackgerrit | John L. Villalovos proposed openstack/ironic: Add a deprecated_reason for periodic_config https://review.openstack.org/301984 | 00:22 |
*** mtanino has quit IRC | 00:25 | |
*** Sukhdev has quit IRC | 00:35 | |
*** baoli has joined #openstack-ironic | 00:52 | |
*** alexpilotti has joined #openstack-ironic | 00:56 | |
*** yuanying has quit IRC | 01:01 | |
*** alexpilotti has quit IRC | 01:01 | |
*** yuanying has joined #openstack-ironic | 01:02 | |
*** yuanying has quit IRC | 01:04 | |
*** alexpilotti has joined #openstack-ironic | 01:04 | |
*** alexpilotti has quit IRC | 01:09 | |
*** zzzeek_ has quit IRC | 01:10 | |
*** yuanying has joined #openstack-ironic | 01:13 | |
*** zzzeek has joined #openstack-ironic | 01:13 | |
*** saripurigopi has quit IRC | 01:24 | |
*** yuanying has quit IRC | 01:25 | |
*** spandhe has quit IRC | 01:26 | |
*** yuanying has joined #openstack-ironic | 01:28 | |
*** yuanying has quit IRC | 01:30 | |
*** jaybeale has quit IRC | 01:33 | |
*** rbrud has quit IRC | 01:38 | |
*** yuanying has joined #openstack-ironic | 01:39 | |
*** xavierr_ has joined #openstack-ironic | 01:41 | |
*** yuanying has quit IRC | 01:42 | |
*** yuanying has joined #openstack-ironic | 01:43 | |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: IPMItool: add IPMIIcsConsole class https://review.openstack.org/301715 | 01:44 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: console utils: add methods for ironic console server https://review.openstack.org/301714 | 01:44 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: conductor RPC: add cosnole-log related methods https://review.openstack.org/301717 | 01:44 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: conductor manager: apply console-log related methods https://review.openstack.org/301716 | 01:44 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: conductor utils: add start/stop console logging https://review.openstack.org/301719 | 01:44 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: REST API: add an API controller for console log https://review.openstack.org/301718 | 01:44 |
*** hoangcx has quit IRC | 01:46 | |
*** hoangcx has joined #openstack-ironic | 01:46 | |
*** yonglihe has joined #openstack-ironic | 01:48 | |
*** xavierr_ has quit IRC | 01:54 | |
*** ChrisAusten has joined #openstack-ironic | 01:56 | |
*** JieLi has joined #openstack-ironic | 01:56 | |
*** yuanying has quit IRC | 02:02 | |
*** yuanying has joined #openstack-ironic | 02:05 | |
*** harshs has joined #openstack-ironic | 02:08 | |
*** ChrisAusten has quit IRC | 02:11 | |
*** spandhe has joined #openstack-ironic | 02:19 | |
*** zzzeek has quit IRC | 02:21 | |
*** zzzeek has joined #openstack-ironic | 02:23 | |
*** saripurigopi has joined #openstack-ironic | 02:24 | |
*** achanda has joined #openstack-ironic | 02:34 | |
*** saripurigopi has quit IRC | 02:36 | |
*** saripurigopi has joined #openstack-ironic | 02:36 | |
*** spandhe_ has joined #openstack-ironic | 02:38 | |
*** harshs_ has joined #openstack-ironic | 02:38 | |
*** spandhe has quit IRC | 02:40 | |
*** spandhe_ is now known as spandhe | 02:40 | |
*** harshs has quit IRC | 02:40 | |
*** harshs_ is now known as harshs | 02:40 | |
*** saripurigopi has quit IRC | 02:43 | |
*** Keedya has joined #openstack-ironic | 02:49 | |
*** yuanying has quit IRC | 02:50 | |
*** Keedya has quit IRC | 02:53 | |
*** Keedya has joined #openstack-ironic | 02:53 | |
openstackgerrit | Haomeng,Wang proposed openstack/ironic-specs: WIP: Cloning bare metal disk to glance image https://review.openstack.org/301498 | 02:54 |
openstackgerrit | Dao Cong Tien proposed openstack/python-ironicclient: Fix typos in docstrings and comments https://review.openstack.org/301995 | 02:55 |
*** jaybeale has joined #openstack-ironic | 02:55 | |
*** Keedya has quit IRC | 02:58 | |
*** Keedya has joined #openstack-ironic | 03:02 | |
*** Keedya has quit IRC | 03:05 | |
*** Keedya has joined #openstack-ironic | 03:10 | |
*** hoangcx has quit IRC | 03:11 | |
*** hoangcx has joined #openstack-ironic | 03:11 | |
*** JieLi has quit IRC | 03:14 | |
*** Keedya has quit IRC | 03:15 | |
*** JieLi has joined #openstack-ironic | 03:26 | |
*** achanda has quit IRC | 03:27 | |
*** hoangcx has quit IRC | 03:29 | |
*** hoangcx has joined #openstack-ironic | 03:40 | |
*** baoli has quit IRC | 03:43 | |
*** yuanying has joined #openstack-ironic | 03:46 | |
*** links has joined #openstack-ironic | 03:52 | |
*** kalpase has joined #openstack-ironic | 03:52 | |
*** hoangcx has quit IRC | 04:02 | |
*** hoangcx has joined #openstack-ironic | 04:02 | |
*** saripurigopi has joined #openstack-ironic | 04:08 | |
*** saripurigopi has quit IRC | 04:09 | |
*** saripurigopi has joined #openstack-ironic | 04:09 | |
*** jaybeale has quit IRC | 04:10 | |
*** JieLi has quit IRC | 04:20 | |
*** hoangcx has quit IRC | 04:20 | |
*** hoangcx has joined #openstack-ironic | 04:21 | |
*** jaybeale has joined #openstack-ironic | 04:23 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic: Updated from global requirements https://review.openstack.org/302012 | 04:25 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-inspector: Updated from global requirements https://review.openstack.org/302013 | 04:25 |
*** jaybeale has quit IRC | 04:25 | |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: driver base: add methods for ConsoleInterface https://review.openstack.org/301713 | 04:40 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: IPMItool: add IPMIIcsConsole class https://review.openstack.org/301715 | 04:40 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: console utils: add methods for ironic console server https://review.openstack.org/301714 | 04:40 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: conductor manager: apply console-log related methods https://review.openstack.org/301717 | 04:40 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: REST API: add an API controller for console log https://review.openstack.org/301718 | 04:40 |
*** praneshp_ has quit IRC | 04:43 | |
*** jaybeale has joined #openstack-ironic | 04:45 | |
*** kalpase has quit IRC | 04:46 | |
*** ChubYann has quit IRC | 04:46 | |
*** rbudden has quit IRC | 04:47 | |
*** mvpnitesh has joined #openstack-ironic | 04:57 | |
*** praneshp_ has joined #openstack-ironic | 04:57 | |
*** achanda has joined #openstack-ironic | 05:00 | |
*** ppiela has quit IRC | 05:02 | |
*** Sukhdev has joined #openstack-ironic | 05:03 | |
*** ppiela has joined #openstack-ironic | 05:05 | |
*** Nisha has joined #openstack-ironic | 05:13 | |
*** jaybeale has quit IRC | 05:16 | |
*** ppiela has quit IRC | 05:17 | |
*** ppiela has joined #openstack-ironic | 05:21 | |
*** krtaylor has quit IRC | 05:29 | |
*** sekrit has quit IRC | 05:30 | |
*** krtaylor has joined #openstack-ironic | 05:31 | |
*** Marga_ has quit IRC | 05:34 | |
*** ppiela has quit IRC | 05:36 | |
*** Marga_ has joined #openstack-ironic | 05:37 | |
*** Marga_ has quit IRC | 05:38 | |
*** Marga_ has joined #openstack-ironic | 05:38 | |
*** ppiela has joined #openstack-ironic | 05:40 | |
*** Marga_ has quit IRC | 05:43 | |
*** moshele has joined #openstack-ironic | 05:46 | |
*** ppiela has quit IRC | 05:46 | |
*** Marga_ has joined #openstack-ironic | 05:52 | |
*** Marga_ has quit IRC | 05:56 | |
lazy_prince | lucasagomes: can you review https://review.openstack.org/#/c/287784/18 pls..? | 05:57 |
openstackgerrit | xiexs proposed openstack/python-ironicclient: Add multi nodes support for "baremetal delete" command https://review.openstack.org/289676 | 05:59 |
openstackgerrit | xiexs proposed openstack/python-ironicclient: Introduce FakeBaremetal class https://review.openstack.org/302037 | 05:59 |
openstackgerrit | xiexs proposed openstack/python-ironicclient: Refactor TestBaremetalDelete with FakeBaremetal https://review.openstack.org/302038 | 05:59 |
*** JieLi has joined #openstack-ironic | 05:59 | |
*** harshs has quit IRC | 05:59 | |
*** rcernin has joined #openstack-ironic | 05:59 | |
*** Marga_ has joined #openstack-ironic | 06:01 | |
*** saripurigopi has quit IRC | 06:01 | |
*** ppiela has joined #openstack-ironic | 06:03 | |
openstackgerrit | Merged openstack/ironic: Follow-up to I244c3f31d0ad26194887cfb9b79f96b5111296c6 https://review.openstack.org/301876 | 06:06 |
*** Sukhdev has quit IRC | 06:08 | |
*** aswadr_ has joined #openstack-ironic | 06:14 | |
*** suro-patz has joined #openstack-ironic | 06:22 | |
*** sekrit has joined #openstack-ironic | 06:23 | |
*** mvpnitesh has quit IRC | 06:28 | |
*** mvpnitesh has joined #openstack-ironic | 06:29 | |
*** suro-patz has quit IRC | 06:34 | |
*** suro-patz has joined #openstack-ironic | 06:38 | |
*** suro-patz has quit IRC | 06:41 | |
*** suro-patz has joined #openstack-ironic | 06:47 | |
*** achanda has quit IRC | 06:47 | |
*** achanda has joined #openstack-ironic | 06:53 | |
*** lijie has joined #openstack-ironic | 06:59 | |
*** JieLi has quit IRC | 06:59 | |
*** achanda has quit IRC | 07:00 | |
*** athomas has quit IRC | 07:02 | |
*** athomas has joined #openstack-ironic | 07:02 | |
*** openstackgerrit has quit IRC | 07:02 | |
*** alexpilotti has joined #openstack-ironic | 07:02 | |
*** openstackgerrit has joined #openstack-ironic | 07:03 | |
*** ifarkas has joined #openstack-ironic | 07:04 | |
*** Marga_ has quit IRC | 07:05 | |
*** pcaruana has joined #openstack-ironic | 07:06 | |
*** spandhe has quit IRC | 07:06 | |
*** praneshp_ has quit IRC | 07:07 | |
*** alexpilotti has quit IRC | 07:07 | |
*** rcernin has quit IRC | 07:08 | |
*** rcernin has joined #openstack-ironic | 07:09 | |
*** Nisha_away has joined #openstack-ironic | 07:09 | |
*** Nisha has quit IRC | 07:09 | |
*** spandhe has joined #openstack-ironic | 07:10 | |
openstackgerrit | Vasyl Saienko proposed openstack/ironic: Allow to set neutron port timeout from config https://review.openstack.org/293876 | 07:11 |
*** suro-patz has quit IRC | 07:11 | |
*** mgoddard has joined #openstack-ironic | 07:25 | |
sergek | morning Ironicers! | 07:26 |
*** Nisha_away has quit IRC | 07:28 | |
*** karimb has joined #openstack-ironic | 07:33 | |
*** dtantsur|afk is now known as dtantsur | 07:51 | |
dtantsur | Morning Ironic | 07:51 |
dtantsur | lazy_prince, he's on pto this week | 07:52 |
*** ppiela has quit IRC | 07:52 | |
*** mbound has joined #openstack-ironic | 07:52 | |
*** ppiela has joined #openstack-ironic | 07:56 | |
aarefiev | dtantsur: morning, doc says 7.1 https://pip.pypa.io/en/stable/user_guide/#constraints-files | 07:58 |
*** spandhe has quit IRC | 07:58 | |
dtantsur | eeek.. weird | 07:59 |
*** mgoddard_ has joined #openstack-ironic | 07:59 | |
aarefiev | and works for me on pip 7.1.0 | 07:59 |
*** ndipanov has joined #openstack-ironic | 07:59 | |
dtantsur | hmm, maybe old pip embedded in virtualenv package? | 08:00 |
* dtantsur checks | 08:00 | |
*** achanda has joined #openstack-ironic | 08:00 | |
dtantsur | right, 6.0.8 is embedded in virtualenv >_< | 08:00 |
aarefiev | it's veeery old venv | 08:02 |
dtantsur | 12.0.7 | 08:02 |
dtantsur | and we need 13.1 at least. I think it's worth documenting somewhere actually... | 08:02 |
*** mgoddard has quit IRC | 08:02 | |
*** ohamada has joined #openstack-ironic | 08:02 | |
aarefiev | yeah, hmm I have on my old env exactly 7.1.0, ubuntu trusty | 08:03 |
* dtantsur headbangs | 08:04 | |
*** daemontool has joined #openstack-ironic | 08:04 | |
* dtantsur reports a bug against Fedora | 08:04 | |
*** achanda has quit IRC | 08:05 | |
alineb | morning all | 08:12 |
openstackgerrit | Zhenguo Niu proposed openstack/ironic: Add deprecated_reason support in config generator https://review.openstack.org/302087 | 08:14 |
*** vmud213 has joined #openstack-ironic | 08:15 | |
*** jistr has joined #openstack-ironic | 08:22 | |
*** ndipanov has quit IRC | 08:26 | |
openstackgerrit | Yuriy Zveryanskyy proposed openstack/ironic-specs: Add hardware properties API to management interface https://review.openstack.org/209612 | 08:27 |
yuriyz | morning Ironic | 08:27 |
openstackgerrit | Moshe Levi proposed openstack/ironic-inspector: Adding InfiniBand Support https://review.openstack.org/264257 | 08:27 |
*** lijie has quit IRC | 08:28 | |
*** ndipanov has joined #openstack-ironic | 08:29 | |
*** ppiela has quit IRC | 08:31 | |
*** bharathk has joined #openstack-ironic | 08:32 | |
vdrok | morning ironic. sergek dtantsur aarefiev alineb and yuriyz ! | 08:33 |
*** ppiela has joined #openstack-ironic | 08:34 | |
sergek | o/ | 08:34 |
*** e0ne has joined #openstack-ironic | 08:35 | |
openstackgerrit | Yuriy Zveryanskyy proposed openstack/ironic-specs: Add power and thermal limits support https://review.openstack.org/251957 | 08:43 |
*** derekh has joined #openstack-ironic | 08:46 | |
*** ppiela has quit IRC | 08:49 | |
openstackgerrit | Yuriy Zveryanskyy proposed openstack/ironic-specs: Intel Node Manager policies support https://review.openstack.org/214657 | 08:56 |
vmud213 | morning vdrok, Yuriy, dtantsur, sergek and others | 08:56 |
vdrok | morning vmud213 :) | 08:56 |
*** karimb has quit IRC | 08:58 | |
*** karimb has joined #openstack-ironic | 08:59 | |
*** e0ne has quit IRC | 09:00 | |
sambetts|afk | Morning all | 09:00 |
*** sambetts|afk is now known as sambetts | 09:00 | |
dtantsur | morning sambetts | 09:00 |
sambetts | dtantsur: whats going on about virtualenvs? | 09:00 |
*** mkovacik has quit IRC | 09:01 | |
dtantsur | sambetts, all released fedoras have an old one with pip 6.0.8 | 09:01 |
dtantsur | meaning, we have to update python-virtualenv from rawhide to be able to run unit test | 09:01 |
sambetts | oh :/ well that sucks | 09:01 |
dtantsur | I've got in touch with maintainers, but they suddenly remembered stable update policies | 09:01 |
vmud213 | morning sambetts | 09:02 |
* sambetts just recently upgraded from debian jessie to track testing | 09:02 | |
sambetts | its insane how out of date stable gets | 09:02 |
sambetts | morning vmud213 | 09:02 |
dtantsur | I can imaging.. but I expected Fedora to be more versatile | 09:02 |
*** itamarl has joined #openstack-ironic | 09:04 | |
*** ppiela has joined #openstack-ironic | 09:04 | |
*** Marga_ has joined #openstack-ironic | 09:05 | |
*** electrofelix has joined #openstack-ironic | 09:05 | |
*** Marga_ has quit IRC | 09:10 | |
*** kalpase has joined #openstack-ironic | 09:14 | |
openstackgerrit | Yuriy Zveryanskyy proposed openstack/ironic-specs: Add power and thermal limits support https://review.openstack.org/251957 | 09:15 |
*** wuhg has joined #openstack-ironic | 09:20 | |
openstackgerrit | Merged openstack/python-ironicclient: Fix typos in docstrings and comments https://review.openstack.org/301995 | 09:26 |
openstackgerrit | Vladyslav Drok proposed openstack/ironic: Fix API node name updates https://review.openstack.org/300983 | 09:28 |
*** kalpase has quit IRC | 09:28 | |
*** mgoddard_ has quit IRC | 09:31 | |
*** achanda has joined #openstack-ironic | 09:33 | |
*** mgoddard has joined #openstack-ironic | 09:37 | |
*** achanda has quit IRC | 09:38 | |
sambetts | dtantsur: in the IPA ip addr patch, couldn't you move the wait_for_dhcp call into the agent.py run() function before the call to agent.IronicPythonAgent to make the whole agent safe from dhcp issues? | 09:47 |
dtantsur | sambetts, not everyone wants to wait for *all* NIC's to get IP's | 09:48 |
dtantsur | sambetts, also, we have a loop waiting for a route to ironic already | 09:48 |
openstackgerrit | vinay kumar muddu proposed openstack/ironic-python-agent: Fix local boot issue with fedora in uefi mode https://review.openstack.org/302143 | 09:55 |
vdrok | morning sambetts ! | 09:57 |
sambetts | morning vdrok | 09:57 |
*** b_bezak has joined #openstack-ironic | 10:01 | |
openstackgerrit | Merged openstack/ironic-inspector: Updated from global requirements https://review.openstack.org/302013 | 10:02 |
sambetts | dtantsur: hmmm, yeah, I'm not sure if there is ever a situation when we need to wait for all the nics for a normal IPA case, is it ever possible that the ironic communication and for example the swift communication might be on different nics and therefore need dhcp on all interfaces | 10:04 |
*** e0ne has joined #openstack-ironic | 10:06 | |
*** Nisha has joined #openstack-ironic | 10:07 | |
*** ekarlso- has quit IRC | 10:09 | |
dtantsur | sambetts, I'd definitely prefer to do it in a separate patch, if at all | 10:10 |
openstackgerrit | Tan Lin proposed openstack/ironic: Make use of oslo-config-generator https://review.openstack.org/247331 | 10:10 |
sambetts | dtantsur: Sure, makes sense, I'm thinking we need further discussions around IPA and networking | 10:11 |
sambetts | dtantsur: I'm seeing an error on some of my pieces of hardware once Ironic has finished deploy and is trying to reboot into the tenant image: "Unable to find requested MBR signature" any ideas? | 10:15 |
-openstackstatus- NOTICE: npm lint jobs are failing due to a problem with npm registry. The problem is under investigation, and we will update once the issue is solved. | 10:17 | |
openstackgerrit | Yuriy Zveryanskyy proposed openstack/ironic: Remove backward compatibility code with old Nova drivers https://review.openstack.org/301682 | 10:17 |
*** ChanServ changes topic to "npm lint jobs are failing due to a problem with npm registry. The problem is under investigation, and we will update once the issue is solved." | 10:17 | |
openstackgerrit | xiexs proposed openstack/python-ironicclient: Add multi nodes support for "baremetal delete" command https://review.openstack.org/289676 | 10:19 |
*** hoangcx has quit IRC | 10:19 | |
*** hoangcx has joined #openstack-ironic | 10:19 | |
dtantsur | sambetts, no, haven't seen this | 10:21 |
openstackgerrit | Vladyslav Drok proposed openstack/ironic: Fix API node name updates https://review.openstack.org/300983 | 10:21 |
*** ekarlso- has joined #openstack-ironic | 10:21 | |
*** ekarlso- has quit IRC | 10:22 | |
*** ekarlso has joined #openstack-ironic | 10:22 | |
mvpnitesh | hi dtantsur | 10:25 |
mvpnitesh | i've a doubt | 10:25 |
*** mgould has joined #openstack-ironic | 10:25 | |
dtantsur | hi mvpnitesh | 10:26 |
mgould | morning Ironic! | 10:26 |
sambetts | Morning mgould | 10:27 |
mvpnitesh | when we provision a bare metal machine , an instance is created in Nova. After we set the provision state as deleted, then the node is available to provision again. What happens to the nova instance | 10:27 |
mvpnitesh | what is the expected behaviour for the above scenario | 10:27 |
dtantsur | mvpnitesh, you should delete instance via nova, not via provision state deleted | 10:28 |
dtantsur | mvpnitesh, then nova will take care of cleaning up everything | 10:28 |
*** rolfb_ has quit IRC | 10:28 | |
mvpnitesh | dtantsur , thanks | 10:29 |
*** rbrud has joined #openstack-ironic | 10:30 | |
rbrud | whois rbrud | 10:30 |
vdrok | dtantsur: a bug was reported about this, not sure if it should be closed - https://bugs.launchpad.net/ironic/+bug/1565696 | 10:30 |
openstack | Launchpad bug 1565696 in Ironic "deleted node cannot be recognized to nova scheduler" [Undecided,New] - Assigned to M V P Nitesh (m-nitesh) | 10:30 |
dtantsur | vdrok, it's definitely not an issue in ironic | 10:31 |
vdrok | yep | 10:31 |
mvpnitesh | i've a doubt on the same bug | 10:32 |
mvpnitesh | i'm trying to fix it.Can you please tell me whether the understanding on that bug is correct or not | 10:32 |
dtantsur | mvpnitesh, nova instances should be deleted via nova, we can't be responsible for them :) not a bug as to me | 10:33 |
sambetts | the work flow defined in that bug is wrong, if your using nova with Ironic then you need to do all interactions through nova | 10:33 |
*** rbrud has quit IRC | 10:35 | |
*** achanda has joined #openstack-ironic | 10:35 | |
mgould | sambetts, mvpnitesh morning | 10:35 |
*** rbrud has joined #openstack-ironic | 10:36 | |
mvpnitesh | mgould ,morning | 10:36 |
*** rbrud has quit IRC | 10:40 | |
*** rbrud has joined #openstack-ironic | 10:40 | |
mvpnitesh | dtantsur,sambetts: I've a node which is provisioned with 'abc' mac id.Now i set the provision state as deleted.So the node is set to available state. Then i should be able to provision the same node.But is not happening because there is a port created in neutron when we first provision the node. Now after we set the deleted state for node and re provision again it is not happening and throughing "No Valid host is Found" error. | 10:40 |
*** mkovacik has joined #openstack-ironic | 10:40 | |
mvpnitesh | *throwing | 10:41 |
*** achanda has quit IRC | 10:41 | |
openstackgerrit | Merged openstack/ironic: Tune interval for node provision state check https://review.openstack.org/299795 | 10:41 |
dtantsur | mvpnitesh, the same thing. nova would remove the port in question, if you used the nova delete command for tearing down the instance | 10:41 |
dtantsur | ironic does not create neutron ports iirc | 10:41 |
mvpnitesh | Ok fine. If we need to reprovision the machine then we have to delete the nova instance first and then re provision the machine. | 10:43 |
dtantsur | yep | 10:44 |
sambetts | mvpnitesh: if your using Ironic with nova, other that initally enrolling the node into Ironic you shouldn't need to talk to the Ironic API at all, all interaction should be through nova | 10:46 |
mvpnitesh | dtantsur, sambetts Thanks , i understood | 10:47 |
*** alexpilotti has joined #openstack-ironic | 10:48 | |
*** linuxgeek has joined #openstack-ironic | 10:53 | |
sambetts | dtantsur: I'm wondering if my MBR issue is something to do with IPA writing to the wrong disk or something :/ | 10:58 |
*** itamarl has quit IRC | 10:58 | |
*** itamarl has joined #openstack-ironic | 10:58 | |
*** karimb has quit IRC | 10:58 | |
dtantsur | possibly | 10:59 |
sambetts | dtantsur: its a whole disk image I'm trying to deploy, is it supposed to pxe chainload for whole disk ? | 11:00 |
openstackgerrit | Aayush Rajoria proposed openstack/ironic: Introduce VolumeConnector object https://review.openstack.org/214584 | 11:00 |
openstackgerrit | Aayush Rajoria proposed openstack/ironic: Introduce new RPCs to support volume connector operation https://review.openstack.org/214585 | 11:00 |
openstackgerrit | Aayush Rajoria proposed openstack/ironic: Add REST API for volume connector operation https://review.openstack.org/214586 | 11:00 |
openstackgerrit | Aayush Rajoria proposed openstack/ironic: Add volume_connector table to save connector information https://review.openstack.org/200983 | 11:00 |
dtantsur | sambetts, not sure, maybe you need to explicitly set boot_option:local | 11:00 |
derekh | lucasagomes: we're you doing something at one stage to allow users to ssh to a ipa image? | 11:00 |
sambetts | derekh: You can inject an ssh key into the IPA coreos image using the kernel parameters https://coreos.com/os/docs/latest/booting-with-pxe.html | 11:02 |
dtantsur | derekh, for DIB image we can use dynamic-login element (which is on by default in tripleo btw) | 11:02 |
derekh | sambetts: hmm, I'm using a centos DIB image | 11:03 |
derekh | dtantsur: ack, will take a look at that | 11:03 |
dtantsur | derekh, set your key as described in https://github.com/openstack/diskimage-builder/blob/master/elements/dynamic-login/README.rst | 11:03 |
sambetts | derekh: then like dtantsur says there is either the dynamic-login element or there is the dev-user element in DIB to make it possible to login to a DIB built image | 11:03 |
vdrok | sambetts: IIRC yes, whole-disk images do chain load if local boot is not requested explicitly | 11:03 |
derekh | dtantsur: thanks, I'm trying to use master and getting this, I think back from the IPA instance | 11:04 |
derekh | {u'debuginfo': None, u'faultcode': u'Client', u'faultstring': u'Not found: Extension with id iscsi not found.'} | 11:04 |
derekh | dtantsur: ^ seen that befor ? | 11:04 |
dtantsur | derekh, I suspect dependency problem prevents iscsi.py from loading | 11:04 |
sambetts | vdrok: cool, thats what I'm seeing happening and I wanted to make sure that was correct, have you ever seen the unable to find the required MBR error ? | 11:04 |
derekh | dtantsur: yup, thats what I suspect as well, ok, I'll go digging a bit | 11:04 |
derekh | dtantsur: sambetts thanks | 11:04 |
vdrok | sambetts: nope :( | 11:05 |
dtantsur | derekh, first bet will be to compare list of requirements with the actual openstack-ironic-python-agent dependencies | 11:05 |
sambetts | vdrok: bummer :P looks like I'll have to debug this futher myself | 11:05 |
derekh | dtantsur: will do | 11:05 |
openstackgerrit | Aline Bousquet proposed openstack/ironic-lib: Add support for metrics https://review.openstack.org/301526 | 11:05 |
*** karimb has joined #openstack-ironic | 11:07 | |
dtantsur | sambetts, ifarkas, aarefiev, when do you think is the good time to start removing support for the old bash ramdisk from inspector? | 11:07 |
sambetts | dtantsur: asap :) | 11:07 |
dtantsur | morning jroll, I see you're here ;) | 11:07 |
jroll | what'd I do | 11:07 |
jroll | oh | 11:07 |
jroll | hey, good morning :) | 11:07 |
sambetts | hey jroll | 11:08 |
dtantsur | so, I think about removing the -dib gate from inspector master | 11:08 |
dtantsur | and then slowly proceeding with removing everything else | 11:08 |
vdrok | morning jroll :) | 11:08 |
aarefiev | sambetts: +1 :) | 11:08 |
dtantsur | or maybe we should make a M1 release before, dunno | 11:08 |
aarefiev | jroll: morning | 11:08 |
dtantsur | jroll, before I forgot: infra folks brought to my attention that all voting check jobs should be running in gate. I don't agree with their position, but here it is. | 11:09 |
sambetts | Are we in the same situation as Ironic with the bash ramdisk and the dib element because of DIBs backward compat issues? | 11:09 |
dtantsur | jroll, currently our job for the old ramdisk does not run in gate (ditto for inspector) | 11:09 |
dtantsur | sambetts, nope. DIB does not have an inspector gate at all | 11:10 |
jroll | dtantsur: I thought we discussed this before :/ | 11:10 |
dtantsur | dunno | 11:10 |
ifarkas | dtantsur, yeah, I don't think we want to bash ramdisk at all | 11:10 |
sambetts | dtantsur: oh good, then thats good | 11:10 |
jroll | dtantsur: where can I find this discussion? | 11:10 |
jroll | was it today? yesterday? | 11:10 |
dtantsur | jroll, on https://review.openstack.org/300989 | 11:10 |
jroll | dtantsur: ah, thanks. hm. | 11:12 |
jroll | dtantsur: I see nova doesn't follow this either, I will follow up | 11:12 |
dtantsur | jroll, yes please | 11:13 |
*** Marga_ has joined #openstack-ironic | 11:15 | |
*** Marga_ has quit IRC | 11:16 | |
*** Marga_ has joined #openstack-ironic | 11:16 | |
openstackgerrit | vinay kumar muddu proposed openstack/ironic-python-agent: [WIP] Fix local boot issue with fedora in uefi mode https://review.openstack.org/302143 | 11:23 |
*** Goneri has quit IRC | 11:25 | |
*** dtantsur is now known as dtantsur|brb | 11:28 | |
mgould | morning jroll | 11:34 |
jroll | hiya mgould | 11:34 |
openstackgerrit | Aayush Rajoria proposed openstack/ironic: Add REST API for volume target operation https://review.openstack.org/285221 | 11:34 |
openstackgerrit | Aayush Rajoria proposed openstack/ironic: Introduce new RPCs to support volume target operations https://review.openstack.org/285220 | 11:34 |
openstackgerrit | Aayush Rajoria proposed openstack/ironic: Introduce VolumeTarget object https://review.openstack.org/285219 | 11:34 |
openstackgerrit | Aayush Rajoria proposed openstack/ironic: Add volume_targets table to save target information https://review.openstack.org/285218 | 11:34 |
mgould | also vdrok ifarkas aarefiev | 11:34 |
mat128 | Good morning everyone :) | 11:36 |
openstackgerrit | xiexs proposed openstack/python-ironicclient: Add multi nodes support for "baremetal delete" command https://review.openstack.org/289676 | 11:37 |
mat128 | Unable to tag wishlist for this: https://bugs.launchpad.net/ironic-python-agent/+bug/1566043 , is it reserved for cores? | 11:37 |
openstack | Launchpad bug 1566043 in ironic-python-agent "[RFE] Agent 'forgets' about cached image on reboot" [Undecided,Confirmed] - Assigned to Clif Houck (f-te-u) | 11:37 |
*** shu-mutou has quit IRC | 11:37 | |
*** karimb has quit IRC | 11:41 | |
vmud213 | morning mgould,jroll | 11:43 |
vmud213 | morning mat128 | 11:43 |
jroll | hi vmud213 \o | 11:44 |
mat128 | hello vmud213 | 11:44 |
mgould | vmud213, mat128 morning! | 11:45 |
openstackgerrit | Milan Kováčik proposed openstack/python-ironic-inspector-client: Introspection on stored data https://review.openstack.org/302195 | 11:50 |
mat128 | clif_h: with relation to your bug (agent forgets cached image), I would like to work on the spec with you | 11:51 |
TheJulia | good morning | 11:55 |
vdrok | Morning mgould mat128 and TheJulia | 11:57 |
mat128 | good morning vdrok | 11:57 |
*** ohamada has quit IRC | 11:58 | |
mgould | morning TheJulia | 11:58 |
sambetts | Morning TheJulia | 12:00 |
sambetts | jroll: my post job for tinyipa got approved :D | 12:00 |
jroll | \o/ | 12:00 |
sambetts | jroll: I'll get some patches out to add a non-src job for tinyipa to ironic and to keep the src job on IPA | 12:01 |
jroll | sambetts: awesome, I'd ilke to get that voting as well | 12:02 |
sambetts | jroll: although we need an IPA merge to trigger it :-P | 12:02 |
jroll | maybe after the non-src job | 12:02 |
jroll | heh, yeah | 12:02 |
jroll | dmitry's thing has 2+2 | 12:02 |
sambetts | awesome :D | 12:03 |
jroll | I'm leaving it for someone else to approve, so once that's through you'll have an image | 12:03 |
jroll | once we have the non-src job green, I'd say make it vote | 12:03 |
jroll | we should do the same for ipmitool, and probably drop ssh drivers | 12:03 |
sambetts | sweet! | 12:03 |
TheJulia | krotscheck: you likely already know this, but the jobs with npm are still looking grumpy with stuff from registry :( | 12:04 |
jroll | TheJulia: /topic :P | 12:04 |
* TheJulia needs more coffee | 12:04 | |
TheJulia | Had to help out a friend and let them crash at our place around 1 AM locally, my brain is le scrambled | 12:05 |
jroll | ouch, hope they're doing better today | 12:06 |
*** Marga_ has quit IRC | 12:07 | |
*** Marga_ has joined #openstack-ironic | 12:09 | |
*** e0ne has quit IRC | 12:13 | |
*** raildo-afk is now known as raildo | 12:14 | |
*** mat128 is now known as mat128|afk | 12:15 | |
*** baoli has joined #openstack-ironic | 12:16 | |
*** e0ne has joined #openstack-ironic | 12:17 | |
*** divya_ has joined #openstack-ironic | 12:18 | |
divya_ | No valid host was found. Reason: No conductor service registered which supports driver agent_ssh. (HTTP 400 | 12:19 |
*** wuhg has quit IRC | 12:19 | |
divya_ | getting error during node creation | 12:19 |
divya_ | anybody plz help | 12:19 |
sambetts | divya_: Do you have an ironic conductor configured that supports the agent_ssh driver? | 12:20 |
divya_ | enabled_drivers = fake,agent_ssh,agent_ipmitool,pxe_ssh,pxe_ipmitool | 12:21 |
divya_ | i have these in my enabled drivers | 12:21 |
*** baoli_ has joined #openstack-ironic | 12:21 | |
sambetts | is the conductor starting successfully ? | 12:22 |
divya_ | no.. the conductor error is displayed | 12:22 |
divya_ | return f(*args, **kwargs) 2016-04-06 17:15:37.813 TRACE futurist.periodics File "/opt/stack/ironic/ironic/common/driver_factory.py", line 221, in _init_extension_manager 2016-04-06 17:15:37.813 TRACE futurist.periodics raise exception.DriverNotFound(driver_name=names) 2016-04-06 17:15:37.813 TRACE futurist.periodics DriverNotFound: Could not find the following driver(s): flat. 2016-04-06 17:15:37.813 TRACE futurist. | 12:22 |
*** trown|outtypewww is now known as trown | 12:23 | |
sambetts | divya_: when you downloaded the ironic neutron intergration patches did you reinstall the package? | 12:23 |
divya_ | in devstack? | 12:24 |
divya_ | no | 12:24 |
divya_ | how to reinstall in devstack | 12:24 |
sambetts | you have to re-install Ironic for the setup.cfg entry points to be detected successfully, e.g. pip install -e /opt/stack/ironic | 12:24 |
*** baoli has quit IRC | 12:24 | |
sambetts | then restart all the Ironic services | 12:25 |
divya_ | Perhaps your account does not have write access to this directory? If the installation directory is a system-owned directory, you may need to sign in as the administrator or "root" account. If you do not have administrative access to this machine, you may wish to choose a different installation directory, preferably one that is listed in your PYTHONPATH environment variable. For information on | 12:27 |
sambetts | sudo pip install ... | 12:28 |
sambetts | sorry I forgot its a global install so you need sudo | 12:28 |
divya_ | i installed and restarted ironic conductor service | 12:29 |
divya_ | still restarting... | 12:29 |
openstackgerrit | Vasyl Saienko proposed openstack/python-ironicclient: Updates supporting ironic-neutron integration https://review.openstack.org/206144 | 12:33 |
openstackgerrit | Sam Betts proposed openstack/ironic: Enable download of tinyipa prebuilt image https://review.openstack.org/302218 | 12:35 |
*** Marga_ has quit IRC | 12:36 | |
xavierr | good morning all :) | 12:37 |
sambetts | Morning xavierr | 12:37 |
xavierr | sambetts, morning | 12:37 |
*** achanda has joined #openstack-ironic | 12:38 | |
*** achanda has quit IRC | 12:43 | |
*** dprince has joined #openstack-ironic | 12:44 | |
openstackgerrit | Julia Kreger proposed openstack/ironic: Rename juno name stat modificaiton method https://review.openstack.org/302224 | 12:45 |
thiagop | good morning Ironic | 12:46 |
TheJulia | good morning thiagop | 12:46 |
mgould | morning thiagop | 12:46 |
openstackgerrit | Julia Kreger proposed openstack/ironic: Rename juno name state modification method https://review.openstack.org/302224 | 12:46 |
openstackgerrit | Andre Aranha proposed openstack/python-oneviewclient: Added get_server_profile_by_uuid https://review.openstack.org/302225 | 12:47 |
*** karimb has joined #openstack-ironic | 12:49 | |
openstackgerrit | xiexs proposed openstack/python-ironicclient: Add multi nodes support for "baremetal delete" command https://review.openstack.org/289676 | 12:52 |
openstackgerrit | Milan Kováčik proposed openstack/ironic-inspector: Allow rerunning introspection on stored data https://review.openstack.org/267637 | 12:53 |
*** bharathk has quit IRC | 12:54 | |
thiagop | TheJulia mgould o/ | 12:55 |
*** links has quit IRC | 12:56 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic: Updated from global requirements https://review.openstack.org/302012 | 12:58 |
sambetts | jroll: https://review.openstack.org/#/c/302242/ and https://review.openstack.org/#/c/302218/ | 13:03 |
*** smoriya_ has quit IRC | 13:03 | |
openstackgerrit | Andre Aranha proposed openstack/python-oneviewclient: Added get_server_profile_by_uuid and changed model https://review.openstack.org/302225 | 13:03 |
*** awiddersheim has joined #openstack-ironic | 13:05 | |
*** karimb has quit IRC | 13:06 | |
sambetts | jroll: if anything I want the depends-on the other way around right? we should have the job merged before the functionality | 13:12 |
jroll | sambetts: well, the job will always fail until the code is there, right? | 13:13 |
jroll | so no sense in wasting nodes | 13:13 |
jroll | we can't test on top of a project-config change anyway, as it doesn't take effect until merged | 13:13 |
sambetts | jroll: right, but the test will be there then to make sure that the code is correct, right from the start? | 13:13 |
jroll | sure, but not a huge deal if it isn't right, and that way we aren't wasting gate nodes in the meantime | 13:14 |
*** kozhukalov has quit IRC | 13:14 | |
sambetts | jroll: make sense I guess | 13:14 |
openstackgerrit | Vasyl Saienko proposed openstack/python-ironicclient: Updates supporting ironic-neutron integration https://review.openstack.org/206144 | 13:14 |
jroll | sambetts: I mean, for a huge feature like the neutron work, it makes sense to have an experimental job, but this is a simple devstack change, I think we'll be okay :) | 13:15 |
*** kozhukalov has joined #openstack-ironic | 13:16 | |
*** cdearborn has joined #openstack-ironic | 13:16 | |
sambetts | :) | 13:17 |
openstackgerrit | Milan Kováčik proposed openstack/python-ironic-inspector-client: Introspection on stored data https://review.openstack.org/302195 | 13:17 |
*** Goneri has joined #openstack-ironic | 13:18 | |
*** rbudden has joined #openstack-ironic | 13:18 | |
*** dprince has quit IRC | 13:22 | |
*** jayc has joined #openstack-ironic | 13:26 | |
openstackgerrit | vinay kumar muddu proposed openstack/ironic-python-agent: Fix local boot issue with fedora in uefi mode https://review.openstack.org/302143 | 13:26 |
*** dprince has joined #openstack-ironic | 13:29 | |
*** alex_xu has quit IRC | 13:33 | |
*** ametts has joined #openstack-ironic | 13:35 | |
*** alex_xu has joined #openstack-ironic | 13:35 | |
*** mtanino has joined #openstack-ironic | 13:37 | |
*** amotoki has joined #openstack-ironic | 13:39 | |
*** garthb has joined #openstack-ironic | 13:42 | |
*** mvpnitesh has quit IRC | 13:49 | |
TheJulia | Can anyone confirm that https://15.184.134.36/74/300674/2/check/gate-tempest-ironic-ilo-driver-iscsi_ilo/60e14ac/ loads for them? | 13:52 |
Nisha | TheJulia, it works without the VPN | 13:55 |
TheJulia | congrats Nisha | 13:55 |
Nisha | but when i am in CI VPN it doesnt | 13:56 |
Nisha | Thanks TheJulia but i think it is still not completely resolved | 13:56 |
Nisha | TheJulia, wait let me try doing CI test again...whether i am able to access git from the slaves now or now | 13:57 |
Nisha | not* | 13:57 |
TheJulia | ok | 13:57 |
TheJulia | you know what information to send me to review to try and provide insight now :) | 13:57 |
*** Nisha_away has joined #openstack-ironic | 14:02 | |
*** electrofelix has quit IRC | 14:02 | |
*** cdearborn has quit IRC | 14:04 | |
*** Nisha has quit IRC | 14:04 | |
*** karimb has joined #openstack-ironic | 14:04 | |
*** saripurigopi has joined #openstack-ironic | 14:06 | |
*** jaybeale has joined #openstack-ironic | 14:06 | |
*** mtanino has quit IRC | 14:08 | |
*** vmud213 has quit IRC | 14:09 | |
mkovacik | dtantsur|brb, sambetts , hi guys, please, recheck https://review.openstack.org/#/c/267637 when you've got some spare time; needed to rebase it. Thanks a lot! | 14:12 |
NobodyCam | good morning Ironicers | 14:13 |
*** mkovacik has quit IRC | 14:13 | |
openstackgerrit | Marcellin Fom Tchassem proposed openstack/ironic-inspector: Make tox respect upper-constraints.txt https://review.openstack.org/301700 | 14:14 |
mat128|afk | morning NobodyCam | 14:14 |
TheJulia | good morning NobodyCam | 14:14 |
*** mat128|afk is now known as mat128 | 14:14 | |
NobodyCam | :) | 14:14 |
TheJulia | mat128: updating the ipa rev won't be until later today, evening and morning got interrupted :( | 14:14 |
thiagop | good mornin' NobodyCam | 14:17 |
mat128 | TheJulia: no problem at all :) | 14:19 |
mgould | morning NobodyCam | 14:19 |
NobodyCam | :) | 14:20 |
* NobodyCam resists a morning ping | 14:20 | |
mat128 | feels great doesnt it? :P | 14:21 |
mat128 | anything to announce? | 14:21 |
sambetts | Morning NobodyCam | 14:21 |
NobodyCam | lol not here just got first cup of coffee | 14:21 |
NobodyCam | :) | 14:21 |
TheJulia | coffee sounds like such a good idea | 14:21 |
mat128 | indeed | 14:22 |
* mat128 goes afk for 5 minutes, getting some coffee | 14:22 | |
*** mat128 is now known as mat128|afk | 14:22 | |
NobodyCam | :) | 14:22 |
*** achanda has joined #openstack-ironic | 14:26 | |
*** mat128|afk is now known as mat128 | 14:29 | |
*** Goneri has quit IRC | 14:32 | |
vdrok | morning NobodyCam :) | 14:36 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: IPMItool: add IPMIIcsConsole class https://review.openstack.org/301715 | 14:38 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: console utils: add methods for ironic console server https://review.openstack.org/301714 | 14:38 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: conductor manager: apply console-log related methods https://review.openstack.org/301717 | 14:38 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: REST API: add an API controller for console log https://review.openstack.org/301718 | 14:38 |
openstackgerrit | Akira YOSHIYAMA proposed openstack/ironic: WIP: add ironic-console-server https://review.openstack.org/302291 | 14:38 |
*** electrofelix has joined #openstack-ironic | 14:40 | |
*** ohamada has joined #openstack-ironic | 14:40 | |
NobodyCam | morning :) | 14:41 |
*** spandhe has joined #openstack-ironic | 14:41 | |
*** Nisha_away is now known as Nisha | 14:45 | |
*** dprince has quit IRC | 14:46 | |
*** Goneri has joined #openstack-ironic | 14:46 | |
*** thiagop has quit IRC | 14:47 | |
* Nisha needs the https://review.openstack.org/266803, https://review.openstack.org/264590 and https://review.openstack.org/264579 to be merged in upstream. These are required ilo driver public CI | 14:47 | |
clif_h | mat128: sure, what are your thoughts? | 14:47 |
NobodyCam | Nisha: those are to support CI? | 14:48 |
Nisha | yes | 14:48 |
mat128 | Well, we would need to store the image UUID somewhere | 14:48 |
*** sinval-afk has quit IRC | 14:48 | |
NobodyCam | I will take a look in a few :) | 14:48 |
clif_h | right, and there's no mechanism (that I know of) to do persistent storage for the agent on the machine locally | 14:49 |
mat128 | that will survive a reboot | 14:49 |
clif_h | right | 14:49 |
mat128 | maybe we can store the image uuid somewhere on the disk? | 14:49 |
*** raildo is now known as raildo-afk | 14:49 | |
clif_h | that sounds tricky | 14:49 |
*** sinval-afk has joined #openstack-ironic | 14:49 | |
clif_h | where would there be a guaranteed safe spot on disk | 14:50 |
clif_h | that won't interfere with images on disk | 14:50 |
*** mdorman has joined #openstack-ironic | 14:50 | |
*** thiagop has joined #openstack-ironic | 14:50 | |
*** raildo-afk is now known as raildo | 14:51 | |
clif_h | one method that JayF proposed was having the agent inpsect its own metadata from ironic on heartbeat | 14:51 |
clif_h | and if the agent finds it should have a cached image, but no record of it in memory, then grab the checksum from ironic and re-verify the image exists | 14:52 |
clif_h | this would depend on having my caching patch in ironic | 14:52 |
openstackgerrit | Merged openstack/ironic: Enable download of tinyipa prebuilt image https://review.openstack.org/302218 | 14:52 |
clif_h | which is something I need to work on | 14:52 |
mat128 | you can't verify the checksum for an extracted image | 14:53 |
mat128 | so ironic declares which cached image the node should have | 14:53 |
mat128 | and we compare whats on disk with it | 14:53 |
clif_h | for reference: https://review.openstack.org/#/c/161832/ | 14:53 |
*** achanda has quit IRC | 14:53 | |
mat128 | or you re-deploy that image every time the machine reboots | 14:53 |
clif_h | oh yeah I guess that does add a wrinkle | 14:54 |
mat128 | oh, didnt see 161832 | 14:54 |
clif_h | its been around a while | 14:54 |
clif_h | and i need to update it | 14:54 |
*** mtanino has joined #openstack-ironic | 14:54 | |
clif_h | its running at Rackspace though :D | 14:55 |
mat128 | heh | 14:55 |
mag009_ | morning all | 14:55 |
NobodyCam | morning | 14:55 |
mat128 | is Ironic managing the fact that you have X machines up at all times or an external system? | 14:55 |
mat128 | just curious | 14:55 |
mag009_ | how/where do you guys handle the removal of efiboot menu so it does not boot onto disk when you rebuild a server in uefi mode ? | 14:56 |
mag009_ | I tested it and it keep booting into my disk and my boot order is disk -> nic 1 -> nic 2 etc.. | 14:56 |
clif_h | mat128: what do you mean? | 14:57 |
mag009_ | I see that the flag pxe is set over ipmi but it only try the first nic 1 and then boot onto disk | 14:57 |
mat128 | clif_h: 161832 is about having nodes with pre-cached images | 14:57 |
clif_h | oh | 14:57 |
mat128 | was wondering what in Ironic manages this | 14:57 |
*** spandhe_ has joined #openstack-ironic | 14:57 | |
clif_h | yeah so there's an external program that manages the cache: https://github.com/rackerlabs/arsenal | 14:57 |
*** spandhe has quit IRC | 14:59 | |
*** spandhe_ is now known as spandhe | 14:59 | |
mag009_ | anyone had that kind of issue? | 14:59 |
clif_h | it incorporates data about flavors, available nodes, and image weights to make decisions about cache management | 15:00 |
*** mdorman has left #openstack-ironic | 15:00 | |
*** mbound has quit IRC | 15:01 | |
*** mbound has joined #openstack-ironic | 15:01 | |
*** saripurigopi has quit IRC | 15:02 | |
mat128 | clif_h: very interesting | 15:04 |
mat128 | that was the missing piece of the puzzle | 15:04 |
mat128 | :) | 15:04 |
*** saripurigopi has joined #openstack-ironic | 15:04 | |
openstackgerrit | Merged openstack/ironic-lib: Explore config options to oslo-config-generator https://review.openstack.org/297549 | 15:05 |
clif_h | yeah caching's not as useful unless you've got something to manage it | 15:05 |
*** b_bezak has quit IRC | 15:06 | |
clif_h | mat128: what makes you interested in the bug I filed? | 15:06 |
*** b_bezak has joined #openstack-ironic | 15:06 | |
mat128 | clif_h: without knowing about 161832, I had seen the caching calls in IPA and thought about the theoretical case of pre-caching an image and losing it's track | 15:08 |
*** itamarl has quit IRC | 15:08 | |
mat128 | but seeing 161832, I think the UUID for the cached image can be in Ironic | 15:09 |
mat128 | similar to cache_status | 15:09 |
*** mbound has quit IRC | 15:09 | |
mat128 | your patch already brings the fact that we read and use cache_status to determine if a re-imaging is required | 15:09 |
jroll | +1 for storing the image id in ironic | 15:09 |
jroll | or just never reboot anything :P | 15:09 |
NobodyCam | mornign jroll :) | 15:09 |
mat128 | Haha yes | 15:09 |
jroll | NobodyCam: mornin' :D | 15:10 |
mat128 | Now, how do you manage a node that Ironic claims to have cached but isnt cached | 15:10 |
openstackgerrit | Merged openstack/ironic: Updated from global requirements https://review.openstack.org/302012 | 15:10 |
jroll | NobodyCam: finally hitting the road here in a couple hours \o/ | 15:10 |
clif_h | mat128: afaict, everything still works, it just results in a cache miss which ironic thought would be a hit | 15:11 |
*** b_bezak has quit IRC | 15:11 | |
NobodyCam | jroll: awesome. remember to stop and enjoy some of the sights onthe road.. :) | 15:11 |
*** absubram has joined #openstack-ironic | 15:11 | |
mat128 | clif_h: if we introduce our behavior, Ironic/IPA will think it's already imaged and will result in an invalid image | 15:11 |
jroll | NobodyCam: of course :) original plan was to leave tomorrow so we're way ahead of schedule | 15:11 |
NobodyCam | oh awesome :) | 15:12 |
clif_h | mat128: mmm, I'm fairly certain the agent doesn't know its imaged, so it re-downloads the image and proceeds normally | 15:12 |
clif_h | if ironic claims the node has a cached image, but the agent doesn't know about it | 15:12 |
mat128 | right now the agent skips if the requested image matches what's on disk | 15:13 |
mat128 | based on the value thats in memory | 15:13 |
mat128 | and we lose this when rebooting | 15:13 |
clif_h | right | 15:13 |
mat128 | so either IPA relies on what's in Ironic, or Ironic doesnt call when it's supposed to be already cached | 15:13 |
mat128 | only does the configdrive | 15:13 |
mat128 | and reboots | 15:13 |
clif_h | you're saying: What if IPA thinks image X is on disk, but it's not? | 15:13 |
mat128 | hmm | 15:14 |
clif_h | oh | 15:14 |
clif_h | so | 15:14 |
mat128 | pretty much, right now, Ironic always asks IPA and IPA does a noop when it matches | 15:14 |
*** rama_y has joined #openstack-ironic | 15:14 | |
mat128 | if we move this logic to Ironic, we might end up with an invalid image | 15:14 |
*** garthb has quit IRC | 15:14 | |
clif_h | I'm thinking IPA should only rely on Ironic if Ironic thinks it has an image cached, but IPA doesn't know about it | 15:14 |
clif_h | if IPA detects that situation, it should download the image and cache it | 15:15 |
clif_h | or recache it | 15:15 |
mat128 | so IPA upon booting immediately caches what Ironic thinks should be cached? | 15:15 |
mat128 | is that it? | 15:15 |
mat128 | without checking whats already on disk | 15:15 |
clif_h | that's what JayF proposed and it sounds plausible | 15:15 |
clif_h | well | 15:15 |
mat128 | so every reboot you essentially re-cache the image | 15:16 |
mat128 | but at least you save time when it comes to the actual deployment | 15:16 |
clif_h | you can check what's on disk, but like you said, since it unzips it, its going to be more difficult to re-verify | 15:16 |
mat128 | can you really check what's on disk? | 15:16 |
*** Marga_ has joined #openstack-ironic | 15:16 | |
mat128 | even forgetting about the checksum part | 15:16 |
mat128 | I guess you could in a RAW scenario | 15:17 |
mat128 | we're on qcow | 15:17 |
mat128 | Let's go back to the original issue | 15:17 |
mat128 | Ironic caches an image on a node, thanks to 161832 | 15:17 |
mat128 | Node reboots | 15:18 |
mat128 | cache_status still says "cached" | 15:18 |
mat128 | cache miss, ends up downloading image, wasting precious time | 15:18 |
mat128 | image was still cached on the disk, so it's a false miss | 15:18 |
*** jcoufal has joined #openstack-ironic | 15:19 | |
clif_h | that's my understanding | 15:19 |
*** dtantsur|brb is now known as dtantsur | 15:19 | |
mat128 | so if Ironic caches the image UUID along with "cache_status" | 15:19 |
mat128 | that means Ironic does not even issue prepare_image to IPA | 15:20 |
mat128 | only does configdrive (that needs to be possible, but thats easy) | 15:20 |
mat128 | the alternative is having IPA check with Ironic what it should have, and consider this instead of it's own variable when getting the prepare_image call | 15:20 |
*** Nisha_away has joined #openstack-ironic | 15:21 | |
mat128 | the other alternative doesnt involve Ironic, only IPA and the machine: store on disk the image UUID and read it when you prepare_image | 15:22 |
mat128 | but you need a place to store this, thats harder IMO | 15:23 |
*** Nisha has quit IRC | 15:23 | |
mat128 | clif_h: to go along your patch (161832) I think I would just store the UUID | 15:23 |
jroll | you're never going to find a place on disk that isn't going to break someone somehow | 15:24 |
mat128 | and either seed the cache with the UUID then normally call prepare_image (least impact), or call something else that only takes care of the configdrive | 15:24 |
dtantsur | morning to everyone I missed while I was out | 15:24 |
mat128 | jroll: thats it, the alternative to caching the UUID is matching it back with the checksum, but that's hard/impossible, even on raw images (you need to know where the data ends) | 15:24 |
mat128 | morning dtantsur | 15:25 |
jroll | yep | 15:25 |
jroll | I don't think you can do this without ironic's cooperation | 15:25 |
mat128 | jroll: so thats out of the question | 15:25 |
Nisha_away | jroll, i need the https://review.openstack.org/266803, https://review.openstack.org/264590 and https://review.openstack.org/264579 to be merged in upstream. These are required ilo driver public CI | 15:25 |
mat128 | as I said, with the foundation that 161832 sets, I think simply caching the UUID would work | 15:26 |
mat128 | (in ironic) | 15:26 |
mat128 | and IPA when booting should read the cache_image_uuid and use that information in prepare_image | 15:26 |
jroll | Nisha_away: 1) the first patch is in merge conflict, the second isn't passing CI. (first/second in the chain, not in your list there). 2) I don't have time this week, sorry | 15:26 |
Nisha_away | jroll, oh it wasnt in merge conflict some time back | 15:27 |
Nisha_away | let me see | 15:27 |
jroll | Nisha_away: it doesn't look like it is, but it says "cannot merge" | 15:27 |
jroll | anyway, gotta run, see y'all tomorrow morning or something | 15:27 |
Nisha_away | thats the main reason we need them upstream. as we need to cherrypick in CI | 15:27 |
Nisha_away | ok let me see | 15:27 |
mat128 | jroll: drive safe | 15:28 |
*** sukhdev has joined #openstack-ironic | 15:29 | |
*** rajinir has joined #openstack-ironic | 15:32 | |
*** moshele has quit IRC | 15:32 | |
*** saripurigopi has quit IRC | 15:33 | |
*** moshele has joined #openstack-ironic | 15:33 | |
*** moshele has quit IRC | 15:35 | |
*** ametts has quit IRC | 15:36 | |
*** praneshp_ has joined #openstack-ironic | 15:37 | |
*** divya_ has quit IRC | 15:38 | |
*** Sukhdev_ has joined #openstack-ironic | 15:51 | |
*** electrofelix has quit IRC | 15:56 | |
*** garthb has joined #openstack-ironic | 15:56 | |
sambetts | TheJulia: ever seen an Unable to find request MBR signature when chain loading a whole disk image via PXE? | 15:59 |
*** Nisha_brb has joined #openstack-ironic | 16:00 | |
TheJulia | sambetts: pondering | 16:00 |
TheJulia | sambetts: is there actually an MBR on the disk? | 16:01 |
JayF | yeah that has to be the pxelinux error indicating no mbr | 16:02 |
TheJulia | that is what I'm thinking | 16:02 |
TheJulia | tell it to boot local and see what happens? :) | 16:03 |
sambetts | TheJulia: :/ its a brand new machine, and a brand new virtual disk I created, I'm seeing this after IPA successfully writes the image to the disk and it reboots to load the user image | 16:03 |
TheJulia | how was the image created? | 16:03 |
*** Nisha_away has quit IRC | 16:03 | |
sambetts | DIB, and its working on other nodes :/ | 16:04 |
TheJulia | does the bios expose any else that could be considered a disk? | 16:04 |
TheJulia | sambetts: are you pxe chainloading the other nodes as well or are they local booting? | 16:05 |
sambetts | TheJulia: chain loading too, they are all deploying the same way | 16:05 |
sambetts | Just trying to manually change the boot order to the disk to make it boot | 16:06 |
sambetts | and see if it works | 16:06 |
TheJulia | worth trying :\ | 16:07 |
TheJulia | sambetts: you said newer hardware, is it something commercially available that we can maybe sift through documentation on? | 16:08 |
sambetts | TheJulia: manually selecting the raid adaptor in the on screen boot menu lead to a success boot | 16:09 |
TheJulia | hmmmmm... | 16:09 |
*** jistr has quit IRC | 16:10 | |
sambetts | I made sure to only create 1 virtual disk too because I thought that it might be trying to boot the wrong disk or something | 16:10 |
TheJulia | sambetts: what is the disk identifier getting saved out to the pxe config? | 16:14 |
*** karimb has quit IRC | 16:14 | |
openstackgerrit | Chris Krelle proposed openstack/ironic: Add support for the audit middleware https://review.openstack.org/272658 | 16:14 |
*** b_bezak has joined #openstack-ironic | 16:15 | |
*** karimb has joined #openstack-ironic | 16:15 | |
sambetts | TheJulia: that I'm not sure, because these nodes are running in my CI so I can't access the data files created during deploy properly | 16:17 |
openstackgerrit | Marcellin Fom Tchassem proposed openstack/ironic-inspector: Make tox respect upper-constraints.txt https://review.openstack.org/301700 | 16:20 |
*** saripurigopi has joined #openstack-ironic | 16:20 | |
TheJulia | sambetts: are you planning the same boot method for testing any tenant isolation in your CI? | 16:20 |
*** karimb has quit IRC | 16:20 | |
*** b_bezak has quit IRC | 16:21 | |
sambetts | TheJulia: looking at the code {{ DISK_IDENTIFIER }} is all that is written into mbr: :/ I can't see anywhere where it gets replaced by something | 16:21 |
sambetts | TheJulia: ah! Found it in deploy utils | 16:22 |
sambetts | TheJulia: right now we're just testing flat, we've not got the infra setup for tenant isolation | 16:23 |
TheJulia | sambetts: that was kind of what I was guessing, but then again maybe you've written a namespace aware conductor patch or something ;) | 16:24 |
*** jayc has quit IRC | 16:24 | |
*** keedya has joined #openstack-ironic | 16:24 | |
TheJulia | sambetts: out of curiosity, how big is the volume? | 16:25 |
sambetts | TheJulia: heh not yet ;) | 16:25 |
TheJulia | sambetts: it is something that has crossed my mind and I've had a few discussions on recently, fwiw :) | 16:26 |
sambetts | TheJulia: the virtual volume is 600gb, I made sure to keep it within mbr | 16:26 |
*** daemontool has quit IRC | 16:28 | |
sambetts | TheJulia: I have actually been looking to solve it in a slightly differnt way, instead of making the conductor namespace aware, I have a half working ironic-conductor-proxy service, similar to the metadata proxy service from neutron | 16:28 |
TheJulia | sambetts: I was actually thinking the same | 16:28 |
*** jistr has joined #openstack-ironic | 16:28 | |
TheJulia | just not calling it a proxy of sorts | 16:29 |
TheJulia | sambetts: clearly, we need to chat about this at Summit | 16:29 |
sambetts | yes :-P | 16:29 |
*** moshele has joined #openstack-ironic | 16:29 | |
sambetts | TheJulia: tbh the hardest part about it is the tftp part because its UDP not tcp, but I'm nearly there | 16:30 |
*** trown is now known as trown|lunch | 16:30 | |
*** jayc has joined #openstack-ironic | 16:30 | |
TheJulia | sambetts: I was thinking do it as all ipxe behond a base tftp offering to upgrade to ipxe | 16:30 |
TheJulia | beyond a base | 16:30 |
*** ohamada has quit IRC | 16:31 | |
*** xavierr has quit IRC | 16:32 | |
*** jtomasek has quit IRC | 16:33 | |
TheJulia | sambetts: I'm kind of thinking the best route is to add as much debug info collection to your CI job scripts as possible so we can dig into a single failure and piece the entire puzzle back together, I'm really wondering about what something like a rescue disk sees as block devices on the system, but that may also just be a red herring | 16:33 |
*** jistr is now known as jistr|off | 16:34 | |
*** Marga_ has quit IRC | 16:34 | |
*** dprince has joined #openstack-ironic | 16:34 | |
sambetts | TheJulia: yeah, I'm wondering what is getting set are the root_uuid/disk_id in the internal info | 16:34 |
TheJulia | only one way to find out :) | 16:35 |
dtantsur | any cores feel like approving https://review.openstack.org/#/c/300548/ ? 2x +2 already | 16:35 |
* TheJulia looks | 16:36 | |
sambetts | TheJulia: man I wish the Ironic API logs logged the data that it received in each request.. . | 16:36 |
*** Marga_ has joined #openstack-ironic | 16:37 | |
dtantsur | sambetts, it's pretty bad that we don't log data tbh. might be a problem in oslo.service/wsme/whatever we use now | 16:37 |
sambetts | dtantsur: I'm sure the other services do it :/ but in our logs we log the data we send/receive to/from keystone each time but not the actual data we're processing | 16:38 |
*** saripurigopi has quit IRC | 16:39 | |
dtantsur | lol. do we have a bug for it? | 16:39 |
sambetts | dtantsur: not seen one | 16:40 |
dtantsur | mind filing? there are plenty of people looking for easy bugs to fix | 16:40 |
*** itamarl has joined #openstack-ironic | 16:40 | |
*** Nisha_away has joined #openstack-ironic | 16:43 | |
*** xavierr has joined #openstack-ironic | 16:43 | |
sambetts | dtantsur: https://bugs.launchpad.net/ironic/+bug/1566976 | 16:43 |
openstack | Launchpad bug 1566976 in Ironic "Ironic API does not log the request and response data for each request even in DEBUG mode" [Undecided,New] | 16:43 |
*** Marga_ has quit IRC | 16:44 | |
*** Nisha has joined #openstack-ironic | 16:45 | |
*** ChubYann has joined #openstack-ironic | 16:46 | |
*** Nisha_brb has quit IRC | 16:46 | |
JayF | sambetts: I hate that bug so much | 16:47 |
*** Nisha_away has quit IRC | 16:47 | |
*** suro-patz has joined #openstack-ironic | 16:48 | |
sambetts | JayF: hate as in want it fixed or hate as in don't want it fixed? | 16:48 |
*** amotoki has quit IRC | 16:48 | |
devananda | I do not believe we should log the request data | 16:48 |
dtantsur | even in DEBUG mode? I can't count number of times when logging incoming inspection data saved me.. | 16:48 |
sambetts | ohai devananda | 16:48 |
devananda | hi :) | 16:48 |
dtantsur | also morning devananda :) | 16:48 |
* devananda is travelling and in weird timezones // with poor network | 16:49 | |
JayF | sambetts: hate as in I've wanted it fixed since I staretd working on Ironic | 16:49 |
JayF | sambetts: but as you see now, not everyone agrees :) | 16:49 |
* JayF belives we should log request data, and probably higher than DEBUG | 16:50 | |
JayF | I log all requests to my ironic api cluster via the load balancer already | 16:50 |
*** saripurigopi has joined #openstack-ironic | 16:50 | |
*** derekh has quit IRC | 16:50 | |
dtantsur | higher than DEBUG is probably a bit too much, but with DEBUG - I'm all for it | 16:50 |
JayF | I'm pretty sure I run in DEBUG anyway, so it doesn't matter | 16:50 |
JayF | lol | 16:50 |
dtantsur | tripleo is debug by default as well | 16:51 |
NobodyCam | morning devananda | 16:52 |
JayF | It's just too hard to reproduce some of the crazy things that can happen, if I run in INFO I might miss the log to help me fix :) | 16:52 |
*** ndipanov has quit IRC | 16:52 | |
*** achanda has joined #openstack-ironic | 16:53 | |
dtantsur | when I need a high-level picture, I just 'grep -v DEBUG' over the whole log :) | 16:53 |
JayF | grep ERROR can be fun, too | 16:53 |
devananda | JayF: I would suggest then that INFO doesn't have enough data | 16:54 |
devananda | I do not believe we should have to run DEBUG in production just to manage the service | 16:54 |
jlvillal | mariojv: I replied to your comment. | 16:55 |
JayF | I mean, I don't have to run in DEBUG to "manage the service" | 16:55 |
jlvillal | Basically I think SOCK_DGRAM is UDP. Which I think is fire and forget. | 16:55 |
sambetts | it would be super useful for debugging problems with data that is technically fine so returns a 200 but is actually wrong, it took me so long to realise that nova was sending me the wrong root disk size value in my tempest tests and that was leading to deploy failure, if I could have seen the incoming data I would have been able to spot it straight away, in the end I had to lok at the nova log | 16:55 |
sambetts | logs API output data | 16:55 |
JayF | I run in DEBUG because we do more builds/cleaning than a hell of a lot of other installations, and so if something breaks once there's no guarantee it'll break again or that I can reproduce it | 16:55 |
JayF | so I want as much data as possible around that failure so I can reason about it better | 16:55 |
JayF | INFO loglevel could be "perfect" and I'd probably still want to run in DEBUG at my scale | 16:56 |
devananda | sambetts: another way to accomplish that would be if the deployment-starting-INFO-log included more details | 16:56 |
mariojv | jlvillal: i think that may be correct wrt the timeout, didn't realize that was udp | 16:56 |
dtantsur | devananda, ++ on improving the deployment-starting-INFO-log | 16:56 |
devananda | I completely agree that our current logging is insufficient | 16:57 |
mariojv | do you still think the concern about it potentially blocking ironic operations that would otherwise succeed is valid though? | 16:57 |
devananda | but I don't think a blanket log-all-request-content is the right solution | 16:57 |
dtantsur | devananda, "Every inbound WSGI should get logged exactly once. It should be logged with enough information that the operation the user was attempting can be reconstructed. " (c) https://wiki.openstack.org/wiki/LoggingStandards#INFO | 16:58 |
mariojv | if there's some socket error that prevents metrics from sending, like being unable to resolve DNS (which I think will be thrown even if UDP is used), i'm not sure if it's good behavior to just raise another error without allowing further operations to continue | 16:58 |
*** saripurigopi has quit IRC | 16:58 | |
JayF | mariojv: I'm commenting that on the review right now, lol | 16:59 |
*** davideagnello has joined #openstack-ironic | 16:59 | |
openstackgerrit | Andre Aranha proposed openstack/python-oneviewclient: Extend client to add Connections https://review.openstack.org/302365 | 16:59 |
jlvillal | mariojv: Good point. | 16:59 |
JayF | jlvillal: we know the real pain from running a bad versino of this patch downstream for a while | 17:00 |
JayF | jlvillal: lol | 17:00 |
* jlvillal likes multiple reviewers as they find all sorts of different things. | 17:00 | |
sambetts | the problem I'm trying to solve now is working out what data IPA has sent me, so I can see what it thinks the root device is, if we were logging the request data I could just look up the incoming API request, instead of having to recreate the whole environment so I can look at the internal driver info field | 17:00 |
jlvillal | sambetts: +1 for more logging from me :) | 17:00 |
dtantsur | I think we MUST log things that ramdisks send us, cause debugging ramdisks is too much fun | 17:00 |
devananda | we should definitely collect logs from ramdisks | 17:01 |
devananda | we could also have better logging in the driver / vendor passthru methods | 17:01 |
devananda | particularly those that we know are related to IPA | 17:01 |
devananda | again, without turning on full capture of request body globally | 17:01 |
*** mgoddard has quit IRC | 17:03 | |
*** mgoddard has joined #openstack-ironic | 17:03 | |
*** spandhe has quit IRC | 17:03 | |
*** rpioso has joined #openstack-ironic | 17:03 | |
sambetts | devananda: our ironic API logs in DEBUG are filled with keystoneauth.session logging all REQ and RESP data | 17:03 |
devananda | dtantsur: I'm not sure I agree with that, but I may be interpreting "can be reconstructed" differently | 17:03 |
*** piet has joined #openstack-ironic | 17:03 | |
devananda | sambetts: yea, I think we should disable that | 17:04 |
devananda | or trim it down | 17:04 |
dtantsur | I'm not saying we must comply, just stating that the guidelines have their opinion on it | 17:04 |
dtantsur | devananda, sambetts, we should update our default ignore-list for keystoneauth. lemme find where we do it | 17:05 |
dtantsur | https://github.com/openstack/ironic/blob/master/ironic/common/service.py#L125 | 17:05 |
* dtantsur puts a patch | 17:05 | |
*** harshs has joined #openstack-ironic | 17:05 | |
*** mishras has joined #openstack-ironic | 17:06 | |
*** ChubYann has quit IRC | 17:08 | |
*** moshele has quit IRC | 17:08 | |
*** dprince has quit IRC | 17:08 | |
*** dprince has joined #openstack-ironic | 17:09 | |
devananda | dtantsur: re: API logging requests at INFO level, I think we currently do that sufficiently, but it sounds like your point is that we should log the entire request -- headers and body and all | 17:09 |
JayF | at INFO level, I just want us to produce apache-style logs, even optionally since some people already run it under a web server | 17:10 |
devananda | I think that's worth digging into and looking at other services' API logs | 17:10 |
devananda | JayF: right. which we do today | 17:10 |
JayF | just route, source addr, size, status code, time to serve, etc | 17:10 |
JayF | no we don't | 17:10 |
devananda | uh | 17:10 |
mishras | o/ | 17:10 |
JayF | we absolutely do not | 17:10 |
devananda | no? | 17:10 |
JayF | unless I've had a bit flipped wrongly in my config for like 2years | 17:10 |
devananda | yea, we do ... | 17:10 |
devananda | JayF: I've relied on that in my dev env for a long time | 17:11 |
JayF | Do you run apache in your dev env? | 17:11 |
devananda | nope | 17:11 |
devananda | ironic-api service directly in a venv | 17:11 |
devananda | and i just watch its output | 17:11 |
JayF | that is 100% not true in my production environment | 17:12 |
JayF | and now I wanna find out why | 17:12 |
devananda | eg, this | 17:12 |
devananda | 2016-04-05 12:20:07.943 17277 INFO ironic_api [req-76a5d9e5-7379-4f42-b387-11f1dc523ce4 - - - - -] 127.0.0.1 "PATCH /v1/nodes/bar HTTP/1.1" status: 500 len: 572 time: 0.1882300 | 17:12 |
JayF | yeah wow I don't have that | 17:13 |
devananda | wow :( | 17:13 |
JayF | it looks like I don't have *any* logs being printed at INFO level | 17:13 |
JayF | what the hell | 17:13 |
devananda | so, the format / content changed in Mitaka | 17:13 |
devananda | when we switched that to use an oslo service thing | 17:13 |
JayF | nope I totes have INFO level logs | 17:13 |
devananda | it didn' thave len and time before | 17:13 |
JayF | that might just be a I'm-not-new-enough problem | 17:13 |
devananda | ah | 17:13 |
*** jtomasek has joined #openstack-ironic | 17:14 | |
JayF | grep PATCH from my logs gives me nothing | 17:14 |
JayF | in an environment I know is doing 1000+ builds/deletes a day, lol | 17:14 |
devananda | yea | 17:14 |
devananda | stable/liberty prints this: | 17:14 |
devananda | 127.0.0.1 - - [06/Apr/2016 10:14:22] "PATCH /v1/nodes/bar HTTP/1.1" 400 184 | 17:14 |
devananda | so mitaka definitely added more data to it, but the request logging was there for several releases | 17:15 |
JayF | I'm running master from about 12/15/15 + patches | 17:15 |
JayF | I'm now wondering what sort of config option I'm missing | 17:15 |
devananda | even with debug and verbose both False, I still get this | 17:16 |
* devananda returns his attention to meetings | 17:16 | |
sambetts | the style deva is seeing is what I'm looking at in my CI logs right now | 17:16 |
JayF | makes me wonder if we have a bug where with debug to true it fails | 17:16 |
JayF | or something similarly nuts | 17:16 |
*** e0ne has quit IRC | 17:17 | |
JayF | Where exactly in the code does it produce these logs? Do you know off the top of your head? | 17:17 |
dtantsur | my internet went away for a walk, could you please give me some context? | 17:18 |
mariojv | jlvillal: responded about the timeout thing, it turns out that UDP can time out | 17:18 |
sambetts | dtantsur: | 17:18 |
mariojv | i don't think those cases are very likely for our use case though so imbw about whether the config option is useful or not | 17:18 |
sambetts | dtantsur: http://paste.openstack.org/show/493207/ | 17:18 |
dtantsur | thnx! | 17:19 |
*** ChubYann has joined #openstack-ironic | 17:20 | |
*** cdearborn has joined #openstack-ironic | 17:21 | |
jlvillal | mariojv: Ah, interesting. Thanks. | 17:22 |
*** itamarl has quit IRC | 17:23 | |
mariojv | np, i've never done socket programming before so wasn't really sure about some of this stuff - kind of interesting though | 17:23 |
jlvillal | mariojv: Very little done by me. | 17:24 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic: Ignore DEBUG logging from keystone{auth,middleware} https://review.openstack.org/302378 | 17:24 |
dtantsur | sambetts, devananda ^^^ | 17:24 |
JayF | oh hell yeah | 17:25 |
dtantsur | actually, I think the patch is wrong, lemme fix it... | 17:25 |
jlvillal | mariojv: http://www.ebay.com/itm/FAST-SHIP-STEVENS-3e-Unix-Network-Programming-The-Sockets-Vol-1-B05-/121923989544?hash=item1c633c7028:g:-20AAOSwX~dWlWdg :) | 17:26 |
*** achanda has quit IRC | 17:27 | |
*** praneshp_ has quit IRC | 17:27 | |
*** Marga_ has joined #openstack-ironic | 17:28 | |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic: Ignore DEBUG logging from keystone{auth,middleware} https://review.openstack.org/302378 | 17:28 |
dtantsur | should be fine now | 17:28 |
*** Sukhdev_ has quit IRC | 17:28 | |
openstackgerrit | Merged openstack/ironic-python-agent: Wait for the interfaces to get IP addresses before inspection https://review.openstack.org/300548 | 17:29 |
*** Nisha has quit IRC | 17:29 | |
*** saripurigopi has joined #openstack-ironic | 17:29 | |
*** spandhe has joined #openstack-ironic | 17:30 | |
*** sukhdev has quit IRC | 17:32 | |
dtantsur | folks, do you think this ^^^ is backportable? jroll, devananda? | 17:32 |
JayF | dtantsur: wait for interfaces? | 17:34 |
dtantsur | yep | 17:34 |
JayF | dtantsur: Other than it hurting my soul that IPA has a stable branch now, I think it's a reasonable thing to backport, but I have no authority whatsoever :) | 17:34 |
sambetts | ++ on the soul hurting | 17:34 |
dtantsur | on one hand it's a bug fix, on the other - it adds an item to inventory and adds a new option | 17:34 |
devananda | dtantsur: and it changes interfaces in IPA | 17:36 |
devananda | https://review.openstack.org/#/c/300548/7/ironic_python_agent/hardware.py | 17:36 |
dtantsur | yeah, that's what I called "inventory" | 17:37 |
devananda | ah | 17:37 |
* dtantsur is thinking in terms of inspection as usual :) | 17:37 | |
openstackgerrit | lokesh s proposed openstack/ironic: Add support for the audit middleware https://review.openstack.org/272658 | 17:37 |
devananda | dtantsur: urgh. it also adds a new CONF optoin | 17:38 |
devananda | that is not permitted for backports :( | 17:38 |
dtantsur | yep, that's what I suspected. thanks for confirming | 17:38 |
devananda | is this a problem for our stable gate? | 17:38 |
devananda | *fixing a problem | 17:39 |
* sambetts is heading off for some dinner | 17:39 | |
sambetts | See everyone tomorrow :) | 17:39 |
devananda | sambetts: g'night! | 17:39 |
*** sambetts is now known as sambetts|afk | 17:39 | |
jlvillal | sambetts: Good night | 17:39 |
sambetts|afk | o/ devananda | 17:39 |
sambetts|afk | jlvillal: Cya | 17:39 |
NobodyCam | night sambetts|afk | 17:39 |
*** [1]cdearborn has joined #openstack-ironic | 17:39 | |
dtantsur | devananda, nope | 17:40 |
devananda | dtantsur: ok. then I'm inclined not to backport it | 17:40 |
dtantsur | got it | 17:40 |
devananda | as much as it looks like quite a good fix | 17:41 |
*** Nisha has joined #openstack-ironic | 17:42 | |
*** david-lyle has quit IRC | 17:44 | |
*** trown|lunch is now known as trown | 17:53 | |
Nisha | jroll, i have a question regarding https://github.com/openstack/ironic/blob/master/devstack/lib/ironic#L113 | 17:53 |
dtantsur | devananda, could you please check https://review.openstack.org/#/c/293876/ ? it concerns me, but maybe my memory fail me | 17:53 |
Nisha | jroll, if the RAMDISK_TYPE is dib, how do we handle it? | 17:53 |
Nisha | IRONIC_RAMDISK_TYPE* | 17:54 |
*** cdearborn has quit IRC | 17:54 | |
*** rcernin has quit IRC | 17:56 | |
Nisha | sambetts|afk, there? | 17:57 |
*** praneshp_ has joined #openstack-ironic | 17:58 | |
*** achanda has joined #openstack-ironic | 17:59 | |
*** jcoufal has quit IRC | 18:01 | |
*** david-lyle has joined #openstack-ironic | 18:02 | |
*** e0ne has joined #openstack-ironic | 18:04 | |
*** ChubYann has quit IRC | 18:05 | |
openstackgerrit | Merged openstack/ironic: Normalize MAC OctetString to fix InvalidMAC exception https://review.openstack.org/299721 | 18:08 |
dtantsur | calling it a day finally, see you tomorrow | 18:10 |
TheJulia | goodnight dtantsur | 18:10 |
*** dtantsur is now known as dtantsur|afk | 18:10 | |
mat128 | Nisha: interesting, are you getting this error in a gate or you are passing IRONIC_RAMDISK_TYPE=dib yourself? | 18:12 |
Nisha | mat128, i am passing it myself in the ilo driver CI | 18:12 |
mat128 | so before a59d8ab023a23df154189fc7e17fbdab9d003352 you were simply getting a freshly-built CoreOS ramdisk? | 18:13 |
*** e0ne has quit IRC | 18:14 | |
*** piet has quit IRC | 18:15 | |
mat128 | in fact, IRONIC_RAMDISK_TYPE wasnt even an option prior to this commit | 18:15 |
*** ChubYann has joined #openstack-ironic | 18:17 | |
*** jaybeale has quit IRC | 18:21 | |
Nisha | mat128, no i build it using dib. | 18:22 |
Nisha | we have devstack patches in review | 18:22 |
Nisha | where we enable the build of dib images | 18:22 |
Nisha | it is there prior to this commit also | 18:23 |
*** e0ne has joined #openstack-ironic | 18:24 | |
TheJulia | I seem to remember there being an override mechanism, but the die does kind of halt things rather abruptly | 18:27 |
mat128 | Is there any pre-built binaries for dib? | 18:29 |
TheJulia | basically pre-building dib binaries has proven to be rather... unreliable | 18:30 |
TheJulia | since dib is a consumer of whatever desired distribution, if there are any mirror errors, which happen often, things just abort. | 18:31 |
mat128 | so should we fall back to any other image (basically default to coreos? instead of die) or build dib on the spot? | 18:31 |
NobodyCam | night dtantsur|afk | 18:32 |
TheJulia | mat128: I think that might be one option in the short term | 18:32 |
*** mgould has quit IRC | 18:32 | |
openstackgerrit | Nisha Agarwal proposed openstack/ironic: Fixes iLO driver CI for IRONIC_RAMDISK_TYPE https://review.openstack.org/302403 | 18:41 |
*** e0ne has quit IRC | 18:46 | |
openstackgerrit | Nisha Agarwal proposed openstack/ironic: Add support for dib based agent ramdisk in lib/ironic https://review.openstack.org/264579 | 18:50 |
Nisha | mat128, build dib is already proposed in patch https://review.openstack.org/264579. Thats what we use in ilo CI | 18:51 |
*** mkovacik has joined #openstack-ironic | 19:05 | |
openstackgerrit | Nisha Agarwal proposed openstack/ironic: Fixes iLO driver CI for IRONIC_RAMDISK_TYPE https://review.openstack.org/302403 | 19:06 |
*** aarefiev_ has joined #openstack-ironic | 19:06 | |
openstackgerrit | Nisha Agarwal proposed openstack/ironic: Fixes iLO driver CI for IRONIC_RAMDISK_TYPE https://review.openstack.org/302403 | 19:08 |
*** Sukhdev has joined #openstack-ironic | 19:08 | |
openstackgerrit | Milan Kováčik proposed openstack/python-ironic-inspector-client: Introspection on stored data https://review.openstack.org/302195 | 19:10 |
NobodyCam | Nisha: added a comment that we should also list DIB | 19:11 |
openstackgerrit | Nisha Agarwal proposed openstack/ironic: Fixes iLO driver CI for IRONIC_RAMDISK_TYPE https://review.openstack.org/302403 | 19:15 |
Nisha | NobodyCam, done ^^^ | 19:15 |
NobodyCam | :) | 19:15 |
*** aarefiev_ has quit IRC | 19:17 | |
*** e0ne has joined #openstack-ironic | 19:20 | |
*** Sukhdev has quit IRC | 19:26 | |
*** ametts has joined #openstack-ironic | 19:31 | |
openstackgerrit | Nisha Agarwal proposed openstack/ironic: Add support for building ISO for deploy ramdisk https://review.openstack.org/264590 | 19:34 |
openstackgerrit | Chris Krelle proposed openstack/ironic: Add support for the audit middleware https://review.openstack.org/272658 | 19:34 |
*** mkovacik has quit IRC | 19:34 | |
*** Goneri has quit IRC | 19:35 | |
*** Nisha_away has joined #openstack-ironic | 19:35 | |
*** Goneri has joined #openstack-ironic | 19:35 | |
*** Sukhdev has joined #openstack-ironic | 19:38 | |
*** [1]cdearborn has quit IRC | 19:39 | |
*** Nisha has quit IRC | 19:39 | |
*** [1]cdearborn has joined #openstack-ironic | 19:39 | |
*** ifarkas has quit IRC | 19:40 | |
*** rlpple has joined #openstack-ironic | 19:41 | |
*** Sukhdev has quit IRC | 19:42 | |
openstackgerrit | Andre Aranha proposed openstack/python-oneviewclient: Added get_server_profile_by_uuid and changed model https://review.openstack.org/302225 | 19:48 |
*** aswadr_ has quit IRC | 19:50 | |
*** e0ne has quit IRC | 19:50 | |
*** rlpple has quit IRC | 19:51 | |
*** piet has joined #openstack-ironic | 19:59 | |
*** mgagne_ is now known as mgagne | 20:04 | |
*** garthb has quit IRC | 20:06 | |
*** garthb has joined #openstack-ironic | 20:07 | |
*** rcernin has joined #openstack-ironic | 20:09 | |
*** MattMan has quit IRC | 20:12 | |
*** MattMan has joined #openstack-ironic | 20:13 | |
* Nisha_away calling it a day | 20:13 | |
*** pcaruana has quit IRC | 20:14 | |
*** Nisha_away has quit IRC | 20:18 | |
*** rbudden_ has joined #openstack-ironic | 20:20 | |
*** rbudden has quit IRC | 20:22 | |
*** rbudden_ is now known as rbudden | 20:22 | |
*** e0ne has joined #openstack-ironic | 20:22 | |
*** mbound has joined #openstack-ironic | 20:25 | |
*** mbound has quit IRC | 20:25 | |
*** mbound has joined #openstack-ironic | 20:25 | |
*** e0ne has quit IRC | 20:28 | |
*** cdearborn has joined #openstack-ironic | 20:32 | |
openstackgerrit | Merged openstack/python-oneviewclient: Refactor of unit Tests https://review.openstack.org/301895 | 20:39 |
*** trown is now known as trown|outtypewww | 20:44 | |
*** spandhe has quit IRC | 20:44 | |
*** [1]cdearborn has quit IRC | 20:46 | |
mrda | Morning Ironic | 20:54 |
*** mishras has quit IRC | 20:54 | |
thiagop | morning mrda | 20:54 |
NobodyCam | morning mrda | 20:55 |
*** spandhe has joined #openstack-ironic | 20:58 | |
*** suro-patz has quit IRC | 20:58 | |
*** Sukhdev has joined #openstack-ironic | 21:01 | |
*** raildo is now known as raildo-afk | 21:02 | |
*** Goneri has quit IRC | 21:04 | |
*** sinval-afk has quit IRC | 21:04 | |
*** jistr|off has quit IRC | 21:04 | |
*** [1]cdearborn has joined #openstack-ironic | 21:07 | |
mrda | hey NobodyCam, thiagop | 21:07 |
*** baoli_ has quit IRC | 21:09 | |
*** mishras has joined #openstack-ironic | 21:13 | |
*** Sukhdev has quit IRC | 21:16 | |
*** suro-patz has joined #openstack-ironic | 21:19 | |
*** dprince has quit IRC | 21:20 | |
*** cdearborn has quit IRC | 21:22 | |
*** mishras has quit IRC | 21:24 | |
*** rcernin has quit IRC | 21:27 | |
*** rbrud has quit IRC | 21:31 | |
TheJulia | good morning mrda | 21:32 |
mrda | hi TheJulia :) | 21:34 |
NobodyCam | TheJulia: how about assert_1.1_provision_state | 21:35 |
*** piet has quit IRC | 21:40 | |
TheJulia | NobodyCam: then I would rename it again in ANC? Should just make it a private method too... | 21:47 |
*** Sukhdev has joined #openstack-ironic | 21:49 | |
*** MattMan has quit IRC | 21:53 | |
*** Sukhdev has quit IRC | 21:53 | |
*** Sukhdev has joined #openstack-ironic | 21:58 | |
NobodyCam | maybe purple is the right answer | 22:00 |
*** Sukhdev has quit IRC | 22:03 | |
openstackgerrit | Julia Kreger proposed openstack/ironic-python-agent: Provide fallback from ATA erase to shredding https://review.openstack.org/270902 | 22:03 |
TheJulia | It would be a rather funny joke regarding bikeshedding ;) | 22:03 |
NobodyCam | jlvillal: thank you ;) | 22:06 |
TheJulia | JayF: mat128: ^^^ Updated 270902 as discussed/agreed. Some retooling/renaming as would be expected, if we have consensus, I'll create the other patch tomorrow. | 22:07 |
*** baoli has joined #openstack-ironic | 22:10 | |
*** MattMan has joined #openstack-ironic | 22:13 | |
*** jaybeale has joined #openstack-ironic | 22:14 | |
jlvillal | NobodyCam: What did I do? | 22:14 |
NobodyCam | lol | 22:14 |
* jlvillal unsure of what the thanks are for? | 22:14 | |
NobodyCam | comment here: https://review.openstack.org/#/c/295734/1//COMMIT_MSG | 22:16 |
jlvillal | :) | 22:16 |
* jlvillal will admit that short commit messages have been annoying him recently. Not sure why he is so annoyed about them... | 22:16 | |
*** [1]cdearborn has quit IRC | 22:19 | |
*** piet has joined #openstack-ironic | 22:19 | |
*** Goneri has joined #openstack-ironic | 22:20 | |
*** baoli has quit IRC | 22:20 | |
*** baoli has joined #openstack-ironic | 22:20 | |
*** ametts has quit IRC | 22:21 | |
TheJulia | jlvillal: Just remember there is a very nice webapge explaining commit guidelines :) | 22:24 |
*** Sukhdev has joined #openstack-ironic | 22:24 | |
jlvillal | TheJulia: Yep :) | 22:25 |
*** jayc has quit IRC | 22:31 | |
*** achanda has quit IRC | 22:32 | |
*** piet has quit IRC | 22:32 | |
*** piet has joined #openstack-ironic | 22:33 | |
*** achanda has joined #openstack-ironic | 22:38 | |
openstackgerrit | Thiago Paiva Brito proposed openstack/python-oneviewclient: OneView client with managers https://review.openstack.org/286803 | 22:41 |
*** thiagop has quit IRC | 22:42 | |
*** piet has quit IRC | 22:45 | |
*** piet has joined #openstack-ironic | 22:45 | |
*** piet has quit IRC | 22:59 | |
*** mgoddard has quit IRC | 23:09 | |
*** mgoddard has joined #openstack-ironic | 23:10 | |
*** Sukhdev has quit IRC | 23:14 | |
*** achanda has quit IRC | 23:15 | |
*** achanda has joined #openstack-ironic | 23:22 | |
*** aNupoisc has joined #openstack-ironic | 23:34 | |
openstackgerrit | Ramamani Yeleswarapu proposed openstack/ironic: Centralize config options - [irmc] https://review.openstack.org/302476 | 23:34 |
*** baoli has quit IRC | 23:44 | |
*** [1]cdearborn has joined #openstack-ironic | 23:49 | |
*** Sukhdev has joined #openstack-ironic | 23:50 | |
*** rbudden has quit IRC | 23:51 | |
*** Sukhdev has quit IRC | 23:52 | |
*** rpioso has quit IRC | 23:52 | |
*** smoriya_ has joined #openstack-ironic | 23:54 | |
*** hoangcx has quit IRC | 23:54 | |
*** jaybeale has quit IRC | 23:55 | |
*** spandhe has quit IRC | 23:56 | |
*** spandhe_ has joined #openstack-ironic | 23:56 | |
*** rama_y has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!