| *** harlowja has joined #openstack-ironic | 00:03 | |
| *** charcol has joined #openstack-ironic | 00:04 | |
| *** yangyapeng has quit IRC | 00:06 | |
| *** yangyapeng has joined #openstack-ironic | 00:07 | |
| *** harlowja has quit IRC | 00:09 | |
| *** yangyapeng has quit IRC | 00:11 | |
| *** yuanying_ has joined #openstack-ironic | 00:14 | |
| *** edleafe has quit IRC | 00:14 | |
| *** harlowja has joined #openstack-ironic | 00:14 | |
| *** yuanying has quit IRC | 00:15 | |
| *** edleafe has joined #openstack-ironic | 00:16 | |
| *** yangyapeng has joined #openstack-ironic | 00:18 | |
| *** yangyapeng has quit IRC | 00:22 | |
| *** jaypipes has quit IRC | 00:24 | |
| *** rivers has quit IRC | 00:30 | |
| *** rivers has joined #openstack-ironic | 00:30 | |
| *** baoli has joined #openstack-ironic | 00:41 | |
| *** hshiina has joined #openstack-ironic | 00:42 | |
| *** baoli_ has joined #openstack-ironic | 00:45 | |
| *** baoli has quit IRC | 00:46 | |
| *** TuanLA has joined #openstack-ironic | 00:54 | |
| *** harlowja has quit IRC | 00:57 | |
| *** yuanying has joined #openstack-ironic | 00:58 | |
| *** yuanyin__ has joined #openstack-ironic | 01:00 | |
| *** harlowja has joined #openstack-ironic | 01:01 | |
| *** yuanying_ has quit IRC | 01:01 | |
| *** yuanying has quit IRC | 01:03 | |
| *** yuanying has joined #openstack-ironic | 01:04 | |
| *** yuanyin__ has quit IRC | 01:05 | |
| *** phuongnh has joined #openstack-ironic | 01:05 | |
| *** mat128 has joined #openstack-ironic | 01:06 | |
| *** yangyapeng has joined #openstack-ironic | 01:15 | |
| *** jkilpatr has quit IRC | 01:26 | |
| *** xuanjia has quit IRC | 01:27 | |
| *** namnh has joined #openstack-ironic | 01:28 | |
| *** zhangfei has joined #openstack-ironic | 01:33 | |
| *** zshi_ has quit IRC | 01:37 | |
| *** jkilpatr has joined #openstack-ironic | 01:38 | |
| *** baoli_ has quit IRC | 01:44 | |
| *** baoli has joined #openstack-ironic | 01:45 | |
| wong | hi | 01:53 |
|---|---|---|
| wong | may I ask a question? | 01:54 |
| wong | how many NICs can I operate in node? | 01:54 |
| wong | untill now, all network steps operate in one NIC | 01:58 |
| *** jkilpatr has quit IRC | 02:04 | |
| *** jlabarre has quit IRC | 02:05 | |
| wong | if I create more than one port,whitch port will be choose? | 02:13 |
| *** jkilpatr has joined #openstack-ironic | 02:16 | |
| *** exodusftw has joined #openstack-ironic | 02:23 | |
| *** baoli has quit IRC | 02:28 | |
| *** baoli has joined #openstack-ironic | 02:29 | |
| *** baoli has quit IRC | 02:40 | |
| wong | it seems conductor will put all ports in tenant network by reading codes | 02:46 |
| *** dsneddon has quit IRC | 02:58 | |
| *** baoli has joined #openstack-ironic | 02:59 | |
| *** penick has joined #openstack-ironic | 03:06 | |
| *** penick has quit IRC | 03:10 | |
| *** yangyape_ has joined #openstack-ironic | 03:11 | |
| *** baoli has quit IRC | 03:11 | |
| *** yangyap__ has joined #openstack-ironic | 03:14 | |
| *** yangyape_ has quit IRC | 03:14 | |
| *** yangyapeng has quit IRC | 03:14 | |
| *** yangyap__ has quit IRC | 03:19 | |
| *** yangyapeng has joined #openstack-ironic | 03:19 | |
| *** links has joined #openstack-ironic | 03:28 | |
| *** yangyape_ has joined #openstack-ironic | 03:30 | |
| *** yangyapeng has quit IRC | 03:30 | |
| *** skazi has quit IRC | 03:31 | |
| *** hshiina has quit IRC | 03:34 | |
| *** udesale has joined #openstack-ironic | 03:46 | |
| *** stendulker has joined #openstack-ironic | 03:55 | |
| *** adisky__ has quit IRC | 03:55 | |
| *** hshiina has joined #openstack-ironic | 03:59 | |
| *** sasha2 has quit IRC | 04:02 | |
| *** aparnav has joined #openstack-ironic | 04:16 | |
| *** gcb has quit IRC | 04:19 | |
| *** trungnv has quit IRC | 04:19 | |
| *** gcb has joined #openstack-ironic | 04:21 | |
| *** yuanying_ has joined #openstack-ironic | 04:28 | |
| *** yuanying has quit IRC | 04:31 | |
| *** charcol has quit IRC | 04:32 | |
| *** charcol has joined #openstack-ironic | 04:33 | |
| *** trungnv has joined #openstack-ironic | 04:37 | |
| *** trungnv_ has quit IRC | 04:37 | |
| *** trungnv has quit IRC | 04:37 | |
| *** ankkumar has joined #openstack-ironic | 04:46 | |
| *** MattMan_1 has quit IRC | 04:53 | |
| *** MattMan_1 has joined #openstack-ironic | 04:53 | |
| *** skazi has joined #openstack-ironic | 04:56 | |
| *** jaganathan has joined #openstack-ironic | 05:00 | |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic stable/pike: Update documentation for ``ilo`` hardware type https://review.openstack.org/501108 | 05:04 |
| *** mat128 has quit IRC | 05:19 | |
| *** marios has joined #openstack-ironic | 05:21 | |
| *** pcaruana has joined #openstack-ironic | 05:27 | |
| *** mjura has joined #openstack-ironic | 05:39 | |
| *** jtomasek has joined #openstack-ironic | 05:53 | |
| *** wlfightup has quit IRC | 05:53 | |
| *** udesale__ has joined #openstack-ironic | 05:53 | |
| *** udesale has quit IRC | 05:56 | |
| *** wlfightup has joined #openstack-ironic | 05:56 | |
| *** yangyapeng has joined #openstack-ironic | 05:57 | |
| *** yangyape_ has quit IRC | 05:57 | |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Fix ``agent`` deploy interface to call ``boot.prepare_instance`` https://review.openstack.org/499050 | 06:19 |
| *** yuanying_ has quit IRC | 06:20 | |
| *** mat128 has joined #openstack-ironic | 06:21 | |
| *** yuanying has joined #openstack-ironic | 06:21 | |
| *** e0ne has joined #openstack-ironic | 06:28 | |
| *** udesale__ has quit IRC | 06:28 | |
| *** jaganathan has quit IRC | 06:29 | |
| *** links has quit IRC | 06:29 | |
| *** jaganathan has joined #openstack-ironic | 06:29 | |
| *** rbartal has joined #openstack-ironic | 06:30 | |
| *** yangyapeng has quit IRC | 06:35 | |
| *** yangyapeng has joined #openstack-ironic | 06:35 | |
| *** adisky__ has joined #openstack-ironic | 06:38 | |
| *** udesale has joined #openstack-ironic | 06:55 | |
| *** links has joined #openstack-ironic | 06:55 | |
| *** rcernin has joined #openstack-ironic | 06:57 | |
| *** e0ne has quit IRC | 06:57 | |
| *** udesale__ has joined #openstack-ironic | 06:57 | |
| *** udesale__ has quit IRC | 06:58 | |
| *** ccamacho has joined #openstack-ironic | 06:58 | |
| *** udesale__ has joined #openstack-ironic | 06:59 | |
| *** udesale has quit IRC | 07:00 | |
| *** udesale__ has quit IRC | 07:09 | |
| *** udesale__ has joined #openstack-ironic | 07:10 | |
| *** udesale__ has quit IRC | 07:15 | |
| *** udesale has joined #openstack-ironic | 07:15 | |
| *** rwsu has quit IRC | 07:16 | |
| *** hjensas has quit IRC | 07:19 | |
| *** karimb has joined #openstack-ironic | 07:22 | |
| *** karimb has quit IRC | 07:29 | |
| *** karimb has joined #openstack-ironic | 07:30 | |
| *** tesseract has joined #openstack-ironic | 07:30 | |
| *** ralonsoh has joined #openstack-ironic | 07:32 | |
| *** charcol has quit IRC | 07:36 | |
| *** TuanLA has quit IRC | 07:40 | |
| *** TuanLA has joined #openstack-ironic | 07:41 | |
| *** athomas has joined #openstack-ironic | 07:44 | |
| *** athomas has quit IRC | 07:46 | |
| *** athomas has joined #openstack-ironic | 07:47 | |
| *** rwsu has joined #openstack-ironic | 07:50 | |
| *** athomas has quit IRC | 07:50 | |
| *** athomas has joined #openstack-ironic | 07:50 | |
| *** hoonetorg has quit IRC | 07:58 | |
| *** udesale has quit IRC | 07:58 | |
| *** udesale has joined #openstack-ironic | 07:59 | |
| vdrok | morning ironic! | 08:06 |
| vdrok | wong: whatever amount of nics you specify in nova boot request are going to be bound to tenant net after deployment. which ironic ports to map to neutron ports is currently a random choice basically, but in pike physnets can affect that, like if you have physnet set in ironic port, the corresponding neutron port will be chosen | 08:10 |
| *** hjensas has joined #openstack-ironic | 08:12 | |
| *** hjensas has quit IRC | 08:12 | |
| *** hjensas has joined #openstack-ironic | 08:12 | |
| *** milan has quit IRC | 08:13 | |
| *** alexpilotti has quit IRC | 08:14 | |
| *** hoonetorg has joined #openstack-ironic | 08:15 | |
| *** amarao has joined #openstack-ironic | 08:15 | |
| *** phuongnh has quit IRC | 08:15 | |
| wong | tks | 08:16 |
| *** phuongnh has joined #openstack-ironic | 08:16 | |
| *** rbartal has quit IRC | 08:19 | |
| *** yangyapeng has quit IRC | 08:19 | |
| *** yangyapeng has joined #openstack-ironic | 08:20 | |
| *** gcb has quit IRC | 08:23 | |
| *** phuongnh has quit IRC | 08:23 | |
| *** phuongnh has joined #openstack-ironic | 08:24 | |
| *** lucas-afk is now known as lucasagomes | 08:28 | |
| *** rbartal has joined #openstack-ironic | 08:31 | |
| *** derekh has joined #openstack-ironic | 08:51 | |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic-python-agent master: Fix to return 'root_uuid' as part of command status https://review.openstack.org/500719 | 08:51 |
| *** alexpilotti has joined #openstack-ironic | 08:54 | |
| *** e0ne has joined #openstack-ironic | 09:03 | |
| *** zhangfei has quit IRC | 09:05 | |
| *** sambetts|afk is now known as sambetts | 09:10 | |
| sambetts | Morning all | 09:11 |
| *** athomas has quit IRC | 09:11 | |
| *** rbartal has quit IRC | 09:11 | |
| *** yangyape_ has joined #openstack-ironic | 09:15 | |
| *** hshiina has quit IRC | 09:15 | |
| *** openstackgerrit has quit IRC | 09:18 | |
| *** yangyapeng has quit IRC | 09:18 | |
| *** yangyape_ has quit IRC | 09:19 | |
| *** yangyapeng has joined #openstack-ironic | 09:19 | |
| *** zhangfei has joined #openstack-ironic | 09:22 | |
| *** rbartal has joined #openstack-ironic | 09:24 | |
| *** athomas has joined #openstack-ironic | 09:25 | |
| wong | morning | 09:28 |
| wong | vdrok: whether ironic support VxLAN? | 09:29 |
| stendulker | Morning sambetts, wong o/ | 09:29 |
| wong | morning :) | 09:30 |
| vdrok | wong: I think it's up to your ml2 driver, but i might be wrong | 09:32 |
| vdrok | morning sambetts | 09:32 |
| *** adisky__ has quit IRC | 09:32 | |
| sambetts | vdrok, wong: yup thats entirely down to your ML2 driver and hardware support, there is nothing in ironic that is specific to VLAN only | 09:33 |
| wong | really? | 09:33 |
| *** milan has joined #openstack-ironic | 09:34 | |
| sambetts | yes... if you can terminate VXLAN in your Baremetal TOR, and the ML2 driver for your hardware understands how to program that for the baremetal VNIC type then it should work just fine | 09:35 |
| sambetts | the baremetal node expects to see untagged packets, how they are encapsulated from the TOR upwards the baremetal node doesn't care | 09:36 |
| *** openstackgerrit has joined #openstack-ironic | 09:48 | |
| openstackgerrit | Ankit Kumar proposed openstack/ironic master: Adding grub2 bootloader support to devstack plugin https://review.openstack.org/454026 | 09:48 |
| *** mrunge has joined #openstack-ironic | 09:48 | |
| mrunge | good morning, are there any options to "repair" the power state of a machine? | 09:49 |
| mrunge | it's currently NULL in the database | 09:49 |
| sambetts | mrunge: the power state of a node will start off as NULL until Ironic can get the power state from the baremetals hardware controller | 09:50 |
| vdrok | morning mrunge , hrm, this most likely means that ironic cannot get the power state | 09:50 |
| sambetts | mrunge: there is a periodic task that will sync that state | 09:50 |
| vdrok | yeah | 09:50 |
| mrunge | hmm, apparently that fails | 09:51 |
| mrunge | I can ssh to the machine | 09:51 |
| vdrok | mrunge: what does node-validate say> | 09:51 |
| vdrok | ? | 09:51 |
| sambetts | mrunge: power state comes from a node out of band management controller, such as IPMI, ILO, CIMC or DRAC | 09:51 |
| mrunge | ok, node-validate says: Missing 'ipmi_terminal_port' parameter in node's driver_info. | 09:52 |
| mrunge | that'd be a valid reason I guess | 09:52 |
| vdrok | and the power interface says it's ok? | 09:52 |
| mrunge | vdrok: uhm, how to check that? | 09:53 |
| vdrok | that is for console I think | 09:53 |
| sambetts | mrunge: the output of node validate tells you which interfaces | 09:53 |
| vdrok | if in node-validate power interface row says result=True then it should be fine | 09:53 |
| sambetts | what state is your node in? | 09:53 |
| mrunge | result is false | 09:53 |
| vdrok | and what's the reason column? | 09:54 |
| mrunge | vdrok: Missing 'ipmi_terminal_port' parameter in node's driver_info. | 09:54 |
| vdrok | mrunge: it's a console property, we don't require it for power interface, are you sure it's in the row where interface=power? | 09:56 |
| *** yangyapeng has quit IRC | 09:56 | |
| *** MattMan_1 is now known as MattMan | 09:56 | |
| *** yangyapeng has joined #openstack-ironic | 09:56 | |
| mrunge | vdrok: aha, now I get you, it says True | 09:57 |
| sambetts | mrunge: which provision state is your node in? | 09:57 |
| mrunge | full output is here: http://paste.openstack.org/show/620493/ | 09:57 |
| sambetts | mrunge: that all looks good, what provision state is your ironic node in? Ironic won't start to try to sync power state until a node is moved out of enroll | 09:58 |
| sambetts | into managable | 09:59 |
| mrunge | the provision state is active | 10:00 |
| mrunge | and maintenance is true | 10:00 |
| sambetts | mrunge: if maintenance is true Ironic won't sync power state, maintenance == Ironic get your hands off | 10:00 |
| mrunge | aha, so setting maintenance to false is the first step | 10:00 |
| sambetts | mrunge: power state is set to null when maintenance is enabled because Ironic doesn't know what state the baremetal node is in anymore because its been told to take its hands off | 10:01 |
| mrunge | unfortunately, that doesn't change anything | 10:02 |
| *** openstackgerrit has quit IRC | 10:03 | |
| mrunge | (other than maintenance being off) | 10:03 |
| sambetts | the power sync state loop should pick up the power state of the server | 10:05 |
| sambetts | but it might be in maintenance because ironic couldn't sync the power state in the first place | 10:06 |
| mrunge | I found in the log (last line): VifAlreadyAttached: Unable to attach VIF because VIF 0e6a3387-0142-4951-93cb-0eee36798155 is already attached to Ironic Port 7a0659e2-1472-4533-aa49-03082e1ccbdc | 10:06 |
| mrunge | hmm | 10:06 |
| sambetts | after N number of failed attempts to sync Ironic puts the node in maintenance automatically to prevent spamming a potentially problematic server | 10:06 |
| mrunge | yes, I saw that, maintenance was turned on again | 10:07 |
| mrunge | err, set to true | 10:07 |
| sambetts | mrunge: if you do ironic node-show <node uuid> there should be information in there in maintenance_reason or last_error telling you why it happened, and there should be logs in the conductor log too | 10:08 |
| mrunge | sambetts: node state None does not match expected state 'None'. Updating DB state to 'None' Switching node to maintenance mode. | 10:10 |
| mrunge | that's what is in last_error, maintenance reason etc. | 10:10 |
| sambetts | I would check the conductor logs, for IPMI power sync state errors | 10:11 |
| mrunge | sambetts: that would be something like ipmitool .... power status | 10:13 |
| mrunge | exit code 1 | 10:13 |
| sambetts | yup | 10:14 |
| mrunge | I see | 10:14 |
| mrunge | ok, thank you! | 10:14 |
| *** mat128 has quit IRC | 10:18 | |
| *** yangyapeng has quit IRC | 10:25 | |
| *** yangyapeng has joined #openstack-ironic | 10:25 | |
| *** openstackgerrit has joined #openstack-ironic | 10:28 | |
| openstackgerrit | Merged openstack/ironic master: [reno] Clarify fix for BFV & image_source https://review.openstack.org/500868 | 10:28 |
| *** yangyapeng has quit IRC | 10:29 | |
| openstackgerrit | Merged openstack/ironic master: [reno] Clarify fix for missing boot.prepare_instance https://review.openstack.org/500855 | 10:31 |
| openstackgerrit | Merged openstack/ironic master: Build docs with Python 2 for now https://review.openstack.org/499173 | 10:31 |
| *** etingof has quit IRC | 10:38 | |
| *** fellypefca-afk has quit IRC | 10:39 | |
| *** fellypefca-afk has joined #openstack-ironic | 10:40 | |
| *** ricardoas1 has joined #openstack-ironic | 10:41 | |
| *** jkilpatr has quit IRC | 10:42 | |
| *** ricardoas has quit IRC | 10:42 | |
| *** udesale has quit IRC | 10:50 | |
| *** etingof has joined #openstack-ironic | 10:50 | |
| *** TuanLA has quit IRC | 10:55 | |
| openstackgerrit | zenghui.shi proposed openstack/ironic-specs master: New hardware interface for BIOS configuration https://review.openstack.org/496481 | 11:01 |
| *** stendulker_ has joined #openstack-ironic | 11:01 | |
| *** Nisha_Agarwal has joined #openstack-ironic | 11:03 | |
| *** zhangfei has quit IRC | 11:04 | |
| *** stendulker has quit IRC | 11:04 | |
| *** jkilpatr has joined #openstack-ironic | 11:07 | |
| *** jkilpatr has quit IRC | 11:07 | |
| *** jkilpatr has joined #openstack-ironic | 11:07 | |
| *** stendulker_ has quit IRC | 11:08 | |
| *** phuongnh has quit IRC | 11:12 | |
| *** jkilpatr has quit IRC | 11:15 | |
| *** links has quit IRC | 11:20 | |
| *** lucasagomes is now known as lucas-hungry | 11:21 | |
| *** racedo has quit IRC | 11:22 | |
| *** yangyapeng has joined #openstack-ironic | 11:29 | |
| *** jkilpatr has joined #openstack-ironic | 11:29 | |
| *** Nisha_Agarwal has quit IRC | 11:30 | |
| *** Nisha_Agarwal has joined #openstack-ironic | 11:30 | |
| *** ankkumar has quit IRC | 11:30 | |
| *** links has joined #openstack-ironic | 11:32 | |
| *** Nisha_Agarwal has quit IRC | 11:32 | |
| fellypefca-afk | Good morning everyone | 11:37 |
| *** aparnav has quit IRC | 11:38 | |
| *** aparnav has joined #openstack-ironic | 11:38 | |
| *** aparnav has quit IRC | 11:42 | |
| *** fellypefca-afk is now known as fellypefca | 11:44 | |
| *** racedo has joined #openstack-ironic | 11:59 | |
| *** bfournie has joined #openstack-ironic | 12:03 | |
| *** yangyapeng has quit IRC | 12:05 | |
| *** jlabarre has joined #openstack-ironic | 12:05 | |
| *** dprince has joined #openstack-ironic | 12:05 | |
| *** yangyapeng has joined #openstack-ironic | 12:05 | |
| *** gcb has joined #openstack-ironic | 12:05 | |
| *** mrtenio has joined #openstack-ironic | 12:06 | |
| *** udesale has joined #openstack-ironic | 12:07 | |
| *** ccamacho is now known as ccamacho|lunch | 12:08 | |
| *** weshay_PTO is now known as weshay | 12:08 | |
| *** bfournie has quit IRC | 12:09 | |
| *** bfournie has joined #openstack-ironic | 12:09 | |
| *** trown|outtypewww is now known as trown | 12:09 | |
| *** yangyapeng has quit IRC | 12:09 | |
| *** srobert has joined #openstack-ironic | 12:13 | |
| *** srobert has quit IRC | 12:14 | |
| *** srobert has joined #openstack-ironic | 12:15 | |
| *** jaypipes has joined #openstack-ironic | 12:30 | |
| karimb | dtantsur|afk anything more needed on https://review.openstack.org/#/c/301226/ ? | 12:34 |
| patchbot | patch 301226 - ironic-staging-drivers - Ovirt support | 12:34 |
| *** lucas-hungry is now known as lucasagomes | 12:34 | |
| *** Goneri has joined #openstack-ironic | 12:51 | |
| *** udesale has quit IRC | 12:56 | |
| *** mikal has quit IRC | 13:05 | |
| *** sasha2 has joined #openstack-ironic | 13:05 | |
| *** ccamacho|lunch is now known as ccamacho | 13:06 | |
| *** adisky__ has joined #openstack-ironic | 13:07 | |
| *** racedo has quit IRC | 13:09 | |
| *** rloo has joined #openstack-ironic | 13:10 | |
| TheJulia | good morning everyoen | 13:10 |
| TheJulia | everyone | 13:11 |
| * TheJulia has yet to have coffee | 13:11 | |
| *** baoli has joined #openstack-ironic | 13:11 | |
| *** mikal has joined #openstack-ironic | 13:12 | |
| sambetts | hey TheJulia | 13:13 |
| vdrok | good morning fellypefca TheJulia | 13:14 |
| fellypefca | TheJulia, vdrok o/ morning! :) | 13:15 |
| *** yangyapeng has joined #openstack-ironic | 13:16 | |
| rloo | hi fellypefca, vdrok, sambetts. Good morning TheJulia | 13:18 |
| fellypefca | Hi rloo :) | 13:19 |
| vdrok | good morning rloo ! | 13:20 |
| sambetts | hi rloo | 13:20 |
| *** yangyapeng has quit IRC | 13:20 | |
| fellypefca | sambetts thank you for all the support in our migration patch :) | 13:22 |
| sambetts | fellypefca: no problem :) | 13:22 |
| openstackgerrit | Kyrylo Romanenko proposed openstack/python-ironicclient master: Tests for OSC baremetal node create command with options https://review.openstack.org/382352 | 13:23 |
| *** thegreenhundred has joined #openstack-ironic | 13:30 | |
| rloo | TheJulia: when we were dealing with CI issues, you had mentioned that maybe we should increase our time out values. Did anyone do anything about that? | 13:32 |
| TheJulia | rloo: I did not, since it looked like it improved a little bit, just based on random observations | 13:32 |
| rloo | TheJulia: ok, I think I just saw sambetts recheck something due to a timeout and I see a timeout in IPA patch, but this one does have a warning about devstack run took > 20 minutes, this is a very slow node. | 13:34 |
| sambetts | rloo: yeah it seems like it was just a slow node unfortuantly :( | 13:36 |
| rloo | sambetts: I guess we should keep an eye out, keep track of timeouts that are not due to a slow node. | 13:36 |
| TheJulia | rloo: I've seen devstack hit 40+ minutes on some of the nodes at times. | 13:36 |
| sambetts | +1 | 13:37 |
| rloo | TheJulia: whoa | 13:37 |
| TheJulia | I think we need to go from an hour to an hour and 15 minutes on our shorter running job and 2.5 hours on our grenade jobs | 13:37 |
| *** amarao1 has joined #openstack-ironic | 13:38 | |
| TheJulia | since our grenade jobs rarely just hang, and when I've seen it time out, its always been like " " <-- that close from finishing | 13:38 |
| rloo | TheJulia: I'm fine with that, better to increase the time out, than waste CI resources re-running | 13:38 |
| TheJulia | yeah | 13:39 |
| TheJulia | I can propose it in a little bit, I just need to actually write an email first | 13:41 |
| openstackgerrit | Ruby Loo proposed openstack/ironic stable/pike: [reno] Clarify fix for missing boot.prepare_instance https://review.openstack.org/501257 | 13:41 |
| openstackgerrit | Ruby Loo proposed openstack/ironic stable/pike: [reno] Clarify fix for BFV & image_source https://review.openstack.org/501258 | 13:41 |
| *** racedo has joined #openstack-ironic | 13:43 | |
| *** wlfightup has quit IRC | 13:43 | |
| *** wlfightup has joined #openstack-ironic | 13:43 | |
| *** jcoufal has joined #openstack-ironic | 13:46 | |
| *** crushil has quit IRC | 13:50 | |
| *** d0ugal has quit IRC | 13:55 | |
| *** zhangfei has joined #openstack-ironic | 13:55 | |
| *** makowals has joined #openstack-ironic | 13:58 | |
| *** makowals has quit IRC | 13:58 | |
| *** crushil has joined #openstack-ironic | 13:58 | |
| *** mat128 has joined #openstack-ironic | 14:01 | |
| openstackgerrit | Vladyslav Drok proposed openstack/ironic master: Revise deploy process documentation https://review.openstack.org/458867 | 14:06 |
| *** priteau has joined #openstack-ironic | 14:16 | |
| *** d0ugal has joined #openstack-ironic | 14:16 | |
| *** yangyapeng has joined #openstack-ironic | 14:18 | |
| *** tuanla_fujitsu has joined #openstack-ironic | 14:18 | |
| *** tuanla__ has joined #openstack-ironic | 14:18 | |
| *** priteau has quit IRC | 14:20 | |
| *** priteau_ has joined #openstack-ironic | 14:20 | |
| *** trown is now known as trown|brb | 14:21 | |
| *** priteau_ has quit IRC | 14:21 | |
| *** gmonteiro has joined #openstack-ironic | 14:22 | |
| *** yangyapeng has quit IRC | 14:22 | |
| *** priteau has joined #openstack-ironic | 14:22 | |
| TheJulia | braaaaaiiinnsss | 14:23 |
| *** trown|brb is now known as trown | 14:27 | |
| *** links has quit IRC | 14:31 | |
| *** srobert has quit IRC | 14:36 | |
| openstackgerrit | Merged openstack/ironic master: Replace DbMigrationError with DBMigrationError https://review.openstack.org/500877 | 14:37 |
| *** zhangfei has quit IRC | 14:40 | |
| *** aolwas has quit IRC | 14:46 | |
| *** aolwas has joined #openstack-ironic | 14:46 | |
| *** efried_zzz is now known as efried | 15:01 | |
| *** rbartal has quit IRC | 15:01 | |
| TheJulia | hmmmmm | 15:03 |
| *** srobert has joined #openstack-ironic | 15:03 | |
| *** trungnv has joined #openstack-ironic | 15:05 | |
| *** mjura has quit IRC | 15:08 | |
| *** marios has quit IRC | 15:08 | |
| TheJulia | wow, timeouts on several different levels | 15:10 |
| hamzy | Does anyone know what might be misconfigured to receive the following error? 2017-09-05 14:46:39.617 14534 ERROR ironic.drivers.modules.deploy_utils [req-1cd1ef71-d58c-4c17-ab54-751dc1021189 ce127a9ce842408682f1251583ca470b 56ffaa22fea94144864840cef5993602 - default default] Agent deploy supports only HTTP(S) URLs as instance_info['image_source'] or swift temporary URL. Either the specified URL is not a valid HTTP(S) URL or is not reachable for node | 15:11 |
| hamzy | 58c6e4a4-b0ec-49a7-9b5a-368a88c50dc3. | 15:11 |
| TheJulia | hamzy: what is in your node's instance_info ? | 15:12 |
| anupn | Hi sambetts: last time gate failed due to incorrect python distribution used while compiling. I changed it to python3.3 that gets used. But right now gate is still failing on Py_Initialize error while cleaning node | 15:12 |
| anupn | sambetts, here http://logs.openstack.org/85/495385/3/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-src-ubuntu-xenial/940a8f3/logs/ironic-bm-logs/node-0_console.txt.gz | 15:13 |
| openstackgerrit | Merged openstack/ironic master: Introduce hpOneView and ilorest to OneView https://review.openstack.org/468129 | 15:13 |
| hamzy | TheJulia, {} | 15:13 |
| TheJulia | that would be why.... | 15:14 |
| hamzy | TheJulia, there is a swift temporary url generated that looks reasonable | 15:14 |
| anupn | sambetts, i again see in devstack logs error while cleaning nodes http://logs.openstack.org/85/495385/3/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-src-ubuntu-xenial/940a8f3/logs/devstacklog.txt.gz#_2017-09-01_18_05_35_221 | 15:14 |
| hamzy | http://9.114.118.98/swift/v1/AUTH_6833b565ea2a4682b6c7512a6e1d27c4/glance/32bc5604-12cb-46ab-bf74-cedf6f2eb98e?temp_url_sig=d915e770067da24637c161e6e62bd11e97866f19&temp_url_expires=1504624993 | 15:14 |
| hamzy | which returns a 404 | 15:14 |
| TheJulia | hamzy: when was the tempurl generated? | 15:15 |
| TheJulia | hamzy: also, is this a rebuild attempt on a failed node? | 15:15 |
| hamzy | TheJulia, during provisioning of the overcloud... it has never worked | 15:16 |
| TheJulia | using tripleo? | 15:16 |
| hamzy | yes | 15:16 |
| TheJulia | what driver are you using? | 15:17 |
| hamzy | is there some configuration that needs to happen to hook up apache with where ever glance stores the image? | 15:17 |
| hamzy | agent_ipmitool | 15:17 |
| hamzy | ppc64le baremetal machine | 15:17 |
| TheJulia | i suspect you'll have to use pxe_ipmitool for tripleo. | 15:17 |
| * TheJulia raises an eyebrow | 15:18 | |
| anupn | sambetts, inside cleaning logs i see "[Errno 13] Permission denied: '/opt/stack/cache/files/stackviz-latest.tar.gz'", but wondering does that mean it is not correctly installed inside python3 or something else, can you take an eye on the logs if you could see some definite error | 15:18 |
| TheJulia | so, there is tempurl related configuration to use swift tempurls, but I think tripleo based deployments only have glance, or at least only did last time I touched TripleO... a long long time ago | 15:18 |
| hamzy | TheJulia, when I use pxe_impitool, I see a different error: {u | 15:20 |
| hamzy | 'message': u"'exceptions.OSError' object has no attribute 'exit_code'", | 15:20 |
| hamzy | and Failed to start the iSCSI target | 15:20 |
| TheJulia | wow | 15:21 |
| TheJulia | What is your undercloud/how was it built? | 15:22 |
| hamzy | well I am using an x86_64 undercloud | 15:25 |
| hamzy | installed via https://trunk.rdoproject.org/centos7-master/current-passed-ci/delorean.repo and https://trunk.rdoproject.org/centos7/delorean-deps.repo | 15:25 |
| *** priteau_ has joined #openstack-ironic | 15:29 | |
| *** priteau has quit IRC | 15:29 | |
| hamzy | what would make iSCSI being used following the instructions in https://fedoraproject.org/wiki/User:Hamzy/TripleO_mixed_undercloud_overcloud_try6 | 15:30 |
| *** pooja has joined #openstack-ironic | 15:30 | |
| *** priteau has joined #openstack-ironic | 15:31 | |
| TheJulia | rloo: dtantsur|afk: https://review.openstack.org/501315 | 15:31 |
| patchbot | patch 501315 - openstack-infra/project-config - Extend ironic timeouts | 15:31 |
| TheJulia | hamzy: reading | 15:31 |
| *** priteau_ has quit IRC | 15:34 | |
| *** dprince has quit IRC | 15:35 | |
| TheJulia | hamzy: we're going to need to work backwards since something is wrong someplace which is completely tripping things up. Can I get `openstack baremetal node show <uuid>` for nodes that have failed deployment | 15:36 |
| *** priteau has quit IRC | 15:36 | |
| hamzy | https://paste.fedoraproject.org/paste/gx--kzJLyNoG5TT~V7eebA/ | 15:37 |
| *** dprince has joined #openstack-ironic | 15:37 | |
| TheJulia | wow that is a lot of ram | 15:38 |
| hamzy | I can reinstall and get back to pxe_ipmitool if needed | 15:39 |
| TheJulia | hamzy: does your api log happen to be logging at a level where we could see what was shipped to ironic? | 15:39 |
| TheJulia | since the build failure is causing the node to be returned to available state and we're loosing the extra info | 15:39 |
| hamzy | I could also enable debug logging if that helps | 15:39 |
| TheJulia | we might see it in the conductor log as well based upon the logging level. | 15:39 |
| TheJulia | hamzy: I guess first, I just want to validate we're getting valid data into ironic for the deploy that is being requested | 15:40 |
| *** priteau has joined #openstack-ironic | 15:40 | |
| *** priteau has quit IRC | 15:41 | |
| *** priteau has joined #openstack-ironic | 15:42 | |
| *** trungnv has quit IRC | 15:42 | |
| *** rama_y has joined #openstack-ironic | 15:43 | |
| TheJulia | hamzy: also, is swift running on your undercloud? | 15:45 |
| hamzy | TheJulia, https://hamzy.fedorapeople.org/ironic-conductor.log | 15:46 |
| hamzy | is that what you were looking for? | 15:46 |
| *** priteau has quit IRC | 15:46 | |
| *** ccamacho has quit IRC | 15:46 | |
| *** priteau has joined #openstack-ironic | 15:46 | |
| hamzy | this is now the use case of agent_impitool and swift_temp_url_key | 15:46 |
| hamzy | (undercloud) [stack@oscloud5 ~]$ swift list | 15:47 |
| hamzy | Authorization Failure. Authorization failed: (http://9.114.118.98:5000/auth/tokens): The resource could not be found. (HTTP 404) | 15:47 |
| *** priteau_ has joined #openstack-ironic | 15:47 | |
| TheJulia | hamzy: sadly that log does not show an attempted deployment | 15:48 |
| *** priteau_ has quit IRC | 15:48 | |
| hamzy | yeah it doesn't get far enough to boot the machine | 15:48 |
| TheJulia | hamzy: is there an endpoint in keystone? | 15:48 |
| hamzy | how do I find that out? | 15:49 |
| TheJulia | openstack endpoint list | 15:50 |
| *** priteau__ has joined #openstack-ironic | 15:50 | |
| *** racedo has quit IRC | 15:50 | |
| hamzy | https://paste.fedoraproject.org/paste/S7IgcWfMx8zbxIF2IatjEw/ | 15:50 |
| *** priteau has quit IRC | 15:51 | |
| openstackgerrit | Hugo Nicodemos proposed openstack/ironic master: Migrate oneview driver to use python-hpOneView https://review.openstack.org/466872 | 15:52 |
| openstackgerrit | Hugo Nicodemos proposed openstack/ironic master: Migrate python-oneviewclient validations to Ironic OneView drivers https://review.openstack.org/468428 | 15:52 |
| openstackgerrit | Hugo Nicodemos proposed openstack/ironic master: Fix persistent information when getting boot device https://review.openstack.org/491983 | 15:52 |
| hamzy | it seems so, yes | 15:52 |
| TheJulia | hamzy: best I can figure at this point is to enable debug logging for the conductor, truncate it, restart it, and attempt to deploy your overcloud | 15:53 |
| hamzy | TheJulia, do you want me to switch back to pxe_ipmitool? | 15:54 |
| hamzy | that at least gets farther along IIRC | 15:54 |
| TheJulia | lets stick with agent for the moment, because it might be a silly simple misconfiguration | 15:56 |
| TheJulia | pxe sounds like is missing a package | 15:56 |
| hamzy | ok... I hope so | 15:57 |
| hamzy | will clean out the logs and try again after lunch | 15:58 |
| TheJulia | okay | 15:58 |
| TheJulia | wow, i guess it is getting to lunch-ish time | 15:58 |
| *** tuanla_fujitsu has quit IRC | 15:59 | |
| *** tuanla__ has quit IRC | 15:59 | |
| *** dsneddon has joined #openstack-ironic | 16:02 | |
| *** amarao has quit IRC | 16:07 | |
| *** lucasagomes is now known as lucas-afk | 16:07 | |
| *** amarao1 has quit IRC | 16:08 | |
| *** pooja has quit IRC | 16:09 | |
| *** dtantsur|afk is now known as dtantsur | 16:16 | |
| dtantsur | (very ugt) morning ironic | 16:17 |
| dtantsur | I think I've sorted my visa stuff finally | 16:17 |
| dtantsur | anything requiring my attention, except for 501315? | 16:19 |
| *** krtaylor has quit IRC | 16:21 | |
| rloo | hi dtantsur. glad you got the visa stuff sorted out! | 16:23 |
| dtantsur | thanks :) you can't imagine how glad I am :) | 16:24 |
| rloo | dtantsur: i cannot imagine, but can try ;) | 16:24 |
| rloo | dtantsur: so i have a question about https://review.openstack.org/#/c/500955/ | 16:24 |
| patchbot | patch 500955 - ironic - Fix race condition in backfill_version_column() | 16:24 |
| dtantsur | now (unrelated) I need to understand how to bring N t-shirts through the US customs without the offices being too upset with me.. | 16:24 |
| dtantsur | s/offices/officers/ | 16:24 |
| *** dprince has quit IRC | 16:24 | |
| rloo | dtantsur: oh geez. i thought you'd get the tshirts done in the US | 16:24 |
| rloo | dtantsur: that is a BIG problem | 16:25 |
| dtantsur | rloo: so did I.. do you know something about it? | 16:25 |
| rloo | dtantsur: if a recollect, and/or if it is similar to canada. They will make you pay taxes | 16:25 |
| rloo | dtantsur: you should ask the people in your company; someone there must know. | 16:25 |
| dtantsur | TheJulia: in case you know something about it ^^^ | 16:25 |
| *** Nisha_Agarwal has joined #openstack-ironic | 16:25 | |
| rloo | NobodyCam: do you recall what you had to go (or HP) to get those sweatshirts into hong kong? | 16:26 |
| *** dprince has joined #openstack-ironic | 16:27 | |
| NobodyCam | Hey Good Morning Ironic'ers | 16:32 |
| rloo | morning NobodyCam! ^^ | 16:32 |
| rloo | dtantsur: so back to my question about the race condition: https://review.openstack.org/#/c/500955/ | 16:33 |
| patchbot | patch 500955 - ironic - Fix race condition in backfill_version_column() | 16:33 |
| rloo | dtantsur: that needs to be backported to pike | 16:33 |
| NobodyCam | rloo: it as mark atwood that got them in to hong kong, I believe he shipped them to the hotel he was staying at. | 16:33 |
| rloo | dtantsur: but if it is backported to pike, then it doesn't need to be on master; i could backport the set-version-for-conductor to pike too | 16:33 |
| rloo | dtantsur: and then i'd end up deleting this method from master altogether. | 16:34 |
| rloo | NobodyCam: ahh. So it needs planning/time to do it. | 16:34 |
| NobodyCam | at least for hong kong. | 16:35 |
| TheJulia | dtantsur: \o/ I don't think so | 16:35 |
| dtantsur | rloo: mm, I don't quite agree with the conclusions. we need it fixed on both releases, because we don't want *future* upgrades to hit problems | 16:35 |
| NobodyCam | and morning rloo, TheJulia dtantsur :) | 16:35 |
| dtantsur | rloo: we cannot just add new migration to pike, because somebody can already run upgraded pike in production. we have to have it in master. | 16:36 |
| TheJulia | dtantsur: depends on the declaration and cost I guess, I've never had to do it | 16:36 |
| rloo | dtantsur: that backfill method was meant to be a one-time thing. after pike, our code will always set the value in the db for 'version' column | 16:36 |
| dtantsur | TheJulia: unrelated: the interop sessions seems to be at 1:15 on Mon | 16:36 |
| TheJulia | dtantsur: shipping to the hotel as a gift, but it also is likely too late to ship them aside from a carrier like fedex | 16:37 |
| TheJulia | or maybe dhl | 16:37 |
| *** rpioso has joined #openstack-ironic | 16:38 | |
| dtantsur | meh... | 16:38 |
| rpioso | Good morning, ironicers! | 16:39 |
| dtantsur | okay, I'll torture our folks :) the last thing I want to do is just to show up with a risky luggage | 16:39 |
| TheJulia | if it is any consolation, I might end up toating a projector to sydney ;) | 16:39 |
| dtantsur | morning rpioso, NobodyCam and everyone | 16:39 |
| rpioso | dtantsur: :) | 16:39 |
| NobodyCam | morning rpioso :) | 16:39 |
| TheJulia | but I'll leave with the projector | 16:39 |
| * TheJulia suddenly gets the idea to take a projector to PTG | 16:40 | |
| rloo | TheJulia: seriously? You should ask the foundation to make sure there is said projector there. | 16:40 |
| TheJulia | Well, even outside of the rooms, I've had a couple cases where it would have been handy | 16:40 |
| rloo | TheJulia: have projector... will travel... | 16:40 |
| TheJulia | muahahaha | 16:41 |
| TheJulia | anyway, I'm going to go snack and return with black hair. | 16:41 |
| TheJulia | hair dye | 16:42 |
| rloo | TheJulia: cool! | 16:42 |
| rpioso | Is anyone familiar with the code mechanics involved in deprecating a hardware type's supported interface? Is it as simple as overriding the __setattr__ method, looking for the property name and deprecated value, and outputing a log message on match? | 16:42 |
| rpioso | NobodyCam: Hey! | 16:43 |
| NobodyCam | :) | 16:43 |
| *** penick has joined #openstack-ironic | 16:44 | |
| dtantsur | rpioso: what exactly would you like to deprecate? | 16:47 |
| *** Nisha_Agarwal has quit IRC | 16:49 | |
| *** Nisha_ has joined #openstack-ironic | 16:49 | |
| rpioso | dtantsur: To add UEFI support to the drac driver, I believe a new boot interface class will be needed. It would be derived from PXEBoot. I envision it being modeled after IloPXEBoot. | 16:50 |
| rpioso | dtantsur: So, the present support for PXEBoot would be deprecated. | 16:50 |
| dtantsur | rpioso: what we did with iRMC was just issue a release note about "pxe" being deprecated | 16:51 |
| dtantsur | but I like the idea of a proper deprecation warning too, if it can be done in a clean way | 16:51 |
| rpioso | dtantsur: The new class would be a strict superset of PXEBoot. | 16:51 |
| dtantsur | __setattr__ may not catch existing nodes with idrac+pxe | 16:51 |
| dtantsur | yeah, it was the same for irmc, we did a similar deprecation | 16:51 |
| dtantsur | rpioso: as a bare minimum, a release note will be enough | 16:52 |
| dtantsur | and a documentation update would be good, if we had *any* documentation for the idrac driver ;) | 16:52 |
| rpioso | dtantsur: Sounds like there are options, some simpler than others :) | 16:53 |
| rpioso | dtantsur: That'll teach me to ask. | 16:54 |
| * sambetts ----> home | 16:54 | |
| sambetts | night all | 16:54 |
| *** sambetts is now known as sambetts|afk | 16:54 | |
| rpioso | dtantsur: ;) | 16:54 |
| dtantsur | :) | 16:54 |
| rpioso | dtantsur: Thank you. | 16:55 |
| dtantsur | you're welcome, as always | 16:55 |
| rpioso | sambetts|afk: Good night! | 16:55 |
| *** Nisha_ has quit IRC | 16:57 | |
| *** Nisha_Agarwal has joined #openstack-ironic | 16:57 | |
| *** athomas has quit IRC | 16:58 | |
| *** e0ne has quit IRC | 17:01 | |
| *** derekh has quit IRC | 17:01 | |
| *** ricardoas1 is now known as ricardoas | 17:01 | |
| *** rcernin has quit IRC | 17:02 | |
| fellypefca | TheJulia Are you good with this explanation that ricardoas gave about the hardcoded to the first system node? :) https://review.openstack.org/#/c/466872/ | 17:04 |
| patchbot | patch 466872 - ironic - Migrate oneview driver to use python-hpOneView | 17:04 |
| *** Nisha_Agarwal has quit IRC | 17:04 | |
| TheJulia | fellypefca: I am good with the hardcoded default as-is :) | 17:04 |
| *** etingof has quit IRC | 17:04 | |
| * TheJulia looks | 17:04 | |
| *** krtaylor has joined #openstack-ironic | 17:05 | |
| TheJulia | fellypefca: interesting.... | 17:05 |
| *** sasha2 has quit IRC | 17:05 | |
| *** jkilpatr has quit IRC | 17:06 | |
| *** sasha2 has joined #openstack-ironic | 17:06 | |
| *** yangyapeng has joined #openstack-ironic | 17:06 | |
| *** harlowja has quit IRC | 17:07 | |
| *** harlowja has joined #openstack-ironic | 17:07 | |
| fellypefca | TheJulia :D :D | 17:09 |
| TheJulia | fellypefca: it just makes me wonder if there was too much over-thinking somewhere in the ilo rest interface | 17:10 |
| *** yangyapeng has quit IRC | 17:10 | |
| fellypefca | TheJulia hmm.. I think I did not understand very well what you mean with too much over-thinking somewhere :/ | 17:12 |
| TheJulia | it being contextual to the session | 17:12 |
| *** milan has quit IRC | 17:17 | |
| ricardoas | fellypefca TheJulia: what I know is that ilo answers rest requests at /rest/v1 and (from version 4 on i think) redfish requests at /redfish/v1 and both are queriable using python-ilorest-library, but when you use ilo ip address to create a client it access only the context of that server hardware... | 17:18 |
| ricardoas | it doesn´t know the other server hardware in the same enclosure/rack/oneview appliance | 17:19 |
| * dtantsur has to bail out and get some food and sleep | 17:19 | |
| TheJulia | dtantsur: goodnight! :) | 17:19 |
| dtantsur | see you tomorrow (finally working, w00t!) | 17:19 |
| *** dtantsur is now known as dtantsur|afk | 17:19 | |
| *** jkilpatr has joined #openstack-ironic | 17:19 | |
| ricardoas | night, dtantsur|afk | 17:19 |
| NobodyCam | have a good night dtantsur|afk | 17:20 |
| TheJulia | ricardoas: I guess that kind of makes sense, but... yeah. | 17:20 |
| *** kzaitsev_pi has joined #openstack-ironic | 17:21 | |
| TheJulia | ricardoas: but...... i suspect that wouldn't work exactly on the moonshot gear, since when I played with the rest interface, I had a single address, and many systems off of v1... but apparently that has changed in later hardware revisions | 17:21 |
| *** trown is now known as trown|lunch | 17:25 | |
| *** jaganathan has quit IRC | 17:26 | |
| *** baoli has quit IRC | 17:28 | |
| ricardoas | TheJulia: you mean one ilo address to many server hardware? | 17:28 |
| ricardoas | TheJulia: I´ve never been to that part of the kingdom :( | 17:30 |
| openstackgerrit | Merged openstack/ironic stable/pike: [reno] Clarify fix for BFV & image_source https://review.openstack.org/501258 | 17:31 |
| *** baoli has joined #openstack-ironic | 17:31 | |
| openstackgerrit | Merged openstack/ironic stable/pike: [reno] Clarify fix for missing boot.prepare_instance https://review.openstack.org/501257 | 17:31 |
| *** adisky__ has quit IRC | 17:32 | |
| openstackgerrit | Merged openstack/ironic stable/pike: Update documentation for ``ilo`` hardware type https://review.openstack.org/501108 | 17:33 |
| *** etingof has joined #openstack-ironic | 17:35 | |
| hamzy | TheJulia, new log at https://hamzy.fedorapeople.org/ironic-conductor.log | 17:43 |
| hamzy | and "glance image-show 32bc5604-12cb-46ab-bf74-cedf6f2eb98e" returns information | 17:46 |
| *** jkilpatr has quit IRC | 17:47 | |
| hamzy | so should there be some glance configuration files for apache? "find /etc/httpd/ | grep glance" shows nothing | 17:48 |
| *** jkilpatr has joined #openstack-ironic | 17:48 | |
| hamzy | hrm... https://docs.openstack.org/glance/latest/admin/apache-httpd.html | 17:50 |
| *** ralonsoh has quit IRC | 18:01 | |
| *** harlowja has quit IRC | 18:02 | |
| TheJulia | yeah, I suspect your going to find an error in the swift logs | 18:04 |
| TheJulia | Might be easier to just run it with pxe at this point, since that doesn't use swift, and we can troubleshoot it from there | 18:05 |
| TheJulia | hamzy: for what its worth, you shouldn't need to reinstall to change the driver, although you may need to change the referenced driver on the ironic node and in any templates defining baremetal machines | 18:07 |
| TheJulia | templates/config files | 18:07 |
| hamzy | okay did "openstack baremetal node set --driver pxe_ipmitool 58c6e4a4-b0ec-49a7-9b5a-368a88c50dc3" and for the other node and am rerunning the deploy | 18:11 |
| TheJulia | ok | 18:11 |
| TheJulia | looking for the exit_code error, to try and see where that is coming from | 18:12 |
| TheJulia | since... something seems way off | 18:12 |
| * TheJulia looks at the ipa source | 18:12 | |
| TheJulia | hamzy: do you know how the deployment ramdisk has been built? | 18:14 |
| hamzy | "openstack overcloud image build" which is a long process | 18:15 |
| TheJulia | does it generate a log of any sort? | 18:15 |
| hamzy | it did but was accidentally deleted | 18:16 |
| hamzy | it eventually calls DIB | 18:16 |
| hamzy | and creates ironic-python-agent.{vmlinuz,initramfs} and overcloud-full.{qcow2,vmlinuz} | 18:17 |
| * TheJulia wonders if the initramfs file would be available for disection..... | 18:18 | |
| hamzy | I can copy it over to fedorapeople | 18:19 |
| *** hjensas has quit IRC | 18:20 | |
| TheJulia | lets go with the conductor log, that will tell me where that driver is failing fairly precisely, and if it is not where I expect, then I fear that image will need to be taken apart and examined | 18:20 |
| *** ijw has joined #openstack-ironic | 18:24 | |
| TheJulia | strong possibility it is missing tgtadm | 18:24 |
| TheJulia | or tgtd | 18:24 |
| *** rama_y has quit IRC | 18:25 | |
| *** ijw has quit IRC | 18:26 | |
| hamzy | okay both nodes ran IPA | 18:26 |
| *** ijw has joined #openstack-ironic | 18:26 | |
| hamzy | https://hamzy.fedorapeople.org/ironic-conductor.log | 18:27 |
| *** krtaylor has quit IRC | 18:28 | |
| *** tesseract has quit IRC | 18:31 | |
| hamzy | there is mention of "#enabled_deploy_interfaces = iscsi,direct" in ironic.conf | 18:31 |
| *** krtaylor has joined #openstack-ironic | 18:31 | |
| TheJulia | you don't need to mess with that using classic drivers | 18:31 |
| hamzy | just wondering why it is trying to call iscsi | 18:32 |
| TheJulia | so, with this error, it is definitely missing something in the ramdisk, I see the bug in IPA that actually gets raised and working on a fix | 18:32 |
| TheJulia | hamzy: so, pxe_ipmitool has a default deployment interface using the iscsi interface | 18:32 |
| TheJulia | IPA shares the root disk with the ironic conductor over iscsi and the image is written out that way | 18:32 |
| hamzy | so DIB was missing a parameter when it was run? | 18:33 |
| rloo | dtantsur|afk: wrt that race condition: https://review.openstack.org/#/c/500955/, I commented in the related bug, i hope it makes sense, because I think we may need to act on it sooner rather than later: https://bugs.launchpad.net/ironic/+bug/1715190 | 18:35 |
| openstack | Launchpad bug 1715190 in Ironic "db.sqlalchemy.api.Connection.backfill_version_column has race condition" [Critical,In progress] - Assigned to Ruby Loo (rloo) | 18:35 |
| patchbot | patch 500955 - ironic - Fix race condition in backfill_version_column() | 18:35 |
| rloo | dtantsur|afk: although maybe it isn't a critical bug, just high. I'm not sure... | 18:35 |
| *** rama_y has joined #openstack-ironic | 18:37 | |
| *** rama_y has quit IRC | 18:37 | |
| TheJulia | hamzy: more like a package is missing in what it is building.... | 18:38 |
| *** trown|lunch is now known as trown | 18:38 | |
| hamzy | TheJulia, I am rerunning the "openstack overcloud image build" to get a log file... unfortunately it will take a couple of hours since the base qcow image for ppc64le downloads a 1Gb+ image file over a really slow link | 18:39 |
| hamzy | https://hamzy.fedorapeople.org/ironic-python-agent.initramfs is out there BTW | 18:40 |
| TheJulia | uhh | 18:40 |
| TheJulia | hmm | 18:40 |
| hamzy | I have uncompressed it locally and can poke around | 18:41 |
| TheJulia | is the ipa image your building centos? | 18:41 |
| hamzy | yes | 18:41 |
| TheJulia | hamzy: do you see tgtadm or tgtd in it? | 18:41 |
| TheJulia | centos7? | 18:41 |
| hamzy | 7.3.1611 | 18:42 |
| hamzy | (undercloud) [stack@oscloud5 ironic-python-agent]$ find . -iname \*tgtd\* | 18:42 |
| hamzy | ./etc/selinux/targeted/active/modules/100/tgtd | 18:42 |
| hamzy | ./usr/lib/modules/3.10.0-514.26.2.el7.ppc64le/kernel/drivers/scsi/ibmvscsi/ibmvstgt.ko | 18:43 |
| hamzy | ./usr/lib/modules/3.10.0-514.26.2.el7.ppc64le/kernel/drivers/scsi/scsi_tgt.ko | 18:43 |
| hamzy | ./etc/selinux/targeted/active/modules/100/tgtd | 18:43 |
| *** mrtenio has quit IRC | 18:43 | |
| TheJulia | lovely | 18:43 |
| hamzy | everything that was needed? | 18:44 |
| TheJulia | looking upt he package now | 18:44 |
| TheJulia | looks like scsi-target-utils just doesn't exist for centos7 which means it is not a viable for pxe based deployments | 18:47 |
| hamzy | :( | 18:47 |
| TheJulia | looks like they went to targetcli | 18:47 |
| TheJulia | which I believe is a fork | 18:47 |
| TheJulia | which means different commands | 18:47 |
| TheJulia | ugh | 18:48 |
| TheJulia | so fedora does carry scsi-target-utils | 18:48 |
| TheJulia | if that is a viable option at all | 18:48 |
| hamzy | you mean build IPA using fedora? | 18:49 |
| TheJulia | yeah | 18:49 |
| TheJulia | well | 18:49 |
| *** ijw has quit IRC | 18:49 | |
| TheJulia | not using, but build a fedora ipa image | 18:49 |
| hamzy | could be possible | 18:49 |
| hamzy | will have to investigate | 18:49 |
| hamzy | thanks for your help! | 18:50 |
| *** bfournie has left #openstack-ironic | 18:53 | |
| *** ijw has joined #openstack-ironic | 18:57 | |
| *** bfournie has joined #openstack-ironic | 18:59 | |
| *** ijw has quit IRC | 19:02 | |
| *** ijw has joined #openstack-ironic | 19:03 | |
| TheJulia | hamzy: I'm working on fixing the error, at least partially as it has to do with iscsi init | 19:05 |
| TheJulia | but, you'll still need the base packages in place | 19:05 |
| hamzy | it would be helpful if an error was returned about missing the executable | 19:05 |
| TheJulia | yeah, that is what I'm working on now, it should actually raise the real error once I'm done | 19:06 |
| hamzy | cool! | 19:07 |
| *** ijw has quit IRC | 19:08 | |
| *** e0ne has joined #openstack-ironic | 19:08 | |
| *** jcoufal_ has joined #openstack-ironic | 19:11 | |
| *** fellypefca is now known as fellypefca-afk | 19:12 | |
| fellypefca-afk | Good night everyone :) | 19:12 |
| *** fellypefca-afk has quit IRC | 19:13 | |
| *** jcoufal has quit IRC | 19:14 | |
| *** gmonteiro has quit IRC | 19:16 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic-python-agent master: Fix OSError catch https://review.openstack.org/501386 | 19:18 |
| *** rivers has quit IRC | 19:25 | |
| *** rivers has joined #openstack-ironic | 19:26 | |
| *** crushil has quit IRC | 19:31 | |
| TheJulia | hamzy: https://bugs.launchpad.net/ironic-python-agent/+bug/1715471 for the centos7 support | 19:32 |
| openstack | Launchpad bug 1715471 in ironic-python-agent "IPA incompatible with Centos7" [Medium,Triaged] | 19:32 |
| *** ijw has joined #openstack-ironic | 19:33 | |
| hamzy | thanks | 19:33 |
| TheJulia | w/r/t agent deployment, if you were to check your swift log, it might reveal some details. Also I'm curious if ironic.conf has swift configured in it. | 19:33 |
| *** pcaruana has quit IRC | 19:34 | |
| * TheJulia will get down to client code one day | 19:34 | |
| TheJulia | s/down/back | 19:34 |
| hamzy | /var/log/swift/ is empty | 19:35 |
| TheJulia | journalctl ? | 19:36 |
| hamzy | https://paste.fedoraproject.org/paste/BDyJBxBlX8v8UQE8T6L-Rg/ which one? | 19:36 |
| TheJulia | proxy or object server if memory serves | 19:37 |
| *** ijw has quit IRC | 19:39 | |
| hamzy | https://paste.fedoraproject.org/paste/6rDlCT7hB-JT7~PRxobfvw/ https://paste.fedoraproject.org/paste/Tacu5SqJUrvjN3SRfigB~w/ don't notice an error in the short logs | 19:39 |
| *** ijw has joined #openstack-ironic | 19:40 | |
| *** mgoddard has joined #openstack-ironic | 19:40 | |
| TheJulia | I guess maybe looking for a 404 error. | 19:41 |
| TheJulia | you know.... | 19:41 |
| * TheJulia pulls the example config up to paste a link | 19:41 | |
| TheJulia | I wonder if http://git.openstack.org/cgit/openstack/ironic/tree/etc/ironic/ironic.conf.sample#n1675 is set or not in ironic.conf | 19:43 |
| TheJulia | or if it is even configured deep inside swift | 19:43 |
| hamzy | yes I set it | 19:43 |
| TheJulia | hamzy: following what instructions? | 19:44 |
| hamzy | https://docs.openstack.org/ironic/latest/install/configure-glance-swift.html | 19:44 |
| *** ijw has quit IRC | 19:45 | |
| hamzy | although I suspect swift_endpoint_url is bogus in that example | 19:45 |
| hamzy | I've tried multiple combinations there | 19:45 |
| hamzy | even messing around with wget on the command line but still receive 404... I think there is no connection for apache to know where that get really lives | 19:47 |
| TheJulia | is glance configured to store images in swift? | 19:49 |
| hamzy | there is a /etc/glance/glance-swift.conf | 19:50 |
| * TheJulia looks at the urls in the logs | 19:50 | |
| hamzy | default_store=swift | 19:52 |
| TheJulia | what is the container set to for glance to store into? | 19:52 |
| hamzy | how do I find that out? | 19:53 |
| TheJulia | good question | 19:54 |
| *** jcoufal_ has quit IRC | 19:55 | |
| TheJulia | ironic thinks it is just "glance", but looking at the swift logs, that might not be the case | 19:55 |
| TheJulia | but you've got a tripleo deployment, so dunno | 19:55 |
| TheJulia | http://git.openstack.org/cgit/openstack/ironic/tree/etc/ironic/ironic.conf.sample#n1626 vs https://paste.fedoraproject.org/paste/Tacu5SqJUrvjN3SRfigB~w/ | 19:55 |
| *** ijw has joined #openstack-ironic | 19:58 | |
| *** dprince has quit IRC | 19:58 | |
| *** jcoufal has joined #openstack-ironic | 19:59 | |
| TheJulia | swift_store_user = service:glance but that might not set container names, googling around seems to reveal that there may be a feature for randomizing container names | 20:00 |
| TheJulia | or using multiple containers | 20:00 |
| * TheJulia doesn't know glance well | 20:00 | |
| TheJulia | swift_store_container = ‘glance’ | 20:01 |
| hamzy | I've been poking around https://paste.fedoraproject.org/paste/bWE2rMdC19OR7E0L--SuSg | 20:02 |
| TheJulia | https://specs.openstack.org/openstack/glance-specs/specs/kilo/swift-store-multiple-containers.html | 20:02 |
| TheJulia | hmmmm | 20:03 |
| TheJulia | look at that shiny overcloud container with 755 objects.... | 20:03 |
| TheJulia | :) | 20:03 |
| hamzy | trying to figure out how to list inside a container | 20:06 |
| *** milan has joined #openstack-ironic | 20:06 | |
| TheJulia | no idea.... | 20:07 |
| hamzy | hrm https://docs.openstack.org/python-openstackclient/latest/cli/command-objects/container.html | 20:08 |
| *** mat128 has quit IRC | 20:09 | |
| *** crushil has joined #openstack-ironic | 20:09 | |
| *** jtomasek has quit IRC | 20:12 | |
| *** jtomasek has joined #openstack-ironic | 20:13 | |
| hamzy | https://paste.fedoraproject.org/paste/VI680Jdg9vyAECaI7VamqQ | 20:14 |
| hamzy | doesn't look like it contains something to deploy | 20:14 |
| TheJulia | ugh | 20:15 |
| TheJulia | so where are the images going then :( | 20:16 |
| hamzy | so when ironic calls glance to generate the temporary url, is glance supposed to cache the object somehow? | 20:16 |
| TheJulia | so | 20:16 |
| TheJulia | not exactly | 20:16 |
| TheJulia | glance is always supposed to keep the images in swift | 20:16 |
| TheJulia | when it is used as the backing store | 20:17 |
| *** jtomasek has quit IRC | 20:17 | |
| TheJulia | what ironic then gets, with the secret key for tempurl access, is ironic generates an encoded value with an embedded timeout for the tempurl, that swift then is able to decode since it knows the secret, and use that to authenticate the request | 20:18 |
| hamzy | so I see images in glance image-list but have yet to translate that somehow into swift container | 20:18 |
| TheJulia | so 404, as noted by the logs, means it actually doesn't have the file | 20:18 |
| TheJulia | or, we're asking in the wrong place | 20:18 |
| *** srobert_ has joined #openstack-ironic | 20:30 | |
| *** mgoddard has quit IRC | 20:32 | |
| *** srobert has quit IRC | 20:33 | |
| *** srobert_ has quit IRC | 20:34 | |
| openstackgerrit | John L. Villalovos proposed openstack/ironic-lib master: flake8: Enable some off-by-default checks https://review.openstack.org/501419 | 20:35 |
| hamzy | yeah I'll play around with it some more... maybe try and wget a file out of the overcloud container | 20:35 |
| TheJulia | hamzy: one tip, generate a very long lived tempurl ;) | 20:36 |
| hamzy | hehe | 20:36 |
| *** Goneri has quit IRC | 20:38 | |
| *** e0ne has quit IRC | 20:38 | |
| *** dprince has joined #openstack-ironic | 20:40 | |
| *** milan has quit IRC | 20:46 | |
| *** rpioso has quit IRC | 20:50 | |
| *** rpioso has joined #openstack-ironic | 20:50 | |
| *** jkilpatr has quit IRC | 20:54 | |
| *** trown is now known as trown|outtypewww | 21:00 | |
| *** krtaylor has quit IRC | 21:01 | |
| openstackgerrit | John L. Villalovos proposed openstack/python-ironicclient master: flake8: Enable some off-by-default checks https://review.openstack.org/501440 | 21:02 |
| openstackgerrit | Ruby Loo proposed openstack/ironic master: reformat REST API Version History page https://review.openstack.org/501442 | 21:03 |
| *** [1]rpioso has joined #openstack-ironic | 21:06 | |
| *** jkilpatr has joined #openstack-ironic | 21:08 | |
| *** rpioso has quit IRC | 21:11 | |
| *** bfournie has quit IRC | 21:13 | |
| *** krtaylor has joined #openstack-ironic | 21:17 | |
| *** yangyapeng has joined #openstack-ironic | 21:22 | |
| *** jcoufal has quit IRC | 21:24 | |
| *** jcoufal has joined #openstack-ironic | 21:24 | |
| *** yolanda has quit IRC | 21:26 | |
| *** yolanda has joined #openstack-ironic | 21:26 | |
| *** yangyapeng has quit IRC | 21:27 | |
| *** crushil has quit IRC | 21:29 | |
| *** crushil has joined #openstack-ironic | 21:30 | |
| *** Nisha_Agarwal has joined #openstack-ironic | 21:40 | |
| *** pooja has joined #openstack-ironic | 21:45 | |
| *** harlowja has joined #openstack-ironic | 21:45 | |
| pooja | Hi, I needed some help with injecting password for a baremetal node during provisioning.. I deployed the nova instance with SSH key but still was not able to login | 21:46 |
| *** Nisha_Agarwal has quit IRC | 21:46 | |
| pooja | Also tried creating the user image with DIB_CLOUD_INIT_DATASOURCES="ConfigDrive, OpenStack" using disk-image-builder and see metadata requests coming to nova-api | 21:47 |
| pooja | Is there any documentation around ways to inject SSH key or password using disk-image-builder? | 21:48 |
| pooja | * I mean for images created using disk-image-builder | 21:48 |
| *** priteau__ has quit IRC | 21:50 | |
| openstackgerrit | Sean McGinnis proposed openstack/ironic master: Use newer location for iso8601 UTC https://review.openstack.org/501476 | 21:54 |
| *** jlabarre has quit IRC | 21:55 | |
| *** jlabarre has joined #openstack-ironic | 21:57 | |
| *** priteau has joined #openstack-ironic | 21:58 | |
| *** priteau has quit IRC | 22:03 | |
| *** ijw has quit IRC | 22:03 | |
| *** jcoufal_ has joined #openstack-ironic | 22:04 | |
| *** ijw has joined #openstack-ironic | 22:05 | |
| *** bfournie has joined #openstack-ironic | 22:07 | |
| *** bfournie has quit IRC | 22:07 | |
| *** jcoufal has quit IRC | 22:07 | |
| *** bfournie has joined #openstack-ironic | 22:08 | |
| *** ijw has quit IRC | 22:11 | |
| jlvillal | Wow, gate is slow today. May job has been queued for 1 hr 38 mins, nothing yet running :( | 22:14 |
| *** Nisha_Agarwal has joined #openstack-ironic | 22:15 | |
| *** baoli has quit IRC | 22:18 | |
| *** Nisha_Agarwal has quit IRC | 22:19 | |
| *** jcoufal_ has quit IRC | 22:23 | |
| *** jcoufal has joined #openstack-ironic | 22:23 | |
| *** jaypipes has quit IRC | 22:24 | |
| anupn | jlvillal, sad :( | 22:26 |
| *** dprince has quit IRC | 22:26 | |
| *** pooja has quit IRC | 22:27 | |
| *** jlabarre has quit IRC | 22:27 | |
| *** jlabarre has joined #openstack-ironic | 22:29 | |
| TheJulia | :( | 22:30 |
| TheJulia | jlvillal: could be worse, I've seen upstream gates queued for far longer :( | 22:30 |
| jlvillal | TheJulia: True. But usually that is near release time. My job has started though :) | 22:31 |
| *** ijw has joined #openstack-ironic | 22:35 | |
| *** krtaylor has quit IRC | 22:37 | |
| *** Nisha_Agarwal has joined #openstack-ironic | 22:48 | |
| *** penick has quit IRC | 22:50 | |
| *** Nisha_ has joined #openstack-ironic | 22:54 | |
| *** Nisha_Agarwal has quit IRC | 22:55 | |
| *** thegreenhundred has quit IRC | 22:55 | |
| *** dyasny_ has joined #openstack-ironic | 22:59 | |
| *** Nisha_ has quit IRC | 22:59 | |
| *** dyasny has quit IRC | 23:00 | |
| *** Nisha_Agarwal has joined #openstack-ironic | 23:02 | |
| *** dyasny_ has quit IRC | 23:03 | |
| *** ijw has quit IRC | 23:07 | |
| *** Goneri has joined #openstack-ironic | 23:23 | |
| *** sasha2 has quit IRC | 23:24 | |
| *** Goneri has quit IRC | 23:29 | |
| *** Nisha_Agarwal has quit IRC | 23:32 | |
| *** yangyapeng has joined #openstack-ironic | 23:38 | |
| *** baoli has joined #openstack-ironic | 23:38 | |
| *** baoli has quit IRC | 23:39 | |
| *** yuanying has quit IRC | 23:40 | |
| *** baoli has joined #openstack-ironic | 23:40 | |
| *** yangyapeng has quit IRC | 23:43 | |
| *** baoli has quit IRC | 23:51 | |
| *** priteau has joined #openstack-ironic | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!