| *** derekh has quit IRC | 00:12 | |
| *** gyee has quit IRC | 01:17 | |
| stevebaker | janders: hey I have a question regarding disk formatting which you may be able to help with | 01:36 |
|---|---|---|
| *** openstackgerrit has joined #openstack-ironic | 01:59 | |
| openstackgerrit | likui proposed openstack/python-ironicclient master: setup.cfg: Replace dashes with underscores https://review.opendev.org/c/openstack/python-ironicclient/+/791078 | 01:59 |
| *** jlvillal has quit IRC | 03:01 | |
| *** jlvillal has joined #openstack-ironic | 03:01 | |
| *** jlvillal has quit IRC | 03:08 | |
| *** jlvillal has joined #openstack-ironic | 03:13 | |
| janders | stevebaker sorry - was in a meeting then in a call then at lunch - how can I help? | 03:32 |
| *** k_mouza has joined #openstack-ironic | 03:34 | |
| *** k_mouza has quit IRC | 03:39 | |
| *** rcernin has quit IRC | 05:13 | |
| *** rcernin has joined #openstack-ironic | 05:19 | |
| *** uzumaki has joined #openstack-ironic | 05:58 | |
| iurygregory | good morning Ironic o/ | 06:16 |
| *** uzumaki has quit IRC | 06:41 | |
| *** lucasagomes has joined #openstack-ironic | 07:04 | |
| *** tosky has joined #openstack-ironic | 07:47 | |
| *** derekh has joined #openstack-ironic | 08:02 | |
| *** ociuhandu has joined #openstack-ironic | 08:13 | |
| *** ociuhandu has quit IRC | 08:18 | |
| janders | hey iurygregory | 08:34 |
| janders | Dear Ironicers. Have you seen a case where virtual media attachment stops working on a node - and reboot / BMC reset does not help? Other nodes mount the same URL without problems. The node affected reports success on API call, shows the vmedia status as mounted with this URL, but it never shows up in the OS (and it used to). Was working fine all | 08:38 |
| janders | week before. Any suggestions? Thanks! | 08:38 |
| janders | (it's an HP ProLiant e910) | 08:39 |
| janders | interestingly, connection attempt shows up in dmesg (but the device no longer appears in lsblk output) and on mount attempt I get "mount: /mnt: no medium found on /dev/sda." | 08:42 |
| iurygregory | janders, hey o/ | 08:42 |
| iurygregory | wow O.o | 08:42 |
| iurygregory | never saw this before | 08:42 |
| janders | I think I might have answered my own question | 08:44 |
| janders | it was busted first, confirmed | 08:44 |
| iurygregory | oh =) | 08:44 |
| janders | but the reboot might have fixed the vmedia but re-enabled the firewall | 08:44 |
| iurygregory | enrr | 08:44 |
| janders | (I am serving the iso over "loopback" to test vmedia performance as it was super slow yesterday) | 08:44 |
| iurygregory | really?! | 08:44 |
| janders | essentiall the server serves the iso to it's own BMC | 08:45 |
| iurygregory | O.o | 08:45 |
| janders | it may sound like the most useless test in the World | 08:45 |
| janders | but given limited visibility of networking setup I think it makes sense :) | 08:45 |
| janders | now that I fixed the OS AND the firewall lets see what happens if I try again :) | 08:45 |
| janders | it's curious why it broke in the first place though | 08:46 |
| iurygregory | yeah | 08:47 |
| janders | without using loopback, the R640 was doing 2MB/s and the e910 was doing 0.5MB/s on vMedia | 08:49 |
| iurygregory | woot | 08:49 |
| janders | on loopback, the R640 is doing 20MB/s and the e910 is doing 7MB/s | 08:49 |
| janders | (that's block, will test fs next) | 08:50 |
| iurygregory | if you compare the it would be 10x and 14x :D | 08:50 |
| iurygregory | much more gain for the second hehe | 08:50 |
| janders | in any case copying the whole centos8 minimal iso takes 40s on the R640 and 90s on the e910 now (block) | 08:51 |
| janders | not the best but usable I reckon | 08:51 |
| janders | (unlike that 0.5MB/s) | 08:51 |
| janders | it will be interesting how vMedia deploys work over WAN (or just long range) links | 08:51 |
| janders | might need some tuning | 08:51 |
| iurygregory | agree, 0.5 is complicated... | 08:51 |
| janders | back in the day when I was working on a geographically distributed OpenStack (controllers in one location, computes on all continents) we had to "warm up" glance cache | 08:52 |
| janders | otherwise if you tried to deploy multiple instances in a remote location at the same time it would be a world of pain | 08:52 |
| iurygregory | I can imagine | 08:53 |
| janders | if we warmed the cache with deploying one instance per location before we actually needed them - it worked pretty much as quick as a single-site cluster | 08:53 |
| janders | I wonder if we will need to consider something like this for vMedia deploys for Edge | 08:53 |
| iurygregory | something to keep in mind I would say | 08:53 |
| janders | meanwhile fs-level whole iso copy on e910 also ran at 7MB/s via "loopback" | 08:54 |
| janders | so I think I can put it in the report and treat it as a baseline should we need one :) | 08:54 |
| iurygregory | ++ | 08:55 |
| janders | learning from this morning's fiasco on the e910, I tried another Supermicro just in case the first one also just had some intermittent vMedia problem in the OS | 08:55 |
| janders | but had the same exact problem (silent failure) | 08:55 |
| janders | so it doesn't look like a one-off problem | 08:56 |
| janders | I will look at BMC changelogs in case they fixed it in newer firmware and if not I will give up on this server for now | 08:56 |
| iurygregory | I still have the feeling is a license problem =( | 08:58 |
| iurygregory | or the machine is just too old | 08:58 |
| iurygregory | :D | 08:58 |
| *** k_mouza has joined #openstack-ironic | 09:02 | |
| *** ociuhandu has joined #openstack-ironic | 09:02 | |
| iurygregory | ajya, hey I've asked the person the test the approach you mentioned, he did, the result: tried it and I got SYS011 (Warning: SYS011: Pending configuration values are already committed, unable to perform another set operation. Wait for the scheduled job to complete or delete the configuration jobs before attempting more set attribute operations.) . Still there is no job in the queue and the discard pending | 09:02 |
| iurygregory | configuration button still applicable. I also preform reset but no change | 09:02 |
| *** ociuhandu has quit IRC | 09:14 | |
| *** ociuhandu has joined #openstack-ironic | 09:14 | |
| *** Xuchu has joined #openstack-ironic | 09:32 | |
| ajya | iurygregory: ok, interesting. Can they do anything else with the system? That is, can they manually (iDRAC web) create a BIOS or RAID job? Can they do Import manually? (Configuration->Server Configuration Profile->Import). | 09:32 |
| ajya | If it is possible manually, then there is something wrong going in sushy-oem-idrac, if they can't, then it's iDRAC. | 09:33 |
| ajya | Also could upgrade iDRAC, I see it's 4.00.00.00 that has issue around virtual media boot anyway. | 09:33 |
| iurygregory | they are using 4.40.00.00 =( | 09:33 |
| iurygregory | I will ask if they can create some jobs | 09:34 |
| iurygregory | they were using FW 3.30.30.30 and did the upgrade to 4.40.0.0 | 09:35 |
| iurygregory | I will also ask them to try 4.22.0.0 for example, to see if the problem will appear | 09:35 |
| *** Xuchu_ has joined #openstack-ironic | 09:36 | |
| *** Xuchu has quit IRC | 09:37 | |
| ajya | ok, I'll check if there is something else that could reset the system (assuming that there is something somewhere stuck internally). | 09:37 |
| iurygregory | ajya, tyvm! | 09:38 |
| ajya | for R640 there is newer 4.40.10.00 available, if there is nothing restricting the upgrade | 09:39 |
| iurygregory | ack | 09:40 |
| *** Xuchu_ has quit IRC | 09:40 | |
| *** ociuhandu has quit IRC | 11:39 | |
| *** ociuhandu has joined #openstack-ironic | 11:40 | |
| *** jhesketh has quit IRC | 11:43 | |
| *** ociuhandu has quit IRC | 11:45 | |
| janders | see you tomorrow Ironic o/ | 11:46 |
| *** ociuhandu has joined #openstack-ironic | 11:56 | |
| iurygregory | bye janders o/ | 11:57 |
| *** tzumainn has joined #openstack-ironic | 12:20 | |
| *** jhesketh has joined #openstack-ironic | 12:21 | |
| *** ociuhandu has quit IRC | 12:25 | |
| *** ociuhandu has joined #openstack-ironic | 12:33 | |
| *** ociuhandu has quit IRC | 12:38 | |
| *** rloo has joined #openstack-ironic | 13:13 | |
| *** rcernin has quit IRC | 13:19 | |
| *** ociuhandu has joined #openstack-ironic | 13:46 | |
| *** ociuhandu has quit IRC | 13:52 | |
| *** ociuhandu has joined #openstack-ironic | 13:52 | |
| *** ociuhandu has quit IRC | 13:57 | |
| *** sdanni has joined #openstack-ironic | 14:06 | |
| *** ociuhandu has joined #openstack-ironic | 14:10 | |
| ajya | what's the status with DHCP-less? Anyone got it working? If using Glean 1.19.0+ with CentOS8 IPA it should be fine now? | 14:10 |
| *** ociuhandu has quit IRC | 14:23 | |
| *** ociuhandu has joined #openstack-ironic | 14:23 | |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic-inspector master: Do not reset FSM when ironic ports cant be queried https://review.opendev.org/c/openstack/ironic-inspector/+/791251 | 14:35 |
| *** sshnaidm is now known as sshnaidm|afk | 15:00 | |
| *** lucasagomes has quit IRC | 15:03 | |
| iurygregory | ajya, I don't remember the Glean version, maybe there is something in the thread dtantsur|afk started in openstack-discuss a while ago | 15:06 |
| ajya | iurygregory: that version is in the docs, recently updated, just want to clarify that it was it | 15:07 |
| iurygregory | oh so it should be :D | 15:07 |
| *** gyee has joined #openstack-ironic | 15:21 | |
| *** rajinir has joined #openstack-ironic | 15:47 | |
| *** k_mouza has quit IRC | 16:00 | |
| *** k_mouza has joined #openstack-ironic | 16:00 | |
| *** ociuhandu has quit IRC | 16:08 | |
| *** ociuhandu has joined #openstack-ironic | 16:24 | |
| openstackgerrit | Bob Fournier proposed openstack/sushy-tools master: Add support for returning message and attribute registries https://review.opendev.org/c/openstack/sushy-tools/+/790361 | 16:27 |
| *** ociuhandu has quit IRC | 16:27 | |
| *** ociuhandu has joined #openstack-ironic | 16:27 | |
| *** ociuhandu has quit IRC | 16:27 | |
| *** ociuhandu has joined #openstack-ironic | 16:36 | |
| *** ociuhandu has quit IRC | 16:40 | |
| *** paras333_ has joined #openstack-ironic | 16:51 | |
| *** derekh has quit IRC | 17:03 | |
| *** k_mouza_ has joined #openstack-ironic | 17:09 | |
| *** k_mouza__ has joined #openstack-ironic | 17:12 | |
| *** k_mouza has quit IRC | 17:13 | |
| *** k_mouza_ has quit IRC | 17:13 | |
| *** k_mouza has joined #openstack-ironic | 17:13 | |
| *** k_mouza__ has quit IRC | 17:17 | |
| *** k_mouza has quit IRC | 17:34 | |
| *** paras333_ has quit IRC | 18:00 | |
| *** bfournie has quit IRC | 19:30 | |
| *** bfournie has joined #openstack-ironic | 19:54 | |
| *** benj_ has quit IRC | 20:09 | |
| *** benj_ has joined #openstack-ironic | 20:12 | |
| -openstackstatus- NOTICE: Zuul is in the process of migrating to a new VM and will be restarted shortly. | 20:40 | |
| *** rloo has quit IRC | 20:50 | |
| *** rloo has joined #openstack-ironic | 20:51 | |
| stevebaker | morning | 20:54 |
| openstackgerrit | Merged openstack/metalsmith master: setup.cfg: Replace dashes with underscores https://review.opendev.org/c/openstack/metalsmith/+/790581 | 22:04 |
| -openstackstatus- NOTICE: We are cautiously optimistic that Zuul is functional now on the new server. We ran into some unexpected problems and want to do another restart in the near future to ensure a revert addresses the source of that problem. | 22:04 | |
| *** k_mouza has joined #openstack-ironic | 22:14 | |
| *** k_mouza has quit IRC | 22:51 | |
| *** rcernin has joined #openstack-ironic | 22:57 | |
| janders | good morning Ironic o/ | 23:09 |
| janders | stevebaker sorry we didn't manage to sync up yesterday - would you still like me to have a look at the disk formatting thing? | 23:10 |
| *** tosky has quit IRC | 23:23 | |
| *** rloo has quit IRC | 23:59 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!