Friday, 2022-04-01

« Thursday, 2022-03-31 Index Saturday, 2022-04-02 »
opendevreviewJulia Kreger proposed openstack/ironic stable/yoga: DNM: get some additional info to debug grenade  https://review.opendev.org/c/openstack/ironic/+/83610502:14
opendevreviewJulia Kreger proposed openstack/ironic master: DNM: get some additional info to debug grenade  https://review.opendev.org/c/openstack/ironic/+/83610602:15
*** akahat is now known as akahat|rover06:35
rpittaugood morning ironic! o/06:50
kamlesh6808cGood morning Ironic !07:24
arne_wiebalckGood morning rpittau kamlesh6808c and Ironic!07:28
rpittauhey arne_wiebalck :)07:28
dmelladoHappy friday, ironic folks ;)07:40
dmelladodtantsur: btw, got an email (I assume you as well) re: our presentation and a demo, I'll say ack on the demo as that was part of my plan. We'll sync on the content later on07:41
rpittauhappy Friday dmellado :)08:07
dmelladohi rpittau ;)08:32
dmelladoand finally, finally I got back my bouncer xD08:32
jandersgood morning rpittau arne_wiebalck dmellado and Ironic o/09:01
rpittauhey janders :)09:31
*** hjensas is now known as hjensas|out-sick09:52
iurygregorygood morning Ironic11:57
iurygregoryHappy Friday!11:57
dmelladoiurygregory: congrats on becoming senior :P11:58
iurygregorydmellado, thanks! =)11:58
iurygregorypeople might think it's an april fools joke :D11:59
rpittauhey iurygregory :)12:02
dmelladooh, true! April 1st! xD12:04
iurygregoryyeah =)12:08
iurygregoryrpittau, going to update the ipa-b patch now o/12:08
rpittauiurygregory: ack12:09
rpittauI'm starting to think that the issue with livirt-python installation is due to the mirrors12:10
dmelladowhen in doubt... dns, it's always dns xD12:10
iurygregoryrpittau, well I would say it can be :D maybe we should reach out to infra?12:11
iurygregorydmellado, ++12:11
iurygregoryand when it's not DNS you can check MTU \o/12:11
rpittauyeah, I'm writing to the now12:11
dmelladoiurygregory, dont forget about selinux12:16
opendevreviewEbbex proposed openstack/bifrost master: Use key as name if not provided in inventory yaml  https://review.opendev.org/c/openstack/bifrost/+/83617212:19
iurygregorydmellado, that's the worst case scenario LOL :D12:20
iurygregorybut it's also the easier to solve =P12:20
dmellado#setenforce 012:21
dmelladoxD12:21
iurygregoryyup!12:21
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic-python-agent-builder master: Add multipath element  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/83609412:30
rpittaubye everyone, have a great weekend! o.14:14
rpittauo/14:14
iurygregorybye rpittau o/14:23
iurygregorystendulker, hey do you know if is expected that after we reboot an HPE machine that has redfish subscriptions they will be deleted? 14:39
iurygregoryhttps://bugzilla.redhat.com/show_bug.cgi?id=206058714:40
stendulkeriurygregory: Never tested, but it should not go away14:40
iurygregoryHPE DL380 - Firmware Revision: 2.31 this is happening when we tested .-.14:41
stendulkeriurygregory: Do you mean rebooting the 'system' or 'ilo'?14:41
iurygregorythe user OS =) system14:42
iurygregoryif we shutdown ilo I would expect that the info would be gone XD14:42
stendulkeriurygregory: Ok. Will check on this.14:42
iurygregorystendulker, thanks!14:42
iurygregoryif you need more details about the HW we used let me know14:43
stendulkeriurygregory: By any chance the delivery of the events were supposed to go to the system being rebooted?14:43
stendulkerthere is an iLO subscription behavior wherein if it fails to deliver the event to the target, it would delete the subscription thinking the subscription is invalid.14:44
iurygregoryok I will double check on that14:44
iurygregoryI've asked in the BZ to see14:47
stendulkeriurygregory: Ok. Thanks14:51
TheJuliaanyone make progress with grenade?15:35
TheJulialooks like grenade on yoga is busted as well15:38
iurygregoryI'm still checking logs15:38
TheJuliaon master, it looks like a permission issue15:38
iurygregoryit was fine in yoga (from what I remember...) /me checks again15:39
iurygregoryselinux \o/15:39
TheJuliahttps://9fc691f832d88a1aa0ff-e6ca3f0f131d5067e28b560534611438.ssl.cf2.rackcdn.com/836105/2/check/ironic-grenade/f29694b/controller/logs/grenade.sh_log.txt15:39
TheJuliathat should be yoga15:39
TheJulialooks like ping fails15:39
TheJuliacould just be transient15:39
TheJuliawe've seen some cases where vip mapping doesn't quite work out as hoped15:40
TheJuliaI just rechecked https://review.opendev.org/c/openstack/ironic/+/836105/15:41
TheJuliahmmm, didn't get logs on muy other job15:43
TheJuliahttps://5665992c7b8f7efc00c9-81db8c3dc3716bc6d03f7a113317339e.ssl.cf2.rackcdn.com/836106/2/check/ironic-grenade/32a06d0/controller/logs/ironic-bm-logs/node-3_console_2022-04-01-03%3A36%3A04_log.txt15:43
* iurygregory looks15:44
TheJuliaand file permissions *should* be set out to 0644...15:50
TheJuliabut it looks like with the way grenade works it doesn't pickup my debug attempt15:51
* TheJulia goes and gets some breakfast15:52
opendevreviewJames Denton proposed openstack/networking-generic-switch master: Add support for switches running SONiC operating system  https://review.opendev.org/c/openstack/networking-generic-switch/+/83591216:50
opendevreviewJulia Kreger proposed openstack/ironic master: DNM: get some additional info to debug grenade  https://review.opendev.org/c/openstack/ironic/+/83610617:28
opendevreviewJulia Kreger proposed openstack/ironic master: DNM: get some additional info to debug grenade  https://review.opendev.org/c/openstack/ironic/+/83610617:32
TheJuliaMESSAGE=tftpd: read: Connection refused17:39
iurygregoryfunny...17:40
TheJuliaYeah17:46
* TheJulia needs to convert the unix time to human readable time17:46
TheJuliait *looks* like it times out17:46
TheJuliasomething smells fishy with libvirt17:47
TheJuliaor networking maybe17:47
TheJulianothing in the kernel log17:48
iurygregorymaybe a bump in libvirt package?17:52
TheJuliait could also be the route back to the vm17:52
TheJuliaI see what is going on17:55
TheJuliawell17:55
TheJuliano17:55
TheJulia10.1.0.0/20 is being created and routed via... 172.24.5.15517:56
TheJuliavm got 10.2.2.blah17:56
iurygregorywoot17:56
iurygregory10.2.x.x?!17:56
iurygregory10.2 doesn't make sense if I recall...17:57
TheJuliawell17:59
TheJuliano it doesn't17:59
TheJuliabecause it would have to be a /817:59
TheJuliaor well17:59
TheJuliaa /15 for 10.2.0.0 to be routed17:59
TheJuliayup, network in neutron is 10.2.0.0/2018:06
TheJuliaour grenade job is creating it18:08
iurygregoryhummm weird .-.18:09
TheJulia62542b81-5bc3-4dfe-b4ba-250eb5916316 is the network, and inside that network it is getting a 172.24.5.71 source ip18:10
TheJuliabut I've yet to find it anywhere else18:10
TheJulianvmd, found it18:11
TheJuliawaiting for current job to fail for the logs before I upload a new change with more debugging18:24
iurygregoryyay I need to book my flight tickets and hotel till Monday for the summit <O>18:29
* TheJulia unfortunately hasn't gotten a green light yet18:34
TheJuliaI think we're waiting on a go/no go18:35
TheJuliafrom the foundation that is18:35
iurygregorygotcha18:40
iurygregoryI got a green light, the problem is just figure out things till Monday <O>18:41
TheJuliatill?18:41
TheJuliastuck in country for a few extra days?18:41
opendevreviewJulia Kreger proposed openstack/ironic master: DNM: get some additional info to debug grenade  https://review.opendev.org/c/openstack/ironic/+/83610618:42
TheJuliaI feel like I'm grasping at straws with this18:44
TheJuliait makes no sense18:44
iurygregoryI need to request access to a new system to book my travel (we don't have Egencia working for LATAM =( )18:49
dmelladoTheJulia the go-no-go from the foundation was on April 7th, wasn't it?18:56
dmelladoiurygregory egencia is *just* terrible :\18:56
iurygregorydmellado, well egencia was good when I was in EMEA, now I'm in LATAM we don't even have XD18:57
iurygregorydmellado, go-no-go ? <eyes> 18:58
dmelladoiurygregory, beware of using it to book Spain's trains xD18:58
iurygregoryomg XD18:58
dmelladoiurygregory, basically confirmation18:58
TheJuliadmellado: yeah18:58
TheJuliaEgencia actually won't let me book trains. Period.18:58
iurygregoryok, so I will tell people to wait ( I don't want to book without the foundation confirmation...)18:58
dmelladowhich I mean, it's weird and odd and maybe they should've waited a bit on sending all the confirmation/venue and so18:59
dmelladobut it's a crazy covid/WWIII-like world and who knows anymore18:59
dmelladoin any case, tbh I don't expect any haywire but I'd wait18:59
TheJuliayeah, and they have been fairly sure they can proceed with the in-person event18:59
iurygregorydo we have a link with this info? that they will decide the go-no-go?19:00
TheJuliathe go/no-go is more the board going "hey, you need to make sure there is a go/no-go for in person". TBH19:00
TheJuliaThat is a good question19:00
dmelladoOTOH, any of you folks going to the KubeCon?19:00
iurygregorynope19:01
dmelladoyeah, I kinda knew this by gossiping 19:01
dmelladoaw, bummer 19:01
TheJuliaNot me. I'm planning on OpenInfra Summit, and SCaLE so far19:01
TheJuliaI was pondering submitting to supercomputing 2022...19:01
dmelladogot a session there as well and I would've loved seeing you there as well19:01
TheJuliabut didn't make the cfp19:01
TheJuliaAlso, I'm not an academic so likely have that against me19:02
dmelladoin any case, if any of you are interested <spam alert>19:04
dmelladohttps://sched.co/ytta19:04
TheJulianice19:04
* TheJulia wonders if we can speed up CI with espresso19:04
dmelladoprobably xD19:05
* TheJulia hates having to do a ton of debugging in grenade19:08
iurygregoryTheJulia, the best way was removing other jobs -grenade from the check in the zuul file 19:09
TheJuliayeah19:10
TheJuliakind of19:10
* TheJulia reads latest email from jonathan19:10
TheJuliaokay, I have the status but it has not been publically announced yet19:12
TheJuliaHelps to be the person with the iron fist in the big chair at the end of the table19:12
dmelladobeware, Iron Fist series was really bad xD19:14
TheJuliaI didn't manage to make it through the first episode19:14
TheJuliaI should just run to the hardware store to pickup project hardware next time I upload into gerrit19:18
TheJuliaokay, yay logs uploaded19:55
TheJuliaokay, so router ip pings...19:56
TheJuliaand permissions are correct19:57
TheJuliaoh... I may have found it20:02
TheJuliaerr, no20:02
TheJulia:(20:02
opendevreviewJulia Kreger proposed openstack/ironic master: DNM: get some additional info to debug grenade  https://review.opendev.org/c/openstack/ironic/+/83610620:13
TheJuliaI thought we had stp disabled across the board, I guess only in some places20:13
TheJuliaI think I'm going to need to reproduce locally21:42
opendevreviewJulia Kreger proposed openstack/ironic master: DNM: get some additional info to debug grenade  https://review.opendev.org/c/openstack/ironic/+/83610622:02
TheJuliaI'm starting to think it is something with the default change to UEFI. The job now tries to launch/run with UEFI by default, but it had never been launched that way previously... so maybe *something* since the networking is a bit more funky22:03
opendevreviewJulia Kreger proposed openstack/ironic master: Grenade: Change to use bios because we have funky networking  https://review.opendev.org/c/openstack/ironic/+/83610622:48
TheJuliaiurygregory: figured it out ^22:48
TheJuliaAlso, the VMs don't have anywhere near enough RAM for UEFI22:48
« Thursday, 2022-03-31 Index Saturday, 2022-04-02 »

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!