*** k_mouza has joined #openstack-ironic | 01:19 | |
*** k_mouza has quit IRC | 01:23 | |
*** rcernin has quit IRC | 02:58 | |
*** rcernin has joined #openstack-ironic | 03:18 | |
*** rcernin has quit IRC | 04:12 | |
*** rcernin has joined #openstack-ironic | 04:13 | |
openstackgerrit | Nisha Agarwal proposed openstack/ironic master: Adds few of the security dashboard parameters to capabilities https://review.opendev.org/746416 | 04:28 |
---|---|---|
*** janders has quit IRC | 04:45 | |
*** janders has joined #openstack-ironic | 04:46 | |
*** rcernin has quit IRC | 05:48 | |
*** PrinzElvis has joined #openstack-ironic | 05:57 | |
*** Qianbiao has joined #openstack-ironic | 05:59 | |
*** rcernin has joined #openstack-ironic | 06:03 | |
*** hjensas has joined #openstack-ironic | 06:04 | |
arne_wiebalck | Good morning, ironic! | 06:05 |
janders | good morning arne_wiebalck | 06:15 |
janders | how was your weekend? | 06:15 |
arne_wiebalck | hey janders o/ | 06:15 |
arne_wiebalck | rainy | 06:15 |
arne_wiebalck | and yours? | 06:15 |
janders | funnily enough a bit rainy, too. | 06:16 |
*** sshnaidm|afk is now known as sshnaidm | 06:17 | |
janders | My wife's laptop malfunctioned so ended up spending a fair bit of the weekend helping her out. Frustrating at first cause despite her reinstalling a couple of times we couldn't get any NIC to deliver any decent performance. Really weird issues. Then we ended up dropping Fedora32 on the laptop and it *just works* and she's happy with it so good | 06:18 |
janders | outcome. | 06:18 |
janders | I haven't touched windows for around 20 years now and looking how much trouble she had I'm not missing out :) | 06:19 |
arne_wiebalck | I banned windows from my house some time ago ... not because it does not work, more because I don't know how fix things :-D | 06:26 |
arne_wiebalck | ... and as the computer engineer in the house, this can become very embarassing ;) | 06:27 |
*** PrinzElvis has quit IRC | 06:46 | |
*** PrinzElvis has joined #openstack-ironic | 06:46 | |
*** jtomasek has joined #openstack-ironic | 06:57 | |
*** PrinzElvis has quit IRC | 07:03 | |
*** PrinzElvis has joined #openstack-ironic | 07:03 | |
*** PrinzElvis has quit IRC | 07:07 | |
*** PrinzElvis has joined #openstack-ironic | 07:08 | |
*** PrinzElvis has quit IRC | 07:10 | |
*** PrinzElvis has joined #openstack-ironic | 07:11 | |
*** trident has quit IRC | 07:18 | |
mnasiadka | morning | 07:29 |
*** PrinzElvis has quit IRC | 07:30 | |
*** PrinzElvis has joined #openstack-ironic | 07:31 | |
*** Prinz_Elvis has joined #openstack-ironic | 07:32 | |
*** Prinz_Elvis has quit IRC | 07:37 | |
*** tosky has joined #openstack-ironic | 07:39 | |
iurygregory | good morning Ironic! o/ | 07:39 |
iurygregory | janders, yeah the properties/capabilties are set =( | 07:40 |
*** Prinz_Elvis has joined #openstack-ironic | 07:41 | |
iurygregory | https://zuul.opendev.org/t/openstack/build/bf03fd694f2b45daaca348588609e8d4/log/job-output.txt#26895 | 07:42 |
*** Prinz_Elvis has quit IRC | 07:44 | |
*** zigo has joined #openstack-ironic | 07:44 | |
*** rcernin has quit IRC | 07:51 | |
rpittau | good morning ironci! o/ | 07:52 |
iurygregory | morning rpittau o/ | 07:52 |
iurygregory | just for me or zuul is a bit different when you check the job result? | 07:53 |
rpittau | hey iurygregory :) | 07:54 |
iurygregory | finally summer is over \o/ | 07:54 |
rpittau | never started for me :/ | 07:54 |
iurygregory | the max temperature this week seems to be 25 \o/ | 07:55 |
* iurygregory dances | 07:55 | |
rpittau | iurygregory: no worries, another heat wave is coming this week :) | 07:56 |
iurygregory | rpittau, noooooooooooooo <O> | 07:56 |
*** belmoreira has joined #openstack-ironic | 07:57 | |
*** PrinzElvis is now known as Prinz-Elvis | 07:58 | |
*** tosky has quit IRC | 08:00 | |
*** jtomasek has quit IRC | 08:00 | |
*** ddurst has quit IRC | 08:00 | |
*** lucasagomes has joined #openstack-ironic | 08:01 | |
*** irclogbot_2 has quit IRC | 08:02 | |
*** Prinz-Elvis is now known as PrinzElvis | 08:04 | |
*** tosky has joined #openstack-ironic | 08:05 | |
*** jtomasek has joined #openstack-ironic | 08:05 | |
*** ddurst has joined #openstack-ironic | 08:05 | |
*** PrinzElvis is now known as Prinz_Elvis | 08:05 | |
*** irclogbot_2 has joined #openstack-ironic | 08:07 | |
janders | arne_wiebalck haha! I know the feeling. | 08:08 |
rpittau | everybody ready for the first day of Ironic Victoria virtual Meetup? :) | 08:08 |
janders | iurygregory rpittau good morning :) how was your weekend | 08:09 |
rpittau | hey janders :) | 08:09 |
iurygregory | a bit complicated, but I solved all my personal problems =) | 08:11 |
rpittau | had a nice dinner with some friends on saturday night, lots of alcohol, cheese and meat! | 08:11 |
rpittau | and worked hard in the new apartment, we move in 1 week, I have internet but no bathrooms yet :D | 08:11 |
*** Prinz_Elvis is now known as PrinzElvis | 08:12 | |
*** ricolin has quit IRC | 08:16 | |
openstackgerrit | Riccardo Pittau proposed openstack/sushy stable/ussuri: Use Sessions URL from root service if it's provided https://review.opendev.org/748972 | 08:16 |
openstackgerrit | Riccardo Pittau proposed openstack/sushy stable/train: Use Sessions URL from root service if it's provided https://review.opendev.org/748973 | 08:17 |
janders | iurygregory rpittau nice! :) | 08:22 |
openstackgerrit | Kaifeng Wang proposed openstack/ironic master: Per-node configuration for erasing devices priority https://review.opendev.org/748975 | 08:24 |
janders | my weekend was a bit similar to yours rpittau. Put some shelves in the garage. Lots of parts missing after the move so had to take the tools out and cut some metal but it all worked in the end. Also put most hooks in so that we can hang paintings on the walls. The place looks awesome now. Then dropped into our fav craft brewery for a couple pints | 08:25 |
janders | as a reward :) | 08:25 |
janders | I will pop our for a quick walk. When back I will check out the UEFI issue logs iurygregory | 08:26 |
iurygregory | janders, tks! | 08:26 |
iurygregory | so far seems that nova is unhappy.. | 08:26 |
iurygregory | looking at the nova-sched logs | 08:26 |
*** Zempashi has joined #openstack-ironic | 08:26 | |
janders | I need to check for any signs of any UEFI tags getting overwritten when capabilities are set | 08:27 |
janders | that was killing me a while back | 08:27 |
openstackgerrit | Riccardo Pittau proposed openstack/ironic master: [trivial] remove emacs config from devstack script https://review.opendev.org/748978 | 08:29 |
*** derekh has joined #openstack-ironic | 08:32 | |
*** Zempashi has quit IRC | 08:37 | |
openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: ansible-lint: fix error 602 https://review.opendev.org/748597 | 08:39 |
openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent master: [WIP] Move ironic-standalone-ipa-src to Ubuntu Focal https://review.opendev.org/748213 | 08:43 |
iurygregory | rpittau, this patch only reminds me of dtantsur|afk 's tweet =) (bifrost) | 08:43 |
openstackgerrit | QianBiao Ng proposed openstack/ironic master: Feat: add ibmc hardware info support for devstack https://review.opendev.org/748841 | 08:44 |
openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent master: Move ironic-standalone-ipa-src to Ubuntu Focal https://review.opendev.org/748213 | 08:44 |
*** Zempashi has joined #openstack-ironic | 08:44 | |
rpittau | iurygregory: mmm which tweet ? | 08:44 |
iurygregory | rpittau, https://twitter.com/creepy_owlet/status/1299434634485420033 | 08:45 |
rpittau | ah yeah, I'm tempted to leave 602 disabled | 08:46 |
iurygregory | after I saw the tweet I totally understood why you said " this will likely fail" | 08:47 |
rpittau | there's a long thread about that | 08:47 |
rpittau | it seems enabling 602 makes everything less readable and more complicated to understand | 08:47 |
iurygregory | ouch | 08:47 |
janders | rpittau you mentioned connecting Internet - out of curiosity, what speeds are you typically getting in Europe? | 08:47 |
janders | I'm 80/40mbps, fast for local standards, but if my memory doesn't fail me I think I remember having 1gbps to the front door in Singapore | 08:48 |
rpittau | janders: with FTTH I have 2 Gbit/s | 08:49 |
janders | nice! way to go! | 08:49 |
janders | I think here they offer 200/200mbps on FTTH (which I don't have) otherwise due to the silly VDSL+ last-hop it's hard to go far beyond 100 | 08:50 |
janders | uploading videos would be totally awesome on 2gbps | 08:50 |
janders | my drone can fly ~30mins between batt swaps, so that in 4K would probably upload under 1 minute | 08:51 |
janders | (assuming the remote side offers that much upload bandwidth) | 08:52 |
rpittau | it really depends by the zone here, even in the same city, but there's a lot of competition and the gov pushes for high speed | 08:52 |
rpittau | in theory, if it was not for the covid, we should have already working 5G | 08:53 |
janders | here it's a bit of 4.5G really | 08:53 |
rpittau | eheh yeah, same :) | 08:53 |
janders | I see uploads of 200-300mbps which isn't really what was expected but not too bad for a mobile phone | 08:56 |
*** janders2 has joined #openstack-ironic | 08:57 | |
rpittau | I don't think there's real 5G deployed anywhere yet, or at least very few places, most companies use a mix of 4G/5G cards, because the frequencies are not open for commercial use yet | 08:58 |
janders2 | ...looks like my ISP is trying to convince me to reconsider my ideas about "5G"/4.5G | 08:58 |
rpittau | :D | 08:58 |
janders2 | brief dropout | 08:58 |
*** Qianbiao has quit IRC | 08:58 | |
*** janders has quit IRC | 09:00 | |
*** janders2 is now known as janders | 09:00 | |
rpittau | can I get one more review for this please https://review.opendev.org/747936 | 09:03 |
patchbot | patch 747936 - networking-baremetal - Add missing keystoneauth1 and oslo.service to requ... - 2 patch sets | 09:03 |
iurygregory | rpittau, done | 09:04 |
rpittau | thanks! | 09:04 |
rpittau | lol "/usr/local/bin/keystone-manage: No such file or directory" | 09:07 |
*** trident has joined #openstack-ironic | 09:08 | |
*** uzumaki has joined #openstack-ironic | 09:10 | |
*** dtantsur|afk is now known as dtantsur | 09:11 | |
dtantsur | morning ironic, happy Monday! | 09:11 |
dtantsur | do I get it right from my email notifications that the multinode job is broken? | 09:11 |
*** Qianbiao has joined #openstack-ironic | 09:13 | |
iurygregory | dtantsur, depends | 09:14 |
iurygregory | devstack is broken... | 09:14 |
rpittau | hey dtantsur :) | 09:14 |
iurygregory | Setuptools 50 and Devstack Failures | 09:14 |
dtantsur | what I've seen was inability to PXE boot on all nodes | 09:14 |
dtantsur | started on Thursday https://zuul.openstack.org/builds?job_name=ironic-tempest-ipa-wholedisk-direct-tinyipa-multinode | 09:15 |
openstackgerrit | Ankit Kumar proposed openstack/ironic master: Enhance certificate verification for ilo harware type https://review.opendev.org/743490 | 09:16 |
-openstackstatus- NOTICE: due to a new release of setuptools (50.0.0), a lot of jobs are currently broken, please do not recheck blindly. see http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016905.html | 09:16 | |
rpittau | mmm no bootable device | 09:17 |
openstackgerrit | Kaifeng Wang proposed openstack/ironic master: Per-node configuration for erasing devices priority https://review.opendev.org/748975 | 09:19 |
rpittau | seems the nic doesn't receive updates from dhcp | 09:19 |
Qianbiao | hello, i am working with devstack too recently. | 09:19 |
Qianbiao | It seems python3 pip could not be installed this afternoon. | 09:20 |
Qianbiao | Yestoday, it's ok... | 09:20 |
Qianbiao | And i am wondering why it auto purge pip first? | 09:20 |
Qianbiao | I cant even install it manually. | 09:20 |
iurygregory | Qianbiao, there is some problem on devstack atm | 09:23 |
openstackgerrit | Verification of a change to openstack/networking-baremetal failed: Add missing keystoneauth1 and oslo.service to requirements https://review.opendev.org/747936 | 09:24 |
dtantsur | iurygregory: could you check https://review.opendev.org/#/c/748853/ please | 09:26 |
patchbot | patch 748853 - bifrost (stable/train) - [Train and older] Fix several CI problems - 8 patch sets | 09:26 |
iurygregory | dtantsur, doing now | 09:26 |
Qianbiao | ok | 09:27 |
*** jtomasek has quit IRC | 09:33 | |
dtantsur | also folks, while devstack is broken, could someone please help me clean up my bifrost reviews? :) https://review.opendev.org/#/q/owner:dtantsur%2540protonmail.com+status:open+project:openstack/bifrost | 09:39 |
dtantsur | yes, I know, I'm a bit crazy, but they'll all good reviews :D | 09:39 |
dtantsur | ("a bit", haha) | 09:40 |
iurygregory | 41 files | 09:41 |
iurygregory | '-' | 09:41 |
iurygregory | in the first patch I clicked | 09:41 |
dtantsur | I hope it's not the TLS patch - not the best way to start your Monday :) | 09:43 |
dtantsur | I wonder if I'll have to walk you folks through it.. | 09:44 |
*** jtomasek has joined #openstack-ironic | 09:44 | |
rpittau | I will leave that for last, I reviewd most of the others last week, going through some more now | 09:45 |
dtantsur | ++ it's a good idea. other patches must be quite straightforward even if large. | 09:46 |
rpittau | also I'm thinking to abandon the ansible-lint patch that enables 602, some changes are ridiculous | 09:47 |
iurygregory | dtantsur, nope =) | 09:47 |
iurygregory | I'm looking at Remove support for non-venv deployments =) | 09:47 |
iurygregory | the good thing is that the changes are simple | 09:48 |
dtantsur | ah, this was created with a lot of find+sed :) | 09:48 |
iurygregory | hehehe | 09:49 |
dtantsur | rpittau: I.. have to concur. just let's make sure we don't do "when: string_variable" because this sane behavior is deprecated.. | 09:49 |
* dtantsur wants to start a rant | 09:49 | |
rpittau | heh, yeah :/ | 09:50 |
Qianbiao | iurygregory do u know which part of devstack is broken. | 09:50 |
iurygregory | Qianbiao, http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016905.html | 09:51 |
dtantsur | Qianbiao: installation of python packages. pretty much everything. | 09:51 |
iurygregory | yep | 09:51 |
* dtantsur wonders how many merge conflicts his patches have between each other | 09:51 | |
iurygregory | dtantsur, you are about to figure out =D | 09:52 |
dtantsur | right :D | 09:52 |
dtantsur | I've also started figuring out what may be missing in the direct deploy compared to iscsi: https://storyboard.openstack.org/#!/story/2008075 | 09:52 |
iurygregory | well your TLS patch for sure will have conflict | 09:53 |
dtantsur | no doubt | 09:53 |
iurygregory | so far is the only I saw in the "Conflicts With" | 09:53 |
Qianbiao | iurygregory And is there a reason that devstack need to reinstall pip? | 09:54 |
Qianbiao | is there an option that skip pip reinstall | 09:54 |
dtantsur | devstack is a pile of hacks, I'm not sure there is a reason, and if there is, I'm not sure if it's still valid | 09:55 |
dtantsur | Qianbiao: http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016907.html has some reviews you could try | 09:55 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost stable/stein: [Train and older] Fix several CI problems https://review.opendev.org/749014 | 09:59 |
*** tosky has quit IRC | 10:13 | |
*** tosky has joined #openstack-ironic | 10:13 | |
janders | hey dtantsur | 10:14 |
dtantsur | o/ | 10:14 |
janders | how was your weekend? | 10:14 |
Qianbiao | I remove "uninstall pip" from devstack, it starts install now. | 10:14 |
Qianbiao | In ironic devstack doc, https://docs.openstack.org/ironic/latest/contributor/dev-quickstart.html, NETWORK_GATEWAY=10.1.0.1 this option is not working, should use IPV4_ADDRS_SAFE_TO_USE=xxxx/24 instead | 10:17 |
openstackgerrit | Merged openstack/bifrost stable/train: [Train and older] Fix several CI problems https://review.opendev.org/748853 | 10:25 |
openstackgerrit | Merged openstack/bifrost master: Remove support for non-venv deployments https://review.opendev.org/747434 | 10:25 |
openstackgerrit | Merged openstack/bifrost master: Make /var/lib/ironic/{,images,master_images} readable by nginx https://review.opendev.org/748472 | 10:25 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent master: [PoC] Do not use eventlet for serving API https://review.opendev.org/749020 | 10:27 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost bugfix/8.3: Make /var/lib/ironic/{,images,master_images} readable by nginx https://review.opendev.org/749021 | 10:27 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost stable/ussuri: Make /var/lib/ironic/{,images,master_images} readable by nginx https://review.opendev.org/749022 | 10:29 |
iurygregory | Qianbiao, I think this is the default from Neutron, feel free to override the configs if doesn't suit to you | 10:29 |
Qianbiao | ok | 10:30 |
*** fmuyassarov has joined #openstack-ironic | 10:41 | |
openstackgerrit | Kaifeng Wang proposed openstack/ironic master: Per-node configuration for erasing devices priority https://review.opendev.org/748975 | 10:44 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent master: [PoC] Do not use eventlet for serving API https://review.opendev.org/749020 | 10:45 |
rpittau | dtantsur, TheJulia: are we going to use meetpad for the virtual Ironic Meetup ? | 10:47 |
dtantsur | I guess so? | 10:48 |
openstackgerrit | Merged openstack/bifrost master: Disable DHCP on the libvirt network rather than doing `killall dnsmasq` https://review.opendev.org/748272 | 11:18 |
openstackgerrit | Merged openstack/bifrost master: Stop supporting storing introspection data in nginx https://review.opendev.org/747901 | 11:18 |
openstackgerrit | Merged openstack/bifrost master: Authentication JSON RPC even in no-auth mode https://review.opendev.org/747897 | 11:18 |
dtantsur | yay, so many merge conflicts \o/ | 11:37 |
*** antotala has joined #openstack-ironic | 11:40 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Move services to internal_ip by default and refactor endpoint creation https://review.opendev.org/748230 | 11:41 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Update keystone documentation https://review.opendev.org/748392 | 11:41 |
*** weshay is now known as weshay|ruck | 11:44 | |
antotala | Hello All, I have added some custom collectors in ironic -python-agent. I want to run them during the inspection, I am not sure how can I enable these collectors | 11:45 |
antotala | I know some where I have to configure this parameter `ipa-inspection-collectors` but where is not very clear to me | 11:46 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: TLS support for API services https://review.opendev.org/747921 | 11:48 |
dtantsur | antotala: there are two places where you configure kernel parameters: in the PXE/iPXE configuration of ironic-inspector itself, as well as in the ironic's option [inspector]extra_kernel_params | 11:49 |
*** uzumaki has quit IRC | 11:50 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Let us finish the rabbit hunt https://review.opendev.org/748265 | 11:50 |
antotala | Let me try that. Thank dtantsur | 11:53 |
*** sshnaidm has quit IRC | 11:57 | |
janders | wrapping up, have a good day. See you tomorrow Ironic o/ | 12:03 |
*** sshnaidm has joined #openstack-ironic | 12:07 | |
*** Qianbiao has quit IRC | 12:08 | |
rpittau | mmm looks like the issue with setuptools is impacting bifrost too | 12:18 |
dtantsur | wonderful \o/ | 12:18 |
dtantsur | rpittau: the focal failure, right? | 12:18 |
dtantsur | so not gate-blocking? | 12:19 |
rpittau | yeah | 12:19 |
openstackgerrit | Ankit Kumar proposed openstack/ironic master: Enhance certificate verification for ilo harware type https://review.opendev.org/743490 | 12:19 |
rpittau | no, not blocking, still frustrating | 12:19 |
rpittau | also not clear why centos8 is failing | 12:19 |
dtantsur | rpittau: is it? I see fedora-latest and ubuntu-focal on my patches in zuul | 12:20 |
rpittau | ok, then maybe it's the 602 change that centos8 doesn't like, even though it's the only one failing | 12:20 |
dtantsur | we have transient failures on bifrost as well, although much less frequently than on ironic | 12:21 |
dtantsur | maybe it's just one of these? | 12:21 |
rpittau | could be | 12:21 |
dtantsur | okay, so the focal problem is up to us to fix. are you looking in it or should I? | 12:22 |
rpittau | dtantsur: go ahead, I'm looking at centos8 at the moment | 12:23 |
dtantsur | okie | 12:23 |
rpittau | the problem is that it's failing on keystone setup and we have no_log: true | 12:24 |
dtantsur | of course :) | 12:25 |
dtantsur | rpittau: if you point me at the exact task, I can take a look | 12:25 |
dtantsur | `ModuleNotFoundError: No module named 'setuptools._distutils` WTF, it's not exactly what breaks devstack? | 12:25 |
rpittau | yes, exactly that | 12:25 |
rpittau | dtantsur: playbooks/roles/bifrost-ironic-install/tasks/keystone_setup.yml | 12:26 |
dtantsur | rpittau: I mean, in your change | 12:26 |
rpittau | oh yeah, of course | 12:26 |
fmuyassarov | Hi JayF and dtantsur. For the custom hardware manager can I use any of the Ironic supported root disk hints (model, vendor, etc.) to filter out the disks I want to clean during the deprovisioning? Or is there some other way to filter the disks? | 12:28 |
dtantsur | fmuyassarov: you totally can. use the get_os_install_device call to detect what the expected root disk is | 12:29 |
dtantsur | mmmm, scratch that, get_os_install_device only works during deployment | 12:29 |
dtantsur | but you can follow roughly the same logic using the node you received in your clean step | 12:30 |
rpittau | dtantsur: the task is "Check ironic admin endpoint exists", I can't find the way to point directly there though, I don't see a link in the logs, just plain logs here https://6ee071d84f4801a650d3-2635c9269ad2bde2592553cd282ad960.ssl.cf2.rackcdn.com/748597/5/check/bifrost-integration-tinyipa-keystone-centos-8/a9247e2/job-output.txt | 12:32 |
fmuyassarov | dtantsur, I will try to copy & modify the logic as in the clean step for filtering. Thank you. | 12:32 |
dtantsur | rpittau: you can point at lines in gerrit by appending @<lineno> | 12:32 |
dtantsur | fmuyassarov: ironic-lib has all the necessary code for dealing with root device hints | 12:33 |
rpittau | dtantsur: oh, you meant the gerrit change, I should've probably said that it's failing in a task that was not modified in the change | 12:34 |
dtantsur | rpittau: start with rebasing your patch. I've rewritten these tasks recently :) | 12:34 |
rpittau | ok :) | 12:34 |
dtantsur | mm, interesting. but let's rebase first anyway. | 12:34 |
fmuyassarov | dtantsur, got it, thanks. I will come back if I don't manage it to work. | 12:35 |
openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: ansible-lint: fix error 206 https://review.opendev.org/747883 | 12:36 |
openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: ansible-lint: fix error 504 https://review.opendev.org/747925 | 12:37 |
openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: ansible-lint: fix error 602 https://review.opendev.org/748597 | 12:37 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Block setuptools 50.0.0 and newer https://review.opendev.org/749046 | 12:38 |
rpittau | ^ sigh | 12:38 |
*** rh-jelabarre has joined #openstack-ironic | 12:39 | |
dtantsur | yeah. mirroring a global reqs change. | 12:40 |
*** antotala has quit IRC | 12:42 | |
iurygregory | omg | 12:44 |
rpittau | 15 minutes to midcyle, meetpad is there -> https://meetpad.opendev.org/Ironic-Victoria-midcycle | 12:46 |
iurygregory | better to use chrome right? | 12:46 |
rpittau | yes | 12:46 |
rpittau | if you even think about using it with firefox, it crashes | 12:47 |
iurygregory | hahaha | 12:47 |
*** Zempashi has quit IRC | 12:49 | |
*** trandles has joined #openstack-ironic | 12:56 | |
*** rloo has joined #openstack-ironic | 12:56 | |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent master: [PoC] Do not use eventlet and oslo.service for serving API https://review.opendev.org/749020 | 12:58 |
dtantsur | JayF: ^^^ | 12:58 |
openstackgerrit | Christopher Dearborn proposed openstack/sushy master: Make message parsing more resilient https://review.opendev.org/748927 | 12:59 |
JayF | oooh | 12:59 |
dtantsur | JayF: it will need also moving ironic-lib away from loopingcall, but that's a good thing to do anyway | 13:00 |
dtantsur | I can look into it later today or tomorrow | 13:01 |
dtantsur | (there is only one place where it's used) | 13:01 |
JayF | oslo.concurrency uses eventlet too aiui | 13:01 |
JayF | so I'm not sure you're 100% wiping out eventlet deps | 13:01 |
dtantsur | sigh | 13:02 |
iurygregory | are we going to use the jitsi meetpad for the notes or the normal etherpad? | 13:02 |
rpittau | iurygregory: I think the normal etherpad | 13:03 |
rpittau | we have all the topics there | 13:03 |
iurygregory | I was thinking this =) | 13:03 |
JayF | Can someone link it in the meetpad etherpad then? | 13:03 |
dtantsur | JayF: at first glance it seems that oslo.concurrency can do both | 13:03 |
JayF | I'm just telling you what a `grep eventlet site-packages` says :D | 13:03 |
rpittau | JayF: it's in the chat in meetpad https://etherpad.opendev.org/p/Ironic-Victoria-midcycle | 13:03 |
JayF | ack | 13:04 |
dtantsur | rpittau: it's not that chrome does not crash.. | 13:07 |
rpittau | yeah :D | 13:07 |
*** bnemec has joined #openstack-ironic | 13:07 | |
JayF | dtantsur: FWIW, I believe we explicitly wanted etherpad for the ability to timeout "stuck" TCP operations? So we might want to dig that too. At least that's what I've been told, I have no direct knowledge of it. | 13:08 |
JayF | **eventlet | 13:14 |
JayF | sorry, I usually wouldn't be awake for another 15-30 minutes :D | 13:14 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic-lib master: Drop the dependency on oslo.service loopingcall https://review.opendev.org/749053 | 13:15 |
dtantsur | JayF: ^^ | 13:16 |
JayF | I want TheJulia to weigh in on if we actually want eventlet for purposes of allowing TCP timeouts | 13:17 |
JayF | because I think we do, which is why I went down the path of making it work instead of nuking it | 13:17 |
dtantsur | mmm, I need to refresh my memory | 13:17 |
dtantsur | I think removing loopingcall from ironic-lib is a good idea nonetheless because it makes ironic-lib eventlet-neutral | 13:18 |
JayF | FWIW, I broke unit tests and need to fix | 13:18 |
JayF | https://review.opendev.org/#/c/747193/ | 13:18 |
patchbot | patch 747193 - ironic-python-agent - If listen_tls is true, enable TLS on wsgi server - 6 patch sets | 13:18 |
JayF | but I got SSL working without breaking the rest of the stack | 13:18 |
JayF | with a limited eventlet monkeypatch | 13:18 |
JayF | I think we should probably make our codebase eventlet-safe. It's used throughout openstack and you'll be playing whackamole forever if you try to keep it out while also using oslo libs | 13:19 |
dtantsur | JayF: I think we didn't end up going the eventlet path with timeouts. I don't see any mentions of eventlet outside of tests after my patch. | 13:19 |
JayF | hmm | 13:19 |
JayF | okay | 13:19 |
dtantsur | actually, using werkzeug to serve API does not prevent someone from using monkey_patch (my PoC prevents it for PoC purposes) | 13:20 |
JayF | I still think trying to do an openstack service without worrying about eventlet-safety is swimming upstream a little | 13:20 |
dtantsur | ironic-inspector use to use Flask's built-in service with eventlet | 13:20 |
dtantsur | * used to | 13:20 |
dtantsur | which is based on werkzeug | 13:20 |
*** fmuyassarov has quit IRC | 13:23 | |
*** Qianbiao has joined #openstack-ironic | 13:36 | |
Qianbiao | hello, i have a question about nova ironic driver | 13:36 |
Qianbiao | how nova knows when to use ironic driver. | 13:37 |
Qianbiao | When reading devstack source code, it seems the flavor has a customer spec named CUSTOM_BAREMETAL. | 13:37 |
Qianbiao | Is any flavor that has property "resources:CUSTOM_*anything*" will use ironic driver. | 13:39 |
openstackgerrit | Jay Faulkner proposed openstack/ironic-python-agent master: If listen_tls is true, enable TLS on wsgi server https://review.opendev.org/747193 | 13:40 |
*** stendulker has joined #openstack-ironic | 13:43 | |
*** tzumainn has joined #openstack-ironic | 13:47 | |
openstackgerrit | Jay Faulkner proposed openstack/ironic-python-agent master: If listen_tls is true, enable TLS on wsgi server https://review.opendev.org/747193 | 13:54 |
TheJulia | JayF: we basically we do because we can't figure out if the socket has hanged otherwise, at least that I'm aware of :( | 13:55 |
JayF | dtantsur: ^^ | 13:55 |
JayF | TheJulia: That's what I thought | 13:55 |
dtantsur | but we don't use eventlet for that | 13:55 |
dtantsur | or do we use some hidden property of it? | 13:55 |
*** uzumaki has joined #openstack-ironic | 13:56 | |
TheJulia | I need to look at it, but I remember fighting some eventlet related stuff when I was trying to detect hung sockets | 13:56 |
TheJulia | because we don't want to be suck on the low level read() | 13:56 |
TheJulia | stuck | 13:56 |
*** Qianbiao has quit IRC | 13:56 | |
*** Qianbiao has joined #openstack-ironic | 13:57 | |
dtantsur | yep, but I don't think we ended up landing it | 13:58 |
TheJulia | uhhhh I think we did | 13:58 |
TheJulia | when I'm not listening I'll need to look | 13:59 |
*** uzumaki has quit IRC | 14:03 | |
openstackgerrit | Jay Faulkner proposed openstack/ironic-python-agent master: Make WSGI server respect listen_* directives https://review.opendev.org/748767 | 14:04 |
JayF | ^ Pretty straightforward bugfix. Just added some additional unit tests. It was +1 across the board in zuul before I added the new unit tests (which pass locally). Should be a trivial review. | 14:05 |
JayF | Will likely conflict with my TLS change, so getting it approved quickly would be nice :D | 14:05 |
dtantsur | JayF: left a comment (just hit a similar thing with my anti-eventlet patch) | 14:06 |
JayF | hmm | 14:06 |
JayF | I don't think those values respect listen_host | 14:07 |
JayF | will look | 14:07 |
dtantsur | I think they do, they're coming from ironic_python_agent.cmd.agent | 14:07 |
JayF | hmm yeah | 14:07 |
JayF | why though | 14:07 |
JayF | Like, it's clearly more correct | 14:07 |
JayF | but I wonder why we pass it thru instead of using it in conf | 14:07 |
dtantsur | it's been there since forever, I think | 14:09 |
dtantsur | I want to refactor it all one day, but probably not in a backportable fix | 14:09 |
JayF | Ack, makes sense | 14:09 |
JayF | if you look at my heartbeat patch (which is failing tests for $whoKnows reasons), I found a lot of dead code around error backoffs that never was used :X | 14:10 |
dtantsur | JayF: re $whoKnows, everything devstack-based is broken now | 14:10 |
dtantsur | but yeah | 14:10 |
JayF | hmm, okay | 14:10 |
JayF | that's nice to know | 14:10 |
openstackgerrit | Jay Faulkner proposed openstack/ironic-python-agent master: Make WSGI server respect listen_* directives https://review.opendev.org/748767 | 14:12 |
JayF | dtantsur: ^ fixed | 14:12 |
dtantsur | thx | 14:12 |
openstackgerrit | Jay Faulkner proposed openstack/ironic-python-agent master: Make WSGI server respect listen_* directives https://review.opendev.org/748767 | 14:23 |
JayF | fixed, and fixed a pep8 issue at the same time | 14:23 |
*** belmoreira has quit IRC | 14:30 | |
dtantsur | JayF: sorry, one thing is incorrect now :) | 14:36 |
dtantsur | (also a comment re storyboard) | 14:36 |
JayF | lol it's alright; low-latency code reviews are great | 14:36 |
JayF | Openstack Commit Messages docs are /wrong/ :C | 14:37 |
JayF | I looked that up... | 14:37 |
*** openstackgerrit has quit IRC | 14:37 | |
*** uzumaki has joined #openstack-ironic | 14:38 | |
*** uzumaki has quit IRC | 14:39 | |
*** thiagop has joined #openstack-ironic | 14:53 | |
*** cdearborn has joined #openstack-ironic | 14:56 | |
*** rloo has quit IRC | 14:58 | |
*** kaifeng has joined #openstack-ironic | 15:01 | |
*** rloo has joined #openstack-ironic | 15:02 | |
iurygregory | newbie question if the user is trying to create a node like in Option1 it would be a problem? http://paste.openstack.org/show/797301/ | 15:05 |
*** mjturek1 has joined #openstack-ironic | 15:05 | |
*** rloo has quit IRC | 15:09 | |
*** Qianbiao has quit IRC | 15:09 | |
TheJulia | I _think_ that is the way | 15:11 |
*** sshnaidm is now known as sshnaidm|bbl | 15:11 | |
TheJulia | If confirmed: https://knowyourmeme.com/photos/1653546-this-is-the-way | 15:12 |
iurygregory | ++ | 15:13 |
kaifeng | my big gamble is option 1 does not work | 15:13 |
*** belmoreira has joined #openstack-ironic | 15:13 | |
dtantsur | this ^^ | 15:13 |
iurygregory | I have this feeling because all uefi jobs are not working | 15:14 |
TheJulia | hmmm | 15:14 |
iurygregory | and I only noticed this after talking with janders that --property capabilities twice would be a problem | 15:14 |
kaifeng | we can have mutiple different property fields set in one command line | 15:14 |
TheJulia | is this new? | 15:14 |
trandles | TheJulia, the next Scientific-SIG meeting is Tuesday. I'll advertise the kexec WG there and share a doodle link if one is available. | 15:14 |
trandles | Tuesday == tomorrow | 15:15 |
TheJulia | trandles: ack, I'll make one after I get some breakfast | 15:15 |
trandles | bon ap | 15:15 |
iurygregory | well let's see what CI will say \o/ | 15:15 |
iurygregory | fingers crossed | 15:15 |
dtantsur | I think the last one will win, but I need to check the client code to be sure | 15:16 |
dtantsur | we could have special processing for capabilities in the client. maybe we even should. | 15:16 |
TheJulia | I'm kind of thinking the same thing, without looking at the client and server side field handling code for properties specifically, it is kind of a wash | 15:17 |
dtantsur | server-side it's a string | 15:18 |
rpittau | shouldn't that include also the cpu_arch in the same property field ? | 15:18 |
dtantsur | cpu_arch is a different property | 15:18 |
iurygregory | yeah cpu_arch is different so it should be ok | 15:18 |
iurygregory | but for capabilities they should be all together | 15:18 |
* iurygregory facepalm | 15:19 | |
*** stendulker has quit IRC | 15:19 | |
dtantsur | capabilities is a dark page of ironic | 15:19 |
iurygregory | hehehe | 15:19 |
iurygregory | gerrit bot is on PTO today | 15:19 |
dtantsur | we have sinned, and now everyone is paying for our sins | 15:19 |
rpittau | pffff my brain ignored 'capabiities' there | 15:19 |
dtantsur | I cannot blame your brain for that | 15:20 |
rpittau | :) | 15:20 |
iurygregory | sorry =) | 15:20 |
*** Goneri has joined #openstack-ironic | 15:25 | |
*** ricolin has joined #openstack-ironic | 15:31 | |
thiagop | Morning folks! TheJulia what would be the best way to find "needs review" stuff currently? I saw that storyboard doesn't have an Ironic board, so I'm looking for a way to find patches to review across all projects under ironic's umbrella... | 15:32 |
iurygregory | thiagop, https://etherpad.openstack.org/p/IronicWhiteBoard | 15:33 |
iurygregory | we have the patches that need attention there (for the week) | 15:33 |
iurygregory | today we skipped the weekly meeting because we had the meetup | 15:34 |
thiagop | TheJulia: ok, I think I found the correct links for the gerrit filters, thanks! iurygregory you mean under 2020-08-20 on the whiteboard itself? | 15:37 |
kaifeng | OH I was wondering why there is no meeting today | 15:37 |
iurygregory | kaifeng, I think we skipped because of the meet up =) | 15:37 |
iurygregory | thiagop, starts on L156 | 15:38 |
* kaifeng is checking etherpad | 15:38 | |
thiagop | iurygregory: oh, ok. hahaha | 15:39 |
thiagop | Kinda difficult to find... | 15:39 |
thiagop | Btw, what time is the meetup? I'd like to attend as a listener, of course :) | 15:40 |
kaifeng | we have changed the default timeout to 15s for ipmitool, it seems working well | 15:40 |
TheJulia | kaifeng: o/ | 15:40 |
iurygregory | thiagop, tomorrow at 15 UTC | 15:40 |
iurygregory | ops | 15:40 |
iurygregory | 13 UTC | 15:40 |
iurygregory | Tuesday September 1st, at 1300 UTC until 1500 UTC | 15:40 |
kaifeng | this issue is raised due to currently we need to support multiple ipmi addresses | 15:40 |
thiagop | iurygregory: kthx | 15:41 |
iurygregory | I can ping you if you need =) | 15:41 |
TheJulia | kaifeng: huh? multiple addresses? | 15:42 |
TheJulia | for a single node? | 15:43 |
TheJulia | well single node's bmc | 15:43 |
kaifeng | TheJulia: yep, one bmc can have multiple ipmi addresses configured | 15:43 |
kaifeng | that's the issue we encountered, by checking them one by one | 15:43 |
TheJulia | are they for distince sub-machines like ipmi bridging or just multiple addresses for BMC for soemthing like multipath | 15:44 |
kaifeng | just mutiple addresses, configured at different channels | 15:44 |
kaifeng | I think this is the problem that user should guarantee, but *shurgs* | 15:45 |
TheJulia | I guess I'm still wondering why | 15:45 |
*** janders3 has joined #openstack-ironic | 15:47 | |
kaifeng | It's because in one of our scenarios, the bmc address is collected by a ramdisk not governed by ironic, previously the ramdisk only collects one bmc address, but when user start to configuring multiple addresses (ipv4/ipv6 for example), some of them may not reachable from ironic conductor | 15:48 |
kaifeng | so the ramdisk collects them all | 15:48 |
TheJulia | hmm | 15:48 |
*** dking has joined #openstack-ironic | 15:48 | |
kaifeng | and registered this node to ironic | 15:48 |
TheJulia | This is a conundrum | 15:48 |
TheJulia | trandles: https://doodle.com/poll/ihbbtns36b2rkhfd | 15:49 |
*** janders has quit IRC | 15:50 | |
*** janders3 is now known as janders | 15:50 | |
trandles | TheJulia, thanks! | 15:51 |
TheJulia | trandles: also added links to the etherpad and for change sets | 15:52 |
trandles | perfect | 15:52 |
*** belmoreira has quit IRC | 15:53 | |
*** Qianbiao has joined #openstack-ironic | 15:53 | |
*** ricolin has quit IRC | 16:00 | |
Qianbiao | Hello, in ironic devstack, Ironic create node and the node auto clean. But how the clean success without setting deploy-kernel | 16:01 |
TheJulia | you need deploy kernel and ramdisk with the agent in them to perform cleaning | 16:01 |
*** lucasagomes has quit IRC | 16:02 | |
dtantsur | I think we set the default kernel/ramdisk in ironic.conf | 16:02 |
Qianbiao | dtantsur you are right. | 16:02 |
Qianbiao | And when i try to add hardware bmc(ibmc), it fails with "clean failed". | 16:03 |
kaifeng | TheJulia: I left some info on the etherpad wrt the snapshot, hope that explains something | 16:03 |
Qianbiao | <dtantsur> ^^^ and the bmc boot up failed with "media error?" | 16:04 |
Qianbiao | should it be the wrong deploy kernel cause this issue? | 16:04 |
Qianbiao | the virt node can be instanced successful. | 16:05 |
*** ricolin has joined #openstack-ironic | 16:08 | |
*** priteau has joined #openstack-ironic | 16:10 | |
TheJulia | kaifeng: thanks | 16:12 |
kaifeng | yw | 16:17 |
dtantsur | rpioso: hi, ever seen anything like https://bugzilla.redhat.com/show_bug.cgi?id=1873305#c2 ? | 16:19 |
openstack | bugzilla.redhat.com bug 1873305 in Bare Metal Hardware Provisioning "Failed to power on /inspect node when using Redfish protocol" [High,New] - Assigned to tsedovic | 16:19 |
*** Qianbiao has quit IRC | 16:25 | |
*** openstackgerrit has joined #openstack-ironic | 16:31 | |
*** belmoreira has joined #openstack-ironic | 16:31 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Stop using --system-site-packages https://review.opendev.org/749081 | 16:31 |
*** belmoreira has quit IRC | 16:38 | |
*** thiagop has quit IRC | 16:43 | |
*** thiagop has joined #openstack-ironic | 16:46 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Stop using --system-site-packages https://review.opendev.org/749081 | 17:04 |
JayF | Both https://review.opendev.org/#/c/748767/ and https://review.opendev.org/#/c/747193/ are ready for review, AIUI tempest failures are due to an ongoing devstack issue. would love to get these in as soon as that is resolved. I'm against a downstream deadline and would strongly prefer backporting community-approved upstream patches than having to take my unmerged drafts :D | 17:07 |
patchbot | patch 748767 - ironic-python-agent - Make WSGI server respect listen_* directives - 5 patch sets | 17:07 |
patchbot | patch 747193 - ironic-python-agent - If listen_tls is true, enable TLS on wsgi server - 8 patch sets | 17:07 |
*** dtantsur is now known as dtantsur|afk | 17:13 | |
dtantsur|afk | o/ | 17:13 |
*** tosky has quit IRC | 17:14 | |
*** derekh has quit IRC | 17:20 | |
*** ijw has joined #openstack-ironic | 17:26 | |
*** Nisha_Agarwal has joined #openstack-ironic | 17:27 | |
*** priteau has quit IRC | 17:29 | |
Nisha_Agarwal | TheJulia, if possible could you please have a look at this RFE https://storyboard.openstack.org/#!/story/2008024. The task 40678 is a very small patch in ironic. Its already under review. The patch link is https://review.opendev.org/746416 | 17:29 |
patchbot | patch 746416 - ironic - Adds few of the security dashboard parameters to c... - 4 patch sets | 17:29 |
*** ijw_ has joined #openstack-ironic | 17:30 | |
*** ijw_ has quit IRC | 17:30 | |
*** ijw_ has joined #openstack-ironic | 17:31 | |
*** ijw_ has quit IRC | 17:31 | |
*** ijw_ has joined #openstack-ironic | 17:32 | |
*** ijw_ has quit IRC | 17:32 | |
*** ijw has quit IRC | 17:33 | |
*** ijw has joined #openstack-ironic | 17:34 | |
openstackgerrit | Nisha Agarwal proposed openstack/ironic master: Adds few of the security dashboard parameters to capabilities https://review.opendev.org/746416 | 17:37 |
*** gyee has joined #openstack-ironic | 17:43 | |
*** JamesBenson has joined #openstack-ironic | 17:43 | |
*** jamesden_ has quit IRC | 17:47 | |
*** jamesdenton has joined #openstack-ironic | 17:49 | |
*** dsneddon has joined #openstack-ironic | 18:25 | |
*** Nisha_Agarwal has quit IRC | 18:32 | |
*** zzzeek has quit IRC | 18:34 | |
*** zzzeek has joined #openstack-ironic | 18:36 | |
*** k_mouza has joined #openstack-ironic | 18:39 | |
*** kaifeng has quit IRC | 18:40 | |
*** k_mouza has quit IRC | 18:40 | |
*** k_mouza has joined #openstack-ironic | 18:41 | |
*** k_mouza has quit IRC | 18:44 | |
*** belmoreira has joined #openstack-ironic | 18:47 | |
*** k_mouza has joined #openstack-ironic | 18:51 | |
*** zzzeek has quit IRC | 18:54 | |
openstackgerrit | vinay kumar muddu proposed openstack/ironic master: Adds ilo-uefi-https boot interface to ilo5 https://review.opendev.org/745501 | 18:56 |
*** zzzeek has joined #openstack-ironic | 18:56 | |
iurygregory | woot it worked \o/ | 19:08 |
iurygregory | https://knowyourmeme.com/photos/1653546-this-is-the-way | 19:09 |
TheJulia | iurygregory: but which way? | 19:20 |
TheJulia | option 1 or option 2? | 19:20 |
iurygregory | 2 | 19:20 |
*** belmoreira has quit IRC | 19:20 | |
*** stevebaker has joined #openstack-ironic | 19:23 | |
trandles | apologies for asking this last Friday and again today...I didn't realize it was so close to end of the day and I closed up IRC before I saw a reply: | 19:29 |
trandles | Do you recommend I install IPA builder from tarball or pip? | 19:29 |
*** k_mouza has quit IRC | 19:34 | |
iurygregory | both should be ok I would say | 19:40 |
*** tosky has joined #openstack-ironic | 20:15 | |
bdodd | "/opt/stack/devstack/lib/keystone: line 448: /usr/local/bin/keystone-manage: No such file or directory" | 20:40 |
bdodd | ^^^ Is this due to the setuptools problem? | 20:40 |
clarkb | bdodd: yes | 20:41 |
bdodd | clarkb Thanks! | 20:41 |
gregwork | has anyone thought about ironic managing virtual metal inside of kube-virt/ocp-virt ? | 20:50 |
TheJulia | gregwork: afaik no. From past experiences such shim layers tend to create all sort of complications, so I think the question needs to be a strong asking of ourselves of "why" | 21:06 |
TheJulia | trandles: pip is likely easier, but you may not be able to just run a pip command | 21:06 |
TheJulia | I guess the whole setuptools thing is a good reason not to look at code today | 21:07 |
TheJulia | or well, to better put it, CI | 21:07 |
trandles | on my testbed I can `pip install` so I'll try that first, thanks iurygregory and TheJulia | 21:07 |
*** jtomasek has quit IRC | 21:12 | |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic master: Add tempest default_boot_option and altflavor https://review.opendev.org/741886 | 21:14 |
*** thiagop has quit IRC | 21:33 | |
TheJulia | dtantsur|afk: on the topic of metalsmith, is there a specific reason you didn't use dib in the CI job? | 21:38 |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic master: Add L3 boot section to the docs https://review.opendev.org/689844 | 21:58 |
janders | good morning Ironic o/ | 22:46 |
*** rcernin has joined #openstack-ironic | 22:51 | |
*** trandles has quit IRC | 22:51 | |
stevebaker | janders: morning | 23:03 |
janders | hi stevebaker | 23:03 |
*** tosky has quit IRC | 23:03 | |
janders | how was your weekend? | 23:03 |
stevebaker | janders: pretty low key, we didn't get up to much | 23:12 |
*** Goneri has quit IRC | 23:33 | |
*** hjensas has quit IRC | 23:51 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!