Thursday, 2020-09-17

*** zzzeek has quit IRC00:03
*** zzzeek has joined #openstack-ironic00:05
jandersI'm trying to help out a colleague who's hitting issues with bifrost running against IPMI real baremetal:00:08
jandershttp://paste.openstack.org/show/797966/00:08
jandershe's getting that while trying to validate nodes00:09
jandershe's running on http_basic auth so I am puzzled why he's hitting keystone issues00:09
jandersdo you have any suggestions how to help him?00:09
*** tonyb has joined #openstack-ironic00:22
*** zzzeek has quit IRC00:35
jandersI suspect it has to do with how they set images using instance-info.. got them to try a couple different things, we'll see how they go00:36
*** zzzeek has joined #openstack-ironic00:36
*** JamesBenson has joined #openstack-ironic00:57
*** JamesBenson has quit IRC01:02
stevebakerjanders: I would guess the version of keystoneauth is too old and is missing the http_basic auth plugin. My second guess is that bifrost is not setting the endpoints in ironic.conf01:23
*** zzzeek has quit IRC01:26
jandersthanks stevebaker! they are setting up a new VM-based env for comparison/reference now to rule out any operator errors. If they hit this there as well we'll track down these settings.01:27
*** zzzeek has joined #openstack-ironic01:27
jandersheading away for a couple hours, back after lunch01:28
stevebakerjanders: they need at least keystoneauth-4.2.001:28
*** JamesBenson has joined #openstack-ironic01:29
openstackgerritSteve Baker proposed openstack/ironic master: Add a driver compatability matrix  https://review.opendev.org/73371601:30
stevebakerTheJulia: I did the speling fixes on ^^01:30
*** JamesBenson has quit IRC01:34
*** Qianbiao has quit IRC01:37
*** rloo has quit IRC01:40
*** Qianbiao has joined #openstack-ironic01:42
*** Goneri has quit IRC01:42
Qianbiao<janders> I think that issue is due to some local ENV not setted.01:57
Qianbiaolike OS_URL or OS_ENDPOINT before running openstack baremetal command.01:58
Qianbiaoreading document should help01:58
*** cdearborn has quit IRC02:20
*** zzzeek has quit IRC02:24
*** zzzeek has joined #openstack-ironic02:26
*** JamesBenson has joined #openstack-ironic02:26
*** John12 has joined #openstack-ironic02:38
*** mkrai has joined #openstack-ironic03:20
openstackgerritVerification of a change to openstack/ironic-python-agent failed: Generate a TLS certificate and send it to ironic  https://review.opendev.org/74993003:21
*** chenhaw has quit IRC03:38
*** mkrai has quit IRC04:06
*** zzzeek has quit IRC04:17
*** zzzeek has joined #openstack-ironic04:18
*** mkrai has joined #openstack-ironic04:19
jandersback04:24
*** Qianbiao has quit IRC04:32
*** uzumaki has joined #openstack-ironic04:32
*** JamesBenson has quit IRC04:56
*** zzzeek has quit IRC05:21
*** zzzeek has joined #openstack-ironic05:21
*** uzumaki has quit IRC05:37
*** uzumaki has joined #openstack-ironic05:37
*** gyee has quit IRC05:38
*** JamesBenson has joined #openstack-ironic05:40
*** tzumainn has quit IRC05:43
*** Qianbiao has joined #openstack-ironic05:47
*** zzzeek has quit IRC05:52
*** zzzeek has joined #openstack-ironic05:53
*** JamesBenson has quit IRC06:11
*** zzzeek has quit IRC06:21
*** zzzeek has joined #openstack-ironic06:23
*** Qianbiao has quit IRC06:31
*** jtomasek has joined #openstack-ironic06:46
*** rcernin has quit IRC06:50
arne_wiebalckGood morning, ironic!06:50
jandersgood morning arne_wiebalck06:51
arne_wiebalckHey janders o/06:52
*** Qianbiao has joined #openstack-ironic06:58
iurygregorygood morning arne_wiebalck janders and Ironic o/06:58
jandershey iurygregory o/07:00
jandershow are things?07:00
iurygregorygood I would say =)07:01
iurygregoryand for you?07:01
jandersnot bad... just a little too many distractions07:02
jandersbut making some forward progress on all fronts which is good :)07:02
*** mkrai has quit IRC07:03
iurygregorygotcha07:07
*** rcernin has joined #openstack-ironic07:08
iurygregoryI love that the landlord just send me a message now saying it will come with tenant at 12 -.-'07:08
*** zzzeek has quit IRC07:09
*** zzzeek has joined #openstack-ironic07:11
*** mkrai has joined #openstack-ironic07:21
*** rcernin has quit IRC07:28
*** jawad_axd has joined #openstack-ironic07:32
*** ociuhandu has joined #openstack-ironic07:48
*** uzumaki has quit IRC07:48
*** dtantsur|afk is now known as dtantsur07:58
dtantsurmorning ironic07:58
dtantsuriurygregory: don't you have any regulations on how in advance they should announce that?07:58
jandersgood morning dtantsur o/07:59
*** mkrai has quit IRC07:59
jandersvery valid point!07:59
jandersyou can also say he's welcome to come as well as he doesnt mind you killing some PIDs while he's around08:00
jandersit will likely freak him and make him go away :P08:00
jandersdtantsur I hit a couple issues with bifrost while setting up a VM-lab on my laptop - I know you run bifrost with nested virt so I wonder if you have seen any of these08:04
dtantsurI do, yes08:04
janders1) in the final step (deploy playbook) it was struggling to get IP address from virbr0 (I hardcoded the url and that passed)08:05
janders2) I think if ansible is installed via dnf on the VM prior to installing bifrost, but ansible-galaxy isn't, that can cause problems08:05
jandershave you seen any of those?08:05
dtantsur1) may be caused by not passing 'testing' everywhere08:06
dtantsur2) haven't tried, but it may be a side-effect of using system-site-packages in our venv08:06
jandersit's all easy to workaround/fix just not sure if it is worthwhile fixing cause I've never seen this on a fresh-install baremetal08:06
janders3) looks like vbmcd isn't starting on boot08:07
dtantsurwell, at least 2) is probably worth fixing. maybe we should get back to using --ignore-installed08:07
dtantsurhmm, I've seen a case of vbmc being suddenly down08:07
janderswhich command takes --ignore-installed? pip, or one of our install scripts/playbooks?08:08
openstackgerritMerged openstack/ironic master: Also wipe agent token on manual power off or reboot  https://review.opendev.org/75181308:10
*** rcernin has joined #openstack-ironic08:10
dtantsurjanders: pip, when we're installing ansible08:11
dtantsurnow, I don't really like using --ignore-installed, but I don't see an easy way around08:11
*** lucasagomes has joined #openstack-ironic08:12
*** rcernin has quit IRC08:17
*** mkrai has joined #openstack-ironic08:17
openstackgerritMerged openstack/ironic master: Allow configuring IPMI cipher suite  https://review.opendev.org/75223708:21
jandershttp://paste.openstack.org/show/797975/ this is the virbr related error08:24
jandershardcoding url in ./playbooks/roles/bifrost-cloud-config/tasks/main.yml works around it08:25
janders*ironic_url08:25
jandersI wonder if it is a bug down the stack (not in bifrost)08:26
iurygregorydtantsur, I'm not aware of any... before she was contacting me 2 days before or more...08:27
dtantsurhuh, maybe we miss collect_facts somewhere?08:27
iurygregoryshe wanted to come at 13 I was like "well I have a meeting"08:27
jandersdtantsur have you ever seen this in your nested-virt setups,?08:29
jandersI had my share of bifrost breakages but I have never seen this one outside VMs08:29
jandersI have a sneaking suspicion something goes wrong here: https://opendev.org/openstack/bifrost/src/branch/master/playbooks/roles/bifrost-cloud-config/defaults/main.yml#L408:32
dtantsurnope, never08:32
janders(based on the error)08:32
jandershmm.. are your VMs CentOS8?08:33
dtantsuryep08:33
dtantsurwell, yes, but the fact should exist, unless you're using a different network_interface08:33
janders(this is a fedora32, cause I built it to test the mariadb fc32 fix)08:33
jandersI wonder if this has something to do with this08:33
openstackgerritAnkit Kumar proposed openstack/ironic master: Adding changes for iso less vmedia support  https://review.opendev.org/75200108:33
jandersI will try to manually read the value of this fact08:34
dtantsurjanders: mmm, try changing deploy-dynamic to gather_facts:yes08:34
openstackgerritDmitry Tantsur proposed openstack/ironic stable/ussuri: Also wipe agent token on manual power off or reboot  https://review.opendev.org/75239308:37
Qianbiaohello dtantsur, you got a minute for the comment from steve on this: https://review.opendev.org/#/c/752024/08:39
patchbotpatch 752024 - ironic-python-agent - Fix: make Intel CNA hardware manager none generic - 5 patch sets08:39
*** derekh has joined #openstack-ironic08:40
dtantsuranswered08:42
Qianbiaook08:45
janders dtantsur enabling facts gathering seems to create other problems http://paste.openstack.org/show/797980/08:48
jandersansible tries to ssh into the VMs (which aren't running yet)08:48
dtantsuroh, of course08:48
*** rcernin has joined #openstack-ironic08:49
dtantsurmaybe we should use the setup module to only gather facts about 127.0.0.1? https://docs.ansible.com/ansible/latest/modules/setup_module.html08:50
jandersthat will likely help - good idea!08:52
janderswhat is really puzzling though is why it only breaks in VMs08:52
janders(thinking about it it's not fedora cause I was helping another RHATter who hit this in a CentOS VM install)08:53
jandersbut then your VMs are good08:53
* janders is scratching his head08:53
jandersI suppose increasing resiliency is the right approach given inconsistent results - hence +1 for setup module with host filtering08:54
jandersI will go grab some dinner08:54
*** k_mouza has joined #openstack-ironic08:57
*** zzzeek has quit IRC08:59
openstackgerritMerged openstack/bifrost master: Recover support for installing stable/ussuri  https://review.opendev.org/75226809:02
*** rcernin has quit IRC09:03
openstackgerritMerged openstack/bifrost master: redfish-emulator: log handled requests  https://review.opendev.org/75203609:04
*** zzzeek has joined #openstack-ironic09:05
iurygregoryit's auth_type that can be none .-. facepalm09:06
openstackgerritMerged openstack/bifrost master: Discourage using non-matching versions of Bifrost and Ironic  https://review.opendev.org/75226409:14
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Gather facts on localhost before running {enroll,deploy}-dynamic  https://review.opendev.org/75241109:15
dtantsurjanders: maybe ^^09:15
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Correct the auth_strategy value (noauth instead of none)  https://review.opendev.org/75241809:30
dtantsuriurygregory, ^^09:30
iurygregorydtantsur, ack my bad I didn't notice it was auth_strategy...09:33
iurygregoryhttps://review.opendev.org/705030 is ready \o/09:58
patchbotpatch 705030 - ironic - Native zuulv3 grenade multinode multitenant - 35 patch sets09:58
*** dtantsur has quit IRC09:59
*** dtantsur has joined #openstack-ironic10:01
iurygregoryyay for merge conflict D:10:04
*** zzzeek has quit IRC10:08
openstackgerritIury Gregory Melo Ferreira proposed openstack/bifrost master: Add ipe installation to bifrost  https://review.opendev.org/75204210:09
openstackgerritDmitry Tantsur proposed openstack/ironic master: Deprecate the iscsi deploy interface  https://review.opendev.org/75020410:10
*** zzzeek has joined #openstack-ironic10:10
*** tosky has joined #openstack-ironic10:19
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Cleanup test-bifrost.yaml  https://review.opendev.org/75242910:43
openstackgerritDmitry Tantsur proposed openstack/bifrost master: test-bifrost: use existing playbooks  https://review.opendev.org/75065610:50
*** zzzeek has quit IRC11:01
openstackgerritMerged openstack/bifrost master: Correct the auth_strategy value (noauth instead of none)  https://review.opendev.org/75241811:01
*** zzzeek has joined #openstack-ironic11:03
*** JamesBenson has joined #openstack-ironic11:07
*** mkrai has quit IRC11:11
*** mkrai has joined #openstack-ironic11:13
*** rcernin has joined #openstack-ironic11:25
*** rcernin has quit IRC11:29
*** zzzeek has quit IRC11:35
*** zzzeek has joined #openstack-ironic11:36
openstackgerritDmitry Tantsur proposed openstack/bifrost master: test-bifrost: use existing playbooks  https://review.opendev.org/75065611:45
*** zzzeek has quit IRC11:50
*** zzzeek has joined #openstack-ironic11:52
openstackgerritVerification of a change to openstack/ironic failed: Extend base build timeouts  https://review.opendev.org/74534811:58
janderswrapping up for today, see you tomorrow Ironic o/12:08
arne_wiebalckbye janders12:08
iurygregorybye janders12:08
iurygregorywhen doing a curl GET /v1/node/<node_uuid> how can I get the driver_internal_info in the response? O.o12:08
iurygregoryI thought it would just return in it...12:09
iurygregorythe API docs say it's Optional in the Response12:10
*** tremble has joined #openstack-ironic12:19
Qianbiao<iurygregory> try detail=True?12:22
trembledtantsur, Any chance of https://review.opendev.org/#/c/752237/ getting backported to train?12:25
patchbotpatch 752237 - ironic - Allow configuring IPMI cipher suite (MERGED) - 3 patch sets12:25
*** zzzeek has quit IRC12:26
dtantsurtremble: unlikely - it's a feature. maybe you can make a case to TheJulia :)12:27
*** derekh has quit IRC12:27
trembledtantsur, Right now I have a production OpenStack cluster that's stopped being able to connect to UCS...12:27
*** zzzeek has joined #openstack-ironic12:28
*** John12 has quit IRC12:30
arne_wiebalcktremble: dtantsur: this is what we use to deal with BMC specifics: https://gitlab.cern.ch/hw/ipmiproxy/12:33
arne_wiebalcktremble: dtantsur: this is the proxy tool I mentioned, which handles all issues we found around ciphers12:34
tremblearne_wiebalck, Basically wrapped ipmitool in a script ?12:34
arne_wiebalckyep12:34
iurygregory*magic*12:34
openstackgerritDmitry Tantsur proposed openstack/bifrost master: [PoC] A naive attempt at creating an upgrade job  https://review.opendev.org/75037612:35
arne_wiebalcktremble: we deploy this along side impitool and have Ironic call this one instead12:35
arne_wiebalcktremble: not the most glorious solution, but it works for our fleet12:36
tremblearne_wiebalck, Well if I'm reading dtantsur's change messages correctly this might be related to our RH OSP16.2 / RHEL 8.2 upgrades in which case it's a rather nasty bug12:36
arne_wiebalcktremble: the cipher issue?12:37
trembleyeah12:37
arne_wiebalcktremble: I think tool handles this, at least from my testing12:38
trembleThat would at least give me a work around12:38
arne_wiebalcktremble: for this latest bug, however, Ironic does not only need to call the proxy, but it can also not pass lanplus any longer12:39
arne_wiebalcktremble: as the proxy will respect this12:39
trembleouch12:39
arne_wiebalckyeah12:39
arne_wiebalcktremble: I don't know how many different BMC implementations/versions we have, but the proxy at the moment knows them all :-D12:40
tremble:)12:40
arne_wiebalcktremble: know == knows how to handle12:41
dtantsurtremble: on most hardware, ipmitool should be able to automatically negotiate the correct cipher suite12:42
dtantsurit's only a problem if a machine says it supports cipher 17 and then refuses to use it12:42
arne_wiebalckdtantsur: this is true for *most* hardware12:42
arne_wiebalckdtantsur: ++12:42
arne_wiebalckthe other option rather than patching Ironic, would be to have sth in the node's config12:43
trembleyeah, it was able to negotiate several weeks ago.  Unfortunately I think we've have a 16.1 upgrade and firmware upgrade12:43
arne_wiebalckbasically, rather than specifying the cipher suite, one specifies the command  (which could be ipmitool with the correct -C option, or a completely different command, like in our case)12:44
rpiosoGood morning, ironic :)12:45
arne_wiebalckhey rpioso o/12:47
rpiosoarne_wiebalck: \o12:48
rpiosoarne_wiebalck: The Redfish Interop sync-up Doodle closed: Thursday, 9/24, 12:00-13:00 UTC. mraineri will be available the first 1/2 hour.12:48
arne_wiebalckrpioso: awesome!12:49
* arne_wiebalck puts this into his calendar12:49
*** Goneri has joined #openstack-ironic12:49
arne_wiebalckrpioso: I create the meeting and send you the invite?12:49
*** mkrai has quit IRC12:52
*** iurygregory has quit IRC12:56
*** iurygregory has joined #openstack-ironic12:58
*** uzumaki has joined #openstack-ironic12:59
rpiosoarne_wiebalck: Yes, please.12:59
* rpioso is in downstream meetings for a couple hours12:59
*** derekh has joined #openstack-ironic13:02
*** rloo has joined #openstack-ironic13:12
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Move CLI validation to bifrost-keystone-client-config  https://review.opendev.org/75246613:13
iurygregoryQianbiao, details=True didn't work13:13
iurygregoryanyone else with some ideas on how to get the driver_internal_info for a node when using curl? .-.13:14
dtantsuriurygregory: I suspect you need to figure out the API version13:22
iurygregorydtantsur, need to set the API version in the request you mean?13:22
dtantsuriurygregory: yep13:22
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Move CLI validation to bifrost-keystone-client-config  https://review.opendev.org/75246613:22
iurygregorydtantsur, ack13:22
*** hjensas is now known as hjensas|afk13:22
Qianbiao<iurygregory> /detail ?13:23
iurygregory"/detail" is deprecated =)13:24
Qianbiao:)13:24
*** tzumainn has joined #openstack-ironic13:25
Qianbiaoit's werid, it should have those info by default. when checking ironic-api log, it just will /v1/nodes/uuid directly.13:26
Qianbiao<iurygregory> when call baremetal node show -f json xxx, it have internal_info. and it does only visit /v1/nodes/uuid.13:27
iurygregoryyeah, maybe it's the missing header like dtantsur said, I've asked the person to try again with the header13:27
QianbiaoTrain version13:27
iurygregorywell cli is easy ( I don't know why the person wants curl when we have the CLI...)13:27
openstackgerritvinay kumar muddu proposed openstack/ironic master: Adds ilo-uefi-https boot interface to ilo5  https://review.opendev.org/74550113:33
*** uzumaki has quit IRC13:41
dtantsuriurygregory, Qianbiao, driver_internal_info appeared in 1.3 https://docs.openstack.org/ironic/latest/contributor/webapi-version-history.html#id4613:47
iurygregorydtantsur, yeah13:47
iurygregoryit worked \o/13:47
* iurygregory dances13:47
Qianbiaolearn :)13:52
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Ensure that repositories are owned by the running users  https://review.opendev.org/75247313:55
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Ensure that repositories are owned by the running users  https://review.opendev.org/75247314:02
*** k_mouza has quit IRC14:18
*** k_mouza has joined #openstack-ironic14:20
*** k_mouza has quit IRC14:25
*** k_mouza has joined #openstack-ironic14:28
*** zzzeek has quit IRC14:30
*** zzzeek has joined #openstack-ironic14:32
*** dking has quit IRC14:50
*** dking has joined #openstack-ironic14:52
*** mkrai has joined #openstack-ironic14:56
Qianbiaohello dtantsur, may u check the comment on: https://review.opendev.org/#/c/752006/14:57
patchbotpatch 752006 - ironic (stable/ussuri) - opt: Enhance old stable branches to use latest pyt... - 6 patch sets14:57
Qianbiaopython-ibmcclient==0.1.0 is not compatible in this patch.14:58
*** priteau has joined #openstack-ironic14:59
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Move CLI validation to bifrost-keystone-client-config  https://review.opendev.org/75246615:01
dtantsurQianbiao: then you need to make it compatible with both versions (e.g. via try..except.. when importing) or abandon the patch15:02
Qianbiaook, thanks dtantsur15:03
*** cp- has quit IRC15:04
*** cp- has joined #openstack-ironic15:09
*** gyee has joined #openstack-ironic15:15
*** tremble has quit IRC15:15
Qianbiaodnsmasq will provide a http service to serve boot.ipxe file?15:32
*** stevebaker has quit IRC15:32
Qianbiaooh, never mind, it's provided by apache215:35
*** stevebaker has joined #openstack-ironic15:35
*** k_mouza has quit IRC15:39
dtantsurleaving a bit earlier today, see you tomorrow15:51
*** dtantsur is now known as dtantsur|afk15:51
*** Qianbiao has quit IRC16:00
*** lucasagomes has quit IRC16:05
*** ociuhandu has quit IRC16:07
*** mkrai has quit IRC16:11
*** mkrai_ has joined #openstack-ironic16:11
*** k_mouza has joined #openstack-ironic16:15
*** Nisha_Agarwal has joined #openstack-ironic16:19
openstackgerritMerged openstack/bifrost master: [CI] Check with Kolla Ansible  https://review.opendev.org/75063716:19
*** k_mouza has quit IRC16:19
Nisha_Agarwaliurygregory, https://review.opendev.org/#/c/752268/216:20
patchbotpatch 752268 - bifrost - Recover support for installing stable/ussuri (MERGED) - 2 patch sets16:20
Nisha_Agarwaliurygregory, the ironic-api and ironic-conductor fails to come up unless we add noauth instead of none.16:21
Nisha_Agarwaldtantsur|afk, ^^^16:21
Nisha_Agarwaliurygregory, i gave the comment after trying it out16:22
*** k_mouza has joined #openstack-ironic16:22
iurygregoryNisha_Agarwal, we merged https://review.opendev.org/#/c/752418/16:27
patchbotpatch 752418 - bifrost - Correct the auth_strategy value (noauth instead of... (MERGED) - 1 patch set16:27
*** mkrai_ has quit IRC16:27
iurygregoryshould be working now =)16:28
Nisha_Agarwaliurygregory, thanks16:30
Nisha_Agarwali didnt see this patch16:30
Nisha_AgarwalThank u16:30
iurygregorynp16:31
*** k_mouza has quit IRC16:44
*** priteau has quit IRC16:50
*** tosky has quit IRC17:00
*** derekh has quit IRC17:04
*** Nisha_Agarwal has quit IRC17:05
*** k_mouza has joined #openstack-ironic17:13
*** k_mouza has quit IRC17:28
openstackgerritChristopher Dearborn proposed openstack/ironic master: Redfish driver firmware update  https://review.opendev.org/74961917:39
*** k_mouza has joined #openstack-ironic17:44
*** k_mouza has quit IRC17:49
*** irclogbot_0 has quit IRC17:58
*** irclogbot_0 has joined #openstack-ironic18:01
*** jawad_axd has quit IRC18:05
*** ociuhandu has joined #openstack-ironic18:15
*** ociuhandu has quit IRC18:19
*** k_mouza has joined #openstack-ironic18:25
*** k_mouza has quit IRC18:25
*** k_mouza has joined #openstack-ironic18:26
*** k_mouza has quit IRC18:28
*** k_mouza has joined #openstack-ironic18:33
*** k_mouza has quit IRC18:37
*** openstackgerrit has quit IRC19:21
*** ociuhandu has joined #openstack-ironic19:41
*** tosky has joined #openstack-ironic20:34
*** JamesBenson has quit IRC20:44
*** ociuhandu has quit IRC20:52
*** openstackgerrit has joined #openstack-ironic21:09
openstackgerritMerged openstack/bifrost master: Cleanup test-bifrost.yaml  https://review.opendev.org/75242921:09
openstackgerritMerged openstack/bifrost master: test-bifrost: use existing playbooks  https://review.opendev.org/75065621:09
*** jhesketh has quit IRC21:55
*** zzzeek has quit IRC21:57
*** zzzeek has joined #openstack-ironic22:01
openstackgerritChristopher Dearborn proposed openstack/ironic master: Redfish driver firmware update  https://review.opendev.org/74961922:13
*** zzzeek has quit IRC22:17
*** tosky has quit IRC22:19
*** zzzeek has joined #openstack-ironic22:19
*** mgagne has joined #openstack-ironic22:37
openstackgerritBob Fournier proposed openstack/ironic master: Handle a Redfish error response when turning power off  https://review.opendev.org/75258222:59
*** rcernin has joined #openstack-ironic23:05
jandersgood morning Ironic o/23:06
*** jhesketh has joined #openstack-ironic23:31
*** Qianbiao has joined #openstack-ironic23:53
*** Goneri has quit IRC23:57

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!