Tuesday, 2020-06-23

*** diurnalist has quit IRC00:50
*** diurnalist has joined #openstack-ironic00:56
*** k_mouza has joined #openstack-ironic00:59
*** diurnalist has quit IRC01:00
*** k_mouza has quit IRC01:03
*** diurnalist has joined #openstack-ironic01:05
*** diurnalist has quit IRC01:11
*** diurnalist has joined #openstack-ironic01:14
*** diurnalist has quit IRC01:19
*** diurnalist has joined #openstack-ironic01:20
*** gyee has quit IRC01:23
*** stevebaker has joined #openstack-ironic01:31
*** ociuhandu has joined #openstack-ironic01:31
*** cdearborn has quit IRC01:31
*** ociuhandu has quit IRC01:35
openstackgerritSteve Baker proposed openstack/ironic-inspector master: Document [ironic] auth options for inspector  https://review.opendev.org/73740401:39
*** tzumainn has quit IRC01:52
*** ricolin has joined #openstack-ironic02:08
*** Lucas_Gray has quit IRC02:10
*** ricolin has quit IRC02:20
*** ricolin has joined #openstack-ironic02:30
*** stevebaker has quit IRC02:31
*** rcernin has quit IRC02:41
*** rcernin has joined #openstack-ironic02:42
*** ricolin has quit IRC02:51
*** ricolin has joined #openstack-ironic03:05
*** Goneri has quit IRC03:11
*** diurnalist has quit IRC03:17
*** k_mouza has joined #openstack-ironic03:44
*** ricolin has quit IRC03:45
*** ricolin has joined #openstack-ironic03:45
*** k_mouza has quit IRC03:49
*** stevebaker has joined #openstack-ironic03:54
*** stevebaker has quit IRC03:56
*** dmellado has quit IRC03:59
*** rh-jelabarre has quit IRC04:16
*** ricolin has quit IRC04:33
erbarrrpioso, TheJulia, got CI back to green on train, results should inc shortly https://review.opendev.org/#/c/736941/04:35
patchbotpatch 736941 - ironic (stable/train) - Fix Redfish handle no continuous override boot src - 1 patch set04:35
*** ricolin has joined #openstack-ironic04:56
*** ricolin has quit IRC05:14
*** dtantsur|afk has quit IRC05:14
*** ricolin has joined #openstack-ironic05:14
*** dtantsur has joined #openstack-ironic05:15
*** strigazi has quit IRC05:18
*** strigazi has joined #openstack-ironic05:19
*** ricolin has quit IRC05:26
*** ricolin has joined #openstack-ironic05:28
arne_wiebalckGood morning, ironic!05:46
*** rpittau|afk is now known as rpittau06:34
rpittaugood morning ironic! o/06:34
iurygregorygood morning arne_wiebalck, rpittau and Ironic o/06:41
arne_wiebalckHey iurygregory & rpittau o/06:41
rpittauhey iurygregory && arne_wiebalck :)06:42
*** jtomasek has joined #openstack-ironic07:01
*** Qianbiao has joined #openstack-ironic07:02
*** Qianbiao has quit IRC07:12
*** Qianbiao has joined #openstack-ironic07:13
*** diurnalist has joined #openstack-ironic07:13
*** diurnalist has quit IRC07:18
*** dougsz has joined #openstack-ironic07:28
*** Qianbiao has quit IRC08:04
*** lucasagomes has joined #openstack-ironic08:07
*** rcernin has quit IRC08:18
*** ricolin has quit IRC08:39
*** ociuhandu has joined #openstack-ironic08:52
*** priteau has joined #openstack-ironic08:58
dtantsurmorning ironic09:05
rpittauhey dtantsur :)09:06
*** chihhsin_ has joined #openstack-ironic09:08
iurygregorymorning dtantsur =)09:08
*** chihhsin has quit IRC09:09
*** sshnaidm|afk is now known as sshnaidm|ruck09:11
*** Lucas_Gray has joined #openstack-ironic09:21
*** Lucas_Gray has quit IRC09:26
*** derekh has joined #openstack-ironic09:30
openstackgerritmelissaml proposed openstack/python-ironicclient master: Fix pygments style  https://review.opendev.org/73746709:30
*** Lucas_Gray has joined #openstack-ironic09:31
openstackgerritRiccardo Pittau proposed openstack/metalsmith master: [WIP] Use Centos 8  https://review.opendev.org/73727809:39
*** Lucas_Gray has quit IRC09:40
openstackgerritVerification of a change to openstack/bifrost failed: Fix fast-track deployment after discovery/inspection  https://review.opendev.org/73723309:44
*** Lucas_Gray has joined #openstack-ironic09:46
*** ricolin has joined #openstack-ironic09:47
openstackgerritRiccardo Pittau proposed openstack/ironic master: Convert ironic-tempest-ipa-wholedisk-bios-agent_ipmitool to dib  https://review.opendev.org/73475909:56
*** rpittau is now known as rpittau|bbl10:12
openstackgerritVerification of a change to openstack/ironic-python-agent-builder failed: Disable automatic updates in dnf-based systems  https://review.opendev.org/73533510:14
*** tkajinam has quit IRC10:17
openstackgerritDmitry Tantsur proposed openstack/ironic master: Add a bug reporting and triaging guide  https://review.opendev.org/73748310:22
dtantsurshadower: ^^10:22
shadowerdtantsur nice one, thanks!10:23
openstackgerritDmitry Tantsur proposed openstack/ironic master: Add a bug reporting and triaging guide  https://review.opendev.org/73748310:23
dtantsuranyone who wants to help with bug triaging (pretty please!), please read and comment ^^10:23
openstackgerritMerged openstack/ironic master: Allow node vif attach to specify port_uuid or portgroup_uuid  https://review.opendev.org/73178010:29
iurygregorydtantsur ++10:30
*** jhesketh has quit IRC10:36
*** jhesketh has joined #openstack-ironic10:37
openstackgerritDmitry Tantsur proposed openstack/ironic master: Add a bug reporting and triaging guide  https://review.opendev.org/73748310:39
dtantsuriurygregory: let's try this wording maybe ^^?10:39
openstackgerritMerged openstack/ironic stable/train: Fix Redfish handle no continuous override boot src  https://review.opendev.org/73694110:42
*** ricolin has quit IRC10:55
*** ociuhandu has quit IRC11:04
*** diurnalist has joined #openstack-ironic11:14
*** diurnalist has quit IRC11:19
openstackgerritMerged openstack/bifrost stable/ussuri: Fix fast-track deployment after discovery/inspection  https://review.opendev.org/73723311:24
*** elemaill has joined #openstack-ironic11:27
iurygregorydtantsur, looking now11:33
iurygregoryI was having lunch =)11:34
maelkHello!! I have a couple of questions related to inspector. Please bear with my lack of knowledge there. I am trying to run inspector behind Apache with mod_wsgi. The packages from tripleo for CentOS do not contain the ironic-inspector-api-wsgi file mentioned in the docs, but it can be found via the packages in pip or generated from source. When run11:36
maelkning with that file, is there a need to run ironic-inspector-conductor (that seems to be pretty much the same as ironic-inspector) ? Did I understand correctly that ironic-inspector is a flask app so when running with WSGI there should not be any need to run anything else ?11:36
*** jawad_axd has joined #openstack-ironic11:43
dtantsurmaelk: I'll take a look at the packaging. as to your second question, ideally we need the conductor/api split, but it currently relies on rabbitmq which you don't have or want.11:48
dtantsuryou should be able to run inspector as it is now behind WSGI, just make sure to avoid running it single-threaded11:48
dtantsur(some API are synchronous and can take time)11:48
maelkthanks dtantsur ! so inspector is not just a flask app when you run it with ironic-inspector ?11:49
dtantsurmaelk: yes11:50
dtantsurand does use greenthreads, something to be careful about11:50
dtantsurmaelk: I've checked the packaging, you need to install openstack-ironic-inspector-api11:50
dtantsurit contains the file you need11:50
* dtantsur cannot google any problems with eventlet+mod_wsgi, so it might be fine11:54
openstackgerritDmitry Tantsur proposed openstack/ironic master: Trivial: clarify usage of AgentCommandTimeout in _wait_for_command  https://review.opendev.org/73750412:00
dtantsurmgoddard: ^^12:00
*** rh-jelabarre has joined #openstack-ironic12:04
maelkgreat, thank you dtantsur12:04
*** rpittau|bbl is now known as rpittau12:14
*** ociuhandu has joined #openstack-ironic12:19
*** ricolin has joined #openstack-ironic12:36
openstackgerritVerification of a change to openstack/ironic failed: Add function definition handling  https://review.opendev.org/70448812:38
*** derekh has quit IRC12:40
*** derekh has joined #openstack-ironic12:40
*** chenhaw has joined #openstack-ironic12:45
*** chenhaw has quit IRC12:46
*** chenhaw has joined #openstack-ironic12:46
openstackgerritDmitry Tantsur proposed openstack/ironic master: Add a bug reporting and triaging guide  https://review.opendev.org/73748312:48
openstackgerritDmitry Tantsur proposed openstack/ironic master: Trivial: clarify usage of AgentCommandTimeout in _wait_for_command  https://review.opendev.org/73750412:49
rpittaudon't drink and triage12:51
iurygregory^ good advice12:51
rpittau:)12:51
dtantsur:D12:52
* dtantsur is not sure he's never done that..12:52
rpittaulol12:52
iurygregoryhehehe12:57
*** fultonj has joined #openstack-ironic13:01
openstackgerritVerification of a change to openstack/ironic failed: Networking boot fallback for local boot  https://review.opendev.org/73449013:04
TheJuliawe need some sort of zuul gif13:05
dtantsuryep13:05
dtantsurgood morning TheJulia13:05
iurygregorygood morning TheJulia =)13:05
iurygregoryyesterday we gave cookies to zuul13:05
iurygregorytoday we shouldn't give any XD13:06
*** rloo has joined #openstack-ironic13:08
TheJuliano cookies for zuul. Check13:12
rpittaugood morning TheJulia :)13:12
TheJuliaI'm getting some of the weirdest emails these days13:15
TheJulialike... I don't think anything can surprise me now13:17
iurygregory=(13:21
iurygregoryare you feeling better TheJulia ? =)13:21
*** elemaill has left #openstack-ironic13:21
TheJuliamostly. I went from feeling okay to feeling a little weird, to being in lots of pain in about 20 minutes13:22
TheJuliaIt was not fun.13:22
TheJuliaI ended up taking special meds that I have and laying down, I felt lie 80% better about an hour later13:22
TheJuliadtantsur: so field team seems to be indicating that the just the second retry patch still occasionally fails. Sometimes downloads are found in hung state just as the first patch sought to prevent, some fail and retry internal, and some fail hard and never are able to continue downloading. Which raises another bug it seems. But with both retry patches deploys have worked so *shrug*13:24
iurygregoryTheJulia, take care =) I hope it won't happen again13:32
dtantsurTheJulia: which one of them is the second?13:38
TheJuliahttps://review.opendev.org/736065 <-- second13:39
patchbotpatch 736065 - ironic-python-agent - Add full download retries - 3 patch sets13:39
TheJuliahttps://review.opendev.org/#/c/734709/ <-- first13:40
patchbotpatch 734709 - ironic-python-agent - Add timeout operations to try and prevent hang on ... - 5 patch sets13:40
dtantsurmmmm ok13:43
TheJuliaI think it is just all of the yields and select/poll magic13:44
dtantsurTheJulia: I don't know, maybe we just merge these13:44
maelk@dtantsur one more question if you don't mind. Since inspector does not use a default configuration file (https://github.com/openstack/ironic-inspector/blob/master/ironic_inspector/common/service_utils.py#L28), and it is not possible to pass it to the daemon from Apache, how do you give it a configuration file ? Is it possible to define an environm13:44
maelkent variable with the file name13:44
TheJuliaI don't have enough liver capacity to figure it out completely :)13:44
dtantsurmaelk: it should be possible to pass arguments via mod_wsgi, hmm13:44
TheJuliadtantsur: yeah, that is kind of what I'm leaning towards given they reported success with both. Looks like they are hitting a another issue with retries, but one I thought we had fixed.13:44
*** tzumainn has joined #openstack-ironic13:45
maelkif using the development version yes, but apparently not with apache13:45
dtantsuramazing..13:45
TheJuliadtantsur: I think it is the conductor can stack retries up for commands thing, at least looking at the logs they posted13:46
dtantsurmaelk: how does it work for ironic itself then, we don't have default_config_files there either..13:47
openstackgerritRiccardo Pittau proposed openstack/ironic master: Enforce autospec in test_common  https://review.opendev.org/73724613:48
openstackgerritRiccardo Pittau proposed openstack/ironic master: Enforce autospec in test_flat  https://review.opendev.org/73728213:48
openstackgerritRiccardo Pittau proposed openstack/ironic master: Enforce autospec in test_utils  https://review.opendev.org/73754213:48
maelkhum, Ironic is reading the /etc/ironic/ironic.conf without configuration, I didn't look into it. I'll check13:48
dtantsurTheJulia: not sure I got the bit about conductor..13:48
dtantsurmaelk: maybe inspector does read something, just not something we usually use13:48
dtantsur?13:48
openstackgerritRiccardo Pittau proposed openstack/ironic master: Enforce autospec in test_common  https://review.opendev.org/73724613:48
openstackgerritRiccardo Pittau proposed openstack/ironic master: Enforce autospec in test_flat  https://review.opendev.org/73728213:48
openstackgerritRiccardo Pittau proposed openstack/ironic master: Enforce autospec in test_utils  https://review.opendev.org/73754213:48
dtantsurlike /etc/ironic-inspector/ironic-inspector.conf or anything?13:48
TheJuliadtantsur: conductor is asking for prepare_image to be run 3 times13:49
dtantsurTheJulia: but that's only on connection failures, no?13:49
dtantsurI mean, if ironic cannot connect to IPA?13:49
TheJuliaI just got the conductor log13:49
maelkah I understood it! it's oslo_config that takes care to automatically read /etc/<name>/<name>.conf ! Thanks a lot for the help dtantsur, that solves my problem!13:51
*** sshnaidm|ruck is now known as sshnaidm|afk13:51
dtantsurneat! yeah, you can blame me for picking /etc/ironic-inspector/inspector.conf that is apparently non-standard :)13:52
*** diurnalist has joined #openstack-ironic13:57
*** aedc_ has quit IRC14:10
*** dhellmann_ has joined #openstack-ironic14:11
*** dhellmann has quit IRC14:13
*** dhellmann_ is now known as dhellmann14:13
*** bnemec has quit IRC14:16
*** bnemec has joined #openstack-ironic14:20
*** riuzen has joined #openstack-ironic14:24
*** riuzen has quit IRC14:28
*** sshnaidm|afk is now known as sshnaidm|ruck14:39
*** Lucas_Gray has quit IRC14:42
*** ricolin has quit IRC14:42
TheJulialooks like lots of post_failures :(14:44
dtantsuryup14:45
openstackgerritVladyslav Drok proposed openstack/python-ironicclient master: Allow to pass global request id in node methods  https://review.opendev.org/72591914:50
openstackgerritVladyslav Drok proposed openstack/python-ironicclient master: Allow to pass global request id in port and volume  https://review.opendev.org/72593014:50
openstackgerritVladyslav Drok proposed openstack/python-ironicclient master: Allow to pass global request id for remaining objects  https://review.opendev.org/72594114:50
openstackgerritVladyslav Drok proposed openstack/python-ironicclient master: Add release note regarding global_request_id  https://review.opendev.org/73259014:50
*** Goneri has joined #openstack-ironic14:50
*** Lucas_Gray has joined #openstack-ironic14:50
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent master: Add debug message to node lookup  https://review.opendev.org/73755514:51
*** jawad_axd has quit IRC14:51
*** priteau has quit IRC14:52
iurygregorydo we want to backport https://review.opendev.org/#/c/732149/ ?14:53
patchbotpatch 732149 - ironic - Add api-ref for indicators API (MERGED) - 6 patch sets14:53
*** bdodd has joined #openstack-ironic14:57
*** dougsz has quit IRC14:58
*** dking has joined #openstack-ironic14:58
*** dougsz has joined #openstack-ironic15:11
* dtantsur switches to working from balcony15:26
rpittauwell that's fantastic, I found an interesting thing, the node lookup fails on centos8 dib images when executed more than once because it tries to contact the api from the 2nd net interface that can't get an ip from dhcp15:32
dtantsurwut15:33
rpittauand then timeout occurs \o/15:33
rpittauif anyone is interested https://aa3a8ea10308e181f84a-43762991937ccde5eef92e3d2b5c183e.ssl.cf1.rackcdn.com/734759/10/check/ironic-tempest-ipa-wholedisk-bios-agent_ipmitool/55d7224/controller/logs/ironic-bm-logs/node-0_console_2020-06-23-11%3A20%3A02_log.txt15:33
rpittaumy head is imploding15:33
dtantsurmmm, yeah, I seem to recall DIB images disliking multiple interfaces..15:33
dtantsurbut usually when they're on the provisioning network15:33
rpittauvery disliking15:33
rpittauI don't get why choosing a failed interface while you have a perfectly working one15:36
rpittaummm it is true that I don't see a clear routing rule15:38
dtantsuriurygregory: I think api-ref is built from master only, but probably yes - for completeness15:43
iurygregorytruth api-ref doesn't have a way to look for the api-ref in stable/branch15:44
dtantsurit's because API is expected to always be incremental15:47
iurygregorygotcha!15:48
*** gyee has joined #openstack-ironic15:59
rpittaugoodnight! o/15:59
*** rpittau is now known as rpittau|afk16:00
openstackgerritDmitry Tantsur proposed openstack/ironic master: WIP: Decompose the core deploy step of the direct deploy  https://review.opendev.org/69830916:00
*** lucasagomes has quit IRC16:03
*** ociuhandu_ has joined #openstack-ironic16:09
*** ociuhandu has quit IRC16:12
*** ociuhandu_ has quit IRC16:14
*** mgoddard has quit IRC16:15
*** ociuhandu has joined #openstack-ironic16:19
*** mgoddard has joined #openstack-ironic16:21
openstackgerritDmitry Tantsur proposed openstack/ironic master: WIP: Decompose the core deploy step on iscsi and ansible deploy  https://review.opendev.org/73118016:22
*** ociuhandu has quit IRC16:23
*** dtantsur is now known as dtantsur|afk16:29
*** rloo has quit IRC16:36
*** rloo has joined #openstack-ironic16:37
*** Lucas_Gray has quit IRC16:38
openstackgerritTzu-Mainn Chen proposed openstack/python-ironicclient master: Add port-uuid parameter to node vif attach  https://review.opendev.org/73758517:15
*** derekh has quit IRC17:15
*** ociuhandu has joined #openstack-ironic17:18
*** sshnaidm|ruck is now known as sshnaidm|afk17:24
rpiosoerbarr: Thank you for getting the CI back to green on stable/train! The subject change -- https://review.opendev.org/#/c/736941/ -- merged \o/17:42
patchbotpatch 736941 - ironic (stable/train) - Fix Redfish handle no continuous override boot src (MERGED) - 1 patch set17:43
arne_wiebalckbye everyone o/18:09
*** diurnalist has quit IRC18:12
openstackgerritJulia Kreger proposed openstack/ironic master: Handle "agent is busy" errors during deployment  https://review.opendev.org/73759518:25
TheJuliawell, I've been chasing that for far too long18:27
*** diurnalist has joined #openstack-ironic18:46
*** dougsz has quit IRC18:47
*** jawad_axd has joined #openstack-ironic18:50
*** fultonj has left #openstack-ironic19:15
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Add timeout operations to try and prevent hang on read()  https://review.opendev.org/73470919:40
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Add full download retries  https://review.opendev.org/73606519:40
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Extend retries to 9, 10 seconds apart.  https://review.opendev.org/73639019:40
*** jtomasek has quit IRC20:06
TheJuliaWell this is bizzar. unrelated change and now unit tests are failing20:08
openstackgerritMerged openstack/ironic master: Networking boot fallback for local boot  https://review.opendev.org/73449020:15
TheJuliahmm. merge changes20:19
TheJuliafun20:19
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Add timeout operations to try and prevent hang on read()  https://review.opendev.org/73470920:25
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Add full download retries  https://review.opendev.org/73606520:27
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Extend retries to 9, 10 seconds apart.  https://review.opendev.org/73639020:27
*** Lucas_Gray has joined #openstack-ironic20:32
*** stevebaker has joined #openstack-ironic20:39
TheJuliaI've updated the review priorites based on current patch merge states. General reminder everyone, reviews are appreciated!20:50
*** Goneri has quit IRC21:46
*** clarkb has quit IRC22:44
*** tkajinam has joined #openstack-ironic22:53
openstackgerritMerged openstack/ironic master: Fix fast-track with the direct deploy interface  https://review.opendev.org/73616422:55
openstackgerritVerification of a change to openstack/ironic failed: Enable HTTP Basic authentication for JSON-RPC  https://review.opendev.org/73575722:55
*** clarkb has joined #openstack-ironic22:58
*** rcernin has joined #openstack-ironic23:02
openstackgerritMerged openstack/ironic-inspector master: Merge jobs  https://review.opendev.org/72612123:05
*** rcernin has quit IRC23:08
*** rcernin has joined #openstack-ironic23:08
*** diurnalist has quit IRC23:52
*** diurnalist has joined #openstack-ironic23:53

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!