Friday, 2020-01-17

openstackgerritDavid Hill proposed openstack/ironic-python-agent master: Skip nic numa_node discovery if it's not assigned to a numa_node  https://review.opendev.org/70299000:11
openstackgerritDavid Hill proposed openstack/ironic-python-agent master: Skip nic numa_node discovery if it's not assigned to a numa_node  https://review.opendev.org/70299000:17
openstackgerritDavid Hill proposed openstack/ironic-python-agent master: Skip nic numa_node discovery if it's not assigned to a numa_node  https://review.opendev.org/70299000:27
*** adrianc_ has quit IRC00:30
*** cjloader has quit IRC00:32
*** adrianc has joined #openstack-ironic00:33
*** yedongcan has joined #openstack-ironic00:50
*** openstackgerrit has quit IRC00:57
*** rloo has quit IRC00:59
*** yedongcan has quit IRC01:12
*** tzumainn has quit IRC01:12
*** openstackgerrit has joined #openstack-ironic01:22
openstackgerritDavid Hill proposed openstack/ironic-python-agent master: Skip nic numa_node discovery if it's not assigned to a numa_node  https://review.opendev.org/70299001:22
*** ociuhandu has joined #openstack-ironic01:31
*** bnemec has quit IRC01:31
*** ociuhandu has quit IRC01:35
rpiosoetingof: I have some progress to share. tinycore boots successfully \o/ However, it appears IPA doesn't execute. Also the server has no IPv4 addresses assigned to its network interfaces, except for its loopback interface.01:50
*** gyee has quit IRC02:07
*** jawad_axd has joined #openstack-ironic02:39
*** jawad_axd has quit IRC02:43
*** logan- has quit IRC02:48
*** logan_ has joined #openstack-ironic02:50
*** logan_ is now known as logan-02:50
*** jawad_axd has joined #openstack-ironic03:00
*** jawad_axd has quit IRC03:04
*** TxGirlGeek has quit IRC03:08
*** rh-jelabarre has quit IRC03:22
*** mkrai_ has joined #openstack-ironic04:09
*** mkrai_ has quit IRC04:47
*** mkrai__ has joined #openstack-ironic04:47
*** dustinc is now known as dustinc|PTO04:52
*** TxGirlGeek has joined #openstack-ironic05:00
*** zaneb has quit IRC05:08
*** jdandrea has quit IRC05:23
*** ociuhandu has joined #openstack-ironic05:30
*** rpittau|afk has quit IRC05:34
*** rpittau|afk has joined #openstack-ironic05:34
*** ociuhandu has quit IRC05:35
*** mkrai__ has quit IRC05:39
*** mkrai_ has joined #openstack-ironic05:39
*** mkrai_ has quit IRC05:40
*** mkrai_ has joined #openstack-ironic05:40
etingofrpioso, good news! do yo have a DHCP server running on any of the networks local to the node?05:42
*** TxGirlGeek has quit IRC05:54
*** TxGirlGeek has joined #openstack-ironic05:59
*** TxGirlGeek has quit IRC06:10
rpiosoetingof: devstack’s?06:56
mkrai_mgoddard, Hi o/07:01
rpiosoetingof: Please note the ramdisk was built by stack.sh, because IRONIC_BUILD_DEPLOY_RAMDISK was set to True. That was probably unnecessary. Fetching a prebuilt tinyipa would have been faster.07:01
mkrai_good morning rpioso etingof07:01
rpiosomkrai_: Good very early morning.07:02
mkrai_rpioso, :)07:02
* rpioso -> sleep07:03
*** zaneb has joined #openstack-ironic07:09
etingofmkrai_, o/07:17
*** samc-bbc has quit IRC07:18
*** NobodyCam has quit IRC07:18
*** trident has quit IRC07:18
*** jrist has quit IRC07:19
*** lifeless has quit IRC07:19
*** JayF has quit IRC07:19
*** ianw has quit IRC07:19
*** mjturek has quit IRC07:19
*** zigo has quit IRC07:19
*** rnoriega_ has quit IRC07:19
*** antonym has quit IRC07:19
*** brtknr has quit IRC07:19
etingofrpioso, I guess your devstack resides at a different L2 broadcast domain than your baremetal. In that case devstack's dhcpd won't be reachable. So to have your baremetal on the network you either have a DHCP responder nearby or engage in dhcp-less deploy testing. ;-)07:19
*** openstackstatus has quit IRC07:20
*** kiseok7 has joined #openstack-ironic07:23
*** hwoarang has quit IRC07:34
*** hwoarang_ has joined #openstack-ironic07:34
arne_wiebalckGood morning, ironic!07:47
szivianiGood morninr, Ironic :)07:58
*** jawad_axd has joined #openstack-ironic08:04
*** samc-bbc has joined #openstack-ironic08:05
*** NobodyCam has joined #openstack-ironic08:05
*** trident has joined #openstack-ironic08:05
*** jrist has joined #openstack-ironic08:05
*** lifeless has joined #openstack-ironic08:05
*** JayF has joined #openstack-ironic08:05
*** mjturek has joined #openstack-ironic08:05
*** ianw has joined #openstack-ironic08:05
*** zigo has joined #openstack-ironic08:05
*** rnoriega_ has joined #openstack-ironic08:05
*** antonym has joined #openstack-ironic08:05
*** brtknr has joined #openstack-ironic08:05
*** zzzeek has quit IRC08:08
*** zzzeek has joined #openstack-ironic08:11
*** tesseract has joined #openstack-ironic08:16
*** rpittau|afk is now known as rpittau08:28
rpittaugood morning ironic! o/08:28
rpittauTGIF!08:29
*** iurygregory has joined #openstack-ironic08:32
iurygregorygood morning o/08:32
rpittauhey iurygregory :)08:33
iurygregoryrpittau, o/08:33
*** dmellado has quit IRC08:34
*** dmellado has joined #openstack-ironic08:35
*** iurygregory_ has joined #openstack-ironic09:01
*** iurygregory has quit IRC09:03
*** khansa has joined #openstack-ironic09:03
*** rcernin_ has joined #openstack-ironic09:04
*** rcernin has quit IRC09:04
*** Lucas_Gray has joined #openstack-ironic09:13
*** lucasagomes has joined #openstack-ironic09:16
*** k_mouza has joined #openstack-ironic09:17
*** dougsz has joined #openstack-ironic09:18
*** Lucas_Gray has quit IRC09:28
*** Lucas_Gray has joined #openstack-ironic09:29
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: [DNM] Test CI  https://review.opendev.org/70304309:33
openstackgerritMerged openstack/ironic-ui stable/stein: Fix horizon dependency  https://review.opendev.org/70168609:36
*** derekh has joined #openstack-ironic09:36
*** ociuhandu has joined #openstack-ironic09:38
*** dougsz has quit IRC09:38
*** ociuhandu has quit IRC09:39
*** mkrai_ has quit IRC09:39
*** Lucas_Gray has quit IRC09:44
*** kaifeng has quit IRC09:54
*** alexmcleod has joined #openstack-ironic09:56
*** ociuhandu has joined #openstack-ironic10:00
*** Lucas_Gray has joined #openstack-ironic10:01
*** dtantsur|afk is now known as dtantsur10:06
dtantsurmorning ironic10:06
iurygregory_morning dtantsur10:08
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: Skip nic numa_node discovery if it's not assigned to a numa_node  https://review.opendev.org/70299010:15
yolandahi etingof10:18
etingofyolanda, o/10:18
yolandahttp://paste.openstack.org/show/788520/10:18
yolandathose are the last bits i get on the conductor log10:18
*** ociuhandu has quit IRC10:19
yolandafrom what i can see the return message of 2020-01-17 10:02:09.300 1 DEBUG sushy.connector [req-925faea9-6ee7-4c7b-ace1-f6f03dfa534d - - - - -] HTTP response for GET https://[fd35:919d:4042::1102]:443/redfish/v1/RegistryStore/registries/en/iLO.json: status code: 200 _op /usr/lib/python3.6/site-packages/sushy/connector.py:11610:19
yolandaare truncated10:19
yolandai tried that from command line but seems i get a binary..10:20
etingofyolanda, try curl -H "Accept: application/json" -H "Content-Type: application/json"10:23
yolandasame10:23
etingofto trick iLO into serving JSON10:23
yolandabut from the python logs seems it's extracting ok10:23
etingofyolanda, what's in the response headers? content-type-wise10:24
yolandacat header.txt10:25
yolandaHTTP/1.1 200 OK10:25
yolandaAllow: GET, HEAD10:25
yolandaCache-Control: no-cache10:25
yolandaContent-Encoding: gzip10:25
yolandaContent-type: application/json; charset=utf-810:25
yolandaDate: Fri, 17 Jan 2020 10:20:55 GMT10:25
yolandaETag: "3FB1CBCD"10:25
yolandaOData-Version: 4.010:25
yolandaTransfer-Encoding: chunked10:25
yolandaX-Frame-Options: sameorigin10:25
yolandaX_HP-CHRP-Service-Version: 1.0.310:25
yolandagzip...10:25
etingofso it it a gzipped json?10:25
etingofcurl ... | gzip -dc10:25
etingofperhaps curl -s10:26
yolandaok i can get the content10:26
etingof\o/10:26
etingof... | python -m json.tool10:27
yolandabig one, just a moment and i'll paste10:27
*** ociuhandu has joined #openstack-ironic10:28
*** ociuhandu has quit IRC10:29
* etingof imagines this fat json is getting pulled by ironic on power sync10:30
yolandahttps://paste.centos.org/view/73426d3210:32
yolandaand the error i get from ironic node is10:32
yolanda Failed to get power state for node xxx. Error: The attribute Messages/Description is missing from the resource /redfish/v1/RegistryStore/registries/en/iLO.json10:33
*** dougsz has joined #openstack-ironic10:34
yolandabut maybe due to that truncation that is seen in the logs?10:34
*** rcernin_ has quit IRC10:34
*** Lucas_Gray has quit IRC10:38
*** Lucas_Gray has joined #openstack-ironic10:42
mgoddardmkrai_: if you read this, see https://www.stackhpc.com/bare-metal-infiniband.html10:43
etingofyolanda, I am still looking into this JSON madness... my guess is that there is some inconsistency either in sushy models or iLO message registry10:44
yolandawhy is that json picked and being used?10:45
yolandawhen i look at logs, i see lots of json files like that being downloaded10:45
etingofright, that's the way how redfish is supposed to communicate BMC failures to the client10:46
*** ociuhandu has joined #openstack-ironic10:46
etingofBMC can fail in many curious ways, to describe at least some, they set up the context in anticipation of the upcoming failure10:47
yolandaso we fail in preparation of that context10:47
etingofironically, the failure happens in preparation to describing the failure10:48
etingofdo you already like IPMI better? ;)10:48
yolandacannot be due to that truncation ? or does it just truncates on logs?10:49
yolandai apologize for all the times i complained about ipmi :)10:49
etingofwell, JSON is not chunkable by definition. if you attempt to chunk/cut JSON, you should get parsing failure10:51
*** ociuhandu has quit IRC10:51
yolandayep, looking at the full logs, i see truncations in other places as well10:51
etingofrather than this schema inconsistency problem10:51
etingofso the good way to debug this is to take sushy in one hand, this iLO JSON into the other and merry these beasts10:52
etingofthey should explode in the same way as you observe under ironic10:52
etingofa hackerish workaround could be to flip True to False in here -- https://github.com/openstack/sushy/blob/master/sushy/resources/registry/message_registry.py#L2310:53
yolandamm look10:53
yolandahttps://paste.centos.org/view/73426d32#L610:53
yolandano Description there in the upper level10:54
yolandabut in other queries i have:10:54
yolandahttp://paste.openstack.org/show/788522/10:54
etingofyes, but it does not seem to be required by the schema...? -- https://redfish.dmtf.org/schemas/v1/MessageRegistry.v1_1_1.json10:54
yolandathere is a Description entry10:54
dtantsuretingof: why do we even make registries required?10:54
etingofdtantsur, because we are good citizens - I think that's what compliant redfish client has to do...10:55
dtantsurin an ideal world - yes...10:58
dtantsurgiven the reality of hardware, I think we should adopt the good old "be flexible with input and strict with output" motto10:58
*** Lucas_Gray has quit IRC10:59
etingofdtantsur, that means that schema violations would not be noticed so that sushy will explode later on unless we add some fuzziness to compensate for missing schema validation11:00
etingofyolanda, so I am looking at MessageRegistry.properties.Description - this field is not among required11:00
yolandaweird, why does it explode ?!11:01
dtantsuryou have a point there...11:01
etingofyolanda, that's curious because in sushy that field is not required either -- https://github.com/openstack/sushy/blob/master/sushy/resources/registry/message_registry.py#L6111:01
yolandaetingof, is that the schema being picked?11:01
etingofyolanda, supposedly, yes -- https://github.com/openstack/sushy/blob/master/sushy/resources/registry/message_registry.py#L1411:02
dtantsurso is it required or is it not in the end?11:03
* dtantsur is confused11:03
*** ociuhandu has joined #openstack-ironic11:03
yolandaindeed, confusing11:04
*** Lucas_Gray has joined #openstack-ironic11:04
etingofthere are two descriptions in the schema. one is required, the other is not11:04
yolandathe inner one is required, right?11:04
etingofyes11:04
yolandaah, then maybe some of those internal messages is missing a description?11:04
etingofI am suspicious about this definition though -- https://github.com/openstack/sushy/blob/master/sushy/resources/registry/message_registry.py#L8011:05
etingofwell, error message mentions 'Messages' object, not something inner11:05
yolandaso some of the entries inside Messages dictionary may be missing a Description...11:06
etingofyolanda, however, there are a lot of description-less messages in your paste -- https://paste.centos.org/view/73426d32#L123211:07
yolandathen that's the issue11:07
yolandabut that's what the hardware is giving...11:07
yolandaseems it doesn't honor the schema then11:08
etingofthey also seem to miss the required Severity field11:08
yolandaamazing11:08
etingofyeah, perhaps11:08
yolandadtantsur, what do you do in those cases? are you reporting the vendor somehow?11:08
etingofso we fail fast, what's the whole purpose of all these checks \o/11:08
yolandaall my boxes have the latest firmware11:09
dtantsurwell, in the ideal world we report to vendors and they fix it11:09
dtantsurin our world, in the unlikely event of a particular luck, you'll get new firmware in a few months11:09
dtantsurwhich means, we may have to hack around it...11:09
dtantsuretingof: to avoid getting relaxed with the schema, I'd simply fall back to NOT using registries11:10
dtantsurwith an ugly warning11:10
dtantsurafter all, understanding registries is not 100% required for a client, as far as I can get11:10
etingofyeah, perhaps that's a way out11:11
yolandado we have any point of contact for HPE redfish?11:11
etingofhowever I seem to recall that we wanted these registries so much when BIOS work was on the table...11:11
dtantsuryolanda: stendulker? (doesn't seem to be online)11:12
* dtantsur tries to remember11:12
dtantsuretingof: well, to me it's better to say "Error happened, we could not display the exact message because the registries implementation is non-compliant"11:13
dtantsurrather than outright refusing to work with the machine11:13
etingofarguably, dropping all registries because of a few malformed entries obscures the whole BMC reporting...11:13
dtantsuretingof: are only a few entries malformed?11:13
dtantsurthen we can probably skip them...11:14
* dtantsur senses an ML thread11:14
etingofabout a dozen according to my brain-resident JSON parser11:14
rpittaudtantsur: hey, sorry for change of context, I don't know if you saw this https://opendev.org/openstack/diskimage-builder/commit/ae2be0b464392256df7009f7030281963c06aa81 dib is broken for Centos 8 until upper-constraints is updated, and by consequence IPA-B CI11:14
dtantsurrpittau: yeah, I'm aware. There's nothing we can do but to wait :(11:14
rpittauok :/11:14
dtantsurThis blends... "nicely".. into the discussion I wanted to have about voting DIB jobs :(11:15
rpittau:D11:15
dtantsurit's even worse that it's not DIB's fault11:15
dtantsurwe can gate on DIB changes, we cannot gate on CentOS changing underneath11:15
rpittauyep, exactly11:15
rpittauthat change was subtle11:16
etingofskipping bad messages would be less harmful indeed, however sushy object model is not well-suited for that kind of constraint relaxation. it's currently all or nothing11:16
etingofbut I guess yolanda should have a way forward once True becomes False there...11:17
dtantsuretingof: well, it may boil down to one (optional) try..except in our list implementation?11:17
dtantsurhere https://opendev.org/openstack/sushy/src/branch/master/sushy/resources/base.py#L20911:18
etingofthat will affect all fields of that type in all JSON documents11:18
dtantsurwe can make it optional11:19
dtantsurlike ListField('Name', skip_broken_elements=True)11:19
dtantsuretingof: ^^11:20
etingofthat's a way, however it may lead to some duplication in definitions effectively making them context-specific... generally speaking11:23
dtantsurI'm not sure I get your comment11:23
dtantsurI don't quite envision any duplications..11:24
dtantsurshell I make a patch to show the approach?11:24
etingofe.g. if we presently have a single Message definition used everywhere, then we discover that in one particular document is can be broken we'd have to introduce another Message which is exactly the same but with this field flipped11:24
etingofyour proposal is clear to me11:25
dtantsuretingof: do we use Messages in contexts other than error reporting?11:25
dtantsurin other words, how safe is it to just change the Message definition for everything?11:26
*** ociuhandu_ has joined #openstack-ironic11:26
etingofI do not know that readily11:26
etingofI am just trying to evaluate the approach11:27
*** ociuhandu_ has quit IRC11:28
*** ociuhandu has quit IRC11:28
dtantsurokay, what other options do we have?11:28
etingofanother possible hack might be to default missing description11:28
*** ociuhandu has joined #openstack-ironic11:28
dtantsurdo we have a sane default for it?11:28
etingofdefault to some swearing of course11:28
dtantsur:D11:28
dtantsursigh, I'm so sad we cannot do it11:29
yolandabut etingof , you mentioned another field not being honored right, not just Description11:29
etingofthanks to OEM, we can even expand vendor IDs there11:29
dtantsur++11:29
dtantsurdo we have a default Severity?11:29
etingofyeah, that's my impression that Severity is required by the schema11:30
etingofperhaps - low to minimize the impact11:30
dtantsurit's a very valid impression, without Severity we cannot even distinguish errors from success11:30
dtantsurmmm, judging by the code it's more of Ok, Warning, Error, etc11:30
dtantsurOk, Warning, Critical, to be precise. if so, there's no default.11:31
etingofof course, not. may be we can add "warning" as a default in case it's missing... heh11:32
dtantsurthis ^^ will not work well for BIOS, will it? we need to detect errors there.11:32
etingofsure, but the alternative is to drop the entire message(s) if Severity is not there11:33
dtantsurwe could default to some Unknown severity. then if we actually see a record referencing it, we raise an error.11:33
dtantsurmmm, I don't explain it well, I guess...11:33
etingofI got it I think11:33
dtantsurI mean, we do parse the registries, we accept Severity==None. But if we get a message referencing it, we raise an error, mentioning both the message and the fact that severity is unknown.11:34
etingofyes, how is it different from having Severity-Critical?11:34
dtantsuran additional message that we could not parse the severity?11:35
dtantsurso that we don't end up with "Error: operation ended successfully" :)11:35
*** jawad_axd has quit IRC11:35
*** Lucas_Gray has quit IRC11:35
etingofyeah, alternatively, we could add something to Description... ;)11:35
etingof"Error: operation ended successfully. Replace your vendor and hit any key..."11:36
yolandago back to IPMI!11:36
dtantsur:D11:36
dtantsur:D :D :D11:36
dtantsur"Error: computers were a mistake, go do some real life fishing instead"11:37
etingofso how critical is this for yolanda to get working?11:37
*** Lucas_Gray has joined #openstack-ironic11:38
etingofI mean, would a local hack suffice for the time being?11:38
yolandait is critical as the boxes don't start . But i can go with a local hack11:40
etingofI can probably propose some official hackaround as discussed here as time permits11:42
dtantsuretingof: it would be great. If new HPE boxes don't work at all... it's quite a priority.11:44
* dtantsur will review11:44
etingofsure11:45
dtantsurthanks!11:45
* etingof is presently busy telling the world how Redfish is better than IPMI11:45
openstackgerritRiccardo Pittau proposed openstack/ironic-inspector master: [WIP] use openstacksdk for ironic module  https://review.opendev.org/67217911:50
*** pcaruana has joined #openstack-ironic11:59
openstackgerritDmitry Tantsur proposed openstack/ironic-inspector stable/train: Respect driver_info.force_persistent_boot_device  https://review.opendev.org/70306212:02
yolandaetingof, don't mention the schema issues then!12:09
* etingof is not sure what yolanda means here12:10
*** jawad_axd has joined #openstack-ironic12:10
etingofah, regarding redfish superiority?!12:10
*** dsneddon has quit IRC12:12
*** mkrai_ has joined #openstack-ironic12:13
dtantsurhehe12:13
dtantsur"Redfish works awesome.. when YOU implement it RIGHT!!"12:14
* etingof can's resist reminding dtantsur of managers<->virtual media feature12:15
dtantsurdon't remind me, I still don't like it :)12:15
*** ociuhandu has quit IRC12:23
*** quoth has joined #openstack-ironic12:23
*** Lucas_Gray has quit IRC12:24
*** Lucas_Gray has joined #openstack-ironic12:26
quothIs there a current list of known good host OS's for installing bifrost to? I have tried CentOS today but pip is failing to install python-ironicclient because more_itertools doesn't support python 2 anymore. So I also tried to switch to python3 but that is failing because the ansible playbooks are trying to install python2 libs since it is CentOS 712:31
quoth* I have tried CentOS 7 ..12:31
dtantsurquoth: which version of bifrost are you installing? Train was the last to support Python 2.12:36
quothI have hit the issue using both the stable/stein and stable/train branches12:36
dtantsurhmmm12:36
dtantsurquoth: these are supposed to work with python 2. could you show us the exact error you're hitting (feel free to use paste.openstack.org)12:37
dtantsurmore-itertools seems properly constrained https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L491-L49512:38
quothhttp://paste.openstack.org/raw/788530/12:38
quothThat is the output from the failing ansible task12:39
dtantsurOUCH https://github.com/openstack/bifrost/blob/e2a919586272946ca081b597014be86d370ceff8/playbooks/roles/bifrost-ironic-install/tasks/install.yml#L90-L9112:39
*** iurygregory_ is now known as iurygregory12:40
dtantsurTheJulia: ^^^12:40
*** dmellado has quit IRC12:41
dtantsurquoth: so, it's a legitimate issue. I wonder if you can work around it by setting ironicclient_source_install to true.12:44
dtantsuranswering myself: no, probably not12:44
*** dmellado has joined #openstack-ironic12:44
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Use upper-constraints for ironicclient and sushy  https://review.opendev.org/70306912:47
dtantsurquoth: try this patch ^^^ let me know if it works please12:47
quothdtantsur: Will do. I need to head out of the office for a while but I will try the patch this afternoon and let you know12:47
quoththanks12:47
dtantsurcool12:47
*** dsneddon has joined #openstack-ironic12:48
*** rh-jelabarre has joined #openstack-ironic12:51
mkrai_Hi, have anyone tried running infiniband with ironic?12:53
mkrai_I am facing issue where cloud-init fails to configure network interfaces on the node because of the fake mac address of IB port12:55
*** jdandrea has joined #openstack-ironic12:55
*** dsneddon has quit IRC12:56
*** ociuhandu has joined #openstack-ironic12:57
*** jdandrea has quit IRC12:57
*** ociuhandu has quit IRC13:03
*** dsneddon has joined #openstack-ironic13:06
*** mmethot has quit IRC13:08
* rpittau needs more coffee13:13
*** mkrai_ has quit IRC13:19
*** dougsz has quit IRC13:22
*** ricolin has joined #openstack-ironic13:30
*** Lucas_Gray has quit IRC13:31
*** derekh has quit IRC13:32
arne_wiebalckrpittau: dtantsur TheJulia On (manual, ie. recurring) inspection and inventory: from what I see, there are no means at the moment to collect a time series of inspection data. New data for a node simply overwrites old data. We can solve this on the backend with object versioning, but then access to this data also becomes backend specific (and different from accessing the latest data).13:32
arne_wiebalckWould it make sense to consider to make the inspector more sophisticated when storing data into its backend?13:33
arne_wiebalckHaving a time series would be neat to track changes, such as serial numbers or f/w versions.13:34
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Use variables for ssh paths  https://review.opendev.org/69765413:39
*** kozhukalov has joined #openstack-ironic13:39
dtantsurarne_wiebalck: this sounds interesting. I'd read an RFE on that. My first concern would be garbage collection, especially when used with the DB backend.13:41
arne_wiebalckdtantsur: sth to discuss at the mid cycle maybe?13:42
rpittauarne_wiebalck: probably an interesting discussion for the mid cycle, yeah13:43
*** pcaruana has quit IRC13:45
rpittaummmm review.opendev.org is not working for me13:45
rpittauoh nvm, it came back13:46
yolandahi etingof , i'm getting this now : Failed to get power state for node 312a7e06-79ed-412b-93af-b5a5154de71d. Error: Redfish exception occurred. Error: Resource https://[xxxx]:443/redfish/v1/Systems/System.Embedded.1 not found13:48
yolandahow can i know the url to use?13:48
yolandamm seems it's /redfish/v1/Systems/1/ . Does it change depending on vendor?13:52
*** mkrai_ has joined #openstack-ironic13:53
dtantsurarne_wiebalck: good idea13:57
arne_wiebalckrpittau: dtantsur thanks, I'll add this to the etherpad13:57
dtantsur++13:57
etingofyolanda, it is up to the vendors to enumerate their systems13:58
*** rloo has joined #openstack-ironic13:58
etingofyolanda, the name can be anything, but it obviously needs to be consistent link-wise13:58
etingofyolanda, so if the official name is /redfish/v1/Systems/1 that's alright, but then it should be '1' everywhere else or BMC should be able to accept non-canonical names as well13:59
etingofyolanda, however, may be that '1' is coming from your node config rather than from some hyperlink?14:02
*** derekh has joined #openstack-ironic14:02
etingofs/1/System.Embedded.1/14:03
etingofyou should have /redfish/v1/Systems/System.Embedded.1 in your ironic driver_info14:03
TheJuliagood morning14:03
etingofgood morning, TheJulia o/14:04
TheJuliadtantsur: for python-ironicclient, we likely can now apply constraints14:04
dtantsurTheJulia: cool, see https://review.opendev.org/#/c/703069/ (and the concern rpittau voiced)14:05
patchbotpatch 703069 - bifrost - Use upper-constraints for ironicclient and sushy - 1 patch set14:05
dtantsurand good morning :)14:05
rpittaugood morning TheJulia :)14:05
TheJuliadtantsur: should be fine now, the ansible stuff doesn't even use python-ironicclient anymore14:05
dtantsurI'll propose a train backport to see it on a working CI14:05
openstackgerritDmitry Tantsur proposed openstack/bifrost stable/train: Use upper-constraints for ironicclient and sushy  https://review.opendev.org/70308614:06
yolandaetingof, i checked /redfish/v1/systems and i got : {"@odata.context":"/redfish/v1/$metadata#ComputerSystemCollection.ComputerSystemCollection","@odata.etag":"W/\"AA6D42B0\"","@odata.id":"/redfish/v1/Systems/","@odata.type":"#ComputerSystemCollection.ComputerSystemCollection","Description":"Computer Systems view","Name":"Computer Systems","Members":[{"@odata.id":"/redfish/v1/Systems/1/"}],"Members@odata.count":1}14:12
etingofso it seems '1' is the canonical name14:13
*** dougsz has joined #openstack-ironic14:13
etingofthen you should probably have it in your driver_info, however the question is where System.Embedded.1 is coming from?14:14
yolandai think i copied that from derekh14:14
etingofah, perhaps Dell does not mix well with HP!14:14
*** ociuhandu has joined #openstack-ironic14:14
derekhetingof: ya, I got it from your Dell notes14:15
yolandathat url allowed me to progress a bit more...14:15
yolandamm now14:16
yolanda| last_error             | Failed to prepare to deploy: Redfish exception occurred. Error: Setting boot mode to uefi failed for node 9d2c305e-4753-4a06-8e70-f1affd6f6a67. Error: The parameter "target" value "None" is invalid. Valid values are: {'utilities', 'diags', 'usb', 'hdd', 'pxe', 'uefi shell', 'cd', 'none', 'bios setup'}14:16
yolandaderekh, you know? uefi shell?14:16
*** hjensas has quit IRC14:19
etingofyolanda, this is coming from ironic... when it tries to set both boot mode and boot device at once (because Redfish). seems like boot device is somehow missing...14:19
*** k_mouza has quit IRC14:20
* derekh is glad etingof had an answer14:20
*** k_mouza has joined #openstack-ironic14:20
yolandado i need to instruct to use boot device somehow?14:21
etingofnot really, iirc it should be taken from the currently set boot device and applied back (together with the new boot mode)14:21
etingoflet me dig into the scary depths of that code14:22
yolandamm i think this machine is set to bios boot, not uefi. Can it be a problem?14:22
yolandabut that's the point of that code right? changing the boot mode....14:22
*** pcaruana has joined #openstack-ironic14:22
etingofyes, ironic tried to change boot mode14:23
etingofbtw, if you set the node to uefi by hand, chances are that would get around that error14:23
yolandacheating!14:24
yolandabut i prefer to cheat :)14:24
* etingof is just back from fishing with this trophy -- https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/redfish/management.py#L21514:25
openstackgerritMerged openstack/ironic-python-agent master: Skip nic numa_node discovery if it's not assigned to a numa_node  https://review.opendev.org/70299014:26
etingofI think `target` is None because boot device is not set in the Systems/1 document14:27
*** ociuhandu has quit IRC14:27
yolandalet me check that output14:27
yolandaseems HPE is not behaving so well with that documents...14:27
*** mkrai_ has quit IRC14:28
etingofso may be if you get your node reporting somehow reporting any boot device via redfish system object, that would get you to the next problem14:28
dtantsuretingof: oh, have you seen https://bugzilla.redhat.com/show_bug.cgi?id=1791392? Looks quite similar to what yolanda saw.14:29
openstackbugzilla.redhat.com bug 1791392 in rhosp-director "Redfish PM driver not working with Supermicro" [Unspecified,New] - Assigned to rhos-maint14:29
TheJuliaI wonder if the hardware is defaulted so setting boot mode gets weird14:29
etingofdtantsur, I think HP made it a bit further than Supermicro - the latter misses the top-level attribute14:30
yolandahttps://paste.centos.org/view/93c7c359#L114:30
dtantsuretingof: lovely...14:30
dtantsurwe have to start being more relaxed about it indeed14:31
yolandaso that's the content i get from Systems/1 ... does it help ?14:31
*** mkrai_ has joined #openstack-ironic14:32
etingofyolanda, yes, hold on14:32
*** ociuhandu has joined #openstack-ironic14:33
dtantsuretingof: I put the bug on your plate as well, it can probably be fixed in the same patch..14:33
yolandaetingof, i'm going to be your nightmare today :)14:34
yolandagoing for lunch14:34
etingofyolanda, do you have the PATCH call in ironic debug log that leads to this failure?14:35
*** mmethot has joined #openstack-ironic14:35
*** aedc has joined #openstack-ironic14:36
etingofyou will be competing with jsonschema in my nightmares14:36
*** ociuhandu has quit IRC14:37
dtantsur"the schema of my nightmares"14:38
*** ociuhandu has joined #openstack-ironic14:38
TheJuliadtantsur: I remember arguments about that, but yeah, definitely need to :\14:48
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Use upper-constraints for ironicclient, sushy and DIB  https://review.opendev.org/70306914:51
dtantsurTheJulia, rpittau, borrowed the hack that I'm using in the metalsmith CI ^^^14:51
* dtantsur updates the train patch to test it14:51
openstackgerritDmitry Tantsur proposed openstack/bifrost stable/train: Use upper-constraints for ironicclient, sushy and DIB  https://review.opendev.org/70308614:52
*** mkrai_ has quit IRC14:52
*** jdandrea has joined #openstack-ironic14:53
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent stable/train: Skip nic numa_node discovery if it's not assigned to a numa_node  https://review.opendev.org/70309614:54
*** TxGirlGeek has joined #openstack-ironic14:55
*** aedc has quit IRC14:55
yolandaetingof, let me see logs14:57
*** dougsz has quit IRC14:58
yolandawhere should i see that? i don't see anything relevant on conductor, just lots of calls to /Systems/1 url14:59
yolandai searched conductor logs for PATCH and cannot see anything14:59
etingofthere should be PATCH against Systems/115:00
etingofalright then15:00
yolandait may not be logged ... just GET calls15:00
etingofright, yes15:00
yolandalooking at the paste... there doesn't seem to exist the uefi mode15:02
etingofyolanda, I think the failure comes from here -- https://github.com/openstack/sushy/blob/master/sushy/resources/system/system.py#L22915:02
yolandajust15:02
yolanda"BootSourceOverrideTarget": "None", "BootSourceOverrideTarget@Redfish.AllowableValues": ["None", "Cd", "Hdd", "Usb", "Utilities", "Diags", "BiosSetup", "Pxe", "UefiShell"]}15:02
etingofthat's not about boot mode, but about non-default boot device15:03
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: WIP - Native zuulv3 grenade job for ironic  https://review.opendev.org/70309815:04
*** ociuhandu has quit IRC15:04
etingofyolanda, let me debug sushy against your json15:04
*** jawad_axd has quit IRC15:05
yolandawhat's the key for default boot device? looking at sushy mappings but cannot see it15:05
etingofyolanda, here you go -- https://github.com/openstack/sushy/blob/master/sushy/resources/system/constants.py#L7715:07
yolandai have that on my paste ... "BootSourceOverrideTarget": "None",15:07
*** jawad_axd has joined #openstack-ironic15:08
etingofyes, that makes me suspect sushy bug. but let me debug it, I do not see what's wrong so far15:08
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Use upper-constraints for ironicclient, sushy and DIB  https://review.opendev.org/70306915:12
openstackgerritDmitry Tantsur proposed openstack/bifrost stable/train: Use upper-constraints for ironicclient, sushy and DIB  https://review.opendev.org/70308615:13
* dtantsur cannot ansible, send help15:13
*** jawad_ax_ has joined #openstack-ironic15:13
*** jawad_axd has quit IRC15:13
* rpittau needs much more coffee15:13
* TheJulia appears with her ears in conference calls15:13
*** hwoarang_ is now known as hwoarang15:16
*** jawad_ax_ has quit IRC15:18
etingofyolanda, are you running tips of ironic/sushy master branches?15:19
yolandaeverything is master, i built the image locally15:20
*** kozhukalov has quit IRC15:23
etingofyolanda, ack, on it15:24
yolandacool thx15:24
*** dougsz has joined #openstack-ironic15:26
etingofyolanda, the bug is here (do not look, it's too weird for a sane human being) -- https://github.com/openstack/sushy/blob/master/sushy/resources/base.py#L10915:29
*** mkrai_ has joined #openstack-ironic15:29
quothdtantsur: Was going to say I tried the patch for bifrost with no luck but I see from above you are uploading more patches for the issue so I shall keep an eye on them.15:29
etingofeffectively, this 'None' literal from JSON document gets mixed up with Python 'None' type representation not normalized as it should15:29
etingoftl;dr; sushy does not work well with anything 'None'15:30
etingofyolanda, could you please set you machine to boot from anything other than None?15:30
*** ociuhandu has joined #openstack-ironic15:31
*** ociuhandu has quit IRC15:32
*** ociuhandu has joined #openstack-ironic15:32
yolandadoh! what a bug15:34
yolandaok i'll do15:35
yolandamm my boot settings are boot from legacy bios15:38
yolandaand then in server boot order i have cd/dvd, usb, hard disk, network device15:38
yolandai can try changing from bios to uefi15:39
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Use upper-constraints for ironicclient, sushy and DIB  https://review.opendev.org/70306915:41
etingofyolanda, actually, I am suggesting that you have BootOverrideTarget set to anything other than None15:41
openstackgerritDmitry Tantsur proposed openstack/bifrost stable/train: Use upper-constraints for ironicclient, sushy and DIB  https://review.opendev.org/70308615:42
etingofalternatively, you can avoid this whole code path by setting your node to uefi15:42
dtantsurquoth: yeah, I could not make it right from the first attempt. Getting there though.15:42
etingofso you have a variety of cheating opportunities15:43
yolandaetingof, i was looking at the ilo 5 web... BootOverrideTarget is one time boot? not sure where i should set it15:43
yolandai need to step out for a while, bbl15:45
*** mkrai_ has quit IRC15:50
etingofyolanda, it is only one-time if BootSourceOverrideMode=Once, otherwise it's forever15:50
*** aedc has joined #openstack-ironic15:52
*** TxGirlGeek has quit IRC15:53
*** jawad_axd has joined #openstack-ironic15:54
*** jawad_axd has quit IRC15:59
*** jawad_axd has joined #openstack-ironic16:15
*** TxGirlGeek has joined #openstack-ironic16:19
*** jawad_axd has quit IRC16:19
etingofyolanda, from redfish perspective, BootOverrideTarget setting overrides "main" boot device which is configured somewhere else, perhaps in BIOS/nvram. I feel that this booting business is complicated, may be that explains the cascading of these settings...16:24
*** belmoreira has joined #openstack-ironic16:24
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Use upper-constraints for ironicclient, sushy and DIB  https://review.opendev.org/70306916:25
openstackgerritDmitry Tantsur proposed openstack/bifrost stable/train: Use upper-constraints for ironicclient, sushy and DIB  https://review.opendev.org/70308616:26
dtantsurThe hacks are piling up :(16:26
*** gyee has joined #openstack-ironic16:27
TheJulia:(16:29
etingofon the other hand, genetically speaking, we are piles of hacks and workarounds16:30
dtantsurwe are for sure16:30
dtantsurcomputers are getting close though16:30
dtantsurTheJulia: does the current version look at least remotely acceptable? (I'm not yet sure if it works)16:31
TheJuliadtantsur: looking16:42
rpittaudtantsur: I was going to say, if you change the extra_args logic, you need to change it everywhere16:42
TheJulianot 1000% sure, but I _think_ so16:43
dtantsurrpittau: not necessary, this part is only used for ironic installation16:43
dtantsurotherwise this patch is going to blow up16:43
TheJuliacp pip_install.yml ../.../bifrost-keystone-install/tasks/16:43
dtantsurideally, yes. practically we seem to only have problem with ironicclient16:43
rpittaudtantsur: oh yeah, my bad, I mean everywhere you use pip_install.yaml16:43
dtantsursince we'll have to backport this patch all the way, I'd prefer to minimize the scope of it16:44
dtantsurrpittau: what exactly place do you have in mind?16:44
dtantsur(my only concern now is ansible scoping rules and extra_args bleeding all over the place)16:45
rpittaudtantsur: that exact file :) my comment is old, I think it should work like that16:45
dtantsurah16:45
*** goldyfruit has joined #openstack-ironic16:45
goldyfruitHi guys16:46
TheJuliao/ long time no see16:46
TheJuliagoldyfruit: hope things are well16:46
dtantsurgoldyfruit: o/16:46
goldyfruitTheJulia all good! I'm working for IBM now16:46
goldyfruitRed Hat -> Ormuco -> IBM16:46
TheJuliagoldyfruit: welcome to the fold...16:47
goldyfruitKind of back to Red Hat ? :p16:47
TheJuliaKind of... does that mean you get purple shirts?16:47
* TheJulia is actually wearing a purple RH shirt this morning16:47
goldyfruitThere are not there yet I guess :p16:47
dtantsur:D16:47
goldyfruitI have a question about fast-track, I found the RFE but I'm not sure to understand what is used for. Could you guys could give me some light on it, please?16:49
TheJuliaHeh, I need to look at a bug about it today16:50
TheJuliaso the idea with fast track is to allow an operator to choose to let their ironic deployment move machines between certain states where we know we likely don't really need to power down.16:50
TheJuliaso If cleaning and provisioning network are the same, then fast track would allow the node to be left powered on with the agent heartbeating such that the deploy could start upon the next heartbeat and we don't need to wait for the power-on self test to complete16:51
rpittaubye all, have a nice weekend! o/16:53
*** rpittau is now known as rpittau|afk16:53
goldyfruitTheJulia so basically the cleaning and the provisioning will appends on the same power-on cycle ?16:53
dtantsurand inspection, if used16:54
goldyfruitOh!!!16:54
TheJuliaDid we do inspection too?16:54
TheJuliaThis might be why my last fix didn't take care of it!16:54
TheJuliagoldyfruit: great timing!16:54
dtantsurTheJulia: I think so? It requires some configuration, but is doable in theory.16:55
goldyfruitThat will save me some time on Dell and HPE which are pretty long to boot due the BIOS post blablablabla16:55
dtantsurgoldyfruit: here goes my regular complaint that vendors don't provide such thing as "hot reboot".16:55
dtantsurwould be life-changing for ironic16:55
TheJulia++++16:55
goldyfruitI agree!16:56
goldyfruitThanks for the light guys!16:56
TheJuliagoldyfruit: so long story, abbreviated, there may be bugs there. We did it for the standalone use case really and... yeah.16:56
dtantsur:)16:56
TheJuliabut it is also increadibly simple16:57
dtantsurthere'll be bugs until people try it and we fix it :)16:57
TheJuliaexactly16:57
TheJuliaother use patterns that we never saw since things can vary so much16:57
dtantsuron this positive note, I need to go enjoy the queues in the Friday evening supermarket :)16:57
dtantsurhave a wonderful weekend16:57
*** dtantsur is now known as dtantsur|afk16:58
TheJuliadtantsur: enjoy!16:58
goldyfruitdtantsur|afk o/16:58
* etingof thinks that you guys underestimate the significance of a healthy reboot for the whole world not to fall apart16:58
*** quoth has left #openstack-ironic16:58
* dtantsur|afk removes standby functionality from etingof's laptop and leaves16:58
TheJulia++16:58
* TheJulia wonders if that removal was just a change to suspend to disk16:59
*** lucasagomes has quit IRC16:59
iurygregoryTheJulia, can you put https://review.opendev.org/#/c/696914/ on your list? *-*16:59
patchbotpatch 696914 - ironic-python-agent - Avoid grub2-install when on UEFI boot mode - 16 patch sets16:59
TheJuliaiurygregory: I think it already is on my list16:59
TheJuliaiurygregory: Haven't looked yet today though... early morning meeting prep and meetings \o/17:00
iurygregorycoffee first!17:00
iurygregory=D17:00
*** dougsz has quit IRC17:04
TheJuliawell, I coffeeed now email and17:04
TheJuliawow... I just noticed the time17:04
*** alexmcleod has quit IRC17:05
TheJuliasadly bigpulse does not provide insight into the data as a user :)17:06
*** goldyfruit has quit IRC17:10
*** goldyfruit has joined #openstack-ironic17:11
arne_wiebalckbye everyone o/17:21
*** ociuhandu_ has joined #openstack-ironic17:25
*** ociuhandu has quit IRC17:27
*** ociuhandu_ has quit IRC17:29
*** k_mouza has quit IRC17:32
*** aedc has quit IRC17:32
etingofthe wonders of caffeinated brainpower -- https://review.opendev.org/70313317:35
patchbotpatch 703133 - nova - [WIP] Add JSON schema for network_data.json - 1 patch set17:35
* etingof is wondering if some sort of unit testing would be proper?17:35
*** afasano has quit IRC17:47
openstackgerritkhansa proposed openstack/sushy-cli master: Update toxi.ini file  https://review.opendev.org/70313917:48
*** afasano has joined #openstack-ironic17:48
TheJuliaetingof: most likely just that data gets passed through17:49
etingofthere are tools that can generate data samples based on the schema17:50
etingofso we can take these samples and wrap into a unitest runner17:50
TheJuliayeah, but is the data being massaged anywhere the nova.virt.ironic.* code paths?17:50
TheJuliabecause if not, doing full schema seems... like overkill17:51
*** khansa has quit IRC17:51
*** khansa has joined #openstack-ironic17:51
etingofthis schema covers exactly the things Nova can produce (minus IPv6, I run out of coffee to finish that off)17:52
*** khansa has quit IRC17:56
TheJuliaetingof: yolanda: I _feel_ like the translation registry entry should be optional, but I might be completely off my rocking chair17:58
*** aedc has joined #openstack-ironic17:59
*** derekh has quit IRC18:00
etingofwhat exactly do you mean by 'translation registry entry'? that missing 'description' attribute?18:00
*** ociuhandu has joined #openstack-ironic18:03
*** aedc has quit IRC18:06
*** tenbrae has joined #openstack-ironic18:08
TheJuliarpioso: etingof: w/r/t not getting a dhcp not working, is there other interfaces on the tinycore machine? i.e. the lack of drivers issue that I think has forced different ipa images in prior testing.18:13
*** ociuhandu has quit IRC18:18
*** ociuhandu has joined #openstack-ironic18:18
*** ociuhandu has quit IRC18:19
*** ociuhandu has joined #openstack-ironic18:20
*** ociuhandu has quit IRC18:21
*** ociuhandu has joined #openstack-ironic18:21
*** afasano has quit IRC18:25
*** ociuhandu has quit IRC18:26
*** k_mouza has joined #openstack-ironic18:41
*** bnemec has joined #openstack-ironic18:44
*** bnemec is now known as beekneemech18:45
*** k_mouza has quit IRC18:46
*** ociuhandu has joined #openstack-ironic18:46
*** pcaruana has quit IRC18:51
*** ociuhandu has quit IRC18:52
*** jawad_axd has joined #openstack-ironic18:53
*** jawad_axd has quit IRC18:58
*** jawad_axd has joined #openstack-ironic19:13
openstackgerritJulia Kreger proposed openstack/ironic master: Fix entry paths for cleaning and deployment  https://review.opendev.org/70316019:16
*** jawad_axd has quit IRC19:18
*** TxGirlGeek has quit IRC19:25
*** TxGirlGeek has joined #openstack-ironic19:26
*** TxGirlGeek has quit IRC19:27
*** TxGirlGeek has joined #openstack-ironic19:28
*** ociuhandu has joined #openstack-ironic19:30
*** tesseract has quit IRC19:32
*** k_mouza has joined #openstack-ironic19:33
*** jawad_axd has joined #openstack-ironic19:34
*** ociuhandu has quit IRC19:35
*** k_mouza has quit IRC19:38
*** jawad_axd has quit IRC19:38
TheJuliaTaking wife to lunch and then an errand, bbl19:46
*** belmoreira has quit IRC19:49
*** aedc has joined #openstack-ironic19:52
*** jawad_axd has joined #openstack-ironic19:55
*** TxGirlGeek has quit IRC19:57
*** TxGirlGeek has joined #openstack-ironic19:58
*** jawad_axd has quit IRC20:00
*** TxGirlGeek has quit IRC20:00
*** openstackstatus has joined #openstack-ironic20:01
*** ChanServ sets mode: +v openstackstatus20:01
*** TxGirlGeek has joined #openstack-ironic20:02
*** TxGirlGeek has quit IRC20:03
*** TxGirlGeek has joined #openstack-ironic20:03
*** jtomasek has quit IRC20:03
etingofcongrats to TheJulia on the election results! \o/20:10
*** jawad_axd has joined #openstack-ironic20:21
*** jawad_axd has quit IRC20:25
*** aedc has quit IRC20:26
*** rh-jelabarre has quit IRC20:36
*** aedc has joined #openstack-ironic20:36
*** belmoreira has joined #openstack-ironic20:38
*** belmoreira has quit IRC20:38
*** jawad_axd has joined #openstack-ironic20:42
*** jawad_axd has quit IRC20:46
*** ociuhandu has joined #openstack-ironic20:46
*** ociuhandu has quit IRC20:48
*** ociuhandu has joined #openstack-ironic20:48
*** mmethot has quit IRC20:51
*** jawad_axd has joined #openstack-ironic21:02
*** ociuhandu has quit IRC21:03
*** ociuhandu has joined #openstack-ironic21:04
*** jawad_axd has quit IRC21:07
*** hwoarang has quit IRC21:09
*** ociuhandu has quit IRC21:13
*** hwoarang has joined #openstack-ironic21:15
*** jawad_axd has joined #openstack-ironic21:23
*** goldyfruit has quit IRC21:23
*** jawad_axd has quit IRC21:27
*** aedc has quit IRC21:42
*** ociuhandu has joined #openstack-ironic21:44
*** jawad_axd has joined #openstack-ironic21:44
*** ociuhandu has quit IRC21:48
*** jawad_axd has quit IRC21:49
*** kozhukalov has joined #openstack-ironic22:00
*** mmethot has joined #openstack-ironic22:01
*** jawad_axd has joined #openstack-ironic22:04
*** jawad_axd has quit IRC22:09
*** TxGirlGeek has quit IRC22:20
*** jawad_axd has joined #openstack-ironic22:25
*** jawad_axd has quit IRC22:30
*** rh-jelabarre has joined #openstack-ironic22:33
openstackgerritDmitry Tantsur proposed openstack/ironic master: DNM try further reducing RAM in DIB jobs  https://review.opendev.org/70270222:34
*** ociuhandu has joined #openstack-ironic22:35
*** ociuhandu has quit IRC22:40
*** jawad_axd has joined #openstack-ironic22:46
*** jawad_axd has quit IRC22:50
*** jawad_axd has joined #openstack-ironic23:07
*** jawad_axd has quit IRC23:12
*** kozhukalov has quit IRC23:13
*** rh-jelabarre has quit IRC23:27
*** jawad_axd has joined #openstack-ironic23:27
*** jawad_axd has quit IRC23:32
*** hwoarang has quit IRC23:33
*** k_mouza has joined #openstack-ironic23:34
*** hwoarang has joined #openstack-ironic23:34
*** k_mouza has quit IRC23:39
*** jawad_axd has joined #openstack-ironic23:48
*** jawad_axd has quit IRC23:53
*** rcernin_ has joined #openstack-ironic23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!