| *** zer0c00l has joined #openstack-ironic | 00:34 | |
| *** goldyfruit___ has quit IRC | 01:17 | |
| *** jawad_axd has joined #openstack-ironic | 01:21 | |
| *** kaifeng|afk is now known as kaifeng | 01:21 | |
| *** jawad_axd has quit IRC | 01:26 | |
| *** igordc has quit IRC | 01:42 | |
| *** jawad_axd has joined #openstack-ironic | 01:42 | |
| *** jawad_axd has quit IRC | 01:47 | |
| *** jawad_axd has joined #openstack-ironic | 02:03 | |
| *** jawad_axd has quit IRC | 02:07 | |
| rpioso | etingof, TheJulia: devstack deployment on dedicated Ubuntu Bionic VM is failing. Keystone is erroring out. ^^^ Any suggestions? | 02:14 |
|---|---|---|
| TheJulia | rpioso: is mysql being pre-installed? | 02:15 |
| TheJulia | oh, /opt/stack/devstack, not /opt/stack/git | 02:16 |
| TheJulia | /opt/stack/git is a old location for clone caches | 02:16 |
| TheJulia | I always do /opt/stack/devstack, move my local.conf into it, and deploy from there. | 02:16 |
| rpioso | I tried /opt/stack/devstack, too. Same failure. | 02:17 |
| rpioso | That’s what I’m doing, too :-) | 02:17 |
| rpioso | I don’t know if mysql was pre-installed. I’ll check that. Should it be? | 02:19 |
| TheJulia | rpioso: no, let it install it | 02:27 |
| TheJulia | what is your current working directly when you run stack.sh? | 02:27 |
| TheJulia | and just to confirm, local.cf is in that same folder? | 02:28 |
| TheJulia | err, local.conf | 02:28 |
| rpioso | If memory serves, I installed the Bionic server distribution. If that installed mysql, should I apt uninstall it? | 02:29 |
| rpioso | cwd is /opt/stack/devstack | 02:30 |
| rpioso | And local.conf is in that directory. | 02:30 |
| rpioso | The other strange thing is that the deploy prompts me for passwords which are set in local.conf. | 02:31 |
| rpioso | Before devstack deploy, I had created a root account with a password. Could that be the cause? | 02:32 |
| *** tzumainn has quit IRC | 02:33 | |
| *** igordc has joined #openstack-ironic | 02:45 | |
| rpioso | TheJulia: It doesn't seem mysql was previously installed. | 02:47 |
| kaifeng | rpioso: I can't remember last time I deployed a devstack :( but what user do you use to execute the stack.sh? | 03:15 |
| rpioso | kaifeng: stack :-) | 03:15 |
| kaifeng | for what I know, ubuntu prohibits root access to mysql, so mysql -u root can't get you in, while sudo mysql can. | 03:16 |
| kaifeng | well, have you tried to enter mysql with the stack user? | 03:17 |
| TheJulia | I suspect part of the problem may also be that if it is pre-installed at all, devstack can't set credentials | 03:25 |
| rpioso | TheJulia: mysql was not preinstalled. | 03:25 |
| rpioso | kaifeng: I haven't tried that, yet. I just kicked off another devstack deploy. I'll try that after it inevitably fails. | 03:27 |
| rpioso | kaifeng: Are you suggesting the devstack deploy scripting needs to change for Ubuntu? Or is there a config knob available? | 03:28 |
| kaifeng | rpioso: haven't deployed devstack in ubuntu server though, i believe there are differences. | 03:28 |
| * rpioso thought Ubuntu Bionic was the current thing | 03:29 | |
| TheJulia | rpioso: I was using bionic last week | 03:29 |
| TheJulia | but not the server, desktop I believe | 03:29 |
| TheJulia | CI is the cloud image I believe | 03:30 |
| rpioso | TheJulia: Oh, the desktop! Hrm ... Does the desktop install a root user? I believe the server install didn't. And, again, the server install did not install mysql. | 03:31 |
| kaifeng | rpioso: oh, I may read wrong words | 03:31 |
| rpioso | TheJulia: I don't understand "CI is the cloud image I believe". | 03:31 |
| TheJulia | rpioso: there is a cloud image similar to server that CI uses | 03:32 |
| kaifeng | rpioso: I would try a sudo mysql to see whether it works before stepping into stack.sh | 03:32 |
| TheJulia | basically the major difference being a GUI | 03:32 |
| kaifeng | the server integrates MAAS service, but that's an iso distribution | 03:33 |
| rpioso | kaifeng: I did. It wasn't found. Same with mysqld and "apt show mysql*". | 03:33 |
| TheJulia | Yeah, I don't ever let server install that when I use it | 03:33 |
| TheJulia | mysql-server I believe. | 03:33 |
| kaifeng | TheJulia: speaking about the Metal3, I barely know it's existence until recently :( | 03:36 |
| TheJulia | typically use my own user, make /opt/stack/, make all sudoers users able to world write it, clone devstack to /opt/stack/devstack, place my local.conf, cd to devstack, and ./stack.sh | 03:37 |
| kaifeng | According to the website, it seems Meta3 is a tool integrated with kubectl, so user can use kubectl to manage/deploy other Nodes in a k8s environment right? | 03:38 |
| TheJulia | kaifeng: basically yes. A CRD is used and that drives ironic on the back-end | 03:38 |
| rpioso | TheJulia: I used the prescribed script to create user stack -- sudo ./devstack/tools/create-stack-user.sh | 03:40 |
| kaifeng | TheJulia: cool! | 03:40 |
| TheJulia | rpioso: I guess I've used that as well, it gets fuzzy trying to figure out the small minor issue in devstack.conf that has caused it all go go sideways | 03:40 |
| rpioso | kaifeng: The deploy failed as expected. mysql is now present. "su -" followed by "mysql -u root" fails with "ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: NO)" | 03:46 |
| rpioso | kaifeng: However, as user stack, "sudo mysql" works. | 03:47 |
| kaifeng | rpioso: why devstack wants to access mysql with root and (no password)? I thought it should run as stack user in the whole process. | 03:48 |
| rpioso | kaifeng: No idea why :-( | 03:49 |
| *** Guest14611 has quit IRC | 03:50 | |
| *** benj has joined #openstack-ironic | 03:51 | |
| *** benj is now known as Guest85345 | 03:51 | |
| * rpioso considers disabling the Ubuntu root account | 03:53 | |
| TheJulia | and devstack is fails in setting up the users for sql access? | 03:55 |
| TheJulia | because the keystone error is way after that which makes me think that the issue is with local.conf | 03:57 |
| rpioso | My guess is that devstack install finds user root and sets up sql access for it which ends up being broken. | 03:57 |
| *** ricolin has joined #openstack-ironic | 03:57 | |
| TheJulia | anyway, I need to crash, I have a possible call super early in the morning | 03:58 |
| rpioso | The local.conf I'm using cdearborn and others have had success with on Xenial. | 03:58 |
| TheJulia | hmm... Interesting. I'll share my local.conf in the morning that is presently working on bionic | 03:59 |
| TheJulia | anyway, goodnight! | 03:59 |
| rpioso | Silly me jumped to Bionic, well, because I believe most are now using that version. | 03:59 |
| rpioso | TheJulia: Good nite! And thank you so much! | 03:59 |
| kaifeng | goodnight TheJulia o/ | 03:59 |
| *** igordc has quit IRC | 05:31 | |
| *** igordc has joined #openstack-ironic | 05:38 | |
| *** mkrai has joined #openstack-ironic | 06:14 | |
| *** jawad_axd has joined #openstack-ironic | 06:14 | |
| iurygregory | good morning Ironic o/ | 06:15 |
| *** igordc has quit IRC | 06:52 | |
| kaifeng | hey iurygregory o/ | 07:03 |
| iurygregory | kaifeng, o/ | 07:03 |
| *** jawad_axd has quit IRC | 07:04 | |
| *** jawad_axd has joined #openstack-ironic | 07:15 | |
| *** jawad_ax_ has joined #openstack-ironic | 07:16 | |
| *** jawad_axd has quit IRC | 07:20 | |
| *** rcernin has quit IRC | 07:28 | |
| arne_wiebalck | Good morning kaifeng iurygregory and ironic o/ | 07:31 |
| kaifeng | hey arne_wiebalck o/ | 07:32 |
| iurygregory | arne_wiebalck, o/ | 07:34 |
| kaifeng | arne_wiebalck: my playing on mdadm shows that, one disk for raid 0/1 works, but raid 5/6 needs at least 2 disks. so the conclusion is if we have --force and --run set, mdadm doesn't complain as long as it can be run in degraded mode. | 07:34 |
| arne_wiebalck | kaifeng: oh, really? interesting! | 07:35 |
| arne_wiebalck | kaifeng: you patched the code to allow 5/6? | 07:35 |
| arne_wiebalck | kaifeng: do we have --force and --run at the moment, or did you add these? | 07:35 |
| kaifeng | arne_wiebalck: not yet, i just tried in a raw linux vm. yes, we have --force and --run set in the code. | 07:36 |
| *** openstackgerrit has joined #openstack-ironic | 07:36 | |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/virtualbmc master: Drop py2 jobs https://review.opendev.org/691812 | 07:36 |
| *** pcaruana has joined #openstack-ironic | 07:37 | |
| kaifeng | otherwise mdadm will wait for user input if the disk number is only one. | 07:37 |
| *** jtomasek has joined #openstack-ironic | 07:37 | |
| arne_wiebalck | ha! that would be bad :) | 07:37 |
| kaifeng | so far looks good :) | 07:38 |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/networking-baremetal master: Drop py2 job https://review.opendev.org/691815 | 07:41 |
| *** tesseract has joined #openstack-ironic | 07:49 | |
| *** trident has quit IRC | 07:55 | |
| *** sri_ has joined #openstack-ironic | 07:56 | |
| *** trident has joined #openstack-ironic | 08:01 | |
| *** yaawang has quit IRC | 08:10 | |
| *** yaawang has joined #openstack-ironic | 08:10 | |
| *** sri_ has quit IRC | 08:17 | |
| openstackgerrit | Merged openstack/python-ironic-inspector-client master: Switch to Ussuri job https://review.opendev.org/690894 | 08:36 |
| *** priteau has joined #openstack-ironic | 08:46 | |
| *** lucasagomes has joined #openstack-ironic | 08:54 | |
| *** dtantsur|afk is now known as dtantsur | 08:55 | |
| dtantsur | morning ironic | 08:56 |
| kaifeng | hey dtantsur o/ | 08:56 |
| kaifeng | dtantsur: is deploy template the only way to utilize deploy steps with priority=0? | 08:59 |
| *** dougsz has joined #openstack-ironic | 09:01 | |
| iurygregory | morning dtantsur o/ | 09:03 |
| *** rpittau|afk is now known as rpittau | 09:08 | |
| rpittau | good morning ironic! o/ | 09:08 |
| kaifeng | morning rpittau o/ | 09:09 |
| rpittau | hey kaifeng :) | 09:10 |
| iurygregory | morning rpittau o/ | 09:12 |
| rpittau | hey iurygregory :) | 09:12 |
| dtantsur | kaifeng: I think so | 09:18 |
| kaifeng | dtantsur: ack, thanks! | 09:18 |
| rpittau | I see we started removing the Python 2.7 jobs \o/ should we also drop the tox py27 jobs ? | 09:19 |
| kaifeng | and functional jobs :) | 09:20 |
| rpittau | and basically anything that starts with 2. | 09:20 |
| iurygregory | rpittau, we can since https://review.opendev.org/#/c/688997/ is merged | 09:21 |
| patchbot | patch 688997 - openstack-zuul-jobs - Update openstack-python3-ussuri-jobs-* templates t... (MERGED) - 9 patch sets | 09:21 |
| iurygregory | - Projects can start dropping the py2.7 support. Common lib and testing tools need to wait until milestone-2. | 09:22 |
| iurygregory | ** pepe8 job to be included in openstack-python3-ussuri-jobs-* templates - https://review.opendev.org/#/c/688997/ | 09:22 |
| iurygregory | ** You can drop openstack-python-jobs template and start using ussuri template once 688997 patch is merged. | 09:22 |
| iurygregory | ** Cross projects dependency (if any ) can be sync up among dependent projects. | 09:22 |
| patchbot | patch 688997 - openstack-zuul-jobs - Update openstack-python3-ussuri-jobs-* templates t... (MERGED) - 9 patch sets | 09:22 |
| rpittau | iurygregory: yeah, exactly | 09:22 |
| kaifeng | olso has notified they will hold py2 for some time, i think it's also valid for our library projects. | 09:22 |
| rpittau | kaifeng: yeah, I would leave the libs out for now | 09:23 |
| dtantsur | rpittau: let's keep unit tests for a while | 09:25 |
| rpittau | dtantsur: alright | 09:26 |
| dtantsur | there's less pressure to remove them, and they make sure we don't completely break python 2 until we decide to break it | 09:27 |
| rpittau | always ready to break python 2 :P | 09:27 |
| dtantsur | :D | 09:27 |
| kaifeng | python version is moving fast, which reminds me the kernel version :) | 09:29 |
| *** alexmcleod has joined #openstack-ironic | 09:30 | |
| iurygregory | dtantsur, molteniron should also switch to ussuri jobs right? | 09:39 |
| dtantsur | iurygregory: I'm not fully aware of its situation | 09:39 |
| iurygregory | dtantsur, ack | 09:41 |
| iurygregory | I will check with TheJulia | 09:41 |
| kaifeng | i believe it's unmaintained.. | 09:42 |
| kaifeng | and i think the ci is already broken as well | 09:44 |
| *** kaifeng is now known as kaifeng|afk | 09:45 | |
| kaifeng|afk | bye folks, have a nice day! | 09:46 |
| *** ociuhandu has joined #openstack-ironic | 09:47 | |
| iurygregory | by kaifeng|afk tks for the info | 09:47 |
| *** khansa has joined #openstack-ironic | 09:49 | |
| *** ociuhandu has quit IRC | 09:50 | |
| *** iurygregory has quit IRC | 10:01 | |
| *** pcaruana has quit IRC | 10:03 | |
| *** priteau has quit IRC | 10:20 | |
| openstackgerrit | Merged openstack/virtualbmc master: Drop py2 jobs https://review.opendev.org/691812 | 10:23 |
| *** pcaruana has joined #openstack-ironic | 10:24 | |
| openstackgerrit | Merged openstack/ironic-inspector master: Make the bifrost job non-voting https://review.opendev.org/691652 | 10:41 |
| openstackgerrit | Merged openstack/ironic-inspector stable/train: Add IPv6 support to dnsmasq example https://review.opendev.org/691697 | 10:41 |
| openstackgerrit | Merged openstack/ironic-python-agent-builder master: DIB: add --branch argument to override IPA branch https://review.opendev.org/688913 | 10:58 |
| *** ianychoi__ is now known as ianychoi | 11:24 | |
| openstackgerrit | Ivan Kolodyazhny proposed openstack/ironic-ui master: Use Python3 for integration tests https://review.opendev.org/691850 | 11:33 |
| *** bfournie has quit IRC | 11:38 | |
| openstackgerrit | khansa proposed openstack/sushy master: Add OEM extension example script https://review.opendev.org/689835 | 11:42 |
| *** Lucas_Gray has joined #openstack-ironic | 11:50 | |
| *** ociuhandu has joined #openstack-ironic | 11:51 | |
| *** Goneri has quit IRC | 11:54 | |
| *** ociuhandu has quit IRC | 11:55 | |
| *** rh-jelabarre has joined #openstack-ironic | 11:58 | |
| *** mkrai has quit IRC | 12:03 | |
| *** mbeierl has joined #openstack-ironic | 12:04 | |
| *** goldyfruit___ has joined #openstack-ironic | 12:15 | |
| *** goldyfruit___ has quit IRC | 12:20 | |
| *** Goneri has joined #openstack-ironic | 12:23 | |
| *** belmoreira has joined #openstack-ironic | 12:27 | |
| *** Goneri has quit IRC | 12:28 | |
| *** Goneri has joined #openstack-ironic | 12:29 | |
| *** bfournie has joined #openstack-ironic | 12:31 | |
| *** Goneri has quit IRC | 12:35 | |
| rpioso | Good morning, ironic o/ | 12:42 |
| rpioso | dtantsur: I'm having difficulty deploying devstack. Details are in the back scroll. Look familiar? | 12:43 |
| dtantsur | rpioso: morning. doesn't ring any bells, sorry | 12:45 |
| *** pcaruana has quit IRC | 12:45 | |
| rpioso | dtantsur: Thank you | 12:46 |
| *** Wryhder has joined #openstack-ironic | 12:51 | |
| *** Lucas_Gray has quit IRC | 12:52 | |
| *** Wryhder is now known as Lucas_Gray | 12:52 | |
| jroll | rpioso: I've seen similar behaviors when I've poorly pasted local.conf, maybe you can check that it looks ok? or put it on paste.openstack.org and we can look? | 12:54 |
| *** Goneri has joined #openstack-ironic | 12:56 | |
| *** pcaruana has joined #openstack-ironic | 12:58 | |
| *** Goneri has quit IRC | 13:04 | |
| *** Lucas_Gray has quit IRC | 13:13 | |
| rpioso | jroll: I believe it's okay -- http://paste.openstack.org/show/785630/. Except for the IP addresses, it's entirely based on the local.conf cdearborn is using. I believe he's deployed on Ubuntu Xenial or Fedora. It's definitely not Bionic, which is what I'm using. | 13:14 |
| openstackgerrit | Ivan Kolodyazhny proposed openstack/ironic-ui master: Use Python3 for integration tests https://review.opendev.org/691850 | 13:14 |
| *** Goneri has joined #openstack-ironic | 13:15 | |
| *** tzumainn has joined #openstack-ironic | 13:18 | |
| openstackgerrit | Merged openstack/networking-baremetal master: Drop py2 job https://review.opendev.org/691815 | 13:21 |
| *** goldyfruit___ has joined #openstack-ironic | 13:26 | |
| *** bobmel has joined #openstack-ironic | 13:28 | |
| *** khansa has quit IRC | 13:30 | |
| TheJulia | rpioso: http://paste.openstack.org/show/785634/ is what I'm prsently using and I get a good stack minus my networking to my vm's seems wonky. For what your doing you could change that to flat networking based on the examples and remove the networking-generic-switch plugin reference. | 13:32 |
| *** S4ren has joined #openstack-ironic | 13:35 | |
| jroll | rpioso: hm, looks ok, sorry I can't be more help | 13:37 |
| *** bobmel has quit IRC | 13:38 | |
| openstackgerrit | Merged openstack/python-ironic-inspector-client master: Switch jobs to python3 https://review.opendev.org/690903 | 13:40 |
| TheJulia | rpioso: Any ^M characters? | 13:42 |
| openstackgerrit | raphael.glon proposed openstack/ironic master: [WIP] snapshots feature, ironic state and orchestration implem https://review.opendev.org/691862 | 13:50 |
| TheJulia | rpioso: not in the paste at least :\ | 13:50 |
| *** pcaruana has quit IRC | 13:52 | |
| *** goldyfruit_ has joined #openstack-ironic | 13:53 | |
| *** pcaruana has joined #openstack-ironic | 13:55 | |
| *** goldyfruit___ has quit IRC | 13:55 | |
| mbeierl | rpioso: Bionic changed to netplan from /etc/network/interfaces. Should be supported by devstack, but it could be something to look for - problems bringing up interfaces? | 13:56 |
| rpioso | jroll, mbeierl, TheJulia: Thank you! I have more digging to do. | 14:04 |
| mbeierl | rpioso: and... now that I look more at devstack, it says that Bionic is the most tested and stable. So that is probably not the issue | 14:05 |
| rpioso | mbeierl: That's why I went with it :-) | 14:06 |
| *** khansa has joined #openstack-ironic | 14:29 | |
| *** rloo has joined #openstack-ironic | 14:36 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-specs master: Node ownership: cover allocations https://review.opendev.org/691871 | 14:37 |
| dtantsur | tzumainn: ^^^ | 14:37 |
| TheJulia | running to the doctor... again... so they can redo labs and give me a paper copy of a prescription so I don't run out of meds in shanghai | 14:42 |
| TheJulia | *grumbles* | 14:42 |
| tzumainn | dtantsur, I'll take a look, thanks! | 14:44 |
| *** mkrai_ has joined #openstack-ironic | 14:45 | |
| dtantsur | TheJulia: good luck! | 14:46 |
| *** mkrai_ has quit IRC | 14:54 | |
| *** bobmel has joined #openstack-ironic | 14:55 | |
| *** gyee has joined #openstack-ironic | 14:57 | |
| *** mkrai has joined #openstack-ironic | 14:57 | |
| *** ociuhandu has joined #openstack-ironic | 15:00 | |
| openstackgerrit | Merged openstack/ironic-python-agent master: [Trivial]: Typo in comment for _get_partition https://review.opendev.org/691394 | 15:02 |
| TheJulia | dtantsur: thanks, I need it. They changed records systems and it has been continious disaster as a service | 15:05 |
| TheJulia | I'm sure the API for that already exists ... | 15:05 |
| *** ociuhandu has quit IRC | 15:07 | |
| openstackgerrit | Merged openstack/ironic-ui master: Use Python3 for integration tests https://review.opendev.org/691850 | 15:10 |
| *** Guest72324 has joined #openstack-ironic | 15:11 | |
| *** Guest72324 is now known as jerryw | 15:12 | |
| *** ociuhandu has joined #openstack-ironic | 15:12 | |
| *** jerryw is now known as jerrywang | 15:12 | |
| jerrywang | Hello, did anyone meet zuul test fail at ironic_standalone test item? Thanks. I had no idea why the item failed even checked the log. | 15:14 |
| TheJulia | jerrywang: could we get some more context? | 15:16 |
| *** khansa has quit IRC | 15:17 | |
| jerrywang | I submit a patch set 9 for WSME, zuul gave -1, because above failure I mentioned. | 15:18 |
| jerrywang | The failure seemed not caused by my code, but I recheck 3 times, still fail. | 15:19 |
| *** ociuhandu has quit IRC | 15:20 | |
| jerrywang | So I want to know anynoe else met such kind of failure recently when submit code review. | 15:20 |
| jerrywang | https://review.opendev.org/675853 | 15:21 |
| patchbot | patch 675853 - ironic - Add support for replacing WSME - 9 patch sets | 15:21 |
| *** ociuhandu has joined #openstack-ironic | 15:22 | |
| jerrywang | And another itme devstack mult-node item also fail, not know why, All other times are successful, only 2 items failed. | 15:23 |
| *** jawad_ax_ has quit IRC | 15:24 | |
| dtantsur | these two jobs are the most unstable | 15:24 |
| dtantsur | if you've made sure that your patch is not causing the failure, you can recheck | 15:24 |
| dtantsur | I have a patch where the standalone job keeps failing as well | 15:24 |
| *** jawad_axd has joined #openstack-ironic | 15:25 | |
| jerrywang | Ok, Thanks for your information, dtantsur. I would try more rechecks. | 15:25 |
| *** ociuhandu has quit IRC | 15:26 | |
| *** jawad_axd has quit IRC | 15:29 | |
| dtantsur | I suspect the standalone job may be even broken | 15:32 |
| dtantsur | we may need to investigate it | 15:32 |
| dtantsur | requests.exceptions.ConnectionError: HTTPSConnectionPool(host='158.69.75.19', port=443): Max retries exceeded with url: /baremetal/v1/lookup?addresses=52%3A54%3A00%3Adc%3A79%3A39%2C52%3A54%3A00%3A18%3A6d%3A27 (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fb3d0b7a4e0>: Failed to establish a new connection: [Errno 101] Network is unreachable',)) | 15:36 |
| dtantsur | udevadm settle - timeout of 20 seconds reached, the event queue contains | 15:38 |
| dtantsur | ahhhemmmm | 15:38 |
| *** mkrai has quit IRC | 15:45 | |
| TheJulia | overloaded ci node? | 15:47 |
| TheJulia | I've seen a decent amount of multinode breakage recently, but each time I've looked it has been due to varying transitory things | 15:49 |
| *** Goneri has quit IRC | 15:56 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent-builder master: tinyIPA: raise udevadm settle timeout https://review.opendev.org/691894 | 15:57 |
| dtantsur | TheJulia: we can try ^^^ | 15:57 |
| *** goldyfruit___ has joined #openstack-ironic | 15:59 | |
| TheJulia | hmmm | 15:59 |
| TheJulia | I guess I could see weirdness if the hypervisor CPU is just maxed out. That seems a bit excessive, but I guess that is okay too | 16:00 |
| jroll | TheJulia | I'm sure the API for that already exists ... <- for continuous disaster as a service? I think you want https://netflix.github.io/chaosmonkey/ | 16:01 |
| jroll | good luck with the medical industry :| | 16:01 |
| *** goldyfruit_ has quit IRC | 16:01 | |
| TheJulia | jroll: heh | 16:01 |
| *** igordc has joined #openstack-ironic | 16:01 | |
| *** mkrai has joined #openstack-ironic | 16:01 | |
| dtantsur | https://review.opendev.org/#/c/689524/ is on its 10th recheck, all because of standalone jobs | 16:03 |
| patchbot | patch 689524 - ironic-tempest-plugin - Allow introspection some time to start in ironic-i... - 2 patch sets | 16:03 |
| clarkb | the standalone job wasthe one runnung out of disk right? did VM images getmovedto the larger device to address that? | 16:06 |
| dtantsur | clarkb: yep, I think so | 16:08 |
| dtantsur | and we made them much smaller | 16:08 |
| dtantsur | at least some of failures are PXE timeouts, some are more strange (like above) | 16:08 |
| * dtantsur wonders if the concurrency is too high | 16:08 | |
| dtantsur | TheJulia, jroll, do you remember why we ended up having 6 VMs for the standalone job if concurrency is just 3? | 16:11 |
| *** lucasagomes has quit IRC | 16:12 | |
| jroll | dtantsur: not sure, but I bet we had both cranked up and then turned down concurrency | 16:13 |
| jroll | oh, some tests need multiple VMs, right? | 16:13 |
| jroll | maybe not in standalone. not sure. | 16:13 |
| dtantsur | not standalone, I think | 16:13 |
| dtantsur | multinode tests certainly do | 16:14 |
| TheJulia | dtantsur: cleaning I think | 16:15 |
| dtantsur | I would expect cleaning to be finished before a test is over.. but maybe you're right | 16:16 |
| TheJulia | I don't think the tests account for complete return, tbh | 16:17 |
| *** igordc has quit IRC | 16:18 | |
| * dtantsur wants to run away screaming | 16:24 | |
| * TheJulia puts out whiskey | 16:32 | |
| clarkb | https://lamada.eu/dstat-graph/ is useful when you suspect there are resource contention issues | 16:33 |
| clarkb | you can download the dstat csv file, uncompress if necessary, then drop it in there | 16:33 |
| TheJulia | neat | 16:35 |
| clarkb | the period of time where https://zuul.opendev.org/t/openstack/build/750bd017e50941979d320a4ff18561e2/logs fails seems fairly quiet though load average is quite significant not long after the test case fails | 16:35 |
| clarkb | seems we go into quite a bit of io wait at that time too (and there is significant paging too, is it swapping?) | 16:36 |
| clarkb | there appears to be quite a bit of memory dedicated to cache which should be able to be used, but maybe it is swapping anyway | 16:36 |
| *** tesseract has quit IRC | 16:38 | |
| dtantsur | clarkb: how much memory do we have on the testing nodes? | 16:40 |
| clarkb | 8GB of memory | 16:40 |
| dtantsur | should be quite enough | 16:41 |
| clarkb | qemu-system-x86 is the biggest cpu hog at that time | 16:41 |
| clarkb | it is only about 22MB into swap there | 16:42 |
| *** paulbrowne has joined #openstack-ironic | 16:44 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Block ability update callback_url https://review.opendev.org/690775 | 16:49 |
| TheJulia | rloo: ^^^ I replied to your comments, one thing doesn't seem required... | 16:53 |
| rloo | TheJulia: thx! | 16:54 |
| TheJulia | dtantsur: re 691372, is the thought that you have that if it looks like a hashed password structure at all, to let it through. I did the hash type checks to just back-up the overall logic, but I feel like your wondering about other hash types? | 17:03 |
| dtantsur | yeah. but on the other hand, a real password can look like a hash.. | 17:07 |
| TheJulia | true | 17:08 |
| rpittau | I think I have the same concern, especially with random generated password | 17:08 |
| TheJulia | which was kind of why I was thinking we check the field values themselves and then, and only then permit it to move forward skipping a local hasing | 17:09 |
| *** igordc has joined #openstack-ironic | 17:16 | |
| *** Goneri has joined #openstack-ironic | 17:17 | |
| TheJulia | I guess I'm not sure of any possible path forward if preventing and being open to anything... short of completely ripping it out and always assuming what we get is hashed, but that would be a very hard break :\ | 17:18 |
| rpittau | bye, goodnight! o/ | 17:25 |
| *** rpittau is now known as rpittau|afk | 17:25 | |
| *** jawad_axd has joined #openstack-ironic | 17:26 | |
| *** gmann is now known as gmann_afk | 17:29 | |
| dtantsur | TheJulia: we could extend the API with a new marker field, like "hashed": true | 17:32 |
| TheJulia | also never backportable :\ | 17:32 |
| TheJulia | We would have to do essentially the same if we were to allow someone to submit their own pre-hashed password anyway | 17:33 |
| *** gmann_afk is now known as gmann | 17:35 | |
| *** ociuhandu has joined #openstack-ironic | 17:40 | |
| dtantsur | backportability.. we may need to reconsider at some point how we treat the policy when it comes to internal interfaces | 17:41 |
| dtantsur | IPA API is not public and has never been | 17:41 |
| dtantsur | (ditto to an extent ironic-lib) | 17:41 |
| dtantsur | but this is a whole rabbit hole :) | 17:41 |
| *** dtantsur is now known as dtantsur|afk | 17:41 | |
| dtantsur|afk | gotta go, see you tomorrow | 17:41 |
| TheJulia | I'm totally for revising such things, and strongly believe that the existing stable policy model ties project hands from doing the right thing | 17:42 |
| TheJulia | but! yeah | 17:42 |
| TheJulia | I'm with you there | 17:42 |
| *** ociuhandu has quit IRC | 17:45 | |
| *** mkrai has quit IRC | 17:57 | |
| *** paulbrowne has quit IRC | 18:07 | |
| *** ociuhandu has joined #openstack-ironic | 18:12 | |
| *** ociuhandu has quit IRC | 18:18 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Block ability update callback_url https://review.opendev.org/690775 | 18:32 |
| *** dougsz has quit IRC | 18:48 | |
| *** alexmcleod has quit IRC | 18:52 | |
| *** Guest85345 is now known as benj_ | 19:08 | |
| NobodyCam | Goos Afternoon Ironic folks | 19:31 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: WIP: Hash the rescue_password https://review.opendev.org/691413 | 20:25 |
| TheJulia | o/ NobodyCam | 20:38 |
| NobodyCam | o/ TheJulia | 20:42 |
| *** khansa has joined #openstack-ironic | 20:48 | |
| openstackgerrit | Tzu-Mainn Chen proposed openstack/ironic master: Allow node owners to administer nodes https://review.opendev.org/689551 | 20:59 |
| *** dtruong has quit IRC | 21:01 | |
| *** problem_v has quit IRC | 21:01 | |
| *** problem_v has joined #openstack-ironic | 21:01 | |
| *** dtruong has joined #openstack-ironic | 21:01 | |
| *** khansa has quit IRC | 21:12 | |
| *** pcaruana has quit IRC | 21:15 | |
| rpioso | TheJulia: Might you have time to review https://review.opendev.org/668987? It's doc :-) | 21:17 |
| patchbot | patch 668987 - ironic - Improve iDrac Documentation - 17 patch sets | 21:18 |
| rpioso | NobodyCam: o/ | 21:18 |
| TheJulia | rpioso: will do after my current conference call and I run into town | 21:18 |
| rpioso | TheJulia: Thank you so much! | 21:18 |
| * rpioso passes TheJulia a pot of coffee ;-) | 21:19 | |
| *** Goneri has quit IRC | 21:27 | |
| *** bfournie has quit IRC | 21:59 | |
| *** rcernin has joined #openstack-ironic | 22:02 | |
| *** goldyfruit___ has quit IRC | 22:04 | |
| NobodyCam | rpioso: \o | 22:10 |
| rpioso | NobodyCam: :-) | 22:23 |
| NobodyCam | hehehe :) | 22:24 |
| *** gyee has quit IRC | 22:27 | |
| *** mroh has quit IRC | 22:33 | |
| *** goldyfruit___ has joined #openstack-ironic | 22:35 | |
| *** gyee has joined #openstack-ironic | 22:52 | |
| *** etingof has quit IRC | 23:08 | |
| *** Goneri has joined #openstack-ironic | 23:29 | |
| *** mroh has joined #openstack-ironic | 23:37 | |
| *** Goneri has quit IRC | 23:38 | |
| *** goldyfruit___ has quit IRC | 23:45 | |
| *** goldyfruit___ has joined #openstack-ironic | 23:48 | |
| *** mbeierl has quit IRC | 23:50 | |
| *** gyee has quit IRC | 23:54 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!