Tuesday, 2024-11-12

opendevreviewAlistair Coles proposed openstack/swift feature/mpu: mpu: refactor MPUSession class  https://review.opendev.org/c/openstack/swift/+/93473711:12
opendevreviewAlistair Coles proposed openstack/swift feature/mpu: mpu-auditor: audit sessions  https://review.opendev.org/c/openstack/swift/+/93151711:17
opendevreviewMerged openstack/swift feature/mpu: mpu: add func tests using an UTF8 mpu name.  https://review.opendev.org/c/openstack/swift/+/93407612:22
opendevreviewMerged openstack/swift feature/mpu: mpu: refactor MPUSession class  https://review.opendev.org/c/openstack/swift/+/93473713:11
fulecorafaHey guys, I'm having problems starting swift here. I just run swift-init restart main and it does not start the servers with "Exception: worker did not start normally: b''", didn't find other logs. Any ideas?13:59
DHEdepending on the distro, check if logs got shoved into some swift-specific files/dir?14:09
DHEfor troubleshooting, you can run the services manually as the swift user, typically with "swift-$type-server /etc/swift/$type-server.conf" and see stderr messages.14:10
fulecorafaSo, no idea why, but seems the container name was it?14:15
fulecorafaI did the same thing multiple times with a host name as "swift-lock". Changed to "swift-why" (little frustrated, sry hehe) and it worked14:16
fulecorafaNah, scratch that, didn't work14:17
fulecorafaI'll try initializing the server isolated14:17
DHEno error message doesn't give much to go on... I would normally assume bad config files or missing ring files. something like that..14:19
fulecorafaSo yeah, no shot here. Tried running the failing servers manually, no error message apert from the one I already sent14:38
DHEas the swift user?14:39
fulecorafaYep14:40
DHEumm.. that was my only real idea... short of much more invasive methods like strace...15:36
timburkefulecorafa, maybe try running with workers=0? that should get us out of the spawn-a-bunch-of-workers path that makes things trickier to debug16:28
timburkei would've hoped that logs would still be going out via syslog :-/16:29
fulecorafa"getpwnam(): name not found: 'swift'" does this help? timburke16:41
timburkefulecorafa, ah! so that's coming from this call in drop_privileges: https://github.com/openstack/swift/blob/2.34.0/swift/common/utils/__init__.py#L97116:46
timburkethis was running in a container, right? you might need to copy (or mount) /etc/passwd in the container16:46
timburkeor run with user=root16:47
fulecorafaI'm not using the latest swift though16:47
fulecorafaI'm at commit 19879831272b37b5e49f73a4d49f1a4587ccd7c7 (HEAD, tag: 2.29.2)16:48
fulecorafaThere's a single file for utils16:48
fulecorafaAlso, the /etc/passwd file already exists and has reasonable configurations16:49
timburkeit's been like this a looong time https://github.com/openstack/swift/blob/1.2.0/swift/common/utils.py#L45316:49
timburkedoes it have a 'swift' user?16:49
fulecorafaThat's what I though16:51
fulecorafaThe user in the VM is called ubuntu and all configuration files point the user as ubuntu16:51
fulecorafaubuntu@swift-why:/etc/swift$ grep -nr ubuntu16:52
fulecorafaproxy-server.conf:5:user = ubuntu16:52
fulecorafaobject-server/1.conf:5:user = ubuntu16:52
fulecorafainternal-client.conf:2:user = ubuntu16:52
fulecorafacontainer-server/1.conf:5:user = ubuntu16:52
fulecorafacontainer-reconciler/1.conf:2:user = ubuntu16:52
fulecorafaaccount-server/1.conf:5:user = ubuntu16:52
fulecorafaobject-expirer.conf:2:user = ubuntu16:52
fulecorafaGreping swift reveals nothing16:52
fulecorafaBut the egg:swift parts16:52
timburkehuh. weird -- the user in drop_privileges should be coming out of the configs: https://github.com/openstack/swift/blob/2.29.2/swift/common/wsgi.py#L46116:56
timburkenot sure why it's looking for 'swift' if you've got 'ubuntu' configured16:58
fulecorafaHuh, juts went there. It's falling in the base case16:59
fulecorafaAs in it's not finding the config user...17:00
fulecorafaThis should be my guide, thx a lot timburke17:00
timburkesure -- let me know how it goes17:01
fulecorafaTrying to understand now why it is not capturing this information17:02
opendevreviewClay Gerrard proposed openstack/swift master: Deprecate expirer options  https://review.opendev.org/c/openstack/swift/+/92045217:02
opendevreviewClay Gerrard proposed openstack/swift master: Configurable expiring_objects_task_container_per_day  https://review.opendev.org/c/openstack/swift/+/93337317:02
opendevreviewClay Gerrard proposed openstack/swift master: refactor: remove iter_task_accounts_to_expire  https://review.opendev.org/c/openstack/swift/+/91963917:02
opendevreviewClay Gerrard proposed openstack/swift master: Parallel distributed task container iteration  https://review.opendev.org/c/openstack/swift/+/91836617:02
opendevreviewClay Gerrard proposed openstack/swift master: Delete s3api MPU segments when expiring the manifest  https://review.opendev.org/c/openstack/swift/+/80070117:02
fulecorafaThere we go! I was missing the user in part of the files. They got overwritten in some commits17:04
fulecorafaThanks a lot for the help guys <317:04
timburkenice -- fwiw, i think we often put user in the [DEFAULT] section17:09
fulecorafaYep. It so happens that someone pushed an overwrite that we didn't expect17:10
opendevreviewTim Burke proposed openstack/swift master: DNM: investigating probe test timeouts  https://review.opendev.org/c/openstack/swift/+/93435017:39
opendevreviewTim Burke proposed openstack/swift master: probe tests: Set default timeout for subprocesses  https://review.opendev.org/c/openstack/swift/+/93481317:39
opendevreviewShreeya Deshpande proposed openstack/swift master: Remove PrefixLoggerAdapter and SwiftLoggerAdapter  https://review.opendev.org/c/openstack/swift/+/93106021:09
opendevreviewTim Burke proposed openstack/swift master: probe tests: Run relinker via subprocess  https://review.opendev.org/c/openstack/swift/+/93491023:39
opendevreviewClay Gerrard proposed openstack/swift master: add backoff sleep to REPLICATE  https://review.opendev.org/c/openstack/swift/+/93467523:57

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!