opendevreview | Takashi Kajinami proposed openstack/glance master: Replace deprecated assertDictContainsSubset https://review.opendev.org/c/openstack/glance/+/802411 | 00:36 |
---|---|---|
brtknr | hey all, anyone know why the glance API is returning 500? ++ functions:_upload_image:121 : openstack --os-cloud=devstack-admin --os-region-name=RegionOne image create Fedora-Cloud-Base-33-1.2.x86_64 --public --container-format bare --disk-format qcow2 --property hw_rng_model=virtio | 08:19 |
brtknr | HttpException: 502: Server Error for url: https://213.32.76.37/image/v2/images/240cc09b-faaa-434a-ad1a-029679875ede/file, Bad Gateway: response from an upstream server.: 502 Bad Gateway: The proxy server received an invalid: Apache/2.4.41 (Ubuntu) Server at 213.32.76.37 Port 80 | 08:19 |
brtknr | this is on CI devstack | 08:19 |
abhishekk | brtknr, can you provide more information form glance api logs and which version of openstack you are using | 10:32 |
brtknr | abhishekk: its master branch on CI: https://zuul.opendev.org/t/openstack/build/b6e10b26b2a84102b381d0fea59f51d6 | 10:33 |
abhishekk | looking | 10:33 |
brtknr | Its been happening 100% of the time as of 1 week | 10:33 |
abhishekk | brtknr, give me sometime, will have a look | 10:36 |
brtknr | abhishekk: thanks | 10:37 |
abhishekk | brtknr, no problem | 10:37 |
abhishekk | brtknr, can you verify that it is working before this patch, https://review.opendev.org/c/openstack/devstack/+/788056 ? | 10:41 |
abhishekk | one way to verify it is; | 10:44 |
brtknr | abhishekk: https://zuul.opendev.org/t/openstack/builds?job_name=magnum-tempest-plugin-tests-api&project=openstack/magnum | 10:44 |
brtknr | based on that history, things stopped working 100% of the time after 19 July | 10:45 |
brtknr | that patch got merged on 17th July | 10:45 |
abhishekk | submit test patch in https://github.com/openstack/magnum-tempest-plugin/blob/master/.zuul.yaml#L14 | 10:45 |
abhishekk | add GLANCE_ENABLE_QUOTAS=False there | 10:45 |
abhishekk | and then make your https://review.opendev.org/c/openstack/magnum/+/802409/ depends on test patch | 10:46 |
brtknr | https://review.opendev.org/c/openstack/magnum-tempest-plugin/+/802453 | 10:58 |
brtknr | abhishekk: ^ hopefully that will do the trick, thank you | 11:01 |
abhishekk | brtknr, looking, facing some network issues :/ | 11:02 |
brtknr | abhishekk: do you have a intuition for why this is causing problems? | 11:02 |
brtknr | looks quite benign to me | 11:02 |
abhishekk | I think this is something related to registering quotas using limits | 11:03 |
akekane_ | brtknr, If this confirms the issue, kindly report it on launchpad as well | 11:05 |
brtknr | glance's launchpad? | 11:06 |
akekane_ | devstack | 11:06 |
*** diablo_rojo__ is now known as diablo_rojo | 11:21 | |
*** diablo_rojo is now known as Guest2424 | 11:22 | |
*** Guest2424 is now known as diablo_rojo | 11:23 | |
brtknr | above failed due to a Cinder issue | 12:26 |
brtknr | why do all CI breakages come at the same time | 12:26 |
akekane_ | :/ | 12:28 |
akekane_ | brtknr, if you have local resources, then you can setup devstack using GLANCE_ENABLE_QUOTAS=True and check it is failing or not | 12:29 |
akekane_ | unfortunately I don't have anything spare at the moment, but I can check it tomorrow (hopefully) | 12:30 |
brtknr | The cinder issue is related to v2 API removal | 12:30 |
brtknr | akekane_: i am already testing here: https://review.opendev.org/c/openstack/magnum/+/802413 | 12:31 |
akekane_ | brtknr, ack | 12:31 |
*** akekane_ is now known as abhishekk | 12:31 | |
opendevreview | Abhishek Kekane proposed openstack/glance master: Refactor gateway auth layer for member APIs https://review.opendev.org/c/openstack/glance/+/802525 | 13:32 |
opendevreview | Abhishek Kekane proposed openstack/glance master: PoC Move member policy checks to API layer https://review.opendev.org/c/openstack/glance/+/802526 | 13:32 |
abhishekk | dansmith, may be once your get_image patch is final then I can reabse these (member patch) on top of that and open for reviews | 13:37 |
dansmith | ack, I'm looking at comments now | 13:37 |
abhishekk | ack | 13:46 |
brtknr | abhishekk: It seems to have address the issue: https://review.opendev.org/c/openstack/magnum/+/802413 | 13:57 |
brtknr | There is a circular dependency so I have hard coded some config there | 13:58 |
dansmith | akekane_: on that test base, you created that file as v2/test_ where I had it in v2/api/test_ which is why I didn't see the conflict.. did you want me to subclass that and add my tests in your file, or import that in my file where I had it? | 14:06 |
*** akekane_ is now known as abhishekk | 14:19 | |
abhishekk | i think former will be more specific way | 14:20 |
abhishekk | dansmith, | 14:20 |
abhishekk | brtknr, ack | 14:20 |
dansmith | ack | 14:20 |
abhishekk | dansmith, do you have any idea about launchpad licensing terms ? | 14:54 |
abhishekk | https://launchpad.net/glance-tempest-plugin | 14:54 |
dansmith | heh, no idea.. fungi ^ ? | 14:55 |
fungi | licensing? that "commercial subscription" thing? | 14:57 |
fungi | if so, i've never seen that on any of our projects before | 14:57 |
dansmith | I didn't realize anyone had to (or would) pay for launchpad | 14:57 |
fungi | they have commercial options, mainly for companies wanting to use it for proprietary/internal thnigs | 14:58 |
fungi | things | 14:58 |
fungi | i'm going to temporarily add myself to ~glance-release in lp so i can poke around in the project settings for glance-tempest-plugin | 14:59 |
fungi | looks like that project was just now created? | 14:59 |
abhishekk | yes | 15:00 |
abhishekk | it wasn't there earlier | 15:00 |
fungi | the project settings look like what i would expect, normally it only requires a commercial subscription if the project doesn't have an open source license. maybe it just adds a free corporate subscription on initial creation, or maybe you initially didn't select a license when creating the project and added it after? | 15:02 |
fungi | i would just ignore it since there is an open source license set on the project now | 15:03 |
abhishekk | I set it to Apache from the start | 15:04 |
abhishekk | fungi, ack | 15:04 |
fungi | also don't forget, if you want bug integration with gerrit changes you need to drop the glance group from the openstack/glance-tempest-plugin project entry at https://opendev.org/openstack/project-config/src/branch/master/gerrit/projects.yaml#L3202-L3205 since right now it still expects bugs for openstack/glance-tempest-plugin to be filed against the glance project in lp | 15:06 |
abhishekk | ack | 15:06 |
abhishekk | will submit a change for the same | 15:07 |
* abhishekk going for dinner | 15:11 | |
opendevreview | Arnaud Morin proposed openstack/glance master: Figure out backend from URI https://review.opendev.org/c/openstack/glance/+/802546 | 15:31 |
dansmith | abhishekk: are you thinking that the existing property protection functional tests somehow don't cover us here? It seems to me that they're doing lots of poking at the api with various policies set and different roles already | 16:24 |
whoami-rajat | abhishekk, dansmith Hey, can you also take a look at another patch related to a cinder feature i did last release, it's the last patch to complete that feature https://review.opendev.org/c/openstack/glance_store/+/796577 | 16:25 |
abhishekk | I think we might uncover something there | 16:25 |
abhishekk | whoami-rajat, ack | 16:26 |
whoami-rajat | thanks | 16:27 |
abhishekk | whoami-rajat, https://review.opendev.org/c/openstack/glance_store/+/796577/2/glance_store/_drivers/cinder.py | 16:29 |
abhishekk | why removed attachment_delete call ? | 16:29 |
whoami-rajat | abhishekk, i realized it is done anyway in the finally block on L#772 so removed it | 16:30 |
abhishekk | whoami-rajat, may be a note in commit message will be useful or you can submit a separate patch as enhancement for the same | 16:32 |
whoami-rajat | abhishekk, i can update the commit message if it's ok? | 16:33 |
abhishekk | wait a minute | 16:33 |
abhishekk | another question | 16:33 |
abhishekk | what is difference between line 709 and 715 | 16:33 |
opendevreview | Rajat Dhasmana proposed openstack/glance_store master: WIP: Add multiattach handling https://review.opendev.org/c/openstack/glance_store/+/786410 | 16:33 |
whoami-rajat | abhishekk, from cinder side, the format is only exposed in attachment get call, so we don't have in connection_info of attachment object before https://review.opendev.org/c/openstack/cinder/+/761152/12/cinder/api/v3/attachments.py | 16:36 |
whoami-rajat | i will add a note to state it clearly | 16:37 |
abhishekk | yeah, that will be helpful | 16:38 |
*** diablo_rojo is now known as Guest2459 | 17:24 | |
abhishekk | whoami-rajat, I am assuming you are going to push new patch so not reviewing current one | 17:26 |
whoami-rajat | abhishekk, yes, i went for dinner, maybe i will submit tomorrow | 17:49 |
abhishekk | ack | 17:50 |
opendevreview | Rajat Dhasmana proposed openstack/glance_store master: Glance cinder nfs: Block creating qcow2 volumes https://review.opendev.org/c/openstack/glance_store/+/796577 | 18:05 |
whoami-rajat | abhishekk, ^^ updated | 18:05 |
abhishekk | whoami-rajat, ack | 18:06 |
* abhishekk signing out for the day | 18:28 | |
opendevreview | Dan Smith proposed openstack/glance master: Add api_patch() to SynchronousAPIBase https://review.opendev.org/c/openstack/glance/+/801119 | 18:34 |
opendevreview | Dan Smith proposed openstack/glance master: Remove dead 403->404 code https://review.opendev.org/c/openstack/glance/+/799699 | 18:34 |
opendevreview | Dan Smith proposed openstack/glance master: Refactor gateway get_repo auth layer https://review.opendev.org/c/openstack/glance/+/789913 | 18:34 |
opendevreview | Dan Smith proposed openstack/glance master: Make image update check policy at API layer https://review.opendev.org/c/openstack/glance/+/789915 | 18:34 |
opendevreview | Dan Smith proposed openstack/glance master: Check get_image(s) in the API https://review.opendev.org/c/openstack/glance/+/796067 | 18:34 |
opendevreview | Dan Smith proposed openstack/glance master: POC: Add a member field to Image when appropriate https://review.opendev.org/c/openstack/glance/+/796066 | 18:34 |
opendevreview | Dan Smith proposed openstack/glance master: POC: Check delete_image policy in the API https://review.opendev.org/c/openstack/glance/+/798073 | 18:34 |
opendevreview | Dan Smith proposed openstack/glance master: POC: Check deactivate, reactivate policy in the API https://review.opendev.org/c/openstack/glance/+/798266 | 18:34 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!