Sunday, 2018-12-23

*** bobh has joined #openstack-vitrage02:32
*** bobh has quit IRC03:41
*** eyalb has joined #openstack-vitrage06:04
*** eyalb1 has joined #openstack-vitrage06:06
*** eyalb has quit IRC06:08
*** ifat_afek has joined #openstack-vitrage07:02
openstackgerritIdan Hefetz proposed openstack/vitrage master: Api-worker sync threads - lock graph from changing during API calls.  https://review.openstack.org/62656607:35
openstackgerritMerged openstack/python-vitrageclient master: Use template for lower-constraints  https://review.openstack.org/62674407:51
openstackgerritMerged openstack/vitrage master: Add Trove cluster capacity autoscaling example  https://review.openstack.org/62701709:07
openstackgerritEyal proposed openstack/vitrage master: fix some pycharm warning  https://review.openstack.org/62706310:03
openstackgerritMerged openstack/vitrage master: mock driver - generate consistent uuids  https://review.openstack.org/62655810:29
openstackgerritEyal proposed openstack/vitrage master: fix some pycharm warning  https://review.openstack.org/62706311:02
*** e0ne has joined #openstack-vitrage11:09
e0nehi team. can anybody please help me with tempest tests?11:19
ifat_afeke0ne: hi11:20
ifat_afekwhat is the problem?11:20
e0nenot really a problem.. I just want to get some information11:21
ifat_afeksure11:21
e0newhy do we have separate vitrage-dsvm-api-py27 vitrage-dsvm-datasources-py27 vitrage-dsvm-mock-py27 jobs instead of one?11:22
ifat_afekthe purpose of the mock is to test the graph on large data. it is used as the only datasource (in addition to doctor, for generating alarms) instead of all the regular openstack datasources11:23
ifat_afekbecause it is a different configuraiton we run it on a different job11:24
ifat_afekdifferent ‘types’ value in vitrage.conf + specific mock configuration11:24
e0neit makes sense, thanks11:25
e0newe can't do it in one job if it requires some config changes11:25
ifat_afekregarding the datasources vs. api - I’m not sure. I think one developer wrote it once and we just keep adding tests to the jobs. I’m not sure there is a real reason for the separation11:25
* e0ne like to dig into the tests because it helps to understand project better11:26
ifat_afekfor the mock - maybe we could if we tried harder, but I’m not sure it makes sense. for the datasources and api, might be worth checking11:26
ifat_afekgo for it :-)11:26
e0neI do:)11:26
e0neand one maybe a stupid question11:27
ifat_afekwhen we started writing the temepst tests, three years ago, I think we have made several mistakes. then we didn’t have time to fix them… but I guess we should11:27
e0neI didn't try such configuration before (I'm deploying it now), but looking throw the code, it looks like we can't run vitrage and tempest plugin on different nodes. am I right?11:28
e0neifat_afek: it's great that you and team understand that we need to fix it :)11:28
ifat_afekright… because the tempest depends on vitrage code and uses it. but once this is fixed, do you see any other problem?11:29
e0neit's not the issue, because it only requires to install vitrage ad get config11:30
e0nebut things like https://github.com/openstack/vitrage-tempest-plugin/blob/9da198fcfe9200eae97b93701c98a7096514ffcb/vitrage_tempest_plugin/tests/utils.py#L41https://github.com/openstack/vitrage-tempest-plugin/blob/ff69d62f3ff6e4f5b1e5db20464d379d7018c770/vitrage_tempest_plugin/tests/common/vitrage_utils.py#L121 and https://github.com/openstack/vitrage-tempest-plugin/blob/9da198fcfe9200eae97b93701c98a7096514ffcb/vitrage_tempest_plugin/tests/base.py#L611:32
e0ne7 seems to be more critical,  IMO11:32
ifat_afekyes… I guess you are right11:35
e0neifat_afek: according to https://storyboard.openstack.org/#!/story/200405311:35
ifat_afekwhat do you mean by ‘7 seems to be more critical’? what 7?11:35
e0neifat_afek: it was a message size limit in IRC :(11:36
e0neit's the end of the previous message11:36
ifat_afekindeed, line 67 makes more sense than line 6 :-)11:37
e0ne:)11:37
e0neifat_afek: I'm not sure that I'll be able to finish #2004053 this release, so  to speedup this a bit I'm going to use python-clients still with a TODO node but decouple tempest plugin from vitrage itself11:38
ifat_afekand you are right, the tempest tests should only use python-vitrageclient. on the other hand, we have important use cases that require graph restart (to make sure persistency works, for example)… so I’m not sure about it11:38
e0nedoes it make sed?11:38
e0nes/sed/sense11:38
ifat_afeksounds fine to me. any step towards the separation is welcome11:38
e0ne:)11:38
ifat_afekI think it’s a lot of work to finish it...11:38
e0neI agree with you11:39
e0nehonestly, I started this for two reasons:11:39
e0ne1) to become more familiar with how vitrage works11:39
e0neand 2) to finish upgrades stuff11:39
ifat_afekand are the changes that you are doing now enough for the upgrade?11:40
e0nenot yet, but I'm about 2-3 patches before it11:41
ifat_afekgood :-)11:42
e0neI need toremove vitrage conf usages11:42
ifat_afekdo you have a change in vitrage that depends on all of your tempest changes? or do you check them one by one?11:42
e0nehere is it: https://review.openstack.org/#/c/612652/11:43
e0neit would be good to add the same jobs for tempest plugin too11:43
ifat_afekbut you have 3 changes in the tempest, right?11:44
ifat_afekand only one in vitrage?11:44
ifat_afekwhat do you mean by adding the same jobs? so the tempest changes will run the tempest as well?11:44
e0nethere is a chain of tempest changes11:45
e0neexactly11:45
openstackgerritIvan Kolodyazhny proposed openstack/vitrage master: Do Not Review. Test tempest changes  https://review.openstack.org/61265211:46
e0neifat_afek: you ca see at zuul http://zuul.openstack.org/status now that my vitrage patch will be testes with all 3 patches to tempest11:47
ifat_afekI think our problem is that there is a cyclic dependency between vitrage and the tempest. if you run tempest in both places, it might cause problems - e.g. if you change an api and you should change both vitrage and the tempest.11:47
e0neoh.. you're right11:48
ifat_afekpersonally I don’t understand the decision to split the tempest tests from the main code. it seems to only mess things up… (although it also forces us to write the code in a correct way)11:48
ifat_afekor at least I don’t understand why the tempest tests are branchless11:49
ifat_afekbut that’s a different discussion11:49
e0nethey are branchless because it's supposed that you'll be able to run the same tests against different versions of the openstack11:50
e0nee.g. it's useful to run the same tests after cloud upgrade11:50
e0nethat's why it's recommended to not use any python-*client in tempest11:51
ifat_afekfor upgrade it makes sense. but if we add a new api then it won’t run against an older version11:51
ifat_afek*not* use python client?11:52
e0neyou can use config with feature flags11:52
e0neifat_afek: yep11:52
ifat_afekyou got me confused. shouldn’t the tempest call python-vitrageclient, python-novaclient, etc.? if not, then what?11:53
e0neno, it should not11:53
e0nebut as I know nobody checks if for plugins11:54
e0nee.g. cinder client implementation for tempest https://github.com/openstack/tempest/blob/master/tempest/lib/services/volume/v3/volumes_client.py11:54
ifat_afekregarding the changes - I see the chain in zuul, but I don’t see any depends-on in https://review.openstack.org/#/c/627052/. what am I missing?11:54
e0netempest should call API directly11:54
ifat_afekright… eyalb explained it to me now. I knew that there is a common way to use clients in tempest tests, but I assumed these are simply methods to access the regular python clients11:55
e0nehere is a git chain: master branch => Use Tempest config => Add constants for datasources =>  Delete unused code11:56
ifat_afekso you pushed 3 commits one on top of the other? wow… we are afraid of doing such things ;-)11:56
e0nehttps://docs.openstack.org/infra/manual/developers.html#adding-a-dependency11:57
e0neifat_afek: yes. why you you afraid to do it?11:57
ifat_afekcool! we could have used it several times11:57
e0ne*why are you11:57
ifat_afekbecause git sometime messes things up if you don’t do it right… and we weren’t aware of this specific option11:58
ifat_afekand also - what happens if you need to make a change in the middle commit?11:58
e0neI can do it with git rebase11:59
ifat_afekok, I learned something new :-)11:59
e0neI'm glad to help you12:00
ifat_afek:-)12:03
*** e0ne has quit IRC12:10
*** e0ne has joined #openstack-vitrage12:12
openstackgerritIdan Hefetz proposed openstack/vitrage master: Api-worker lock graph from changing during API calls  https://review.openstack.org/62656612:28
openstackgerritIdan Hefetz proposed openstack/vitrage master: Fix topology api crashes  https://review.openstack.org/62707212:28
openstackgerritIdan Hefetz proposed openstack/vitrage master: Api-worker sync threads - lock graph from changing during API calls.  https://review.openstack.org/62656612:31
*** e0ne has quit IRC12:47
*** e0ne has joined #openstack-vitrage12:51
*** ifat_afek has quit IRC13:02
*** ifat_afek has joined #openstack-vitrage13:03
*** e0ne has quit IRC13:18
*** e0ne has joined #openstack-vitrage13:28
*** e0ne has quit IRC13:30
*** ifat_afek has quit IRC13:41
*** ifat_afek has joined #openstack-vitrage13:58
openstackgerritBartosz Zurkowski proposed openstack/vitrage master: Add Monasca datasource  https://review.openstack.org/62289914:50
*** eyalb1 has quit IRC15:05
openstackgerritMerged openstack/vitrage master: Api-worker sync threads - lock graph from changing during API calls.  https://review.openstack.org/62656615:06
openstackgerritBartosz Zurkowski proposed openstack/vitrage master: Add Monasca datasource  https://review.openstack.org/62289915:06
openstackgerritIdan Hefetz proposed openstack/vitrage master: Fix topology api crashes  https://review.openstack.org/62707215:06
*** bobh has joined #openstack-vitrage15:49
*** bobh has quit IRC15:53
*** bobh_ has joined #openstack-vitrage15:53
*** bobh_ has quit IRC16:53
*** bobh has joined #openstack-vitrage17:12
*** bobh has quit IRC17:16
*** bobh has joined #openstack-vitrage17:28
openstackgerritBartosz Zurkowski proposed openstack/vitrage master: Add Monasca datasource  https://review.openstack.org/62289917:34
*** ifat_afek has quit IRC17:45
*** bobh has quit IRC18:13
*** e0ne has joined #openstack-vitrage18:56
*** e0ne has quit IRC18:57
*** e0ne has joined #openstack-vitrage20:07
*** e0ne has quit IRC20:13
*** e0ne has joined #openstack-vitrage20:51
*** e0ne has quit IRC20:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!