*** hamalq has quit IRC | 00:06 | |
*** dviroel has quit IRC | 00:12 | |
*** timburke has joined #openstack-infra | 00:26 | |
openstackgerrit | Ade Lee proposed openstack/openstack-zuul-jobs master: Add FIPS job https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/790534 | 00:43 |
---|---|---|
*** gyee has quit IRC | 01:06 | |
*** __ministry has joined #openstack-infra | 01:12 | |
*** ysandeep|SL is now known as ysandeep | 01:54 | |
*** whoami-rajat has quit IRC | 02:18 | |
*** zxiiro has quit IRC | 02:19 | |
*** ysandeep is now known as ysandeep|afk | 03:23 | |
*** carloss has quit IRC | 03:49 | |
*** lajoskatona has joined #openstack-infra | 03:56 | |
*** rlandy has quit IRC | 03:57 | |
*** lajoskatona has quit IRC | 04:00 | |
*** ykarel has joined #openstack-infra | 04:53 | |
*** ralonsoh has joined #openstack-infra | 05:10 | |
*** fdegir has quit IRC | 05:26 | |
*** fdegir has joined #openstack-infra | 05:26 | |
*** cgoncalves has quit IRC | 05:27 | |
*** cgoncalves has joined #openstack-infra | 05:27 | |
*** bnemec has quit IRC | 05:27 | |
*** bnemec has joined #openstack-infra | 05:29 | |
*** vishalmanchanda has joined #openstack-infra | 06:22 | |
*** dklyle has quit IRC | 06:39 | |
*** ysandeep|afk is now known as ysandeep | 06:48 | |
*** jcapitao has joined #openstack-infra | 06:49 | |
*** sboyron has joined #openstack-infra | 06:49 | |
*** sshnaidm|afk has quit IRC | 07:03 | |
*** sshnaidm has joined #openstack-infra | 07:20 | |
*** hashar has joined #openstack-infra | 07:22 | |
*** andrewbonney has joined #openstack-infra | 07:23 | |
*** ramishra has quit IRC | 07:24 | |
*** ramishra has joined #openstack-infra | 07:25 | |
*** ociuhandu has joined #openstack-infra | 07:35 | |
*** rpittau|afk is now known as rpittau | 07:38 | |
*** tosky has joined #openstack-infra | 07:39 | |
*** dasm has quit IRC | 07:41 | |
*** mgoddard has quit IRC | 07:45 | |
*** ociuhandu has quit IRC | 07:45 | |
*** ociuhandu has joined #openstack-infra | 07:46 | |
*** mgoddard has joined #openstack-infra | 07:50 | |
*** ociuhandu has quit IRC | 07:50 | |
*** jpena|off is now known as jpena | 07:51 | |
*** dasm has joined #openstack-infra | 08:00 | |
*** lucasagomes has joined #openstack-infra | 08:11 | |
*** ociuhandu has joined #openstack-infra | 08:16 | |
*** ociuhandu has quit IRC | 08:17 | |
*** ociuhandu has joined #openstack-infra | 08:17 | |
*** lpetrut has joined #openstack-infra | 08:22 | |
*** rcernin has quit IRC | 08:32 | |
*** dciabrin has quit IRC | 08:36 | |
*** dciabrin has joined #openstack-infra | 08:36 | |
openstackgerrit | Lajos Katona proposed openstack/project-config master: Rename x/tap-as-a-service to openstack/tap-as-a-service https://review.opendev.org/c/openstack/project-config/+/790093 | 08:43 |
*** gfidente|afk is now known as gfidente | 09:01 | |
*** rcernin has joined #openstack-infra | 09:09 | |
*** ykarel_ has joined #openstack-infra | 09:19 | |
*** ykarel has quit IRC | 09:21 | |
*** rcernin has quit IRC | 09:27 | |
*** ykarel_ is now known as ykarel | 09:28 | |
*** rcernin has joined #openstack-infra | 09:34 | |
*** ociuhandu has quit IRC | 09:52 | |
*** rcernin has quit IRC | 09:53 | |
*** ykarel is now known as ykarel|lunch | 09:54 | |
*** ykarel_ has joined #openstack-infra | 09:58 | |
*** ykarel|lunch has quit IRC | 10:00 | |
*** ociuhandu has joined #openstack-infra | 10:10 | |
*** dtantsur|afk is now known as dtantsur | 10:15 | |
*** lpetrut has quit IRC | 10:30 | |
*** rcernin has joined #openstack-infra | 10:44 | |
*** rcernin has quit IRC | 10:48 | |
*** carloss has joined #openstack-infra | 10:55 | |
*** ykarel_ is now known as ykarel | 10:56 | |
*** lpetrut has joined #openstack-infra | 10:56 | |
*** jcapitao is now known as jcapitao_lunch | 10:57 | |
*** ysandeep is now known as ysandeep|afk | 11:11 | |
*** dviroel has joined #openstack-infra | 11:11 | |
*** jpena is now known as jpena|lunch | 11:15 | |
*** ociuhandu has quit IRC | 11:21 | |
*** ociuhandu has joined #openstack-infra | 11:22 | |
*** ociuhandu has quit IRC | 11:26 | |
*** lpetrut has quit IRC | 11:27 | |
*** gfidente has quit IRC | 11:37 | |
*** ysandeep|afk is now known as ysandeep | 11:40 | |
*** rlandy has joined #openstack-infra | 11:40 | |
*** gfidente has joined #openstack-infra | 11:41 | |
*** jcapitao_lunch is now known as jcapitao | 11:46 | |
sean-k-mooney | clarkb: quick question how do you currently ingest the logs into logstation are the files parsed form txt or do you convert them to json first? | 11:53 |
*** jpena|lunch is now known as jpena | 11:56 | |
*** ociuhandu has joined #openstack-infra | 11:58 | |
*** ociuhandu has quit IRC | 12:02 | |
*** dpawlik has quit IRC | 12:12 | |
*** ykarel_ has joined #openstack-infra | 12:18 | |
*** ociuhandu has joined #openstack-infra | 12:19 | |
*** dpawlik3 has joined #openstack-infra | 12:20 | |
*** ykarel has quit IRC | 12:20 | |
*** dpawlik3 is now known as dpawlik | 12:26 | |
sean-k-mooney | oh https://opendev.org/openstack/logstash-filters/src/branch/master/filters/openstack-filters.conf is how you ingest them today | 12:27 |
*** nweinber has joined #openstack-infra | 12:35 | |
*** ociuhandu has quit IRC | 12:43 | |
*** jaicaa has quit IRC | 12:47 | |
*** jaicaa has joined #openstack-infra | 12:47 | |
*** dwilde has joined #openstack-infra | 12:53 | |
*** dwilde has quit IRC | 13:04 | |
*** ociuhandu has joined #openstack-infra | 13:09 | |
*** rcernin has joined #openstack-infra | 13:13 | |
*** ociuhandu has quit IRC | 13:14 | |
*** ociuhandu has joined #openstack-infra | 13:23 | |
*** dwilde has joined #openstack-infra | 13:25 | |
*** rcernin has quit IRC | 13:26 | |
*** dwilde has quit IRC | 13:34 | |
*** Roamer` has quit IRC | 13:38 | |
*** ykarel_ has quit IRC | 13:42 | |
*** ykarel_ has joined #openstack-infra | 13:44 | |
*** stephenfin has quit IRC | 13:56 | |
*** dwilde has joined #openstack-infra | 13:57 | |
*** jcapitao has quit IRC | 13:58 | |
*** dwilde has quit IRC | 13:59 | |
*** dwilde has joined #openstack-infra | 13:59 | |
*** jcapitao has joined #openstack-infra | 13:59 | |
*** iurygregory has quit IRC | 14:22 | |
*** iurygregory has joined #openstack-infra | 14:22 | |
*** happyhemant has joined #openstack-infra | 14:24 | |
*** ykarel_ is now known as ykarel | 14:25 | |
fungi | sean-k-mooney: yep, the reason it's in its own repo is that openstack operators ostensibly had an interest in collaborating on those filters so they could be used in production environments too, though i have no idea to what extent that actually happened in the end | 14:26 |
*** hashar is now known as hasharAway | 14:29 | |
sean-k-mooney | godaddy had there own set https://github.com/godaddy/openstack-logstash | 14:34 |
sean-k-mooney | but ya not sure | 14:34 |
*** stephenfin has joined #openstack-infra | 14:34 | |
*** ykarel has quit IRC | 14:42 | |
gmann | fungi: clarkb mnaser can you check this quick one once have time -https://review.opendev.org/c/openstack/project-config/+/790056 | 14:46 |
clarkb | sean-k-mooney: fungi: yup its the same logs you see in the log dir for jobs. We have thought about doing json but then we'd need two copies of the logs which isn't great (because humans don't read json as easily) | 14:53 |
openstackgerrit | Merged openstack/project-config master: Retire puppet-glare - Step 1: End project Gating https://review.opendev.org/c/openstack/project-config/+/790056 | 14:56 |
sean-k-mooney | clarkb: ya after debuging customer issue with the logs in json format i agre it very human unfriendly | 15:04 |
sean-k-mooney | clarkb: there is apprently a tool in olso to convert form json to text but that is still proably more complex then we want | 15:05 |
clarkb | sean-k-mooney: that is good to know about the tool, but I agree that would just make it less likely epople debug failures | 15:05 |
sean-k-mooney | well i was thinking we would log in json the convert to text and only store the text in swift | 15:06 |
sean-k-mooney | but ya more complex and proably not worth the effort | 15:06 |
clarkb | well we need to store what we index (at least in the current system) | 15:07 |
fungi | any time i need to read json i end up leaning on SpamapS's https://pypi.org/project/flamel/ | 15:07 |
fungi | it's indispensable | 15:08 |
sean-k-mooney | fungi: the json format puts every line into a json object | 15:08 |
sean-k-mooney | even if it converted to yaml its pretty hard to digest | 15:08 |
fungi | oh, ew | 15:09 |
clarkb | ya its there to simplify ingestion to elasticsearch | 15:09 |
*** ociuhandu has quit IRC | 15:09 | |
clarkb | but terrible for humans | 15:09 |
clarkb | you can basically skip the logstash step if you do this | 15:09 |
clarkb | as the data is preparsed | 15:09 |
sean-k-mooney | there is also nataiveish fluentd supprot in oslo log | 15:09 |
*** dave-mccowan has quit IRC | 15:10 | |
sean-k-mooney | its just a tweak to the normal json output | 15:10 |
sean-k-mooney | clarkb: i can proably find it but did ye just use the tail plugin to load the log files or did ye do somehting smarter | 15:11 |
sean-k-mooney | oh are ye taking it via tcp https://opendev.org/opendev/system-config/src/branch/master/modules/openstack_project/templates/logstash/input.conf.erb | 15:12 |
clarkb | sean-k-mooney: its a bit more complicated because when this all originated the way ELK recommended it was via redis and that worked for about 2 files before it fell over and OOM'd | 15:13 |
sean-k-mooney | hehe i see | 15:13 |
clarkb | sean-k-mooney: what we do is zuul jobs submit a gearman job to a gearman server. We then have small python daemons that look for gearman jobs on that server that will download the file and push them via tcp to logstash | 15:13 |
sean-k-mooney | oh is that code somewhere | 15:14 |
*** dklyle has joined #openstack-infra | 15:14 | |
clarkb | the gearman stuff is an implementation detail. I think doing the push over tcp like that is probably sane though | 15:14 |
clarkb | sean-k-mooney: https://opendev.org/opendev/puppet-log_processor/src/branch/master/files/log-gearman-worker.py | 15:14 |
sean-k-mooney | i was considering using fluentd since kolla can deploy that isntead of logstach and pushign over http or tcp | 15:14 |
clarkb | fluentd cannot do the necessary data parsing last I checked | 15:15 |
*** dave-mccowan has joined #openstack-infra | 15:15 | |
sean-k-mooney | it has regex parsers but not sure if it can fully work | 15:15 |
sean-k-mooney | i could just use logstash too for what its worth | 15:15 |
clarkb | depending on the use case that is a good or a bad thing. For us it is a bad thing because we've got 50 different file formats and they all need massaging | 15:15 |
fungi | for a replacement, i would probably reconsider the zuul job injecting things into geard approach, fwiw | 15:15 |
clarkb | sean-k-mooney: oh if they added proper parsing then fluentd may work | 15:15 |
sean-k-mooney | there is a sampel opsnestack parser https://github.com/fluent/fluent-bit/blob/master/conf/parsers_openstack.conf | 15:16 |
sean-k-mooney | im not sure if that actully works | 15:16 |
clarkb | oh wow they basically reimplemtned logstash after asserting the logstash approach was wrong :) | 15:16 |
sean-k-mooney | they have parser plugins | 15:17 |
*** ociuhandu has joined #openstack-infra | 15:17 | |
fungi | at this point, zuul's api is robust and a new implementation could probably query zuul to find completed builds and get the log urls that way | 15:17 |
clarkb | sean-k-mooney: ya so the main formats we handle are: the console log, "oslofmt" basically openstack services except swift, syslog/journald, apache combined log format | 15:17 |
clarkb | fungi: yup | 15:17 |
clarkb | swift uses apache combined log format | 15:18 |
sean-k-mooney | fungi: well that was kind of what i was thinking. i was contempleatin runnign my own zuul instance that would listen for comments form upstream zuul for -1 in a pipline | 15:18 |
sean-k-mooney | that would trigger a jobs that would downwload the output, process it if need and uploaded it to fulentd | 15:19 |
sean-k-mooney | im not sure that is a good idea or not | 15:19 |
sean-k-mooney | but basically wanted to fiture out how to injest logs first | 15:19 |
fungi | sean-k-mooney: thinking about it, i would probably not even worry about event streams | 15:20 |
fungi | treat the zul builds api as a queue, and poll it periodically to check for new work | 15:20 |
fungi | er, zuul i mean | 15:21 |
sean-k-mooney | oh well i was thinking of having zuul anyway | 15:21 |
fungi | though zul isn't in this channel at the moment so i don't need to apologize for the ping ;) | 15:21 |
sean-k-mooney | but i could have it run in a perodic instead | 15:21 |
*** ociuhandu has quit IRC | 15:22 | |
fungi | ahh, yeah that's a great point, a second zuul to react to reports in gerrit and use that to coordinate the indexing work | 15:22 |
*** hjensas is now known as hjensas|afk | 15:22 | |
*** ociuhandu has joined #openstack-infra | 15:22 | |
fungi | though not all builds are reported in gerrit | 15:23 |
sean-k-mooney | like the perodics | 15:23 |
fungi | zactly | 15:23 |
fungi | also post, tag, et cetera | 15:23 |
sean-k-mooney | ya gate and check are though which woudl be a start | 15:23 |
sean-k-mooney | ok ill think about it anyway | 15:24 |
sean-k-mooney | there isnt a zuul zuul triger is there :P | 15:24 |
sean-k-mooney | havign zuul trigger form extrenal zuul will only end bardly eventually :) | 15:25 |
fungi | not sure what you mean by "zuul zuul trigger" | 15:26 |
clarkb | there is a zuul driver but I think that may be for internal events, I don't think there is a way to expose those externally (yet?) | 15:26 |
clarkb | fungi: one zuul tells another zuul to do work | 15:26 |
fungi | yeah, i mainly am curious what channel such a trigger would use | 15:26 |
sean-k-mooney | clarkb: yep | 15:26 |
fungi | probably a webhook sort of driver | 15:27 |
sean-k-mooney | fungi: well i was thinkign of havign it check the zuul reset api for complete jobs or something like that | 15:27 |
sean-k-mooney | anyway it was not intended as a real idea because a cron job would proably work jsut as well | 15:27 |
sean-k-mooney | anyway im going to redploy my home infrastucure later this week and once i have a clean slate ill see how best i can use it. | 15:31 |
sean-k-mooney | the zuul api might be a bettere way to go or i might realise that this is too much work to actully run locally | 15:33 |
*** ysandeep is now known as ysandeep|away | 15:48 | |
*** lucasagomes has quit IRC | 15:58 | |
*** jcapitao has quit IRC | 15:58 | |
*** ykarel has joined #openstack-infra | 16:00 | |
*** hasharAway is now known as hashar | 16:02 | |
*** lbragstad has quit IRC | 16:04 | |
*** ociuhandu_ has joined #openstack-infra | 16:13 | |
*** jamesden_ has joined #openstack-infra | 16:16 | |
*** lbragstad has joined #openstack-infra | 16:16 | |
*** ociuhandu has quit IRC | 16:17 | |
*** jamesdenton has quit IRC | 16:17 | |
*** ociuhandu_ has quit IRC | 16:18 | |
*** dwilde has quit IRC | 16:18 | |
*** ociuhandu has joined #openstack-infra | 16:25 | |
*** ralonsoh has quit IRC | 16:25 | |
*** dwilde has joined #openstack-infra | 16:25 | |
*** ykarel has quit IRC | 16:29 | |
*** ociuhandu has quit IRC | 16:30 | |
*** dtantsur is now known as dtantsur|afk | 16:32 | |
*** zxiiro has joined #openstack-infra | 16:33 | |
*** sboyron has quit IRC | 16:34 | |
*** dwilde has quit IRC | 16:35 | |
*** rpittau is now known as rpittau|afk | 16:36 | |
*** dwilde has joined #openstack-infra | 16:41 | |
sean-k-mooney | clarkb: fungi if ye are around i have a different question. | 16:48 |
sean-k-mooney | teh review priority lable | 16:49 |
fungi | yah | 16:49 |
sean-k-mooney | is that sticky | 16:49 |
sean-k-mooney | e.g. will it persist across patch revisions | 16:49 |
fungi | whether or not a label persists across reviews is configurable per label (and per project) | 16:49 |
sean-k-mooney | ya so i was looking for the dfintion in https://github.com/openstack/project-config | 16:49 |
sean-k-mooney | but i have not found it yet | 16:50 |
fungi | the various copy options listed at https://review.opendev.org/Documentation/config-labels.html#label_layout control those behaviors | 16:50 |
sean-k-mooney | perhaps its not public or loaded htere but i did not see the project.config file | 16:51 |
sean-k-mooney | yep | 16:51 |
sean-k-mooney | so maybe defining https://review.opendev.org/Documentation/config-labels.html#label_copyAnyScore | 16:51 |
sean-k-mooney | so in https://review.opendev.org/c/openstack/project-config/+/787523 | 16:52 |
sean-k-mooney | i could set label_copyAnyScore = true | 16:52 |
sean-k-mooney | would i have to do that in each file by redfining the lable | 16:53 |
fungi | we don't define a review-priority label globally, any project which uses one defines that within their own project acl | 16:53 |
sean-k-mooney | oh ok so that is what i missed | 16:54 |
sean-k-mooney | ok so ill copy the lable defition form one fo the other projects and configure it thanks | 16:54 |
fungi | sean-k-mooney: example is https://opendev.org/openstack/project-config/src/branch/master/gerrit/acls/openstack/cinder.config#L25-L35\ | 16:55 |
fungi | er, minus the stray \ at the end of that line | 16:55 |
fungi | which just happens to be adjacent to my return key, enough that my fat fingers added it at the last moment | 16:56 |
clarkb | now that openstack has the meta config it may be worth considering doing a global openstack review priority, but everyone has done it differently so may not be easy | 17:06 |
clarkb | another option is to tag things instead of using reviews | 17:07 |
*** jpena is now known as jpena|off | 17:07 | |
*** andrewbonney has quit IRC | 17:07 | |
fungi | yeah, getting consensus between teams on how those new labels are used would be a necessary first step | 17:09 |
fungi | one that i would be happy to leave to the tc (who would likely delegate the fact finding to a volunteer pop-up team) | 17:10 |
*** gfidente is now known as gfidente|afk | 17:11 | |
sean-k-mooney | at least the nova usecase is 2 fold. one directing active review capasity(core and non core) and two, potentailly providing an async way for contibutors to singal to cores that they would like something to be a priortiy | 17:20 |
sean-k-mooney | ill admit i was more thinkign of the former case which seams to be what cinder is using it for | 17:20 |
fungi | sean-k-mooney: and yeah, recommend also considering hashtags as an alternative implementation | 17:21 |
sean-k-mooney | hastags? | 17:21 |
sean-k-mooney | can you point me at an example | 17:21 |
fungi | sean-k-mooney: the quick intro is at https://review.opendev.org/Documentation/intro-user.html#hashtags | 17:22 |
sean-k-mooney | is that similar to the topic? | 17:23 |
sean-k-mooney | oh its sperate | 17:23 |
fungi | you can have more than one on a change, unlike the review topic field | 17:23 |
sean-k-mooney | oh i see it in the ui | 17:23 |
sean-k-mooney | there is no input bug | 17:23 |
sean-k-mooney | ah | 17:24 |
sean-k-mooney | ADD HASHTAG | 17:24 |
sean-k-mooney | dose not show up in dark mode | 17:24 |
fungi | sean-k-mooney: it has to be enabled, https://opendev.org/openstack/project-config/src/branch/master/gerrit/acls/zuul/zuul.config#L6 | 17:24 |
fungi | i think it will error when you try to set one otherwise | 17:24 |
fungi | though we've been talking about enabling it system-wide | 17:25 |
sean-k-mooney | oh acutlly it does | 17:25 |
sean-k-mooney | https://review.opendev.org/c/openstack/project-config/+/787523 has it | 17:25 |
sean-k-mooney | but i dont see it on https://review.opendev.org/c/openstack/neutron/+/766277/ | 17:25 |
sean-k-mooney | oh that mereged | 17:26 |
sean-k-mooney | ok so its by acl | 17:26 |
sean-k-mooney | fungi: i could see that as useful for catagorising patches | 17:26 |
*** dklyle has quit IRC | 17:26 | |
sean-k-mooney | as in "networking" "live-migration" "ui" ectra | 17:27 |
*** dklyle has joined #openstack-infra | 17:27 | |
clarkb | ya we've been talking about enabling it gerrit wide. Probably not a bad followup to fungi's All-Project acl cleanups | 17:27 |
clarkb | sean-k-mooney: you can also set 'priority' and 'back-port' | 17:27 |
*** hashar is now known as hasharAway | 17:27 | |
sean-k-mooney | yes you could | 17:27 |
clarkb | it gives you a bit of freedom where the voting mechanism is rigid | 17:27 |
sean-k-mooney | i would see it like the tags we have in launchpad | 17:28 |
sean-k-mooney | i can raise this with the wider nova tema as a possible alternitive implemation or we could use both in paralle once we defien what we want to achive | 17:29 |
sean-k-mooney | for example we coudl have a need-priorty tag and then have core review that or somehting but that | 17:30 |
clarkb | I think ironic is doing both. I personally think that will just cause confusion but I'm happy for others to use the features how they want | 17:30 |
sean-k-mooney | clarkb: does the hashtags feature supprot proptign for existing tags | 17:32 |
sean-k-mooney | as you can proably tell if i have to spell thing consitenlty well its proably not going to happen :) | 17:33 |
clarkb | I'm not sure. I haven't really used it myself yet | 17:34 |
clarkb | you can search by them though which is a big thing for most I think | 17:34 |
*** dwilde has quit IRC | 17:34 | |
*** dwilde has joined #openstack-infra | 17:48 | |
*** lpetrut has joined #openstack-infra | 17:55 | |
*** lpetrut has quit IRC | 17:57 | |
*** dwilde has quit IRC | 18:05 | |
*** dwilde has joined #openstack-infra | 18:07 | |
*** happyhemant has quit IRC | 18:23 | |
*** whoami-rajat_ has joined #openstack-infra | 18:33 | |
*** vishalmanchanda has quit IRC | 18:34 | |
*** gyee has joined #openstack-infra | 18:45 | |
*** hamalq has joined #openstack-infra | 18:50 | |
*** yoctozepto has quit IRC | 19:13 | |
*** yoctozepto6 has joined #openstack-infra | 19:13 | |
*** dwilde has quit IRC | 19:39 | |
*** dwilde has joined #openstack-infra | 19:57 | |
*** nweinber has quit IRC | 20:00 | |
*** hamalq has quit IRC | 20:09 | |
*** rpioso has quit IRC | 20:09 | |
*** lxkong has quit IRC | 20:09 | |
*** srwilkers has quit IRC | 20:09 | |
*** Adri2000 has quit IRC | 20:09 | |
*** erbarr has quit IRC | 20:11 | |
*** hamalq has joined #openstack-infra | 20:13 | |
*** rpioso has joined #openstack-infra | 20:13 | |
*** lxkong has joined #openstack-infra | 20:13 | |
*** srwilkers has joined #openstack-infra | 20:13 | |
*** Adri2000 has joined #openstack-infra | 20:13 | |
*** erbarr has joined #openstack-infra | 20:13 | |
*** JanZerebecki[m] has quit IRC | 20:16 | |
*** dirk has quit IRC | 20:17 | |
*** wolsen has quit IRC | 20:17 | |
*** hasharAway has quit IRC | 20:27 | |
mtreinish | clarkb, fungi: do you think it would be possible to get an archive of the subunit2sql db before it's retired? | 20:29 |
mtreinish | not that I've been actively doing much dev on subunit2sql lately, but having such a large dataset was useful in the past for testing various things on the project | 20:29 |
fungi | mtreinish: probably, yeah | 20:29 |
fungi | the real trick is finding scratch space to do the mysqldump | 20:30 |
fungi | (it's not small) | 20:30 |
fungi | it's not like we're turning any of this off tomorrow though, just getting the conversation going, setting expectations, working out logistics | 20:31 |
*** dirk has joined #openstack-infra | 20:42 | |
mtreinish | I've got plenty of space locally, I remember we looked into this for a db migration a long time ago and can't remember what we ended up doing | 20:45 |
mtreinish | I seem to remember the trove db has very tight restrictions on connecting to it, I wonder if we can use the readonly proxy with mysqldump | 20:45 |
*** JanZerebecki[m] has joined #openstack-infra | 20:46 | |
fungi | probably? | 20:46 |
fungi | worth testing that anyway | 20:47 |
mtreinish | I'll have to reread the man page and give it a go | 20:47 |
*** wolsen has joined #openstack-infra | 20:48 | |
fungi | mysqldump -h <hostname> -p -u <username> <database> | xz > dump.sql.xz | 20:48 |
fungi | something like that should work | 20:49 |
fungi | it'll prompt interactively for the "password" | 20:49 |
mtreinish | ah, right I remeber this now. It requires more permissions than the basic read we gave the public user: | 20:51 |
mtreinish | mysqldump: Got error: 1044: "Access denied for user 'query'@'%' to database 'subunit2sql'" when using LOCK TABLES | 20:52 |
fungi | ahh, okay | 20:52 |
fungi | you should be able to tell mysqldump not to try to lock? | 20:52 |
mtreinish | yeah, looks like --skip-lock-tables | 20:53 |
mtreinish | it seems to be working | 20:53 |
fungi | right on | 20:53 |
*** JanZerebecki[m] has quit IRC | 20:57 | |
*** dirk has quit IRC | 21:02 | |
*** wolsen has quit IRC | 21:03 | |
*** dwilde has quit IRC | 21:03 | |
*** slaweq has quit IRC | 21:19 | |
*** JanZerebecki[m] has joined #openstack-infra | 21:26 | |
*** wolsen has joined #openstack-infra | 21:29 | |
*** dirk has joined #openstack-infra | 21:30 | |
*** brtknr has quit IRC | 21:47 | |
*** brtknr has joined #openstack-infra | 21:47 | |
*** dhill has quit IRC | 21:58 | |
*** dhill has joined #openstack-infra | 22:00 | |
*** rcernin has joined #openstack-infra | 22:05 | |
*** rcernin has quit IRC | 22:27 | |
*** rcernin has joined #openstack-infra | 23:02 | |
*** dave-mccowan has quit IRC | 23:02 | |
*** rcernin has quit IRC | 23:02 | |
*** rcernin has joined #openstack-infra | 23:02 | |
*** whoami-rajat_ is now known as whoami-rajat | 23:05 | |
*** dave-mccowan has joined #openstack-infra | 23:06 | |
*** tosky has quit IRC | 23:24 | |
*** zzzeek has quit IRC | 23:34 | |
*** zzzeek has joined #openstack-infra | 23:35 | |
*** zxiiro has quit IRC | 23:38 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!