| *** markvoelker has joined #openstack-infra | 00:00 | |
| *** markvoelker has quit IRC | 00:05 | |
| *** owalsh has joined #openstack-infra | 00:13 | |
| *** mattw4 has quit IRC | 00:19 | |
| *** markvoelker has joined #openstack-infra | 00:22 | |
| *** mriedem_away is now known as mriedem | 00:32 | |
| *** mriedem has quit IRC | 00:33 | |
| *** michael-beaver has quit IRC | 00:35 | |
| *** gyee has quit IRC | 00:36 | |
| *** markvoelker has quit IRC | 00:47 | |
| *** rh-jelabarre has joined #openstack-infra | 00:48 | |
| *** armax has joined #openstack-infra | 00:49 | |
| *** larainema has joined #openstack-infra | 01:00 | |
| *** whoami-rajat has quit IRC | 01:04 | |
| *** bobh has joined #openstack-infra | 01:24 | |
| *** rosmaita has joined #openstack-infra | 01:32 | |
| *** mattw4 has joined #openstack-infra | 01:33 | |
| *** Goneri has quit IRC | 01:35 | |
| *** bobh has quit IRC | 01:38 | |
| *** apetrich has quit IRC | 02:10 | |
| *** mattw4 has quit IRC | 02:23 | |
| *** gregoryo has joined #openstack-infra | 02:32 | |
| *** noorul has joined #openstack-infra | 02:35 | |
| *** dave-mccowan has joined #openstack-infra | 02:36 | |
| *** markvoelker has joined #openstack-infra | 02:40 | |
| *** noorul has quit IRC | 02:44 | |
| *** noorul has joined #openstack-infra | 02:45 | |
| *** markvoelker has quit IRC | 02:46 | |
| *** goldyfruit has quit IRC | 03:01 | |
| *** psachin has joined #openstack-infra | 03:01 | |
| *** noorul has quit IRC | 03:04 | |
| openstackgerrit | Paul Belanger proposed openstack/project-config master: Set protected / final for propose-updates job https://review.opendev.org/678129 | 03:05 |
|---|---|---|
| *** noorul has joined #openstack-infra | 03:09 | |
| openstackgerrit | Paul Belanger proposed openstack/project-config master: Set protected for propose-updates job https://review.opendev.org/678129 | 03:09 |
| *** noorul has quit IRC | 03:13 | |
| *** ramishra has joined #openstack-infra | 03:17 | |
| *** markvoelker has joined #openstack-infra | 03:20 | |
| *** markvoelker has quit IRC | 03:25 | |
| openstackgerrit | Merged openstack/project-config master: Set protected for propose-updates job https://review.opendev.org/678129 | 03:30 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Move external propose-updates changes to project-config https://review.opendev.org/678135 | 03:32 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Move external propose-updates changes to project-config https://review.opendev.org/678135 | 03:36 |
| *** zhangfei has joined #openstack-infra | 03:48 | |
| *** armax has quit IRC | 03:51 | |
| openstackgerrit | Merged openstack/project-config master: Move external propose-updates changes to project-config https://review.opendev.org/678135 | 03:56 |
| *** raukadah is now known as chkumar|rover | 04:04 | |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Handle sphinx PDF files https://review.opendev.org/678077 | 04:06 |
| *** rh-jelabarre has quit IRC | 04:09 | |
| AJaeger | config-core, could you review https://review.opendev.org/677647 as next promote change, please? | 04:10 |
| *** ricolin has quit IRC | 04:14 | |
| *** ricolin has joined #openstack-infra | 04:21 | |
| *** udesale has joined #openstack-infra | 04:23 | |
| openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Download PDF artifacts as well https://review.opendev.org/678142 | 04:38 |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Handle sphinx PDF files https://review.opendev.org/678077 | 04:39 |
| *** markvoelker has joined #openstack-infra | 04:40 | |
| *** markvoelker has quit IRC | 04:45 | |
| openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Download PDF artifacts as well https://review.opendev.org/678142 | 04:51 |
| *** jaosorior has joined #openstack-infra | 05:01 | |
| *** ricolin has quit IRC | 05:02 | |
| *** ricolin has joined #openstack-infra | 05:03 | |
| openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Download PDF artifacts as well https://review.opendev.org/678142 | 05:06 |
| *** janki has joined #openstack-infra | 05:08 | |
| *** odicha has joined #openstack-infra | 05:13 | |
| openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Download PDF artifacts as well https://review.opendev.org/678142 | 05:14 |
| openstackgerrit | Felix Schmidt proposed zuul/zuul master: Improve visualization retry attempts in UI https://review.opendev.org/678147 | 05:16 |
| *** dave-mccowan has quit IRC | 05:16 | |
| *** adriant has joined #openstack-infra | 05:23 | |
| *** noorul has joined #openstack-infra | 05:26 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Rotate proposal-bot key https://review.opendev.org/678148 | 05:28 |
| openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Download PDF artifacts as well https://review.opendev.org/678142 | 05:28 |
| *** e0ne has joined #openstack-infra | 05:33 | |
| ianw | ahh, gerrit set-account --add-ssh-key says the "content of the public ssh key" not "path to a file containing the content of the public ssh key" ... that would have saved me 20 minutes thinking i'd generated an incompatible key :) | 05:35 |
| *** noorul has quit IRC | 05:36 | |
| *** noorul has joined #openstack-infra | 05:42 | |
| *** apetrich has joined #openstack-infra | 05:42 | |
| *** e0ne has quit IRC | 05:44 | |
| *** jbadiapa has quit IRC | 05:47 | |
| *** jbadiapa has joined #openstack-infra | 05:48 | |
| openstackgerrit | Merged openstack/project-config master: Rotate proposal-bot key https://review.opendev.org/678148 | 05:49 |
| *** udesale has quit IRC | 05:55 | |
| *** kopecmartin|off is now known as kopecmartin | 05:55 | |
| *** udesale has joined #openstack-infra | 05:55 | |
| *** gregoryo has quit IRC | 05:56 | |
| AJaeger | ianw: oh fun... | 06:01 |
| AJaeger | ianw: that key is far longer - is that correct? | 06:02 |
| *** ociuhandu has joined #openstack-infra | 06:03 | |
| *** udesale has quit IRC | 06:06 | |
| ianw | i think it's 4096 v probably 2046 | 06:07 |
| *** ociuhandu has quit IRC | 06:07 | |
| AJaeger | cool | 06:08 |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Add promote-openstack-training-guides https://review.opendev.org/678156 | 06:11 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 06:23 |
| *** florianf has joined #openstack-infra | 06:23 | |
| *** florianf has left #openstack-infra | 06:23 | |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Handle sphinx PDF files https://review.opendev.org/678077 | 06:30 |
| openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Download PDF artifacts as well https://review.opendev.org/678142 | 06:31 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [dnm] lb idea https://review.opendev.org/678159 | 06:33 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: DNM: Test PDF building https://review.opendev.org/678160 | 06:35 |
| *** markvoelker has joined #openstack-infra | 06:40 | |
| *** e0ne has joined #openstack-infra | 06:42 | |
| *** e0ne has quit IRC | 06:43 | |
| *** markvoelker has quit IRC | 06:45 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [dnm] lb idea https://review.opendev.org/678159 | 06:47 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [dnm] lb idea https://review.opendev.org/678159 | 06:49 |
| *** e0ne has joined #openstack-infra | 06:53 | |
| *** jpena|off is now known as jpena | 06:59 | |
| *** e0ne has quit IRC | 06:59 | |
| *** takamatsu has joined #openstack-infra | 07:08 | |
| AJaeger | config-core, could you review https://review.opendev.org/677647 as next promote change, please? | 07:11 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [dnm] lb idea https://review.opendev.org/678159 | 07:14 |
| *** ricolin has quit IRC | 07:15 | |
| *** rcernin has quit IRC | 07:15 | |
| *** gfidente|afk is now known as gfidente | 07:20 | |
| *** trident has quit IRC | 07:25 | |
| openstackgerrit | Merged openstack/project-config master: Add starlingx promote jobs https://review.opendev.org/677647 | 07:25 |
| AJaeger | thanks, ianw ! | 07:28 |
| *** lpetrut has joined #openstack-infra | 07:29 | |
| *** jtomasek has joined #openstack-infra | 07:29 | |
| *** trident has joined #openstack-infra | 07:31 | |
| *** andreww has joined #openstack-infra | 07:33 | |
| *** guoqiao_ has joined #openstack-infra | 07:35 | |
| *** xarses_ has quit IRC | 07:37 | |
| *** guoqiao has quit IRC | 07:37 | |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Remove openSUSE 42.3 https://review.opendev.org/677158 | 07:40 |
| *** jtomasek has quit IRC | 07:42 | |
| *** ociuhandu has joined #openstack-infra | 07:44 | |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Remove openSUSE 42.3 https://review.opendev.org/677158 | 07:45 |
| *** ociuhandu has quit IRC | 07:46 | |
| *** Vadmacs has joined #openstack-infra | 07:49 | |
| *** roman_g has joined #openstack-infra | 07:56 | |
| *** roman_g_ has joined #openstack-infra | 07:56 | |
| yoctozepto | hey infra, I discovered some of kolla-ansible jobs did not run in periodic, I proposed the following patch: https://review.opendev.org/678170 - however, I am not sure whether it would better be solved at Zuul's level - periodic never has changes so this pipeline should not check the files? | 07:57 |
| *** ralonsoh has joined #openstack-infra | 07:57 | |
| yoctozepto | whether it wouldn't* be | 07:57 |
| yoctozepto | (tricky double negation) | 07:57 |
| *** e0ne has joined #openstack-infra | 08:05 | |
| *** lucasagomes has joined #openstack-infra | 08:06 | |
| mordred | yoctozepto: I'm still on first coffee, but I think that should work. you're right, becuase there is no change for periodic, file matchers have nothing to match. | 08:09 |
| *** dtantsur|afk is now known as dtantsur | 08:10 | |
| yoctozepto | mordred: yeah and this is true of periodic in general, hence why I'm suggesting to take this into consideration at the infra level, in case other projects wonder the same :-) | 08:12 |
| *** diablo_rojo has joined #openstack-infra | 08:12 | |
| mordred | yah | 08:12 |
| yoctozepto | I'm just not sure whether setting files to .* will help, probably not, hence also why I'm asking | 08:13 |
| yoctozepto | because nothing against .* results in nothing anyway | 08:13 |
| yoctozepto | can I unset it or something? | 08:13 |
| *** rpittau|afk is now known as rpittau | 08:14 | |
| AJaeger | mordred: once you're beyond coffee time, could you review https://review.opendev.org/677286 for shade, please? | 08:18 |
| *** tkajinam has quit IRC | 08:19 | |
| mordred | AJaeger: I'm never *beyond* coffee time | 08:19 |
| AJaeger | mordred: and I have three changes up for the PDF community goal that belong together and would love your advice whether this will all work - including if no PDF is build: https://review.opendev.org/678077 https://review.opendev.org/#/c/678142 https://review.opendev.org/#/c/664555 . This was all tested in https://review.opendev.org/#/c/678080/ with exception of the promote job | 08:19 |
| *** ociuhandu has joined #openstack-infra | 08:20 | |
| *** dchen has quit IRC | 08:20 | |
| AJaeger | mordred: then let me rephrase: Once coffee is a sufficient level ;) | 08:20 |
| mordred | AJaeger: :) | 08:21 |
| *** whoami-rajat has joined #openstack-infra | 08:23 | |
| *** ociuhandu has quit IRC | 08:25 | |
| mordred | AJaeger: the first two look great - very clear and understandable :) | 08:25 |
| AJaeger | yeah, good framework - once you're into it... | 08:26 |
| *** xenos76 has joined #openstack-infra | 08:27 | |
| AJaeger | I just hope I read the code correctly that the promote job works if there are no PDF files to publish... | 08:27 |
| *** lpetrut has quit IRC | 08:31 | |
| mordred | AJaeger: I *think* it does | 08:33 |
| *** roman_g_ has quit IRC | 08:34 | |
| *** roman_g has quit IRC | 08:34 | |
| mordred | AJaeger: left a couple of comments on the tox-docs patch | 08:34 |
| *** roman_g has joined #openstack-infra | 08:34 | |
| frickler | infra-root: can we configure mailman to create digests at least once per day and not wait for almost forever? I've set digest mode on my subscription to release-announcements and just received a digest with 199 mails, making up for almost 2 months' content | 08:40 |
| frickler | if nobody comes up with "ah, that's easy, let me twist this knob", I can start digging myself | 08:40 |
| openstackgerrit | Monty Taylor proposed zuul/zuul master: Write json log file by seeking and appending https://review.opendev.org/676717 | 08:41 |
| AJaeger | mordred: thanks for reviews | 08:41 |
| *** kjackal has joined #openstack-infra | 08:47 | |
| *** janki has quit IRC | 08:48 | |
| *** diablo_rojo has quit IRC | 08:48 | |
| mordred | frickler: uhm. weird. I thought it was already supposed to be like daily or weekly at least | 08:49 |
| mordred | frickler: but I haven't used digest mode so I honestly don't know | 08:50 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [dnm] lb idea https://review.opendev.org/678159 | 08:52 |
| openstackgerrit | Merged zuul/zuul-jobs master: Handle sphinx PDF files https://review.opendev.org/678077 | 08:57 |
| openstackgerrit | Monty Taylor proposed zuul/zuul master: Write errors from ansible execution into json log https://review.opendev.org/676723 | 08:59 |
| roman_g | Hello team. All translation updates jobs for today have failed due to wrong review.opendev.org ssh fingerprint passed to a variable. Would appreciate if someone could take a look, if it's not yet noticed. http://zuul.openstack.org/builds?job_name=propose-translation-update | 09:02 |
| roman_g | Thank you! | 09:02 |
| roman_g | May be other jobs are also affected, didn't check. | 09:03 |
| *** Lucas_Gray has joined #openstack-infra | 09:06 | |
| AJaeger | roman_g: we just updated the variable in change https://review.opendev.org/678148 | 09:06 |
| AJaeger | infra-root, anything wrong with that change? It merged 10 mins before the proposal jobs run... | 09:06 |
| *** Lucas_Gray has quit IRC | 09:11 | |
| roman_g | AJaeger: ssh-keyscan -p 29418 review.opendev.org | 09:11 |
| roman_g | lists old ssh fingerprint | 09:11 |
| roman_g | ending with ...DIXYsy+TVH | 09:12 |
| *** Lucas_Gray has joined #openstack-infra | 09:12 | |
| roman_g | This https://review.opendev.org/#/settings/ssh-keys also lists old fingerprint | 09:13 |
| mordred | hrm. | 09:16 |
| mordred | I'm not sure why that change would have included an update to the fingerprint if all that was happening was rotating the user's jey | 09:16 |
| *** owalsh is now known as owalsh|away | 09:16 | |
| mordred | key | 09:16 |
| mordred | roman_g, AJaeger: I'd suggest a change reverting the fingerprint | 09:17 |
| openstackgerrit | Roman Gorshunov proposed openstack/project-config master: Revert SSH fingerprint of review.opendev.org https://review.opendev.org/678187 | 09:23 |
| roman_g | mordred: AJaeger ^^^ | 09:23 |
| *** Wryhder has joined #openstack-infra | 09:29 | |
| *** ociuhandu has joined #openstack-infra | 09:30 | |
| *** Lucas_Gray has quit IRC | 09:30 | |
| *** Wryhder is now known as Lucas_Gray | 09:30 | |
| zbr | can we please switch a some decent DNS entries for our log hosting? https://ac13160b9f6505cb4f48-58ad23e4ce64c146e6acb1a522568306.ssl.cf1.rackcdn.com --- is a kinda perverse FQDN :) -- also nothing in it is specific to openstack. i had some browser user-scripts for improving the logs. what patterns should I put now? | 09:32 |
| zbr | my url bar now displays only a hex string, nothing more. | 09:32 |
| *** ociuhandu has quit IRC | 09:34 | |
| *** kjackal has quit IRC | 09:46 | |
| mordred | zbr: those are the rackspace CDN urls for the swift containers where the logs are now published- the cloud regions will have other urls and they will vary by job (this is part of moving logs off of the static log server) | 09:47 |
| *** ociuhandu has joined #openstack-infra | 09:47 | |
| *** Lucas_Gray has quit IRC | 09:48 | |
| mordred | zbr: the zuul dashboard will now render many of the logs and does things with them, and those urls should be stable | 09:48 |
| mordred | but maybe your log viewing improvements are applicable to the zuul dashboard rendering? | 09:49 |
| zbr | mordred: not sure yet, mainly i am talking about the regexes that are coloring errors and warnings in our B&W logs, so I waste less time scrolling in order to find the task that failed. | 09:53 |
| zbr | if we would have ANSI, their benefits would be considerably less important. | 09:54 |
| zbr | for the moment i whilelisted the entire domain, and i will see how to goes. | 09:55 |
| openstackgerrit | Merged openstack/project-config master: Revert SSH fingerprint of review.opendev.org https://review.opendev.org/678187 | 09:55 |
| *** Lucas_Gray has joined #openstack-infra | 09:58 | |
| zbr | the new dashboard also made few steps back, now I see myself without any usable error on main page, having to click Logs tab, pressing the job-output.txt to open the file that used to be the first. Or pressing the Console tab (when it appears, ages later, and hopping that it will display a meaningful error. -- i got lots of cases, especially around deployment where the errored task was a shell command with entire output redirected to a log, | 09:59 |
| zbr | when this happens, i need to go backto file browser and find that particular file. | 09:59 |
| zbr | one of my regexes was conferting log-filenames to urls (success rate ~60-70%), but saved a huge amount of time because I could click the filename and load that particular log. | 10:00 |
| zbr | with the new log browsing experience this no longer works, but maybe we could make it work. | 10:01 |
| *** psachin has quit IRC | 10:04 | |
| *** psachin has joined #openstack-infra | 10:05 | |
| *** ociuhandu has quit IRC | 10:10 | |
| mordred | zbr: yeah - there's code in the dashboard for filtering by error/warning/etc - so one would expect that to be able to be applied to things like coloring. also - the main page should still be showing the error, so it would be worth debugging why you're not seeing that anymore. linking to an output redirection target seems like a potentially nice thing if we can figure out a solid way to do it | 10:10 |
| *** jaosorior has quit IRC | 10:10 | |
| roman_g | mordred, frickler thanks | 10:12 |
| zbr | mordred: finding the right path for the file is a very tricky business. but if we can load the list of log files as json, we could mainly transform it into a grep. | 10:15 |
| zbr | collected_files | grep filename_from_console | ... hopefully one result to make it URL. | 10:16 |
| ianw | mordred / roman_g : sorry, my bad on that. now i look again i don't know what i was thinking | 10:17 |
| roman_g | ianw: no problem at all. just re-trigger all http://zuul.openstack.org/builds?job_name=propose-translation-update jobs ;) | 10:18 |
| roman_g | not obligatory, but would be helpful. | 10:19 |
| ianw | ummm, let me see... | 10:22 |
| *** jaosorior has joined #openstack-infra | 10:27 | |
| ianw | roman_g: i think http://paste.openstack.org/show/762528/ will get it | 10:28 |
| roman_g | ianw: openstack/i18n, please. | 10:28 |
| roman_g | thanks! | 10:28 |
| *** guoqiao_ has quit IRC | 10:30 | |
| ianw | roman_g: i get the feeling it's not working ... and now i remember http://lists.zuul-ci.org/pipermail/zuul-discuss/2019-May/000914.html where i tried this before | 10:35 |
| ianw | i think may need the HEAD of each of those :/ | 10:36 |
| ianw | i'm sorry but i've run out of time to investigate further right now | 10:37 |
| roman_g | ianw: don't worry. it will be re-triggered tomorrow morning, which is not bad at all | 10:37 |
| roman_g | thanks for attempt anyway :) | 10:37 |
| *** odicha has quit IRC | 10:37 | |
| ianw | mordred: ^ perhaps you could take a look? http://lists.zuul-ci.org/pipermail/zuul-discuss/2019-May/000909.html i still think stands as our documentation is not correct, at least | 10:38 |
| zbr | mordred: what was the dirty trick to use to convince zuul to re-gate https://review.opendev.org/#/c/639951/ ? --- i tries abandon/restore, adding -W and removing it, recheck, nothing seems to convince it to reschedule it on https://zuul.opendev.org/t/openstack/status | 10:39 |
| *** guoqiao_ has joined #openstack-infra | 10:42 | |
| *** ociuhandu has joined #openstack-infra | 10:43 | |
| *** Lucas_Gray has quit IRC | 10:46 | |
| *** stakeda has quit IRC | 10:47 | |
| AJaeger | zbr: recheck should work - and I don't see you trying it. | 10:50 |
| *** odicha has joined #openstack-infra | 10:50 | |
| AJaeger | The +w/-W does not work due to the -2 | 10:50 |
| AJaeger | Ah, there's a recheck... | 10:50 |
| AJaeger | zbr: now it's in the queue... | 10:52 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Optionally allow zoned executors to process unzoned jobs https://review.opendev.org/673840 | 10:52 |
| *** odicha has quit IRC | 10:52 | |
| *** odicha has joined #openstack-infra | 10:54 | |
| *** lpetrut has joined #openstack-infra | 10:56 | |
| *** kjackal has joined #openstack-infra | 10:59 | |
| *** apetrich has quit IRC | 11:08 | |
| *** apetrich has joined #openstack-infra | 11:09 | |
| *** rfolco is now known as rfolco|brb | 11:10 | |
| *** tesseract has joined #openstack-infra | 11:12 | |
| *** goldyfruit has joined #openstack-infra | 11:14 | |
| *** Lucas_Gray has joined #openstack-infra | 11:15 | |
| *** rfolco|brb is now known as rfolco | 11:17 | |
| *** bauzas has quit IRC | 11:18 | |
| *** bauzas has joined #openstack-infra | 11:19 | |
| *** Lucas_Gray has quit IRC | 11:19 | |
| openstackgerrit | Felix Schmidt proposed zuul/zuul master: Make direct-push configurable on project-level https://review.opendev.org/677109 | 11:21 |
| openstackgerrit | Felix Schmidt proposed zuul/zuul master: Implement push job in merger https://review.opendev.org/677110 | 11:21 |
| openstackgerrit | Felix Schmidt proposed zuul/zuul master: Push changes in GerritReporter if direct-push is enabled https://review.opendev.org/677111 | 11:21 |
| openstackgerrit | Merged opendev/bindep master: Expose base python version as an atom https://review.opendev.org/639951 | 11:23 |
| *** apetrich has quit IRC | 11:24 | |
| *** Lucas_Gray has joined #openstack-infra | 11:24 | |
| *** apetrich has joined #openstack-infra | 11:25 | |
| openstackgerrit | Felix Schmidt proposed zuul/zuul master: Improve visualization retry attempts in UI https://review.opendev.org/678147 | 11:25 |
| *** jaosorior has quit IRC | 11:26 | |
| *** eernst has joined #openstack-infra | 11:30 | |
| *** jpena is now known as jpena|lunch | 11:32 | |
| *** rosmaita has quit IRC | 11:37 | |
| *** rosmaita has joined #openstack-infra | 11:37 | |
| *** rosmaita has quit IRC | 11:42 | |
| *** jaosorior has joined #openstack-infra | 11:43 | |
| *** markvoelker has joined #openstack-infra | 11:57 | |
| *** zhangfei has quit IRC | 12:00 | |
| *** Lucas_Gray has quit IRC | 12:02 | |
| *** rh-jelabarre has joined #openstack-infra | 12:02 | |
| *** Lucas_Gray has joined #openstack-infra | 12:03 | |
| *** dave-mccowan has joined #openstack-infra | 12:06 | |
| *** larainema has quit IRC | 12:09 | |
| *** Lucas_Gray has quit IRC | 12:12 | |
| efried | clarkb: We went through a couple of iterations yesterday and might be getting close to having those logs, but we're still POST_FAILUREing, now with "sudo: no tty present and no askpass program specified" -- do you know off the top how to get around that? | 12:14 |
| efried | https://zuul.opendev.org/t/openstack/build/f64b3baf6dd0417bb33b08618867f2bf/log/job-output.txt#18267 | 12:14 |
| *** eernst has quit IRC | 12:15 | |
| *** beagles has joined #openstack-infra | 12:17 | |
| *** rlandy has joined #openstack-infra | 12:20 | |
| *** rlandy is now known as rlandy|ruck | 12:20 | |
| *** Lucas_Gray has joined #openstack-infra | 12:28 | |
| zbr | i really hate when people do not assure that after running tests the repository is not in a dirty state, i would go so far to add an extra task to tox jobs to fail the build if they find any dirt but i am not sure if everyone will appreciate that. | 12:30 |
| zbr | any chance of getting infra support for such a task? | 12:31 |
| openstackgerrit | Graham Hayes proposed openstack/project-config master: Allow all TC members +W access https://review.opendev.org/678214 | 12:35 |
| fungi | yoctozepto: see https://storyboard.openstack.org/#!/story/2005040 about the problem you described, and you'll probably like to review https://review.opendev.org/637916 and https://review.opendev.org/660856 which are possible ways to approach addressing it with new behaviors in zuul | 12:41 |
| fungi | frickler: i too have observed what you describe with digests for the release-announce ml. i'll see if i can come up with something | 12:42 |
| fungi | but feel free to see if you are able to identify it, not sure when i'll get to it | 12:42 |
| *** ociuhandu has quit IRC | 12:44 | |
| fungi | zbr: maybe the manifest (which should also be a stable link relative to the build details) is what you're looking for? it's a json list of all the log files, pretty sure | 12:45 |
| zbr | fungi: yep, that is what I was thinking about. still my JS skills are extreamly low so is unlikely i will find time to do it. | 12:46 |
| zbr | but it should be doable in pure-js | 12:47 |
| *** udesale has joined #openstack-infra | 12:48 | |
| *** jpena|lunch is now known as jpena | 12:49 | |
| roman_g | Android cancels naming of releases after sweets (lollypop, etc.); OpenWRT cancels naming of releases after alcoholic drinks (Whiskey, etc.); OpenStack, please, leave release naming. | 12:56 |
| fungi | heh | 13:02 |
| *** eharney has joined #openstack-infra | 13:12 | |
| *** dchen has joined #openstack-infra | 13:14 | |
| *** jaosorior has quit IRC | 13:14 | |
| *** ociuhandu has joined #openstack-infra | 13:14 | |
| *** ociuhandu has quit IRC | 13:19 | |
| *** Goneri has joined #openstack-infra | 13:20 | |
| *** aaronsheffield has joined #openstack-infra | 13:20 | |
| *** kushal has joined #openstack-infra | 13:26 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Annotate QueueItem logger https://review.opendev.org/678226 | 13:30 |
| openstackgerrit | Graham Hayes proposed openstack/project-config master: Allow all TC members +W access https://review.opendev.org/678214 | 13:33 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 13:33 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: DNM: Test PDF building https://review.opendev.org/678160 | 13:33 |
| yoctozepto | fungi: thanks | 13:33 |
| yoctozepto | know any easy way to work around it at the moment? :-) | 13:34 |
| *** bnemec has joined #openstack-infra | 13:34 | |
| *** gagehugo has quit IRC | 13:34 | |
| *** bnemec is now known as beekneemech | 13:35 | |
| *** kushal has quit IRC | 13:35 | |
| *** mriedem has joined #openstack-infra | 13:37 | |
| fungi | use a different job definition with no file matchers | 13:37 |
| yoctozepto | fungi: yeah, that's obvious - I was thinking about how to override files back to nothing | 13:38 |
| yoctozepto | but it does not seem to be possible | 13:38 |
| yoctozepto | to noize it again ;d | 13:39 |
| fungi | they're only additive | 13:39 |
| yoctozepto | additive even? | 13:39 |
| yoctozepto | I read the docs to mean they are replaced | 13:39 |
| yoctozepto | but could be wrong | 13:39 |
| yoctozepto | lemme check | 13:39 |
| fungi | oh, maybe that got changed | 13:39 |
| yoctozepto | https://zuul-ci.org/docs/zuul/user/config.html#attr-job.files | 13:40 |
| fungi | i tend to avoid files and irrelevant-files matchers because they're tough to reason about | 13:40 |
| yoctozepto | " Unlike branches, this value is subject to inheritance and overriding, so only the final value is used to determine if the job should run" | 13:40 |
| yoctozepto | yeah | 13:40 |
| yoctozepto | recently learnt they are ignored when you merge a change configuring zuul | 13:40 |
| yoctozepto | and it suddenly made all our jobs run for the checking changes | 13:40 |
| fungi | yes, that was to prevent people from 1. merging non-working zuul configuration because the jobs they were altering wouldn't be run when the zuul configs were excluded, and 2. to prevent folks from having to list zuul configs in every single files list | 13:41 |
| yoctozepto | though we use these to avoid ci overkill with many jobs | 13:41 |
| *** ociuhandu has joined #openstack-infra | 13:41 | |
| yoctozepto | well, I agree and all but it was surprising to see execution plan changing for already started-to-check changes | 13:42 |
| yoctozepto | we don't reconfigure zuul every now and then | 13:42 |
| fungi | yeah, it's not clear to me what you mean by that | 13:43 |
| fungi | as far as i know all we intended to alter was to make it impossible for folks to accidentally exclude zuul configuration from triggering some jobs | 13:44 |
| fungi | accidentally exclude proposed changes to zuul configuration from triggering some jobs, i mean | 13:45 |
| yoctozepto | all right, do not i don't find it that bad but let me describe what I observed | 13:45 |
| yoctozepto | do note* | 13:45 |
| yoctozepto | we had one job doing some checks | 13:45 |
| yoctozepto | or rather a change | 13:45 |
| yoctozepto | it had like say 7 jobs running | 13:45 |
| fungi | did that change include alterations to zuul configuration? | 13:45 |
| yoctozepto | no | 13:46 |
| yoctozepto | in the meantime | 13:46 |
| yoctozepto | zuul change merged | 13:46 |
| yoctozepto | and suddenly 12 check jobs running for that same change | 13:46 |
| fungi | yes, so that sounds like it could be an unintended side-effect | 13:46 |
| fungi | might be worth bringing up in #zuul and trying to see if we can create a minimal reproducer in a unit test | 13:47 |
| clarkb | did the change that merged add new jobs? | 13:47 |
| *** psachin has quit IRC | 13:47 | |
| clarkb | because we always test rebased on the target branch. This affects zuul configs too | 13:48 |
| yoctozepto | fungi, clarkb: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2019-08-19.log.html#t2019-08-19T10:29:27 | 13:48 |
| yoctozepto | frickler responded | 13:48 |
| yoctozepto | yoctozepto: 2019-08-19 10:04:33,230 DEBUG zuul.layout: [e: d383ebbbfc1248a3b59af867de2eaba2] The configuration of job <Job kolla-ansible-ubuntu-source-ironic branches: {MatchAny:{BranchMatcher:master}} source: opendev/base-jobs/zuul.d/jobs.yaml@master#25> is changed by <Change 0x7f185d716908 openstack/kolla 677144,1>; ignoring file matcher | 13:48 |
| clarkb | yoctozepto: is 677144 the change you were working on or thr parent that merged? | 13:49 |
| yoctozepto | clarkb: 677144 is the change that was being checked and got extra jobs | 13:50 |
| yoctozepto | when another merged | 13:50 |
| clarkb | ok that change does modify zuul's config so I dont think that is a bug | 13:51 |
| yoctozepto | ah | 13:51 |
| yoctozepto | I don't find it too bad either | 13:51 |
| yoctozepto | only surprising | 13:52 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 13:52 |
| *** armax has joined #openstack-infra | 13:52 | |
| clarkb | this is what fungi was describing if the config of the job(s) changes they are run regardless of the file matchers | 13:52 |
| fungi | yeah, however it should have already been running all available jobs | 13:53 |
| clarkb | this allows you to remove config matching file matchers while still ensuring changes to jobs dont break them | 13:53 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 13:53 |
| fungi | if the change that merged added more jobs and zuul reconfigured, then it would have also added those new jobs to the already-queued change though, yes | 13:53 |
| clarkb | fungi: unless the parent added new jobs that depend on or parent to the jobs modified in this change | 13:53 |
| clarkb | yup | 13:53 |
| *** ociuhandu has quit IRC | 13:54 | |
| fungi | i would state it as "if the config of the job(s) is being altered by the proposed change" | 13:54 |
| fungi | specifically, if the proposed change includes modifications to zuul configuration | 13:55 |
| AJaeger | clarkb, fungi, I have three changes up for the PDF community goal that belong together and would love your advice whether this will all work - including if no PDF is build: https://review.opendev.org/678077 (merged already) https://review.opendev.org/#/c/678142 https://review.opendev.org/#/c/664555 . This was all tested in https://review.opendev.org/#/c/678080/ with exception of the promote job | 13:55 |
| * AJaeger just pushed an update for 664555 and will retest... | 13:56 | |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: DNM: Test PDF building https://review.opendev.org/678160 | 13:56 |
| *** ociuhandu has joined #openstack-infra | 14:00 | |
| *** ramishra has quit IRC | 14:01 | |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 14:08 |
| *** rosmaita has joined #openstack-infra | 14:08 | |
| mnaser | infra-root: i'm still struggling with usage of 127.0.0.1 as a resolver so i'd like a hold on 678107 to see why its still breaknig :( | 14:11 |
| *** cyberpear_ is now known as cyberpear | 14:17 | |
| *** dchen has quit IRC | 14:19 | |
| *** dpawlik has quit IRC | 14:20 | |
| openstackgerrit | Merged openstack/hacking master: Fix python 3.6 escape char warnings in strings https://review.opendev.org/650056 | 14:21 |
| *** chkumar|rover is now known as raukadah | 14:24 | |
| *** odicha has quit IRC | 14:27 | |
| openstackgerrit | Jeremy Stanley proposed zuul/zuul master: Document logging configuration schema https://review.opendev.org/678243 | 14:30 |
| fungi | mnaser: either of those jobs for it is fine? doesn't matter which i set the hold on? | 14:32 |
| mnaser | fungi: yep, any of them work, they're all broken D: | 14:32 |
| fungi | sudo zuul autohold --tenant opendev --project vexxhost/kue --job kue-integration-1-node --change 678107 --reason "mnaser debugging unbound and kubernetes interaction" --count 1 | 14:33 |
| fungi | that's what i set | 14:33 |
| fungi | recheck at will | 14:33 |
| openstackgerrit | Merged zuul/nodepool master: Add a dib-cmd option for diskimages https://review.opendev.org/672196 | 14:35 |
| mnaser | thanks fungi | 14:35 |
| fungi | yw! | 14:40 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 14:40 |
| fungi | mnaser: let me know once you notice the job fail, in case i don't, and i can add your ssh key to it | 14:41 |
| mnaser | willdo | 14:41 |
| frickler | fungi: corvus: this patch seems to cause all mailman crons to fail because the var isn't set for them https://opendev.org/opendev/puppet-mailman/commit/af11a96f7810b06e534cdbf57adf52a4d827db1c | 14:41 |
| frickler | that includes the cron job that is supposed to send out digests daily | 14:41 |
| *** guoqiao_ has quit IRC | 14:42 | |
| frickler | https://storyboard.openstack.org/#!/story/2001382 the date 2017-12-19 matches with that last daily digest I can find in my mail archive | 14:45 |
| fungi | frickler: good find. we probably need to expand the crontab entries to iterate over sites | 14:46 |
| *** kopecmartin is now known as kopecmartin|off | 14:51 | |
| frickler | fungi: as a shortterm workaround, I'd like to reduce the digest size on release-announce from 1000k to 30k, matching what is set for openstack-discuss. | 14:51 |
| *** mattw4 has joined #openstack-infra | 14:54 | |
| *** lpetrut has quit IRC | 14:54 | |
| *** ociuhandu has quit IRC | 14:55 | |
| fungi | that also seems fine. maybe check with the release team first though? i think the idea is to avoid folks getting spammed with dozens of digest messages on a coordinated release | 14:56 |
| *** sgw has joined #openstack-infra | 14:56 | |
| fungi | anyway, since they're the list owners, that configuration is up to them | 14:56 |
| mnaser | blah | 14:58 |
| mnaser | i'm very unlucky. it seems like my 'master' node has spontaneously combused at ovh fungi | 14:59 |
| mnaser | http://zuul.opendev.org/t/opendev/stream/d819a5d9a2e243ad941612fd27528a8c?logfile=console.log | 14:59 |
| mnaser | 158.69.72.234 is pingable but not ssh-able | 14:59 |
| mnaser | wait, no | 14:59 |
| mnaser | sorry, thats .72 vs .71 | 14:59 |
| *** dpawlik has joined #openstack-infra | 15:00 | |
| fungi | mnaser: i guess that's a 2-node job? | 15:02 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 15:02 |
| mnaser | fungi: yes it is | 15:02 |
| fungi | mnaser: what ssh key do you want added to those nodes? | 15:02 |
| mnaser | https://github.com/mnaser.keys | 15:02 |
| fungi | -bash: vi: command not found | 15:03 |
| AJaeger | clarkb, fungi, mnaser, https://review.opendev.org/664555 and https://review.opendev.org/678142 are ready for publishing PDF files. Reviews welcome, please | 15:03 |
| fungi | wow | 15:03 |
| mnaser | neat. | 15:03 |
| mnaser | :p | 15:03 |
| clarkb | fungi: ya they are very minimal | 15:04 |
| fungi | mnaser: ssh root@158.69.72.234 and root@158.69.71.237 | 15:04 |
| clarkb | I use echo to add ssh keys normally | 15:05 |
| fungi | yeah, i ended up doing `wget -qO- https://github.com/mnaser.keys >> .ssh/authorized_keys` | 15:05 |
| *** sthussey has joined #openstack-infra | 15:05 | |
| fungi | i usually `vi .ssh/authorized_keys` and then jump to the end of the file and `r https://github.com/mnaser.keys` instead | 15:05 |
| mnaser | til about 'r' | 15:06 |
| fungi | r is normally used to read in and insert data from a local file | 15:06 |
| fungi | but modern vi also understands urls and will fetch the content at them as if they were files | 15:06 |
| mnaser | neat | 15:07 |
| fungi | so you can also do tricks on the shell command line like `view https://github.com/mnaser.keys` to look at content from remote files | 15:07 |
| fungi | especially useful for things like job logs | 15:07 |
| *** anteaya has joined #openstack-infra | 15:07 | |
| fungi | when, say, they're so long they asplode your web browser | 15:08 |
| clarkb | ++ that is how I ogten deal with large job logs | 15:08 |
| *** cmurphy is now known as cmorpheus | 15:09 | |
| mnaser | thats really useful to know | 15:10 |
| mnaser | i usually start benchmarking my web browser :) | 15:10 |
| openstackgerrit | Merged zuul/zuul master: Set failed, unreachable, skipped statuses in json plugin https://review.opendev.org/676516 | 15:12 |
| openstackgerrit | Merged openstack/ptgbot master: Display room capabilities https://review.opendev.org/674606 | 15:16 |
| *** dave-mccowan has quit IRC | 15:20 | |
| openstackgerrit | Thierry Carrez proposed openstack/ptgbot master: Generate etherpad links automatically https://review.opendev.org/674622 | 15:21 |
| *** Vadmacs has quit IRC | 15:22 | |
| AJaeger | mnaser: this is a review for you as TC chair: https://review.opendev.org/678214 | 15:22 |
| mnaser | AJaeger: going to likely hold that off until the dependency is voted on | 15:23 |
| AJaeger | mnaser: sure... | 15:23 |
| *** gagehugo has joined #openstack-infra | 15:24 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Mark nodes as USED when deleting autohold https://review.opendev.org/664060 | 15:25 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 15:30 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Rebase api-guide/ref jobs https://review.opendev.org/678256 | 15:30 |
| clarkb | AJaeger: note on https://review.opendev.org/#/c/664555/25 but I think it is fine as is so I +2'd | 15:32 |
| *** jpena is now known as jpena|off | 15:32 | |
| *** rpittau is now known as rpittau|afk | 15:32 | |
| AJaeger | clarkb: thanks, just answered - happy to iterate again if you have some specific request | 15:33 |
| clarkb | AJaeger: I think it is fine as is. We almost always use envlist to mean singleton and if we really need to change that in the future it shouldn' | 15:34 |
| clarkb | *shouldn't be too difficult | 15:34 |
| AJaeger | good | 15:35 |
| *** jovial[m] has joined #openstack-infra | 15:37 | |
| jovial[m] | what happend to the openstack zuul github app (available at https://github.com/apps/openstack-zuul)? | 15:38 |
| openstackgerrit | Merged opendev/base-jobs master: Download PDF artifacts as well https://review.opendev.org/678142 | 15:38 |
| *** mattw4 has quit IRC | 15:39 | |
| mnaser | infra-root: i no longer need the hold on 678107. i have figured it out (finally) | 15:39 |
| mnaser | jovial[m]: i believe its @ https://github.com/apps/opendev-zuul now | 15:39 |
| jovial[m] | thank you | 15:39 |
| jovial[m] | any idea how I can debug the webhook not firing on https://review.opendev.org/#/c/656627/ ? I would have expected zuul to start the gate run after the pull request that it depends on was merged. | 15:43 |
| clarkb | jovial[m]: depends-on only trigger jobs in child changes if they share the same gate queue | 15:44 |
| jovial[m] | oh, didn't realise - thanks | 15:45 |
| mriedem | i see the log_url in elasticsearch doesn't work now | 15:45 |
| mriedem | http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22Re-fetching%20instances%5C%22%20AND%20tags:%5C%22screen-n-cpu.txt%5C%22&from=7d | 15:45 |
| mriedem | one hit was here https://6fdff4ae8ccdeb6fec5b-203bd40ea72bf2a5f64a71e70c49816e.ssl.cf5.rackcdn.com/677790/2/check/tempest-slow-py3/81d16b2/controller/logs/screen-n-cpu.txt | 15:45 |
| clarkb | jovial[m]: and since we only do third party testing against github repos I don't think we want them to share gate queues with stuff in gerrit | 15:45 |
| clarkb | jovial[m]: if you revote a +W it should go into the gate | 15:46 |
| fungi | mnaser: deleted, let us know if you need anything else | 15:46 |
| *** gyee has joined #openstack-infra | 15:46 | |
| clarkb | mriedem: that is because it needs the .gz suffix | 15:46 |
| clarkb | mriedem: https://review.opendev.org/#/c/677236/ and https://review.opendev.org/#/c/677265/ will fix that | 15:47 |
| mriedem | ah ok | 15:47 |
| clarkb | swift doesn't know to do the redirects we had before | 15:47 |
| clarkb | switching things over to the actual names should fix all that | 15:47 |
| *** jamesmcarthur has joined #openstack-infra | 15:47 | |
| clarkb | if any other config-core or infra-root wants to review 677265 I can approve it and 677236 when I get back from errands today | 15:48 |
| clarkb | (or feel free to approve it and monitor yourself :) you'll want to ensure logs continue to get indexed after they merge, then we'll want to restart all logstash workers with 677265 in place and check they still index after that | 15:49 |
| clarkb | then mriedem and I can probably sanity check e-r queries | 15:49 |
| clarkb | (as those taht use filename may need updating) | 15:50 |
| clarkb | er sorry its 677236 that will precipitate worker restarts | 15:50 |
| clarkb | not 677265 | 15:50 |
| mriedem | clarkb: i'd like to get these in first https://review.opendev.org/#/q/status:open+project:opendev/elastic-recheck+branch:master+topic:elastic-recheck-cleanup if possible | 15:51 |
| mriedem | i mean before we scrub e-r | 15:51 |
| clarkb | ++ | 15:51 |
| clarkb | I've got to head out now but will start there when looking at the other two changes | 15:51 |
| *** udesale has quit IRC | 15:57 | |
| *** udesale has joined #openstack-infra | 15:58 | |
| *** hamzy has quit IRC | 15:59 | |
| *** kmalloc is now known as needscoffee | 16:00 | |
| *** needscoffee is now known as needsSoMuchMoreC | 16:00 | |
| *** needsSoMuchMoreC is now known as needscoffee | 16:00 | |
| *** dtantsur is now known as dtantsur|afk | 16:00 | |
| *** beekneemech has quit IRC | 16:07 | |
| *** lucasagomes has quit IRC | 16:09 | |
| *** tesseract has quit IRC | 16:11 | |
| *** dpawlik has quit IRC | 16:13 | |
| *** Lucas_Gray has quit IRC | 16:14 | |
| *** bnemec has joined #openstack-infra | 16:20 | |
| AJaeger | mordred, fungi, could you review https://review.opendev.org/664555 for PDF building, please? I addressed mordred's comments on it and the team working on it would love to have this merged today to enable PDF building. | 16:26 |
| *** dpawlik has joined #openstack-infra | 16:29 | |
| *** mattw4 has joined #openstack-infra | 16:31 | |
| *** AJaeger_ has joined #openstack-infra | 16:31 | |
| *** whoami-rajat has quit IRC | 16:32 | |
| *** dpawlik has quit IRC | 16:34 | |
| *** AJaeger has quit IRC | 16:35 | |
| *** AJaeger_ is now known as AJaeger | 16:38 | |
| *** markvoelker has quit IRC | 16:39 | |
| zbr | if anyone want to have a big laugh about what m$ did with azure-cli tool (python based!) read https://github.com/Azure/azure-cli/issues/7387 -- spoiler alert: they also bundled another python inside! that needs a cartoon. | 16:39 |
| fungi | yo dawg i heard you like python so i... | 16:46 |
| fungi | yeah, that's nuts | 16:46 |
| fungi | you can always complain to mugsie ;) | 16:47 |
| *** AJaeger_ has joined #openstack-infra | 16:47 | |
| fungi | not that he probably has any control over it whatsoever | 16:47 |
| *** markvoelker has joined #openstack-infra | 16:47 | |
| ozzzo | It looks like nova is keeping mysql connections open until they time out. Is there a way to stop these error messages? | 16:48 |
| ozzzo | Aborted connection 10726 to db: 'nova' user: 'nova' host: 'asdf' (Got timeout reading communication packets) | 16:48 |
| pabelanger | doing CI is hard | 16:50 |
| pabelanger | was likely a quick fix, then left that way for ever | 16:51 |
| *** AJaeger has quit IRC | 16:51 | |
| fungi | ozzzo: you've found the channel where we collaborate to operate the community infrastructure, this is not a channel about building infrastructure with openstack | 16:52 |
| fungi | ozzzo: see https://wiki.openstack.org/wiki/IRC for a list of official openstack irc channels, but you may want #openstack or #openstack-nova | 16:52 |
| stephenfin | fungi: Could you say if I'm correct in what I'm saying here https://review.opendev.org/#/c/677969/1//COMMIT_MSG@10 (we don't need egg-related config in nova's 'setup.cfg' because we don't distribute eggs) | 16:52 |
| stephenfin | (or wheels) | 16:53 |
| fungi | stephenfin: https://pypi.org/project/nova/#files | 16:53 |
| *** bnemec has quit IRC | 16:53 | |
| fungi | nova-19.0.2-py2.py3-none-any.whl is a wheel | 16:53 |
| stephenfin | well damn | 16:53 |
| stephenfin | I didn't think we published nova to pypi | 16:54 |
| fungi | we started publishing all openstack services to pypi last cycle i think (or maybe it was early this cycle?) | 16:54 |
| fungi | more of a discussion for #openstack-release though | 16:54 |
| stephenfin | agreed | 16:54 |
| stephenfin | cheers :) | 16:54 |
| fungi | stephenfin: that said, skimming your setup.cfg change the rest of that is probably fine just don't drop the section which tells it to make universal wheels | 16:55 |
| stephenfin | ack | 16:56 |
| openstackgerrit | Radosław Piliszek proposed zuul/zuul master: Make files matcher match changes with no files https://review.opendev.org/678273 | 16:59 |
| *** udesale has quit IRC | 17:05 | |
| *** udesale has joined #openstack-infra | 17:06 | |
| *** igordc has joined #openstack-infra | 17:09 | |
| *** jamesmcarthur has quit IRC | 17:11 | |
| *** jamesmcarthur has joined #openstack-infra | 17:11 | |
| *** udesale has quit IRC | 17:11 | |
| *** udesale has joined #openstack-infra | 17:12 | |
| *** cyberpear has quit IRC | 17:18 | |
| *** Vadmacs has joined #openstack-infra | 17:20 | |
| *** jamesmcarthur has quit IRC | 17:22 | |
| donnyd | how does glean actually find the config drive in a provisioned host? | 17:24 |
| mnaser | donnyd: it is at a predictable location | 17:25 |
| mnaser | afaik its a device with 'label' config-2 or something | 17:25 |
| clarkb | the label on the devuce ya | 17:25 |
| donnyd | Ok, so it just searches for a file system labled config-2 ? | 17:26 |
| mnaser | clarkb, donnyd: https://opendev.org/opendev/glean/src/branch/master/glean/init/glean.sh | 17:26 |
| donnyd | thanks mnaser , that is exactly what i was looking for | 17:27 |
| *** michael-beaver has joined #openstack-infra | 17:32 | |
| *** ralonsoh has quit IRC | 17:34 | |
| *** udesale has quit IRC | 17:35 | |
| *** hamzy has joined #openstack-infra | 17:35 | |
| clarkb | mriedem: I've approved the cleanup script for e-r. however in the query removal change seems like a lot of those queries still have hits? | 17:38 |
| clarkb | mriedem: do we want to remove those if they have hits? I'd personally prefer to keep them if they are still generating hits and maybe we unfix the bug statuses? | 17:38 |
| mriedem | let me take a look through those | 17:39 |
| clarkb | config-core infra-root any other takers on https://review.opendev.org/#/c/677265/ I am happy to watch that go in now | 17:39 |
| fungi | approved it just now | 17:41 |
| clarkb | mriedem: http://status.openstack.org/elastic-recheck/index.html#1745168 http://status.openstack.org/elastic-recheck/index.html#1282876 http://status.openstack.org/elastic-recheck/index.html#1669468 have msall numbers of hits for example | 17:41 |
| clarkb | fungi: thanks! | 17:42 |
| clarkb | I'm approving the other change and will restart workers once job side is ready too | 17:42 |
| mriedem | clarkb: http://status.openstack.org/elastic-recheck/index.html#1745168 is pretty generic and the original bug is fixed so if there are new or persistent problems we likely need a new bug and a new investigation in a new query | 17:44 |
| mriedem | https://bugs.launchpad.net/openstack-ci/+bug/1282876 is marked as fix but...idk - maybe the graph for that should be marked as suppress-graph: true? | 17:44 |
| openstack | Launchpad bug 1282876 in OpenStack-Gate "git clone fails with "fatal: Not a git repository", "git remote update failed."" [Critical,Fix released] - Assigned to Jeremy Stanley (fungi) | 17:45 |
| mriedem | http://status.openstack.org/elastic-recheck/index.html#1669468 i'm not sure about, will need to check on it | 17:45 |
| clarkb | mriedem: ++ to 1282 being a suppressed graph that is a fairly eneric queriy too | 17:45 |
| clarkb | the bug says not a git repository but the actual query is for connection remote end hung up unexpectedly | 17:46 |
| mriedem | i had a todo in the cleanup script to check query results, maybe as an option since it can be slow for all of the open queries, maybe i should just implement that quick and run the thing again to see what's removed | 17:46 |
| clarkb | (so that query/bug details might be buggy) | 17:46 |
| openstackgerrit | Merged opendev/elastic-recheck master: Add script to remove queries for fixed bugs https://review.opendev.org/677302 | 17:48 |
| clarkb | mriedem: I think we can delete 1282.. since we have http://status.openstack.org/elastic-recheck/index.html#1384373 | 17:50 |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 17:50 |
| clarkb | though maybe one is git and the other is distro? | 17:50 |
| clarkb | no I think both are git so we are good to remove 1282... | 17:51 |
| efried | clarkb: We went through a couple of iterations yesterday and might be getting close to having those logs, but we're still POST_FAILUREing, now with "sudo: no tty present and no askpass program specified" -- do you know off the top how to get around that? | 17:51 |
| efried | https://zuul.opendev.org/t/openstack/build/d7cc9013b1414f52a6cfdc40abad7621 | 17:51 |
| clarkb | efried: hrm those jobs may remove sudo access for the zuul user | 17:52 |
| efried | o | 17:52 |
| clarkb | I think there is a tox parent job that is tox with sudo | 17:52 |
| clarkb | you might be able to reparent to that /me looks for its name | 17:52 |
| fungi | yeah, usually tox jobs we disallow sudo because we want folks to be able to safely run them locally too | 17:53 |
| fungi | could always chmod those log files world-readable before dropping sudo | 17:54 |
| clarkb | efried: openstack-tox-with-sudo | 17:54 |
| efried | clarkb: http://zuul.openstack.org/job/openstack-tox-with-sudo | 17:54 |
| efried | whee | 17:54 |
| clarkb | efried: thats the one, if you reparent to that you should have working sudo | 17:54 |
| fungi | yeah, if it's just for troubleshooting and not a more long-term thing, that's likely fine | 17:54 |
| efried | sweet, thank you. | 17:54 |
| openstackgerrit | Merged openstack/project-config master: Stop treating .gz files as special in log handling https://review.opendev.org/677265 | 17:54 |
| efried | clarkb: do I still need become:true in my post? | 17:55 |
| clarkb | efried: ya, all that does is allow sudo to function you still hav eto request sudo where you need it | 17:55 |
| efried | neat | 17:55 |
| efried | clarkb, fungi: trying again: https://review.opendev.org/#/c/678051/ | 17:55 |
| efried | Thanks for the help. | 17:55 |
| fungi | but more generally, it'll be safer to find ways not to need sudo at the end of the job | 17:56 |
| fungi | if it's something you want to keep long-term | 17:56 |
| efried | fungi: oh, I'm just trying to recreate this one gate failure and have mysql logs when it happens. | 17:56 |
| efried | This is not long term | 17:57 |
| efried | unless by "long term" you mean "in the starry future where I can condition certain post behavior on certain failure conditions" | 17:57 |
| efried | I guess maybe with enough bash hacking one might be able to do that in a post... | 17:58 |
| clarkb | fungi: this is a one off to get more logs for a failure that seems to only happen on limestone | 17:59 |
| clarkb | I don't think we'll be merging this change if we can get the data | 17:59 |
| clarkb | (though maybe we will want to collect those logs usually? not sure) | 17:59 |
| mriedem | clarkb: i'm getting sidetracked with something, it's probably best to just leave comments on the query removal patch and i'll go through them | 18:02 |
| mriedem | and maybe tweak the script - a fun friday afternoon exercise | 18:02 |
| mriedem | clarkb: btw, if you're looking for some light reading in your alone time https://deadspin.com/tag/why-your-team-sucks-2019 | 18:02 |
| mriedem | seahawks are down that list | 18:03 |
| *** ozzzo has quit IRC | 18:09 | |
| *** AJaeger_ is now known as AJaeger | 18:14 | |
| *** cyberpear has joined #openstack-infra | 18:15 | |
| mriedem | clarkb: ok i marked up the e-r query removal patch with the ones that still get hits https://review.opendev.org/#/c/677306/1 | 18:18 |
| openstackgerrit | Clark Boylan proposed zuul/zuul master: Stop executor if log streamer dies https://review.opendev.org/678049 | 18:24 |
| mriedem | clarkb: ok commented on all removed queries with hits still. the other ones beside the git one you pointed out are either (1) failures in the check queue for broken patches or (2) duplicates of other bugs - which is the case with the c-bak one | 18:32 |
| mriedem | so i think we're good to go with those removals since the queries are false hits | 18:32 |
| clarkb | mriedem: ok | 18:33 |
| clarkb | approved | 18:34 |
| *** rosmaita has quit IRC | 18:35 | |
| *** gyee has quit IRC | 18:42 | |
| *** e0ne has quit IRC | 18:46 | |
| openstackgerrit | Merged opendev/elastic-recheck master: Remove old queries: 2019-08-19 https://review.opendev.org/677306 | 18:46 |
| *** gyee has joined #openstack-infra | 18:46 | |
| openstackgerrit | Clark Boylan proposed zuul/zuul master: Document js tool installation in scratch doc https://review.opendev.org/678286 | 18:49 |
| openstackgerrit | Clark Boylan proposed zuul/zuul master: Stop executor if log streamer dies https://review.opendev.org/678049 | 18:53 |
| AJaeger | config-core, https://review.opendev.org/678256 and https://review.opendev.org/677804 are two promote job cleanups . Reviews welcome. That's the end of my promote job week ;) | 18:55 |
| AJaeger | The rest of the jobs stay for a bit probably. The majority of runs is converted and the rest are special cases. | 18:55 |
| *** eandersson has joined #openstack-infra | 19:00 | |
| eandersson | What format should IPv6 addresses be stored in yaml format? | 19:00 |
| eandersson | Trying to figure out if I should change the code, or just store the IPs differently | 19:00 |
| eandersson | https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/logs_66/678266/2/check/designate-ipv6-only-bind9/0719c1d/controller/logs/etc/designate/pools_yaml.txt.gz | 19:00 |
| eandersson | It was originally trying to use | 19:00 |
| eandersson | > host: [2604:e100:3:0:f816:3eff:fe78:5bb7] | 19:01 |
| eandersson | I changed it to | 19:01 |
| eandersson | > host: "[2604:e100:3:0:f816:3eff:fe78:5bb7]" | 19:01 |
| eandersson | but it seems to want | 19:01 |
| eandersson | > host: "2604:e100:3:0:f816:3eff:fe78:5bb7" | 19:01 |
| clarkb | eandersson: that would be a question for designate | 19:01 |
| *** hamzy has quit IRC | 19:01 | |
| clarkb | your first example creates a list with one element in it though | 19:01 |
| eandersson | Sorry, this is from the perspective from a Designate dev | 19:01 |
| fungi | usually you would only wrap ipv6 addresses in [] if you're adding a port number using : as a separator | 19:02 |
| eandersson | Yea exactly clarkb | 19:02 |
| clarkb | I would expect the second and third options to both work | 19:02 |
| eandersson | Second fails due to netaddr not liking [] | 19:02 |
| fungi | because 2604:e100:3::f816:3eff:fe78:5bb7:443 would be too vague so you [2604:e100:3::f816:3eff:fe78:5bb7]:443 to make it clear the 443 is a port number | 19:03 |
| clarkb | eandersson: that sounds like a netaddr bug | 19:03 |
| fungi | but if you're not using a port number then there's usually no need, unless you want to make it clear you're _not_ including a port number for some reason | 19:03 |
| eandersson | I kinda want to strip the [] so that both works | 19:03 |
| fungi | and yeah, yaml is going to get confused and think the [] without quoting is declaring a singleton list | 19:04 |
| fungi | but with quoting yaml shouldn't be confused regardless | 19:04 |
| eandersson | Basically trying to fix these non-voting jobs https://review.opendev.org/#/c/678266/ | 19:05 |
| clarkb | designate should accept both imo | 19:05 |
| clarkb | (both second and third value) | 19:05 |
| eandersson | I agree - will deferr that to a different patch thou | 19:05 |
| eandersson | Where does $<PROJECT>_SERVICE_HOST usually come from? | 19:06 |
| clarkb | eandersson: its the devstack var to specify what address the api for that service should listen on | 19:06 |
| eandersson | https://review.opendev.org/#/c/678266/2/devstack/designate_plugins/backend-bind9 | 19:07 |
| *** bnemec has joined #openstack-infra | 19:10 | |
| *** bnemec is now known as beekneemech | 19:11 | |
| clarkb | eandersson: depending on how that file is rendered you may have to escape the "s | 19:12 |
| *** eharney has quit IRC | 19:13 | |
| clarkb | ya that is a heredoc | 19:13 |
| clarkb | try \"\" | 19:13 |
| mnaser | is there a straight forward way of installing dependencies checked out by zuul? | 19:13 |
| clarkb | mnaser: that is super dependent on what and how things are installed | 19:14 |
| mnaser | i.e. say i have "magnum" in requirements.txt -- can that be checked out by zuul and then it installs master (rather than $whatever_is_in_pypi) | 19:14 |
| clarkb | (so no I don't think so, it will depend on whatever the stuff is) | 19:14 |
| eandersson | clarkb, > failed to detect a valid IP address from '\\"[2604:e100:3:0:f816:3eff:fe78:5bb7]\\"' | 19:14 |
| clarkb | eandersson: can you paste the content of that portion of the file? | 19:14 |
| clarkb | mnaser: tox siblings doe sthat for python deps | 19:15 |
| clarkb | mnaser: so should happen if you use tox | 19:15 |
| mnaser | ok so thats what all that magic is about. is there something neat to make it happen easily for users that run tox locally? | 19:15 |
| eandersson | clarkb, http://paste.openstack.org/show/762849/ | 19:15 |
| eandersson | I just did something like that | 19:16 |
| mnaser | pointing to git repos seems iffy but if it's the best we can do.. sure | 19:16 |
| fungi | mnaser: not really because it depends on them having the other repository checked out to a specific location or telling tox where to find it | 19:16 |
| eandersson | btw it works fine if I just drop the [], so I am pretty sure this is just a python issue (or maybe a netaddr issue) | 19:17 |
| mnaser | hmm, i'm trying to think the best approach to do in this case to make it easier for a contributor to work on this locally (but also work properly in gates) | 19:17 |
| eandersson | not sure if netaddr is supposed to allow [] or not | 19:17 |
| fungi | mnaser: and having some way for tox to differentiate between when it should look for local source code for a dependency vs ask pip to fetch it from pypi | 19:17 |
| clarkb | eandersson: what does the output file look like? | 19:17 |
| clarkb | eandersson: if the ""s are being dropped because of the heredoc rendering then []s will result in an invalid input to netaddr likely | 19:17 |
| eandersson | http://paste.openstack.org/show/762850/ | 19:17 |
| fungi | mnaser: the "easy" solution openstack came up with for this problem was devstack, if that gives you a feel for how deep this problem space is | 19:18 |
| eandersson | This stores it as a string which is fine | 19:18 |
| clarkb | eandersson: cool that looks correct, likely a bug in the python code then | 19:18 |
| eandersson | Yea I guess | 19:19 |
| eandersson | > import netaddr; netaddr.IPAddress('2604:e100:3:0:f816:3eff:fe78:5bb7') | 19:19 |
| eandersson | This works | 19:19 |
| eandersson | This does not | 19:19 |
| eandersson | > import netaddr; netaddr.IPAddress('[2604:e100:3:0:f816:3eff:fe78:5bb7]') | 19:19 |
| mnaser | fungi: in my case i'm trying to write a magnum 'driver' so the code depends on a few imports from magnum | 19:19 |
| clarkb | ya thats a bug in netaddr imo | 19:19 |
| eandersson | The only thing that confuses me would be why are only we seeing this? | 19:20 |
| eandersson | I was looking at the nova code path and I don't think they are doing anything different | 19:20 |
| clarkb | eandersson: there tests may never set an escaped ipv6 address value? | 19:21 |
| clarkb | s/there/their/ | 19:21 |
| clarkb | or they are stripping the [] off | 19:21 |
| fungi | eandersson: if you're considering filing an issue against netaddr, terminology-wise the thing you're wanting it to support is ietf rfc 2732 "format for literal ipv6 addresses in urls" | 19:22 |
| fungi | though it's possible they consider that out of scope for raw address parsing | 19:23 |
| eandersson | short term is there a devstack env variable that does not have []? or should I just strip it in bash for now? | 19:23 |
| *** ozzzo has joined #openstack-infra | 19:23 | |
| fungi | for reference, https://tools.ietf.org/html/rfc2732 | 19:24 |
| clarkb | eandersson: I don't think you should strip it in bash or "fix it" to remove the []s | 19:25 |
| clarkb | they are perfectly valid and your software should accept them as inputs | 19:25 |
| fungi | also possible urllib could be used to dereference those before passing to netaddr, but i haven't looked | 19:25 |
| clarkb | (I'm going to be a little insistent on that becaus etools like docker completely fail at recognizing those as valid inputs) | 19:25 |
| mnaser | i wonder if there's an alternative in testing world where i can depend on magnum (and i'm able to run unit tests without having it inside 'requirements' ?) | 19:25 |
| clarkb | mnaser: that is why test-requirements is separate from requirements | 19:26 |
| *** hamzy has joined #openstack-infra | 19:26 | |
| mnaser | (this is more python advice) but i'm just wondering if there's a clean way to be able to run unit tests without .. having it there | 19:26 |
| mnaser | oh i just thought of a similar use case.. out of tree nova drivers | 19:27 |
| mnaser | maybe ill go dig there | 19:27 |
| fungi | you could probably have a job which creates a venv, installs magnum (via whatever method you prefer) into that venv, and then instructs tox to use that venv instead of creatnig one of its own | 19:27 |
| eandersson | clarkb, sure I agree with you, but could take months before that is fixed upstream and our upper requirements are updated. | 19:27 |
| fungi | but those are also the steps your local devs would need to follow to replicate testing | 19:27 |
| clarkb | eandersson: fix it in designate then | 19:27 |
| eandersson | clarkb, probably best to fix it in oslo tbh (we don't call netaddr directly). | 19:28 |
| *** jamesmcarthur has joined #openstack-infra | 19:28 | |
| eandersson | https://github.com/openstack/oslo.versionedobjects/blob/master/oslo_versionedobjects/fields.py#L514 | 19:28 |
| fungi | eandersson: i have a feeling netaddr may consider itself low-enough level that it only expects to parse raw ip addresses and cidrs, in which case url-oriented syntax isn't its purview but you could still, as clarkb points out, have designate accept it | 19:29 |
| mnaser | https://github.com/openstack/compute-hyperv/blob/master/tox.ini#L20 | 19:30 |
| mnaser | i guess this is how compute-hyperv did it, but it probably means that you cant use zuul checked out changes | 19:30 |
| fungi | mnaser: yep. many openstack projects were littered with stuff like that until it got cleaned up | 19:31 |
| fungi | because it's surprising to people when a change passes in the gate behind a change in a from-source dependency which should have broken it, or when depends-on to that dependency mysteriously just doesn't work | 19:31 |
| *** jamesmcarthur has quit IRC | 19:32 | |
| *** jamesmcarthur has joined #openstack-infra | 19:32 | |
| mnaser | it seems easy to solve for CI, but hard to make it work 'natively' locally | 19:32 |
| fungi | mnaser: the way some projects like oslo have tackled it is to run two jobs, one which installs the dependency from python packages (pypi or mirror thereof), and another which installs from the on-disk source code zuul provides | 19:33 |
| fungi | that works well if you want to make sure you don't allow changes to merge when they're incompatible with the most recently-published release of the dependency | 19:33 |
| mnaser | yeah, makes sure you dont do something that breaks the existing release, makes senes | 19:34 |
| fungi | yet still want to also make sure they work with and can be demonstrated against the corresponding branch tip of the dependency too | 19:34 |
| fungi | some projects have rejected that solution because they want to only develop against the future release state of their dependency | 19:34 |
| fungi | and want to be able to break compatibility with the latest release of the dependency, because they're sure to be careful to only release when or after the dependency next releases | 19:35 |
| fungi | but still, yeah, to be able to do the same locally you need instructions for your developers to put the dependency source code at a known location so tox can reference it | 19:36 |
| mnaser | i guess i could always just build this whole thing out with 0 dependency on magnum (or anything i import are conditional imports that i can stub out or something) | 19:37 |
| fungi | also possible | 19:37 |
| openstackgerrit | Clark Boylan proposed zuul/nodepool master: Set manage_images to false on aws https://review.opendev.org/678292 | 19:39 |
| *** roman_g has quit IRC | 19:41 | |
| eandersson | fungi, this isnt an url-oriented syntax thou | 19:41 |
| clarkb | I'm not seeing the log_urls in logstash events with the .gz suffixes like I expected :/ | 19:41 |
| clarkb | we seem to still get the older log_urls without .gz suffixes | 19:42 |
| clarkb | that means stuff is working as before so not a firedrill but its odd | 19:42 |
| clarkb | eandersson: I'm sure that devstack sets that var escaped so that it can construct urls with them | 19:42 |
| clarkb | and that way it doesn't have to check if the value is ipv4 or ipv6 before adding []s | 19:42 |
| clarkb | however those [] wrapped addrs are perfectly valid and should be accepted | 19:43 |
| *** jamesmcarthur has quit IRC | 19:43 | |
| *** tomaw has quit IRC | 19:44 | |
| eandersson | clarkb, yep - I am brining it up with the oslo people | 19:44 |
| clarkb | re .txt.gz could be that no jobs that started after the change landed ith .txt.gz files has completed yet? | 19:44 |
| eandersson | It's easy enough to fix in designate, but we really just use the oslo code directly | 19:44 |
| *** jamesmcarthur has joined #openstack-infra | 19:45 | |
| eandersson | https://github.com/openstack/designate/blob/master/designate/objects/fields.py#L171 | 19:45 |
| fungi | well, valid as part of a url for rfc 2732 compliant software, and nice to support but i'm not aware of a standard requiring them outside use in a url | 19:45 |
| fungi | since the advent of rfc 2732 they've become somewhat of a general convention, especially when you want to conveniently tack on a port number using : as the port separator | 19:46 |
| *** tomaw has joined #openstack-infra | 19:46 | |
| clarkb | fungi: its not a requirement to use them but it is something that users may do (as evidenced by devstack doing so) | 19:47 |
| clarkb | fungi: and software should just do the right thing there | 19:47 |
| clarkb | fwiw I think python socket lib accepts them without complaint | 19:47 |
| fungi | yeah, i'm not surprised | 19:48 |
| fungi | there also may be another rfc about wrapping v6 addresses in [] i just don't know what it is if so | 19:49 |
| *** jamesmcarthur has quit IRC | 19:50 | |
| eandersson | I don't think socket accepts [] | 19:52 |
| eandersson | I tested | 19:52 |
| eandersson | > s.connect(('::1', 80, 0, 0)) | 19:52 |
| eandersson | and that works fine | 19:52 |
| eandersson | but this does not work | 19:52 |
| eandersson | > s.connect(('[::1]', 80, 0, 0)) | 19:52 |
| eandersson | I assume that should be fine? | 19:53 |
| clarkb | ah I am mistaken then | 19:53 |
| clarkb | (maybe devstack should provide both escaped and unescaped values then? though untablging that through all services is likely to be "fun") | 19:55 |
| clarkb | I'm fairly certain the reason it has the [] are because that var is used ot create urls and they don't want t oconditionally add [] everytime | 19:56 |
| eandersson | I'll just rollback my change for now. The job is non-voting anyway. | 19:56 |
| eandersson | I'll get that merged and figure out if we should do this in devstack or code. | 19:58 |
| eandersson | Feel free to drop a comment here if you have any feedback https://review.opendev.org/#/c/678266/ | 19:59 |
| *** eharney has joined #openstack-infra | 20:10 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Fix secret for promote-stx-tox-docs https://review.opendev.org/678299 | 20:10 |
| *** weshay is now known as weshay_MOD | 20:10 | |
| AJaeger | config-core, this fixes starlingx promote jobs, could we merge this quickly to unbreak, please? ^ | 20:10 |
| *** jamesmcarthur has joined #openstack-infra | 20:14 | |
| fungi | looking | 20:15 |
| fungi | thanks for fixing! | 20:16 |
| AJaeger | thanks for quick review | 20:17 |
| * AJaeger waves good night and wishes a great weekend | 20:17 | |
| *** jamesmcarthur has quit IRC | 20:18 | |
| *** jamesmcarthur has joined #openstack-infra | 20:19 | |
| fungi | you too AJaeger! | 20:21 |
| clarkb | I'm really stumped on this logstash filename thing | 20:23 |
| clarkb | in theory the code I wrote has merged and goes into the running zuul config for jobs that start afte rthat merge | 20:23 |
| clarkb | however I don't see evidence of that not even in the zuul executor debug logs | 20:24 |
| clarkb | one thing is we set ignore_errors to true on that play, but looking at the executor debug logs it doesn't appera to have errored | 20:29 |
| openstackgerrit | Merged openstack/project-config master: Fix secret for promote-stx-tox-docs https://review.opendev.org/678299 | 20:30 |
| clarkb | ok I think I may be a derp | 20:31 |
| openstackgerrit | Clark Boylan proposed opendev/base-jobs master: Stop treating .gz files as special in log handling https://review.opendev.org/678303 | 20:36 |
| clarkb | infra-root config-core ^ the submit log processor jobs are all in base-jobs now | 20:37 |
| clarkb | fungi: ^ maybe you can ack that and I'll merge it? | 20:37 |
| *** igordc has quit IRC | 20:37 | |
| clarkb | I'm going to delete those roles from project-config now | 20:37 |
| openstackgerrit | Clark Boylan proposed openstack/project-config master: Cleanup roles that have moved to opendev/base-jobs https://review.opendev.org/678304 | 20:38 |
| clarkb | hopefully ^ reduces future confusion | 20:38 |
| *** whoami-rajat has joined #openstack-infra | 21:00 | |
| *** michael-beaver has quit IRC | 21:10 | |
| *** roman_g has joined #openstack-infra | 21:18 | |
| *** needscoffee is now known as kmalloc | 21:32 | |
| *** Vadmacs has quit IRC | 21:43 | |
| *** igordc has joined #openstack-infra | 21:45 | |
| *** jamesmcarthur has quit IRC | 21:46 | |
| *** jamesmcarthur has joined #openstack-infra | 21:48 | |
| *** jamesmcarthur has quit IRC | 21:50 | |
| *** jamesmcarthur has joined #openstack-infra | 21:51 | |
| openstackgerrit | Clark Boylan proposed zuul/zuul master: Set git user config in from scratch document https://review.opendev.org/678312 | 21:54 |
| openstackgerrit | Clark Boylan proposed opendev/puppet-log_processor master: Don't try to get .gz suffixed files in addition to base url https://review.opendev.org/677236 | 21:55 |
| *** takamatsu has quit IRC | 21:55 | |
| *** jamesmcarthur has quit IRC | 22:07 | |
| *** jamesmcarthur has joined #openstack-infra | 22:07 | |
| *** rcernin has joined #openstack-infra | 22:11 | |
| johnsom | Hi folks, I'm having a problem with the new zuul logs archive: https://ddcc85fe9cd658c6dac3-b81d4381f8c07328b28c126876a3e27b.ssl.cf5.rackcdn.com/667249/2/check/openstack-tox-docs/a6e2f90/html/ | 22:12 |
| johnsom | Web Listing Disabled | 22:12 |
| *** jamesmcarthur has quit IRC | 22:13 | |
| johnsom | Ah, ok, It's a bug in the new pdf-docs job I bet. The html docs aren't there | 22:14 |
| johnsom | They are now under "docs" instead of "html" which is what zuul points to. | 22:14 |
| *** aaronsheffield has quit IRC | 22:15 | |
| johnsom | The link from zuul is https://ddcc85fe9cd658c6dac3-b81d4381f8c07328b28c126876a3e27b.ssl.cf5.rackcdn.com/667249/2/check/openstack-tox-docs/a6e2f90/html/ but the docs job is doing: https://ddcc85fe9cd658c6dac3-b81d4381f8c07328b28c126876a3e27b.ssl.cf5.rackcdn.com/667249/2/check/openstack-tox-docs/a6e2f90/docs/ | 22:17 |
| clarkb | hrm I didn't think the html stuff changed just addition of pdf on the side | 22:20 |
| johnsom | I think this patch has a bug: https://review.opendev.org/#/c/678142 | 22:20 |
| johnsom | Trying to figure out where to report it as base-jobs doesn't exist in storyboard. | 22:20 |
| *** kaisers has quit IRC | 22:21 | |
| *** rlandy|ruck has quit IRC | 22:21 | |
| clarkb | johnsom: ya but that is only pdf stuff | 22:22 |
| clarkb | that doesn't touch html | 22:22 |
| clarkb | a few lines above there is where the html is processed and that goes under docs/ | 22:22 |
| clarkb | so maybe an ealrier change | 22:22 |
| johnsom | Ah, yeah | 22:22 |
| clarkb | its been that way since its inception | 22:24 |
| johnsom | Odd though, that code was added five months ago. I'm pretty sure this is new or related to the pdf changes. | 22:24 |
| clarkb | I think the change to promote instead of rebuilding is what must've done it | 22:24 |
| clarkb | johnsom: the relatively recent change is to use the promote pipeline to grab artifacts built during the gate and promote them to published locations | 22:25 |
| clarkb | johnsom: rather than rebuilding the docs again post merge | 22:25 |
| clarkb | that happened in the last week | 22:25 |
| johnsom | That sounds like a good candidate | 22:25 |
| clarkb | can you link to the builds page that has the wrong link in it? | 22:25 |
| johnsom | It's still running in zuul: 667249 | 22:26 |
| johnsom | It will eventually be here: https://review.opendev.org/667249 | 22:26 |
| *** kaisers has joined #openstack-infra | 22:26 | |
| clarkb | the build-openstack-api-ref job works | 22:27 |
| clarkb | with that docs/ url | 22:27 |
| johnsom | Ha, yeah, interesting | 22:27 |
| clarkb | that gives us something to compare against | 22:27 |
| *** mriedem has quit IRC | 22:27 | |
| clarkb | they use the same system | 22:27 |
| clarkb | its the success-url | 22:28 |
| johnsom | https://opendev.org/openstack/openstack-zuul-jobs/src/branch/master/zuul.d/jobs.yaml#L436 | 22:29 |
| clarkb | ya and line 455 | 22:30 |
| clarkb | I think if we change that to docs/ it will work or maybe even drop it | 22:30 |
| clarkb | build-openstack-api-ref doesn't set it | 22:30 |
| clarkb | but works | 22:30 |
| clarkb | johnsom: doyou want to push that change up? | 22:31 |
| johnsom | Yeah, I can do that. | 22:31 |
| *** jamesmcarthur has joined #openstack-infra | 22:31 | |
| *** roman_g has quit IRC | 22:31 | |
| johnsom | Do you know the patch that switched to the promote pipeline? | 22:36 |
| *** jamesmcarthur has quit IRC | 22:37 | |
| clarkb | johnsom: I7d5ba35733be78b9d734776ff8edd7020ec6b694 I think | 22:38 |
| johnsom | Thanks, that looks like it. | 22:39 |
| *** jamesmcarthur has joined #openstack-infra | 22:39 | |
| openstackgerrit | Michael Johnson proposed openstack/openstack-zuul-jobs master: Remove the success-url from openstack-tox-docs https://review.opendev.org/678319 | 22:40 |
| clarkb | thanks! | 22:41 |
| johnsom | NP, thanks for the help | 22:42 |
| *** anteaya has quit IRC | 22:45 | |
| *** jamesmcarthur has quit IRC | 22:46 | |
| *** jamesmcarthur has joined #openstack-infra | 22:50 | |
| *** tonyb[m] has joined #openstack-infra | 22:54 | |
| *** kjackal has quit IRC | 22:57 | |
| *** igordc has quit IRC | 23:00 | |
| *** jamesmcarthur has quit IRC | 23:01 | |
| *** whoami-rajat has quit IRC | 23:10 | |
| fungi | clarkb: lgtm, i've approved it | 23:11 |
| fungi | and sorry for the delay, inlaws staying over and i needed to cook/eat dinner | 23:11 |
| *** rcernin has quit IRC | 23:11 | |
| *** rcernin has joined #openstack-infra | 23:12 | |
| clarkb | no worries I'm still around for a little bit | 23:13 |
| *** jamesmcarthur has joined #openstack-infra | 23:15 | |
| *** jamesmcarthur has quit IRC | 23:17 | |
| *** jamesmcarthur has joined #openstack-infra | 23:19 | |
| *** guoqiao_ has joined #openstack-infra | 23:20 | |
| eandersson | clarkb, what do you think about something like this? https://review.opendev.org/#/c/678321/2/devstack/settings | 23:21 |
| *** jamesmcarthur has quit IRC | 23:22 | |
| *** jamesmcarthur has joined #openstack-infra | 23:22 | |
| clarkb | eandersson: I think SERVICE_HOST isn't always HOST_IP, multinode testing in particular will be different | 23:24 |
| clarkb | also HOST_IP != HOST_IPV6 | 23:24 |
| clarkb | so I think that will always get you an ipv4 address | 23:24 |
| *** beekneemech is now known as keanu | 23:26 | |
| *** keanu is now known as beekneemech | 23:27 | |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Remove the success-url from openstack-tox-docs https://review.opendev.org/678319 | 23:29 |
| openstackgerrit | Merged opendev/base-jobs master: Stop treating .gz files as special in log handling https://review.opendev.org/678303 | 23:31 |
| *** jamesmcarthur has quit IRC | 23:32 | |
| *** ijw has joined #openstack-infra | 23:33 | |
| *** mattw4 has quit IRC | 23:37 | |
| *** jamesmcarthur has joined #openstack-infra | 23:38 | |
| eandersson | clarkb, Yea I'll have to re-think this. Gonna see if I at least can get past this to make sure there isn't anything else broken. | 23:38 |
| *** jamesmcarthur has quit IRC | 23:42 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!