| *** jamesmcarthur has joined #openstack-infra | 00:02 | |
| *** dingyichen has joined #openstack-infra | 00:05 | |
| *** pbourke has quit IRC | 00:07 | |
| *** pbourke has joined #openstack-infra | 00:09 | |
| *** slaweq has joined #openstack-infra | 00:11 | |
| *** linkmark has quit IRC | 00:12 | |
| *** slaweq has quit IRC | 00:16 | |
| *** jamesmcarthur has quit IRC | 00:16 | |
| *** jamesmcarthur has joined #openstack-infra | 00:18 | |
| pabelanger | ianw: my current thoughts on fedora traceroute failures: https://review.openstack.org/586851/ | 00:19 |
|---|---|---|
| pabelanger | tl;dr, dns failures | 00:19 |
| *** Kevin_Zheng has quit IRC | 00:35 | |
| *** jamesmcarthur has quit IRC | 00:35 | |
| *** jamesmcarthur has joined #openstack-infra | 00:38 | |
| kei-ichi | Hi Infra team members. Cloud you plz add me as one of slogging-release repository. I forgot to ask you about this for a long time, sorry. | 00:39 |
| *** jamesmcarthur has quit IRC | 00:41 | |
| ianw | kei-ichi: done | 00:46 |
| kei-ichi | Thank you lanw ! | 00:46 |
| ianw | pabelanger: hrm, ok. would putting it in a block help? i have to look into ansible ordering more | 00:47 |
| kei-ichi | Sorry ... I made mistake for your name. Again thank you ianw o/ | 00:48 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Add trigger-readthedocs-webhook job https://review.openstack.org/583449 | 00:58 |
| openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: Use webhook update for docs-on-readthedocs https://review.openstack.org/583834 | 01:07 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add role to trigger readthedocs via authenticated endpoint https://review.openstack.org/579434 | 01:17 |
| *** hongbin has joined #openstack-infra | 01:23 | |
| *** jamesmcarthur has joined #openstack-infra | 01:26 | |
| openstackgerrit | Fatema Khalid Sherif proposed openstack-infra/storyboard-webclient master: Expose ordering criteria in search UI https://review.openstack.org/577870 | 01:33 |
| *** r-daneel has joined #openstack-infra | 01:33 | |
| *** jamesmcarthur has quit IRC | 01:36 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Add trigger-readthedocs-webhook job https://review.openstack.org/583449 | 01:36 |
| *** jamesmcarthur has joined #openstack-infra | 01:37 | |
| openstackgerrit | Fatema Khalid Sherif proposed openstack-infra/storyboard-webclient master: Expose ordering criteria in search UI https://review.openstack.org/577870 | 01:41 |
| *** jamesmcarthur has quit IRC | 01:42 | |
| *** jamesmcarthur has joined #openstack-infra | 01:47 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add non-voting nodejs-npm-run-lint nodejs-npm-run-test jobs https://review.openstack.org/584605 | 02:02 |
| *** jamesmcarthur has quit IRC | 02:09 | |
| *** diablo_rojo has quit IRC | 02:09 | |
| *** slaweq has joined #openstack-infra | 02:11 | |
| *** jento has quit IRC | 02:12 | |
| *** jamesmcarthur has joined #openstack-infra | 02:12 | |
| *** slaweq has quit IRC | 02:15 | |
| *** jento has joined #openstack-infra | 02:18 | |
| *** annp has joined #openstack-infra | 02:23 | |
| *** jamesmcarthur has quit IRC | 02:30 | |
| *** jamesmcarthur has joined #openstack-infra | 02:34 | |
| *** armaan has joined #openstack-infra | 02:37 | |
| *** armaan has quit IRC | 02:41 | |
| *** jamesmcarthur has quit IRC | 02:51 | |
| *** jamesmcarthur has joined #openstack-infra | 02:55 | |
| *** psachin has joined #openstack-infra | 02:56 | |
| *** bobh has joined #openstack-infra | 02:58 | |
| *** gongysh has joined #openstack-infra | 03:04 | |
| *** ramishra has joined #openstack-infra | 03:07 | |
| *** slaweq has joined #openstack-infra | 03:11 | |
| *** jamesmcarthur has quit IRC | 03:12 | |
| *** slaweq has quit IRC | 03:15 | |
| *** Bhujay has joined #openstack-infra | 03:16 | |
| *** felipemonteiro__ has joined #openstack-infra | 03:24 | |
| *** felipemonteiro_ has quit IRC | 03:27 | |
| *** jamesmcarthur has joined #openstack-infra | 03:29 | |
| *** jamesmcarthur has quit IRC | 03:34 | |
| *** jamesmcarthur has joined #openstack-infra | 03:35 | |
| *** yolanda_ has joined #openstack-infra | 03:38 | |
| *** links has joined #openstack-infra | 03:39 | |
| *** udesale has joined #openstack-infra | 03:40 | |
| *** jamesmcarthur has quit IRC | 03:40 | |
| *** yolanda has quit IRC | 03:41 | |
| *** mschuppert has joined #openstack-infra | 04:05 | |
| *** Bhujay has quit IRC | 04:07 | |
| *** sambetts_ has quit IRC | 04:07 | |
| *** sambetts_ has joined #openstack-infra | 04:09 | |
| *** armaan has joined #openstack-infra | 04:12 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Use nodepool-builder.logging.conf from puppet-nodepool https://review.openstack.org/586236 | 04:14 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Cleanup nodepool.openstack.org to be a zk server https://review.openstack.org/547248 | 04:14 |
| *** bobh has quit IRC | 04:14 | |
| *** links has quit IRC | 04:15 | |
| *** stakeda has joined #openstack-infra | 04:15 | |
| *** armaan has quit IRC | 04:17 | |
| *** rkukura has quit IRC | 04:23 | |
| *** yamamoto has quit IRC | 04:23 | |
| *** yamamoto has joined #openstack-infra | 04:24 | |
| *** chkumar|trekk is now known as chandankumar | 04:30 | |
| *** links has joined #openstack-infra | 04:33 | |
| *** rkukura has joined #openstack-infra | 04:37 | |
| *** jamesmcarthur has joined #openstack-infra | 04:38 | |
| *** hongbin has quit IRC | 04:41 | |
| *** jamesmcarthur has quit IRC | 04:42 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move LVM cleanup phase into cleanup https://review.openstack.org/579102 | 04:49 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Only detach device if all partitions have been cleaned https://review.openstack.org/576876 | 04:49 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add a PartitionTableNode to graph https://review.openstack.org/579059 | 04:49 |
| *** dhajare has joined #openstack-infra | 04:49 | |
| *** ddurst has quit IRC | 04:53 | |
| *** armaan has joined #openstack-infra | 04:54 | |
| *** ddurst has joined #openstack-infra | 04:58 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add publish-to-pypi-horizon job to masakari-dashboard https://review.openstack.org/585975 | 04:58 |
| *** aeng has joined #openstack-infra | 04:58 | |
| *** gongysh has quit IRC | 04:59 | |
| *** armaan has quit IRC | 05:00 | |
| *** armaan has joined #openstack-infra | 05:01 | |
| *** armaan_ has joined #openstack-infra | 05:03 | |
| *** armaan_ has quit IRC | 05:03 | |
| *** armaan_ has joined #openstack-infra | 05:04 | |
| *** armaan has quit IRC | 05:06 | |
| *** armaan_ has quit IRC | 05:08 | |
| *** slaweq has joined #openstack-infra | 05:11 | |
| *** Bhujay has joined #openstack-infra | 05:14 | |
| *** cshastri has joined #openstack-infra | 05:15 | |
| *** slaweq has quit IRC | 05:15 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/infra-specs master: Direction setting for 3rd Party CI https://review.openstack.org/563849 | 05:18 |
| *** ykarel| has joined #openstack-infra | 05:20 | |
| *** felipemonteiro__ has quit IRC | 05:24 | |
| *** e0ne has joined #openstack-infra | 05:28 | |
| *** gongysh has joined #openstack-infra | 05:30 | |
| *** ykarel| is now known as ykarel | 05:35 | |
| *** rkukura has quit IRC | 05:39 | |
| *** kjackal has joined #openstack-infra | 05:41 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement a Kubernetes driver https://review.openstack.org/535557 | 05:49 |
| *** jaosorior has joined #openstack-infra | 05:51 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: executor: add support for generic build resource https://review.openstack.org/570668 | 05:51 |
| *** vivsoni has joined #openstack-infra | 05:53 | |
| *** e0ne has quit IRC | 06:00 | |
| *** slaweq has joined #openstack-infra | 06:11 | |
| *** alexchadin has joined #openstack-infra | 06:12 | |
| *** alexchadin has quit IRC | 06:14 | |
| *** slaweq has quit IRC | 06:16 | |
| *** jtomasek has joined #openstack-infra | 06:18 | |
| *** quiquell has joined #openstack-infra | 06:19 | |
| *** vaidy has quit IRC | 06:23 | |
| *** isviridov_away has quit IRC | 06:23 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Don't quote names with sgdisk https://review.openstack.org/578265 | 06:26 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Only detach device if all partitions have been cleaned https://review.openstack.org/576876 | 06:27 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add a PartitionTableNode to graph https://review.openstack.org/579059 | 06:27 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement an OpenShift resource provider https://review.openstack.org/570667 | 06:30 |
| *** melwitt has quit IRC | 06:31 | |
| *** sdake has quit IRC | 06:31 | |
| *** melwitt has joined #openstack-infra | 06:32 | |
| *** melwitt is now known as Guest9714 | 06:32 | |
| *** sdake has joined #openstack-infra | 06:32 | |
| *** sdake has quit IRC | 06:32 | |
| *** sdake has joined #openstack-infra | 06:32 | |
| *** agopi has quit IRC | 06:35 | |
| *** kjackal has quit IRC | 06:37 | |
| *** vaidy has joined #openstack-infra | 06:38 | |
| *** threestrands has joined #openstack-infra | 06:38 | |
| *** threestrands has quit IRC | 06:38 | |
| *** threestrands has joined #openstack-infra | 06:38 | |
| *** isviridov_away has joined #openstack-infra | 06:39 | |
| *** sambetts_ has quit IRC | 06:41 | |
| *** ccamacho has joined #openstack-infra | 06:44 | |
| *** sambetts_ has joined #openstack-infra | 06:45 | |
| *** janki has joined #openstack-infra | 06:47 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-base-jobs master: Add base openshift job https://review.openstack.org/570669 | 06:49 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-base-jobs master: Update test-requirements ansible version https://review.openstack.org/586949 | 06:49 |
| *** slaweq has joined #openstack-infra | 06:56 | |
| *** pcaruana has joined #openstack-infra | 06:56 | |
| *** Bhujay has quit IRC | 06:57 | |
| *** zoli is now known as zoli|wfh | 06:57 | |
| *** zoli|wfh is now known as zoli | 06:57 | |
| *** zhurong has joined #openstack-infra | 06:58 | |
| *** ramishra has quit IRC | 07:00 | |
| *** ramishra has joined #openstack-infra | 07:01 | |
| *** tesseract has joined #openstack-infra | 07:04 | |
| *** pguimaraes has joined #openstack-infra | 07:08 | |
| *** rcernin has quit IRC | 07:09 | |
| *** yamamoto has quit IRC | 07:11 | |
| *** pcaruana has quit IRC | 07:14 | |
| *** ginopc has joined #openstack-infra | 07:17 | |
| *** pcaruana has joined #openstack-infra | 07:18 | |
| *** lpetrut has joined #openstack-infra | 07:20 | |
| *** yolanda_ is now known as yolanda | 07:21 | |
| *** jpich has joined #openstack-infra | 07:21 | |
| *** florianf has joined #openstack-infra | 07:23 | |
| *** dalvarez has joined #openstack-infra | 07:25 | |
| *** AJaeger has quit IRC | 07:26 | |
| *** benj_ has quit IRC | 07:30 | |
| *** yamamoto has joined #openstack-infra | 07:30 | |
| *** threestrands has quit IRC | 07:32 | |
| *** benj_ has joined #openstack-infra | 07:32 | |
| *** jtomasek has quit IRC | 07:34 | |
| *** jtomasek_ has joined #openstack-infra | 07:34 | |
| *** kjackal has joined #openstack-infra | 07:36 | |
| *** ykarel is now known as ykarel|lunch | 07:38 | |
| *** Bhujay has joined #openstack-infra | 07:40 | |
| *** PapaOurs is now known as bauzas | 07:41 | |
| *** peereb has joined #openstack-infra | 07:43 | |
| *** rpittau has joined #openstack-infra | 07:43 | |
| *** jpena has joined #openstack-infra | 07:47 | |
| *** e0ne has joined #openstack-infra | 07:50 | |
| *** rossella_s has joined #openstack-infra | 07:53 | |
| *** Bhujay has quit IRC | 08:02 | |
| *** hashar has joined #openstack-infra | 08:02 | |
| *** derekh has joined #openstack-infra | 08:08 | |
| *** zhurong has quit IRC | 08:09 | |
| *** roman_g has joined #openstack-infra | 08:11 | |
| *** ginopc has quit IRC | 08:19 | |
| *** ginopc has joined #openstack-infra | 08:20 | |
| *** ykarel|lunch is now known as ykarel | 08:22 | |
| *** ginopc has quit IRC | 08:27 | |
| *** dingyichen has quit IRC | 08:30 | |
| *** d0ugal has joined #openstack-infra | 08:31 | |
| *** d0ugal has quit IRC | 08:31 | |
| *** d0ugal has joined #openstack-infra | 08:31 | |
| *** pblaho has joined #openstack-infra | 08:38 | |
| *** gfidente has joined #openstack-infra | 08:46 | |
| *** gfidente has joined #openstack-infra | 08:46 | |
| *** bhavik1 has joined #openstack-infra | 08:50 | |
| *** AJaeger has joined #openstack-infra | 08:52 | |
| *** shardy has joined #openstack-infra | 09:04 | |
| *** sshnaidm has quit IRC | 09:07 | |
| *** sshnaidm has joined #openstack-infra | 09:09 | |
| *** sshnaidm is now known as sshnaidm|afk | 09:12 | |
| *** quiquell is now known as quiquell|mtg | 09:15 | |
| *** rossella_s has quit IRC | 09:16 | |
| *** sambetts_ is now known as sambetts | 09:19 | |
| *** psachin` has joined #openstack-infra | 09:21 | |
| *** rpioso is now known as rpioso|afk | 09:22 | |
| *** psachin has quit IRC | 09:22 | |
| *** dtantsur|afk is now known as dtantsur | 09:35 | |
| *** pjrusak has joined #openstack-infra | 09:35 | |
| *** quiquell|mtg is now known as quiquell | 09:37 | |
| *** Bhujay has joined #openstack-infra | 09:46 | |
| *** sshnaidm|afk has quit IRC | 09:47 | |
| *** yamamoto has quit IRC | 10:01 | |
| *** slaweq has quit IRC | 10:07 | |
| *** slaweq has joined #openstack-infra | 10:09 | |
| *** bhavik1 has quit IRC | 10:16 | |
| *** jaosorior has quit IRC | 10:26 | |
| *** yamamoto has joined #openstack-infra | 10:27 | |
| *** jamesmcarthur has joined #openstack-infra | 10:38 | |
| *** yamamoto has quit IRC | 10:39 | |
| *** jamesmcarthur has quit IRC | 10:43 | |
| *** udesale has quit IRC | 10:47 | |
| *** zzzeek has quit IRC | 10:49 | |
| *** kjackal has quit IRC | 10:49 | |
| *** panda|rover|off is now known as panda|rover | 10:50 | |
| *** zzzeek has joined #openstack-infra | 10:53 | |
| dtantsur | morning folks. is the topic of this and many channels up-to-date? I see most of jobs passing. | 10:56 |
| *** rh-jelabarre has joined #openstack-infra | 10:56 | |
| *** sshnaidm|afk has joined #openstack-infra | 11:05 | |
| *** jangutter has joined #openstack-infra | 11:06 | |
| *** rosmaita has joined #openstack-infra | 11:08 | |
| *** diablo_rojo has joined #openstack-infra | 11:09 | |
| *** yamamoto has joined #openstack-infra | 11:13 | |
| *** annp has quit IRC | 11:14 | |
| *** yamamoto has quit IRC | 11:14 | |
| *** yamamoto has joined #openstack-infra | 11:16 | |
| *** diablo_rojo has quit IRC | 11:16 | |
| *** kjackal has joined #openstack-infra | 11:18 | |
| *** yamamoto has quit IRC | 11:19 | |
| *** yamamoto has joined #openstack-infra | 11:25 | |
| *** zoli is now known as zoli|doctor | 11:26 | |
| *** larainema has quit IRC | 11:27 | |
| *** diablo_rojo has joined #openstack-infra | 11:28 | |
| *** vivsoni has quit IRC | 11:28 | |
| *** jpena is now known as jpena|lunch | 11:29 | |
| *** dhajare has quit IRC | 11:32 | |
| *** jaosorior has joined #openstack-infra | 11:32 | |
| *** dhajare has joined #openstack-infra | 11:32 | |
| *** quiquell is now known as quiquell|lunch | 11:33 | |
| *** rfolco|off is now known as rfolco|ruck | 11:36 | |
| AJaeger | mmh, did we forget a #status ok? LEt me try... | 11:37 |
| AJaeger | #status ok | 11:37 |
| openstackstatus | AJaeger: sending ok | 11:37 |
| *** vivsoni has joined #openstack-infra | 11:39 | |
| AJaeger | dtantsur: looks indeed as if the status ok was drafted but never sent ;( | 11:40 |
| dtantsur | heh, okay, thanks! | 11:41 |
| *** ldnunes has joined #openstack-infra | 11:41 | |
| AJaeger | dtantsur: thanks for telling us! | 11:42 |
| *** boden has joined #openstack-infra | 11:44 | |
| *** wolverineav has joined #openstack-infra | 11:44 | |
| *** panda|rover is now known as panda|lunch | 11:51 | |
| *** yamamoto has quit IRC | 11:55 | |
| AJaeger | infra-root, I do not see a "finished sending ok" from openstackstatus - and the channel topic is not reset ;( Could you check, please? | 11:58 |
| *** yamamoto has joined #openstack-infra | 12:04 | |
| *** yamamoto has quit IRC | 12:09 | |
| *** yamamoto has joined #openstack-infra | 12:09 | |
| *** quiquell|lunch is now known as quiquell | 12:11 | |
| *** peereb has quit IRC | 12:19 | |
| *** rlandy has joined #openstack-infra | 12:31 | |
| *** jpena|lunch is now known as jpena | 12:32 | |
| *** panda|lunch is now known as panda|rover | 12:32 | |
| *** jcoufal has joined #openstack-infra | 12:34 | |
| *** tpsilva has joined #openstack-infra | 12:36 | |
| roman_g | "recheck" in gerrit comments should re-trigger all jobs - it that correct? | 12:38 |
| AJaeger | roman_g: yes | 12:38 |
| roman_g | thanks, AJaeger | 12:39 |
| AJaeger | roman_g: It runs the check queue again - so all jobs, in that queue are run again. | 12:39 |
| *** rcarrill1 is now known as rcarrillocruz | 12:41 | |
| *** links has quit IRC | 12:44 | |
| *** zoli|doctor is now known as zoli | 12:45 | |
| *** zoli is now known as zoli|wfh | 12:46 | |
| *** zoli|wfh is now known as zoli | 12:46 | |
| *** kgiusti has joined #openstack-infra | 12:47 | |
| *** jamesmcarthur has joined #openstack-infra | 12:47 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: Also compress json files https://review.openstack.org/587049 | 12:48 |
| *** mriedem has joined #openstack-infra | 12:49 | |
| *** agopi has joined #openstack-infra | 12:49 | |
| *** mugsie has quit IRC | 12:49 | |
| *** mugsie has joined #openstack-infra | 12:49 | |
| *** mugsie has quit IRC | 12:49 | |
| *** mugsie has joined #openstack-infra | 12:49 | |
| *** jamesmcarthur has quit IRC | 12:53 | |
| *** yamamoto has quit IRC | 12:54 | |
| *** edmondsw has joined #openstack-infra | 12:56 | |
| *** links has joined #openstack-infra | 12:56 | |
| *** camunoz has joined #openstack-infra | 12:58 | |
| *** jamesmcarthur has joined #openstack-infra | 12:58 | |
| *** kgiusti has quit IRC | 13:00 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: Also compress json files https://review.openstack.org/587049 | 13:01 |
| *** edmondsw has quit IRC | 13:06 | |
| *** sshnaidm|afk is now known as sshnaidm | 13:06 | |
| *** camunoz has quit IRC | 13:06 | |
| *** camunoz has joined #openstack-infra | 13:07 | |
| *** janki has quit IRC | 13:08 | |
| *** janki has joined #openstack-infra | 13:08 | |
| *** bobh has joined #openstack-infra | 13:09 | |
| *** jroll has quit IRC | 13:10 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/openstack-zuul-jobs master: Extend project translation template for Rocky https://review.openstack.org/587055 | 13:10 |
| *** jroll has joined #openstack-infra | 13:10 | |
| *** rkukura has joined #openstack-infra | 13:11 | |
| *** dizquierdo has joined #openstack-infra | 13:11 | |
| *** yamamoto has joined #openstack-infra | 13:14 | |
| *** kgiusti has joined #openstack-infra | 13:18 | |
| *** bnemec has joined #openstack-infra | 13:20 | |
| *** dmsimard has joined #openstack-infra | 13:23 | |
| *** dmsimard has quit IRC | 13:23 | |
| *** dmsimard has joined #openstack-infra | 13:23 | |
| *** agopi is now known as agopi|brb | 13:25 | |
| *** r-daneel has quit IRC | 13:28 | |
| *** rpioso|afk is now known as rpioso | 13:29 | |
| *** agopi|brb has quit IRC | 13:30 | |
| *** udesale has joined #openstack-infra | 13:30 | |
| *** gongysh has quit IRC | 13:34 | |
| *** udesale has quit IRC | 13:35 | |
| *** Goneri has joined #openstack-infra | 13:38 | |
| *** ade_lee has joined #openstack-infra | 13:40 | |
| *** niedbalski has quit IRC | 13:42 | |
| *** niedbalski has joined #openstack-infra | 13:42 | |
| *** lbragstad has joined #openstack-infra | 13:46 | |
| *** kaiokmo has quit IRC | 13:48 | |
| *** kgiusti has quit IRC | 13:50 | |
| *** bobh has quit IRC | 13:51 | |
| *** yyz_ has joined #openstack-infra | 13:53 | |
| *** agopi has joined #openstack-infra | 13:54 | |
| *** kaiokmo has joined #openstack-infra | 13:54 | |
| *** electrofelix has joined #openstack-infra | 14:00 | |
| *** psachin`` has joined #openstack-infra | 14:05 | |
| *** psachin` has quit IRC | 14:06 | |
| *** kgiusti has joined #openstack-infra | 14:07 | |
| *** dhajare has quit IRC | 14:07 | |
| *** rkukura has quit IRC | 14:10 | |
| *** hongbin has joined #openstack-infra | 14:14 | |
| *** yamamoto has quit IRC | 14:16 | |
| *** yamamoto has joined #openstack-infra | 14:16 | |
| *** yamamoto has quit IRC | 14:16 | |
| *** yamamoto has joined #openstack-infra | 14:17 | |
| *** quiquell has quit IRC | 14:17 | |
| *** yamamoto has quit IRC | 14:18 | |
| *** yamamoto has joined #openstack-infra | 14:18 | |
| *** yamamoto has quit IRC | 14:18 | |
| *** bobh has joined #openstack-infra | 14:23 | |
| *** pjrusak has quit IRC | 14:24 | |
| *** bobh has quit IRC | 14:24 | |
| *** bobh has joined #openstack-infra | 14:24 | |
| *** wolverineav has quit IRC | 14:26 | |
| *** wolverineav has joined #openstack-infra | 14:26 | |
| *** links has quit IRC | 14:27 | |
| *** ramishra has quit IRC | 14:29 | |
| bnemec | Should the channel topics still be about the retry_limit thing? | 14:29 |
| *** ramishra has joined #openstack-infra | 14:30 | |
| *** felipemonteiro__ has joined #openstack-infra | 14:31 | |
| *** mriedem has quit IRC | 14:31 | |
| openstackgerrit | yatin proposed openstack-infra/project-config master: [generate_puppetfile] Add support for handling commit https://review.openstack.org/587078 | 14:33 |
| *** udesale has joined #openstack-infra | 14:34 | |
| *** dklyle has joined #openstack-infra | 14:34 | |
| *** pblaho has quit IRC | 14:34 | |
| *** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/" | 14:36 | |
| *** pblaho has joined #openstack-infra | 14:37 | |
| *** dtantsur is now known as dtantsur|brb | 14:38 | |
| corvus | AJaeger: thanks, i restored them from the last set it logged | 14:38 |
| *** mriedem has joined #openstack-infra | 14:39 | |
| *** ykarel is now known as ykarel|away | 14:41 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:43 | |
| *** felipemonteiro__ has quit IRC | 14:46 | |
| *** ekhugen has quit IRC | 14:46 | |
| *** slaweq has quit IRC | 14:48 | |
| *** jiapei has joined #openstack-infra | 14:49 | |
| *** ekhugen has joined #openstack-infra | 14:49 | |
| AJaeger | thanks, corvus! | 14:49 |
| *** ykarel|away has quit IRC | 14:51 | |
| *** felipemonteiro_ has quit IRC | 14:56 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:57 | |
| *** jamesdenton has joined #openstack-infra | 14:59 | |
| *** slaweq has joined #openstack-infra | 15:01 | |
| *** janki has quit IRC | 15:03 | |
| *** pblaho has quit IRC | 15:05 | |
| *** pcaruana has quit IRC | 15:16 | |
| *** eernst has joined #openstack-infra | 15:18 | |
| pabelanger | config-core: I noticed https://review.openstack.org/586851/ on the weekend, and would make like to test today. tl;dr is it is possible for DNS to fail in base job, due to unbound restarting after all roles have run. This is because the way handlers work | 15:18 |
| clarkb | pabelanger: the 'is it is' makes it slightly ambiguous if you are saying it is posible or wondering if it is possible | 15:19 |
| pabelanger | clarkb: I _think_ it is possible, but don't really have logs to point to yet. I am mostly trying to debug: http://logs.openstack.org/47/586847/1/gate/windmill-fedora-27/2f06941/job-output.txt.gz | 15:20 |
| pabelanger | but if you see, unbound restarts after the validate-host failure | 15:20 |
| pabelanger | and looking at code, only way I can see traceroute / traceroute6 fail could be if we cannot resolve DNS for hostname | 15:21 |
| clarkb | gotcha so unbound isn't fully configured at that point | 15:21 |
| pabelanger | which, if we are not restarting unbound to pick up forwarding.conf changes, could just be it | 15:21 |
| pabelanger | yah | 15:21 |
| pabelanger | it still is a guess, but struggle to understand why fedora has a high failure rate because of this | 15:22 |
| *** yyz_ has quit IRC | 15:22 | |
| clarkb | pabelanger: left a note for a minor thing that might make this harder to undo in the future but willing to try it | 15:23 |
| *** r-daneel has joined #openstack-infra | 15:23 | |
| *** gyee has joined #openstack-infra | 15:25 | |
| *** janki has joined #openstack-infra | 15:27 | |
| clarkb | pabelanger: other distros might reload the config more gracefully with their init systems? | 15:28 |
| clarkb | or have a default dns if not otherwise set that works? | 15:28 |
| clarkb | fedora does the new systemd stuff iirc which might be related | 15:28 |
| *** diablo_rojo has quit IRC | 15:29 | |
| *** jchhatbar has joined #openstack-infra | 15:29 | |
| *** janki has quit IRC | 15:30 | |
| clarkb | hrm we should boot all instances with working unbond though, they will have both ipv4 and ipv6 resolvers though then we trim that list to ipv4 or ipv6 based on local networkingand reload configs | 15:30 |
| *** jchhatbar has quit IRC | 15:30 | |
| *** dave-mcc_ has joined #openstack-infra | 15:30 | |
| *** jchhatbar has joined #openstack-infra | 15:31 | |
| *** dave-mccowan has quit IRC | 15:33 | |
| clarkb | alright I've got to pop out now. Taking kids to the optometrist. I'll be back in a few hours, but then I'm going to try and book travel and get other paperwork things done now that feature freeze is over | 15:35 |
| *** dave-mccowan has joined #openstack-infra | 15:36 | |
| *** dtantsur|brb is now known as dtantsur | 15:37 | |
| *** dave-mcc_ has quit IRC | 15:38 | |
| *** ethfci_ has joined #openstack-infra | 15:38 | |
| *** ethfci has quit IRC | 15:38 | |
| *** dtruong_ has quit IRC | 15:39 | |
| *** cshastri has quit IRC | 15:48 | |
| *** tesseract has quit IRC | 15:49 | |
| *** ramishra has quit IRC | 15:51 | |
| *** jpich has quit IRC | 15:52 | |
| *** dizquierdo has quit IRC | 15:52 | |
| *** Bhujay has quit IRC | 15:53 | |
| pabelanger | new kernels on executors are holding up well, the executor queue is way down today: http://grafana.openstack.org/dashboard/db/zuul-status | 15:54 |
| pabelanger | mind you, gate is a little more relaxed today | 15:55 |
| *** psachin`` has quit IRC | 15:56 | |
| *** zoli is now known as zoli|gone | 15:57 | |
| *** zoli|gone is now known as zoli | 15:58 | |
| *** kgiusti has left #openstack-infra | 16:01 | |
| *** eernst has quit IRC | 16:03 | |
| *** eernst_ has joined #openstack-infra | 16:05 | |
| *** yyz_ has joined #openstack-infra | 16:05 | |
| *** eernst_ has quit IRC | 16:06 | |
| *** eernst has joined #openstack-infra | 16:06 | |
| *** myoung has joined #openstack-infra | 16:14 | |
| *** Guest9714 is now known as melwitt | 16:15 | |
| *** eernst has quit IRC | 16:16 | |
| AJaeger | pabelanger: regarding https://review.openstack.org/#/c/586851/ - want to do the change that clarkb proposed or shall I +2A? | 16:16 |
| *** eernst has joined #openstack-infra | 16:16 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Reset base-test playbooks https://review.openstack.org/587104 | 16:17 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Add base-minimal / base-minimal-test playbooks https://review.openstack.org/587105 | 16:17 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Parent base-test to base-minimal-test https://review.openstack.org/587106 | 16:17 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Parent base to base-minimal https://review.openstack.org/587107 | 16:17 |
| pabelanger | AJaeger: I can update the comment if we move it into base, is that alright? | 16:17 |
| *** eernst has quit IRC | 16:18 | |
| AJaeger | pabelanger: fine for me - just wanted to know how you wnat to handle it. | 16:18 |
| *** eernst has joined #openstack-infra | 16:18 | |
| AJaeger | pabelanger: but I think clarkb suggested a separte role - not only comment update | 16:18 |
| *** eernst has quit IRC | 16:18 | |
| *** eernst has joined #openstack-infra | 16:18 | |
| AJaeger | pabelanger: +2A | 16:19 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Parent base to base-minimal https://review.openstack.org/587107 | 16:20 |
| *** rlandy is now known as rlandy|brb | 16:21 | |
| tdasilva | AJaeger: hello! I just noticed while reviewing p 584794 that we don't have unit/functional tests running on swift stable branches, so I backported patch #587108, do you foresee any issues with that? | 16:22 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Move base-test into ozj https://review.openstack.org/587110 | 16:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Move base-test into ozj https://review.openstack.org/587110 | 16:23 |
| AJaeger | tdasilva, go ahead, should be fine | 16:24 |
| *** jesusaur has quit IRC | 16:24 | |
| tdasilva | AJaeger: ok, thanks, just wanted to double check that didn't have to do anything different for stable branches regarding zuulv3 | 16:25 |
| openstackgerrit | boden proposed openstack-infra/project-config master: remove lib-forward-testing tempate from neutron-lib https://review.openstack.org/587112 | 16:25 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Remove base-test now defined in openstack-zuul-jobs https://review.openstack.org/587113 | 16:25 |
| AJaeger | tdasilva: let me review quickly... | 16:25 |
| *** ccamacho has quit IRC | 16:26 | |
| openstackgerrit | Merged openstack-infra/project-config master: Split roles after unbound into own play https://review.openstack.org/586851 | 16:27 |
| *** bobh has quit IRC | 16:29 | |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Install openstacksdk on zuul executors https://review.openstack.org/586718 | 16:30 |
| *** e0ne has quit IRC | 16:31 | |
| *** felipemonteiro__ has joined #openstack-infra | 16:31 | |
| *** felipemonteiro_ has quit IRC | 16:33 | |
| *** priteau has joined #openstack-infra | 16:33 | |
| *** sthussey has joined #openstack-infra | 16:33 | |
| *** shaner has quit IRC | 16:33 | |
| *** shaner has joined #openstack-infra | 16:35 | |
| *** panda|rover is now known as panda|rover|off | 16:36 | |
| *** udesale has quit IRC | 16:43 | |
| corvus | clarkb, mordred: i'd like to start poking at swift this week; does https://review.openstack.org/585830 look good? | 16:44 |
| *** priteau has quit IRC | 16:44 | |
| *** camunoz has quit IRC | 16:44 | |
| *** yamahata has quit IRC | 16:45 | |
| mordred | corvus: I think there is an error - comment left | 16:46 |
| corvus | thanks! | 16:46 |
| *** diablo_rojo has joined #openstack-infra | 16:47 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add a base job to test storing logs in swift https://review.openstack.org/585830 | 16:47 |
| mordred | corvus: +2 | 16:47 |
| mordred | AJaeger: ^^ you +2'd that before - it just got an update | 16:48 |
| *** bobh has joined #openstack-infra | 16:48 | |
| *** tonytan4ever has joined #openstack-infra | 16:49 | |
| *** tonytan4ever has quit IRC | 16:49 | |
| AJaeger | mordred: thanks, +2A | 16:52 |
| *** kgiusti has joined #openstack-infra | 16:58 | |
| *** camunoz has joined #openstack-infra | 16:59 | |
| *** rlandy|brb is now known as rlandy | 16:59 | |
| *** derekh has quit IRC | 17:01 | |
| *** priteau has joined #openstack-infra | 17:02 | |
| *** gfidente has quit IRC | 17:03 | |
| *** eernst has quit IRC | 17:05 | |
| *** eernst has joined #openstack-infra | 17:07 | |
| *** eernst has joined #openstack-infra | 17:07 | |
| *** sambetts is now known as sambetts|afk | 17:08 | |
| *** hashar is now known as hasharAway | 17:09 | |
| *** jpena is now known as jpena|off | 17:10 | |
| *** cloudtrainme has joined #openstack-infra | 17:11 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/project-config master: Setup translation jobs for Rocky https://review.openstack.org/587164 | 17:11 |
| *** felipemonteiro_ has joined #openstack-infra | 17:12 | |
| *** felipemonteiro__ has quit IRC | 17:12 | |
| *** cloudtrainme has quit IRC | 17:13 | |
| *** kjackal has quit IRC | 17:14 | |
| *** kjackal has joined #openstack-infra | 17:14 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create base-ozj base job https://review.openstack.org/587165 | 17:15 |
| *** cloudtrainme has joined #openstack-infra | 17:15 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Parent to base-ozj for testing https://review.openstack.org/587168 | 17:16 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Delete current base-minimal job https://review.openstack.org/587169 | 17:18 |
| *** yamahata has joined #openstack-infra | 17:19 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Parent to base-ozj for testing https://review.openstack.org/587168 | 17:19 |
| *** cloudtrainme is now known as tonyontopic | 17:21 | |
| *** shardy has quit IRC | 17:28 | |
| mwhahaha | so can anyone point out why https://review.openstack.org/#/c/578742 isn't proceeding to the gate even though it's +A? It looks like all the depends-on are merged and it doesn't look like it's sitting on top of any not merged local changes | 17:30 |
| mwhahaha | oh nevermind there it went | 17:30 |
| mwhahaha | a bit sluggish today | 17:30 |
| *** kjackal has quit IRC | 17:31 | |
| *** camunoz has quit IRC | 17:35 | |
| *** camunoz has joined #openstack-infra | 17:37 | |
| *** jamesmcarthur has quit IRC | 17:38 | |
| *** kjackal has joined #openstack-infra | 17:39 | |
| *** jamesmcarthur has joined #openstack-infra | 17:39 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add a base job to test storing logs in swift https://review.openstack.org/585830 | 17:39 |
| *** shaner has quit IRC | 17:40 | |
| *** e0ne has joined #openstack-infra | 17:43 | |
| *** jamesmcarthur has quit IRC | 17:43 | |
| *** ykarel|away has joined #openstack-infra | 17:45 | |
| *** shaner has joined #openstack-infra | 17:46 | |
| roman_g | Has anyone noticed and questioned why Ara-report is always in reversed chronological order? | 17:46 |
| *** jamesmcarthur has joined #openstack-infra | 17:46 | |
| corvus | roman_g: yeah, i wrote a patch to change that, but it ran into dmsimard's 1.0 rewrite | 17:47 |
| corvus | or, hrm, maybe i didn't write that patch... | 17:48 |
| corvus | at least, i can't find it right now :| | 17:48 |
| mordred | we've talked about a patch at leats | 17:48 |
| *** jamesmcarthur has quit IRC | 17:48 | |
| corvus | i definitely wrote some other patches (related to playbook names) | 17:48 |
| *** jamesmcarthur has joined #openstack-infra | 17:48 | |
| corvus | (so they aren't all just called "post.yaml") | 17:48 |
| mordred | roman_g: the ara report in reverse chronological order makes more sense if you'reusing it as a long-runing service that tracks all of your ansible runs (the most run in that scenario is the most likely thing you wnat to look at) | 17:49 |
| corvus | but yeah, i'd love it if, when it's used in this situtation, we could have it in chrono order | 17:50 |
| corvus | (so, regardless, it needs to be an option so that both uses are supported) | 17:50 |
| corvus | and yeah, apparently i made up that bit about me writing a patch, sorry. dmsimard will know if there's an existing effort to work on that or not. | 17:51 |
| corvus | (most of the patches i write in my dreams get written in reality, but apparently not all of them) | 17:51 |
| roman_g | :D | 17:51 |
| roman_g | Thanks for explanation :) | 17:52 |
| *** lpetrut has quit IRC | 17:52 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: DNM: test logs in swift https://review.openstack.org/587178 | 17:54 |
| *** felipemonteiro__ has joined #openstack-infra | 17:55 | |
| *** shaner has quit IRC | 17:55 | |
| *** shaner has joined #openstack-infra | 17:56 | |
| *** tonyontopic has quit IRC | 17:58 | |
| *** felipemonteiro_ has quit IRC | 17:59 | |
| *** tonyontopic has joined #openstack-infra | 17:59 | |
| *** tonyontopic has quit IRC | 17:59 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Allow launch-retries to indefinitely retry for openstack https://review.openstack.org/584488 | 18:02 |
| AJaeger | config-core, could you review https://review.openstack.org/#/c/587055/ and https://review.openstack.org/#/c/587164/ , please? Those are needed for rocky translations... | 18:08 |
| *** jiapei has quit IRC | 18:09 | |
| *** roman_g has quit IRC | 18:09 | |
| *** roman_g has joined #openstack-infra | 18:09 | |
| openstackgerrit | Jill Rouleau proposed openstack-infra/project-config master: Add Tripleo Ansible repo https://review.openstack.org/583415 | 18:11 |
| AJaeger | thanks, corvus | 18:14 |
| corvus | huh. why didn't i think to have the swift logs test job put logs in *both* places? | 18:15 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Publish swift logs also to static fileserver https://review.openstack.org/587188 | 18:17 |
| corvus | clarkb, AJaeger, mordred: ^ | 18:18 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Extend project translation template for Rocky https://review.openstack.org/587055 | 18:20 |
| *** kjackal has quit IRC | 18:21 | |
| *** myoung is now known as myoung|lunch | 18:22 | |
| mordred | corvus: because that would be too sensible :) +A | 18:22 |
| *** kgiusti has quit IRC | 18:23 | |
| corvus | mordred: where did the profile fix end up? | 18:29 |
| corvus | or was there one...? | 18:30 |
| *** electrofelix has quit IRC | 18:31 | |
| corvus | mordred: ah it's this one: https://review.openstack.org/585780 | 18:31 |
| *** dtantsur is now known as dtantsur|afk | 18:31 | |
| corvus | mordred: what's the prognosis for a release with that? | 18:31 |
| *** kgiusti has joined #openstack-infra | 18:39 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add auth_url to vexxhost secret https://review.openstack.org/587194 | 18:40 |
| corvus | mordred, AJaeger, clarkb: ^ workaround | 18:41 |
| openstackgerrit | Merged openstack-infra/project-config master: Setup translation jobs for Rocky https://review.openstack.org/587164 | 18:46 |
| openstackgerrit | Merged openstack-infra/project-config master: Publish swift logs also to static fileserver https://review.openstack.org/587188 | 18:55 |
| notmyname | is there a way to ask gerrit to show open patches that touch a particular file? | 18:56 |
| timburke | notmyname: yes; do a query like 'is:open file:path/to/file' | 18:58 |
| timburke | you can even do regex matching, like file:^path/to/dir/.* | 18:59 |
| notmyname | thanks | 19:00 |
| *** zul has quit IRC | 19:03 | |
| *** zul has joined #openstack-infra | 19:04 | |
| *** yyz_ has quit IRC | 19:04 | |
| *** diablo_rojo has quit IRC | 19:07 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add auth_url to vexxhost secret https://review.openstack.org/587194 | 19:23 |
| *** ykarel|away has quit IRC | 19:30 | |
| *** myoung|lunch is now known as myoung | 19:34 | |
| openstackgerrit | Tim Burke proposed openstack-dev/pbr master: Add an option to skip generating RELEASENOTES.rst https://review.openstack.org/587204 | 19:35 |
| *** rkukura has joined #openstack-infra | 19:38 | |
| clarkb | ok back from optometrist and lunch | 19:40 |
| clarkb | notmyname: https://review.openstack.org/Documentation/user-search.html has all the gerrit search infos | 19:41 |
| openstackgerrit | Tim Burke proposed openstack-dev/pbr master: Ignore Zuul when generating AUTHORS https://review.openstack.org/587208 | 19:44 |
| AJaeger | andreaf, gmann, clarkb, could you review https://review.openstack.org/#/c/587112/ , please? I got some push back on my -1 there by boden and would like you to comment and help to see the big picture for both of us. happy to remove my -1 if you think I'm wrong... | 19:45 |
| clarkb | AJaeger: I left a response hopefully that clears up understanding the purpose of the job | 19:51 |
| corvus | Zuul encountered a syntax error while parsing its configuration in the\nrepo openstack/puppet-tripleo on branch stable/newton. The error was:\n\n Job tripleo-ci-centos-7-scenario005-multinode-oooq not defined | 19:54 |
| corvus | http://zuul.openstack.org/api/config-errors | 19:54 |
| mordred | corvus: fun | 19:55 |
| mordred | corvus: did we perhaps hit a sad related to branching? | 19:56 |
| corvus | mordred: maybe so. i'm trying to find out where that job might have been defined... | 19:57 |
| corvus | pabelanger: ^? | 19:57 |
| corvus | maybe here: https://review.openstack.org/581376 | 19:58 |
| *** hasharAway is now known as hashar | 19:59 | |
| mordred | corvus: yah. that certainly seems like a patch removing it | 20:00 |
| pabelanger | corvus: sorry, I am not sure. weshay might know more | 20:00 |
| corvus | now i'm going to try to see what version of zuul we were running when that landed | 20:00 |
| corvus | (unfortunately, the log line telling us that landed long after) | 20:01 |
| corvus | this change should have reported the error: https://review.openstack.org/579997 but it landed on july 11; the next restart was july 18, so it went into production then. about 16 hours after the tripleo change landed. | 20:06 |
| corvus | so just missed it. | 20:06 |
| corvus | rlandy, weshay, pabelanger: you may be interested in fixing the errors described at http://zuul.openstack.org/api/config-errors sorry zuul didn't report them to you at the time, i think that's since been fixed. | 20:06 |
| corvus | 2018-07-30 20:00:32,144 DEBUG zuul.AnsibleJob: [build: 184ca3ed2e34447b85b77e4ad259b3a5] Ansible output: b'An exception occurred during task execution. To see the full traceback, use -vvv. The error was: keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-e1cdc647-c94f-44a3-84c3-d7adfa083107)' | 20:09 |
| corvus | mordred: ^ that's going to be annoying to debug, isn't it? | 20:10 |
| * weshay looks | 20:11 | |
| mordred | corvus: yeah. | 20:11 |
| mordred | corvus: :( | 20:11 |
| mordred | corvus: oh!I think I already know the fix though | 20:12 |
| corvus | mordred: oh thank goodness | 20:12 |
| mordred | corvus: so - debugging would suck - but this time I think we got lucky | 20:12 |
| mordred | corvus: hrm. nope. I lied | 20:17 |
| weshay | corvus, k.. thanks | 20:17 |
| mordred | corvus: easiest thing is probably going to be holding a node | 20:17 |
| weshay | will start looking into that | 20:17 |
| corvus | mordred: well, this is all on the executor | 20:17 |
| corvus | and the secret is intentionally transient | 20:17 |
| mordred | corvus: oh. right | 20:18 |
| mordred | corvus: this is going to be annoying to debug | 20:18 |
| *** jchhatbar has quit IRC | 20:18 | |
| corvus | let me go back to the current openstacksdk in my local test. perhaps there are more unreleased fixes we're depending on or something. | 20:18 |
| mordred | corvus: ++ - I am also happy to help test/debug that | 20:19 |
| mordred | corvus: the other thing to verify would be if the password picked up a space or a ' or something that we cant' see beause encrypted blob | 20:19 |
| mordred | the other bits look correct to me | 20:20 |
| *** ade_lee has quit IRC | 20:20 | |
| *** ade_lee has joined #openstack-infra | 20:21 | |
| *** rkukura has quit IRC | 20:22 | |
| *** ade_lee has quit IRC | 20:27 | |
| *** kgiusti has left #openstack-infra | 20:31 | |
| *** rkukura has joined #openstack-infra | 20:32 | |
| *** rkukura has quit IRC | 20:37 | |
| *** rpioso is now known as rpioso|afk | 20:38 | |
| *** ade_lee has joined #openstack-infra | 20:38 | |
| *** hashar has quit IRC | 20:39 | |
| pabelanger | clarkb: AJaeger: looks like unbound change seems to have fixed fedora failures: http://logs.openstack.org/28/587128/1/check/windmill-fedora-27/76a59d6/job-output.txt.gz was on rax-iad, which was failing before | 20:40 |
| *** ade_lee has quit IRC | 20:40 | |
| pabelanger | I'll proposed an update to base job shortlyl | 20:41 |
| *** ade_lee has joined #openstack-infra | 20:41 | |
| pabelanger | shortly* | 20:41 |
| corvus | mordred: yeah, i put a newline in the password :( | 20:41 |
| *** akhilaki has joined #openstack-infra | 20:42 | |
| *** camunoz has quit IRC | 20:42 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Fix vexxhost secret https://review.openstack.org/587220 | 20:44 |
| corvus | mordred, clarkb, AJaeger: ^ | 20:44 |
| *** ade_lee has quit IRC | 20:45 | |
| clarkb | +2 | 20:46 |
| mordred | corvus: thank goodness it wasn't something deeper | 20:47 |
| *** kjackal has joined #openstack-infra | 20:47 | |
| corvus | mordred: that's the *next* problem :) | 20:47 |
| *** pguimaraes has quit IRC | 20:47 | |
| mordred | \o/ :) | 20:47 |
| *** lpetrut has joined #openstack-infra | 20:48 | |
| *** lpetrut has quit IRC | 20:52 | |
| *** jamesmcarthur has quit IRC | 20:54 | |
| *** jamesmcarthur has joined #openstack-infra | 20:54 | |
| *** hamzy_ is now known as hamzy | 20:59 | |
| *** jamesmcarthur has quit IRC | 20:59 | |
| *** r-daneel has quit IRC | 21:03 | |
| *** agopi is now known as agopi|brb | 21:07 | |
| openstackgerrit | Merged openstack-infra/project-config master: Fix vexxhost secret https://review.openstack.org/587220 | 21:08 |
| *** jamesmcarthur has joined #openstack-infra | 21:10 | |
| *** r-daneel has joined #openstack-infra | 21:11 | |
| *** agopi|brb has quit IRC | 21:12 | |
| *** masayukig has quit IRC | 21:13 | |
| *** priteau has quit IRC | 21:14 | |
| *** jamesmcarthur has quit IRC | 21:15 | |
| *** masayukig has joined #openstack-infra | 21:15 | |
| *** ldnunes has quit IRC | 21:19 | |
| *** florianf has quit IRC | 21:21 | |
| corvus | mordred, clarkb: https://object-storage-ca-ymq-1.vexxhost.net/swift/v1/86bbbcfa8ad043109d2d7af530225c72/logs_78/587178/1/check/tox-py35/d606ba1/ | 21:26 |
| corvus | it's a start | 21:26 |
| mnaser | ^^^ thats cool | 21:27 |
| mnaser | where is the code that is doing the upload? | 21:27 |
| mnaser | s/code/role/ | 21:27 |
| clarkb | neat, looks like we need to switch ara to uncompressed output | 21:27 |
| corvus | mnaser: http://git.zuul-ci.org/cgit/zuul-jobs/tree/roles/wip-upload-logs-swift | 21:28 |
| corvus | clarkb: yeah, ara and the testr stuff are getting compressed when they shouldn't be. also we're uploading the logs/ directory instead of its contents. | 21:28 |
| mordred | corvus: that's double-compression there yeah? | 21:29 |
| corvus | not sure what's going on there yet | 21:30 |
| corvus | when i download and un-gnzip, it works as expected | 21:30 |
| corvus | looks like we're saying it's text/html with no encoding, instead of either saying it's application/octet-stream or text/html with gzip encoding | 21:32 |
| mordred | yeah - that's what I'm seeing here too | 21:32 |
| clarkb | y because we explicitly gzip it but adding that ti mime table probably a good idea | 21:33 |
| corvus | i see the derp | 21:33 |
| *** rfolco|ruck is now known as rfolco|off | 21:34 | |
| *** felipemonteiro__ has quit IRC | 21:34 | |
| *** felipemonteiro__ has joined #openstack-infra | 21:34 | |
| *** ade_lee has joined #openstack-infra | 21:35 | |
| *** Goneri has quit IRC | 21:36 | |
| corvus | i'm going to fix it, but i've fallen down a rabbit hole looking into the test failure on https://review.openstack.org/587049 | 21:40 |
| corvus | biab. | 21:40 |
| mnaser | btw https://object-storage-ca-ymq-1.vexxhost.net/swift/v1/86bbbcfa8ad043109d2d7af530225c72/logs_78/587178/1/check/tox-py35/d606ba1/ and https://object-storage-ca-ymq-1.vexxhost.net/v1/86bbbcfa8ad043109d2d7af530225c72/logs_78/587178/1/check/tox-py35/d606ba1/ both work if you wanna drop the /swift/ | 21:41 |
| notmyname | mnaser: what are you running in front of swift to do that path translation? | 21:42 |
| mnaser | haproxy | 21:42 |
| mnaser | (brb) | 21:42 |
| notmyname | looks like the icons need to have a relative path (or get caught by some hook in haproxy). right now they are returning 405 | 21:45 |
| corvus | notmyname: icons are my fault | 21:45 |
| *** bnemec has quit IRC | 21:46 | |
| corvus | i'm generating the index file, but haven't uploaded the icons yet | 21:46 |
| *** bobh has quit IRC | 21:47 | |
| clarkb | corvus: that reminds me are we setting the expiry header? I meant to look for that in the previous changes then never double checked | 21:47 |
| corvus | clarkb: yeah, default is 6mo | 21:50 |
| pabelanger | I was just about to ask how expires worked :) | 21:50 |
| mordred | pabelanger: magically :) | 21:50 |
| corvus | http://git.zuul-ci.org/cgit/zuul-jobs/tree/roles/wip-upload-logs-swift/library/zuul_swift_upload.py#n398 | 21:50 |
| mordred | pabelanger: my understanding is that all of the swifts in the world send an excel spreadsheet to notmyname and he takes care of expring objects when it's time | 21:51 |
| pabelanger | ha | 21:51 |
| notmyname | BY THE POWER OF `python -c 'import csv'` I COMMAND YOU! | 21:51 |
| clarkb | it runs a background task/process/thread that scans for upcoming deletes | 21:51 |
| mordred | notmyname: ++ | 21:51 |
| clarkb | its basically what we do with the fs based logs, just swift bakes it in as a feature | 21:51 |
| clarkb | which is handy as a user | 21:52 |
| corvus | well, this is an improvement on our current system where fungi deletes files | 21:52 |
| *** felipemonteiro has joined #openstack-infra | 21:52 | |
| mordred | notmyname: (I just imagined a giant wall in your house with an absurd number of toilet-flush handles - and that expiring a swift object involved you physically 'flushing' the correct handle ... it's possible it's getting to be the right timefor me to EOD) | 21:52 |
| *** boden has quit IRC | 21:52 | |
| notmyname | oh my | 21:53 |
| *** felipemonteiro__ has quit IRC | 21:53 | |
| mordred | although now I want an animation of that | 21:53 |
| clarkb | mordred: "how the cloud really works" | 21:53 |
| mordred | clarkb: openstack is people? | 21:53 |
| *** felipemonteiro has quit IRC | 21:53 | |
| *** felipemonteiro has joined #openstack-infra | 21:54 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Also compress json files https://review.openstack.org/587049 | 21:55 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Swift logs: send the content-encoding header if we know it https://review.openstack.org/587237 | 21:55 |
| *** yamamoto has joined #openstack-infra | 21:55 | |
| clarkb | Make room! make room! | 21:57 |
| *** myoung has quit IRC | 21:59 | |
| pabelanger | clarkb: can you re-explain: https://review.openstack.org/586851/ comment? | 22:02 |
| *** rcernin has joined #openstack-infra | 22:02 | |
| pabelanger | do you man, single play with only configure-unbound role? | 22:02 |
| *** jesusaur has joined #openstack-infra | 22:03 | |
| clarkb | pabelanger: roles:\n - configure-unbound as the only thing in the block. Is a block a play? | 22:04 |
| clarkb | that way if we add new roles it is clera that you shouldn't add to that list | 22:05 |
| clarkb | I just worry we will update things later and break it again | 22:05 |
| pabelanger | clarkb: https://etherpad.openstack.org/p/cyYO4CB4ff | 22:06 |
| clarkb | ya that | 22:06 |
| pabelanger | kk | 22:06 |
| clarkb | it is a very subtle bug I think and so organizing it in a clear way is a good idea | 22:07 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Move configure-unbound into its own play https://review.openstack.org/587238 | 22:10 |
| pabelanger | clarkb: ^ | 22:11 |
| pabelanger | that does seem to fix my fedora failures | 22:11 |
| pabelanger | so, will test again, before proposing change to base | 22:11 |
| clarkb | pabelanger: I went ahead and approved it since its a change to base-test | 22:12 |
| pabelanger | thanks | 22:12 |
| *** priteau has joined #openstack-infra | 22:14 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Swift logs: don't normalize directories https://review.openstack.org/587240 | 22:16 |
| clarkb | I'll pll those fixes up shortly | 22:17 |
| corvus | there's the source of the extra "logs/" directory | 22:17 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Swift logs: don't run the regular log upload script https://review.openstack.org/587241 | 22:17 |
| *** threestrands has joined #openstack-infra | 22:18 | |
| *** threestrands has quit IRC | 22:18 | |
| *** threestrands has joined #openstack-infra | 22:18 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Swift logs: don't run the regular log upload script https://review.openstack.org/587241 | 22:18 |
| corvus | mnaser: it returns the url that openstacksdk returns as the "endpoint" for swift | 22:18 |
| mnaser | o | 22:19 |
| mnaser | good to know | 22:19 |
| corvus | mnaser: http://git.zuul-ci.org/cgit/zuul-jobs/tree/roles/wip-upload-logs-swift/library/zuul_swift_upload.py#n355 | 22:19 |
| mnaser | lol | 22:19 |
| * mnaser notes | 22:19 | |
| * corvus has dreams of automatically using multiple swifts in the future | 22:20 | |
| clarkb | corvus: fwiw I'm approving the changes | 22:21 |
| clarkb | did you want to wait for more testing first? | 22:21 |
| corvus | clarkb: nope, +w is good | 22:21 |
| clarkb | this isn't in production yet so worst case we fix in a followup | 22:21 |
| corvus | the role is called "wip-swift-upload-logs" for a reason :) | 22:22 |
| clarkb | corvus: left a thought on https://review.openstack.org/#/c/587240/1 I don't think it is critical but something to consider | 22:23 |
| clarkb | tl;dr as before, symlinks how do they work | 22:24 |
| corvus | clarkb: agreed. if so, we should do it inside the FileList class, then it'll get unit tested. that bit of removal was left over from the main loop of the original script, and is outside of what's covered by tests. | 22:25 |
| *** wolverineav has quit IRC | 22:25 | |
| corvus | (i was really puzzled how we got the wrong behavior since there are unit tests covering both cases) | 22:25 |
| *** wolverineav has joined #openstack-infra | 22:26 | |
| openstackgerrit | Merged openstack-infra/project-config master: Move configure-unbound into its own play https://review.openstack.org/587238 | 22:30 |
| clarkb | snmp to ze10 doesn't look happy. Going to see if restarting the daemon helps (I checked firewall rules and they look good | 22:31 |
| clarkb | It also looks like we've leaked dirs on the ze hosts other than ze11 (based on grafana hdd usage graph). Going to look at cleaning those up | 22:32 |
| clarkb | hrm or maybe its just git repos being older? | 22:32 |
| *** wolverineav has quit IRC | 22:33 | |
| corvus | clarkb: we should delete leaked build dirs on startup now (including our most recent restart) | 22:33 |
| clarkb | corvus: checking /var/lib/zuul/builds says everything is current so the higher hdd usage must be elsewhere | 22:34 |
| clarkb | corvus: which lines up with autocleaning that on restart | 22:34 |
| corvus | i think we may still be storting zuul refs | 22:34 |
| clarkb | ah | 22:34 |
| corvus | so if the git dirs look bigger, that may be why | 22:35 |
| *** rkukura has joined #openstack-infra | 22:35 | |
| clarkb | I am asking du for a breakdown which should confirm ^ as soon as the fs stating is done | 22:36 |
| mordred | clarkb: "symlinks how do they work" a) now insane cloud posse is in my head, thanks - b) the zuul-build-dashboard-multi-tenant job is a great pathological test case | 22:36 |
| *** gongysh has joined #openstack-infra | 22:36 | |
| * mordred leaves https://www.youtube.com/watch?v=8GyVx28R9-s here and quietly walks away from it | 22:38 | |
| *** e0ne has quit IRC | 22:39 | |
| *** felipemonteiro has quit IRC | 22:40 | |
| *** jcoufal has quit IRC | 22:40 | |
| *** linkmark has joined #openstack-infra | 22:40 | |
| clarkb | corvus: ya the difference is in executor-git. 3.9G on ze11 and 8.7G on ze10 | 22:41 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Also compress json files https://review.openstack.org/587049 | 22:44 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Swift logs: send the content-encoding header if we know it https://review.openstack.org/587237 | 22:44 |
| clarkb | pabelanger: I'm noticing the packethost mirror is not running again so I don't think this is load induced as it should have no load | 22:48 |
| clarkb | pabelanger: I'm going to restart it via openstack api and see if I can find anymore clues on why it is happening | 22:49 |
| *** hongbin has quit IRC | 22:52 | |
| pabelanger | clarkb: ack, I haven't heard anything back from emails sent last week | 22:54 |
| clarkb | fwiw 01 is still running, and diggingaround syslog and kernel log on 02 after a reboot doesn't show anything other than logs stopped a few days ago | 22:56 |
| clarkb | before that it had fairly consistent udp requests (for snmpd) logged | 22:56 |
| *** gongysh has quit IRC | 22:56 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Swift logs: don't normalize directories https://review.openstack.org/587240 | 22:59 |
| clarkb | those were the two big followups I had from last week I think. I guess we wait to see if john finds anything about the instance shutdowns | 22:59 |
| clarkb | executors look really happy with the new kernel though | 22:59 |
| clarkb | tomorrow I'll try to pick up the puppet 4 work again | 23:00 |
| corvus | clarkb: can you +A https://review.openstack.org/587241 ? | 23:01 |
| pabelanger | Yah, I like how executors have been looking today | 23:01 |
| corvus | pabelanger: ++ thanks | 23:02 |
| clarkb | other infra-roots fyi shrews proposed a cleanup to irc accessbot ops https://review.openstack.org/#/c/585804/1 general consensus on that would be much appreciated | 23:02 |
| clarkb | corvus: yup looking now | 23:02 |
| corvus | clarkb: know if someone has pinged those folks in irc? | 23:03 |
| corvus | (that seems like the best way to handle this one :) | 23:03 |
| clarkb | corvus: pleia2 was but only because pleia2 lurks here :) | 23:04 |
| *** mschuppert has quit IRC | 23:04 | |
| clarkb | I can reach out to the others | 23:04 |
| clarkb | lifeless: SergeyLukjanov yolanda fyi https://review.openstack.org/#/c/585804/1/accessbot/channels.yaml proposes a cleanup to openstack irc ops list. If you would like to remain on the list feel free to let me know or leave a comment on that change | 23:05 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Promote bast-test change for configure-unbound https://review.openstack.org/587246 | 23:05 |
| pabelanger | infra-root: ^ seems to fix validate-host failures I've seen on fedora. I've rechecked all day on base-test change, without a failure now | 23:06 |
| clarkb | pabelanger: thanks I'm willing to try it at alrger scale | 23:07 |
| *** tpsilva has quit IRC | 23:07 | |
| corvus | pabelanger, clarkb: i left a comment on 587246 | 23:09 |
| corvus | as someone who hasn't been following that problem in detail, the comment doesn't explain the solution to me. | 23:09 |
| clarkb | corvus: handlers run after all roles are done I guess (this was how I understood it) so unbound is left half configured after that role runs until the end of the old block | 23:10 |
| clarkb | we can add more detail to the comment though | 23:10 |
| clarkb | pabelanger: ^ | 23:10 |
| openstackgerrit | Merged openstack-infra/project-config master: Swift logs: don't run the regular log upload script https://review.openstack.org/587241 | 23:10 |
| corvus | clarkb, pabelanger: great, those 2 pieces of information (configure-unbound has a handler to restart, and handlers run at the end) really help :) | 23:12 |
| pabelanger | clarkb: corvus: I can update, but yes what clarkb said. ‘notify’ actions are triggered at the end of each block of tasks in a play | 23:12 |
| corvus | would be great to have that in the comment | 23:12 |
| pabelanger | ++ | 23:12 |
| *** michaelxin has quit IRC | 23:13 | |
| corvus | clarkb, pabelanger: why is restarting implemented as a handler? | 23:13 |
| clarkb | corvus: I think it is the ansibly way to do it? have file resource notify a handler? we don't have to do it htat way and could just make it a step | 23:13 |
| corvus | oh i think i see | 23:13 |
| pabelanger | Yah, a way to reuse logic in a play | 23:14 |
| pabelanger | notify the handler | 23:14 |
| corvus | because there are multiple tasks which *may* run and therefore restarting *may* need to happen. using the handler causes it to happen at most once at the end. | 23:14 |
| corvus | pabelanger: makes sense | 23:14 |
| corvus | (there are two config file writing tasks which notify the restart handler) | 23:14 |
| corvus | so, if we wanted to make this more self-contained, we could probably just do some kind of register variable or something and conditionally run a restart task at the end | 23:15 |
| *** r-daneel has quit IRC | 23:16 | |
| pabelanger | meta: flush_handlers is also something we could have tried too, but I haven't used that much, and was added in 2.2 (I think) | 23:16 |
| pabelanger | to force handlers to trigger | 23:16 |
| clarkb | that seems more magical | 23:19 |
| *** bobh has joined #openstack-infra | 23:21 | |
| *** bobh has quit IRC | 23:21 | |
| *** sshnaidm is now known as sshnaidm|afk | 23:23 | |
| corvus | well, if that's in the role, that at least keeps the magic contained | 23:25 |
| corvus | right now, role implementation details are leaking out | 23:25 |
| corvus | https://object-storage-ca-ymq-1.vexxhost.net/swift/v1/86bbbcfa8ad043109d2d7af530225c72/logs_78/587178/1/check/tox-py35/e88b9ea/ looks better | 23:26 |
| clarkb | ara still not working quite right, I think that is beacuse it is asking for non .gz files but they are .gz files? | 23:27 |
| openstackgerrit | Merged openstack-infra/project-config master: Skip releases jobs on doc updates https://review.openstack.org/584515 | 23:27 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove heat-templates python jobs https://review.openstack.org/584774 | 23:27 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Swift logs: don't compress ara html https://review.openstack.org/587251 | 23:28 |
| corvus | clarkb: yeah, we don't really want to have .gz files. i feel like that's a log system implementation detail and really belongs in the upload-logs roles. | 23:29 |
| corvus | clarkb: ^ that should fix ara | 23:29 |
| clarkb | yup +2'd | 23:29 |
| clarkb | corvus: the other thing people will want is clickable timestamps in job-output.txt | 23:30 |
| corvus | on the list for tomorrow: icons and symlinks. | 23:30 |
| clarkb | but as far as serving content goes this is looking pretty close | 23:30 |
| corvus | clarkb: ah, thanks for the reminder. i haven't plumbed the osla filter in yet. | 23:30 |
| openstackgerrit | James E. Blair proposed openstack-infra/os-loganalyze master: Fix HTMLify CLI https://review.openstack.org/587253 | 23:32 |
| corvus | clarkb: will need that change | 23:32 |
| corvus | btw, the logs_78 container was auto-created by the upload script. | 23:33 |
| clarkb | neat | 23:33 |
| clarkb | https://review.openstack.org/#/c/547248/2 is a straightfoward nodepool.o.o cleanup (removes all the nodepool stuff and keeps only the zk puppet) | 23:34 |
| corvus | clarkb: +2 but no +W due to eod | 23:34 |
| clarkb | thanks I think that may be a morning merge for me too unless ianw wants to self approve | 23:35 |
| *** akhilaki has quit IRC | 23:36 | |
| *** michaelxin has joined #openstack-infra | 23:38 | |
| ianw | are the zkNN servers actually in rotation? it wasn't clear to me where that's up to | 23:38 |
| corvus | ianw: i don't think so, i think we're still only on nodepool.o.o. pabelanger may be able to confirm. | 23:39 |
| ianw | also that change is stacked ontop of https://review.openstack.org/#/c/586236/ which removes the builder logging | 23:39 |
| ianw | reviewing that was what reminded me i had that cleanup sitting around :) | 23:40 |
| clarkb | corvus: ianw correct we are yet to migrate to the multinode set and intsead use nodepool.o.o as single node zk server | 23:40 |
| clarkb | corvus: minor improvement suggested on https://review.openstack.org/#/c/587253/1 mostly for consistency with the existing Line() class | 23:41 |
| clarkb | but I +2'd because current ps will fix problem too | 23:42 |
| clarkb | ianw: thanks for the reviews on the future parser changes, I'm going to try and get a bunch of those through tomorrow and watch and make sure puppet remians happy | 23:46 |
| * fungi is not around yet, but notes the zkNN servers still don't seem to know their proper fqdns and so bounce cronspam due to malformed helo every day | 23:48 | |
| clarkb | fungi: when do you rejoin us? | 23:48 |
| ianw | clarkb: ok, i still have a few puppet things in flight, a couple of added rspec tests for ether* for example, but my list is getting shorter :) | 23:50 |
| fungi | clarkb: wednesday the 1st | 23:50 |
| fungi | catching up from a hotel on the road home just now | 23:50 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!