| *** wolverineav has joined #openstack-infra | 00:00 | |
| *** hongbin has quit IRC | 00:04 | |
| *** wolverineav has quit IRC | 00:05 | |
| *** VW has joined #openstack-infra | 00:06 | |
| *** patriciadomin has quit IRC | 00:06 | |
| *** dingyichen has joined #openstack-infra | 00:08 | |
| *** patriciadomin has joined #openstack-infra | 00:09 | |
| *** VW has quit IRC | 00:15 | |
| *** abelur_ has joined #openstack-infra | 00:28 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add native distro test jobs https://review.openstack.org/543268 | 00:34 |
|---|---|---|
| ianw | pabelanger: ^ that answers a question i've had for a while ... which is why does the suse test always work. answer: it's not actually doing anything :) | 00:35 |
| *** mdrabe has quit IRC | 00:35 | |
| *** mdrabe has joined #openstack-infra | 00:38 | |
| *** wolverineav has joined #openstack-infra | 00:39 | |
| *** zhurong has joined #openstack-infra | 00:39 | |
| *** tosky has quit IRC | 00:39 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Switch to native nodepool jobs https://review.openstack.org/543270 | 00:41 |
| *** slaweq has joined #openstack-infra | 00:42 | |
| *** wolverineav has quit IRC | 00:43 | |
| *** VW has joined #openstack-infra | 00:44 | |
| *** mdrabe has quit IRC | 00:45 | |
| *** slaweq has quit IRC | 00:47 | |
| *** mdrabe has joined #openstack-infra | 00:48 | |
| *** VW has quit IRC | 00:48 | |
| *** patriciadomin has quit IRC | 00:51 | |
| *** patriciadomin has joined #openstack-infra | 00:52 | |
| *** salv-orlando has joined #openstack-infra | 00:57 | |
| *** namnh has joined #openstack-infra | 01:00 | |
| *** ekhugen has quit IRC | 01:00 | |
| *** ekhugen has joined #openstack-infra | 01:01 | |
| *** ari[m] has joined #openstack-infra | 01:02 | |
| *** mdbooth has joined #openstack-infra | 01:02 | |
| *** salv-orlando has quit IRC | 01:03 | |
| *** patriciadomin has quit IRC | 01:03 | |
| *** patriciadomin has joined #openstack-infra | 01:04 | |
| *** gcb has joined #openstack-infra | 01:05 | |
| *** ekhugen has quit IRC | 01:06 | |
| *** ekhugen has joined #openstack-infra | 01:06 | |
| *** mdrabe has quit IRC | 01:07 | |
| *** patriciadomin has quit IRC | 01:09 | |
| *** Qiming has quit IRC | 01:09 | |
| *** patriciadomin has joined #openstack-infra | 01:09 | |
| *** mdrabe has joined #openstack-infra | 01:10 | |
| ianw | AJaeger / EmilienM: https://review.openstack.org/543271 deals with the scripts moving and dib base job ... not 100% sure if correct? | 01:12 |
| *** Qiming has joined #openstack-infra | 01:13 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing tripleo job https://review.openstack.org/543272 | 01:14 |
| *** patriciadomin has quit IRC | 01:17 | |
| *** cuongnv has joined #openstack-infra | 01:17 | |
| *** patriciadomin has joined #openstack-infra | 01:18 | |
| *** gcb has quit IRC | 01:18 | |
| *** wolverineav has joined #openstack-infra | 01:18 | |
| *** VW has joined #openstack-infra | 01:21 | |
| *** mdrabe has quit IRC | 01:22 | |
| *** wolverineav has quit IRC | 01:23 | |
| *** mdrabe has joined #openstack-infra | 01:26 | |
| *** VW has quit IRC | 01:26 | |
| *** wolverineav has joined #openstack-infra | 01:33 | |
| *** wolverineav has quit IRC | 01:37 | |
| *** wolverineav has joined #openstack-infra | 01:53 | |
| *** patriciadomin has quit IRC | 01:56 | |
| *** patriciadomin has joined #openstack-infra | 01:56 | |
| *** zhurong has quit IRC | 01:57 | |
| *** wolverineav has quit IRC | 01:58 | |
| *** d0ugal_ has quit IRC | 02:03 | |
| *** mdrabe_ has joined #openstack-infra | 02:03 | |
| *** mdrabe has quit IRC | 02:05 | |
| *** ekhugen has quit IRC | 02:08 | |
| *** ekhugen has joined #openstack-infra | 02:09 | |
| *** d0ugal_ has joined #openstack-infra | 02:13 | |
| *** hongbin has joined #openstack-infra | 02:25 | |
| *** wolverineav has joined #openstack-infra | 02:26 | |
| *** kiennt26 has joined #openstack-infra | 02:30 | |
| *** wolverineav has quit IRC | 02:30 | |
| *** gcb has joined #openstack-infra | 02:30 | |
| *** ekhugen- has joined #openstack-infra | 02:41 | |
| *** ekhugen has quit IRC | 02:41 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add native distro test jobs https://review.openstack.org/543268 | 02:49 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add native distro test jobs https://review.openstack.org/543268 | 02:58 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Fix legacy dsvm jobs https://review.openstack.org/543327 | 02:58 |
| *** wolverineav has joined #openstack-infra | 03:01 | |
| *** d0ugal_ has quit IRC | 03:02 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/glean master: Switch nodepool boot tests to native jobs https://review.openstack.org/543328 | 03:04 |
| *** wolverineav has quit IRC | 03:06 | |
| *** dhill__ has quit IRC | 03:06 | |
| *** edmondsw has joined #openstack-infra | 03:07 | |
| *** gcb has quit IRC | 03:07 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Remove legacy nodepool jobs https://review.openstack.org/543329 | 03:08 |
| openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: Remove legacy nodepool boot jobs https://review.openstack.org/543330 | 03:10 |
| *** patriciadomin has quit IRC | 03:11 | |
| *** edmondsw has quit IRC | 03:11 | |
| *** patriciadomin has joined #openstack-infra | 03:11 | |
| *** d0ugal_ has joined #openstack-infra | 03:12 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add native distro test jobs https://review.openstack.org/543268 | 03:14 |
| *** ijw has quit IRC | 03:15 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/glean master: Switch nodepool boot tests to native jobs https://review.openstack.org/543328 | 03:17 |
| *** VW has joined #openstack-infra | 03:18 | |
| *** gcb has joined #openstack-infra | 03:20 | |
| *** ekhugen- has quit IRC | 03:23 | |
| *** patriciadomin has quit IRC | 03:24 | |
| *** mdrabe_ has quit IRC | 03:24 | |
| *** mdrabe has joined #openstack-infra | 03:25 | |
| ianw | #status log received rax notification that host of nl02.o.o and zm06.o.o has some sort of issue; currently can't log into either. updates from rax pending | 03:25 |
| openstackstatus | ianw: finished logging | 03:25 |
| *** patriciadomin has joined #openstack-infra | 03:25 | |
| ianw | Please do not access or modify 'nl02.openstack.org' during this process. | 03:26 |
| ianw | well ... yeah good luck with that :) | 03:26 |
| *** ekhugen_alt has joined #openstack-infra | 03:29 | |
| *** mdrabe has quit IRC | 03:32 | |
| *** olaph has joined #openstack-infra | 03:33 | |
| *** mdrabe has joined #openstack-infra | 03:34 | |
| *** olaph1 has quit IRC | 03:35 | |
| *** mdrabe has quit IRC | 03:43 | |
| *** links has joined #openstack-infra | 03:44 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Fix legacy dsvm jobs https://review.openstack.org/543327 | 03:47 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add native distro test jobs https://review.openstack.org/543268 | 03:47 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing tripleo job https://review.openstack.org/543272 | 03:48 |
| *** patriciadomin has quit IRC | 03:48 | |
| *** patriciadomin has joined #openstack-infra | 03:50 | |
| *** mdrabe has joined #openstack-infra | 03:51 | |
| *** yamamoto has joined #openstack-infra | 03:54 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql master: Add --dpi flag to subunit2sql-graph https://review.openstack.org/543335 | 03:56 |
| *** ramishra has joined #openstack-infra | 03:57 | |
| *** ekhugen_alt has quit IRC | 04:02 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql master: Add --dpi flag to subunit2sql-graph https://review.openstack.org/543335 | 04:03 |
| *** VW has quit IRC | 04:03 | |
| *** ekhugen_alt has joined #openstack-infra | 04:03 | |
| *** VW has joined #openstack-infra | 04:03 | |
| *** mdrabe has quit IRC | 04:05 | |
| *** patriciadomin has quit IRC | 04:05 | |
| *** patriciadomin has joined #openstack-infra | 04:05 | |
| *** d0ugal_ has quit IRC | 04:06 | |
| *** mdrabe has joined #openstack-infra | 04:07 | |
| *** dave-mccowan has quit IRC | 04:10 | |
| *** dave-mccowan has joined #openstack-infra | 04:11 | |
| *** wolverineav has joined #openstack-infra | 04:11 | |
| *** d0ugal_ has joined #openstack-infra | 04:14 | |
| *** ijw has joined #openstack-infra | 04:15 | |
| *** wolverineav has quit IRC | 04:16 | |
| *** dave-mccowan has quit IRC | 04:18 | |
| *** cshastri has joined #openstack-infra | 04:20 | |
| *** psachin has joined #openstack-infra | 04:22 | |
| *** ykarel|away has joined #openstack-infra | 04:25 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Fix legacy dsvm jobs https://review.openstack.org/543327 | 04:27 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add native distro test jobs https://review.openstack.org/543268 | 04:27 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing tripleo job https://review.openstack.org/543272 | 04:29 |
| *** psachin has quit IRC | 04:30 | |
| *** psachin has joined #openstack-infra | 04:32 | |
| *** mdrabe has quit IRC | 04:32 | |
| *** nicolasbock has quit IRC | 04:33 | |
| *** mdrabe has joined #openstack-infra | 04:34 | |
| *** xinliang has joined #openstack-infra | 04:36 | |
| ianw | #status log per previous message, seems host was rebooted. nl02.o.o looks ok; manually restarted zuul-merger on zm06. no more issues expected | 04:41 |
| openstackstatus | ianw: finished logging | 04:41 |
| *** janki has joined #openstack-infra | 04:41 | |
| *** patriciadomin has quit IRC | 04:42 | |
| *** patriciadomin has joined #openstack-infra | 04:43 | |
| *** ykarel|away is now known as ykarel | 04:44 | |
| *** mdrabe has quit IRC | 04:44 | |
| *** slaweq has joined #openstack-infra | 04:45 | |
| *** wolverineav has joined #openstack-infra | 04:48 | |
| *** slaweq has quit IRC | 04:49 | |
| *** mdrabe has joined #openstack-infra | 04:50 | |
| *** wolverineav has quit IRC | 04:53 | |
| *** hongbin has quit IRC | 04:56 | |
| AJaeger | ianw: 543271 LGTM, thanks | 05:14 |
| *** mdrabe_ has joined #openstack-infra | 05:17 | |
| *** mdrabe has quit IRC | 05:17 | |
| *** ekhugen_alt has quit IRC | 05:18 | |
| *** ekhugen- has joined #openstack-infra | 05:18 | |
| *** patriciadomin has quit IRC | 05:19 | |
| *** patriciadomin has joined #openstack-infra | 05:20 | |
| *** wolverineav has joined #openstack-infra | 05:20 | |
| *** mdrabe_ has quit IRC | 05:22 | |
| *** mdrabe has joined #openstack-infra | 05:22 | |
| *** wolverineav has quit IRC | 05:25 | |
| *** ekhugen- has quit IRC | 05:25 | |
| *** ekhugen_alt has joined #openstack-infra | 05:26 | |
| *** dsariel has joined #openstack-infra | 05:29 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add native distro test jobs https://review.openstack.org/543268 | 05:39 |
| *** patriciadomin has quit IRC | 05:46 | |
| *** patriciadomin has joined #openstack-infra | 05:47 | |
| *** armaan has quit IRC | 05:50 | |
| *** armaan has joined #openstack-infra | 05:50 | |
| *** wolverineav has joined #openstack-infra | 05:57 | |
| *** mdrabe has quit IRC | 05:58 | |
| *** patriciadomin has quit IRC | 05:59 | |
| *** mdrabe has joined #openstack-infra | 06:00 | |
| *** patriciadomin has joined #openstack-infra | 06:00 | |
| *** pgadiya has joined #openstack-infra | 06:01 | |
| *** wolverineav has quit IRC | 06:01 | |
| *** salv-orlando has joined #openstack-infra | 06:03 | |
| *** yamamoto has quit IRC | 06:05 | |
| *** links has quit IRC | 06:07 | |
| *** yamamoto has joined #openstack-infra | 06:15 | |
| *** wolverineav has joined #openstack-infra | 06:34 | |
| *** wolverineav has quit IRC | 06:38 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add native distro test jobs https://review.openstack.org/543268 | 06:41 |
| *** gcb has quit IRC | 06:41 | |
| *** dhajare has joined #openstack-infra | 06:41 | |
| *** kjackal has joined #openstack-infra | 06:43 | |
| *** dhajare has quit IRC | 06:45 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Emit a warning when using unsafe public key url https://review.openstack.org/543206 | 06:47 |
| *** pcichy has joined #openstack-infra | 06:48 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add native distro test jobs https://review.openstack.org/543268 | 06:48 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Revert fixes for legacy boot jobs https://review.openstack.org/543350 | 06:48 |
| *** links has joined #openstack-infra | 06:51 | |
| AJaeger | ianw, could you review the stacks starting at https://review.openstack.org/#/c/541868/ and https://review.openstack.org/#/c/543139/ , please? Not asking for review of all of them - I'm more looking whether the approach is sane and whether naming/locations are ok. | 06:53 |
| *** cuongnv has quit IRC | 06:55 | |
| *** cuongnv has joined #openstack-infra | 06:56 | |
| *** gcb has joined #openstack-infra | 06:56 | |
| *** janki has quit IRC | 06:57 | |
| *** janki has joined #openstack-infra | 06:57 | |
| *** gcb has quit IRC | 07:02 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Remove unused method checkoutLocalBranch https://review.openstack.org/543359 | 07:09 |
| *** ijw_ has joined #openstack-infra | 07:17 | |
| *** yamamoto has quit IRC | 07:20 | |
| *** ijw has quit IRC | 07:21 | |
| *** eumel8 has joined #openstack-infra | 07:24 | |
| *** maciejjozefczyk has quit IRC | 07:28 | |
| *** VW has quit IRC | 07:29 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add native distro test jobs https://review.openstack.org/543268 | 07:33 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Revert fixes for legacy boot jobs https://review.openstack.org/543350 | 07:33 |
| *** ijw_ has quit IRC | 07:35 | |
| openstackgerrit | Alexander Chadin proposed openstack-infra/irc-meetings master: Move watcher meeting to 8:00 UTC https://review.openstack.org/543363 | 07:37 |
| *** wolverineav has joined #openstack-infra | 07:40 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Don't decode str in LogStreamingHandler https://review.openstack.org/543365 | 07:42 |
| *** jtomasek has joined #openstack-infra | 07:43 | |
| *** kopecmartin has joined #openstack-infra | 07:44 | |
| *** hashar has joined #openstack-infra | 07:44 | |
| *** slaweq has joined #openstack-infra | 07:45 | |
| *** wolverineav has quit IRC | 07:45 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix broken fail_json in zuul_console https://review.openstack.org/543370 | 08:04 |
| *** slaweq_ has joined #openstack-infra | 08:06 | |
| *** pcaruana has joined #openstack-infra | 08:07 | |
| *** slaweq_ has quit IRC | 08:11 | |
| *** wolverineav has joined #openstack-infra | 08:16 | |
| *** ralonsoh has joined #openstack-infra | 08:17 | |
| *** tesseract has joined #openstack-infra | 08:18 | |
| *** florianf has joined #openstack-infra | 08:19 | |
| *** wolverineav has quit IRC | 08:20 | |
| *** yamamoto has joined #openstack-infra | 08:21 | |
| *** efoley has joined #openstack-infra | 08:26 | |
| *** salv-orlando has quit IRC | 08:27 | |
| *** efoley has quit IRC | 08:29 | |
| *** yamamoto has quit IRC | 08:29 | |
| *** efoley has joined #openstack-infra | 08:29 | |
| openstackgerrit | Lenny Verkhovsky proposed openstack/diskimage-builder master: Checking link status according to DIB_DHCP_TIMEOUT https://review.openstack.org/529976 | 08:30 |
| *** HeOS has joined #openstack-infra | 08:33 | |
| *** dtantsur|afk is now known as dtantsur | 08:33 | |
| *** ijw has joined #openstack-infra | 08:36 | |
| *** amoralej|off is now known as amoralej | 08:38 | |
| *** rcernin has quit IRC | 08:39 | |
| *** yamahata has quit IRC | 08:39 | |
| *** bauwser is now known as bauzas | 08:43 | |
| *** jpena|off is now known as jpena | 08:45 | |
| Jeffrey4l | is there some issue in infra mirror repo for ubuntu? i saw this | 08:48 |
| Jeffrey4l | http://logs.openstack.org/81/542481/3/check/kolla-build-ubuntu-source/5e790fc/logs/build/nova-libvirt.txt.gz | 08:48 |
| Jeffrey4l | libvirt-daemon-system : Depends: policykit-1 but it is not going to be installed | 08:48 |
| *** kiennt26 has quit IRC | 08:49 | |
| *** dsariel_ has joined #openstack-infra | 08:51 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add native distro test jobs https://review.openstack.org/543268 | 08:53 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Revert fixes for legacy boot jobs https://review.openstack.org/543350 | 08:53 |
| *** danpawlik has joined #openstack-infra | 08:54 | |
| *** jpich has joined #openstack-infra | 08:54 | |
| *** snapiri has quit IRC | 08:56 | |
| *** lpetrut has joined #openstack-infra | 08:58 | |
| *** claudiub has joined #openstack-infra | 09:02 | |
| *** rossella_s has joined #openstack-infra | 09:02 | |
| *** d0ugal_ has quit IRC | 09:03 | |
| *** d0ugal has joined #openstack-infra | 09:03 | |
| *** d0ugal has quit IRC | 09:03 | |
| *** d0ugal has joined #openstack-infra | 09:03 | |
| *** efoley has quit IRC | 09:07 | |
| *** olaph1 has joined #openstack-infra | 09:14 | |
| *** ykarel is now known as ykarel|lunch | 09:15 | |
| *** alexchadin has joined #openstack-infra | 09:16 | |
| *** olaph has quit IRC | 09:16 | |
| *** tpsilva has joined #openstack-infra | 09:20 | |
| *** salv-orlando has joined #openstack-infra | 09:28 | |
| *** petems has quit IRC | 09:28 | |
| *** petems has joined #openstack-infra | 09:29 | |
| *** dsariel_ has quit IRC | 09:31 | |
| *** dsariel_ has joined #openstack-infra | 09:32 | |
| *** shardy has joined #openstack-infra | 09:33 | |
| *** dirk has quit IRC | 09:33 | |
| *** salv-orlando has quit IRC | 09:33 | |
| *** dirk has joined #openstack-infra | 09:34 | |
| *** efoley has joined #openstack-infra | 09:34 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Move watcher meeting to 8:00 UTC https://review.openstack.org/543363 | 09:34 |
| *** Ng has quit IRC | 09:37 | |
| *** Ng has joined #openstack-infra | 09:37 | |
| *** yamamoto has joined #openstack-infra | 09:43 | |
| *** shardy has quit IRC | 09:43 | |
| *** shardy has joined #openstack-infra | 09:43 | |
| *** yamamoto has quit IRC | 09:44 | |
| *** ijw has quit IRC | 09:46 | |
| *** panda|off is now known as panda | 09:47 | |
| *** xgerman_ has quit IRC | 09:49 | |
| *** xgerman_ has joined #openstack-infra | 09:50 | |
| *** snapiri has joined #openstack-infra | 09:53 | |
| *** armaan has quit IRC | 09:53 | |
| *** armaan has joined #openstack-infra | 09:54 | |
| *** e0ne has joined #openstack-infra | 09:55 | |
| *** patricku has quit IRC | 09:56 | |
| *** patricku has joined #openstack-infra | 09:57 | |
| *** alexchadin has quit IRC | 10:03 | |
| *** briancurtin has quit IRC | 10:05 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add native distro test jobs https://review.openstack.org/543268 | 10:05 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Revert fixes for legacy boot jobs https://review.openstack.org/543350 | 10:05 |
| *** briancurtin has joined #openstack-infra | 10:05 | |
| *** slaweq_ has joined #openstack-infra | 10:07 | |
| *** armaan has quit IRC | 10:07 | |
| *** armaan has joined #openstack-infra | 10:08 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: zuul autohold: allow operator to specify nodes TTL https://review.openstack.org/543403 | 10:08 |
| *** namnh has quit IRC | 10:08 | |
| *** cuongnv has quit IRC | 10:10 | |
| *** alexchadin has joined #openstack-infra | 10:12 | |
| *** slaweq_ has quit IRC | 10:12 | |
| *** gfidente has joined #openstack-infra | 10:14 | |
| *** gfidente has joined #openstack-infra | 10:14 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool master: Clean held nodes automatically after configurable timeout https://review.openstack.org/536295 | 10:17 |
| *** derekh has joined #openstack-infra | 10:17 | |
| *** ykarel|lunch is now known as ykarel | 10:19 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool master: Add /label-list to the webapp https://review.openstack.org/535563 | 10:19 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool master: Refactor status functions, add web endpoints, allow params https://review.openstack.org/536301 | 10:19 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool master: Add separate modules for management commands https://review.openstack.org/536303 | 10:20 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool master: webapp: add optional admin endpoint https://review.openstack.org/536319 | 10:21 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: zuul autohold: allow operator to specify nodes TTL https://review.openstack.org/543403 | 10:23 |
| *** wxy has quit IRC | 10:26 | |
| *** wxy has joined #openstack-infra | 10:26 | |
| *** salv-orlando has joined #openstack-infra | 10:29 | |
| *** salv-orlando has quit IRC | 10:34 | |
| *** electrofelix has joined #openstack-infra | 10:36 | |
| openstackgerrit | Merged openstack/ptgbot master: Single table for scheduled and additional rooms https://review.openstack.org/542180 | 10:38 |
| openstackgerrit | Merged openstack/ptgbot master: Add page for digital PTG signage https://review.openstack.org/542181 | 10:38 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: zuul autohold: allow operator to specify nodes TTL https://review.openstack.org/543403 | 10:40 |
| *** lucas-afk is now known as lucasagomes | 10:44 | |
| *** salv-orlando has joined #openstack-infra | 10:44 | |
| *** wolverineav has joined #openstack-infra | 10:44 | |
| *** yamamoto has joined #openstack-infra | 10:45 | |
| *** ijw has joined #openstack-infra | 10:46 | |
| *** yamamoto has quit IRC | 10:51 | |
| *** dingyichen has quit IRC | 10:53 | |
| *** yujunz has quit IRC | 10:54 | |
| *** yujunz has joined #openstack-infra | 10:55 | |
| *** mrhillsman has quit IRC | 10:57 | |
| *** mrhillsman has joined #openstack-infra | 10:58 | |
| *** tosky has joined #openstack-infra | 10:58 | |
| wendar | Is the openstack-infra/openstackweb project in storyboard the right place to report a dead link on the page https://www.openstack.org/foundation? | 10:59 |
| *** lathiat has quit IRC | 11:03 | |
| *** rfolco|off is now known as rfolco|rover | 11:03 | |
| *** sambetts|afk is now known as sambetts | 11:06 | |
| *** ralonsoh_ has joined #openstack-infra | 11:06 | |
| AJaeger | wendar: no - use https://bugs.launchpad.net/openstack-org instead | 11:07 |
| wendar | AJaeger: awesome, thanks! | 11:07 |
| *** ralonsoh has quit IRC | 11:10 | |
| *** efoley has quit IRC | 11:10 | |
| *** efoley has joined #openstack-infra | 11:10 | |
| *** jaosorior has joined #openstack-infra | 11:10 | |
| *** bhavik1 has joined #openstack-infra | 11:13 | |
| *** seongsoocho has quit IRC | 11:14 | |
| *** seongsoocho has joined #openstack-infra | 11:15 | |
| openstackgerrit | Darragh Bailey proposed openstack/python-jenkins master: Migration to using requests https://review.openstack.org/205637 | 11:18 |
| *** coreycb has quit IRC | 11:19 | |
| *** coreycb has joined #openstack-infra | 11:20 | |
| *** yamamoto has joined #openstack-infra | 11:20 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool master: Clean held nodes automatically after configurable timeout https://review.openstack.org/536295 | 11:23 |
| *** giblet is now known as gibi | 11:24 | |
| *** pbourke has quit IRC | 11:24 | |
| *** pbourke has joined #openstack-infra | 11:26 | |
| *** pcichy has quit IRC | 11:28 | |
| *** pcichy has joined #openstack-infra | 11:30 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool master: webapp: add optional admin endpoint https://review.openstack.org/536319 | 11:30 |
| *** yamamoto has quit IRC | 11:32 | |
| openstackgerrit | Thierry Carrez proposed openstack/ptgbot master: Increase label size on signage page https://review.openstack.org/543433 | 11:38 |
| *** finucannot is now known as stephenfin | 11:40 | |
| *** alexchadin has quit IRC | 11:45 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/puppet-ptgbot master: Deploy signage schedule view https://review.openstack.org/543436 | 11:47 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/puppet-ptgbot master: PTGbot configuration for Dublin PTG https://review.openstack.org/543437 | 11:47 |
| *** katkapilatova has joined #openstack-infra | 11:49 | |
| *** nicolasbock has joined #openstack-infra | 11:53 | |
| *** bhavik1 has quit IRC | 12:01 | |
| *** yamamoto has joined #openstack-infra | 12:02 | |
| *** dave-mccowan has joined #openstack-infra | 12:08 | |
| *** slaweq_ has joined #openstack-infra | 12:08 | |
| *** sshnaidm is now known as sshnaidm|ruck | 12:09 | |
| *** agopi_out has quit IRC | 12:11 | |
| *** slaweq_ has quit IRC | 12:13 | |
| *** jpena is now known as jpena|lunch | 12:26 | |
| *** adarazs is now known as adarazs_brb | 12:31 | |
| *** pgadiya has quit IRC | 12:32 | |
| *** wxy has quit IRC | 12:36 | |
| *** jlabarre has joined #openstack-infra | 12:40 | |
| *** efoley has quit IRC | 12:42 | |
| *** HeOS has quit IRC | 12:42 | |
| *** efoley has joined #openstack-infra | 12:44 | |
| *** ralonsoh__ has joined #openstack-infra | 12:46 | |
| *** dsariel has quit IRC | 12:48 | |
| *** dsariel_ has quit IRC | 12:49 | |
| *** ralonsoh_ has quit IRC | 12:50 | |
| *** r-daneel has joined #openstack-infra | 12:56 | |
| *** dsariel has joined #openstack-infra | 13:02 | |
| *** dsariel_ has joined #openstack-infra | 13:02 | |
| *** adarazs_brb is now known as adarazs | 13:03 | |
| *** armaan_ has joined #openstack-infra | 13:05 | |
| *** armaan has quit IRC | 13:08 | |
| *** dsariel has quit IRC | 13:08 | |
| *** dsariel_ has quit IRC | 13:08 | |
| *** weshay|ruck is now known as weshay | 13:10 | |
| *** edmondsw has joined #openstack-infra | 13:15 | |
| *** jcoufal has joined #openstack-infra | 13:15 | |
| *** edmondsw has quit IRC | 13:15 | |
| *** edmondsw_ has joined #openstack-infra | 13:16 | |
| *** rosmaita has joined #openstack-infra | 13:18 | |
| *** efoley has quit IRC | 13:18 | |
| *** efoley has joined #openstack-infra | 13:19 | |
| *** dprince has joined #openstack-infra | 13:24 | |
| openstackgerrit | Kevin Tibi proposed openstack/diskimage-builder master: Fix typo doc https://review.openstack.org/543454 | 13:26 |
| *** jpena|lunch is now known as jpena | 13:26 | |
| *** olaph1 is now known as olaph | 13:29 | |
| *** rlandy has joined #openstack-infra | 13:32 | |
| *** edmondsw_ is now known as edmondsw | 13:37 | |
| *** lathiat has joined #openstack-infra | 13:39 | |
| *** olaph1 has joined #openstack-infra | 13:42 | |
| *** olaph has quit IRC | 13:43 | |
| *** gfidente has quit IRC | 13:45 | |
| *** slaweq_ has joined #openstack-infra | 13:46 | |
| *** dsariel_ has joined #openstack-infra | 13:47 | |
| *** eumel8 has quit IRC | 13:48 | |
| *** dsariel has joined #openstack-infra | 13:49 | |
| *** slaweq_ has quit IRC | 13:51 | |
| *** gfidente has joined #openstack-infra | 13:51 | |
| *** gfidente has joined #openstack-infra | 13:51 | |
| *** dtantsur is now known as dtantsur|brb | 13:52 | |
| *** myoung|off is now known as myoung | 13:53 | |
| *** jamesmcarthur has joined #openstack-infra | 13:54 | |
| *** nicolasbock has quit IRC | 13:54 | |
| *** kong has quit IRC | 13:55 | |
| *** lathiat has quit IRC | 14:00 | |
| *** HeOS has joined #openstack-infra | 14:01 | |
| *** ihrachys has joined #openstack-infra | 14:02 | |
| tosky | AJaeger (or anyone else who knows bindep): hi, in a bindep.txt file, is any name between [...] which is not platform: considered a profile name? | 14:02 |
| *** arxcruz is now known as arxcruz|sick | 14:06 | |
| *** trown|outtypewww is now known as trown | 14:07 | |
| *** VW has joined #openstack-infra | 14:07 | |
| *** amoralej is now known as amoralej|lunch | 14:08 | |
| fungi | tosky: yes | 14:10 |
| tosky | thanks | 14:10 |
| *** madhuvishy has quit IRC | 14:11 | |
| *** ralonsoh__ is now known as ralonsoh | 14:11 | |
| *** madhuvishy has joined #openstack-infra | 14:11 | |
| *** neith has quit IRC | 14:12 | |
| *** rajinir has quit IRC | 14:12 | |
| *** rajinir has joined #openstack-infra | 14:12 | |
| *** neith has joined #openstack-infra | 14:12 | |
| *** [HeOS] has joined #openstack-infra | 14:13 | |
| *** HeOS has quit IRC | 14:14 | |
| *** lathiat has joined #openstack-infra | 14:15 | |
| *** ekhugen- has joined #openstack-infra | 14:15 | |
| *** patriciadomin_ has joined #openstack-infra | 14:16 | |
| *** mdrabe_ has joined #openstack-infra | 14:17 | |
| *** ekhugen_alt has quit IRC | 14:17 | |
| *** dhill__ has joined #openstack-infra | 14:18 | |
| fungi | tosky: to be more specific, any name between [] is either a platform profile or a user profile. platform profiles must start with "platform:" but there are no other recognized prefixes (and profile names can contain lower-case ascii letters, arabic digits, and the punctuation characters : - . | 14:18 |
| fungi | according to the grammar rules in depends.py | 14:19 |
| *** patriciadomin has quit IRC | 14:19 | |
| fungi | some recent patches also introduced the ability to group user profiles with () | 14:19 |
| *** mdrabe has quit IRC | 14:20 | |
| fungi | like if you only want a certain package installed when two particular user profiles have been specified | 14:20 |
| *** evgenyl has quit IRC | 14:21 | |
| *** evgenyl has joined #openstack-infra | 14:21 | |
| *** mdrabe_ is now known as mdrabe | 14:23 | |
| *** yamamoto has quit IRC | 14:24 | |
| *** eharney has joined #openstack-infra | 14:24 | |
| jaosorior | how do I register a project to get automatic commits for updating the requirements file? | 14:25 |
| *** psachin has quit IRC | 14:26 | |
| AJaeger | jaosorior: should be covered on http://docs.openstack.org/requirements/ | 14:26 |
| AJaeger | jaosorior: and there's an #openstack-requirements channel | 14:26 |
| AJaeger | jaosorior: basically: Update projects.txt in requirements repo - after adding check-requirements job to your repo. And best to manually update requirements directly, since the update scripts will fail in case of unsupported entries | 14:27 |
| jaosorior | AJaeger: thanks! | 14:28 |
| *** zxiiro has quit IRC | 14:29 | |
| *** zxiiro has joined #openstack-infra | 14:29 | |
| *** slaweq has quit IRC | 14:31 | |
| *** slaweq has joined #openstack-infra | 14:32 | |
| *** pcichy has quit IRC | 14:34 | |
| *** pcichy has joined #openstack-infra | 14:35 | |
| *** slaweq has quit IRC | 14:36 | |
| *** dsariel has quit IRC | 14:36 | |
| *** dsariel_ has quit IRC | 14:36 | |
| *** cshastri has quit IRC | 14:37 | |
| *** yamahata has joined #openstack-infra | 14:38 | |
| *** david-lyle has quit IRC | 14:38 | |
| *** edmondsw has quit IRC | 14:38 | |
| *** janki has quit IRC | 14:39 | |
| *** armaan has joined #openstack-infra | 14:39 | |
| *** lbragstad has joined #openstack-infra | 14:39 | |
| *** armaan_ has quit IRC | 14:42 | |
| *** yamahata has quit IRC | 14:42 | |
| *** yamahata has joined #openstack-infra | 14:43 | |
| *** Goneri has joined #openstack-infra | 14:44 | |
| *** r-daneel has quit IRC | 14:45 | |
| *** lucasagomes is now known as lucas-hungry | 14:48 | |
| *** edmondsw has joined #openstack-infra | 14:52 | |
| *** amoralej|lunch is now known as amoralej | 14:57 | |
| *** yamamoto has joined #openstack-infra | 14:57 | |
| *** simondodsley has quit IRC | 14:58 | |
| *** simondodsley has joined #openstack-infra | 14:58 | |
| *** esberglu has joined #openstack-infra | 14:59 | |
| *** caphrim007 has quit IRC | 15:01 | |
| *** jamesmcarthur has quit IRC | 15:08 | |
| *** jamesmcarthur has joined #openstack-infra | 15:08 | |
| *** jpmaxman has quit IRC | 15:09 | |
| *** jpmaxman has joined #openstack-infra | 15:09 | |
| *** auggy has quit IRC | 15:09 | |
| *** auggy has joined #openstack-infra | 15:10 | |
| *** eumel8 has joined #openstack-infra | 15:11 | |
| *** jamesmcarthur has quit IRC | 15:13 | |
| *** agopi_out has joined #openstack-infra | 15:14 | |
| *** lucas-hungry is now known as lucasagomes | 15:19 | |
| *** dprince has quit IRC | 15:23 | |
| *** olaph has joined #openstack-infra | 15:24 | |
| *** olaph1 has quit IRC | 15:26 | |
| *** camunoz has joined #openstack-infra | 15:26 | |
| eumel8 | Hello infra-team! There is still one translation sync job to merge for release: https://review.openstack.org/#/c/543192/ | 15:28 |
| eumel8 | and to move on with translation check site we need at first the user accounts in place: https://review.openstack.org/#/c/504179/ https://review.openstack.org/#/c/530920/ | 15:29 |
| *** dham1 has quit IRC | 15:30 | |
| *** dham1 has joined #openstack-infra | 15:30 | |
| *** fmccrthy has quit IRC | 15:31 | |
| *** fmccrthy has joined #openstack-infra | 15:32 | |
| *** cloudnull has quit IRC | 15:32 | |
| *** jamesmcarthur has joined #openstack-infra | 15:34 | |
| *** olaph1 has joined #openstack-infra | 15:35 | |
| *** cloudnull has joined #openstack-infra | 15:36 | |
| dmsimard | pabelanger: hey, thanks for looking for the non-voting gate job thing.. kid was sick last week and I wasn't able to get there yet. I left a comment on https://review.openstack.org/#/c/543487/ to explain why I did it that way and why it's not as simple | 15:37 |
| *** olaph has quit IRC | 15:37 | |
| *** felipemonteiro_ has joined #openstack-infra | 15:37 | |
| *** kopecmartin has quit IRC | 15:37 | |
| *** felipemonteiro__ has joined #openstack-infra | 15:38 | |
| dmsimard | pabelanger: basically, the amount of jobs we'd run to patch things around and ensure the gate jobs would not run (temporarily) kind of outweighs the amount of "wasted" gate jobs there would be by having to patch zuul.yaml in project-config, master and feature/1.0 -- not sure if you see what I mean | 15:39 |
| *** jamesmcarthur has quit IRC | 15:39 | |
| dmsimard | gate jobs were meant to be set to non-voting for the equivalent of maybe 4-5 commits | 15:39 |
| *** lpetrut has quit IRC | 15:39 | |
| *** links has quit IRC | 15:39 | |
| dmsimard | I understand what you're saying about running non-voting gate jobs is wasteful but I actually went for what I felt was the least wasteful option | 15:40 |
| *** ijw_ has joined #openstack-infra | 15:42 | |
| *** felipemonteiro_ has quit IRC | 15:42 | |
| *** ykarel is now known as ykarel|away | 15:44 | |
| *** jamesmcarthur has joined #openstack-infra | 15:44 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Only run openstack tox jobs on ara master branch https://review.openstack.org/543503 | 15:46 |
| *** ijw has quit IRC | 15:46 | |
| *** david-lyle has joined #openstack-infra | 15:46 | |
| *** slaweq has joined #openstack-infra | 15:47 | |
| pabelanger | dmsimard: See reply, but ^ should allow for it to merge | 15:48 |
| *** dprince has joined #openstack-infra | 15:48 | |
| pabelanger | opps, if i can get zuul syntax correct | 15:48 |
| dmsimard | pabelanger: yeah but then you need to cherry pick the jobs in 1.0 because I'm interested in the result of the non-voting check jobs | 15:48 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Only run openstack tox jobs on ara master branch https://review.openstack.org/543503 | 15:49 |
| pabelanger | dmsimard: no, you'll still have non-voting jobs on check. Because they already are defined in zuul.yaml on the branch | 15:50 |
| dmsimard | pabelanger: ah, right | 15:50 |
| pabelanger | we just remove them from gate | 15:50 |
| dmsimard | maybe I saw this as being more complicated than it should have been | 15:50 |
| dmsimard | I expected openstack-python35-jobs was required as part of the PTI or something but I guess ara isn't an official OpenStack project (yet?) | 15:51 |
| *** slaweq has quit IRC | 15:51 | |
| *** VW_ has joined #openstack-infra | 15:52 | |
| dmsimard | pabelanger: there's an error in https://review.openstack.org/#/c/543487/ (and I wonder if zuul should be able to detect that) | 15:53 |
| dmsimard | I wonder how Zuul behaves if a patch depends on itself, never tried | 15:53 |
| AJaeger | pabelanger: don't we need noop job in gate for non-master then? | 15:53 |
| *** armaan has quit IRC | 15:54 | |
| pabelanger | dmsimard: opps, typo | 15:54 |
| pabelanger | fixing | 15:54 |
| *** ykarel|away has quit IRC | 15:54 | |
| *** armaan has joined #openstack-infra | 15:54 | |
| pabelanger | AJaeger: don't believe so, the non-master branch (only 1) already has zuul.d files | 15:55 |
| *** VW has quit IRC | 15:56 | |
| AJaeger | pabelanger: ah, ok then | 15:56 |
| *** VW_ has quit IRC | 15:56 | |
| *** VW has joined #openstack-infra | 15:57 | |
| AJaeger | pabelanger: we should add to system-required a zuul linter that gives -1 for non-voting gate jobs ;) | 15:57 |
| dmsimard | AJaeger: doable | 15:58 |
| dmsimard | AJaeger: although, would you enforce it for every project/branch ? | 15:58 |
| *** VW has quit IRC | 15:58 | |
| AJaeger | sure ;) | 15:58 |
| dmsimard | AJaeger: that would be an OpenStack thing, not something shipped as part of Zuul | 15:58 |
| AJaeger | dmsimard: yes | 15:58 |
| dmsimard | +1 | 15:58 |
| *** VW has joined #openstack-infra | 15:59 | |
| * AJaeger is not going to do that in the near time, but if others want... | 15:59 | |
| pabelanger | maybe something to bring up at weekly infra meeting | 15:59 |
| AJaeger | config-core, we're ready to get rid of /usr/local/jenkins on our nodes - please see these two stacks and tell me whether the approache and locations are fine: https://review.openstack.org/#/c/543139/ and https://review.openstack.org/#/c/541868/ | 16:00 |
| *** pcaruana has quit IRC | 16:04 | |
| *** jlabarre has quit IRC | 16:04 | |
| *** adarazs is now known as adarazs_brb | 16:05 | |
| *** slaweq has joined #openstack-infra | 16:06 | |
| *** ykarel|away has joined #openstack-infra | 16:07 | |
| *** Swanson has quit IRC | 16:07 | |
| AJaeger | infra-root, danger zone - zuul currently uses 29.4 GB and started swapping. Currently 280 MB... | 16:07 |
| AJaeger | infra-root, also http://grafana.openstack.org/dashboard/db/nodepool looks odd - see 14:40 in graph "In-use nodes" and afterwards | 16:08 |
| *** dsariel has joined #openstack-infra | 16:09 | |
| *** dsariel_ has joined #openstack-infra | 16:09 | |
| *** jlabarre has joined #openstack-infra | 16:09 | |
| *** adarazs_brb is now known as adarazs | 16:09 | |
| clarkb | AJaeger: I'm not an expert but I think that may be the behavior we get when the zookeeper connection is lost? | 16:09 |
| *** krtaylor has quit IRC | 16:10 | |
| clarkb | pabelanger: ^ I think you've looked into this in the past and might recognize it | 16:10 |
| pabelanger | looking | 16:10 |
| pabelanger | yes, I see the following related to zookeeper: http://paste.openstack.org/show/670169/ | 16:12 |
| pabelanger | then | 16:12 |
| pabelanger | 2018-02-12 14:56:40,427 WARNING kazoo.client: Connection dropped: socket connection broken | 16:12 |
| AJaeger | pabelanger: is that self-healing or do we need to do anything? | 16:13 |
| * AJaeger is worried that Zuul is swapping now | 16:13 | |
| pabelanger | I am also seeing http://paste.openstack.org/show/670170/ looping in the logs | 16:13 |
| pabelanger | AJaeger: no swapping yet, but close | 16:13 |
| pabelanger | corvus: if you have a moment, we might be able to use your assistance for zuul debugging | 16:14 |
| AJaeger | pabelanger: it is - http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=64793&rra_id=0&view_type=tree&graph_start=1518365647&graph_end=1518452047 | 16:14 |
| pabelanger | seeing some zookeeper is not locked issues | 16:14 |
| pabelanger | AJaeger: k | 16:15 |
| AJaeger | pabelanger: now 350 MB swapping, it was 280 earlier, see http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=64794&rra_id=0&view_type=tree&graph_start=1518365647&graph_end=1518452047 (not graph, just legend) | 16:15 |
| *** ykarel|away has quit IRC | 16:16 | |
| pabelanger | I'm going to have to defer to corvus, I think we merged a fix to zookeeper disconnects last week, but unsure if zuul was restarted to pick them up | 16:17 |
| pabelanger | I also think there was also a fix for nodepool too? | 16:17 |
| dmsimard | pabelanger: it's documented in the etherpad we had when this last occured: https://etherpad.openstack.org/p/HRUjBTyabM | 16:19 |
| pabelanger | that also explains the post failures I was trying to debug, the nodes were deleted by zookeeper under running jobs (because zuul lost connection) | 16:19 |
| dmsimard | If I remember correctly, corvus restarted the launchers after https://review.openstack.org/#/c/541375/ landed | 16:19 |
| *** kmARC has quit IRC | 16:19 | |
| *** kmARC has joined #openstack-infra | 16:20 | |
| dmsimard | The other patch doesn't seem documented in the etherpad but corvus does mention that the scheduler couldn't recover from the disconnection -- I'll try and find the patch. | 16:21 |
| dmsimard | Looks like https://review.openstack.org/#/c/541454/ | 16:21 |
| dmsimard | Merged 5 days ago | 16:21 |
| corvus | this is likely solved by 454 | 16:23 |
| corvus | unfortunately, we don't have a way to remove an item from post | 16:23 |
| corvus | so we may just want to go ahead and save queues and restart | 16:23 |
| corvus | will solve both the ram and the node-lock problems | 16:24 |
| corvus | dmsimard, pabelanger, AJaeger: sound good? | 16:24 |
| *** dtantsur|brb is now known as dtantsur | 16:24 | |
| *** dougwig has joined #openstack-infra | 16:25 | |
| pabelanger | corvus: wfm | 16:25 |
| dmsimard | lgtm as well | 16:26 |
| corvus | stopping | 16:26 |
| corvus | starting | 16:28 |
| *** bobh has joined #openstack-infra | 16:30 | |
| dmsimard | corvus: Is there a way to tell if the scheduler had been already restarted with 454 ? | 16:31 |
| *** r-daneel has joined #openstack-infra | 16:32 | |
| corvus | dmsimard: you can look at the version on the status page, or check the process time (root only) | 16:32 |
| dmsimard | Ah.. too late to check at this point now I guess. Was mostly curious if 454 had gotten in and we still had a recurrence. | 16:32 |
| *** felipemonteiro__ has quit IRC | 16:32 | |
| *** felipemonteiro_ has joined #openstack-infra | 16:32 | |
| corvus | re-enqueuing | 16:32 |
| corvus | dmsimard: no i don't think we've restarted since then | 16:32 |
| dmsimard | ack | 16:33 |
| corvus | dmsimard: if we didn't want to rely on my memory, of course we could check the logs | 16:33 |
| corvus | there are some messages that are only printed on process start | 16:33 |
| dmsimard | How intense is grepping through several days worth of logs? :) | 16:34 |
| *** jamespage has quit IRC | 16:34 | |
| *** jamespage has joined #openstack-infra | 16:35 | |
| *** ijw_ has quit IRC | 16:35 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: update gentoo vars for new profile and python https://review.openstack.org/543533 | 16:37 |
| *** imacdonn has joined #openstack-infra | 16:37 | |
| fungi | dmsimard: from a cpu/io perspective fairly, but you could always nice it to reduce cpu scheduling impact | 16:38 |
| fungi | and (z)grep is generally pretty low on memory overhead since it does chunked reads | 16:38 |
| fungi | also, our scheduler instance is waaay overpowered so i wouldn't worry about it too much anyway | 16:39 |
| corvus | yeah, it has 6 idle cores | 16:40 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool master: webapp: add optional admin endpoint https://review.openstack.org/536319 | 16:42 |
| openstackgerrit | Merged openstack/gertty master: Show merged parents if outdated https://review.openstack.org/543154 | 16:44 |
| pabelanger | dmsimard: mind a +3 on https://review.openstack.org/542993/ | 16:44 |
| *** felipemonteiro_ has quit IRC | 16:45 | |
| *** links has joined #openstack-infra | 16:47 | |
| *** caphrim007 has joined #openstack-infra | 16:47 | |
| clarkb | SamYaple: following up from last week, are both bindep and the docker cache happy at this point? | 16:47 |
| *** lpetrut has joined #openstack-infra | 16:48 | |
| SamYaple | clarkb: https://review.openstack.org/#/c/542370/ | 16:51 |
| *** hongbin has joined #openstack-infra | 16:51 | |
| SamYaple | bindep is solid, thanks! | 16:51 |
| *** links has quit IRC | 16:53 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: Cap aiohttp <3.0.0 https://review.openstack.org/543546 | 16:53 |
| *** links has joined #openstack-infra | 16:54 | |
| fungi | mordred: digging into this release failure, do you recall how an sdist/wheel build from a tag is supposed to figure out what constraints file to use for stable branch point releases? this one seems to have grabbed master upper-constraints for a stable/pike tag: http://logs.openstack.org/13/13fec4048a3c57d77307f4384b26788227179113/release/release-openstack-python/1dc8c7a/ | 16:57 |
| *** pcichy has quit IRC | 17:00 | |
| corvus | fungi: i believe mordred is [mostly] afk this week | 17:00 |
| fungi | ahh, drat | 17:01 |
| pabelanger | AJaeger: heads up, project-config zuul linters is broken until we land 543546^ | 17:01 |
| *** tosky_ has joined #openstack-infra | 17:02 | |
| *** tosky has quit IRC | 17:03 | |
| *** tosky_ is now known as tosky | 17:03 | |
| AJaeger | pabelanger: thanks | 17:04 |
| AJaeger | SamYaple: could you review https://review.openstack.org/#/q/topic:zuulv3-projects+projects:openstack/loci , please? | 17:05 |
| *** verdurin_ is now known as verdurin | 17:07 | |
| *** jpich has quit IRC | 17:07 | |
| SamYaple | AJaeger: on it, and ill be submitting proper decom for those repos soon | 17:07 |
| corvus | fungi: it *appears* that it just relies on zuul to set up openstack/requirements via the required-projects attribute of the release-openstack-python job | 17:08 |
| fungi | corvus: yeah, that's where i got to as well | 17:08 |
| fungi | presumably the jobs which want to run from tags and apply upper constraints will need some logic to guess a branch | 17:09 |
| corvus | fungi: setting aside how to convince zuul to do something otherwise -- how, actually, can one determine what branch should be used? | 17:09 |
| corvus | fungi: yeah.. i wonder if we've ever had such logic? | 17:09 |
| AJaeger | SamYaple: thanks | 17:09 |
| fungi | corvus: well, for local developers they all merge patches like https://review.openstack.org/493017 to stable branches | 17:10 |
| fungi | but our ci jobs don't exercise that logic since we set UPPER_CONSTRAINTS_FILE directly | 17:10 |
| corvus | fungi: so 'inspect the contents of the repo' is one potential answer... | 17:12 |
| *** felipemonteiro_ has joined #openstack-infra | 17:13 | |
| fungi | yeah, that feels really dirty | 17:13 |
| fungi | but certainly is one way out | 17:13 |
| corvus | i don't see a systematic way to map something like '5.2.1' to stable/pike | 17:14 |
| *** pcarver has joined #openstack-infra | 17:15 | |
| clarkb | pabelanger: SamYaple is https://review.openstack.org/#/c/542370/1 something we want to test in a single region really quickly to check the assumption that older users (tripleo?) are not broken and new users work too? | 17:15 |
| pabelanger | clarkb: yah, we could manually apply to tripleo mirror now | 17:16 |
| openstackgerrit | Merged openstack-infra/puppet-mailman master: Remove openstack HTML templates https://review.openstack.org/535855 | 17:16 |
| pabelanger | clarkb: give me a moment and will do that now, and have SamYaple confirm both clients still work | 17:17 |
| clarkb | pabelanger: ok, thanks | 17:17 |
| SamYaple | pabelanger: cool. 17.10 is the first to start "breaking" the old way for reference | 17:19 |
| fungi | corvus: i think we can take advantage (in our jobs anyway) of the assumption that the only time a job will run for a tag which appears on two branches will be at a time when either the checkout fallback to master requirements is acceptable (prior to branching requirements for the coordinated release) or during the rc period when constraints is frozen and we don't care whether the new stable branch or | 17:19 |
| fungi | master gets used | 17:19 |
| *** e0ne has quit IRC | 17:19 | |
| pabelanger | SamYaple: okay, try against http://mirror.regionone.tripleo-test-cloud-rh1.openstack.org/ | 17:19 |
| fungi | so we _could_ just use git branch --contains, i think? | 17:19 |
| fungi | corvus: given that depends on very openstacky business logic, i of course wouldn't want to embed assumptions like that in the job stdlib so would probably need to be a new openstack-zuul-jobs role/task | 17:20 |
| SamYaple | pabelanger: a pull is coming through that mirror now | 17:23 |
| SamYaple | pabelanger: should see it in the logs (this is from the new clients) | 17:23 |
| pabelanger | SamYaple: on 8081 right? | 17:23 |
| corvus | fungi: that sounds reasonable, and i think we can do it in the python-tarball pre-run playbook, which is in project-config and therefore openstack-specific | 17:23 |
| SamYaple | pabelanger: ye. im staging an older client now | 17:24 |
| pabelanger | SamYaple: okay, I see that | 17:24 |
| SamYaple | yea i had firewall troubles on my end | 17:24 |
| pabelanger | and I see that | 17:25 |
| SamYaple | old client now "error pulling image configuration: unknown blob | 17:25 |
| pcarver | Hi. I'm hoping someone can suggest some search engine query terms to help me out. I'm looking to script a Gerrit query and I need to figure out how to handle authentication in the script. I'm consulting https://gerrit-review.googlesource.com/Documentation/rest-api.html but I don't think this takes into account the Ubuntu One interaction. | 17:25 |
| pabelanger | SamYaple: hmm | 17:26 |
| pabelanger | I'll have to enable debug logs | 17:26 |
| pabelanger | 1 min | 17:26 |
| SamYaple | pabelanger: haha it works with the full URI | 17:27 |
| SamYaple | but not with the raw port | 17:27 |
| clarkb | pcarver: the rest api uses your gerrit user's api token which is separate from your openid login. You can find that info in your user settings in gerrit | 17:27 |
| pcarver | clarkb: That's what I figured | 17:27 |
| clarkb | pcarver: also note that our instance of gerrit hosts version specific docs for the version of gerrit we are running (not sure how much the rest api changes between 2.13 and master) | 17:27 |
| SamYaple | pabelanger: "registry-mirrors": ["http://mirror.regionone.tripleo-test-cloud-rh1.openstack.org:8081/registry-1.docker/"] <--- old clients work fine | 17:28 |
| SamYaple | pabelanger: "registry-mirrors": ["http://mirror.regionone.tripleo-test-cloud-rh1.openstack.org:8081/"] <-- new clients work fine | 17:28 |
| pcarver | I don't know what search terms to look for in order to figure out how to get a token | 17:28 |
| *** felipemonteiro_ has quit IRC | 17:28 | |
| pabelanger | SamYaple: okay, so no issue? | 17:28 |
| corvus | pcarver: https://review.openstack.org/Documentation/rest-api.html#authentication | 17:28 |
| SamYaple | pabelanger: unless the docker cache in apache only works for specific versions after it gets staged? | 17:29 |
| pcarver | clarkb: I'm guessing I need to make some sort of call to Ubuntu One with my credentials to request a token and then use that token in the call to Gerrit | 17:29 |
| SamYaple | pabelanger: seems fine for me, but there is defientely something subtle we are missing | 17:29 |
| pabelanger | SamYaple: will old clients also work with new syntax ? | 17:29 |
| SamYaple | pabelanger: nien | 17:29 |
| clarkb | pcarver: no its generated by gerrit in the user settings portion of the web ui | 17:29 |
| pabelanger | SamYaple: okay, try new syntax again with new client, want to make sure you are hitting cache | 17:29 |
| SamYaple | ok moment | 17:29 |
| clarkb | pcarver: https://review.openstack.org/#/settings/http-password | 17:29 |
| pcarver | clarkb: Oh, ok. I'll take a look. Maybe I was assuming its more complicated than it is. | 17:30 |
| corvus | pcarver: i did send you a link directly to the documentation page that tells you what you need. you don't need to assume anything. | 17:30 |
| SamYaple | pabelanger:pulling now | 17:31 |
| pabelanger | kk, that hit cache it looks like | 17:31 |
| SamYaple | cool | 17:31 |
| pabelanger | and if you can also try old syntax / old client | 17:31 |
| SamYaple | im happy with this setup then, and i guess ill just keep an eye to see if that "subtle" problem becomes worse | 17:31 |
| SamYaple | yup | 17:31 |
| pcarver | corvus: Yes, I'm taking a look at it now. I meant when I was trying to figure it out last week I was assuming I had to authenticate against Ubuntu One. | 17:32 |
| SamYaple | pabelanger: pulling | 17:32 |
| clarkb | SamYaple: pabelanger let me know when you are happy with the results and I can approve the change | 17:33 |
| corvus | pcarver: cool, the rest api docs are really good. i recommend just reading them straight through. i don't think there's anything unusual about our setup that would diverge from what's described there. | 17:33 |
| SamYaple | pabelanger: all pulled, see anything? | 17:33 |
| pabelanger | not that time | 17:34 |
| SamYaple | trying again | 17:34 |
| *** ijw has joined #openstack-infra | 17:34 | |
| fungi | pcarver: also keep in mind that a bunch of gerrit's rest api methods don't require authentication. any not anchored under a/ can be used anonymously, so if you don't actually need any of the specific authenticated methods you can probably skip putting any auth handling in your script whatsoever | 17:34 |
| *** VW has quit IRC | 17:35 | |
| pabelanger | SamYaple: nothing yet | 17:35 |
| SamYaple | pabelanger: its actively pulling with 17.09 client and old syntax | 17:35 |
| SamYaple | finished now | 17:35 |
| fungi | pcarver: and in the past we've also lobbied upstream to move some non-sensitive api methods to be anonymous | 17:35 |
| pabelanger | SamYaple: okay, you'll need to enable debug client side, I think is bypassed our registry | 17:35 |
| SamYaple | okie dokie | 17:36 |
| pabelanger | http://mirror.regionone.tripleo-test-cloud-rh1.openstack.org:8081/registry-1.docker/ | 17:36 |
| pabelanger | okay | 17:36 |
| pabelanger | 1 sec | 17:36 |
| pcarver | corvus: clarkb: Thanks. Looks like that's what I needed. I'd never set an HTTP password in Gerrit. I just did and using that works. | 17:36 |
| pabelanger | k, that wasn't use | 17:37 |
| pabelanger | you* | 17:37 |
| SamYaple | pabelanger: yea debug logs dont say anything good or bad | 17:38 |
| SamYaple | dockerd[9728]: time="2018-02-12T12:35:18.674860110-05:00" level=debug msg="Trying to pull ubuntu from https://registry-1.docker.io v2" | 17:38 |
| SamYaple | i think its ignoring. ill try an even older version | 17:38 |
| pabelanger | yah, it is skipping us | 17:38 |
| pabelanger | what is the URL you are using? | 17:38 |
| SamYaple | the one you just posted (double checked) | 17:38 |
| pabelanger | which client? | 17:39 |
| pabelanger | client version sorry | 17:39 |
| SamYaple | just now, 17.09 | 17:39 |
| pabelanger | odd | 17:39 |
| SamYaple | trying 17.07 now (as far as i can go back on this box) | 17:39 |
| pabelanger | 104.189.132.219 - - [12/Feb/2018:17:25:37 +0000] "GET /v2/library/ubuntu/manifests/sha256:7c308c8feb40a2a04a6ef158295727b6163da8708e8f6125ab9571557e857b29 HTTP/1.1" 200 1823 "-" "docker/17.09.0-ce go/go1.9 git-commit/afdb6d44a8 kernel/4.15.1-2-ARCH os/linux arch/amd64 UpstreamClient(Docker-Client/17.09.0-ce \\(linux\\))" | 17:39 |
| pabelanger | I did see it before | 17:39 |
| SamYaple | that looks like my request | 17:40 |
| SamYaple | just pulled with 17.07, anything? | 17:40 |
| pabelanger | no | 17:40 |
| SamYaple | oh are you sure the log above wasnt from my running against 8081 directly, with no URI? | 17:41 |
| pabelanger | oh, maybe | 17:42 |
| pabelanger | try dropping it | 17:42 |
| SamYaple | yea moment (client is currently 17.07) | 17:42 |
| SamYaple | pulling | 17:42 |
| pabelanger | see that | 17:42 |
| SamYaple | "error pulling image configuration: unknown blob" | 17:42 |
| SamYaple | debug doesnt give much more info | 17:43 |
| pabelanger | SamYaple: try a new image, wonder if a caching issue | 17:43 |
| SamYaple | http://paste.openstack.org/show/670331/ | 17:43 |
| SamYaple | ok | 17:43 |
| SamYaple | debian:stretch, same issue. unknown blob | 17:44 |
| *** myoung is now known as myoung|food | 17:44 | |
| pabelanger | SamYaple: have a debug from that? | 17:44 |
| SamYaple | thatis the debug | 17:44 |
| SamYaple | from the daemon | 17:45 |
| pabelanger | was it sha256:723254a2c089166d4bcfa917be0181ddbecd94971ebfe85792d96e7e29be9c68 | 17:45 |
| SamYaple | no client side debug logs from "pull" | 17:45 |
| *** VW has joined #openstack-infra | 17:45 | |
| SamYaple | oh yea for debian stretch | 17:45 |
| SamYaple | pabelanger: http://paste.openstack.org/show/670334/ | 17:46 |
| *** VW has quit IRC | 17:47 | |
| *** VW has joined #openstack-infra | 17:47 | |
| pabelanger | SamYaple: what was the syntax you used for docker cli? | 17:48 |
| pabelanger | want to try locally | 17:49 |
| SamYaple | docker pull debian:stretch | 17:49 |
| SamYaple | or `docker pull ubuntu` | 17:49 |
| *** yamamoto has quit IRC | 17:49 | |
| SamYaple | to recap my understanding of this situation, >17.07 doesnt work with the URI, >17.10 breaks with the URI, <17.10 doesnt use the cache with or without URI (breaks when pulling without URI, unknonw blob) | 17:49 |
| *** ykarel|away has joined #openstack-infra | 17:53 | |
| *** trown is now known as trown|lunch | 17:54 | |
| *** yamamoto has joined #openstack-infra | 17:54 | |
| pabelanger | okay, 1 sec | 17:55 |
| pabelanger | think I see issue | 17:55 |
| pabelanger | let me try something | 17:55 |
| SamYaple | ++ | 17:55 |
| *** david-lyle has quit IRC | 17:55 | |
| *** eroux has joined #openstack-infra | 17:56 | |
| pabelanger | SamYaple: which client you have installed now? | 17:57 |
| pabelanger | old or new? | 17:57 |
| SamYaple | 17.07 | 17:57 |
| SamYaple | old | 17:57 |
| pabelanger | okay, use http://mirror.regionone.tripleo-test-cloud-rh1.openstack.org:8081/registry-1.docker/ | 17:58 |
| pabelanger | please | 17:58 |
| SamYaple | ok moment | 17:58 |
| pabelanger | and pull image | 17:58 |
| SamYaple | pulling now | 17:59 |
| SamYaple | not breaking yet | 17:59 |
| pabelanger | okay, I don't see that. which is fine | 17:59 |
| pabelanger | using that same client | 17:59 |
| pabelanger | okay, use http://mirror.regionone.tripleo-test-cloud-rh1.openstack.org:8082/" | 17:59 |
| SamYaple | k | 17:59 |
| SamYaple | pulling, not breaking | 18:00 |
| *** yamamoto has quit IRC | 18:00 | |
| pabelanger | also don't see anything | 18:00 |
| pabelanger | okay, upgrade to latest client | 18:00 |
| SamYaple | super slow though | 18:00 |
| SamYaple | ok | 18:00 |
| *** bhavik1 has joined #openstack-infra | 18:00 | |
| *** derekh has quit IRC | 18:00 | |
| pabelanger | use :8002 again | 18:00 |
| fungi | corvus: yeah, so digging in project-config history, i think the lack of tag-to-branch matching is a regression brought by our v3 native equivalents: https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml?id=d4cc58d06#n200 | 18:00 |
| SamYaple | 8082*? | 18:00 |
| pabelanger | SamYaple: yes | 18:01 |
| SamYaple | k | 18:01 |
| SamYaple | pulling | 18:01 |
| pabelanger | Hmm, 1 sec | 18:01 |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Make timeout value apply to entire job https://review.openstack.org/541485 | 18:02 |
| pabelanger | doh, 1 sec | 18:02 |
| corvus | fungi: how about that! cool, i think we can stick that in the pre-playbook for that job and we'll be good. if we find a match, we can just 'git checkout' that branch. | 18:03 |
| fungi | corvus: yep, that's what i'm going to try here shortly | 18:03 |
| mnaser | i dont see any reported issues but is there any problems with logs? | 18:03 |
| mnaser | fatal: [ubuntu-xenial]: UNREACHABLE! => {"changed": false, "msg": "SSH Error: data could not be sent to remote host \"198.72.124.98\". Make sure this host can be reached over ssh", "unreachable": true} | 18:04 |
| AJaeger | mnaser: when was that? | 18:04 |
| mnaser | 2018-02-12 15:46:39.078925 | 18:04 |
| *** bhavik1 has quit IRC | 18:04 | |
| clarkb | mnaser: that ip addr doesn't have a reverse ptr and isn't the logs server ipaddress | 18:05 |
| clarkb | mnaser: more context might be helpful but I'm not sure the logs server is involved | 18:05 |
| mnaser | http://logs.openstack.org/65/543465/1/check/openstack-ansible-functional-ubuntu-xenial/428a52c/job-output.txt.gz (warning, big log file as usual) | 18:05 |
| AJaeger | mnaser: looks more like a fallout from zookeeper disconnect looking at timing | 18:05 |
| mnaser | i guess the worker node had problems? | 18:05 |
| sshnaidm|ruck | what can I use for set up local "nodepool" mirrors? For example if I'd like to run caching proxies on some of my local machines to speed up various stuff.. | 18:05 |
| sshnaidm|ruck | pabelanger, clarkb ^^ | 18:06 |
| pabelanger | SamYaple: okay, try 8082 again please, latest client | 18:06 |
| clarkb | mnaser: AJaeger ya if the loss of zookeeper connectivity resulted in that server being deleted out from under a job that would happen | 18:06 |
| SamYaple | moment | 18:06 |
| clarkb | mnaser: AJaeger it looks like connectivity to the test node itself is what broke | 18:06 |
| pabelanger | mnaser: no, we lost connection to zookeeper, then nodepool deleted all nodes | 18:06 |
| SamYaple | pabelanger: pulling | 18:06 |
| AJaeger | config-core, infra-root, we're ready to get rid of /usr/local/jenkins on our nodes - please see these two stacks and tell me whether the approache and locations are fine: https://review.openstack.org/#/c/543139/ and https://review.openstack.org/#/c/541868/ | 18:06 |
| pabelanger | SamYaple: see that | 18:06 |
| SamYaple | pabelanger: cool, old client test again? | 18:07 |
| *** ralonsoh has quit IRC | 18:07 | |
| pabelanger | SamYaple: yah, back to old | 18:07 |
| clarkb | sshnaidm|ruck: we have puppet deploy apache vhost configs for us | 18:07 |
| *** dklyle has joined #openstack-infra | 18:07 | |
| SamYaple | pabelanger: pulling | 18:07 |
| AJaeger | config-core, no need to review everything in detail - I'm interested in thumbs up or comments what to change overall | 18:07 |
| pabelanger | SamYaple: see that | 18:07 |
| SamYaple | pabelanger: "unknown blob" | 18:07 |
| SamYaple | so its still borked for that | 18:07 |
| AJaeger | config-core (sure, details reviews welcome as well ;) | 18:07 |
| pabelanger | SamYaple: kk, go back to 8081/registry-1.docker now | 18:08 |
| clarkb | sshnaidm|ruck: https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/mirror.vhost.erb is our current template | 18:08 |
| SamYaple | k | 18:08 |
| SamYaple | pabelanger: pulling | 18:08 |
| pabelanger | k, I don't see that | 18:08 |
| pabelanger | which, is expected | 18:08 |
| SamYaple | ok, so new port for new client? | 18:08 |
| SamYaple | old port remains the same? | 18:09 |
| pabelanger | yah, there is actually 3 clients | 18:09 |
| SamYaple | haha great | 18:09 |
| pabelanger | so, new client for 8082 | 18:09 |
| SamYaple | thats good for me. being that you have the apache config there, wanna take over the patch? | 18:09 |
| pabelanger | 8081 is for my client, which is docker/1.13.1 | 18:09 |
| pabelanger | and 17.09 is broken | 18:09 |
| pabelanger | SamYaple: I can push up a new patch here is a moment | 18:10 |
| SamYaple | i think they might have been siliently dropping the "bad" URI mirror in some version after 1.13.1 | 18:10 |
| pabelanger | possible, that is the version that still ships with fedora-27 | 18:10 |
| sshnaidm|ruck | clarkb, only this template and that's it? | 18:11 |
| clarkb | sshnaidm|ruck: well you need to install and manage apache2.4 as well | 18:11 |
| pabelanger | SamYaple: on last test, can you go back to new client | 18:11 |
| *** yamamoto has joined #openstack-infra | 18:11 | |
| *** yamamoto has quit IRC | 18:11 | |
| SamYaple | new client, with old URI? | 18:11 |
| sshnaidm|ruck | clarkb, yeah, of course.. can I see one these generated templates? | 18:11 |
| pabelanger | SamYaple: yah, just :8081/ nothing after | 18:12 |
| clarkb | sshnaidm|ruck: what portion do you want? the stuff related to caching proxy isn't templated just teh vhost name and server aliases and log locations | 18:12 |
| clarkb | sshnaidm|ruck: which is server specific anyways and not sure it will help much to see that | 18:12 |
| clarkb | sshnaidm|ruck: also if it is just for you locally it might be simpler to run squid as an open proxy (assuming you have local firewall keeping others out) | 18:13 |
| pabelanger | SamYaple: never mind, my tests confirmed it | 18:13 |
| sshnaidm|ruck | clarkb, and apache config? | 18:13 |
| pabelanger | SamYaple: I'll push up changes here shortly | 18:13 |
| pabelanger | need coffee | 18:13 |
| sshnaidm|ruck | clarkb, I'm not sure it works with https well | 18:13 |
| SamYaple | pabelanger: cool. sounds good | 18:13 |
| SamYaple | pabelanger: for completeness,its pulling now | 18:14 |
| fungi | clarkb: AJaeger: also probably transient failure resulting from the zk disconnect earlier? http://logs.openstack.org/31/31181cba50df52a1a723f7f34af2eef6d0e3e673/tag/publish-openstack-releasenotes/dfe7a5a/ara/result/08f952e4-67dc-47bc-9742-f6579324b5d7/ | 18:14 |
| clarkb | sshnaidm|ruck: it can if you mitm yourself. We don't really solve that with our proxy either though and just use http there | 18:14 |
| *** harlowja has joined #openstack-infra | 18:14 | |
| sshnaidm|ruck | clarkb, I see, thanks, will try it | 18:15 |
| fungi | sshnaidm|ruck: and set appropriate options in tools to override their inevitable "zomg you're using insecure http you dirty heathen!" | 18:15 |
| clarkb | or add teh cert to your trust chain, or pay for a cert that would already be trusted. | 18:15 |
| SamYaple | clarkb: feelings on not using the infra package mirrors for post jobs? (so i can have signed repos) | 18:15 |
| sshnaidm|ruck | fungi, yeah.. | 18:15 |
| clarkb | actually you probably can't pay for one of those | 18:15 |
| clarkb | but you can likely just make a cert that works for all the things iirc this was a setup in former corp env. super secure | 18:16 |
| AJaeger | fungi: that looks more like race in publishing - two jobs publishing at same time | 18:16 |
| fungi | AJaeger: thanks | 18:16 |
| clarkb | fungi: AJaeger and happened before the zookeeper disconnect | 18:16 |
| fungi | got it, i wasn't sure what the timeframe was for that | 18:16 |
| AJaeger | fungi: 14:40 started AFAIR | 18:17 |
| fungi | i would find it strange to have two jobs racing on glance release notes updates | 18:17 |
| fungi | but maybe they had tags pushed for two different branches at roughly the same time or something | 18:18 |
| *** jpena is now known as jpena|off | 18:18 | |
| fungi | or could it be any two jobs updating glance docs? | 18:18 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Support docker registry mirrors without URI https://review.openstack.org/542370 | 18:20 |
| AJaeger | fungi: 14.0.1 and 15.01 merged around the same time | 18:20 |
| pabelanger | clarkb: SamYaple: ^ actually needed based on our testing just now | 18:20 |
| fungi | AJaeger: yep, smcginnis just confirmed that as well | 18:20 |
| fungi | thanks! | 18:21 |
| SamYaple | pabelanger: thanks! can i ask what the actual issue was? was it the ProxyPass '/'? | 18:22 |
| pabelanger | SamYaple: not sure, I didn't really debug it. Just that my client locally wouldn't properly work | 18:23 |
| SamYaple | got it | 18:23 |
| pabelanger | SamYaple: and 17.09 seems to never work | 18:23 |
| *** lpetrut has quit IRC | 18:23 | |
| *** gfidente is now known as gfidente|afk | 18:23 | |
| SamYaple | well im happy with any working solution to be honest | 18:23 |
| *** lpetrut has joined #openstack-infra | 18:23 | |
| SamYaple | i just dont want 8083 and 8084 for future versions of docker haha | 18:23 |
| pabelanger | yah, if only docker use existing tools to handle caching | 18:23 |
| pabelanger | :) | 18:23 |
| SamYaple | one of the many reasons i want to switch away from docker, but i think were still a few years out from that option | 18:24 |
| * AJaeger hopes to use cri-o soon | 18:27 | |
| SamYaple | oh man. that wouldbe sweet | 18:27 |
| AJaeger | (at least in k8s) | 18:27 |
| *** lpetrut has quit IRC | 18:27 | |
| *** lpetrut has joined #openstack-infra | 18:27 | |
| *** r-daneel has quit IRC | 18:27 | |
| SamYaple | well we arebasically buildinga non-k8s solution that would work with k8s (self-orchestrating containers) as a migration plan | 18:28 |
| SamYaple | so cri-o is certainly on the table | 18:28 |
| *** lpetrut has quit IRC | 18:28 | |
| *** lpetrut_ has joined #openstack-infra | 18:28 | |
| *** zoli is now known as zoli|gone | 18:29 | |
| *** zoli|gone is now known as zoli | 18:29 | |
| *** lpetrut_ has quit IRC | 18:29 | |
| *** efoley has quit IRC | 18:29 | |
| *** lpetrut has joined #openstack-infra | 18:29 | |
| *** dklyle has quit IRC | 18:30 | |
| *** lpetrut has quit IRC | 18:30 | |
| *** camunoz has quit IRC | 18:30 | |
| *** lpetrut has joined #openstack-infra | 18:30 | |
| *** electrofelix has quit IRC | 18:34 | |
| *** lpetrut has quit IRC | 18:35 | |
| *** r-daneel has joined #openstack-infra | 18:35 | |
| *** lpetrut has joined #openstack-infra | 18:35 | |
| *** tosky has quit IRC | 18:36 | |
| *** electrofelix has joined #openstack-infra | 18:37 | |
| *** lpetrut has quit IRC | 18:39 | |
| *** lpetrut has joined #openstack-infra | 18:40 | |
| *** links has quit IRC | 18:45 | |
| *** rlandy is now known as rlandy|brb | 18:46 | |
| *** signed8bit has joined #openstack-infra | 18:47 | |
| ijw | A feature request, I guess: is there any way we could get related Zuul job status on gerrit pages? Even a cross-link would help. Sometimes you're left wondering if a job is scheduled, running or not submitted. | 18:50 |
| *** electrofelix has quit IRC | 18:51 | |
| dmsimard | ijw: I have a story for something like that, I believe the "backend" implementation already allows for something like that | 18:51 |
| clarkb | ijw: we've implemented that in the past but it ended up killing the zuul server. Definitely something to improve on (I think its just been low priority because the zuulv3 and you can always check the status page directly) | 18:51 |
| *** ijw has quit IRC | 18:52 | |
| *** ijw has joined #openstack-infra | 18:53 | |
| AJaeger | fungi: do you want to +2A this bindep change for removing of zuul project name - https://review.openstack.org/539777 ? | 18:53 |
| dmsimard | https://storyboard.openstack.org/#!/story/2000873 is the story I was talking about https://storyboard.openstack.org/#!/story/2000873 | 18:53 |
| dmsimard | Er, sorry for double paste. | 18:53 |
| *** david-lyle has joined #openstack-infra | 18:54 | |
| *** e0ne has joined #openstack-infra | 18:55 | |
| *** camunoz has joined #openstack-infra | 18:56 | |
| fungi | dmsimard: indeed, we already have an implementation in fact, just need someone with an interest in hacking on javascript to make it more efficient i think | 18:56 |
| *** myoung|food is now known as myoung | 18:57 | |
| *** ykarel|away has quit IRC | 18:57 | |
| fungi | the problem we ran into previously is that hundreds of developers each with dozens of gerrit tabs perpetually open in their browsers all hammering the zuul status api put us in a bad place and so we had to disable it again | 18:57 |
| fungi | ijw: ^ | 18:58 |
| *** dprince has quit IRC | 18:58 | |
| dmsimard | I wonder if there could be a *lightweight* API endpoint that we can just query to see if there are Zuul jobs in progress for a particular change and then hook that up to gerrit somehow (display "RUNNING" or "QUEUED" or the end success like FAILURE/SUCCESS accordingly) | 18:58 |
| ijw | fungi: if you can tell me how the JS needs hacking I may be able to assist, but I'm not sure how JS can help with the number of API requests... | 18:58 |
| fungi | dmsimard: yeah, that's what we did | 18:58 |
| fungi | dmsimard: the zuul status api in v2 had a means of querying individual changes | 18:59 |
| dmsimard | Ah, that predates my increased interest in Zuul things :) | 18:59 |
| fungi | and i believe changes landed to the v3 status api to suppose the same | 18:59 |
| dmsimard | fungi: but it was just a filter, right ? It still loaded all the other changes ? | 18:59 |
| ijw | Cos loading the whole Zuul dash isn't lightweight (not that I do it often) and actually finding the job on there is surprisingly annoying | 18:59 |
| fungi | dmsimard: no, you can specifically ask the status api to return just the info for a specific change | 19:00 |
| fungi | and indeed, asking for the full status.json would of course be a non-starter | 19:00 |
| *** signed8bit has quit IRC | 19:00 | |
| ijw | fungi: To reduce the load further, what we could do is make it so that you have to click to discover job status, I suppose, which means it wouldn't be a default action for every gerrit page loaded. It could still report in-page. That's pretty simple stuff | 19:01 |
| fungi | ijw: yeah, that might work i suppose | 19:01 |
| ijw | If you can point me at the API I can work up a snippet | 19:01 |
| fungi | the relevant code is still present in http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/gerrit/hideci.js | 19:03 |
| *** lucasagomes is now known as lucas-pto | 19:03 | |
| ijw | That includes the lightweight API call | 19:03 |
| ijw | ? | 19:03 |
| *** tosky has joined #openstack-infra | 19:04 | |
| fungi | yeah, it hits zuul.o.o/status/change/... | 19:04 |
| fungi | would need to check the present v3 api to make sure the query syntax is still the same | 19:04 |
| *** jamesmcarthur has quit IRC | 19:05 | |
| *** rlandy|brb is now known as rlandy | 19:08 | |
| dmsimard | fungi: I wonder if Zuul has the notion of a build before the job actually starts, but then you also need to filter builds for each change and it never ends :/ | 19:08 |
| ijw | Yeah, someone there is very enthusiastic, that looks like a 15s poll of Zuul - if a 'refresh on click' would keep people happy then that would certainly be lighter weight. | 19:08 |
| * ijw adds it to his odd jobs list | 19:10 | |
| fungi | dmsimard: ijw: aha, we're waiting on https://review.openstack.org/535903 | 19:10 |
| *** dprince has joined #openstack-infra | 19:11 | |
| *** sshnaidm|ruck is now known as sshnaidm|off | 19:11 | |
| fungi | "Port per-change status to zuul-web" | 19:11 |
| *** yamamoto has joined #openstack-infra | 19:12 | |
| fungi | i think that explains why my attempts to exercise the old syntax were resulting in a 404 | 19:12 |
| *** gyee has joined #openstack-infra | 19:12 | |
| fungi | so based on that, looks like the syntax will be the same as it was under v2 | 19:12 |
| dmsimard | mordred was way ahead of us | 19:12 |
| *** sambetts is now known as sambetts|afk | 19:13 | |
| *** rwsu has quit IRC | 19:13 | |
| fungi | also, with zuul-web being a separate daemon, that may get us better performance than we had attempting to do the same under v2 | 19:13 |
| *** rwsu has joined #openstack-infra | 19:13 | |
| *** eharney has quit IRC | 19:13 | |
| fungi | since it won't drag down the scheduler daemon | 19:13 |
| *** jtomasek has quit IRC | 19:14 | |
| *** dprince has quit IRC | 19:15 | |
| *** dprince has joined #openstack-infra | 19:15 | |
| *** signed8bit has joined #openstack-infra | 19:16 | |
| AJaeger | now, if we just could fix mordred's 535903... | 19:17 |
| *** tesseract has quit IRC | 19:18 | |
| *** yamamoto has quit IRC | 19:19 | |
| *** felipemonteiro has joined #openstack-infra | 19:23 | |
| *** amoralej is now known as amoralej|off | 19:27 | |
| *** bobh has quit IRC | 19:27 | |
| *** yamahata has quit IRC | 19:28 | |
| *** gordc has joined #openstack-infra | 19:29 | |
| *** gordc has left #openstack-infra | 19:30 | |
| *** e0ne has quit IRC | 19:31 | |
| *** gfidente|afk has quit IRC | 19:33 | |
| *** DennyZhang has joined #openstack-infra | 19:33 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add zuul from scratch doc https://review.openstack.org/542518 | 19:34 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Reclassify some debug log lines as info https://review.openstack.org/543044 | 19:34 |
| openstackgerrit | Kendall Nelson proposed openstack-infra/project-config master: Enable StoryBoard Use for Election Repo https://review.openstack.org/542528 | 19:35 |
| openstackgerrit | Kendall Nelson proposed openstack-infra/project-config master: Enable StoryBoard Use for Election Repo https://review.openstack.org/542528 | 19:35 |
| *** felipemonteiro has quit IRC | 19:39 | |
| *** felipemonteiro_ has joined #openstack-infra | 19:39 | |
| *** florianf has quit IRC | 19:40 | |
| fungi | #status log Ubuntu has published Trusty and Xenial updates for CVE-2018-6789; I have manually updated lists.openstack.org and lists.katacontainers.io with the new packages manually rather than waiting for unattended-upgrades to find them | 19:40 |
| openstackstatus | fungi: finished logging | 19:40 |
| fungi | infra-root: ^ | 19:40 |
| clarkb | fungi: thank you | 19:40 |
| dmsimard | thanks | 19:40 |
| openstackgerrit | Merged openstack-infra/bindep master: Zuul: Remove project name https://review.openstack.org/539777 | 19:40 |
| pabelanger | ack | 19:41 |
| *** e0ne has joined #openstack-infra | 19:41 | |
| *** lbragstad_ has joined #openstack-infra | 19:41 | |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard master: Update Development & Migration Docs https://review.openstack.org/539723 | 19:41 |
| fungi | looks like bionic is the only one still lagging now: https://people.canonical.com/~ubuntu-security/cve/2018/CVE-2018-6789.html | 19:41 |
| *** e0ne has quit IRC | 19:41 | |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard master: Update Development & Migration Docs https://review.openstack.org/539723 | 19:42 |
| DennyZhang | exit | 19:42 |
| DennyZhang | exit | 19:42 |
| DennyZhang | exit | 19:42 |
| DennyZhang | exit | 19:42 |
| *** DennyZhang has left #openstack-infra | 19:42 | |
| *** panda is now known as panda|off | 19:42 | |
| *** trown|lunch is now known as trown | 19:43 | |
| *** lbragstad_ has quit IRC | 19:43 | |
| *** dtantsur is now known as dtantsur|afk | 19:44 | |
| dmsimard | he ended up exiting | 19:45 |
| *** ijw_ has joined #openstack-infra | 19:45 | |
| fungi | i imagined someone shouting that at their screen | 19:48 |
| *** pcichy has joined #openstack-infra | 19:48 | |
| *** ijw has quit IRC | 19:48 | |
| *** pramodrj07 has joined #openstack-infra | 19:49 | |
| AJaeger | infra-root, is ovs-bhs1 having problems? See http://grafana.openstack.org/dashboard/db/nodepool-ovh | 19:54 |
| *** kjackal has quit IRC | 19:54 | |
| dmsimard | AJaeger: looks like the same issue we had recently (last week?) | 19:55 |
| AJaeger | the time to ready and error node launch attempts graph strike me as odd | 19:55 |
| pabelanger | AJaeger: yah, noticed that a few hours ago | 19:55 |
| *** kjackal has joined #openstack-infra | 19:55 | |
| pabelanger | looks like recovering now | 19:55 |
| pabelanger | I see nodes online | 19:55 |
| dmsimard | pabelanger: The folks from OVH ended up never getting back to me last time, I guess their monitoring ends up picking that up | 19:56 |
| AJaeger | ok, thanks | 19:56 |
| pabelanger | yup, every so often they have issues, but eventually comes back online | 19:56 |
| clarkb | its the message timeouts again | 19:57 |
| clarkb | 'Error in creating the server: Timed out waiting for a reply to message ID 02610833f9194ac5b1b58e47282718a7' for example | 19:57 |
| pabelanger | yah | 19:57 |
| pabelanger | overloaded message queue? | 19:57 |
| AJaeger | we could use that capacity right now - 230 changes in check pipeline... | 19:57 |
| *** bobh has joined #openstack-infra | 19:57 | |
| pabelanger | AJaeger: yah, slowly making our way down. about 1.4k requests pending | 19:58 |
| pabelanger | ovh-bhs1 coming back online will help | 19:58 |
| *** pcichy has quit IRC | 19:59 | |
| *** VW_ has joined #openstack-infra | 20:00 | |
| AJaeger | team, we're ready to get rid of /usr/local/jenkins on our nodes - please see these two stacks and tell me whether the approach and file names/locations are fine: https://review.openstack.org/#/c/543139/ and https://review.openstack.org/#/c/541868/ . | 20:00 |
| AJaeger | one stack is for bindep-fallback.txt, other is for jenkins/scipts | 20:00 |
| *** pcichy has joined #openstack-infra | 20:00 | |
| *** VW_ has quit IRC | 20:01 | |
| *** VW_ has joined #openstack-infra | 20:01 | |
| AJaeger | config-core, and one review request for https://review.openstack.org/#/c/540670/ ,please - the dependency merged, we can remove legacy kolla-kubernetes jobs now from project-config | 20:02 |
| *** VW has quit IRC | 20:03 | |
| *** eharney has joined #openstack-infra | 20:03 | |
| pabelanger | infra-root: looks like we might have lost console streaming on ze09.o.o and ze04.o.o. I can see <defunct> zuul-executor processes and OOM in dmesg | 20:05 |
| *** yamahata has joined #openstack-infra | 20:05 | |
| pabelanger | ze02.o.o looks good still with no OOM in dmesg | 20:05 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/project-config master: Update nova's gerritbot config https://review.openstack.org/543600 | 20:06 |
| mriedem | will ^ take a regex for the branches? | 20:06 |
| AJaeger | mriedem: did we merge that change? | 20:07 |
| AJaeger | mriedem: https://review.openstack.org/#/c/499367/ ;( | 20:08 |
| *** Swami has joined #openstack-infra | 20:08 | |
| *** VW_ has quit IRC | 20:08 | |
| *** VW has joined #openstack-infra | 20:09 | |
| mriedem | efried strikes again | 20:09 |
| fungi | gotta admire someone who sees software as what it should be, rather than merely what it is ;) | 20:10 |
| AJaeger | infra-root, what about merging 499367? Might make it much easier for us with new branches | 20:10 |
| fungi | should i be trying to do something like {{ zuul.projects[git.openstack.org/openstack/requirements].src_dir }} in a task or just assume {{ ansible_user_dir }}/src/git.openstack.org/openstack/requirements instead? | 20:12 |
| AJaeger | fungi: the former is the newer syntax and might be safer | 20:14 |
| fungi | i was looking for examples of doing that but could only find the latter | 20:14 |
| dmsimard | fungi: that's because until recently .projects was a list, not a dict | 20:15 |
| AJaeger | fungi: we reecently merged at least one of the newer | 20:15 |
| fungi | not sure what needs quoting when referencing associative arrays in ansible variables | 20:15 |
| dmsimard | now it's a dict keyed by project names | 20:15 |
| fungi | is what i have above viable then, or do i need quotes around "git.openstack.org/openstack/requirements" to make that work?> | 20:15 |
| AJaeger | fungi: http://git.openstack.org/cgit/openstack-infra/nodepool/tree/.zuul.yaml#n65 | 20:15 |
| AJaeger | or http://git.openstack.org/cgit/openstack/python-tempestconf/tree/roles/generate-tempestconf-file/tasks/main.yaml#n67 | 20:16 |
| fungi | thanks! | 20:16 |
| dmsimard | fungi: also note that technically it would be "{{ zuul.projects['git.openstack.org/openstack/requirements'].src_dir }}" (note the single quotes) | 20:16 |
| fungi | so yes to quotes around the key | 20:16 |
| fungi | that's exactly what i was asking ;) | 20:16 |
| dmsimard | I double checked in a zuul inventory file to make sure I wasn't talking nonsense :D | 20:17 |
| *** ijw_ has quit IRC | 20:18 | |
| *** dprince has quit IRC | 20:19 | |
| *** esberglu has quit IRC | 20:19 | |
| *** olaph has joined #openstack-infra | 20:22 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add native distro test jobs https://review.openstack.org/543268 | 20:22 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Revert fixes for legacy boot jobs https://review.openstack.org/543350 | 20:22 |
| ianw | dmsimard: yep, had to use that exact thing in ^^ to make sure we ran the scripts out of nodepool when being used by other projects | 20:23 |
| *** alexchadin has joined #openstack-infra | 20:23 | |
| AJaeger | fungi, https://review.openstack.org/#/c/543268/13/playbooks/nodepool-functional-py35-src/run.yaml | 20:24 |
| *** olaph1 has quit IRC | 20:24 | |
| AJaeger | fungi, note that these are relatives dir, so you can still add "{{ ansible_user_dir }}/" for the absolute path if needed | 20:25 |
| *** jcoufal has quit IRC | 20:25 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: zuul web: add admin endpoint, enqueue commands https://review.openstack.org/539004 | 20:27 |
| *** kong has joined #openstack-infra | 20:28 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config master: Use correct requirements branch for tags https://review.openstack.org/543607 | 20:28 |
| fungi | AJaeger: dmsimard: so like that ^ ? | 20:28 |
| dmsimard | fungi: that's a bit hard to parse, I'll take a minute :) | 20:29 |
| fungi | er, and i already found a copy-paste error from the original implementation | 20:30 |
| *** esberglu has joined #openstack-infra | 20:30 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove legacy-devstack-unit-tests job https://review.openstack.org/543608 | 20:31 |
| AJaeger | fungi: the zuul.projects line looks fine - will review the rest tomorrow and call it a day now... | 20:32 |
| fungi | thanks AJaeger! | 20:32 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config master: Use correct requirements branch for tags https://review.openstack.org/543607 | 20:32 |
| fungi | it's non-urgent. we haven't even noticed until today when deep-diving into a job log for a stable point release which failed for unrelated reasons | 20:33 |
| dmsimard | fungi: the branch for the change is already in the host vars, is there a particular reason we're trying to parse it ? I don't have full context on this but could we do something like (pseudocode) git checkout {{ zuul.branch }} ... when: "stable" in {{ zuul.branch }} ? | 20:33 |
| fungi | dmsimard: there is no branch for the change, that's why we have to do this | 20:34 |
| *** alexchadin has quit IRC | 20:34 | |
| fungi | it's a job which runs from a git tag | 20:34 |
| dmsimard | ah, bummer | 20:34 |
| fungi | tags are inherently branchless | 20:34 |
| dmsimard | right | 20:34 |
| *** lpetrut has quit IRC | 20:38 | |
| *** fultonj has joined #openstack-infra | 20:38 | |
| ianw | clarkb: the stack to move all the !ubuntu devstack jobs to native @ https://review.openstack.org/#/c/540704/ should be ready for reviews. i say this because it was your devstack-early log change that started it all :) | 20:43 |
| openstackgerrit | Merged openstack-infra/nodepool master: Fix legacy dsvm jobs https://review.openstack.org/543327 | 20:45 |
| clarkb | ianw: ok I've got to see the tax accountant in a little bit but will try to dig in after | 20:45 |
| ianw | clarkb: no huge rush, still working through CI but i expect it to all pass (famous last words :) | 20:46 |
| clarkb | ianw: https://review.openstack.org/#/c/542370/ is one that may interest you considering your work on mirrors | 20:46 |
| ianw | oh cool, saw the tail end of that discussion the other day i think | 20:46 |
| clarkb | also if other infra-root could review topic:update-for-dublin that would be great to get PTGbot prep done. (I can review though likely won't approve to avoid piling on a bunch of foundation votes on foundation written changes) | 20:47 |
| *** eumel8 has quit IRC | 20:48 | |
| *** jamesmcarthur has joined #openstack-infra | 20:48 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-httpd master: Reload vhost changes, not restart https://review.openstack.org/497948 | 20:49 |
| pabelanger | clarkb: ianw: ^ should also help with no-outage mirror changes too | 20:49 |
| pabelanger | assuming puppet is happy | 20:49 |
| ianw | pabelanger: so basically, docker can't handle a mirror of the form "http://the.mirror.com/foo-bar/" ? | 20:50 |
| pabelanger | ianw: yup, how awesome is that | 20:51 |
| fungi | the list of things docker can't handle seems to get longer every day | 20:51 |
| pabelanger | yah, I have no idea why they wouldn't support it | 20:52 |
| ianw | the change that broke it seems to be sort of one level up ... that they weren't checking the return value of the config checker or something. i wonder if they actually realise that's the behaviour | 20:52 |
| pabelanger | I can understand --insecure flag for non https sites | 20:52 |
| *** jamesmcarthur has quit IRC | 20:52 | |
| ianw | it might have been unintended, but nobody noticed. anyway ... that sounds like a rabbit hole of pain unless someone is already very conversant working on docker internals | 20:53 |
| corvus | clarkb, ttx: ptgbot changes all +3 | 20:53 |
| clarkb | corvus: tyty | 20:53 |
| fungi | yeah, i did some spelunking and basically from the very first patch which added mirror support they had a routine which checked to make sure there was nothing after the the hostname and first / in the mirror setting... but they never actually failed the config load when that check failed | 20:53 |
| fungi | (until a much more recent release) | 20:54 |
| fungi | what _i_ wonder is whether they were aware that using mirrors which weren't at the top of the url path actually worked anyway without that safety check in place | 20:54 |
| fungi | no clue why they thought it was something worth protecting against | 20:55 |
| clarkb | thats what gets me | 20:55 |
| clarkb | its http | 20:55 |
| clarkb | but they refuse to treat it as http | 20:55 |
| fungi | strikes me more as an implementation from someone who doesn't know how software mirrors are usually hosted | 20:55 |
| clarkb | your url can't include a protocl (so no specifying http:// or https://) and you can't use paths... | 20:55 |
| fungi | you don't usually have a separate vhost/port for each bit of software you're mirroring, and you put them at arbitrary paths in your archive site | 20:55 |
| pabelanger | I'm sure it make senses to somebody | 20:58 |
| *** bobh has quit IRC | 21:00 | |
| openstackgerrit | Merged openstack-infra/zuul master: Cap aiohttp <3.0.0 https://review.openstack.org/543546 | 21:01 |
| openstackgerrit | Sean McGinnis proposed openstack-infra/devstack-gate master: Update grenade settings for stable/queens https://review.openstack.org/543615 | 21:02 |
| *** ChanServ has quit IRC | 21:02 | |
| *** rfolco|rover is now known as rfolco|off | 21:06 | |
| *** VW has quit IRC | 21:06 | |
| *** felipemonteiro__ has joined #openstack-infra | 21:08 | |
| *** slaweq has quit IRC | 21:09 | |
| *** suhdood has joined #openstack-infra | 21:10 | |
| *** ChanServ has joined #openstack-infra | 21:11 | |
| *** barjavel.freenode.net sets mode: +o ChanServ | 21:11 | |
| *** VW has joined #openstack-infra | 21:11 | |
| *** felipemonteiro_ has quit IRC | 21:12 | |
| *** efried has joined #openstack-infra | 21:12 | |
| dmsimard | clarkb: there's an apt-https plugin yeah m | 21:12 |
| dmsimard | yeah ? | 21:13 |
| clarkb | dmsimard: ? | 21:13 |
| clarkb | apt just does https now aiui | 21:13 |
| clarkb | you set your url to https and it just works (tm) | 21:13 |
| efried | Howdy infra wizards! A Rocky spec merged earlier today (https://review.openstack.org/#/c/540179/) but isn't showing up in the publish (http://specs.openstack.org/openstack/nova-specs/specs/rocky/). Also don't see it in any post queue on z.o.o. I know we've had some problems with these publish jobs in the past. Any ideas? | 21:14 |
| dmsimard | clarkb: oh that's built in now ? It used to be a plugin you had to install | 21:14 |
| dmsimard | https://packages.debian.org/sid/apt-transport-https | 21:14 |
| dirk | everyone, is zuul hanging? zuul.openstack.org lists 100's of events pending | 21:15 |
| dmsimard | "https support has been moved into the apt package in 1.5" neat | 21:15 |
| clarkb | dirk: the order of operations there is all resulst then process events queue iirc | 21:15 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: WIP: add abstract job attribute https://review.openstack.org/543619 | 21:15 |
| *** r-daneel has quit IRC | 21:17 | |
| clarkb | efried: its in the post queue | 21:17 |
| clarkb | efried: 32b00cc | 21:17 |
| *** r-daneel has joined #openstack-infra | 21:17 | |
| efried | clarkb: Oh, I was looking for it by the review number. Where would I get "32b00cc" from? | 21:17 |
| clarkb | efried: that is the sha1 for the resulting commit (in this case a merge commit) | 21:18 |
| openstackgerrit | Merged openstack-infra/puppet-openstackci master: Allow viewing of .log.gz files https://review.openstack.org/543266 | 21:18 |
| efried | aha! Tribal knowledge! (Or possibly in the docs I haven't read...) | 21:18 |
| clarkb | efried: post queue operates on merged commits not changes hence that difference | 21:18 |
| efried | I guess that makes sense :) | 21:18 |
| clarkb | dirk: yup results queue just dropped as did events so it is still processing | 21:19 |
| clarkb | efried: we might consider updating the description of the post queue on the status page to be more explicit about that. I think that comes from https://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul.d/pipelines.yaml#n104 | 21:22 |
| *** felipemonteiro__ has quit IRC | 21:23 | |
| corvus | dirk: we usually don't worry about event backlogs until it gets into the thousands | 21:23 |
| *** felipemonteiro__ has joined #openstack-infra | 21:23 | |
| *** jgriffith has quit IRC | 21:26 | |
| *** gagehugo has quit IRC | 21:27 | |
| efried | clarkb: Can a guy use HTML tags in that yaml? | 21:28 |
| *** gagehugo has joined #openstack-infra | 21:28 | |
| *** pcichy has quit IRC | 21:30 | |
| openstackgerrit | Eric Fried proposed openstack-infra/project-config master: Document 'post' job names https://review.openstack.org/543625 | 21:32 |
| efried | clarkb: ^ | 21:32 |
| *** apetrich has quit IRC | 21:32 | |
| *** apetrich has joined #openstack-infra | 21:33 | |
| openstackgerrit | Merged openstack-infra/puppet-ptgbot master: Update index page contents for Dublin https://review.openstack.org/540456 | 21:34 |
| openstackgerrit | Merged openstack-infra/puppet-ptgbot master: Deploy signage schedule view https://review.openstack.org/543436 | 21:34 |
| *** suhdood has quit IRC | 21:34 | |
| corvus | efried: 'queue item' would be more accurate than 'job name' in that. i'd avoid html. | 21:35 |
| openstackgerrit | Eric Fried proposed openstack-infra/project-config master: Document 'post' job names https://review.openstack.org/543625 | 21:39 |
| efried | corvus: hecho ^ | 21:39 |
| *** wolverineav has quit IRC | 21:39 | |
| *** edmondsw has quit IRC | 21:39 | |
| *** felipemonteiro__ has quit IRC | 21:39 | |
| *** slaweq has joined #openstack-infra | 21:41 | |
| corvus | gracias | 21:45 |
| *** ijw has joined #openstack-infra | 21:45 | |
| openstackgerrit | Merged openstack-infra/puppet-ptgbot master: PTGbot configuration for Dublin PTG https://review.openstack.org/543437 | 21:46 |
| jhesketh | Morning | 21:52 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool master: Clean held nodes automatically after configurable timeout https://review.openstack.org/536295 | 21:53 |
| *** peterlisak has quit IRC | 21:54 | |
| *** onovy has quit IRC | 21:54 | |
| *** aeng has joined #openstack-infra | 21:55 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul master: Delete IncludeRole object from result object for include_role tasks https://review.openstack.org/543633 | 21:56 |
| openstackgerrit | Merged openstack-infra/system-config master: Support docker registry mirrors without URI https://review.openstack.org/542370 | 21:57 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/project-config master: Add a playbook for publishing javascript tarballs https://review.openstack.org/543234 | 21:58 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul master: Delete IncludeRole object from result object for include_role tasks https://review.openstack.org/543633 | 21:58 |
| openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Add building of openSUSE Tumbleweed nodepool images https://review.openstack.org/504169 | 21:58 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: zuul autohold: allow operator to specify nodes TTL https://review.openstack.org/543403 | 21:58 |
| dmsimard | Zuul meeting imminent in #openstack-meeting-alt | 21:59 |
| corvus | clarkb: do you have the ptg brainstorming etherpad handy? | 21:59 |
| *** felipemonteiro__ has joined #openstack-infra | 21:59 | |
| *** bobh has joined #openstack-infra | 22:00 | |
| fungi | corvus: https://etherpad.openstack.org/p/infra-rocky-ptg | 22:00 |
| fungi | (so sayeth my browser history) | 22:00 |
| corvus | fungi: aha, it was infra-ptg-queens last time. we changed it up. :) | 22:00 |
| fungi | i think it was made by a new ptl this time ;) | 22:01 |
| *** VW has quit IRC | 22:01 | |
| *** VW_ has joined #openstack-infra | 22:02 | |
| *** bobh has quit IRC | 22:04 | |
| *** trown is now known as trown|outtypewww | 22:05 | |
| *** bobh has joined #openstack-infra | 22:06 | |
| *** Sukhdev has joined #openstack-infra | 22:07 | |
| *** bobh has quit IRC | 22:07 | |
| *** bobh has joined #openstack-infra | 22:08 | |
| *** olaph1 has joined #openstack-infra | 22:09 | |
| *** olaph has quit IRC | 22:10 | |
| *** threestrands has joined #openstack-infra | 22:12 | |
| *** wolverineav has joined #openstack-infra | 22:12 | |
| *** ijw has quit IRC | 22:16 | |
| *** wolverineav has quit IRC | 22:18 | |
| *** wolverineav has joined #openstack-infra | 22:18 | |
| openstackgerrit | Merged openstack-infra/zuul master: Emit a warning when using unsafe public key url https://review.openstack.org/543206 | 22:18 |
| openstackgerrit | Merged openstack-infra/zuul master: Remove unused method checkoutLocalBranch https://review.openstack.org/543359 | 22:18 |
| *** ijw has joined #openstack-infra | 22:19 | |
| *** suhdood has joined #openstack-infra | 22:21 | |
| *** wolverineav has quit IRC | 22:23 | |
| *** jamesmcarthur has joined #openstack-infra | 22:26 | |
| *** felipemonteiro__ has quit IRC | 22:26 | |
| *** felipemonteiro__ has joined #openstack-infra | 22:26 | |
| *** hashar has quit IRC | 22:28 | |
| *** masber has quit IRC | 22:29 | |
| *** slaweq has quit IRC | 22:30 | |
| *** caphrim007_ has joined #openstack-infra | 22:31 | |
| *** rcernin has joined #openstack-infra | 22:31 | |
| *** caphrim007 has quit IRC | 22:34 | |
| *** wolverineav has joined #openstack-infra | 22:34 | |
| *** ihrachys has quit IRC | 22:35 | |
| *** suhdood has quit IRC | 22:38 | |
| *** wolverin_ has joined #openstack-infra | 22:41 | |
| *** wolverin_ has quit IRC | 22:42 | |
| *** wolverin_ has joined #openstack-infra | 22:42 | |
| *** Goneri has quit IRC | 22:42 | |
| *** wolverineav has quit IRC | 22:45 | |
| openstackgerrit | Merged openstack-infra/project-config master: Enable StoryBoard Use for Election Repo https://review.openstack.org/542528 | 22:45 |
| *** jlabarre has quit IRC | 22:51 | |
| *** katkapilatova has left #openstack-infra | 22:55 | |
| *** wolverin_ has quit IRC | 22:55 | |
| *** felipemonteiro_ has joined #openstack-infra | 22:57 | |
| *** jamesmca_ has joined #openstack-infra | 22:59 | |
| *** jamesmcarthur has quit IRC | 23:00 | |
| *** signed8b_ has joined #openstack-infra | 23:01 | |
| *** felipemonteiro__ has quit IRC | 23:01 | |
| *** slaweq has joined #openstack-infra | 23:02 | |
| *** aeng has quit IRC | 23:03 | |
| *** jamesmcarthur has joined #openstack-infra | 23:03 | |
| *** signed8bit has quit IRC | 23:04 | |
| *** ramishra has quit IRC | 23:05 | |
| *** rosmaita has quit IRC | 23:07 | |
| *** jamesmca_ has quit IRC | 23:07 | |
| *** slaweq has quit IRC | 23:07 | |
| openstackgerrit | Merged openstack-infra/storyboard master: Update Development & Migration Docs https://review.openstack.org/539723 | 23:09 |
| *** wolverineav has joined #openstack-infra | 23:12 | |
| openstackgerrit | Merged openstack-infra/project-config master: Only run openstack tox jobs on ara master branch https://review.openstack.org/543503 | 23:14 |
| *** wolverineav has quit IRC | 23:15 | |
| *** wolverineav has joined #openstack-infra | 23:15 | |
| dmsimard | infra-root: Are new gerrit groups created in the Gerrit UI ? TripleO would like a third party CI group to allow voting from a third party CI. | 23:19 |
| clarkb | no they are created by adding acls that use them | 23:19 |
| clarkb | jeepyb will create the grouos before applying acls if they dont already exist | 23:20 |
| *** Sukhdev has quit IRC | 23:20 | |
| dmsimard | clarkb: ah, so we send a patch to adjust the ACL -- give it a (hopefully unique) name and it'll be created. Magic. | 23:20 |
| *** aeng has joined #openstack-infra | 23:20 | |
| dmsimard | EmilienM: ^ | 23:20 |
| *** aviau has quit IRC | 23:20 | |
| *** wolverin_ has joined #openstack-infra | 23:20 | |
| *** aviau has joined #openstack-infra | 23:21 | |
| EmilienM | dmsimard: ok so project-config... doing it now | 23:21 |
| *** wolverineav has quit IRC | 23:21 | |
| fungi | yeah, not so much magic as rube-goldburg-esque levels of automated contraption in jeepyb | 23:24 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: Create tripleo-ci group in Gerrit https://review.openstack.org/543654 | 23:24 |
| fungi | er, rube-goldberg-esque | 23:24 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove intree jobs for openstack/windmill https://review.openstack.org/542993 | 23:25 |
| *** wolverin_ has quit IRC | 23:25 | |
| *** wolverineav has joined #openstack-infra | 23:26 | |
| *** wolverineav has quit IRC | 23:26 | |
| *** wolverineav has joined #openstack-infra | 23:27 | |
| *** wolverin_ has joined #openstack-infra | 23:29 | |
| *** wolverin_ has quit IRC | 23:29 | |
| *** wolverin_ has joined #openstack-infra | 23:30 | |
| *** bobh has quit IRC | 23:32 | |
| *** Sukhdev has joined #openstack-infra | 23:32 | |
| *** wolverineav has quit IRC | 23:33 | |
| *** claudiub has quit IRC | 23:34 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add abstract job attribute https://review.openstack.org/543619 | 23:36 |
| *** eroux has quit IRC | 23:38 | |
| *** signed8b_ is now known as signed8bit_Zzz | 23:39 | |
| *** wolverin_ has quit IRC | 23:42 | |
| *** wolverineav has joined #openstack-infra | 23:42 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: Create tripleo-ci-thirdparty group in Gerrit https://review.openstack.org/543654 | 23:43 |
| *** wolverineav has quit IRC | 23:43 | |
| *** wolverineav has joined #openstack-infra | 23:43 | |
| *** VW has joined #openstack-infra | 23:46 | |
| *** VW has quit IRC | 23:48 | |
| *** VW has joined #openstack-infra | 23:48 | |
| *** wolverineav has quit IRC | 23:48 | |
| *** VW_ has quit IRC | 23:48 | |
| *** olaph has joined #openstack-infra | 23:50 | |
| *** olaph1 has quit IRC | 23:52 | |
| *** VW_ has joined #openstack-infra | 23:52 | |
| *** felipemonteiro_ has quit IRC | 23:53 | |
| *** wolverineav has joined #openstack-infra | 23:54 | |
| *** abelur has quit IRC | 23:54 | |
| *** aeng has quit IRC | 23:54 | |
| *** aeng has joined #openstack-infra | 23:55 | |
| *** VW has quit IRC | 23:55 | |
| *** VW_ has quit IRC | 23:57 | |
| *** rossella_s has quit IRC | 23:57 | |
| tonyb | So um ansible experts what's the closest to the following python I can do in "ansiable": {'x86_64': 'amd64'}.get(ansible_machine, ansible_machine) | 23:58 |
| tonyb | 'cause architecture names are hard and we seem doomed to keep confusing them | 23:58 |
| *** wolverineav has quit IRC | 23:59 | |
| clarkb | tonyb: you want to convert the ansible fact value to the distro specific terminology? | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!