*** gyee has quit IRC | 00:00 | |
*** jamesmcarthur has quit IRC | 00:03 | |
ianw | anyone want to suggest why the "when:" statement for only including the file on centos & debian didn't trigger properly in http://logs.openstack.org/35/589335/10/check/openstack-infra-base-integration-fedora-latest/9470852/ara-report/ ? | 00:04 |
---|---|---|
*** bobh has joined #openstack-infra | 00:04 | |
*** bobh has quit IRC | 00:08 | |
*** bobh has joined #openstack-infra | 00:09 | |
*** r-daneel has quit IRC | 00:10 | |
scas | my gut says old syntax | 00:11 |
ianw | for extra weirdness, here's the same thing from a prior run where it seem sto be skipped correctly -> http://logs.openstack.org/35/589335/10/check/openstack-infra-base-integration-fedora-27/f6259d3/ara-report/ | 00:12 |
*** zhurong has joined #openstack-infra | 00:12 | |
*** bobh has quit IRC | 00:13 | |
scas | when: "'{{ ansible_os_family }}' == 'Debian' and [...]" is what my non-ansible ways seem to conjure up | 00:13 |
ianw | when should be a raw jinja2 expression, so no braces etc | 00:15 |
scas | i didn't say i knew ansible well :) | 00:17 |
*** dingyichen has joined #openstack-infra | 00:22 | |
*** dhill_ has joined #openstack-infra | 00:28 | |
*** xarses_ has joined #openstack-infra | 00:29 | |
*** dhill_ has quit IRC | 00:29 | |
*** dhill_ has joined #openstack-infra | 00:29 | |
*** jesusaur has quit IRC | 00:42 | |
*** kei-ichi has quit IRC | 00:47 | |
*** kei-ichi has joined #openstack-infra | 00:49 | |
*** dhill_ has quit IRC | 00:49 | |
openstackgerrit | Wei Tie proposed openstack-dev/pbr master: Support subdirectory in the url https://review.openstack.org/590066 | 01:04 |
*** ddurst- is now known as ddurst | 01:04 | |
*** gagehugo_ has quit IRC | 01:07 | |
*** pbourke has quit IRC | 01:20 | |
*** pbourke has joined #openstack-infra | 01:22 | |
*** gagehugo has joined #openstack-infra | 01:22 | |
*** eumel8 has quit IRC | 01:24 | |
*** zhurong has quit IRC | 01:47 | |
*** yamamoto has joined #openstack-infra | 01:48 | |
*** yamamoto has quit IRC | 01:51 | |
*** xarses_ has quit IRC | 01:55 | |
*** SumitNaiksatam has joined #openstack-infra | 01:56 | |
*** mriedem has quit IRC | 02:08 | |
ianw | sight, 500 errors from github for a pull request | 02:15 |
*** jamesmcarthur has joined #openstack-infra | 02:21 | |
*** xe1gyq_ has joined #openstack-infra | 02:25 | |
xe1gyq_ | Hi :) | 02:25 |
xe1gyq_ | I am working in setting up OpenStack Documentation for StarlingX and I have some questions | 02:25 |
xe1gyq_ | I am not clear what is the official guideline about the structure of <project>/doc directory, does it need to include conf.py or not? Any place to see the latest documentation about the specific structure? | 02:26 |
xe1gyq_ | About the same <project>/doc structure, which could be a project that implements these latest guidelines on documentation stucture and build? | 02:27 |
*** Bhujay has joined #openstack-infra | 02:30 | |
*** Bhujay has quit IRC | 02:30 | |
*** Bhujay has joined #openstack-infra | 02:31 | |
*** zhurong has joined #openstack-infra | 02:34 | |
*** rmcallis has joined #openstack-infra | 02:39 | |
*** rmcall has quit IRC | 02:41 | |
*** dklyle has joined #openstack-infra | 02:46 | |
*** psachin has joined #openstack-infra | 02:47 | |
*** hongbin has joined #openstack-infra | 02:49 | |
*** Bhujay has quit IRC | 02:51 | |
*** bobh has joined #openstack-infra | 02:53 | |
*** bobh has quit IRC | 02:55 | |
*** rmcall has joined #openstack-infra | 02:56 | |
*** bobh has joined #openstack-infra | 02:56 | |
*** rmcallis has quit IRC | 02:57 | |
*** bobh has quit IRC | 02:57 | |
*** rosmaita has quit IRC | 03:04 | |
*** roman_g has quit IRC | 03:07 | |
*** bobh_ has joined #openstack-infra | 03:08 | |
*** bobh_ has quit IRC | 03:11 | |
jlv-sick | Are POST_FAILUREs a known issue at the moment? | 03:17 |
jlv-sick | I've gotten them twice in two runs over the last 4 hours or so: https://review.openstack.org/547132 | 03:17 |
*** ykarel has joined #openstack-infra | 03:21 | |
*** jamesmcarthur has quit IRC | 03:30 | |
*** dhill_ has joined #openstack-infra | 03:35 | |
*** ramishra has joined #openstack-infra | 03:36 | |
*** jesusaur has joined #openstack-infra | 03:38 | |
*** ykarel_ has joined #openstack-infra | 03:38 | |
*** ykarel has quit IRC | 03:40 | |
*** dhill_ has quit IRC | 03:40 | |
*** hongbin has quit IRC | 03:41 | |
*** dklyle has quit IRC | 03:42 | |
*** dhill_ has joined #openstack-infra | 03:43 | |
*** bobh_ has joined #openstack-infra | 03:44 | |
*** zhurong has quit IRC | 03:53 | |
*** ykarel__ has joined #openstack-infra | 03:54 | |
*** ykarel_ has quit IRC | 03:56 | |
*** janki has joined #openstack-infra | 03:57 | |
*** hemna_ has quit IRC | 03:57 | |
*** larainema has joined #openstack-infra | 03:58 | |
*** ykarel__ is now known as ykarel | 03:59 | |
*** bobh_ has quit IRC | 04:01 | |
*** e0ne has joined #openstack-infra | 04:11 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: executor: enable inventory to be updated with zuul_return https://review.openstack.org/590092 | 04:12 |
ianw | xe1gyq_: i'd imagine it will require a conf.py | 04:14 |
ianw | jlv-sick: hrrm, all in the applytests? | 04:16 |
*** jamesmcarthur has joined #openstack-infra | 04:22 | |
*** e0ne has quit IRC | 04:24 | |
openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Revert "Remove unneeded required projects" https://review.openstack.org/590054 | 04:25 |
*** jamesmcarthur has quit IRC | 04:26 | |
xe1gyq_ | ianw: here you go https://review.openstack.org/#/c/590094/ | 04:32 |
*** Bhujay has joined #openstack-infra | 04:32 | |
*** Bhujay has quit IRC | 04:34 | |
*** markvoelker has joined #openstack-infra | 04:41 | |
*** apetrich has joined #openstack-infra | 04:42 | |
openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: [WIP] openafs client install https://review.openstack.org/589335 | 04:43 |
*** jesusaur has quit IRC | 04:46 | |
*** jesusaur has joined #openstack-infra | 04:48 | |
*** xarses_ has joined #openstack-infra | 04:48 | |
openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: [WIP] openafs client install https://review.openstack.org/589335 | 05:01 |
*** udesale has joined #openstack-infra | 05:06 | |
*** nicolasbock has joined #openstack-infra | 05:34 | |
*** eumel8 has joined #openstack-infra | 05:36 | |
*** hwoarang has joined #openstack-infra | 05:41 | |
openstackgerrit | Wei Tie proposed openstack-dev/pbr master: Support subdirectory in the url https://review.openstack.org/590066 | 05:43 |
*** AJaeger has quit IRC | 06:16 | |
*** quiquell has joined #openstack-infra | 06:19 | |
*** AJaeger has joined #openstack-infra | 06:19 | |
*** Emine has joined #openstack-infra | 06:28 | |
*** hamzy_ has quit IRC | 06:29 | |
*** hamzy_ has joined #openstack-infra | 06:29 | |
*** gbutnaru_ has quit IRC | 06:32 | |
*** nicolasbock has quit IRC | 06:35 | |
*** pcaruana has joined #openstack-infra | 06:38 | |
*** nicolasbock has joined #openstack-infra | 06:41 | |
*** gbutnaru_ has joined #openstack-infra | 06:45 | |
*** udesale has quit IRC | 06:54 | |
*** evrardjp has joined #openstack-infra | 06:54 | |
*** ccamacho has joined #openstack-infra | 06:58 | |
*** udesale has joined #openstack-infra | 06:58 | |
*** stakeda has joined #openstack-infra | 07:06 | |
*** yamamoto has joined #openstack-infra | 07:11 | |
*** ginopc has joined #openstack-infra | 07:11 | |
*** Bhujay has joined #openstack-infra | 07:16 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Revert "Revert "Remove unneeded required projects"" https://review.openstack.org/590142 | 07:16 |
*** rcernin has quit IRC | 07:16 | |
*** amoralej|off is now known as amoralej | 07:19 | |
*** holser_ has joined #openstack-infra | 07:20 | |
holser_ | Good morning | 07:20 |
holser_ | Can anyone help me with 587982 ... it's stuck on gating ... at least according to http://zuul.openstack.org | 07:21 |
holser_ | Thanks | 07:21 |
*** Bhujay has quit IRC | 07:22 | |
*** dpawlik has joined #openstack-infra | 07:22 | |
*** yamamoto has quit IRC | 07:22 | |
dirk | here: could you please review https://review.openstack.org/#/c/589007 - it is blocking py36 jobs on global requirements repo | 07:22 |
AJaeger | holser_: we merge in order - and that one is in a queue, so 588619 needs to merge first etc. | 07:22 |
AJaeger | dirk: this is not slack ;) | 07:23 |
holser_ | Thanks AJaeger | 07:23 |
AJaeger | dirk: better ask infra-root directly for a system-config change like yours | 07:23 |
holser_ | I'll keep my fingers crossed | 07:23 |
*** xarses_ has quit IRC | 07:23 | |
*** dpawlik has quit IRC | 07:24 | |
*** dpawlik has joined #openstack-infra | 07:24 | |
AJaeger | eumel8, corvus , tristanC lots of new translation imports, see https://review.openstack.org/#/q/status:open+topic:zanata/translations,n,z - thanks! | 07:24 |
*** ykarel has quit IRC | 07:36 | |
*** ykarel has joined #openstack-infra | 07:39 | |
dirk | AJaeger: It seems at least you have a slack-plugin installed ;) | 07:39 |
AJaeger | ;) | 07:40 |
*** Bhujay has joined #openstack-infra | 07:40 | |
*** xarses_ has joined #openstack-infra | 07:42 | |
eumel8 | AJaeger, corvus , tristanC: yes, thanks also from my side. Now we are back in service just in time R3 | 07:42 |
tristanC | excellent, glad we fixed this :-) | 07:43 |
*** jpena|off is now known as jpena | 07:50 | |
openstackgerrit | Merged openstack-infra/puppet-statusbot master: Have the 'statusbot' service subscribe to the pip install https://review.openstack.org/547132 | 07:51 |
*** tosky has joined #openstack-infra | 07:52 | |
*** udesale has quit IRC | 07:53 | |
*** xarses_ has quit IRC | 07:58 | |
openstackgerrit | Thierry Carrez proposed openstack-infra/irc-meetings master: Added Cyborg Team Meeting https://review.openstack.org/589971 | 08:05 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Support job pause https://review.openstack.org/585389 | 08:07 |
tosky | can anyone please fix the channel topic on #openstack-interop? It seems to be stuck on "(Meeting topic: maintenance)" for 10 days | 08:11 |
*** lucasagomes has joined #openstack-infra | 08:12 | |
AJaeger | tosky: what should the topic be? | 08:17 |
*** jpich has joined #openstack-infra | 08:19 | |
tosky | AJaeger: uh, good question, let me dig the previous topics | 08:19 |
AJaeger | thanks, tosky - couldn't find it quickly myself ;( | 08:19 |
*** dulek has joined #openstack-infra | 08:20 | |
*** udesale has joined #openstack-infra | 08:24 | |
tosky | AJaeger: I suspect I will have to wait for the cores to show up | 08:24 |
*** dtantsur|afk is now known as dtantsur | 08:33 | |
frickler | tosky: AJaeger: I've set the topic to the latest I found in the logs on eavesdrop, let me know if you need a different one | 08:34 |
*** janki has quit IRC | 08:36 | |
tosky | frickler: wow, you went back a lot | 08:37 |
tosky | or I missed it (I checked June and July) | 08:38 |
tosky | thanks, I will ask | 08:38 |
frickler | tosky: yeah, that was from march. didn't matter much for "wget -r", though ;) | 08:40 |
tosky | ah, direct access to the logs :P | 08:41 |
cgoncalves | could someone please review https://review.openstack.org/#/c/588676/? it is required in order to verify SSL certificates when e.g. fetching RPM repo metadata, otherwise jobs fail | 08:44 |
cgoncalves | we detected this in octavia when changed the nodeset to centos7. job would fail when fetching metadata from EPEL repo | 08:44 |
*** priteau has quit IRC | 08:47 | |
*** priteau has joined #openstack-infra | 08:47 | |
quiquell | zuul question, can we have a Depends-On in the same project if we are not reparenting ? | 08:50 |
openstackgerrit | Merged openstack-infra/system-config master: Remove references to stackalytics.o.o https://review.openstack.org/585208 | 08:50 |
AJaeger | frickler: thanks! | 08:54 |
quiquell | jrist: Are you there ? have a tht question | 08:56 |
tosky | quiquell: it should work (Depends-On on the same project) | 08:56 |
quiquell | tosky: Cool thanks, | 08:57 |
quiquell | Ups wrong channel with the tht quesiton | 08:57 |
*** pbourke has quit IRC | 09:08 | |
*** ykarel is now known as ykarel|lunch | 09:11 | |
*** electrofelix has joined #openstack-infra | 09:11 | |
*** janki has joined #openstack-infra | 09:15 | |
*** pbourke has joined #openstack-infra | 09:16 | |
*** dingyichen has quit IRC | 09:16 | |
*** ykarel|lunch is now known as ykarel|mtg | 09:30 | |
*** derekh has joined #openstack-infra | 09:35 | |
*** dpawlik has quit IRC | 09:39 | |
*** dpawlik has joined #openstack-infra | 09:41 | |
*** gfidente has joined #openstack-infra | 09:42 | |
*** ykarel_ has joined #openstack-infra | 09:42 | |
*** ykarel|mtg has quit IRC | 09:44 | |
*** dpawlik has quit IRC | 09:45 | |
*** rakhmerov has joined #openstack-infra | 09:48 | |
*** dpawlik has joined #openstack-infra | 09:49 | |
*** neiljerram has joined #openstack-infra | 09:55 | |
*** Emine has quit IRC | 10:04 | |
*** Emine has joined #openstack-infra | 10:04 | |
*** ykarel_ has quit IRC | 10:06 | |
openstackgerrit | Merged openstack-infra/irc-meetings master: Added Cyborg Team Meeting https://review.openstack.org/589971 | 10:09 |
openstackgerrit | Merged openstack/diskimage-builder master: Install ca-certificate with redhat-common https://review.openstack.org/588676 | 10:11 |
*** ykarel has joined #openstack-infra | 10:14 | |
*** claudiub has joined #openstack-infra | 10:18 | |
*** stakeda has quit IRC | 10:26 | |
openstackgerrit | Markus Hosch proposed openstack-infra/nodepool master: Add list of metrics provided to statsd https://review.openstack.org/590233 | 10:31 |
*** dhill_ has quit IRC | 10:51 | |
openstackgerrit | Slawek Kaplonski proposed openstack-infra/project-config master: Clean Neutron failure rates Grafana dashboard https://review.openstack.org/590239 | 10:53 |
*** ansmith has quit IRC | 10:56 | |
*** amoralej is now known as amoralej|lunch | 11:01 | |
*** jpena is now known as jpena|lunch | 11:01 | |
*** holser_ has quit IRC | 11:06 | |
*** snapiri has quit IRC | 11:25 | |
*** snapiri has joined #openstack-infra | 11:25 | |
*** sambetts|afk has quit IRC | 11:29 | |
*** agopi has quit IRC | 11:31 | |
*** bobh_ has joined #openstack-infra | 11:31 | |
*** annp has quit IRC | 11:42 | |
*** agopi has joined #openstack-infra | 11:49 | |
*** rh-jelabarre has joined #openstack-infra | 11:52 | |
*** yamamoto has joined #openstack-infra | 11:57 | |
*** jpena|lunch is now known as jpena | 11:58 | |
*** boden has joined #openstack-infra | 12:01 | |
*** dhill_ has joined #openstack-infra | 12:06 | |
*** eharney has quit IRC | 12:17 | |
openstackgerrit | Michel Peterson proposed openstack-infra/project-config master: [n-odl] Make the Y axis display correctly https://review.openstack.org/590275 | 12:19 |
*** trown|outtypewww is now known as trown | 12:22 | |
*** jamesmcarthur has joined #openstack-infra | 12:23 | |
openstackgerrit | Slawek Kaplonski proposed openstack-infra/project-config master: Clean Neutron failure rates Grafana dashboard https://review.openstack.org/590239 | 12:25 |
*** jamesmcarthur has quit IRC | 12:27 | |
*** lathiat_ has quit IRC | 12:30 | |
*** lathiat has joined #openstack-infra | 12:31 | |
*** rosmaita has joined #openstack-infra | 12:32 | |
openstackgerrit | Merged openstack-infra/nodepool master: Bump minimum openstacksdk version to 0.17.2 https://review.openstack.org/589563 | 12:35 |
pabelanger | ianw: we don't seem to be tracking FIP task in grafana.o.o now for nodepool any more. For example: stats.nodepool.task.packethost-us-west-1.NetworkGetPorts | 12:37 |
*** oanson has joined #openstack-infra | 12:42 | |
*** tpsilva has joined #openstack-infra | 12:44 | |
*** edmondsw has joined #openstack-infra | 12:45 | |
*** ansmith has joined #openstack-infra | 12:47 | |
*** ianychoi has quit IRC | 12:49 | |
*** kgiusti has joined #openstack-infra | 12:54 | |
openstackgerrit | Mike Kolesnik proposed openstack-infra/project-config master: Remove Networking-ODL fullstack from grafana https://review.openstack.org/590305 | 12:56 |
tosky | not sure if it's an infra question but I think you know when: are stable branches creates during RC1? (this week for Rocky) | 12:56 |
*** quiquell has quit IRC | 12:58 | |
*** eharney has joined #openstack-infra | 12:58 | |
*** ramishra has quit IRC | 12:59 | |
mordred | tosky: I believe stable branches are cut for a project when it cuts its rc1 | 13:01 |
mordred | tosky: but I don't actually know | 13:01 |
*** amoralej|lunch is now known as amoralej | 13:02 | |
*** jamesmcarthur has joined #openstack-infra | 13:02 | |
tosky | ack, thanks | 13:02 |
*** sthussey has joined #openstack-infra | 13:06 | |
*** ramishra has joined #openstack-infra | 13:08 | |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Remove old inactive users https://review.openstack.org/588553 | 13:08 |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Set mgmt_hieradata variable for bridge.openstack.org https://review.openstack.org/588627 | 13:08 |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Use a when clause to make skip work with first_found https://review.openstack.org/589963 | 13:08 |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add exim role to base playbook https://review.openstack.org/589964 | 13:08 |
*** holser_ has joined #openstack-infra | 13:12 | |
openstackgerrit | Merged openstack-infra/openstackid master: Fix 400 error on auth code grant https://review.openstack.org/589997 | 13:23 |
*** mriedem has joined #openstack-infra | 13:24 | |
*** jcoufal has joined #openstack-infra | 13:27 | |
*** jcoufal_ has joined #openstack-infra | 13:28 | |
*** edmondsw has quit IRC | 13:29 | |
*** yamamoto has quit IRC | 13:31 | |
*** jcoufal has quit IRC | 13:31 | |
*** apetrich has quit IRC | 13:34 | |
AJaeger | tosky: ask on #openstack-release | 13:35 |
*** gbutnaru_ is now known as gbutnaru | 13:36 | |
*** edmondsw has joined #openstack-infra | 13:37 | |
*** jistr is now known as jistr|call | 13:39 | |
*** edmondsw has quit IRC | 13:41 | |
*** ccamacho has quit IRC | 13:44 | |
*** ccamacho has joined #openstack-infra | 13:44 | |
*** bobh_ has quit IRC | 13:44 | |
*** eharney has quit IRC | 13:45 | |
*** ykarel is now known as ykarel|away | 13:46 | |
openstackgerrit | Monty Taylor proposed openstack-infra/puppet-openstack_infra_spec_helper master: Run ansible base playbook for puppet tests https://review.openstack.org/588326 | 13:46 |
*** ccamacho has quit IRC | 13:48 | |
*** edmondsw has joined #openstack-infra | 13:48 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: executor: enable inventory to be updated with zuul_return https://review.openstack.org/590092 | 13:49 |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: executor: add support for generic build resource https://review.openstack.org/570668 | 13:49 |
*** eharney has joined #openstack-infra | 13:49 | |
openstackgerrit | Merged openstack-infra/project-config master: Adding tobiko to the project list https://review.openstack.org/588963 | 13:51 |
*** boden has quit IRC | 13:52 | |
*** ykarel|away has quit IRC | 13:53 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement an OpenShift resource provider https://review.openstack.org/570667 | 13:53 |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement an OpenShift Pod provider https://review.openstack.org/590335 | 13:53 |
*** apetrich has joined #openstack-infra | 13:54 | |
*** jistr|call is now known as jistr | 13:59 | |
*** apetrich has quit IRC | 14:01 | |
*** amotoki_ is now known as amotoki | 14:01 | |
openstackgerrit | Monty Taylor proposed openstack-infra/ansible-role-puppet master: Update yaml style to be consistent with infra yaml https://review.openstack.org/590338 | 14:07 |
openstackgerrit | Monty Taylor proposed openstack-infra/puppet-openstack_infra_spec_helper master: Run ansible base playbook for puppet tests https://review.openstack.org/588326 | 14:19 |
mordred | cmurphy, clarkb: I made https://review.openstack.org/#/c/588553/ depends-on https://review.openstack.org/#/c/588326/ - and am looking at the runs in the system-config patch to make sure it's running ansible correctly | 14:20 |
cmurphy | yay testing | 14:20 |
mordred | ikr? | 14:20 |
*** ccamacho has joined #openstack-infra | 14:25 | |
*** ccamacho has quit IRC | 14:25 | |
*** ccamacho has joined #openstack-infra | 14:26 | |
*** hongbin has joined #openstack-infra | 14:41 | |
*** rpioso|afk is now known as rpioso | 14:42 | |
*** dtantsur is now known as dtantsur|brb | 14:43 | |
fungi | wow, looking through the etherpad-lite develop branch, they've seriously doubled down on improving their testing recently | 14:44 |
pabelanger | AJaeger: mind a +3 on https://review.openstack.org/588388/ to remove old fedora-27 job. needed for removal of fedora-27 DIB in nodepool | 14:44 |
AJaeger | pabelanger: done | 14:46 |
*** ginopc has quit IRC | 14:47 | |
fungi | infra-root: i've restarted the etherpad-lite service on etherpad-dev.o.o, currently at commit 10f0cb3 (head of the develop branch). this includes 58c3154 which should fix the bullet list authorship attribution issue, but testing is warranted. if they don't tag a release in the next couple weeks, i propose we upgrade etherpad.o.o to this commit a week before the ptg | 14:50 |
*** ginopc has joined #openstack-infra | 14:51 | |
*** priteau has quit IRC | 14:52 | |
pabelanger | AJaeger: thanks | 14:53 |
fungi | https://etherpad-dev.openstack.org/p/things in case anybody wants to help test the bullet list authorship problem is solved | 14:53 |
openstackgerrit | Merged openstack-infra/project-config master: Remove legacy-tempest-dsvm-neutron-full-fedora-27 job https://review.openstack.org/588388 | 14:55 |
*** ginopc has quit IRC | 14:58 | |
*** ginopc has joined #openstack-infra | 14:58 | |
pabelanger | clarkb: corvus: catching up after a few days of leave, is there a check list of things to do before migrating logs to swift for zuul.o.o? | 15:01 |
mordred | pabelanger: we need to remember to run around in a circle waving our arms in the air and screaming | 15:02 |
pabelanger | :) | 15:02 |
*** Swami has joined #openstack-infra | 15:03 | |
*** janki has quit IRC | 15:03 | |
openstackgerrit | Monty Taylor proposed openstack-infra/puppet-openstack_infra_spec_helper master: Run ansible base playbook for puppet tests https://review.openstack.org/588326 | 15:03 |
openstackgerrit | Frank Kloeker proposed openstack-infra/project-config master: Setup missing translation jobs for neutron-lbaas-dashboard https://review.openstack.org/590364 | 15:04 |
pabelanger | config-core: could I get a +3 on https://review.openstack.org/581117/ moving forward with using fedora-latest over fedora-27 | 15:10 |
*** hwoarang has quit IRC | 15:12 | |
mordred | pabelanger: done | 15:14 |
clarkb | mordred: pabelanger I think its mostly just getting the last little details like icons working and restarting all the logstash workers | 15:17 |
clarkb | then the arm flailing happens after we switch :) | 15:18 |
mordred | so much arms. all the flailing | 15:18 |
*** ginux has joined #openstack-infra | 15:20 | |
mordred | clarkb: fwiw, my next step on bridge is to test running remote puppet from there to something - probably review-dev ... | 15:20 |
pabelanger | okay cool, I'm happy to volunteer for the effort. Some discussion now of also trying the new swift upload of logs in rdoproject, after it's been done upstream here | 15:20 |
clarkb | mordred: that is a good candidate, non trivial puppet but also dev server :) | 15:20 |
mordred | but I'm iterating on getting the integration testing in the gate to grok the base playbook first | 15:20 |
*** ginux is now known as Guest8458 | 15:20 | |
*** ginopc has quit IRC | 15:20 | |
*** Guest8458 is now known as ginopc | 15:20 | |
mordred | I*think* that's almost working - so once it is I'll bang on that a bit more | 15:21 |
*** Bhujay has quit IRC | 15:21 | |
mordred | pabelanger: sweet! | 15:21 |
openstackgerrit | Witold Bedyk proposed openstack-infra/project-config master: Remove openstack-python35-jobs for monasca-api https://review.openstack.org/590387 | 15:22 |
*** jcoufal_ has quit IRC | 15:24 | |
fungi | https://78.media.tumblr.com/55e743a6c14ecf989ac7a8f744e58582/tumblr_n3kfmpZxcG1srkiv2o1_400.gif | 15:26 |
fungi | (kermit arms) | 15:26 |
openstackgerrit | Merged openstack-infra/project-config master: Gate zuul-job on fedora-latest https://review.openstack.org/581117 | 15:27 |
mordred | fungi: that was dangerously close to you adopting the millenial approach of communicating via gifs and emjoi | 15:29 |
mordred | fungi: you didn't secret go get a snapchat account did you? | 15:29 |
*** dtantsur|brb is now known as dtantsur | 15:29 | |
*** ccamacho has quit IRC | 15:29 | |
*** jcoufal has joined #openstack-infra | 15:30 | |
clarkb | I dunno I'm catching up on email and fungi is replying to people inline using text. Not sure the snapchat bug has quite gotten to fungi yet | 15:32 |
AJaeger | clarkb, pabelanger, could you look together at https://review.openstack.org/563790 and https://review.openstack.org/586639 - and decide which one to use? Those are in conflict and are different approaches. | 15:33 |
mordred | ok. cool. I didn't want to have to completley reassess my view of reality | 15:33 |
*** ginopc has quit IRC | 15:33 | |
fungi | yeah, i also still don't top-post, do people top-post on snapchat? | 15:36 |
corvus | pabelanger: re swift logs -- we need to verify that the new log processor is working, finish the icon support, and update the playbook to run the htmlify role. | 15:36 |
clarkb | AJaeger: pabelanger had updated one of my related changes to make the reordering there as well. I think we can probably abandon his change above as long as we get the log inventory stack in? | 15:36 |
clarkb | AJaeger: pabelanger https://review.openstack.org/#/c/563789/ is the change, looks like it may need a rebase though? | 15:36 |
mordred | fungi: I think the answer is "bouncing emoji face" | 15:37 |
fungi | ahh | 15:37 |
*** priteau has joined #openstack-infra | 15:37 | |
mordred | fungi: but I might be wrong, and it might be "poop emoji" - I really don't know | 15:37 |
*** ginopc has joined #openstack-infra | 15:38 | |
fungi | i thought that one was just a common glyph at a particular unicode codepoint | 15:39 |
*** dklyle has joined #openstack-infra | 15:39 | |
mordred | fungi: as are we all | 15:42 |
AJaeger | pabelanger: want to update (see clarkb's comment above)? Could you together propose the way forward, please? | 15:44 |
*** psachin has quit IRC | 15:44 | |
openstackgerrit | Wei Tie proposed openstack-dev/pbr master: Support subdirectory in the url https://review.openstack.org/590066 | 15:45 |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Use log-inventory in base jobs https://review.openstack.org/563789 | 15:47 |
pabelanger | AJaeger: done | 15:47 |
AJaeger | pabelanger: so, we can merge 563789 now? Good, will +2A then... | 15:50 |
pabelanger | AJaeger: actually, let me find a job log first and link it | 15:51 |
pabelanger | just to confirm it is working | 15:51 |
AJaeger | pabelanger: ok, will +2 - and let you +A | 15:51 |
AJaeger | pabelanger: so, do we still need https://review.openstack.org/#/c/586639/1/roles/validate-host/tasks/main.yaml ? https://review.openstack.org/#/c/563790/1/roles/validate-host/tasks/main.yaml removes that line | 15:52 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: DMN - testing base-test https://review.openstack.org/590407 | 15:53 |
pabelanger | AJaeger: nope, I'll drop | 15:54 |
pabelanger | AJaeger: clarkb: https://review.openstack.org/588387/ removed fedora-27 job that is no longer used | 15:55 |
* dtantsur watches more and more people leaving their passwords in #openstack-unregistered.. :( | 15:55 | |
*** roman_g has joined #openstack-infra | 15:57 | |
corvus | hrm. we could make it so that the channel is muted and only ops see messages | 15:58 |
*** SumitNaiksatam has quit IRC | 15:59 | |
Shrews | corvus: i was about to suggest that | 15:59 |
*** dklyle has quit IRC | 15:59 | |
corvus | we could also have a bot autorespond when people join | 15:59 |
*** ykarel|away has joined #openstack-infra | 16:00 | |
corvus | also "quiet unregistered users" "+q $~a" would be an option | 16:01 |
*** dklyle has joined #openstack-infra | 16:01 | |
*** jpena is now known as jpena|off | 16:07 | |
*** jpich has quit IRC | 16:08 | |
*** Bhujay has joined #openstack-infra | 16:08 | |
*** ginopc has quit IRC | 16:09 | |
*** holser_ has quit IRC | 16:12 | |
*** derekh has quit IRC | 16:14 | |
openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Delete legacy-tempest-dsvm-neutron-full-fedora-27 https://review.openstack.org/588387 | 16:15 |
openstackgerrit | Markus Hosch proposed openstack-infra/nodepool master: Add metric for image build result https://review.openstack.org/590412 | 16:16 |
openstackgerrit | Jill Rouleau proposed openstack-infra/project-config master: Add release jobs to ansible-role-tripleo-* https://review.openstack.org/590045 | 16:24 |
clarkb | corvus: Shrews any idea if the spam attack persists? | 16:26 |
corvus | clarkb: not offhand. i'd be supportive of turning off +r here to find out | 16:29 |
clarkb | corvus: wfm | 16:29 |
mordred | corvus, clarkb: I just added +R on myself on Sunday | 16:29 |
mordred | because the spam attack had spread to private messages | 16:29 |
mordred | but I am supportive of turning off +r to test it just to see | 16:30 |
corvus | well, that's not promising. maybe we should try later. | 16:30 |
clarkb | https://freenode.net/news/spam-shake is most recent update from freenode | 16:31 |
Shrews | topic in #freenode seems to suggest it is still ongoing | 16:31 |
clarkb | xe1gyq_: It is python sphinx documentation. You'll need whatever it is that sphinx needs to run | 16:35 |
clarkb | xe1gyq_: we don't really control any of that (and it could change over time if sphinx makes changes) | 16:35 |
*** hongbin has quit IRC | 16:37 | |
*** Swami has quit IRC | 16:37 | |
*** tosky has quit IRC | 16:39 | |
*** ykarel|away has quit IRC | 16:40 | |
*** armax has joined #openstack-infra | 16:47 | |
pabelanger | clarkb: AJaeger: I've +3 https://review.openstack.org/563789 after confirming log-inventory worked as expected | 16:48 |
*** ifat_afek has joined #openstack-infra | 16:50 | |
*** boden has joined #openstack-infra | 16:50 | |
clarkb | we appear to have leaked ports in packethost fwiw | 16:51 |
pabelanger | ah, was trying to figure out why it was deleting all the nodes | 16:51 |
clarkb | I am working to clean them out. In the past they have been the byproduct of other errors I think | 16:51 |
mordred | xe1gyq_, clarkb: well - we do have a slightly stricter approach than sphinx broadly | 16:51 |
clarkb | so will keep looking around to see if other errors are apparent | 16:52 |
clarkb | (maybe leaked fips too? | 16:52 |
mordred | xe1gyq_, clarkb: we require the doc directory to be called "doc" to have a "source" directory under that, for conf.py to be in doc/source - and we don't use any of the Makefiles that sphinx-quickstart generates | 16:53 |
openstackgerrit | Matt Riedemann proposed openstack-infra/irc-meetings master: Update the nova team meeting chair to melwitt https://review.openstack.org/590427 | 16:53 |
mriedem | melwitt: ^ | 16:53 |
clarkb | mordred: ah right, we need sphinx source content in doc/source but if sphinx wanted to call it sphinx_conf.py we wouldn't dictate that, they do right? | 16:53 |
clarkb | (its been a stable api, I don't expect it to change, but if you want to know what goes in a conf.py sphinx is your source for that info) | 16:54 |
*** agopi has quit IRC | 16:54 | |
mordred | clarkb: that's right | 16:54 |
mordred | clarkb: I would imagine if sphinx changed conf.py to something else a giant portion of the world would immediately break :) | 16:55 |
openstackgerrit | Merged openstack-infra/project-config master: Use log-inventory in base jobs https://review.openstack.org/563789 | 16:55 |
*** amoralej is now known as amoralej|off | 16:58 | |
clarkb | deleting ports is slow | 17:00 |
clarkb | I could probably parallelize it actually, but meh | 17:00 |
xe1gyq_ | ian: Thanks for your help! | 17:00 |
openstackgerrit | Markus Hosch proposed openstack-infra/nodepool master: Add metric for image build result https://review.openstack.org/590412 | 17:02 |
*** ramishra has quit IRC | 17:03 | |
clarkb | we don't appear to have leaked floating ips | 17:03 |
xe1gyq_ | clarkb: thanks! I have made the appropiate changes into the conf.py based in feedback, it seems I got confused looking around where conf.py is located | 17:03 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: WIP Map file comment line numbers https://review.openstack.org/590429 | 17:03 |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets / jobs https://review.openstack.org/588378 | 17:04 |
xe1gyq_ | mordred: thanks! I have removed the Makefile as part of the feedback obtained | 17:04 |
*** AhmadMahmoudi has joined #openstack-infra | 17:05 | |
clarkb | I think packethost has broken in such a way that we have servers in an error state due to their ports not existing or being found | 17:06 |
clarkb | issuing server delete against these servers directly doesn't seem to help | 17:07 |
clarkb | I don't think I've ever seen this failure mode before | 17:07 |
clarkb | mordred: ^ ring a bell for you? | 17:07 |
openstackgerrit | Adam Spiers proposed openstack-dev/specs-cookiecutter master: make tox docs environment follow PTI guidelines for sphinx build https://review.openstack.org/590436 | 17:10 |
clarkb | its like the inverse of a port leak, we lost the ports :/ | 17:12 |
*** AhmadMahmoudi has quit IRC | 17:14 | |
*** AhmadMahmoudi has joined #openstack-infra | 17:14 | |
mnaser | it should still be able to delete them | 17:16 |
*** jamesmcarthur has quit IRC | 17:16 | |
mnaser | because afaik it would be a noop if the ports dont exist | 17:16 |
pabelanger | clarkb: corvus: I can't seem to figure out why https://review.openstack.org/588378/ hasn't been enqueued into zuul.o.o, wondering if maybe a side affect of http API now? | 17:16 |
clarkb | mnaser: Unable to establish connection to http://localhost:8158/neutron/v2.0/ports.json?device_id=d31fef3b-5b91-4007-9f77-ff6c55d609b1: HTTPConnectionPool(host='localhost', port=8158): Max retries exceeded with url: /neutron/v2.0/ports.json?device_id=d31fef3b-5b9", u'code': 500 | 17:16 |
pabelanger | checking zuul debug logs now | 17:16 |
clarkb | mnaser: that is the error in the server record returned by server show | 17:17 |
clarkb | mriedem: ^ you may know if that is expected or not | 17:17 |
mnaser | clarkb: the compute node is misconfigured | 17:17 |
mnaser | or maybe platform9 does something weird | 17:17 |
*** xarses_ has joined #openstack-infra | 17:17 | |
mnaser | wait, it's returning 500 | 17:17 |
mnaser | so it's responding but with a 500.. on localhost.. on the compute node.. are you seeing that error in the 'fault' or 'error' section in the api? | 17:17 |
clarkb | mnaser: ya | 17:17 |
* mnaser has no idea what type of shenanigans they do... | 17:18 | |
clarkb | mnaser: fault | 17:18 |
mnaser | is neutron api responding publicly? | 17:18 |
clarkb | mnaser: ya we can boot other nodes and show ports that do seem to exist | 17:18 |
mnaser | clarkb: localized to a single compute node? | 17:18 |
clarkb | mnaser: that I don't know | 17:18 |
mnaser | hostId in the API will give you the answer | 17:18 |
clarkb | ok | 17:18 |
clarkb | pabelanger: only reporting back to gerrit is over https | 17:19 |
openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool master: Do not abort node launch if failed node cannot be deleted https://review.openstack.org/589854 | 17:19 |
clarkb | pabelanger: depends on loop maybe? | 17:19 |
pabelanger | clarkb: know more in a minute, looking at logs | 17:20 |
mriedem | clarkb: if that's server show, | 17:21 |
mriedem | it's from the api trying to get the port from neutron so we can get the related security groups for the port | 17:21 |
mriedem | "Max retries exceeded with url" is likely from ksa? | 17:21 |
mriedem | but my guess is neutron is overloaded? | 17:22 |
mriedem | server show wouldn't hit the compute node at all | 17:22 |
clarkb | mriedem: would you expect that to prevent the delete from going through? or is there likely omething else going on with the failed deletes? | 17:22 |
pabelanger | clarkb: corvus: looks like http 400 error from gerrit: http://paste.openstack.org/show/727754/ | 17:22 |
mriedem | didn't read far enough back about failed deletes, | 17:23 |
mriedem | but server delete will try to delete/unbind ports yeah | 17:23 |
*** udesale has quit IRC | 17:23 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: WIP Map file comment line numbers (alternate) https://review.openstack.org/590442 | 17:24 |
mriedem | someone did recently add a retry on the network teardown during server delete in the compute https://github.com/openstack/nova/commit/c6dda9f8064e0fcdf7ac85d08ed68554083be74b | 17:24 |
clarkb | mriedem: and if that fails the delete will fail? | 17:25 |
mriedem | but that's not released or on stable | 17:25 |
mriedem | clarkb: yeah | 17:25 |
clarkb | mnaser: initial sampling says different compute hosts | 17:25 |
corvus | pabelanger: look for 2 more attempts | 17:25 |
mriedem | we'll have killed the guest on the host by that point | 17:26 |
mnaser | mriedem: but the delete of port happens on the compute node, right? | 17:26 |
mriedem | but we'll raise before getting here https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L2629 | 17:26 |
mriedem | to delete the instance from the nova db | 17:26 |
clarkb | mriedem: ok, I don't think those ports exist anymore fwiw, so when trying to get them via device_id (the nova instance id) it fails, but I've not absolutely confirmed that yet | 17:26 |
corvus | pabelanger: oh! they're both going to fail, that's not a transient error | 17:26 |
mriedem | mnaser: when deleting the server, if the compute is up, yes | 17:26 |
pabelanger | corvus: yah, next 2 also fail | 17:26 |
openstackgerrit | Matthew Edmonds proposed openstack-infra/project-config master: Add readthedocs web hooks for powervm https://review.openstack.org/590444 | 17:26 |
*** studarus has joined #openstack-infra | 17:26 | |
mnaser | cause the compute is up and yet it's erroring failing to contact *localhost* | 17:26 |
mriedem | clarkb: we should get a 404 from neutron then, not a 500 | 17:26 |
mnaser | and contacting localhost and getting a 500 from it | 17:26 |
mriedem | then the compute is misconfigured | 17:26 |
mnaser | which is super weird | 17:26 |
pabelanger | corvus: checking docs to see what is bad with the request | 17:27 |
mnaser | i was just wondering *how* there is something listening at localhost on that port lol | 17:27 |
corvus | pabelanger: "file .zuul.yaml not found in revision 588378,6" | 17:27 |
mnaser | on compute node | 17:27 |
mriedem | also, when nova-compute tears down the ports, if they are already gone, we won't see them | 17:27 |
mriedem | https://github.com/openstack/nova/blob/master/nova/network/neutronv2/api.py#L1501 | 17:27 |
mriedem | and if we're racing, we'll ignore 404 https://github.com/openstack/nova/blob/master/nova/network/neutronv2/api.py#L1487 | 17:28 |
pabelanger | corvus: that is true, we don't have a .zuul.yaml file. only zuul.d/ files | 17:28 |
mriedem | i mean, you look up robust and you'll see nova in the dictionary amiright guys?!?!?!!? | 17:28 |
corvus | pabelanger: i see the problem | 17:28 |
clarkb | mriedem: mnaser: and hte confusion about localhost is that the compute process not api server or conductor etc is what calls out to neutron? | 17:28 |
mriedem | clarkb: if that is what is actually deleting the port yes, | 17:29 |
mriedem | but you were saying server show above so i was confused | 17:29 |
mnaser | i think he meant that after deleting the server, 'fault' was set to an exception with the 500 hitting neutron | 17:29 |
clarkb | mriedem: that is where I got the fault output | 17:29 |
mriedem | it is possible for nova-api to delete the ports if the compute service, on which the server is running, is down | 17:29 |
mriedem | clarkb: ah ok | 17:29 |
clarkb | mriedem: server delete returns no error but doesn't succeed | 17:29 |
mnaser | so nova-api is responding fine, its the 'fault' field that contains the exception | 17:29 |
mriedem | then the server delete rpc cast to compute | 17:29 |
clarkb | mnaser: yup | 17:29 |
mriedem | and compute failed | 17:29 |
mnaser | nova service-list should confirm if compute is up or down | 17:30 |
studarus | clarkb: not urgent but I've been seeing a higher than usual delete count and wanted to know if I should investgate | 17:30 |
pabelanger | corvus: ack | 17:30 |
pabelanger | thanks | 17:30 |
clarkb | studarus: ya I think it is a side effect of what we are discussing with mnaser and mriedem, we have a bunch of nodes in an error state that nodepool will try to frequently delete | 17:30 |
studarus | gotcha | 17:30 |
clarkb | studarus: it seems to be at least partially related to 500 errors when looking up ports | 17:31 |
studarus | So it is provider agnostic? | 17:31 |
clarkb | studarus: no this is packethost specific | 17:31 |
studarus | then I should investigate! | 17:32 |
clarkb | studarus: if I server show one of the packethost ERROR instances I get fault neutron returned 500 error on port lookup essentially | 17:32 |
clarkb | and deletes fail to actually delete | 17:32 |
clarkb | studarus: ok let me know if I can help provide more info | 17:33 |
*** gouthamr is now known as gouthamr_away | 17:37 | |
pabelanger | clarkb: when free, trying to figure out why we didn't re-run check jobs at: https://review.openstack.org/588415/ but went straight into gate with a recheck | 17:38 |
clarkb | pabelanger: because it was already +1 Verified | 17:38 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Scope config line comments to change https://review.openstack.org/590446 | 17:38 |
pabelanger | ah right | 17:39 |
corvus | pabelanger: ^ that should fix it | 17:39 |
corvus | i'm thinking about a test | 17:39 |
*** Bhujay has quit IRC | 17:39 | |
pabelanger | corvus: great | 17:45 |
clarkb | corvus: pabelanger so it was getting queued just not able to report back when jobs completed? I guess the error on ps6 was a clue to that since ps7 only updated commit msg | 17:46 |
corvus | yep | 17:46 |
openstackgerrit | Paul Belanger proposed openstack-infra/bindep master: Remove fedora-27 fallback job https://review.openstack.org/590450 | 17:47 |
*** gyee has joined #openstack-infra | 17:47 | |
*** mudpuppy has joined #openstack-infra | 17:48 | |
*** psachin has joined #openstack-infra | 17:51 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Scope config line comments to change https://review.openstack.org/590446 | 17:52 |
*** felipemonteiro has joined #openstack-infra | 17:52 | |
corvus | clarkb, pabelanger: ^ fix with tests | 17:52 |
clarkb | studarus: noticing that floating IP networking might also be unhappy (similar to when you decided to make a dedicated network node). Perhaps those two things are related | 17:52 |
openstackgerrit | Adam Spiers proposed openstack-dev/specs-cookiecutter master: make tox docs environment follow PTI guidelines for sphinx build https://review.openstack.org/590436 | 17:57 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Scope config line comments to change https://review.openstack.org/590446 | 17:59 |
corvus | clarkb, pabelanger: ^ sorry, pep8 error. should be gtg now | 17:59 |
*** SumitNaiksatam has joined #openstack-infra | 18:00 | |
*** gfidente has quit IRC | 18:05 | |
*** ifat_afek has quit IRC | 18:07 | |
*** agopi has joined #openstack-infra | 18:14 | |
fungi | clarkb: i see you're discussing packethost issues in here. studarus e-mailed you and me asking about the high delete count there | 18:15 |
fungi | ahh, he found you in here too | 18:15 |
*** priteau has quit IRC | 18:15 | |
* fungi is still catching up on scrollback after writing a particularly lengthy e-mail | 18:16 | |
studarus | I finallly defeated the IRC registration guardians... | 18:16 |
fungi | none shall pass! | 18:16 |
openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit master: Filter out link-local ipv6 address in loadbalancer https://review.openstack.org/576262 | 18:21 |
openstackgerrit | Merged openstack-infra/project-config master: Remove fedora-27 jobs https://review.openstack.org/588386 | 18:21 |
*** panda|ruck is now known as panda|ruck|off | 18:22 | |
*** dtantsur is now known as dtantsur|afk | 18:24 | |
*** trown is now known as trown|lunch | 18:26 | |
*** felipemonteiro has quit IRC | 18:30 | |
*** electrofelix has quit IRC | 18:31 | |
*** apetrich has joined #openstack-infra | 18:33 | |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Remove old inactive users https://review.openstack.org/588553 | 18:36 |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Set mgmt_hieradata variable for bridge.openstack.org https://review.openstack.org/588627 | 18:36 |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Use a when clause to make skip work with first_found https://review.openstack.org/589963 | 18:36 |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add exim role to base playbook https://review.openstack.org/589964 | 18:36 |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Split base playbook into two plays https://review.openstack.org/590478 | 18:36 |
studarus | One nova host is flakey. Spinning up a replacement. | 18:37 |
studarus | Nova services are reported down. | 18:38 |
clarkb | studarus: is that what was preventing the deletes from happening? | 18:38 |
mordred | cmurphy: darn all these pesky tests showing issues in what seemed fine! | 18:39 |
mordred | cmurphy: we should delete the tests, it would make it easier for me to land these patches ;) | 18:39 |
studarus | Well, it is a smoking gun but I can't say for certain. | 18:39 |
dhellmann | clarkb : I would like to add a topic to the infra agenda for the ptg. Is there an etherpad for that, yet? I don't see one on https://wiki.openstack.org/wiki/PTG/Stein/Etherpads | 18:39 |
*** jamesmcarthur has joined #openstack-infra | 18:39 | |
clarkb | dhellmann: https://etherpad.openstack.org/p/infra-ptg-denver-2018 I will add it to the wiki now | 18:40 |
dhellmann | clarkb : thanks | 18:40 |
cmurphy | mordred: we could land code so much faster! | 18:43 |
mordred | clarkb, corvus: https://review.openstack.org/#/c/588553 I updated it to add a comment about the uids - does that seem decent? | 18:44 |
clarkb | mordred: that wfm | 18:45 |
zxiiro | Is openstack meetbot maintained? we have a request to have it generate a symlink for the latest copy of the meeting minutes but seems like the project is maybe not really active so I dunno if it would be worth opening a feature request for it? | 18:50 |
*** owalsh has quit IRC | 18:50 | |
zxiiro | maybe I'll open one anyway just to have it logged. | 18:50 |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Fixed bug on track serialization https://review.openstack.org/590485 | 18:51 |
*** owalsh has joined #openstack-infra | 18:51 | |
fungi | zxiiro: we'd like to reimplement it in a more modern bot framework, so the incentive to keep dumping features in there has been lukewarm at best | 18:52 |
fungi | what's there is already forked from debian and then ubuntu i think, and not super maintainable | 18:53 |
openstackgerrit | Merged openstack-infra/openstackid-resources master: Fixed bug on track serialization https://review.openstack.org/590485 | 18:53 |
zxiiro | fungi: I would be interested in participating in such a bot framework if it was started. keep me posted. In the meantime I'll open a storyboard to remind me of this feature request. | 18:53 |
fungi | zxiiro: https://specs.openstack.org/openstack-infra/infra-specs/specs/irc.html is currently a "help wanted" category spec | 18:55 |
zxiiro | fungi: awesome, i starred that story, thanks! | 18:56 |
fungi | zxiiro: up side to that plan is that we can still basically use the current meetbot plugin directly, so maybe not incompatible with what you're asking to do | 18:57 |
zxiiro | I'd totally jump on this if I had free time to lead it. I used to love making IRC bots. | 18:57 |
fungi | (or maybe the plugin only needs a little work to make it compatible with limnoria) | 18:57 |
corvus | zxiiro, fungi, jlv-sick: i plan to pick up the limnoria work once we fix up our deployment tooling, then we can move forward on that. hopefully quickly and in parallel. | 19:01 |
corvus | (i started, but our current deployment tooling is wedged in a complicated way and we can't actually install limnoria right now) | 19:01 |
* mordred hopes to have that fixed soon | 19:04 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-ethercalc master: Update ethercalc to work with Ubuntu Xenial https://review.openstack.org/527144 | 19:08 |
openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-ethercalc master: Add basic rspec test https://review.openstack.org/527822 | 19:08 |
openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-ethercalc master: Turn off binary symlink in nodejs module https://review.openstack.org/585291 | 19:08 |
openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-ethercalc master: Add workaround for ethercalc bug https://review.openstack.org/585292 | 19:08 |
openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-ethercalc master: Add idempotency test https://review.openstack.org/585293 | 19:08 |
openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-ethercalc master: Add test for ethercalc::apache https://review.openstack.org/585294 | 19:08 |
openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-ethercalc master: Use versioncmp function https://review.openstack.org/590489 | 19:08 |
cmurphy | oops | 19:08 |
*** mriedem has quit IRC | 19:11 | |
*** mriedem has joined #openstack-infra | 19:11 | |
*** apetrich has quit IRC | 19:18 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for paste.o.o https://review.openstack.org/590492 | 19:21 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for planet.o.o https://review.openstack.org/590493 | 19:21 |
prometheanfire | if I just got added to core on a project, does anyone know how to get gertty to resync to allow me to bote +2+W and the like? | 19:24 |
prometheanfire | one of the reviews I can vote on, the others I can't | 19:25 |
*** SumitNaiksatam has left #openstack-infra | 19:25 | |
*** jcoufal_ has joined #openstack-infra | 19:26 | |
*** pcaruana has quit IRC | 19:33 | |
openstackgerrit | Merged openstack-infra/zuul master: Scope config line comments to change https://review.openstack.org/590446 | 19:37 |
fungi | prometheanfire: ctrl+r | 19:38 |
prometheanfire | tried that :P | 19:38 |
fungi | are you subscribed to the project that change is targeting? | 19:38 |
fungi | or alternatively, did you ctrl+r while viewing the change in question? | 19:39 |
prometheanfire | ctrl+r for each one works, but not project wide | 19:39 |
prometheanfire | guess that works (not many reviews) | 19:39 |
prometheanfire | have to do it from within the change | 19:39 |
fungi | basically, gertty will resync all changes owned by you and all changes in projects to which you subscribe, as well as any change you happen to have up viewing at the time you hit it | 19:40 |
fungi | it will not automatically resync any other changes it simply happens to know about | 19:40 |
*** jcoufal_ has quit IRC | 19:41 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn the future parser on for etherpad-dev https://review.openstack.org/590026 | 19:42 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for etherpad.o.o https://review.openstack.org/590029 | 19:42 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for ethercalc.o.o https://review.openstack.org/590030 | 19:42 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for eavesdrop.o.o https://review.openstack.org/590048 | 19:42 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for paste.o.o https://review.openstack.org/590492 | 19:42 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for planet.o.o https://review.openstack.org/590493 | 19:42 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for logstash-worker01 https://review.openstack.org/590499 | 19:42 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for all logstash workers https://review.openstack.org/590500 | 19:42 |
*** trown|lunch is now known as trown | 19:43 | |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Split base playbook into two plays https://review.openstack.org/590478 | 19:43 |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets / jobs https://review.openstack.org/588378 | 19:46 |
prometheanfire | win 33 | 19:47 |
*** xe1gyq_ has quit IRC | 19:54 | |
fungi | so much win | 19:54 |
*** jcoufal_ has joined #openstack-infra | 19:54 | |
*** jcoufal_ has quit IRC | 19:55 | |
*** eharney has quit IRC | 19:57 | |
*** psachin has quit IRC | 20:02 | |
studarus | clarkb: how far back do you keep glance images? 32 images going back to July 4 seem right? | 20:05 |
*** apetrich has joined #openstack-infra | 20:05 | |
fungi | we normally only keep two for each as far as i know (the most recent two which built/uploaded successfully) | 20:06 |
fungi | the only time i'd expect to see images from july 4 is if image building broke for a month | 20:07 |
studarus | Ok - so that looks fine then | 20:07 |
pabelanger | maybe image for mirror? | 20:08 |
studarus | The instance error is unable to connect to neutron on localhost. Happened across multiple servers. | 20:08 |
fungi | yeah, we may have manually uploaded a custom image to boot the mirror server from but i wouldn't expect more than one of those (and would be in the other tenant) | 20:08 |
studarus | I hit neutron localhost across them all and it replied | 20:09 |
*** nicolasbock has quit IRC | 20:11 | |
clarkb | studarus: neutron was returning a 500 error, maybe the neutron logs have more info on why it did that? | 20:15 |
*** ansmith has quit IRC | 20:16 | |
studarus | I did a quick grep for error. Let me actually open the log... :) | 20:20 |
*** apetrich has quit IRC | 20:20 | |
studarus | Clarkb: too many open files... Failed to read or write | 20:22 |
pabelanger | sounds like ulimit issue | 20:24 |
openstackgerrit | Merged openstack-infra/zuul master: Add winrm certificate handling https://review.openstack.org/535717 | 20:28 |
*** owalsh_ has joined #openstack-infra | 20:29 | |
openstackgerrit | Merged openstack-infra/zuul master: Support job pause https://review.openstack.org/585389 | 20:29 |
studarus | yeah, files-max is ready 26M though... | 20:31 |
studarus | already | 20:31 |
*** owalsh has quit IRC | 20:31 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Add allowed-triggers and allowed-reporters tenant settings https://review.openstack.org/554082 | 20:31 |
openstackgerrit | Logan V proposed openstack-infra/zuul master: encrypt_secret: Allow file scheme for public key https://review.openstack.org/581429 | 20:31 |
*** owalsh has joined #openstack-infra | 20:34 | |
openstackgerrit | Merged openstack-infra/zuul-jobs master: Add a yarn role https://review.openstack.org/586550 | 20:34 |
*** owalsh_ has quit IRC | 20:35 | |
*** apetrich has joined #openstack-infra | 20:35 | |
*** kgiusti has left #openstack-infra | 20:35 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Add command socket handler for full reconfiguration https://review.openstack.org/581754 | 20:36 |
*** owalsh_ has joined #openstack-infra | 20:39 | |
*** owalsh has quit IRC | 20:39 | |
corvus | i'm going to restart zuul-web. in the process, i'm going to see if we still have that pidfile problem. it may be down for a minute or two | 20:40 |
corvus | yes we do -- so that does need fixing in zuul-web. | 20:41 |
openstackgerrit | Merged openstack-infra/zuul master: Add request reference when hitting a node failure https://review.openstack.org/589856 | 20:43 |
corvus | tristanC: looks like we missed something in the job api: http://paste.openstack.org/show/727768/ | 20:46 |
*** yamahata_ has joined #openstack-infra | 20:48 | |
openstackgerrit | Merged openstack-infra/zuul master: Allow get_mime: False on localhost https://review.openstack.org/549475 | 20:52 |
*** ssbarnea has quit IRC | 20:52 | |
*** gouthamr_away is now known as gouthamr | 20:53 | |
*** jamesmcarthur has quit IRC | 20:56 | |
*** jamesmcarthur has joined #openstack-infra | 21:03 | |
*** trown is now known as trown|outtypewww | 21:04 | |
*** yamahata_ is now known as yamahata__ | 21:04 | |
*** yamahata__ is now known as yamahata | 21:05 | |
openstackgerrit | Merged openstack-infra/zuul master: Use copy instead of symlink for multi-tenant dashboard https://review.openstack.org/587554 | 21:09 |
openstackgerrit | Merged openstack-infra/zuul master: Make GitHub rate limit logging configurable https://review.openstack.org/580295 | 21:13 |
*** dosaboy has joined #openstack-infra | 21:14 | |
*** yamahata has quit IRC | 21:17 | |
*** jcoufal has quit IRC | 21:17 | |
*** dave-mccowan has quit IRC | 21:17 | |
openstackgerrit | Ian Wienand proposed openstack-infra/zuul-jobs master: [WIP] kerberos & afs client roles https://review.openstack.org/589334 | 21:19 |
*** gouthamr is now known as gouthamr|brb | 21:20 | |
*** yamahata has joined #openstack-infra | 21:20 | |
*** gouthamr|brb is now known as gouthamr | 21:20 | |
*** gouthamr is now known as gouthamr|brb | 21:21 | |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Split base playbook into two plays https://review.openstack.org/590478 | 21:21 |
pabelanger | clarkb: fungi: ianw: https://review.openstack.org/590450/ is another fedora-27 clean up | 21:21 |
mordred | corvus: that doesn't look awesome | 21:22 |
openstackgerrit | Merged openstack-infra/zuul master: Add command socket handler for full reconfiguration https://review.openstack.org/581754 | 21:22 |
*** owalsh_ is now known as owalsh | 21:25 | |
*** slaweq has quit IRC | 21:26 | |
*** apetrich has quit IRC | 21:32 | |
openstackgerrit | Ian Wienand proposed openstack-infra/zuul-jobs master: [WIP] kerberos & afs client roles https://review.openstack.org/589334 | 21:33 |
*** iyamahat has joined #openstack-infra | 21:35 | |
*** iyamahat has quit IRC | 21:36 | |
*** iyamahat has joined #openstack-infra | 21:37 | |
openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: [WIP] openafs client install https://review.openstack.org/589335 | 21:37 |
*** iyamahat has left #openstack-infra | 21:40 | |
*** gouthamr|brb is now known as gouthamr | 21:40 | |
*** boden has quit IRC | 21:49 | |
*** jamesmcarthur has quit IRC | 21:49 | |
*** agopi has quit IRC | 21:51 | |
*** jamesmcarthur has joined #openstack-infra | 21:56 | |
clarkb | fungi: https://review.openstack.org/590450/ is one that you are probably interested in it given prior concerns about bindep testing | 22:02 |
fungi | thanks! | 22:02 |
*** yamamoto has joined #openstack-infra | 22:04 | |
*** sthussey has quit IRC | 22:06 | |
fungi | aha, yes i think it was this change which prompted my earlier discussion (and surprise at the fact that we had frozen the fallback file rather than continuing to treat it as a functional test on each platform) | 22:06 |
fungi | er, nope | 22:06 |
fungi | it came up in the context of adding opensuse entries to the fallback list, now that i think about it | 22:06 |
fungi | anyway yeah, i'm resolved that we have good enough coverage without that additional functional testing | 22:07 |
*** neiljerram has quit IRC | 22:08 | |
*** jamesmcarthur has quit IRC | 22:09 | |
*** rcernin has joined #openstack-infra | 22:09 | |
*** slaweq has joined #openstack-infra | 22:11 | |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Split base playbook into two plays https://review.openstack.org/590478 | 22:14 |
*** tobasco is now known as tobias-urdin | 22:14 | |
*** slaweq has quit IRC | 22:15 | |
openstackgerrit | Merged openstack-infra/bindep master: Remove fedora-27 fallback job https://review.openstack.org/590450 | 22:17 |
*** yamamoto has quit IRC | 22:21 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: WIP: cache branches in connections/sources https://review.openstack.org/589975 | 22:21 |
*** tosky has joined #openstack-infra | 22:30 | |
*** xe1gyq has joined #openstack-infra | 22:48 | |
clarkb | cmurphy: mordred re changes like https://review.openstack.org/#/c/590030/2 we should coordinate around the bridge cutover as we will have to update the new magical inventory things | 22:50 |
*** claudiub has quit IRC | 22:55 | |
*** evrardjp has quit IRC | 22:55 | |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets / jobs https://review.openstack.org/588378 | 22:56 |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets / jobs https://review.openstack.org/588378 | 23:01 |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Flip fedora-latest integration tests voting https://review.openstack.org/590579 | 23:05 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Cache branches in connections/sources https://review.openstack.org/589975 | 23:05 |
pabelanger | dmsimard: do you mind a +3 on https://review.openstack.org/590577/ so we can remove fedora-27 from nodepool (replaced with fedora-latest) | 23:06 |
*** gyee has quit IRC | 23:06 | |
*** tpsilva has quit IRC | 23:10 | |
*** slaweq has joined #openstack-infra | 23:11 | |
*** slaweq has quit IRC | 23:16 | |
*** AhmadMahmoudi has quit IRC | 23:19 | |
*** rpioso is now known as rpioso|afk | 23:24 | |
*** efried has quit IRC | 23:31 | |
*** efried has joined #openstack-infra | 23:31 | |
openstackgerrit | Matt McEuen proposed openstack-infra/project-config master: New Airship project - Treasuremap https://review.openstack.org/590581 | 23:33 |
ianw | is axe throwing a thing? | 23:35 |
clarkb | ianw: ya its byob though | 23:35 |
clarkb | they provide the axes | 23:35 |
ianw | haha what could possibly go wrong | 23:35 |
mordred | clarkb: yeah - maybe so? | 23:38 |
mordred | clarkb: lemme see how far I get tomorrow | 23:38 |
*** tosky has quit IRC | 23:48 | |
*** ssbarnea has joined #openstack-infra | 23:54 | |
*** slagle has joined #openstack-infra | 23:55 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!