openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: Use fedora-release-common for fedora 30+ https://review.opendev.org/656905 | 00:00 |
---|---|---|
pabelanger | lets see if it is that simple | 00:00 |
*** Weifan has quit IRC | 00:00 | |
*** Weifan has joined #openstack-infra | 00:02 | |
*** mriedem has quit IRC | 00:03 | |
*** dciabrin has quit IRC | 00:03 | |
openstackgerrit | Paul Belanger proposed opendev/system-config master: Mirror fedora 30 for jobs https://review.opendev.org/656906 | 00:05 |
*** eumel8 has quit IRC | 00:07 | |
ianw | pabelanger: urgh, i'd say fedora's full ... http://grafana.openstack.org/d/ACtl1JSmz/afs?orgId=1 ... i'll look into that in a big | 00:08 |
ianw | bit | 00:08 |
pabelanger | ack | 00:09 |
*** hamzy has joined #openstack-infra | 00:10 | |
pabelanger | ianw:so, I uncapped DIB today, but still get the following install problem with fedora-29: http://paste.openstack.org/show/750347/ | 00:10 |
pabelanger | I'm not sure why we don't see that issue here | 00:10 |
*** Weifan has quit IRC | 00:10 | |
ianw | i think *sometimes* we do ... i can't understand why it's non-deterministic | 00:11 |
pabelanger | oh, so eventually you build a good image? | 00:11 |
*** slaweq has joined #openstack-infra | 00:13 | |
ianw | i think i've just seen it in our CI | 00:13 |
pabelanger | ianw: maybe we should check to see if dbus-daemon is enabled, and skip? | 00:14 |
pabelanger | cause right now, I can't get a fedora-29 image to build | 00:15 |
ianw | i'm trying to remember what it's about ... there's dbus-broker and dbus-daemon right? one's on demand or something and the other, well a daemon | 00:15 |
pabelanger | yah, I think that is right | 00:16 |
pabelanger | something is still pulling in dbus-daemon, from what I see in logs | 00:16 |
ianw | but dbus-broker is the new default? | 00:16 |
pabelanger | yah | 00:16 |
pabelanger | dbus still pulls in dbus-daemon | 00:16 |
pabelanger | ianw:but, I don't know when dbus-broker became the default | 00:17 |
ianw | pabelanger: so how are we getting dbus-daemon? https://opendev.org/openstack/diskimage-builder/commit/7cb5916a7600b0bd4cd26c9f254cab71778b1702 | 00:18 |
ianw | my thought is that dbus-broker is pulled in for initial chroot, and then that should satisfy any dbus requirements | 00:19 |
pabelanger | ianw:http://paste.openstack.org/show/750348/ | 00:20 |
pabelanger | ianw: Oh, so I think we install dbus before dbus-broker | 00:21 |
pabelanger | and for some reason, that still depends on dbus-daemon | 00:21 |
pabelanger | but, why doesn't nodepool.o.o hit this | 00:22 |
*** e0ne has quit IRC | 00:22 | |
ianw | dbus-daemon does come in ... https://nb02.openstack.org/fedora-29-0000038820.log | 00:23 |
*** slaweq has quit IRC | 00:23 | |
*** igordc has quit IRC | 00:24 | |
pabelanger | yah | 00:24 |
pabelanger | ystemctl --no-reload enable dbus-broker.service works for nodepool.o.o | 00:24 |
pabelanger | but me fails | 00:24 |
pabelanger | let me find the spec file for dbus-daemon | 00:25 |
openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: tox siblings install: handle no metadata in setup.cfg https://review.opendev.org/656908 | 00:27 |
*** bhavikdbavishi has quit IRC | 00:28 | |
openstackgerrit | Ian Wienand proposed opendev/system-config master: [wip] Use testinfra from master in devel job https://review.opendev.org/656877 | 00:28 |
openstackgerrit | Ian Wienand proposed opendev/system-config master: [wip] Use testinfra from master in devel job https://review.opendev.org/656877 | 00:29 |
*** gyee has quit IRC | 00:30 | |
pabelanger | ianw: http://paste.openstack.org/show/750349/ that is the install scripts for dbus-daemon rpm | 00:31 |
ianw | preset ... that's not quite enable is it? | 00:35 |
*** Lucas_Gray has quit IRC | 00:37 | |
pabelanger | ianw: if I understand, preset falls back to distro policy to then enable / disable said service | 00:40 |
pabelanger | so, while dbus-daemon could be preset, it might not actually start before of policy | 00:40 |
pabelanger | 90-default.preset:enable dbus-broker.service | 00:41 |
pabelanger | that is on local fedora-30 | 00:41 |
pabelanger | /lib/systemd/system-preset | 00:41 |
pabelanger | so, I wonder if what we are doing in: https://opendev.org/openstack/diskimage-builder/commit/7cb5916a7600b0bd4cd26c9f254cab71778b1702 is the right patch here | 00:42 |
pabelanger | we should maybe make sure that /lib/systemd/system-preset/90-default.preset has enable-dbus-broker | 00:42 |
pabelanger | ianw: that should be in fedora-release | 00:44 |
ianw | yeah, fedora-release-common on my f30 system ... i wonder if the two issues are related ... | 00:45 |
pabelanger | ianw: https://src.fedoraproject.org/rpms/fedora-release/blob/f29/f/90-default.preset#_16 | 00:45 |
pabelanger | so, I think we might have jumped the gun on dbus-broker on f29 | 00:46 |
pabelanger | https://src.fedoraproject.org/rpms/fedora-release/blob/f30/f/90-default.preset#_16 | 00:46 |
pabelanger | looks like dbus-broker is fedora-30+ | 00:47 |
ianw | hrm, the problem was we had no dbus starting which resulted in no networking and no login | 00:48 |
pabelanger | ianw: Hmm, I have no issue building fedora-29 on 2.19.0, which doesn't have that patch | 00:49 |
*** _erlon_ has quit IRC | 00:49 | |
pabelanger | so maybe it was something else? | 00:49 |
pabelanger | or now fixed? | 00:49 |
pabelanger | I'm just reverting again locally, and confirming | 00:50 |
ianw | maybe it was fixed? | 00:50 |
pabelanger | maybe | 00:50 |
pabelanger | if we revert, nodepool dsvm test on fedora should confirm | 00:51 |
pabelanger | otherwise, we'll have broken network | 00:51 |
openstackgerrit | Ian Wienand proposed opendev/system-config master: [wip] Use testinfra from master in devel job https://review.opendev.org/656877 | 00:52 |
ianw | yeah, i'd have to go back and remember what was failing, i assume it was that | 00:54 |
openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: Revert "Enable dbus-broker for Fedora 29" https://review.opendev.org/656909 | 00:54 |
pabelanger | ianw: k, lets see what testing says | 00:55 |
pabelanger | ianw: okay cool, https://review.opendev.org/656838/ is green. That gets us glean under python3 for fedora | 00:57 |
pabelanger | centos-7 just did pip install, fedora-29 pip3 install | 00:58 |
*** Weifan has joined #openstack-infra | 01:01 | |
*** lseki has quit IRC | 01:02 | |
*** Weifan has quit IRC | 01:10 | |
ianw | #status log bumped fedora.mirror quota to 800000000 k | 01:15 |
openstackstatus | ianw: finished logging | 01:15 |
*** jbadiapa has joined #openstack-infra | 01:16 | |
ianw | 28 being kind of special given rhel8 branching we might keep that for a bit | 01:16 |
ianw | running update manually since it's been hitting quota for a while | 01:18 |
*** bobh has joined #openstack-infra | 01:21 | |
pabelanger | ack | 01:23 |
*** Weifan has joined #openstack-infra | 01:25 | |
*** Weifan has quit IRC | 01:26 | |
*** Weifan has joined #openstack-infra | 01:27 | |
*** bobh has quit IRC | 01:31 | |
*** Weifan has quit IRC | 01:31 | |
*** tjgresha has joined #openstack-infra | 01:45 | |
*** tjgresha has quit IRC | 01:50 | |
*** apetrich has quit IRC | 01:57 | |
*** whoami-rajat has quit IRC | 01:58 | |
*** michael-beaver has quit IRC | 01:58 | |
pabelanger | ianw: so we build a fedora-30 image, it just doesn't boot. Looks grub related: http://logs.openstack.org/05/656905/2/check/nodepool-functional-py35-redhat-src/2b93322/controller/logs/screen-nodepool-launcher.txt.gz#_May_03_00_56_07_392192 | 02:01 |
openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: Use fedora-release-common for fedora 30+ https://review.opendev.org/656905 | 02:02 |
pabelanger | I'll do the depends on the other way, so we can stack patches on ^ | 02:03 |
ianw | pabelanger: there was something in the faq i hit the other day about grub boot menus ... | 02:06 |
ianw | https://fedoraproject.org/wiki/Common_F30_bugs#GRUB_boot_menu_is_not_populated_after_an_upgrade | 02:07 |
ianw | we might be fiddling grub the wrong way now :/ | 02:07 |
*** jbadiapa has quit IRC | 02:08 | |
openstackgerrit | Ian Wienand proposed opendev/system-config master: Add NO_TIMEOUT for mirror update scripts https://review.opendev.org/656912 | 02:20 |
*** rh-jelabarre has quit IRC | 02:23 | |
*** ykarel|away has joined #openstack-infra | 02:23 | |
*** dklyle has joined #openstack-infra | 02:30 | |
*** dklyle has quit IRC | 02:36 | |
*** gmann has quit IRC | 02:43 | |
*** yamamoto has joined #openstack-infra | 02:52 | |
*** jbadiapa has joined #openstack-infra | 02:53 | |
*** jbadiapa has quit IRC | 02:58 | |
*** yamamoto has quit IRC | 03:04 | |
*** otherwiseguy has quit IRC | 03:08 | |
*** bhavikdbavishi has joined #openstack-infra | 03:09 | |
*** otherwiseguy has joined #openstack-infra | 03:10 | |
*** hongbin has joined #openstack-infra | 03:17 | |
*** yamamoto has joined #openstack-infra | 03:17 | |
*** yamamoto has quit IRC | 03:17 | |
*** yamamoto has joined #openstack-infra | 03:21 | |
*** yamamoto has quit IRC | 03:21 | |
*** yamamoto has joined #openstack-infra | 03:21 | |
*** efried has joined #openstack-infra | 03:25 | |
*** gmann has joined #openstack-infra | 03:28 | |
*** psachin has joined #openstack-infra | 03:33 | |
*** sarob has joined #openstack-infra | 03:34 | |
*** ykarel|away has quit IRC | 03:34 | |
*** psachin has quit IRC | 03:35 | |
*** sarob has quit IRC | 03:36 | |
*** psachin has joined #openstack-infra | 03:36 | |
*** sarob has joined #openstack-infra | 03:36 | |
*** yamamoto has quit IRC | 03:41 | |
*** sshnaidm has joined #openstack-infra | 03:43 | |
*** sarob has quit IRC | 03:45 | |
*** yamamoto has joined #openstack-infra | 03:46 | |
*** armax has quit IRC | 03:50 | |
*** hongbin has quit IRC | 03:54 | |
*** e0ne has joined #openstack-infra | 04:06 | |
*** pcaruana has joined #openstack-infra | 04:12 | |
*** ykarel has joined #openstack-infra | 04:17 | |
*** ykarel_ has joined #openstack-infra | 04:20 | |
*** ykarel has quit IRC | 04:23 | |
*** pcaruana has quit IRC | 04:32 | |
*** udesale has joined #openstack-infra | 04:35 | |
*** raukadah is now known as chandankumar | 04:46 | |
*** samueldmq has quit IRC | 04:46 | |
*** Lucas_Gray has joined #openstack-infra | 04:51 | |
*** janki has joined #openstack-infra | 04:54 | |
*** yamamoto has quit IRC | 05:03 | |
*** hwoarang has quit IRC | 05:05 | |
*** hwoarang has joined #openstack-infra | 05:07 | |
*** e0ne has quit IRC | 05:15 | |
*** yamamoto has joined #openstack-infra | 05:18 | |
*** Lucas_Gray has quit IRC | 05:22 | |
*** yamamoto has quit IRC | 05:28 | |
*** yamamoto has joined #openstack-infra | 05:31 | |
*** yamamoto has quit IRC | 05:36 | |
fungi | ianychoi: i've added you to the chanserv access list for #openstack-i18n so you should now be able to set the channel topic with something like `/msg chanserv topic #openstack-i18n This is our new topic` | 05:40 |
ianychoi | fungi, thanks a lot - sorry that I couldn't join in this PTG physically, and enjoy PTG :) | 05:41 |
fungi | thanks! your presence is missed, and i hope to see you sometime soon! | 05:42 |
ianychoi | Thanks too! sure :) | 05:44 |
*** lpetrut has joined #openstack-infra | 05:46 | |
*** yamamoto has joined #openstack-infra | 05:53 | |
*** bradm has joined #openstack-infra | 05:53 | |
*** yamamoto has quit IRC | 05:58 | |
*** kjackal has joined #openstack-infra | 06:03 | |
*** yamamoto has joined #openstack-infra | 06:13 | |
*** kjackal has quit IRC | 06:14 | |
*** lpetrut has quit IRC | 06:18 | |
*** markvoelker has quit IRC | 06:20 | |
*** yamamoto has quit IRC | 06:21 | |
*** yamamoto has joined #openstack-infra | 06:21 | |
*** yamamoto has quit IRC | 06:24 | |
*** yamamoto has joined #openstack-infra | 06:24 | |
*** jtomasek has joined #openstack-infra | 06:31 | |
*** pcaruana has joined #openstack-infra | 06:36 | |
openstackgerrit | Tim Burke proposed zuul/zuul-jobs master: Better handle packages without [metadata]name option https://review.opendev.org/656925 | 06:42 |
*** yamamoto has quit IRC | 06:43 | |
*** yamamoto has joined #openstack-infra | 06:43 | |
*** yamamoto has quit IRC | 06:44 | |
*** yamamoto has joined #openstack-infra | 06:53 | |
*** ginopc has joined #openstack-infra | 07:01 | |
*** kopecmartin|off is now known as kopecmartin | 07:05 | |
*** shardy has joined #openstack-infra | 07:05 | |
*** tesseract has joined #openstack-infra | 07:06 | |
AJaeger | ianw, timburke , you both fix the same problem with https://review.opendev.org/#/c/656925/1 and https://review.opendev.org/#/c/656908 . Could you review each other's changes and decide on how to move forward, please? | 07:12 |
*** kjackal has joined #openstack-infra | 07:19 | |
*** pcaruana has quit IRC | 07:22 | |
openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Check groups entry in gerrit/projects https://review.opendev.org/656926 | 07:23 |
openstackgerrit | Andreas Jaeger proposed openstack/project-config master: DNM: Test groups list check https://review.opendev.org/656927 | 07:23 |
AJaeger | fungi, this should avoid groups errors coming like those you patched yesterday ^ | 07:23 |
*** markvoelker has joined #openstack-infra | 07:25 | |
*** lpetrut has joined #openstack-infra | 07:30 | |
*** bhavikdbavishi has quit IRC | 07:35 | |
*** rcernin has quit IRC | 07:36 | |
*** jpich has joined #openstack-infra | 07:37 | |
*** roman_g has quit IRC | 07:43 | |
*** apetrich has joined #openstack-infra | 07:44 | |
*** tosky has joined #openstack-infra | 07:46 | |
AJaeger | stephenfin: Is it spring cleaning time? Thanks! | 07:47 |
*** jpena|off is now known as jpena | 07:48 | |
*** kjackal_v2 has joined #openstack-infra | 07:54 | |
*** kjackal has quit IRC | 07:54 | |
*** bhavikdbavishi has joined #openstack-infra | 07:57 | |
*** ykarel_ is now known as ykarel | 08:00 | |
*** ykarel is now known as ykarel|lunch | 08:01 | |
*** altlogbot_0 has quit IRC | 08:03 | |
*** altlogbot_0 has joined #openstack-infra | 08:04 | |
*** kjackal has joined #openstack-infra | 08:25 | |
*** kjackal_v2 has quit IRC | 08:25 | |
*** rpittau|afk is now known as rpittau | 08:39 | |
*** ykarel|lunch is now known as ykarel | 08:49 | |
*** pcaruana has joined #openstack-infra | 08:56 | |
*** gmann has quit IRC | 08:57 | |
*** kjackal has quit IRC | 09:01 | |
*** kjackal has joined #openstack-infra | 09:01 | |
*** whoami-rajat has joined #openstack-infra | 09:09 | |
*** gthiemonge has joined #openstack-infra | 09:13 | |
*** jbadiapa has joined #openstack-infra | 09:15 | |
*** Lucas_Gray has joined #openstack-infra | 09:16 | |
*** Lucas_Gray has quit IRC | 09:31 | |
*** kjackal has quit IRC | 09:36 | |
*** kjackal has joined #openstack-infra | 09:36 | |
*** Lucas_Gray has joined #openstack-infra | 09:37 | |
*** ginux has joined #openstack-infra | 09:49 | |
*** ginopc has quit IRC | 09:52 | |
*** ginux is now known as ginopc | 09:52 | |
*** yolanda_ has quit IRC | 09:54 | |
*** kjackal has quit IRC | 10:10 | |
*** roman_g has joined #openstack-infra | 10:16 | |
*** jbadiapa has quit IRC | 10:21 | |
*** pcaruana has quit IRC | 10:22 | |
*** jbadiapa has joined #openstack-infra | 10:26 | |
*** yamamoto has quit IRC | 10:33 | |
*** lpetrut has quit IRC | 10:51 | |
*** d34dh0r53 has quit IRC | 10:52 | |
*** cloudnull has quit IRC | 10:53 | |
*** eglute has quit IRC | 10:54 | |
*** ginopc has quit IRC | 10:57 | |
*** ginopc has joined #openstack-infra | 10:57 | |
*** pcaruana has joined #openstack-infra | 11:01 | |
*** lpetrut has joined #openstack-infra | 11:05 | |
*** yamamoto has joined #openstack-infra | 11:09 | |
*** yamamoto has quit IRC | 11:14 | |
*** kaisers has quit IRC | 11:25 | |
*** bhavikdbavishi has quit IRC | 11:30 | |
*** rascasoft has quit IRC | 11:32 | |
*** kaisers has joined #openstack-infra | 11:34 | |
*** kjackal has joined #openstack-infra | 11:34 | |
*** jpena is now known as jpena|lunch | 11:35 | |
*** rascasoft has joined #openstack-infra | 11:38 | |
openstackgerrit | Ian Wienand proposed opendev/system-config master: [wip] Use testinfra from master in devel job https://review.opendev.org/656877 | 11:46 |
*** shardy has quit IRC | 11:48 | |
*** kjackal has quit IRC | 11:50 | |
*** kjackal has joined #openstack-infra | 11:50 | |
*** yamamoto has joined #openstack-infra | 11:54 | |
*** e0ne has joined #openstack-infra | 11:55 | |
*** imacdonn has quit IRC | 11:57 | |
*** imacdonn has joined #openstack-infra | 11:57 | |
*** xek has quit IRC | 12:01 | |
*** yamamoto has quit IRC | 12:02 | |
gthiemonge | Hi folks, I have random 404 errors on opendev.org: http://logs.openstack.org/00/656300/1/check/octavia-v1-dsvm-scenario/f932553/job-output.txt.gz#_2019-05-03_07_38_10_298471 | 12:10 |
*** rh-jelabarre has joined #openstack-infra | 12:11 | |
gthiemonge | http://paste.openstack.org/show/750358/ | 12:11 |
pabelanger | ianw: thanks, will look today to see if I find anything obvious | 12:11 |
ianw | pabelanger: thanks | 12:13 |
ianw | pabelanger: i *just* got a good ansible-runner+testinfra run : http://logs.openstack.org/77/656877/5/check/system-config-run-base-ansible-devel/a50c4ad/ | 12:13 |
ianw | i believe this to now be on par with the direct calls, although it might be slower | 12:13 |
*** sthussey has joined #openstack-infra | 12:28 | |
*** udesale has quit IRC | 12:32 | |
*** jpena|lunch is now known as jpena | 12:33 | |
*** udesale has joined #openstack-infra | 12:33 | |
frickler | infra-root: I can reproduce gthiemonge's errors. I do not see any errors when I curl from gitea0[1-8] directly. so possibly the haproxy is having issues. I don't have time to dig more, maybe someone can pick this up | 12:34 |
*** whoami-rajat has quit IRC | 12:38 | |
*** rlandy has joined #openstack-infra | 12:41 | |
roman_g | clarkb: Hello Clark. Could we have repos on GitHub marked as abandoned with information on where to find new repositories? / Airship | 12:44 |
*** rfarr_ has joined #openstack-infra | 12:46 | |
AJaeger | roman_g: can you give an example, please? | 12:47 |
*** jbadiapa has quit IRC | 12:50 | |
*** yamamoto has joined #openstack-infra | 12:55 | |
*** whoami-rajat has joined #openstack-infra | 12:58 | |
*** yamamoto has quit IRC | 13:02 | |
*** rosmaita has joined #openstack-infra | 13:02 | |
*** rosmaita has left #openstack-infra | 13:02 | |
roman_g | AJaeger: https://github.com/openstack/?q=airship | 13:03 |
roman_g | Syncing repos to GitHub no longer works, as repositories are renamed | 13:03 |
roman_g | All of them have last update date over 2 weeks | 13:04 |
roman_g | But in fact the work continues here: https://opendev.org/airship/ | 13:04 |
AJaeger | roman_g: I see, you might need to ask again next week due to the summit - or send an email to openstack-infra mailing list. I agree, that is one of the followup tasks to be done and I don't know the plan for that | 13:05 |
roman_g | Example of an "Archived" repository on GitHub: https://github.com/att-comdev/treasuremap - note the yellow notice line and description saying that project has moved | 13:06 |
roman_g | AJaeger: all right, thank you. | 13:06 |
*** yamamoto has joined #openstack-infra | 13:07 | |
Shrews | clarkb: infra-root: looks like the builder on nb2 was killed due to memory usage. I see the other builders are pretty maxed out right now too. I'm concerned by this memory issue suddenly showing up on both launchers and builders. | 13:10 |
*** bdodd has joined #openstack-infra | 13:12 | |
clarkb | frickler: gthiemonge I wouldnt expect http 404s from an unhappy proxy. Maybe ~1-2 backends are unhappy | 13:14 |
clarkb | roman_g: AJaeger I think we are waiting for the tc to decide that archiving those is appropriate | 13:15 |
AJaeger | clarkb: those are airship repos and outside of TC control, aren't they? | 13:15 |
clarkb | AJaeger: they arein the openstack org on github though | 13:16 |
AJaeger | which is owned by TC - I see... | 13:16 |
clarkb | if airship wantsto move them out and set up replication jobs they can do that | 13:16 |
frickler | clarkb: that was my first idea, but checking them individually with e.g. https://gitea01.opendev.org:3000/... doesn't give any errors for me on any of them | 13:17 |
jroll | AJaeger: clarkb: roman_g: there's been no objections to archiving these repos, so we're going to do it. I just didn't want to try to talk people into scripting that until after PTG | 13:17 |
jroll | so probably next week | 13:17 |
jroll | here's the ML thread: http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005629.html | 13:18 |
*** Goneri has joined #openstack-infra | 13:19 | |
*** markvoelker has quit IRC | 13:21 | |
*** janki has quit IRC | 13:22 | |
*** e0ne has quit IRC | 13:22 | |
AJaeger | jroll: I like roman_g 's idea to adjust the project description to point to the new location, e.g say for project "x/y": "The repo now lives at opendev.org/x/y". roman_g want to propose that as followup to jroll's email? | 13:23 |
jroll | sure, that'd be fine | 13:24 |
*** _erlon_ has joined #openstack-infra | 13:26 | |
*** kjackal has quit IRC | 13:30 | |
*** kjackal has joined #openstack-infra | 13:33 | |
clarkb | frickler: infra-root looks like at least gitea06 404s on that url | 13:35 |
clarkb | ya I think gitea06 is unhappy. the others return 200 for that url | 13:36 |
*** yamamoto has quit IRC | 13:36 | |
clarkb | I've got to get ready for ptg'ing but imagine looking into ^ is something we can do there | 13:37 |
*** markvoelker has joined #openstack-infra | 13:40 | |
clarkb | looks like the stable stein branch for openstack requiremeents is a 404 so not just that one file | 13:41 |
*** gmann has joined #openstack-infra | 13:51 | |
*** yamamoto has joined #openstack-infra | 14:02 | |
*** lpetrut has quit IRC | 14:04 | |
*** e0ne has joined #openstack-infra | 14:05 | |
mordred | clarkb: gitea-web_1 | 2019/05/03 14:05:42 [...ules/context/repo.go:602 func1()] [E] RepoRef invalid repo: branch or tag not exist: | 14:06 |
mordred | gitea-web_1 | [Macaron] 2019-05-03 14:05:42: Completed HEAD /openstack/requirements/raw/branch/stable/stein/upper-constraints.txt 404 Not Found in 15.88504ms | 14:06 |
mordred | clarkb: I agree - that's logs from gitea on 06 when trying to get openstack/requirements | 14:06 |
frickler | mordred: how did you create/look at at that log? | 14:09 |
mordred | frickler: there's two ways - you can cd /etc/gitea-docker and run 'docker-compose logs --tail=X' (where X is a number of lines ... without X it'll give you logs since the beginning of time) | 14:10 |
mordred | frickler: second, you can run docker ps to find the containers that are running, then run docker logs on one of them - so like "docker logs --since=5m giteadocker_gitea-web_1" | 14:11 |
*** efried has quit IRC | 14:12 | |
frickler | mordred: nice, thx | 14:14 |
clarkb | can we trigger replication on openstack/requirements to see if that fixes it | 14:16 |
*** jpich has quit IRC | 14:18 | |
*** psachin has quit IRC | 14:19 | |
*** jpich has joined #openstack-infra | 14:19 | |
ykarel | now the gitweb link is not visible in gerrit, earlier it was visible but not working, and it was said after restarting(as config changed to use internal gitweb) it will work | 14:19 |
ykarel | #infra-root is ^^ known | 14:19 |
pabelanger | clarkb: do you mind reviewing: https://review.opendev.org/656838/ that updates glean to use python3, when possible. In my case downstream, trying to build images with no python2. | 14:21 |
clarkb | ykarel: ues the restart ended up removing the links due to a second missong config | 14:22 |
clarkb | we have since added that config and another restart should actually fix the links rather than removong them | 14:22 |
ykarel | clarkb, okk Thanks for confirming | 14:22 |
clarkb | I'm going to trigger replication on openstack/requirements now | 14:27 |
clarkb | also I've camped at the coffee shop as you enter the convention center | 14:28 |
clarkb | the lighting is a bit nicer and there is some power | 14:28 |
*** sshnaidm has quit IRC | 14:29 | |
clarkb | replication has not fixed the 404 issue | 14:30 |
*** efried has joined #openstack-infra | 14:31 | |
clarkb | if I clone from gitea06 I don't get a remotes/origin/stable/stein | 14:33 |
*** mriedem has joined #openstack-infra | 14:34 | |
clarkb | gitea06:/var/gitea/data/git/repositories/openstack/requirements.git/refs/heads/stable/stein looks like binary junk data | 14:34 |
clarkb | I imagine we might be able to copy that file from another host | 14:35 |
clarkb | hrm dmesg shows a really unhappy fs | 14:36 |
clarkb | I think that is likly the underlying cause. We might want ot consider removing this host from the load balancer and replacing it | 14:36 |
clarkb | mnaser: ^ is that of interest to you before we delete the host? I believe it is a booted from volume ubuntu bionic node running ext4 on vexxhost scj1 | 14:38 |
*** ricolin has joined #openstack-infra | 14:39 | |
*** jpich has quit IRC | 14:39 | |
*** jpich has joined #openstack-infra | 14:39 | |
clarkb | pabelanger: is glean known to work under python3? | 14:40 |
*** e0ne has quit IRC | 14:41 | |
clarkb | pabelanger: I think check experimental runs the nodepool integration with dib and glean so I've added that comment | 14:42 |
*** armax has joined #openstack-infra | 14:43 | |
mordred | clarkb: I can verify that the gerrit config on disk is now correct for gitweb | 14:45 |
clarkb | infra-root I'm working to remove gitea06 from our lb pool and socat isn't installed on our loadbalancer node. Any objections to me installing socat there? | 14:46 |
clarkb | I hear no objections I'm installing it now | 14:48 |
*** iurygregory_ has joined #openstack-infra | 14:49 | |
*** iurygregory has quit IRC | 14:51 | |
mriedem | at some point today i'd like to talk to some infra/qa people about some issues i'm having in enabling a pre-run playbook in this change https://review.opendev.org/#/c/656656/ - i was hitting issues in PS2 so removed a thing, but now hitting different failures in PS3, just wondering what i'm screwing up. it seems that i'm hitting http://status.openstack.org/elastic-recheck/#1806912 consistently in PS2 | 14:52 |
mriedem | because of the pre-run using the orchestrate-devstack role | 14:52 |
clarkb | #status log Disabled gitea06 backends in gitea-lb01 haproxy because gitea06 has a sad filesystem according to dmesg and openstack/requirements stable/stein was affected. | 14:53 |
*** slaweq has joined #openstack-infra | 14:53 | |
openstackstatus | clarkb: finished logging | 14:53 |
clarkb | frickler: gthiemonge ^ fyi I ran the 100 curls loop and all are 200s now | 14:53 |
clarkb | mriedem: it is my undestanding that orchestrate devstack will run devstack on all the nodes it knows about in the inventory | 14:55 |
clarkb | mriedem: so your suspicion in the ps2 comments is correct aiui | 14:55 |
clarkb | mriedem: you want to run your setup multi cell policy after devstack runs I take it? There are a set of jobs that have devstack setup in pre-run which means your pre run would happen after that | 14:56 |
clarkb | let me see if I can find that parent job | 14:56 |
*** dklyle has joined #openstack-infra | 14:56 | |
mriedem | clarkb: yeah i need to modify the policy file after devstack is stacked on the controller | 14:56 |
mriedem | btw i copied that orchestrate-devstack role / play from devstack-tempest which is the parent job (sort of, grandparent) of my job | 14:57 |
mriedem | so i'm not sure why it blows up for me, but not the devstack-tempest job | 14:57 |
clarkb | mriedem: because the devstack-tempest job is also going to run it for you I think | 14:57 |
clarkb | you don't want it to run twice | 14:57 |
gmann | clarkb: this is ready. what we discussed to test stable on d-g - https://review.opendev.org/#/c/647912/ | 14:58 |
*** e0ne has joined #openstack-infra | 14:58 | |
clarkb | mriedem: it iwll run in your pre-run then it will run in the devstack run | 14:58 |
clarkb | mriedem: https://opendev.org/openstack/devstack/src/branch/master/.zuul.yaml#L585-L607 parenting on that might help since it runs devstack in pre run then your pre run will run after and can just set up the multi cell config (orchestrate-devstack already handled for you) | 15:00 |
gthiemonge | clarkb: thanks for fixing this issue! | 15:00 |
mriedem | clarkb: ok so i guess the devstack-tempest run will override parent devstack-base run which also does devstack-orchestrate | 15:00 |
mriedem | for some reason i thought devstack-tempest was letting its parent setup devstack, but i see now it's overriding the parent run so it has to run devstack and then also run tempest | 15:01 |
*** ykarel is now known as ykarel|away | 15:01 | |
*** dklyle has quit IRC | 15:01 | |
*** kjackal has quit IRC | 15:03 | |
*** lucasagomes has joined #openstack-infra | 15:03 | |
*** lucasagomes has joined #openstack-infra | 15:04 | |
gmann | mriedem: clarkb other clean way but little duplicate is to override all playbook and then insert the policy-override role before run-tempest | 15:04 |
mriedem | gmann: yeah i was worried about that - my PS3 is failing because my pre-run is running before devstack-tempest runs devstack | 15:04 |
*** rosmaita has joined #openstack-infra | 15:05 | |
mriedem | i'd like to avoid overriding the devstack-tempest playbook in case that changes later for some reason | 15:05 |
*** diablo_rojo has joined #openstack-infra | 15:05 | |
gmann | yeah that is one thing. | 15:06 |
mriedem | my alternative way to do this is a simple env var flag in devstack which my job can set in local.conf and just have devstack setup the policy for me - the legacy way | 15:06 |
*** rosmaita has left #openstack-infra | 15:06 | |
*** eharney has joined #openstack-infra | 15:07 | |
mriedem | is there a way we could put some conditional task in the tempest run such that a child job could set a variable which if set will push the policy variable to the defined file? | 15:07 |
gmann | yeah that is ok for now and as we discussed in onboarding , we can check for hook in devstack-tempest job for pre-run-tempest things | 15:07 |
corvus | mriedem: fwiw, we've concieved of roles as the base unit of reusability here; the playbooks involved should be fairly simple and not change very much; the roles are the thing. so if you can conveniently avoid making a new playbook, that's great, but if not, i wouldn't recommend going out of your way. these playbooks are simple lists of roles for exactly this reason. | 15:07 |
corvus | (i haven't dug into the issue under discussion -- that's just a general observation. mileage may vary) | 15:08 |
pabelanger | clarkb: yah, glean boot for fedora nodepool test as python3, so I think we are safe here | 15:09 |
pabelanger | clarkb: let me reply | 15:09 |
mriedem | i wonder if i could just run the setup-stack-user role on the controller before my policy task, before devstack sets up | 15:12 |
mriedem | assuming that's all fairly idempotent | 15:12 |
mriedem | since all i need to do is write a file to the host | 15:12 |
*** rlandy is now known as rlandy|brb | 15:14 | |
openstackgerrit | Clark Boylan proposed opendev/system-config master: Remove gitea06 from the gitea lb https://review.opendev.org/656960 | 15:16 |
*** Lucas_Gray has quit IRC | 15:17 | |
*** eumel8 has joined #openstack-infra | 15:17 | |
*** sshnaidm|ptg has joined #openstack-infra | 15:17 | |
*** ralonsoh has joined #openstack-infra | 15:17 | |
openstackgerrit | Clark Boylan proposed opendev/system-config master: Install socat where we install haproxy https://review.opendev.org/656962 | 15:18 |
clarkb | gmann: one thing on that chnage (I left a comment on it) | 15:21 |
*** Lucas_Gray has joined #openstack-infra | 15:21 | |
*** gyee has joined #openstack-infra | 15:21 | |
*** bgmccollum has joined #openstack-infra | 15:23 | |
openstackgerrit | James E. Blair proposed opendev/system-config master: Split the base playbook into services https://review.opendev.org/656871 | 15:29 |
openstackgerrit | James E. Blair proposed opendev/system-config master: Split the base playbook into services https://review.opendev.org/656871 | 15:31 |
*** ykarel|away has quit IRC | 15:32 | |
*** sdatko has joined #openstack-infra | 15:33 | |
*** iurygregory_ has quit IRC | 15:35 | |
*** rpittau is now known as rpittau|afk | 15:36 | |
*** rlandy|brb is now known as rlandy | 15:38 | |
openstackgerrit | James E. Blair proposed opendev/system-config master: Split the base playbook into services https://review.opendev.org/656871 | 15:39 |
mriedem | gmann: i'm going to see if i can get the stack user setup and the policy file written in my pre-run before the tempest job sets up devstack https://review.opendev.org/656656 | 15:39 |
mriedem | if that fails i'll go the hacky devstack variable local.conf route | 15:39 |
SotK | I'm thinking about IRC bots, where can I find the source for the bot which expands launchpad links ooi? | 15:44 |
*** jamesmcarthur has joined #openstack-infra | 15:45 | |
clarkb | #164001 I want to see which nick responds (so that I can find the source for ^) | 15:45 |
openstackgerrit | Monty Taylor proposed openstack/openstack-zuul-jobs master: Set bindep_fallback in legacy-base https://review.opendev.org/656969 | 15:45 |
clarkb | apparently you have to use a link maybe? | 15:45 |
fungi | SotK: which launchpad links? have a concrete example? | 15:45 |
fungi | i can also just walk over there ;) | 15:45 |
corvus | SotK, fungi: https://opendev.org/opendev/meetbot i think | 15:45 |
*** ijw has joined #openstack-infra | 15:45 | |
fungi | oh, that, yes | 15:45 |
clarkb | https://bugs.launchpad.net/bzr/+bug/77744 | 15:46 |
openstack | Launchpad bug 77744 in Breezy "win32 bzr is confused by filename case changes" [High,Triaged] - Assigned to Jelmer Vernooij (jelmer) | 15:46 |
clarkb | yup openstack is meetbot | 15:46 |
corvus | bug 1 | 15:46 |
openstack | bug 1 in Ubuntu Malaysia LoCo Team "Microsoft has a majority market share" [Critical,In progress] https://launchpad.net/bugs/1 - Assigned to MFauzilkamil Zainuddin (apogee) | 15:46 |
*** ijw has quit IRC | 15:46 | |
SotK | thanks | 15:46 |
* SotK tries to work out where the LP integration is | 15:47 | |
*** ijw has joined #openstack-infra | 15:47 | |
mordred | SotK: java | 15:47 |
SotK | fun | 15:47 |
corvus | ignore mordred | 15:47 |
corvus | /ignore mordred | 15:47 |
* mordred throws some perl at SotK | 15:47 | |
openstackgerrit | Monty Taylor proposed openstack/project-config master: Make bindep fallback only happen in openstack https://review.opendev.org/656195 | 15:48 |
openstackgerrit | Adam Spiers proposed openstack/ptgbot master: Fix crash after #unsubscribe https://review.opendev.org/656970 | 15:48 |
*** jbadiapa has joined #openstack-infra | 15:48 | |
*** ccamacho has joined #openstack-infra | 15:49 | |
*** ijw has quit IRC | 15:49 | |
*** ijw has joined #openstack-infra | 15:49 | |
*** ccamacho has quit IRC | 15:50 | |
*** jamesmcarthur has quit IRC | 15:51 | |
*** ccamacho has joined #openstack-infra | 15:52 | |
*** ykarel|away has joined #openstack-infra | 15:55 | |
*** jbadiapa has quit IRC | 15:55 | |
*** jamesmcarthur has joined #openstack-infra | 15:57 | |
*** ccamacho has quit IRC | 15:58 | |
openstackgerrit | Monty Taylor proposed opendev/system-config master: Fix cgit references in docstrings https://review.opendev.org/656974 | 16:00 |
openstackgerrit | Merged openstack/ptgbot master: Fix crash after #unsubscribe https://review.opendev.org/656970 | 16:02 |
*** Lucas_Gray has quit IRC | 16:02 | |
*** diablo_rojo has quit IRC | 16:03 | |
openstackgerrit | Merged opendev/system-config master: Remove gitea06 from the gitea lb https://review.opendev.org/656960 | 16:03 |
openstackgerrit | James E. Blair proposed opendev/system-config master: Split the base playbook into services https://review.opendev.org/656871 | 16:04 |
openstackgerrit | Merged openstack/openstack-zuul-jobs master: Set bindep_fallback in legacy-base https://review.opendev.org/656969 | 16:06 |
*** markvoelker has quit IRC | 16:13 | |
*** efried has quit IRC | 16:13 | |
*** diablo_rojo has joined #openstack-infra | 16:14 | |
openstackgerrit | Merged opendev/system-config master: Install socat where we install haproxy https://review.opendev.org/656962 | 16:15 |
*** _erlon_ has quit IRC | 16:16 | |
rm_work | dhellmann: is tooz ... "working"? or is it dead? | 16:16 |
*** efried has joined #openstack-infra | 16:16 | |
rm_work | you were the last real committer that I see | 16:16 |
*** jpich has quit IRC | 16:17 | |
*** igordc has joined #openstack-infra | 16:18 | |
fungi | corvus: the guidelines i mentioned are published at https://governance.openstack.org/tc/resolutions/20170530-binary-artifacts.html | 16:20 |
*** dklyle has joined #openstack-infra | 16:20 | |
openstackgerrit | Vitaliy Lotorev proposed zuul/zuul master: Replace /bin/bash with /bin/sh shebang https://review.opendev.org/656979 | 16:20 |
openstackgerrit | Vitaliy Lotorev proposed zuul/zuul master: Don't use full path while calling ansible-playbook https://review.opendev.org/656980 | 16:20 |
fungi | corvus: it's two years old now, so if any of that is unreasonable or there are now better alternative solutions i'm happy to draft a new resolution | 16:21 |
openstackgerrit | Vitaliy Lotorev proposed zuul/zuul master: Replace /bin/bash with /bin/sh shebang https://review.opendev.org/656979 | 16:22 |
openstackgerrit | Vitaliy Lotorev proposed zuul/zuul master: Don't use full path while calling ansible-playbook https://review.opendev.org/656980 | 16:22 |
openstackgerrit | Merged opendev/system-config master: Add cache-control headers for service-types.openstack.org https://review.opendev.org/484163 | 16:25 |
openstackgerrit | Merged opendev/system-config master: Rename cgit_file to git_file https://review.opendev.org/654055 | 16:25 |
*** jamesmcarthur has quit IRC | 16:28 | |
*** eernst has joined #openstack-infra | 16:29 | |
*** ccamacho has joined #openstack-infra | 16:29 | |
*** mattw4 has joined #openstack-infra | 16:31 | |
*** shardy has joined #openstack-infra | 16:33 | |
*** quiquell has joined #openstack-infra | 16:33 | |
AJaeger | config-core, a small (not urgent) cleanup change for review please: https://review.opendev.org/#/c/654580/ | 16:33 |
*** bgmccollum has quit IRC | 16:34 | |
mordred | mattoliverau: https://opendev.org/zuul/zuul/src/branch/master/.zuul.yaml#L77-L155 | 16:34 |
*** ricolin has quit IRC | 16:34 | |
mordred | mattoliverau: https://opendev.org/zuul/zuul/src/branch/master/Dockerfile | 16:34 |
*** mpjetta has quit IRC | 16:34 | |
*** ricolin has joined #openstack-infra | 16:34 | |
corvus | mattoliverau: https://zuul-ci.org/docs/zuul/user/encryption.html | 16:34 |
corvus | mattoliverau: https://opendev.org/zuul/zuul/raw/branch/master/tools/encrypt_secret.py | 16:35 |
*** tosky has quit IRC | 16:35 | |
AJaeger | mordred: looking at https://review.opendev.org/#/c/484163 - the process for the proposal bot is: Push to service-types page, then download directly. If we cache the site, a new content will not be available directly, won't it? | 16:36 |
*** tosky has joined #openstack-infra | 16:36 | |
AJaeger | mordred: Wait, we run curl and threre no proxies involved - so that should not affect us . Correct? | 16:37 |
mattoliverau | corvus, mordred: sweet, thanks heaps guys! | 16:37 |
*** mattw4 has quit IRC | 16:37 | |
*** yamamoto has quit IRC | 16:37 | |
*** sdatko has quit IRC | 16:38 | |
fungi | mattoliverau: please also review https://governance.openstack.org/tc/resolutions/20170530-binary-artifacts.html and keep those guidelines in mind | 16:38 |
mordred | AJaeger: yeah - I think we should be fine | 16:38 |
*** sdatko has joined #openstack-infra | 16:39 | |
AJaeger | mordred: ok... | 16:40 |
*** lifeless has quit IRC | 16:40 | |
*** tdasilva has joined #openstack-infra | 16:41 | |
fungi | clarkb: SotK: AJaeger's https://review.opendev.org/656926 change should help prevent us merging new broken storyboard project groups entries like we saw earlier | 16:41 |
*** e0ne has quit IRC | 16:41 | |
*** mattw4 has joined #openstack-infra | 16:41 | |
*** jamesmcarthur has joined #openstack-infra | 16:41 | |
*** lucasagomes has quit IRC | 16:43 | |
*** sdatko has quit IRC | 16:44 | |
clarkb | fungi: I approved it, thanks for pointing it out | 16:45 |
*** ijw has quit IRC | 16:47 | |
openstackgerrit | Merged opendev/system-config master: Fix cgit references in docstrings https://review.opendev.org/656974 | 16:48 |
*** sdatko has joined #openstack-infra | 16:49 | |
clarkb | mordred: fungi corvus http://logs.openstack.org/80/656880/1/check/system-config-run-docker-registry/ea474d6/job-output.txt.gz#_2019-05-03_16_23_11_780378 bad credentials for the registry? | 16:52 |
clarkb | is that a thing that has been debugged yet? | 16:53 |
*** hwoarang has quit IRC | 16:53 | |
corvus | mordred: http://logs.openstack.org/71/656871/6/check/system-config-run-base/a784d0f/bridge.openstack.org/ara-report/ | 16:53 |
*** betherly has joined #openstack-infra | 16:53 | |
*** hwoarang has joined #openstack-infra | 16:54 | |
openstackgerrit | Merged openstack/project-config master: Check groups entry in gerrit/projects https://review.opendev.org/656926 | 16:57 |
*** betherly has quit IRC | 16:58 | |
*** jpena is now known as jpena|off | 16:58 | |
*** bgmccollum has joined #openstack-infra | 16:59 | |
*** jamesmcarthur has quit IRC | 17:00 | |
*** dklyle has quit IRC | 17:02 | |
*** e0ne has joined #openstack-infra | 17:02 | |
*** Lucas_Gray has joined #openstack-infra | 17:03 | |
*** udesale has quit IRC | 17:05 | |
*** jamesmcarthur has joined #openstack-infra | 17:05 | |
*** diablo_rojo has quit IRC | 17:06 | |
spotz | Hey what url does our git config need to be now? | 17:06 |
clarkb | spotz: if you open the old http(s) urls you will get redirected to the correct url | 17:07 |
fungi | the old urls should still work, as long as they're not git:// | 17:07 |
clarkb | that is probably the easiest way to determine what it is | 17:07 |
spotz | ok I'll switch to https: | 17:07 |
*** diablo_rojo has joined #openstack-infra | 17:07 | |
*** lucasagomes has joined #openstack-infra | 17:07 | |
*** ginopc has quit IRC | 17:08 | |
spotz | and no git. but https://opendev.org worked:) | 17:08 |
mordred | \o/ | 17:08 |
*** yamamoto has joined #openstack-infra | 17:08 | |
openstackgerrit | James E. Blair proposed opendev/system-config master: Split the base playbook into services https://review.opendev.org/656871 | 17:09 |
*** Weifan has joined #openstack-infra | 17:09 | |
*** kopecmartin is now known as kopecmartin|off | 17:10 | |
*** Weifan has quit IRC | 17:12 | |
*** jamesmcarthur has quit IRC | 17:13 | |
*** yamamoto has quit IRC | 17:13 | |
*** ralonsoh has quit IRC | 17:14 | |
*** bnemec has quit IRC | 17:14 | |
*** Lucas_Gray has quit IRC | 17:15 | |
*** gyee has quit IRC | 17:16 | |
openstackgerrit | David Shrewsbury proposed opendev/puppet-nodepool master: Install jemalloc on nodepool servers https://review.opendev.org/656986 | 17:19 |
corvus | May 3 17:17:53 static puppet-user[12900]: (/Stage[main]/Httpd/Service[httpd]) AH00526: Syntax error on line 38 of /etc/apache2/sites-enabled/50-service-types.openstack.org.conf: | 17:19 |
corvus | May 3 17:17:53 static puppet-user[12900]: (/Stage[main]/Httpd/Service[httpd]) ExpiresByType takes two arguments, a MIME type followed by an expiry date code | 17:19 |
corvus | that has caused static.o.o to die | 17:19 |
openstackgerrit | Monty Taylor proposed opendev/system-config master: Revert "Add cache-control headers for service-types.openstack.org" https://review.opendev.org/656987 | 17:20 |
*** zbr has joined #openstack-infra | 17:21 | |
Shrews | infra-root: hoping https://review.opendev.org/656986 helps a bit with the nodepool mem issues. please double check my puppeting | 17:21 |
mordred | /etc/apache2/sites-enabled/50-service-types.openstack.org.conf: ExpiresActive On | 17:21 |
mordred | /etc/apache2/sites-enabled/50-service-types.openstack.org.conf: ExpiresByType "" | 17:21 |
*** mattw4 has quit IRC | 17:22 | |
*** bnemec has joined #openstack-infra | 17:22 | |
*** Weifan has joined #openstack-infra | 17:23 | |
*** dklyle has joined #openstack-infra | 17:23 | |
*** bnemec is now known as beekneemech | 17:24 | |
*** beekneemech is now known as bnemec | 17:24 | |
*** bnemec is now known as beekneemech | 17:24 | |
*** eernst has quit IRC | 17:24 | |
openstackgerrit | Merged opendev/storyboard-webclient master: Add page size of 1000 to preferences https://review.opendev.org/604437 | 17:25 |
*** ykarel|away has quit IRC | 17:26 | |
*** ralonsoh has joined #openstack-infra | 17:27 | |
*** mattw4 has joined #openstack-infra | 17:28 | |
*** tesseract has quit IRC | 17:28 | |
*** shardy has quit IRC | 17:28 | |
*** dklyle has quit IRC | 17:29 | |
openstackgerrit | James E. Blair proposed opendev/system-config master: Split the base playbook into services https://review.opendev.org/656871 | 17:30 |
openstackgerrit | Monty Taylor proposed opendev/system-config master: Revert "Revert "Add cache-control headers for service-types.openstack.org"" https://review.opendev.org/656990 | 17:34 |
spotz | fungi clarkb any changes for gerrit? | 17:41 |
clarkb | spotz: gerrit is not canonically at review.opendev.org and if a project was renamed you'll need to change the path (we can't redirect there) | 17:41 |
*** chandankumar is now known as raukadah | 17:42 | |
openstackgerrit | Dirk Mueller proposed zuul/zuul-website master: Correct company spelling https://review.opendev.org/656992 | 17:42 |
openstackgerrit | Vitaliy Lotorev proposed zuul/zuul master: Replace /bin/bash with /bin/sh shebang https://review.opendev.org/656979 | 17:42 |
openstackgerrit | Vitaliy Lotorev proposed zuul/zuul master: Don't use full path while calling ansible-playbook https://review.opendev.org/656980 | 17:42 |
spotz | clarkb: ok Tobias is trying to publish a meeting update we'll look further | 17:42 |
fungi | spotz: need to pull the latest state of the repository and then delete your gerrit remote. after that, git review should readd the gerrit remote for you with the corrected hostname and project name | 17:43 |
*** EmilienM is now known as EvilienM | 17:43 | |
spotz | fungi: ok thanks | 17:43 |
fungi | another alternative is to delete the local repository and clone it again | 17:44 |
*** michael-beaver has joined #openstack-infra | 17:45 | |
spotz | We'll know in a second if we got it:) | 17:45 |
openstackgerrit | Tobias Rydberg proposed opendev/irc-meetings master: Removing unused meeting time for the Public Cloud WG. https://review.opendev.org/656993 | 17:46 |
openstackgerrit | Amy Marrich (spotz) proposed opendev/irc-meetings master: Removing unused meeting time for the Public Cloud WG. https://review.opendev.org/656993 | 17:46 |
*** efried has quit IRC | 17:52 | |
openstackgerrit | James E. Blair proposed opendev/system-config master: Split the base playbook into services https://review.opendev.org/656871 | 17:52 |
*** ralonsoh has quit IRC | 17:53 | |
*** sdatko has quit IRC | 17:55 | |
*** lucasagomes has quit IRC | 17:55 | |
*** efried has joined #openstack-infra | 17:57 | |
*** sdatko has joined #openstack-infra | 17:58 | |
*** bdodd has quit IRC | 17:58 | |
*** bdodd has joined #openstack-infra | 18:00 | |
*** slaweq has quit IRC | 18:00 | |
*** kjackal has joined #openstack-infra | 18:03 | |
logan- | logs.openstack.org seems down | 18:06 |
clarkb | logan-: should be fixed | 18:06 |
fungi | logan-: yeah, the manual revert got undone while waiting for the actual revert to merge | 18:07 |
*** bgmccollum has quit IRC | 18:07 | |
clarkb | we can all buy monty a beer for both breaking and fixingg it | 18:07 |
openstackgerrit | Merged zuul/zuul-website master: Correct company spelling https://review.opendev.org/656992 | 18:07 |
logan- | :) thanks | 18:07 |
*** eernst has joined #openstack-infra | 18:08 | |
openstackgerrit | Merged opendev/system-config master: Revert "Add cache-control headers for service-types.openstack.org" https://review.opendev.org/656987 | 18:09 |
*** e0ne has quit IRC | 18:12 | |
*** ricolin has quit IRC | 18:17 | |
*** eharney has quit IRC | 18:17 | |
*** quiquell has quit IRC | 18:20 | |
openstackgerrit | Monty Taylor proposed opendev/puppet-openstack_infra_spec_helper master: Make hosts file in inventory directory https://review.opendev.org/657002 | 18:20 |
openstackgerrit | Monty Taylor proposed opendev/puppet-openstack_infra_spec_helper master: Make hosts file in inventory directory https://review.opendev.org/657002 | 18:20 |
*** sshnaidm|ptg has quit IRC | 18:20 | |
mordred | cmurphy: ^^ wanna make sure i rubyd correctly? | 18:21 |
openstackgerrit | James E. Blair proposed opendev/system-config master: Split the base playbook into services https://review.opendev.org/656871 | 18:22 |
*** ccamacho has quit IRC | 18:23 | |
*** dklyle has joined #openstack-infra | 18:28 | |
cmurphy | mordred: that looks indeed like ruby | 18:30 |
*** eernst has quit IRC | 18:31 | |
*** jamesmcarthur has joined #openstack-infra | 18:33 | |
*** dklyle has quit IRC | 18:35 | |
*** beekneemech has quit IRC | 18:36 | |
*** bobh has joined #openstack-infra | 18:37 | |
*** jamesmcarthur has quit IRC | 18:38 | |
*** imacdonn has quit IRC | 18:38 | |
*** imacdonn has joined #openstack-infra | 18:39 | |
*** jamesmcarthur has joined #openstack-infra | 18:39 | |
rm_work | clarkb: so it seems like I added those IPs correctly to the br-infra interface, and it didn't appear to help | 18:44 |
*** diablo_rojo has quit IRC | 18:46 | |
*** jamesmcarthur has quit IRC | 18:47 | |
roman_g | AJaeger, jroll, clarkb, replied to that e-mail with suggestion (to the mailing list). Sorry, have just subscribed, so mesage is actually out of thread. | 18:51 |
clarkb | roman_g: I rhink it ie a good idea and something we can do but likely not before we get home from the summit | 18:52 |
*** jamesmcarthur has joined #openstack-infra | 18:52 | |
*** lseki has joined #openstack-infra | 18:52 | |
*** ricolin has joined #openstack-infra | 18:53 | |
*** dklyle has joined #openstack-infra | 18:53 | |
roman_g | clarkb: no problem at all. Thank you for all the work you are doing for the Infra. | 18:54 |
roman_g | clarkb: the only drawback I see from not archieving repos earlier, is that Github repos are indexed and ranked high by search engines, and people git clone from github and complain about software not working, whereas we are many commits ahead already and bugs people complain about are fixed already | 18:55 |
roman_g | e.g. https://www.google.com/search?q=airship+armada - first hist would be github repo | 18:57 |
roman_g | *hit | 18:57 |
roman_g | >> Airship Armada is the second level of World Star in Super Mario Run. | 18:58 |
roman_g | lol | 18:58 |
*** bnemec has joined #openstack-infra | 18:59 | |
*** efried has quit IRC | 19:02 | |
*** efried has joined #openstack-infra | 19:02 | |
*** pcaruana has quit IRC | 19:02 | |
*** betherly has joined #openstack-infra | 19:16 | |
*** ricolin has quit IRC | 19:20 | |
*** dklyle has quit IRC | 19:20 | |
*** jamesmcarthur has quit IRC | 19:21 | |
*** bnemec has quit IRC | 19:21 | |
*** betherly has quit IRC | 19:21 | |
*** rosmaita has joined #openstack-infra | 19:22 | |
*** eharney has joined #openstack-infra | 19:26 | |
*** bobh has quit IRC | 19:27 | |
*** bnemec has joined #openstack-infra | 19:28 | |
*** sshnaidm|ptg has joined #openstack-infra | 19:28 | |
*** quiquell has joined #openstack-infra | 19:30 | |
*** jtomasek has quit IRC | 19:33 | |
*** e0ne has joined #openstack-infra | 19:34 | |
*** ijw has joined #openstack-infra | 19:34 | |
*** betherly has joined #openstack-infra | 19:37 | |
*** bgmccollum has joined #openstack-infra | 19:37 | |
*** ralonsoh has joined #openstack-infra | 19:39 | |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: Restore posargs when running stestr https://review.opendev.org/657020 | 19:41 |
*** jamesmcarthur has joined #openstack-infra | 19:41 | |
*** betherly has quit IRC | 19:42 | |
*** rosmaita has left #openstack-infra | 19:42 | |
*** jamesmcarthur has quit IRC | 19:45 | |
*** slaweq has joined #openstack-infra | 19:45 | |
*** ijw has quit IRC | 19:45 | |
*** ijw has joined #openstack-infra | 19:46 | |
*** ccamacho has joined #openstack-infra | 19:47 | |
*** slaweq has quit IRC | 19:51 | |
*** dklyle has joined #openstack-infra | 19:52 | |
rm_work | clarkb: is there a good time to catch you for maybe setting up a hold? this is the patch i've been using to test it: https://review.opendev.org/#/c/656852/ | 19:54 |
*** slaweq has joined #openstack-infra | 19:55 | |
*** bgmccollum has quit IRC | 19:56 | |
rm_work | clarkb: http://logs.openstack.org/52/656852/9/check/octavia-v2-dsvm-scenario-two-node/aa76969/job-output.txt.gz (search in page for "inet6 2001:db8::" | 19:57 |
rm_work | ) | 19:57 |
*** bgmccollum has joined #openstack-infra | 19:58 | |
*** devananda has joined #openstack-infra | 19:59 | |
*** e0ne has quit IRC | 20:00 | |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: DNM: try out mitogen for zuul jobs https://review.opendev.org/657024 | 20:02 |
clarkb | rm_work: hold is in place feel free to recheck | 20:04 |
*** e0ne has joined #openstack-infra | 20:06 | |
*** kjackal has quit IRC | 20:07 | |
*** ijw has quit IRC | 20:08 | |
rm_work | ok | 20:08 |
*** pkopec has quit IRC | 20:08 | |
*** betherly has joined #openstack-infra | 20:09 | |
*** ricolin has joined #openstack-infra | 20:09 | |
*** ccamacho has quit IRC | 20:09 | |
rm_work | clarkb: i guess soon i'll be asking you how to actually... use the held nodes :D | 20:10 |
*** lifeless has joined #openstack-infra | 20:11 | |
clarkb | rm_work: when the jobs fail we'll get a record in the nodepool db saying the nodes are heald and we add your ssh key to the nodes and then you ssh in | 20:11 |
clarkb | rm_work: so the next step is recheck jobs and wait for them to fail. Then give us your ssh keys | 20:12 |
rm_work | ok cool :) | 20:12 |
rm_work | i did so | 20:12 |
rm_work | waiting on the 656852 `octavia-v2-dsvm-scenario-two-node` job to fail | 20:12 |
*** betherly has quit IRC | 20:13 | |
*** ccamacho has joined #openstack-infra | 20:16 | |
*** devananda has quit IRC | 20:22 | |
*** ijw has joined #openstack-infra | 20:25 | |
*** tjgresha has joined #openstack-infra | 20:39 | |
openstackgerrit | Matthew Thode proposed openstack/project-config master: add version map for python3.6 to 3.7 https://review.opendev.org/657044 | 20:52 |
*** ijw has quit IRC | 20:55 | |
*** ijw has joined #openstack-infra | 20:56 | |
openstackgerrit | Stephen Finucane proposed openstack/project-config master: Retire bilean, python-bileanclient https://review.opendev.org/656856 | 21:00 |
*** betherly has joined #openstack-infra | 21:01 | |
gmann | mriedem: you might need to take all things base job's pre.yaml does and then extend it to policy role for host: controller | 21:02 |
gmann | this one - https://opendev.org/openstack/devstack/src/branch/master/.zuul.yaml#L291 | 21:03 |
gmann | as you are overriding the complete pre-run | 21:04 |
openstackgerrit | Stephen Finucane proposed openstack/project-config master: Retire hurricane https://review.opendev.org/656862 | 21:05 |
*** lucasagomes has joined #openstack-infra | 21:05 | |
*** betherly has quit IRC | 21:06 | |
openstackgerrit | Vitaliy Lotorev proposed zuul/zuul master: Add proxy settings for Zuul scheduler https://review.opendev.org/657048 | 21:07 |
mriedem | gmann: i'll cut my right arm off before doing that | 21:07 |
*** jamesmcarthur has joined #openstack-infra | 21:07 | |
openstackgerrit | Vitaliy Lotorev proposed zuul/zuul master: Add proxy settings for Zuul scheduler https://review.opendev.org/657048 | 21:08 |
aspiers | infra-root: https://cfp.all-systems-go.io/ASG2018/talk/207/ is the talk I just mentioned (sorry for those not at PTG) | 21:08 |
fungi | thanks aspiers! | 21:09 |
*** bnemec has quit IRC | 21:11 | |
*** ricolin has quit IRC | 21:12 | |
openstackgerrit | Stephen Finucane proposed openstack/project-config master: Retire aeromancer https://review.opendev.org/657054 | 21:16 |
*** e0ne has quit IRC | 21:18 | |
gmann | mriedem: i am worried about log files but waiting for gate results | 21:19 |
*** slaweq has quit IRC | 21:21 | |
*** bnemec has joined #openstack-infra | 21:21 | |
*** ijw has quit IRC | 21:22 | |
*** ijw has joined #openstack-infra | 21:22 | |
openstackgerrit | Dirk Mueller proposed opendev/system-config master: Add mirroring for Stein packages https://review.opendev.org/655686 | 21:24 |
openstackgerrit | Dirk Mueller proposed opendev/system-config master: Properly mirror the lxc container images as well https://review.opendev.org/655895 | 21:24 |
*** e0ne has joined #openstack-infra | 21:25 | |
*** ccamacho has quit IRC | 21:25 | |
*** sdatko has quit IRC | 21:26 | |
*** slaweq has joined #openstack-infra | 21:27 | |
*** ijw has quit IRC | 21:29 | |
*** ijw has joined #openstack-infra | 21:29 | |
*** ijw has quit IRC | 21:30 | |
*** ijw has joined #openstack-infra | 21:30 | |
openstackgerrit | Stephen Finucane proposed openstack/project-config master: Retire aeromancer https://review.opendev.org/657054 | 21:31 |
openstackgerrit | Stephen Finucane proposed openstack/project-config master: Initiate retirement of aeromancer https://review.opendev.org/657059 | 21:31 |
*** rfolco|ruck has quit IRC | 21:32 | |
*** ralonsoh has quit IRC | 21:32 | |
*** betherly has joined #openstack-infra | 21:33 | |
*** Weifan has quit IRC | 21:34 | |
openstackgerrit | Stephen Finucane proposed openstack/project-config master: Retire mors https://review.opendev.org/657061 | 21:36 |
*** betherly has quit IRC | 21:37 | |
*** uberjay has quit IRC | 21:39 | |
*** lewo has quit IRC | 21:39 | |
*** csatari has quit IRC | 21:39 | |
*** dancek has quit IRC | 21:39 | |
*** gary_perkins has quit IRC | 21:39 | |
*** woojay has quit IRC | 21:39 | |
*** mgagne has quit IRC | 21:39 | |
*** mugsie has quit IRC | 21:39 | |
*** ricolin has joined #openstack-infra | 21:40 | |
*** freerunner has quit IRC | 21:42 | |
corvus | mordred: http://logs.openstack.org/71/656871/10/check/system-config-run-eavesdrop/71bb94f/ara-report/result/a4da2b8a-ba30-4312-a465-7948fa7d878e/ | 21:42 |
openstackgerrit | Stephen Finucane proposed openstack/project-config master: Initiate retirement of hurricane https://review.opendev.org/657065 | 21:42 |
openstackgerrit | Stephen Finucane proposed openstack/project-config master: Retire alexandria https://review.opendev.org/657066 | 21:42 |
mordred | corvus: looking | 21:42 |
corvus | mordred: so we're back at the missing puppet module mystery | 21:42 |
*** MarkMaglana has quit IRC | 21:43 | |
*** jamespage has quit IRC | 21:43 | |
*** jroll has quit IRC | 21:43 | |
*** dustinc has quit IRC | 21:43 | |
*** dtantsur has quit IRC | 21:43 | |
*** cjloader has quit IRC | 21:43 | |
*** persia has quit IRC | 21:43 | |
*** gema has quit IRC | 21:43 | |
*** stevebaker has quit IRC | 21:43 | |
*** ericyoung has quit IRC | 21:43 | |
*** freerunner has joined #openstack-infra | 21:44 | |
*** cgoncalves has quit IRC | 21:44 | |
aspiers | infra-root: https://dirkmueller.github.io/presentation-berlin-log-classify/#/7 | 21:45 |
*** ijw has quit IRC | 21:45 | |
*** ralonsoh has joined #openstack-infra | 21:45 | |
*** ijw has joined #openstack-infra | 21:46 | |
*** cgoncalves has joined #openstack-infra | 21:47 | |
stephenfin | AJaeger: I think that's enough project retirement emails for one day | 21:47 |
*** betherly has joined #openstack-infra | 21:53 | |
*** bdodd has quit IRC | 21:54 | |
*** mattw4 has quit IRC | 21:55 | |
*** mattw4 has joined #openstack-infra | 21:55 | |
*** betherly has quit IRC | 21:58 | |
openstackgerrit | James E. Blair proposed opendev/system-config master: Split the base playbook into services https://review.opendev.org/656871 | 21:58 |
*** jbadiapa has joined #openstack-infra | 21:58 | |
*** jamesmcarthur has quit IRC | 21:59 | |
*** jamesmcarthur has joined #openstack-infra | 22:01 | |
*** jamesmcarthur has quit IRC | 22:02 | |
*** yamamoto has joined #openstack-infra | 22:03 | |
*** gary_perkins has joined #openstack-infra | 22:07 | |
*** uberjay has joined #openstack-infra | 22:07 | |
*** dancek has joined #openstack-infra | 22:07 | |
*** yamamoto has quit IRC | 22:07 | |
*** csatari has joined #openstack-infra | 22:07 | |
*** persia has joined #openstack-infra | 22:07 | |
*** stevebaker has joined #openstack-infra | 22:08 | |
*** jamespage has joined #openstack-infra | 22:08 | |
*** dustinc has joined #openstack-infra | 22:08 | |
*** ericyoung has joined #openstack-infra | 22:08 | |
*** jroll has joined #openstack-infra | 22:08 | |
*** MarkMaglana has joined #openstack-infra | 22:08 | |
*** pfallenop has quit IRC | 22:08 | |
smcginnis | stephenfin: Love seeing those! | 22:09 |
*** dtantsur has joined #openstack-infra | 22:10 | |
*** mugsie has joined #openstack-infra | 22:10 | |
*** mgagne has joined #openstack-infra | 22:10 | |
rm_work | clarkb: ok so they've failed, I need to send you ssh pubkeys? | 22:10 |
clarkb | rm_work: ya if you can give me a pubkey I'll add it to the host | 22:11 |
clarkb | hosts* | 22:11 |
clarkb | pm is fine | 22:12 |
*** rfarr__ has joined #openstack-infra | 22:13 | |
rm_work | i mean, it's pubkeys | 22:13 |
rm_work | but sure :D | 22:13 |
clarkb | ya it just helpskeeps noise out of the channel | 22:13 |
fungi | though usually it's just a url to a pubkey somewhere else ;) | 22:14 |
*** pfallenop has joined #openstack-infra | 22:14 | |
*** rlandy has quit IRC | 22:15 | |
clarkb | rm_work: ssh root@104.239.174.153 and ssh root@104.239.174.143 | 22:16 |
clarkb | fungi: ya rm_work gave me a paste link but often people splat them straight into irc | 22:16 |
*** rfarr_ has quit IRC | 22:16 | |
clarkb | rm_work: I don't know which is which in your test so oyu'll have to cross check agains the test job inventory | 22:16 |
rm_work | ok | 22:17 |
rm_work | yeah we can see | 22:17 |
*** rfarr_ has joined #openstack-infra | 22:18 | |
rm_work | 153=controller, 143=controller2 | 22:18 |
*** ralonsoh has quit IRC | 22:19 | |
*** rfarr__ has quit IRC | 22:21 | |
*** yamamoto has joined #openstack-infra | 22:21 | |
*** sshnaidm|ptg has quit IRC | 22:21 | |
*** quiquell has quit IRC | 22:22 | |
*** lucasagomes has quit IRC | 22:22 | |
*** rfarr_ has quit IRC | 22:23 | |
*** niceplace has quit IRC | 22:27 | |
*** slaweq has quit IRC | 22:29 | |
rm_work | clarkb: so if we do changes and it triggers another check, will those failed nodes also hold, or not? | 22:32 |
rm_work | (did you do a limit-1 hold, or indefinite?) | 22:32 |
clarkb | I think I did the one | 22:33 |
*** niceplace has joined #openstack-infra | 22:33 | |
clarkb | yup no existing holds | 22:33 |
clarkb | er autoholds in zuul | 22:33 |
*** betherly has joined #openstack-infra | 22:35 | |
rm_work | kk that's fine, i'll ping you again if i need another :) | 22:36 |
*** ijw has quit IRC | 22:38 | |
*** ijw has joined #openstack-infra | 22:39 | |
*** ijw_ has joined #openstack-infra | 22:40 | |
*** betherly has quit IRC | 22:40 | |
*** ricolin has quit IRC | 22:40 | |
*** ijw_ has quit IRC | 22:41 | |
*** jbryce has quit IRC | 22:42 | |
*** jbryce has joined #openstack-infra | 22:42 | |
*** ijw_ has joined #openstack-infra | 22:42 | |
*** ijw has quit IRC | 22:47 | |
*** ijw_ has quit IRC | 22:47 | |
*** ijw has joined #openstack-infra | 22:47 | |
*** cjloader has joined #openstack-infra | 22:47 | |
*** ijw has quit IRC | 22:47 | |
*** sshnaidm|ptg has joined #openstack-infra | 22:47 | |
*** openstackstatus has quit IRC | 22:47 | |
*** ijw has joined #openstack-infra | 22:47 | |
*** e0ne has quit IRC | 22:47 | |
*** ijw has quit IRC | 22:49 | |
*** Ng has quit IRC | 22:49 | |
*** eumel8 has quit IRC | 22:49 | |
*** Ng has joined #openstack-infra | 22:50 | |
*** egonzalez has quit IRC | 22:50 | |
*** egonzalez has joined #openstack-infra | 22:50 | |
*** e0ne has joined #openstack-infra | 22:50 | |
*** e0ne has quit IRC | 22:50 | |
*** e0ne has joined #openstack-infra | 22:51 | |
*** dklyle has quit IRC | 22:51 | |
*** e0ne has quit IRC | 22:51 | |
*** e0ne has joined #openstack-infra | 22:52 | |
*** bgmccollum has quit IRC | 22:53 | |
openstackgerrit | Merged zuul/zuul master: Restore posargs when running stestr https://review.opendev.org/657020 | 22:53 |
*** wendar has joined #openstack-infra | 22:55 | |
*** ricolin has joined #openstack-infra | 22:55 | |
*** bgmccollum has joined #openstack-infra | 22:56 | |
rm_work | clarkb: so after adding the ip to br-infra it still doesn't work, BUT it looks like there's a duplicate route on br-ex to that ipv6 subnet, and when we remove THAT one, it works | 22:57 |
*** e0ne has quit IRC | 22:57 | |
rm_work | i am assuming neutron adds that one | 22:57 |
clarkb | ya br-ex is nwutron | 22:58 |
*** cgoncalves has quit IRC | 22:58 | |
*** ccamacho has joined #openstack-infra | 22:58 | |
clarkb | I wonder if neutron filters it on br-ex so VMs cant talk to the control plane | 22:58 |
*** cgoncalves has joined #openstack-infra | 22:58 | |
*** ricolin has quit IRC | 23:00 | |
*** cgoncalves has quit IRC | 23:02 | |
*** e0ne has joined #openstack-infra | 23:03 | |
*** cgoncalves has joined #openstack-infra | 23:04 | |
*** e0ne has quit IRC | 23:05 | |
rm_work | yeah, *I* have no idea how I'd fix that, but hopefully johnsom is on it ;) | 23:05 |
*** e0ne has joined #openstack-infra | 23:05 | |
*** mriedem has quit IRC | 23:07 | |
*** e0ne has quit IRC | 23:08 | |
*** bnemec has quit IRC | 23:11 | |
*** tosky has quit IRC | 23:13 | |
*** bgmccollum has quit IRC | 23:13 | |
fungi | mordred: corvus: looking at the new run failures on 656871 it seems like maybe the job isn't finding the openstack_project module in system-config when installing puppet modules and so later the puppet run breaks on global site manifest references to our server classes? http://logs.openstack.org/71/656871/11/check/system-config-run-base/5b12895/trusty/syslog.txt.gz#_May__3_22_22_11 | 23:14 |
*** aaronsheffield has quit IRC | 23:14 | |
*** Lucas_Gray has joined #openstack-infra | 23:15 | |
*** mattw4 has quit IRC | 23:16 | |
*** betherly has joined #openstack-infra | 23:18 | |
*** eharney has quit IRC | 23:18 | |
*** bgmccollum has joined #openstack-infra | 23:18 | |
*** yamamoto has quit IRC | 23:19 | |
*** bnemec has joined #openstack-infra | 23:19 | |
*** Goneri has quit IRC | 23:22 | |
*** betherly has quit IRC | 23:23 | |
*** jbadiapa has quit IRC | 23:25 | |
*** mriedem has joined #openstack-infra | 23:29 | |
*** tdasilva has quit IRC | 23:31 | |
*** cloudnull has joined #openstack-infra | 23:36 | |
*** eglute has joined #openstack-infra | 23:37 | |
*** d34dh0r53 has joined #openstack-infra | 23:37 | |
*** efried has quit IRC | 23:38 | |
*** betherly has joined #openstack-infra | 23:39 | |
*** Weifan has joined #openstack-infra | 23:39 | |
*** betherly has quit IRC | 23:43 | |
*** jbadiapa has joined #openstack-infra | 23:49 | |
*** Weifan has quit IRC | 23:51 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!