| corvus | fungi: weird, http://logs.openstack.org/86/567686/4/check/zuul-website-build/1afdfb7/html/ does work for me in chromium | 00:03 |
|---|---|---|
| *** gyee has quit IRC | 00:04 | |
| *** aeng has joined #openstack-infra | 00:04 | |
| *** dave-mccowan has quit IRC | 00:05 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [dnm] testing zuul logs with_items https://review.openstack.org/567703 | 00:05 |
| *** tosky has quit IRC | 00:08 | |
| *** dayou_ has joined #openstack-infra | 00:09 | |
| clarkb | corvus: works for me too | 00:10 |
| clarkb | in my chrome install for flash and mp4 | 00:10 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [dnm] testing zuul logs with_items https://review.openstack.org/567703 | 00:13 |
| *** yolanda_ has joined #openstack-infra | 00:13 | |
| *** yolanda has quit IRC | 00:16 | |
| openstackgerrit | Xing Zhang proposed openstack-infra/system-config master: Perform two-stage sync for RPM mirror https://review.openstack.org/567704 | 00:25 |
| xingzhang | mordred: ^ This is my thought about rpm-based repo sync, but need others more implement to solve the problem you've methioned at 13:17 | 00:25 |
| xingzhang | mordred: for rpm based distros we're mirroring using rsync and as-of-yet haven't found a good way to implement that same logic (although yum/dnf to an index refresh each time so we see that failure less frequently)13:17 | 00:25 |
| *** xingzhang has quit IRC | 00:29 | |
| *** stakeda has joined #openstack-infra | 00:32 | |
| *** hemna_ has quit IRC | 00:38 | |
| *** VW_ has quit IRC | 00:50 | |
| *** VW has joined #openstack-infra | 00:50 | |
| clarkb | I've approved the limesurvey spec. THere were no objections that I saw and it has been a long standing spec so happy to get it in | 00:51 |
| *** andreas_s has joined #openstack-infra | 00:52 | |
| openstackgerrit | Merged openstack-infra/infra-specs master: Add survey spec https://review.openstack.org/349831 | 00:55 |
| *** andreas_s has quit IRC | 00:57 | |
| *** eernst has quit IRC | 00:58 | |
| openstackgerrit | Merged openstack-infra/project-config master: publish constellations https://review.openstack.org/566176 | 01:04 |
| *** eernst has joined #openstack-infra | 01:05 | |
| *** harlowja has joined #openstack-infra | 01:06 | |
| *** r-daneel has quit IRC | 01:09 | |
| *** eernst has quit IRC | 01:10 | |
| *** ianychoi_ has quit IRC | 01:14 | |
| *** neiloy has quit IRC | 01:15 | |
| *** owalsh_ has joined #openstack-infra | 01:16 | |
| *** jamesmcarthur has joined #openstack-infra | 01:20 | |
| *** owalsh has quit IRC | 01:20 | |
| *** jamesmcarthur has quit IRC | 01:27 | |
| *** xingzhang has joined #openstack-infra | 01:30 | |
| *** xingzhang has quit IRC | 01:31 | |
| *** xingzhang has joined #openstack-infra | 01:31 | |
| *** zhangfei has joined #openstack-infra | 01:36 | |
| *** caphrim007 has joined #openstack-infra | 01:45 | |
| *** caphrim007 has quit IRC | 01:47 | |
| *** bobh has joined #openstack-infra | 01:48 | |
| *** xingzhang has quit IRC | 01:59 | |
| *** xingzhang has joined #openstack-infra | 01:59 | |
| *** harlowja has quit IRC | 02:07 | |
| *** caphrim007 has joined #openstack-infra | 02:14 | |
| *** rcernin has joined #openstack-infra | 02:14 | |
| *** alex_xu has joined #openstack-infra | 02:21 | |
| *** psachin` has joined #openstack-infra | 02:23 | |
| *** hongbin has joined #openstack-infra | 02:29 | |
| *** ianychoi has joined #openstack-infra | 02:29 | |
| *** zhangfei has quit IRC | 02:31 | |
| *** xingzhang has quit IRC | 02:32 | |
| *** xingzhang has joined #openstack-infra | 02:33 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul master: [DNM] Testing for with_items log output https://review.openstack.org/567722 | 02:34 |
| *** xingzhang has quit IRC | 02:34 | |
| *** nicolasbock has quit IRC | 02:36 | |
| *** xingzhang has joined #openstack-infra | 02:36 | |
| *** felipemonteiro has joined #openstack-infra | 02:40 | |
| *** zhangfei has joined #openstack-infra | 02:43 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul master: [DNM] Testing for with_items log output https://review.openstack.org/567722 | 02:43 |
| *** xingzhang has quit IRC | 02:47 | |
| *** dbecker has quit IRC | 02:47 | |
| *** xingzhang has joined #openstack-infra | 02:47 | |
| *** xingzhang has quit IRC | 02:50 | |
| *** xingzhang has joined #openstack-infra | 02:50 | |
| *** eernst has joined #openstack-infra | 02:51 | |
| *** andreas_s has joined #openstack-infra | 02:53 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul master: [DNM] Testing for with_items log output https://review.openstack.org/567722 | 02:55 |
| *** bobh has quit IRC | 02:58 | |
| *** andreas_s has quit IRC | 02:58 | |
| *** dbecker has joined #openstack-infra | 03:01 | |
| *** ramishra has joined #openstack-infra | 03:06 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul master: [DNM] Testing for with_items log output https://review.openstack.org/567722 | 03:09 |
| *** xingzhang has quit IRC | 03:10 | |
| *** xingzhang has joined #openstack-infra | 03:11 | |
| *** xingzhang has quit IRC | 03:11 | |
| *** xingzhang has joined #openstack-infra | 03:12 | |
| *** rm_work has quit IRC | 03:13 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul master: [DNM] Testing for with_items log output https://review.openstack.org/567722 | 03:15 |
| *** rosmaita has quit IRC | 03:16 | |
| *** rm_work has joined #openstack-infra | 03:23 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul master: [DNM] Testing for with_items log output https://review.openstack.org/567722 | 03:32 |
| *** dhajare has joined #openstack-infra | 03:35 | |
| *** agopi has joined #openstack-infra | 03:41 | |
| *** janki has joined #openstack-infra | 03:44 | |
| *** lpetrut has joined #openstack-infra | 03:45 | |
| *** VW has quit IRC | 03:46 | |
| *** cshastri has joined #openstack-infra | 03:49 | |
| *** dayou_ has quit IRC | 03:53 | |
| *** udesale has joined #openstack-infra | 03:55 | |
| *** xingzhang has quit IRC | 03:58 | |
| *** xingzhang has joined #openstack-infra | 03:59 | |
| *** hongbin has quit IRC | 03:59 | |
| *** germs has quit IRC | 04:04 | |
| *** slaweq has joined #openstack-infra | 04:10 | |
| *** slaweq has quit IRC | 04:16 | |
| *** eernst has quit IRC | 04:18 | |
| *** eernst has joined #openstack-infra | 04:18 | |
| *** gyan_ has joined #openstack-infra | 04:25 | |
| *** gyankum has joined #openstack-infra | 04:26 | |
| *** ykarel|away has joined #openstack-infra | 04:31 | |
| *** ykarel|away is now known as ykarel | 04:31 | |
| *** pgadiya has joined #openstack-infra | 04:32 | |
| *** pgadiya has quit IRC | 04:32 | |
| *** yamamoto has joined #openstack-infra | 04:37 | |
| *** Kensuke has joined #openstack-infra | 04:52 | |
| *** lpetrut has quit IRC | 04:53 | |
| *** VW has joined #openstack-infra | 04:53 | |
| *** eernst has quit IRC | 04:55 | |
| *** xingzhang has quit IRC | 04:59 | |
| *** xingzhang has joined #openstack-infra | 04:59 | |
| *** slaweq has joined #openstack-infra | 05:01 | |
| *** Kensuke has quit IRC | 05:10 | |
| *** dansmith has quit IRC | 05:11 | |
| *** mikal has joined #openstack-infra | 05:22 | |
| *** jamesmcarthur has joined #openstack-infra | 05:23 | |
| *** Kensuke has joined #openstack-infra | 05:25 | |
| *** mikal_ has quit IRC | 05:25 | |
| *** jamesdenton has quit IRC | 05:26 | |
| *** xingzhang has quit IRC | 05:27 | |
| *** xingzhang has joined #openstack-infra | 05:28 | |
| *** jamesmcarthur has quit IRC | 05:28 | |
| *** yamamoto has quit IRC | 05:31 | |
| *** aeng has quit IRC | 05:38 | |
| *** Guest7914 has joined #openstack-infra | 05:40 | |
| *** slaweq has quit IRC | 05:40 | |
| *** yamamoto has joined #openstack-infra | 05:46 | |
| *** felipemonteiro has quit IRC | 05:57 | |
| *** hemna_ has joined #openstack-infra | 05:59 | |
| *** hemna_ has quit IRC | 05:59 | |
| *** pblaho has quit IRC | 06:09 | |
| *** agopi has quit IRC | 06:10 | |
| *** pblaho has joined #openstack-infra | 06:10 | |
| *** slaweq has joined #openstack-infra | 06:11 | |
| *** xingzhang has quit IRC | 06:13 | |
| *** xingzhang has joined #openstack-infra | 06:14 | |
| *** agopi has joined #openstack-infra | 06:15 | |
| *** slaweq has quit IRC | 06:16 | |
| *** agopi has quit IRC | 06:24 | |
| *** links has joined #openstack-infra | 06:31 | |
| *** pcaruana has joined #openstack-infra | 06:32 | |
| *** zzzeek has quit IRC | 06:32 | |
| *** andreas_s has joined #openstack-infra | 06:33 | |
| *** zzzeek has joined #openstack-infra | 06:33 | |
| *** andreas_s_ has joined #openstack-infra | 06:34 | |
| *** lpetrut has joined #openstack-infra | 06:35 | |
| *** annp has quit IRC | 06:36 | |
| *** annp has joined #openstack-infra | 06:36 | |
| *** andreas_s has quit IRC | 06:37 | |
| openstackgerrit | Jeffrey Zhang proposed openstack-infra/project-config master: Retire kolla-kubernetes projects - step 2 end project gating https://review.openstack.org/567779 | 06:38 |
| *** cshastri has quit IRC | 06:43 | |
| *** Kensuke has quit IRC | 06:45 | |
| *** armaan has joined #openstack-infra | 06:47 | |
| *** cshastri has joined #openstack-infra | 06:51 | |
| *** aojea has joined #openstack-infra | 06:56 | |
| *** ccamacho has joined #openstack-infra | 07:00 | |
| *** udesale_ has joined #openstack-infra | 07:05 | |
| *** slaweq has joined #openstack-infra | 07:05 | |
| *** slaweq has quit IRC | 07:05 | |
| *** slaweq has joined #openstack-infra | 07:05 | |
| *** rpittau has quit IRC | 07:06 | |
| *** udesale has quit IRC | 07:08 | |
| *** dmellado has quit IRC | 07:09 | |
| *** dmellado has joined #openstack-infra | 07:10 | |
| *** jogo has quit IRC | 07:12 | |
| openstackgerrit | Jeffrey Zhang proposed openstack-infra/project-config master: Retire kolla-kubernetes projects - step 2 end project gating https://review.openstack.org/567779 | 07:16 |
| *** arxcruz|off is now known as arxcruz | 07:18 | |
| *** rpittau has joined #openstack-infra | 07:18 | |
| *** tesseract has joined #openstack-infra | 07:20 | |
| *** ykarel is now known as ykarel|afk | 07:22 | |
| *** amoralej|off is now known as amoralej | 07:22 | |
| *** dhajare has quit IRC | 07:23 | |
| openstackgerrit | Artem Goncharov proposed openstack-infra/nodepool master: fail to build image without known type https://review.openstack.org/566437 | 07:25 |
| *** wolverineav has joined #openstack-infra | 07:25 | |
| *** jtomasek has joined #openstack-infra | 07:30 | |
| *** alexchadin has joined #openstack-infra | 07:30 | |
| *** yamamoto_ has joined #openstack-infra | 07:36 | |
| *** ltomasbo has quit IRC | 07:36 | |
| *** dalvarez has quit IRC | 07:36 | |
| *** radez has quit IRC | 07:36 | |
| *** udesale_ has quit IRC | 07:38 | |
| *** udesale_ has joined #openstack-infra | 07:39 | |
| *** yamamoto has quit IRC | 07:39 | |
| *** jpena|off has quit IRC | 07:40 | |
| *** amoralej has quit IRC | 07:40 | |
| *** ykarel|afk is now known as ykarel | 07:41 | |
| *** ssbarnea_ has joined #openstack-infra | 07:41 | |
| *** wolverineav has quit IRC | 07:42 | |
| *** wolverineav has joined #openstack-infra | 07:42 | |
| openstackgerrit | Merged openstack-infra/yaml2ical master: Allow for meeting to be scheduled every 4 weeks. https://review.openstack.org/566335 | 07:44 |
| *** wolverineav has quit IRC | 07:47 | |
| *** jogo has joined #openstack-infra | 07:47 | |
| *** jogo has joined #openstack-infra | 07:47 | |
| *** tosky has joined #openstack-infra | 07:47 | |
| openstackgerrit | Merged openstack-infra/yaml2ical master: Document new quadweekly frequencies https://review.openstack.org/567452 | 07:48 |
| *** ssbarnea_ has quit IRC | 07:49 | |
| *** aojea has quit IRC | 07:51 | |
| *** dhajare has joined #openstack-infra | 07:54 | |
| *** jpich has joined #openstack-infra | 07:55 | |
| *** janki has quit IRC | 07:57 | |
| *** rcernin has quit IRC | 07:58 | |
| *** ykarel is now known as ykarel|lunch | 07:59 | |
| *** electrofelix has joined #openstack-infra | 08:00 | |
| *** jpena has joined #openstack-infra | 08:13 | |
| *** owalsh has joined #openstack-infra | 08:17 | |
| *** owalsh_ has quit IRC | 08:18 | |
| *** VW has quit IRC | 08:21 | |
| *** VW has joined #openstack-infra | 08:21 | |
| *** xingzhang has quit IRC | 08:25 | |
| *** lucas-afk is now known as lucasagomes | 08:25 | |
| *** xingzhang has joined #openstack-infra | 08:25 | |
| *** ltomasbo` has joined #openstack-infra | 08:30 | |
| *** alexchad_ has joined #openstack-infra | 08:30 | |
| *** ykarel|lunch is now known as ykarel | 08:30 | |
| *** mshalamov has joined #openstack-infra | 08:31 | |
| *** alexchadin has quit IRC | 08:31 | |
| evrardjp | good morning | 08:32 |
| evrardjp | is there an issue with centos images right now? | 08:32 |
| evrardjp | wow | 08:32 |
| evrardjp | that's definitely not what I meant | 08:32 |
| evrardjp | is there an issue with centos repo mirrors, like EPEL particularily? | 08:33 |
| evrardjp | as you can see here: http://logs.openstack.org/79/466179/29/check/openstack-ansible-functional-centos-7/d0f38a8/job-output.txt.gz#_2018-05-11_08_20_46_564113 we install packages, we enable EPEL, we install more packages and it fails there | 08:33 |
| *** gouthamr has quit IRC | 08:34 | |
| *** gouthamr has joined #openstack-infra | 08:36 | |
| *** gfidente has joined #openstack-infra | 08:39 | |
| *** e0ne has joined #openstack-infra | 08:40 | |
| *** xingzhang has quit IRC | 08:40 | |
| *** xingzhang has joined #openstack-infra | 08:41 | |
| *** amoralej has joined #openstack-infra | 08:42 | |
| *** VW has quit IRC | 08:47 | |
| *** VW has joined #openstack-infra | 08:48 | |
| *** gongysh has joined #openstack-infra | 08:48 | |
| *** derekh has joined #openstack-infra | 08:49 | |
| *** derekh has quit IRC | 08:50 | |
| *** derekh has joined #openstack-infra | 08:52 | |
| *** xingzhang_ has joined #openstack-infra | 09:00 | |
| *** xingzhang has quit IRC | 09:01 | |
| *** VW has quit IRC | 09:03 | |
| *** VW has joined #openstack-infra | 09:09 | |
| *** VW has quit IRC | 09:10 | |
| *** VW has joined #openstack-infra | 09:12 | |
| *** openstack has joined #openstack-infra | 09:26 | |
| *** ChanServ sets mode: +o openstack | 09:26 | |
| frickler | and back to working | 09:27 |
| frickler | evrardjp: it seems centos released 7.5 earlier, your issue might be related | 09:28 |
| *** xingzhang_ has quit IRC | 09:33 | |
| *** xingzhang has joined #openstack-infra | 09:34 | |
| *** andreas_s has quit IRC | 09:34 | |
| *** zoli is now known as zoli|lunch | 09:34 | |
| *** andreas_s has joined #openstack-infra | 09:34 | |
| *** andreas_s has quit IRC | 09:36 | |
| *** andreas_s has joined #openstack-infra | 09:36 | |
| *** yamamoto has joined #openstack-infra | 09:40 | |
| *** xingzhang has quit IRC | 09:46 | |
| *** xingzhang has joined #openstack-infra | 09:46 | |
| *** alexchad_ has quit IRC | 09:49 | |
| *** larainema has quit IRC | 09:50 | |
| *** stakeda has quit IRC | 09:51 | |
| *** gongysh has quit IRC | 09:53 | |
| *** gongysh has joined #openstack-infra | 09:53 | |
| *** ssbarnea_ has joined #openstack-infra | 09:57 | |
| *** xinliang has quit IRC | 09:57 | |
| frickler | clarkb: SotK: FYI I reproduced your earlier SB issue and created a story if you'd like to watch https://storyboard.openstack.org/#!/story/2002008 | 10:04 |
| *** VW has quit IRC | 10:04 | |
| *** VW has joined #openstack-infra | 10:05 | |
| SotK | frickler: thanks, seems like http://git.openstack.org/cgit/openstack-infra/storyboard-webclient/tree/src/app/util/service/last_location.js isn't working properly | 10:07 |
| *** armaan has quit IRC | 10:07 | |
| *** armaan has joined #openstack-infra | 10:08 | |
| *** xingzhang has quit IRC | 10:13 | |
| *** xinliang has joined #openstack-infra | 10:13 | |
| *** xinliang has quit IRC | 10:13 | |
| *** xinliang has joined #openstack-infra | 10:13 | |
| *** armaan has quit IRC | 10:14 | |
| *** armaan has joined #openstack-infra | 10:14 | |
| *** xingzhang has joined #openstack-infra | 10:16 | |
| *** xingzhang has quit IRC | 10:20 | |
| *** xinliang3 has quit IRC | 10:22 | |
| *** xinliang3 has joined #openstack-infra | 10:23 | |
| *** jamesmcarthur has joined #openstack-infra | 10:24 | |
| *** VW_ has joined #openstack-infra | 10:25 | |
| *** VW has quit IRC | 10:25 | |
| *** dtantsur|afk is now known as dtantsur | 10:28 | |
| *** jamesmcarthur has quit IRC | 10:29 | |
| *** wolverineav has joined #openstack-infra | 10:30 | |
| *** cshastri_ has joined #openstack-infra | 10:32 | |
| *** cshastri has quit IRC | 10:35 | |
| *** xinliang3 has quit IRC | 10:35 | |
| *** xinliang3 has joined #openstack-infra | 10:35 | |
| *** bhavik1 has joined #openstack-infra | 10:40 | |
| *** xinliang3 has quit IRC | 10:41 | |
| *** xinliang3 has joined #openstack-infra | 10:42 | |
| *** nicolasbock has joined #openstack-infra | 10:45 | |
| *** gongysh has quit IRC | 10:48 | |
| *** bhavik1 has quit IRC | 10:51 | |
| *** xarses has quit IRC | 10:53 | |
| *** zoli|lunch is now known as zoli | 11:00 | |
| *** VW_ has quit IRC | 11:01 | |
| andreykurilin | Hi folks! what is going on with zuul? It doesn't want to see one of my patches(rechecks, new patch-set do not work) | 11:07 |
| *** panda is now known as panda|lunch | 11:09 | |
| *** pbourke has quit IRC | 11:10 | |
| *** pbourke has joined #openstack-infra | 11:11 | |
| *** yamamoto has quit IRC | 11:12 | |
| *** lucasagomes is now known as lucas-hungry | 11:13 | |
| witek | hello, how can I change, where monasca-api documentation gets published? | 11:14 |
| witek | currently it is https://docs.openstack.org/monasca-api | 11:14 |
| witek | I would like to move it to https://docs.openstack.org/monasca | 11:15 |
| evrardjp | andreykurilin: you're not the only one :) | 11:16 |
| andreykurilin | evradjp: good. actually it is not good but at least I'm not alone :) | 11:17 |
| *** VW has joined #openstack-infra | 11:19 | |
| *** yamamoto has joined #openstack-infra | 11:20 | |
| *** agopi has joined #openstack-infra | 11:22 | |
| *** yamamoto has quit IRC | 11:25 | |
| *** xinliang has quit IRC | 11:26 | |
| *** njohnston is now known as njohnston|ooo | 11:27 | |
| *** yamamoto has joined #openstack-infra | 11:28 | |
| evrardjp | andreykurilin: I thought it was worth sharing if you missed it. | 11:28 |
| *** pblaho has quit IRC | 11:28 | |
| andreykurilin | sure, thanks | 11:28 |
| *** xinliang has joined #openstack-infra | 11:29 | |
| *** xinliang has quit IRC | 11:29 | |
| *** xinliang has joined #openstack-infra | 11:29 | |
| *** ldnunes has joined #openstack-infra | 11:30 | |
| *** pblaho has joined #openstack-infra | 11:31 | |
| odyssey4me | zuul is dead jim - it appears it's not getting gerrit events :/ | 11:34 |
| *** electrofelix has quit IRC | 11:35 | |
| *** jogo has quit IRC | 11:40 | |
| *** xinliang3 has quit IRC | 11:42 | |
| *** jogo has joined #openstack-infra | 11:43 | |
| *** jpena is now known as jpena|lunch | 11:43 | |
| *** VW has quit IRC | 11:43 | |
| *** yamamoto has quit IRC | 11:45 | |
| *** bobh has joined #openstack-infra | 11:45 | |
| *** amotoki_ has joined #openstack-infra | 11:45 | |
| *** VW_ has joined #openstack-infra | 11:47 | |
| *** amotoki__ has joined #openstack-infra | 11:54 | |
| *** yamamoto has joined #openstack-infra | 11:55 | |
| *** rosmaita has joined #openstack-infra | 11:55 | |
| *** amotoki_ has quit IRC | 11:55 | |
| *** amotoki_ has joined #openstack-infra | 11:59 | |
| *** amotoki__ has quit IRC | 12:01 | |
| *** annp has quit IRC | 12:01 | |
| *** edmondsw has joined #openstack-infra | 12:08 | |
| *** amotoki__ has joined #openstack-infra | 12:08 | |
| *** amotoki_ has quit IRC | 12:08 | |
| *** lucas-hungry is now known as lucasagomes | 12:09 | |
| *** trown|outtypewww is now known as trown | 12:09 | |
| *** mriedem has joined #openstack-infra | 12:09 | |
| *** dingyichen has quit IRC | 12:10 | |
| AJaeger | FYI, witek and myself discuss on #openstack-doc... | 12:11 |
| *** sambetts|afk is now known as sambetts | 12:11 | |
| *** yamamoto has quit IRC | 12:12 | |
| *** yamamoto has joined #openstack-infra | 12:13 | |
| *** armaan has quit IRC | 12:14 | |
| *** armaan has joined #openstack-infra | 12:15 | |
| *** agopi has quit IRC | 12:15 | |
| *** kgiusti has joined #openstack-infra | 12:15 | |
| *** agopi has joined #openstack-infra | 12:15 | |
| *** dtantsur is now known as dtantsur|brb | 12:17 | |
| *** VW_ has quit IRC | 12:18 | |
| *** VW has joined #openstack-infra | 12:18 | |
| *** bobh has quit IRC | 12:18 | |
| *** panda|lunch is now known as panda | 12:20 | |
| *** armaan has quit IRC | 12:20 | |
| *** yamamoto has quit IRC | 12:22 | |
| *** yamamoto has joined #openstack-infra | 12:23 | |
| *** auristor has quit IRC | 12:24 | |
| *** agopi has quit IRC | 12:25 | |
| *** camunoz has joined #openstack-infra | 12:27 | |
| *** yamamoto has quit IRC | 12:27 | |
| mriedem | anyone else noticing that zuul isn't picking up builds? http://grafana.openstack.org/dashboard/db/zuul-status | 12:27 |
| *** armaan has joined #openstack-infra | 12:27 | |
| mmedvede | mriedem: on the third-party CI side, I stopped seeing gerrit events | 12:33 |
| pabelanger | looks like at 09:00 UTC zuul stopped getting events | 12:33 |
| pabelanger | http://grafana.openstack.org/dashboard/db/zuul-status | 12:33 |
| pabelanger | checking logs | 12:33 |
| pabelanger | infra-root: zuul is down | 12:33 |
| pabelanger | well, not getting events from gerrit I believe | 12:34 |
| AJaeger | pabelanger: I just wanted to add a status notice - but since you're around, we can wait until you figured it out if it's quickly... | 12:34 |
| *** efried is now known as fried_rice | 12:35 | |
| *** rlandy has joined #openstack-infra | 12:35 | |
| pabelanger | pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on 'b52b0ab7c5d18bd64c3a20f5ac0c84ac3408116f.rackspaceclouddb.com' ([Errno -3] Temporary failure in name resolution)") | 12:37 |
| pabelanger | so, we had DNS issue at 9:15 | 12:37 |
| Shrews | pabelanger: interesting. that's the same error that causes zk to lose connection, too. | 12:38 |
| *** auristor has joined #openstack-infra | 12:38 | |
| pabelanger | 2018-05-11 09:24:30,261 DEBUG zuul.GerritConnection: Scheduling event from gerrit: <GerritTriggerEvent ref-replication-done git.openstack.org/openstack/horizon> | 12:38 |
| pabelanger | seems to be the last event we got from gerrit | 12:38 |
| pabelanger | 2018-05-11 09:13:20,487 ERROR zuul.Pipeline.openstack.check: Exception while reporting | 12:39 |
| Shrews | i don't see zk errors though | 12:39 |
| pabelanger | was DB error | 12:39 |
| *** cshastri_ has quit IRC | 12:39 | |
| pabelanger | I wonder if the ssh connection to gerrit was dropped and never established again, but I don't see any errors in logs for that | 12:40 |
| pabelanger | I believe we need to dump threads and see what is happening | 12:40 |
| fried_rice | Morning folks. Do we need a PTL ack for https://review.openstack.org/#/c/559769/ or can we just get it pushed? Poor orphaned #openstack-placement channel has just been pining away, "Nobody loves me, sniff sniff..." | 12:41 |
| mmedvede | I have restarted zuul on pkvmci and it started seeing events right away, so probably simply lost connection at some point | 12:42 |
| pabelanger | mmedvede: good to know, we should see why zuul didn't re-establish the connection | 12:43 |
| *** ssbarnea_ has quit IRC | 12:43 | |
| mmedvede | pabelanger: is v3 supposed to reestablish automatically? seems like v2 usually does not | 12:44 |
| *** amoralej is now known as amoralej|lunch | 12:44 | |
| *** sambetts is now known as bamsetts | 12:45 | |
| *** jroll is now known as jrollinhatin | 12:45 | |
| *** yamamoto has joined #openstack-infra | 12:46 | |
| *** yamamoto has quit IRC | 12:47 | |
| *** TheJulia is now known as needsleep | 12:47 | |
| AJaeger | fried_rice: we can only merge such change when no meetings take place... | 12:47 |
| *** yamamoto has joined #openstack-infra | 12:47 | |
| fried_rice | AJaeger: Sorry, I don't understand. | 12:48 |
| pabelanger | okay, I've sent SIGUSR2 to zuul | 12:49 |
| pabelanger | I think at this point, we should restart to get it back online? | 12:49 |
| *** krenczewski has joined #openstack-infra | 12:49 | |
| pabelanger | infra-root: ^ | 12:50 |
| *** germs has joined #openstack-infra | 12:50 | |
| *** germs has quit IRC | 12:50 | |
| *** germs has joined #openstack-infra | 12:50 | |
| AJaeger | fried_rice: as part of deplying that change, we restart the bots - and that breaks all meetings that are active. Thus, we can only merge this when no meeting happens- like perhaps later today... | 12:50 |
| *** zzzeek has quit IRC | 12:51 | |
| fried_rice | AJaeger: Ah, I see. But okay, nothing holding it up, just a lack of being on y'all's radar? Should I add some reviewers? | 12:51 |
| Shrews | pabelanger: ++ | 12:51 |
| *** jpena|lunch is now known as jpena | 12:51 | |
| *** amotoki__ has quit IRC | 12:52 | |
| *** thiagolib_ has joined #openstack-infra | 12:52 | |
| *** jcoufal has joined #openstack-infra | 12:52 | |
| *** esarault has joined #openstack-infra | 12:52 | |
| *** yamamoto_ has joined #openstack-infra | 12:53 | |
| *** zzzeek has joined #openstack-infra | 12:53 | |
| pabelanger | okay, zuul starting now | 12:54 |
| AJaeger | fried_rice: I suggest you ask again here in an hour or two when more folks are around... | 12:54 |
| fried_rice | AJaeger: Roger that, and thanks. | 12:54 |
| *** xingzhang has joined #openstack-infra | 12:56 | |
| *** yamamoto has quit IRC | 12:57 | |
| pabelanger | okay, zuul looks to be back online | 12:58 |
| *** anteaya has joined #openstack-infra | 12:58 | |
| *** openstackgerrit has joined #openstack-infra | 12:59 | |
| openstackgerrit | Witold Bedyk proposed openstack-infra/project-config master: Publish Monasca docs to docs.openstack.org/monasca https://review.openstack.org/567852 | 12:59 |
| krenczewski | pabelanger: does it picku up alle the build or should I recheck? | 12:59 |
| pabelanger | AJaeger: I think you can send your status update about the outage, it looks to have started at 09:00 UTC, if you want indicate to recheck any patches since then and now | 12:59 |
| pabelanger | krenczewski: yes, you will need to recheck | 12:59 |
| *** xingzhang has quit IRC | 13:00 | |
| pabelanger | %status notice Due to a Zuul outage, patches uploaded to Gerrit between 09:00UTC and 12:5UTC, were not properly added to Zuul. Please recheck any patches during this window and apologies for the inconvenience. | 13:03 |
| *** VW has quit IRC | 13:03 | |
| pabelanger | AJaeger: how does ^ sound? | 13:03 |
| pabelanger | Shrews:^ | 13:03 |
| pabelanger | 12:50UTC* | 13:04 |
| *** VW has joined #openstack-infra | 13:04 | |
| AJaeger | pabelanger: go ahead! | 13:04 |
| * AJaeger is in a meeting now | 13:04 | |
| Shrews | pabelanger: ++ | 13:04 |
| pabelanger | #status notice Due to a Zuul outage, patches uploaded to Gerrit between 09:00UTC and 12:50UTC, were not properly added to Zuul. Please recheck any patches during this window and apologies for the inconvenience. | 13:05 |
| openstackgerrit | Witold Bedyk proposed openstack-infra/project-config master: Publish Monasca docs to docs.openstack.org/monasca https://review.openstack.org/567852 | 13:06 |
| *** bhujay has joined #openstack-infra | 13:08 | |
| *** VW has quit IRC | 13:08 | |
| pabelanger | looks like we lost openstackstatus bot around the same time as zuul too | 13:10 |
| pabelanger | 2018-05-11 09:13:01,020 DEBUG irc.client: _dispatcher: pubmsg | 13:10 |
| pabelanger | last entry in logs | 13:10 |
| pabelanger | I've gone a head and restarted the service | 13:11 |
| *** openstackstatus has joined #openstack-infra | 13:11 | |
| *** ChanServ sets mode: +v openstackstatus | 13:11 | |
| *** ssbarnea_ has joined #openstack-infra | 13:12 | |
| *** Goneri has joined #openstack-infra | 13:12 | |
| pabelanger | #status notice Due to a Zuul outage, patches uploaded to Gerrit between 09:00UTC and 12:50UTC, were not properly added to Zuul. Please recheck any patches during this window and apologies for the inconvenience. | 13:13 |
| openstackstatus | pabelanger: sending notice | 13:13 |
| Shrews | pabelanger: status.rackspace.com indicates a router issue "between 04:13 and 04:25 CDT" | 13:14 |
| -openstackstatus- NOTICE: Due to a Zuul outage, patches uploaded to Gerrit between 09:00UTC and 12:50UTC, were not properly added to Zuul. Please recheck any patches during this window and apologies for the inconvenience. | 13:15 | |
| pabelanger | Shrews: yah, that seems to be the root cause. 2 different services had the issue | 13:15 |
| pabelanger | hopefully the thread dump will help to allow zuul to recover in the future | 13:16 |
| openstackstatus | pabelanger: finished sending notice | 13:17 |
| pabelanger | stack_dump: https://pastebin.com/raw/SUabNGZ4 | 13:19 |
| *** bhujay has quit IRC | 13:19 | |
| *** germs has quit IRC | 13:20 | |
| *** germs has joined #openstack-infra | 13:20 | |
| *** yamamoto_ has quit IRC | 13:21 | |
| fungi | checking rackspace trouble tickets, we have one over a week old (may 3) about a volume outage for afs02.dfw (main03, /dev/xvdf). unfortunately the dmesg ring buffer has spammed off any entries prior to may 5 and our syslog rotation ends with may 4 at this point | 13:24 |
| *** germs has quit IRC | 13:24 | |
| *** dklyle has quit IRC | 13:24 | |
| fungi | though /vicepa hasn't been marked read-only (i was able to `touch /vicepa/foo` with no problem) so it's _probably_ fine | 13:25 |
| *** Guest7914 is now known as superdan | 13:26 | |
| *** superdan is now known as Guest82609 | 13:26 | |
| *** armaan has quit IRC | 13:32 | |
| *** armaan has joined #openstack-infra | 13:33 | |
| *** ramishra has quit IRC | 13:33 | |
| *** jamesmcarthur has joined #openstack-infra | 13:35 | |
| *** felipemonteiro has joined #openstack-infra | 13:36 | |
| *** armaan has quit IRC | 13:37 | |
| *** VW has joined #openstack-infra | 13:38 | |
| *** bhujay has joined #openstack-infra | 13:42 | |
| openstackgerrit | Artem Goncharov proposed openstack-infra/zuul master: dont wait infinitely for the connection to zuul_console server https://review.openstack.org/567861 | 13:43 |
| *** esberglu has joined #openstack-infra | 13:44 | |
| *** gyan_ has quit IRC | 13:45 | |
| *** gyankum has quit IRC | 13:46 | |
| *** xinliang3 has joined #openstack-infra | 13:46 | |
| *** udesale_ has quit IRC | 13:48 | |
| *** hongbin has joined #openstack-infra | 13:49 | |
| *** psachin` has quit IRC | 13:50 | |
| *** radez has joined #openstack-infra | 13:51 | |
| *** armaan has joined #openstack-infra | 13:53 | |
| *** amoralej|lunch is now known as amoralej | 13:54 | |
| *** eharney has joined #openstack-infra | 13:55 | |
| *** eernst has joined #openstack-infra | 13:56 | |
| *** jcoufal_ has joined #openstack-infra | 13:56 | |
| *** bamsetts is now known as sambetts|afk | 13:56 | |
| *** germs has joined #openstack-infra | 13:59 | |
| *** germs has quit IRC | 13:59 | |
| *** germs has joined #openstack-infra | 13:59 | |
| *** jcoufal has quit IRC | 13:59 | |
| openstackgerrit | Artem Goncharov proposed openstack-infra/zuul master: fill `delta` with '0' for `creates` and `removes` command. https://review.openstack.org/567864 | 14:01 |
| *** hemna_ has joined #openstack-infra | 14:01 | |
| *** njohnston|ooo has quit IRC | 14:03 | |
| *** dklyle has joined #openstack-infra | 14:06 | |
| *** larainema has joined #openstack-infra | 14:08 | |
| kaiokmo | can I get a core look at https://review.openstack.org/#/c/566722/ | 14:11 |
| kaiokmo | thanks | 14:11 |
| *** e0ne has quit IRC | 14:12 | |
| *** e0ne has joined #openstack-infra | 14:12 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:12 | |
| *** felipemonteiro has quit IRC | 14:13 | |
| *** felipemonteiro__ has joined #openstack-infra | 14:13 | |
| *** armaan has quit IRC | 14:15 | |
| *** andreas_s has quit IRC | 14:16 | |
| *** armaan has joined #openstack-infra | 14:16 | |
| *** andreas_s has joined #openstack-infra | 14:16 | |
| *** felipemonteiro_ has quit IRC | 14:18 | |
| *** germs has quit IRC | 14:18 | |
| *** armaan has quit IRC | 14:20 | |
| *** yamamoto has joined #openstack-infra | 14:21 | |
| *** pblaho has quit IRC | 14:21 | |
| corvus | pabelanger, Shrews, fungi: the gerrit connection already sets ssh keepalives on the connection. but the logs and the stack trace suggest that wasn't effective and we received no notification that there was a problem. | 14:24 |
| *** david-lyle has joined #openstack-infra | 14:25 | |
| *** felipemonteiro__ has quit IRC | 14:25 | |
| *** r-daneel has joined #openstack-infra | 14:25 | |
| *** andreas_s has quit IRC | 14:25 | |
| *** felipemonteiro__ has joined #openstack-infra | 14:25 | |
| openstackgerrit | Merged openstack-infra/zuul-website master: Add favicon https://review.openstack.org/567685 | 14:25 |
| *** dklyle has quit IRC | 14:25 | |
| *** dklyle has joined #openstack-infra | 14:27 | |
| *** stephenfin is now known as finucannot | 14:27 | |
| *** yamamoto has quit IRC | 14:27 | |
| fungi | if the network equipment between those systems was performing some sort of state tracking and lost its state tables during the event, it could have been silently discarding subsequent packets for those active sessions unless we also turned on some sort of dead peer detection | 14:27 |
| *** Guest82609 is now known as superdan | 14:27 | |
| *** david-lyle has quit IRC | 14:27 | |
| fungi | keepalives on their own only help avoid devices thinking an idle connection is dead, but don't necessarily help peers determine that an active connection has become a black hole | 14:28 |
| corvus | fungi: hrm; i guess i was expecting that the lack of a TCP ack would make its way back to paramiko | 14:29 |
| fried_rice | Howdy again folks. PTL has acked https://review.openstack.org/#/c/559769/ -- would you please slate it for a look/merge whenever (IIUC) there is a lull in meetings? | 14:29 |
| *** melwitt is now known as jgwentworth | 14:29 | |
| corvus | fried_rice: my calendar says meetings clear at 16:00 utc | 14:30 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient master: Generate a tarball when running `grunt build` https://review.openstack.org/567429 | 14:30 |
| fried_rice | corvus: /me converts... | 14:30 |
| fungi | corvus: if it's doing something akin to ClientAliveCountMax or ServerAliveCountMax from ssh(d)_config then that is effectively dead peer detection | 14:30 |
| corvus | fried_rice: +1.5hrs | 14:30 |
| fried_rice | corvus: so 90 mins? Cool | 14:30 |
| fried_rice | thanks | 14:30 |
| *** andreas_s has joined #openstack-infra | 14:31 | |
| corvus | fungi: ... unclear: http://docs.paramiko.org/en/2.4/api/transport.html#paramiko.transport.Transport.set_keepalive | 14:31 |
| fungi | corvus: oh, yeah the TCPKeepAlive entry in the manpage indicates it should be doing dpd | 14:31 |
| fungi | if it's emulating openssh at least | 14:32 |
| corvus | fungi: i think it's *not* doing tcp keepalives | 14:32 |
| fungi | also mentions "...only uses TCP keepalives (as opposed to using ssh level keepalives), so takes a long time to notice when the connection dies. As such, you probably want the ServerAliveInterval option as well. However, this means that connections will die if the route is down temporarily..." | 14:33 |
| corvus | fungi: right, but the paramiko option doesn't sound like that at all. it says "sends a keepalive packet that the server ignores" and specifies an interval. | 14:34 |
| fungi | yeah. so set_keepalive() looks more akin to ServerAliveInterval | 14:35 |
| *** andreas_s has quit IRC | 14:35 | |
| fungi | which on its own won't do dpd unless there's some implied ServerAliveCountMax value too | 14:35 |
| corvus | NEWS: * Transport.set_keepalive() -- makes paramiko send periodic junk packets | 14:36 |
| fungi | granted, for openssh (modern versions thereof anyway) ServerAliveCountMax defaults to 3 which means if ServerAliveInterval is set then openssh will do dpd | 14:37 |
| corvus | https://github.com/paramiko/paramiko/blob/master/paramiko/transport.py#L1037 | 14:37 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove tripleo-incubator from infra systems https://review.openstack.org/565840 | 14:37 |
| fungi | corvus: yeah, looking at the code there, no dpd (unless they implemented it elsewhere) | 14:38 |
| fungi | corvus: also relevant, https://github.com/paramiko/paramiko/issues/918 | 14:40 |
| *** kaiokmo has quit IRC | 14:40 | |
| fungi | "...there's no equivalent of ServerAliveCountMax..." | 14:40 |
| fungi | patches welcome, i guess | 14:41 |
| hwoarang | hello. any cores around for an opensuse/obs mirror fix please? https://review.openstack.org/#/c/566924/ thanks! | 14:44 |
| corvus | fungi: oh..... i don't believe it calls select or poll on the sending socket | 14:44 |
| corvus | fungi: so it's just calling socket.send | 14:44 |
| fungi | corvus: however, that bug report led me down a hole to discover https://pypi.org/project/radssh/ which seems to implement its own dpd on top of paramiko | 14:45 |
| corvus | fungi: i think maybe that means it won't detect a problem until the tcp send buffer fills up? the keepalive packets it's sending are fairly small. | 14:46 |
| fungi | sounds likely so, yes | 14:46 |
| *** germs has joined #openstack-infra | 14:47 | |
| *** germs has quit IRC | 14:47 | |
| *** germs has joined #openstack-infra | 14:47 | |
| corvus | fungi: the comment https://github.com/radssh/radssh/blob/master/radssh/keepalive.py#L33 is relevant and agrees with my suspicions as i was reading the paramiko code | 14:48 |
| fungi | yeah, looks pretty trivial to duplicate (or even directly reuse as the code is bsd-licensed) | 14:49 |
| *** openstackgerrit has quit IRC | 14:49 | |
| corvus | ya. i think we should. | 14:49 |
| corvus | okay -- next problem. zuul's mailman instance is not running. | 14:50 |
| pabelanger | corvus: I haven't made any progress or debugged yet. | 14:52 |
| fungi | the smtp log's last entry was May 07 19:52:23 | 14:53 |
| fungi | same for its post log | 14:53 |
| *** germs has quit IRC | 14:53 | |
| *** kaiokmo has joined #openstack-infra | 14:53 | |
| *** andreas_s has joined #openstack-infra | 14:53 | |
| *** _mmethot_ has quit IRC | 14:54 | |
| corvus | i don't see anything useful in syslog | 14:54 |
| fungi | same. also /srv/mailman/zuul/run is empty, last modified May 7 20:24 | 14:55 |
| fungi | which is presumably when the pidfile was unlinked | 14:55 |
| fungi | so at least that gives is a ~1-minute granularity idea of when it died, for better correlation | 14:56 |
| corvus | May 7 20:24:12 lists ansible-command: Invoked with warn=True executable=None _uses_shell=True _raw_params=PATH=$PATH:/opt/puppetlabs/bin puppet --version | cut -d '.' -f 1 removes=None creates=None chdir=None | 14:56 |
| corvus | that doesn't seem like it should cause a problem | 14:56 |
| *** r-daneel has quit IRC | 14:57 | |
| corvus | fungi: i guess shrug and restart? | 14:57 |
| fungi | well, definitely restart. i'm not done shrugging yet but getting close | 14:57 |
| fungi | corvus: have a look in /var/log/auth.log | 14:59 |
| corvus | fungi: did i.... stop it to work on the env var problem and never restart it? | 15:01 |
| *** pcichy has joined #openstack-infra | 15:01 | |
| *** thiagolib_ has quit IRC | 15:02 | |
| fungi | corvus: only you can answer that ;) | 15:02 |
| *** andreas_s has quit IRC | 15:02 | |
| corvus | fungi: and yet i can't :) it seems like a plausible explanation. | 15:03 |
| corvus | welp, it's running now | 15:03 |
| corvus | fungi: sorry and thanks :) | 15:03 |
| fungi | i'd chalk it up to that and not lay awake at night wondering if we've introduced some weird crash error into mailman with our special configuration here | 15:03 |
| *** ykarel is now known as ykarel|afk | 15:04 | |
| fungi | no worries, just glad we can probably move on to more pressing issues | 15:04 |
| *** jogo has quit IRC | 15:04 | |
| fungi | after the release team meeting, i can hack on the ssh dpd addition for zuul's gerrit event stream connections if you're not already half-done typing it up | 15:05 |
| corvus | fungi: nope, it's all yours :) | 15:05 |
| fungi | cool | 15:07 |
| *** pcaruana has quit IRC | 15:07 | |
| fungi | can discuss further in #zuul if i have questions | 15:08 |
| *** andreas_s has joined #openstack-infra | 15:08 | |
| *** jiapei has joined #openstack-infra | 15:08 | |
| *** vabada2 has quit IRC | 15:09 | |
| *** jtomasek has quit IRC | 15:09 | |
| clarkb | catching up, tldr is zuul thought it was connected to gerrit but gerrit didn't agree ? | 15:10 |
| clarkb | so add better connection timeout handling zuul side? | 15:10 |
| fungi | well, _any_ timeout handling zuul side | 15:12 |
| fungi | paramiko is only sending keepalives, but won't notice if the connection goes dead | 15:13 |
| *** rpittau has quit IRC | 15:14 | |
| *** dpawlik has quit IRC | 15:15 | |
| *** andreas_s has quit IRC | 15:17 | |
| dhellmann | fungi : regarding etherpad in safari: it partially loads a page, then just seems to hang. chrome on the same machine works fine. as far as I can tell, it's getting stuck trying to load pad.js, plugin-definitions.json, and colorutils.js. I've had the problem before, sometimes only with one or two etherpads. I assume it's some dumbness in the caching behavior in the browser itself. Usually switching to chrome for a day | 15:18 |
| dhellmann | or two makes it go away | 15:18 |
| fungi | oh, weird. do you happen to have a guess as to when the behavior first cropped up for you? | 15:19 |
| dhellmann | this occurrence started within the last 2 hours some time, as I was looking at https://etherpad.openstack.org/p/rocky-relmgt-tracking | 15:20 |
| dhellmann | I hit reload to try to fix a rendering issue, and that's when it came up | 15:20 |
| clarkb | does safari have an incognito mode you can test it with ? | 15:20 |
| *** kaiokmo has quit IRC | 15:21 | |
| dhellmann | there's another regular bug with safari where I get a scary error on initial load and then hitting reload fixes it, so I assume this is just a browser behavior problem | 15:21 |
| dhellmann | clarkb : oh, good idea, let me try that | 15:21 |
| dhellmann | clarkb : yes, that does work | 15:21 |
| *** kaiokmo has joined #openstack-infra | 15:21 | |
| dhellmann | I now have one window hanging and a different window showing the page | 15:21 |
| clarkb | so probably a cache issue as you suspected and not a browser specific issue | 15:22 |
| dhellmann | I wonder if this is actually an extension problem... | 15:22 |
| clarkb | or extension ya | 15:22 |
| fungi | if it's the same "scary error" i'm thinking of, it usually happens when the client can't establish a websocket to the server for api queries, or gets disconnected mid-query | 15:22 |
| dhellmann | fungi : yeah, it's something like that, usually presented in very large unstyled type | 15:22 |
| *** andreas_s has joined #openstack-infra | 15:22 | |
| fungi | but i agree this new thing you're hitting does indeed sound like some issue caching javascript for it | 15:22 |
| dhellmann | I've seen that one so often I usually hit reload before I'm fully conscious of seeing it | 15:23 |
| dhellmann | yeah, I'm looking at clearing things up on my client side | 15:23 |
| *** yamamoto has joined #openstack-infra | 15:24 | |
| *** links has quit IRC | 15:24 | |
| fungi | speaking of etherpad (and the reason we got on that subject elsewhere before moving here), would be nice if some infra-root wants to take a look at https://review.openstack.org/567610 to upgrade etherpad.o.o before we get too close to the summit | 15:25 |
| fungi | i'm happy to perform the required service restart to pick up the new version once that's in place | 15:25 |
| dmsimard | fungi: +3 | 15:26 |
| clarkb | dmsimard: thanks. I was just confirming the lines lined up on etherpad-dev | 15:26 |
| *** andreas_s has quit IRC | 15:27 | |
| corvus | fungi: definitely don't have me perform the restart | 15:27 |
| clarkb | any other infra root want to review https://review.openstack.org/#/c/565599/2 fixes a bug in dib and adding apt repos/keys | 15:28 |
| *** mmethot has joined #openstack-infra | 15:28 | |
| clarkb | corvus: ha | 15:28 |
| *** armaan has joined #openstack-infra | 15:28 | |
| dhellmann | fungi, clarkb: clearing my cache did fix the problem | 15:29 |
| *** yamamoto has quit IRC | 15:32 | |
| clarkb | fungi: dmsimard while I'm thinking about it we might want to restart the etherpad server sunday evening to clear out connections | 15:34 |
| clarkb | er sunday before summit/forum/opendev | 15:34 |
| *** Guest6945 is now known as zeus | 15:38 | |
| *** zeus has joined #openstack-infra | 15:38 | |
| *** rlandy is now known as rlandy|brb | 15:40 | |
| *** gyee has joined #openstack-infra | 15:41 | |
| *** openstackgerrit has joined #openstack-infra | 15:42 | |
| openstackgerrit | Merged openstack-infra/system-config master: Update etherpad to 1.6.6 https://review.openstack.org/567610 | 15:42 |
| *** ykarel|afk has quit IRC | 15:43 | |
| fungi | clarkb: not a terrible idea | 15:44 |
| fungi | and possibly evenings between summit days too | 15:44 |
| *** andreas_s has joined #openstack-infra | 15:44 | |
| *** dklyle has quit IRC | 15:46 | |
| dmsimard | you mean as a way to kick people who endlessly idle on multiple etherpads ? | 15:49 |
| *** dtantsur|brb is now known as dtantsur | 15:49 | |
| clarkb | dmsimard: ya also the act of closing a laptop to move to next session tends to result in lots of close_wait sockets that hang around for a while iirc | 15:49 |
| clarkb | or is it idle_timeout? | 15:49 |
| dmsimard | I wonder if we have a way to just time people out a bit more aggressively, would be more sustainable than putting a restart in a cron :p | 15:50 |
| dmsimard | is it apache keeping the connections open ? | 15:50 |
| *** dtantsur is now known as dtantsurrealism | 15:52 | |
| clarkb | ya it is apache | 15:52 |
| clarkb | I'm sure we can timeout things more aggressively but we'd need to make sure that doesn't impact real idlers | 15:52 |
| *** rpioso|afk is now known as rpioso | 15:52 | |
| *** kaiokmo has quit IRC | 15:52 | |
| clarkb | (this is simiilar to the zuul discussion I'm sure) | 15:53 |
| *** zoli is now known as zoli|gone | 15:53 | |
| *** zoli|gone is now known as zoli | 15:53 | |
| *** r-daneel has joined #openstack-infra | 15:54 | |
| *** andreas_s has quit IRC | 15:54 | |
| dmsimard | real idlers shouldn't be allowed to idle forever ? they can just refresh to reconnect | 15:54 |
| *** kaiokmo has joined #openstack-infra | 15:55 | |
| clarkb | there is a tradeoff there (thundering herd concerns for example) | 15:56 |
| clarkb | which is another issue we've had with etherpad in the past. everyone changes sessions and bam here are a bunch of new connections or conference wifi flaps and you get them all in at once | 15:56 |
| fungi | yeah, you have hundreds of clients connected, sessions all end at the same time, those people move to somewhere else in the venue, possibly even different sections of the network coming from different nat addresses, and their browsers establish new connections while the old connections are just dead at the client end | 15:57 |
| fungi | and that inrush has in the past caused the whole service to fall over, which is then self-perpetuating because all the clients rush to reconnect as soon as they notice it went away | 15:59 |
| fungi | granted it's gotten incrementally better as we've resized the instance we're running, better tuned apache, upgraded to newer etherpad versions which themselves have fewer crash bugs or efficiency improvements | 16:00 |
| fried_rice | corvus: Is now good for https://review.openstack.org/#/c/559769/ ? | 16:00 |
| *** rlandy|brb is now known as rlandy | 16:01 | |
| *** jogo has joined #openstack-infra | 16:01 | |
| corvus | fried_rice: yep; clarkb, fungi, dmsimard: ^ want to +3 that? | 16:02 |
| clarkb | looking | 16:02 |
| clarkb | done | 16:02 |
| fried_rice | Thanks corvus clarkb and jeblair | 16:04 |
| *** kaiokmo has quit IRC | 16:05 | |
| *** bhujay has quit IRC | 16:05 | |
| *** e0ne has quit IRC | 16:06 | |
| *** slaweq has quit IRC | 16:09 | |
| * corvus is jeblair | 16:09 | |
| *** slaweq has joined #openstack-infra | 16:10 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add LOCI to StoryBoard https://review.openstack.org/566965 | 16:10 |
| *** mriedem is now known as mriedem_lunch | 16:13 | |
| *** germs has joined #openstack-infra | 16:16 | |
| *** germs has quit IRC | 16:16 | |
| *** germs has joined #openstack-infra | 16:16 | |
| *** germs has quit IRC | 16:16 | |
| *** jpich has quit IRC | 16:16 | |
| *** germs has joined #openstack-infra | 16:17 | |
| *** germs has joined #openstack-infra | 16:17 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add statusbot and meetbot to #openstack-placement https://review.openstack.org/559769 | 16:21 |
| *** dpawlik has joined #openstack-infra | 16:21 | |
| *** trown is now known as trown|lunch | 16:25 | |
| *** dpawlik has quit IRC | 16:26 | |
| *** lucasagomes is now known as lucas-afk | 16:27 | |
| *** yamamoto has joined #openstack-infra | 16:28 | |
| *** fried_rice is now known as fried_rolls | 16:31 | |
| *** yamamoto has quit IRC | 16:34 | |
| clarkb | corvus: is a phone booth involved in the transformation? | 16:35 |
| corvus | those are getting so hard to find! | 16:37 |
| corvus | not sure i can ever change back at this point | 16:38 |
| *** gfidente has quit IRC | 16:44 | |
| *** armaan_ has joined #openstack-infra | 16:46 | |
| *** armaan has quit IRC | 16:47 | |
| *** armaan has joined #openstack-infra | 16:47 | |
| *** armaan_ has quit IRC | 16:48 | |
| *** jcoufal has joined #openstack-infra | 16:51 | |
| *** jamesmcarthur has quit IRC | 16:52 | |
| *** jcoufal_ has quit IRC | 16:54 | |
| *** derekh has quit IRC | 16:55 | |
| *** tesseract has quit IRC | 16:59 | |
| dmsimard | I can totally picture that, now you need some sort of superhero costume for when you go on stage to talk about Zuul imo. | 17:00 |
| *** openstackstatus has quit IRC | 17:00 | |
| *** openstack has joined #openstack-infra | 17:02 | |
| *** ChanServ sets mode: +o openstack | 17:02 | |
| *** armaan has quit IRC | 17:11 | |
| *** armaan has joined #openstack-infra | 17:12 | |
| scas | is the documentation on zuul-ci.org geared toward 3? if i ran through the quickstart, what would i expect to come out the other side? | 17:15 |
| corvus | scas: yes it is. the quickstart is a little too "quick" though, i think. "zuul from scratch" may be more useful (and several of us have run through it recently and can confirm you'll get something working at the end) | 17:17 |
| *** dhajare has quit IRC | 17:18 | |
| corvus | scas: either way, you should end up with some running software which doesn't do anything -- they both still stop short of instruction on "how to set up some jobs to actually run a test". that's a gap i'd like to fix. | 17:18 |
| corvus | scas: the #zuul channel here in freenode also has some folks in it which will be happy to help you along and fill in the gaps | 17:19 |
| *** armaan has quit IRC | 17:20 | |
| *** armaan has joined #openstack-infra | 17:20 | |
| scas | corvus: thanks for the context. one of my extracurricular projects is to set up a private zuul instance, and, obviously, i've not gotten very far | 17:20 |
| *** armaan has quit IRC | 17:21 | |
| *** armaan has joined #openstack-infra | 17:21 | |
| *** jpena is now known as jpena|off | 17:22 | |
| corvus | scas: we're very happy to help you with that (and hopefully in the process improve our docs, which are very new and haven't gotten a lot of use from people who aren't the authors :) | 17:23 |
| *** jcoufal_ has joined #openstack-infra | 17:23 | |
| *** jcoufal has quit IRC | 17:24 | |
| *** panda is now known as panda|off | 17:28 | |
| *** jcoufal has joined #openstack-infra | 17:28 | |
| *** jcoufal_ has quit IRC | 17:30 | |
| *** yamamoto has joined #openstack-infra | 17:30 | |
| *** germs has quit IRC | 17:32 | |
| *** e0ne has joined #openstack-infra | 17:32 | |
| *** armaan has quit IRC | 17:33 | |
| *** armaan_ has joined #openstack-infra | 17:33 | |
| *** jcoufal_ has joined #openstack-infra | 17:33 | |
| *** armaan has joined #openstack-infra | 17:34 | |
| *** armaan_ has quit IRC | 17:34 | |
| scas | corvus: right on. i'm sure i'll have questions as i dig in. | 17:34 |
| *** jcoufal has quit IRC | 17:35 | |
| *** yamamoto has quit IRC | 17:36 | |
| *** jcoufal has joined #openstack-infra | 17:37 | |
| *** trown|lunch is now known as trown | 17:39 | |
| *** jcoufal_ has quit IRC | 17:40 | |
| *** mriedem_lunch is now known as mriedem | 17:40 | |
| *** jcoufal_ has joined #openstack-infra | 17:40 | |
| *** germs has joined #openstack-infra | 17:41 | |
| *** germs has quit IRC | 17:41 | |
| *** germs has joined #openstack-infra | 17:41 | |
| *** lpetrut has quit IRC | 17:41 | |
| *** jcoufal has quit IRC | 17:43 | |
| *** germs has quit IRC | 17:43 | |
| *** germs has joined #openstack-infra | 17:43 | |
| *** germs has quit IRC | 17:43 | |
| *** germs has joined #openstack-infra | 17:43 | |
| *** diablo_rojo has joined #openstack-infra | 17:48 | |
| *** jcoufal has joined #openstack-infra | 17:51 | |
| *** eernst has quit IRC | 17:52 | |
| *** rossella_s has quit IRC | 17:52 | |
| *** jcoufal_ has quit IRC | 17:53 | |
| *** dtantsurrealism is now known as dtantsur|afk | 17:55 | |
| *** jcoufal_ has joined #openstack-infra | 17:55 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool master: Use openstacksdk instead of os-client-config https://review.openstack.org/566158 | 17:55 |
| *** jcoufal has quit IRC | 17:56 | |
| *** andreas_s has joined #openstack-infra | 17:56 | |
| *** kjackal has quit IRC | 17:57 | |
| openstackgerrit | Mohammed Naser proposed openstack-infra/project-config master: Add Ubuntu Bionic to Linaro https://review.openstack.org/567917 | 17:58 |
| *** eernst has joined #openstack-infra | 17:59 | |
| mnaser | fungi, corvus, pabelanger, clarkb ^ if anyone would like to check it out | 17:59 |
| mnaser | be nice to try and it will help get coverage for zuul | 17:59 |
| *** eernst has quit IRC | 18:00 | |
| clarkb | do we need to test that it works first? I Know that ianw couldn't get a default xenial iamge booting | 18:00 |
| *** eernst has joined #openstack-infra | 18:00 | |
| *** andreas_s has quit IRC | 18:01 | |
| clarkb | I guess we can give it a go and if it fails to boot worry about it then | 18:02 |
| *** jcoufal_ has quit IRC | 18:06 | |
| *** jcoufal has joined #openstack-infra | 18:06 | |
| *** lpetrut has joined #openstack-infra | 18:10 | |
| *** jcoufal_ has joined #openstack-infra | 18:10 | |
| mnaser | clarkb: i'm going to assume most of the work to get xenial working should probably work for bionic | 18:11 |
| *** armaan has quit IRC | 18:12 | |
| *** armaan has joined #openstack-infra | 18:13 | |
| *** jcoufal has quit IRC | 18:14 | |
| *** e0ne has quit IRC | 18:14 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add Ubuntu Bionic to Linaro https://review.openstack.org/567917 | 18:14 |
| *** dhajare has joined #openstack-infra | 18:15 | |
| mnaser | ^ so whats the process, wait for puppet to run? | 18:16 |
| fungi | roughly, yes | 18:17 |
| clarkb | ya once puppet runs ndoepool will notice it needs to build and upaload that image and do so | 18:18 |
| *** antonym has quit IRC | 18:18 | |
| fungi | #status log restarted the etherpad-lite service on etherpad.openstack.org for the upgrade to 1.6.6 | 18:20 |
| openstackstatus | fungi: finished logging | 18:20 |
| fungi | looks like it's working as expected | 18:20 |
| fungi | vcsrepo does odd things with tag refs in puppet-etherpad_lite | 18:23 |
| fungi | i see it checked out a local branch named "tag/1.6.6" instead of checking out the tag | 18:23 |
| fungi | huh, i wonder if we're using it incorrectly | 18:24 |
| clarkb | I seem to recall that behavior | 18:24 |
| clarkb | I don't know why it does that though | 18:24 |
| *** eharney has quit IRC | 18:24 | |
| fungi | looks like it actually checked out master with a local branch named tag/1.6.6 | 18:24 |
| *** esberglu has quit IRC | 18:25 | |
| clarkb | hrm that doesn't seem right | 18:25 |
| *** esberglu has joined #openstack-infra | 18:26 | |
| clarkb | git show 1.6.6 matches HEAD | 18:26 |
| fungi | or it may just be that 1.6.6 and origin/master are the same ref for now | 18:26 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Fix ConfigValue comparisons https://review.openstack.org/567927 | 18:26 |
| fungi | yeah | 18:26 |
| clarkb | and the 1.6.5 branch and tag match so I think it does the right thing | 18:27 |
| *** rajinir has joined #openstack-infra | 18:27 | |
| *** jcoufal has joined #openstack-infra | 18:29 | |
| *** esberglu has quit IRC | 18:31 | |
| *** yamamoto has joined #openstack-infra | 18:32 | |
| *** jcoufal_ has quit IRC | 18:32 | |
| *** yamamoto has quit IRC | 18:36 | |
| clarkb | fungi: my clarkb-test etherpad looks fine. I do note that a hard refresh was required to get the font size and line spacing update | 18:38 |
| *** jcoufal_ has joined #openstack-infra | 18:38 | |
| *** pcichy has quit IRC | 18:40 | |
| *** jcoufal has quit IRC | 18:41 | |
| *** armaan has quit IRC | 18:43 | |
| *** armaan has joined #openstack-infra | 18:43 | |
| *** esberglu has joined #openstack-infra | 18:44 | |
| *** lpetrut has quit IRC | 18:45 | |
| *** eernst has quit IRC | 18:50 | |
| *** wolverineav has quit IRC | 18:56 | |
| *** lpetrut has joined #openstack-infra | 18:57 | |
| *** wolverineav has joined #openstack-infra | 18:57 | |
| *** mriedem is now known as mriedem_afk | 18:57 | |
| fungi | yeah, i think that's because of javascript caching | 18:59 |
| fungi | i experienced the same | 18:59 |
| pabelanger | mnaser: clarkb: corvus: I'm running reprepro export on ubuntu-ports to pick up the bionic-backports repo, since DIB is failing there | 19:02 |
| *** fried_rolls is now known as fried_rice | 19:03 | |
| clarkb | pabelanger: do we need a config update too? | 19:04 |
| *** eernst has joined #openstack-infra | 19:04 | |
| pabelanger | clarkb: I don't believe so, we're mirroring both bionic and xenial packages for arm64, just backports hasn't released anything so the folder is not created | 19:04 |
| clarkb | gotcha | 19:04 |
| *** eernst has quit IRC | 19:05 | |
| *** eernst has joined #openstack-infra | 19:05 | |
| pabelanger | we could also just remove backports from our images by default too, but that is a larger patch | 19:05 |
| *** jamesmcarthur has joined #openstack-infra | 19:07 | |
| *** ldnunes has quit IRC | 19:07 | |
| *** eernst has quit IRC | 19:07 | |
| *** ldnunes has joined #openstack-infra | 19:08 | |
| *** eernst has joined #openstack-infra | 19:08 | |
| clarkb | http://mirror.dfw.rax.openstack.org/ubuntu/dists/xenial-backports/main/binary-amd64/Packages it is a fairly small set for xenial at least | 19:08 |
| clarkb | but probably best to keep mirroring that to pick up anything useful/important should they end up there | 19:08 |
| *** eernst_ has joined #openstack-infra | 19:09 | |
| *** eernst_ has quit IRC | 19:10 | |
| *** eernst_ has joined #openstack-infra | 19:10 | |
| *** e0ne has joined #openstack-infra | 19:11 | |
| *** eernst has quit IRC | 19:11 | |
| *** xingzhang has joined #openstack-infra | 19:17 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Fix ConfigValue comparisons https://review.openstack.org/567927 | 19:17 |
| *** bnemec is now known as beekneemech | 19:20 | |
| *** jcoufal has joined #openstack-infra | 19:21 | |
| *** xingzhang has quit IRC | 19:21 | |
| *** jcoufal_ has quit IRC | 19:23 | |
| *** amoralej is now known as amoralej|off | 19:24 | |
| *** e0ne has quit IRC | 19:26 | |
| *** eernst_ has quit IRC | 19:31 | |
| *** eernst has joined #openstack-infra | 19:32 | |
| *** yamamoto has joined #openstack-infra | 19:33 | |
| *** felipemonteiro__ has quit IRC | 19:34 | |
| *** felipemonteiro_ has joined #openstack-infra | 19:34 | |
| *** jamesmcarthur has quit IRC | 19:34 | |
| *** eernst has quit IRC | 19:36 | |
| *** yamamoto has quit IRC | 19:38 | |
| *** felipemonteiro__ has joined #openstack-infra | 19:39 | |
| *** eernst has joined #openstack-infra | 19:39 | |
| *** jamesmcarthur has joined #openstack-infra | 19:40 | |
| *** jcoufal_ has joined #openstack-infra | 19:40 | |
| *** jcoufal__ has joined #openstack-infra | 19:42 | |
| *** felipemonteiro_ has quit IRC | 19:42 | |
| *** jcoufal has quit IRC | 19:43 | |
| *** jcoufal_ has quit IRC | 19:44 | |
| *** jcoufal has joined #openstack-infra | 19:45 | |
| *** jcoufal__ has quit IRC | 19:48 | |
| *** jcoufal_ has joined #openstack-infra | 19:48 | |
| *** jcoufal has quit IRC | 19:52 | |
| *** andreas_s has joined #openstack-infra | 19:58 | |
| *** dklyle has joined #openstack-infra | 19:59 | |
| *** andreas_s has quit IRC | 20:02 | |
| mnaser | is there a way to know if nodepool built something and didnt break D: | 20:07 |
| clarkb | mnaser: normally yes, but it appears that http to nb03.o.o isn't working | 20:08 |
| clarkb | mnaser: http://nb01.openstack.org/ and http://nb01.openstack.org/images would typically be the indicator though | 20:08 |
| clarkb | http://nl01.openstack.org/image-list however may be our ticket | 20:09 |
| clarkb | still only stretch and xenial. I'll have to check the build logs directly since http isn't working there | 20:09 |
| *** jamesmcarthur has quit IRC | 20:10 | |
| clarkb | mnaser: http://nl01.openstack.org/dib-image-list that says it is building | 20:11 |
| *** camunoz has quit IRC | 20:11 | |
| mnaser | i guess if that 13 turns into 14 | 20:12 |
| mnaser | and still building | 20:12 |
| mnaser | we know that something is wrong | 20:12 |
| clarkb | ya | 20:12 |
| *** jamesmcarthur has joined #openstack-infra | 20:14 | |
| *** dpawlik has joined #openstack-infra | 20:16 | |
| corvus | isn't the fact that it's 13 already mean it's a problem? or was that the thing pabelanger fixed? | 20:19 |
| corvus | ah, yes, i think so. i think i'm caught up now :) | 20:20 |
| *** dpawlik has quit IRC | 20:20 | |
| clarkb | ya, there may be more problems :) | 20:20 |
| *** dhajare has quit IRC | 20:21 | |
| corvus | we're at 14 now. the error on 13 was: | 20:21 |
| corvus | 2018-05-11 20:17:29.742 | E: Failed to fetch http://mirror.regionone.linaro.openstack.org/ubuntu-ports/dists/bionic-backports/main/binary-arm64/Packages 404 Not Found [IP: 103.20.251.153 80] | 20:21 |
| *** armaan has quit IRC | 20:22 | |
| corvus | maybe pabelanger's fix is still in progress? | 20:22 |
| *** armaan has joined #openstack-infra | 20:22 | |
| clarkb | corvus: maybe pabelanger didn't do a vos release? | 20:22 |
| corvus | i joined pabelanger's screen; looks like something is still running | 20:23 |
| corvus | yeah, reprepro is still running | 20:24 |
| corvus | in other news, i've managed to extricate the openstack theming from the zuul mailing lists. now that's done, we can probably re-theme them with the zuul logo | 20:25 |
| corvus | i admit, i rather prefer the openstack look to stock mailman :) | 20:26 |
| *** mriedem_afk is now known as mriedem | 20:26 | |
| clarkb | ha | 20:26 |
| fungi | mailman3/hyperkitty doesn't look nearly so terrible | 20:27 |
| fungi | after having gotten to use it some | 20:27 |
| *** yamamoto has joined #openstack-infra | 20:34 | |
| *** jamesmcarthur has quit IRC | 20:35 | |
| *** jamesmcarthur has joined #openstack-infra | 20:36 | |
| *** eharney has joined #openstack-infra | 20:37 | |
| *** yamamoto has quit IRC | 20:39 | |
| *** eernst has quit IRC | 20:44 | |
| *** VW_ has joined #openstack-infra | 20:44 | |
| *** eernst has joined #openstack-infra | 20:45 | |
| *** jamesmcarthur has quit IRC | 20:45 | |
| *** jamesmcarthur has joined #openstack-infra | 20:46 | |
| *** eernst has quit IRC | 20:47 | |
| *** VW has quit IRC | 20:47 | |
| *** VW_ has quit IRC | 20:49 | |
| *** felipemonteiro__ has quit IRC | 20:51 | |
| *** felipemonteiro__ has joined #openstack-infra | 20:52 | |
| *** jamesmcarthur has quit IRC | 20:54 | |
| *** lpetrut has quit IRC | 20:56 | |
| clarkb | thats weird if I telnet to nb03.o.o and GET / I get the listing of logs files | 20:58 |
| *** pcichy has joined #openstack-infra | 20:58 | |
| clarkb | and if I GET /ubuntu-bionic-arm64-0000000020.log I get the log file but if I connect with wget or firefox it fails | 20:58 |
| clarkb | is this some weird layer 7 filtering that is circumvented by my dumb client? | 20:59 |
| clarkb | fungi: corvus mnaser ^ anyone else seeing similar? | 20:59 |
| fungi | clarkb: could it be firewalling in the provider? | 20:59 |
| fungi | or security groups? | 20:59 |
| clarkb | fungi: no, port 80 works that is why it is weird. I must be layer 7 filtering because telent GET / is fine but not firefox or wget | 20:59 |
| fungi | oh, i thought you meant over localhost | 21:00 |
| *** trown is now known as trown|outtypewww | 21:00 | |
| *** antonym has joined #openstack-infra | 21:00 | |
| *** antonym has quit IRC | 21:00 | |
| *** antonym has joined #openstack-infra | 21:00 | |
| fungi | yeah, probably some sort of application layer proxy there | 21:00 |
| clarkb | because I'm not doing proper http 1.1 I wonder if its letting it through | 21:00 |
| *** jamesmcarthur has joined #openstack-infra | 21:00 | |
| fungi | maybe logan- knows? | 21:00 |
| fungi | no, wrong provider | 21:00 |
| clarkb | fungi: this is linaro, gema may know | 21:00 |
| fungi | sorry for the ping logan-! | 21:01 |
| clarkb | anyways mnaser ^ thats a really silly way of getting that info for now | 21:01 |
| *** rosmaita has quit IRC | 21:01 | |
| *** esarault has quit IRC | 21:01 | |
| fungi | gonna go grab early dinner. much progress was made getting apache mod_auth_openid working with limesurvey on the https://survey01.openstack.org/ prototype | 21:02 |
| fungi | back in a while | 21:02 |
| openstackgerrit | Anita Kuno proposed openstack-infra/system-config master: This patch impliments the survey spec: I3c389596373b94459a32a4e540d514a2941acbb1 https://review.openstack.org/557979 | 21:02 |
| anteaya | thank you fungi, enjoy food | 21:04 |
| *** jamesmcarthur has quit IRC | 21:04 | |
| *** armaan has quit IRC | 21:06 | |
| *** armaan has joined #openstack-infra | 21:06 | |
| *** jcoufal has joined #openstack-infra | 21:07 | |
| *** jcoufal__ has joined #openstack-infra | 21:09 | |
| *** jcoufal_ has quit IRC | 21:09 | |
| *** jcoufal has quit IRC | 21:12 | |
| *** ldnunes has quit IRC | 21:16 | |
| *** eernst has joined #openstack-infra | 21:21 | |
| *** rh-jelabarre has quit IRC | 21:22 | |
| *** eernst has quit IRC | 21:24 | |
| *** eernst has joined #openstack-infra | 21:25 | |
| *** pcichy has quit IRC | 21:25 | |
| *** eernst_ has joined #openstack-infra | 21:28 | |
| *** eernst has quit IRC | 21:28 | |
| mnaser | clarkb: yeah i noticed that it wasn't down but connection was being reset | 21:28 |
| mnaser | ok arm64 bionic failed | 21:32 |
| clarkb | mnaser: ya corvus mentioned that pabelanger's fix seems to still be running | 21:32 |
| clarkb | I think we are still fialing on backports | 21:33 |
| *** eernst_ has quit IRC | 21:33 | |
| *** yamamoto has joined #openstack-infra | 21:35 | |
| *** wolverineav has quit IRC | 21:39 | |
| *** wolverineav has joined #openstack-infra | 21:39 | |
| *** yamamoto has quit IRC | 21:41 | |
| *** wolverineav has quit IRC | 21:43 | |
| * clarkb is going to pop out now to spend some time with the kids. I'll check back in later. Feels like wheels are spinning anyways | 21:44 | |
| *** dklyle has quit IRC | 21:47 | |
| *** dklyle has joined #openstack-infra | 21:47 | |
| *** felipemonteiro__ has quit IRC | 21:49 | |
| *** dpawlik has joined #openstack-infra | 21:51 | |
| *** dpawlik has quit IRC | 21:51 | |
| *** dpawlik has joined #openstack-infra | 21:52 | |
| *** edmondsw has quit IRC | 21:58 | |
| *** jcoufal has joined #openstack-infra | 21:59 | |
| *** dpawlik has quit IRC | 22:00 | |
| *** edmondsw has joined #openstack-infra | 22:02 | |
| *** jcoufal__ has quit IRC | 22:03 | |
| *** rlandy has quit IRC | 22:03 | |
| *** edmondsw has quit IRC | 22:06 | |
| *** neiloy has quit IRC | 22:07 | |
| *** fried_rice is now known as efried | 22:16 | |
| *** ssbarnea_ has quit IRC | 22:16 | |
| *** slaweq has quit IRC | 22:19 | |
| fungi | i am back in case of emergencies but will be easing into my weekend and testing the micro-hdmi to $various adapters i just received to make sure i can connect to projectors from my super teeny computers | 22:23 |
| anteaya | very important | 22:24 |
| *** hemna_ has quit IRC | 22:25 | |
| *** edmondsw has joined #openstack-infra | 22:29 | |
| *** esberglu has quit IRC | 22:30 | |
| *** jcoufal_ has joined #openstack-infra | 22:34 | |
| *** jcoufal has quit IRC | 22:34 | |
| *** anteaya has quit IRC | 22:37 | |
| *** hongbin has quit IRC | 22:49 | |
| *** r-daneel has quit IRC | 23:00 | |
| *** yamamoto has joined #openstack-infra | 23:01 | |
| pabelanger | clarkb: mnaser: corvus: back now, checking progress | 23:07 |
| pabelanger | and did vos release now | 23:09 |
| pabelanger | will check back in the next hour for DIB build | 23:10 |
| *** mtreinish_ has joined #openstack-infra | 23:19 | |
| *** mtreinish has quit IRC | 23:19 | |
| *** mtreinish_ is now known as mtreinish | 23:20 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: WIP replace use of asyncio with cherrypy https://review.openstack.org/567959 | 23:25 |
| *** yamamoto has quit IRC | 23:26 | |
| *** jcoufal has joined #openstack-infra | 23:27 | |
| *** jcoufal__ has joined #openstack-infra | 23:30 | |
| *** jcoufal_ has quit IRC | 23:31 | |
| *** jcoufal_ has joined #openstack-infra | 23:32 | |
| *** mmethot has quit IRC | 23:32 | |
| *** jcoufal has quit IRC | 23:33 | |
| *** jcoufal has joined #openstack-infra | 23:35 | |
| *** jcoufal__ has quit IRC | 23:35 | |
| *** jcoufal__ has joined #openstack-infra | 23:37 | |
| *** jcoufal_ has quit IRC | 23:38 | |
| *** rpioso is now known as rpioso|afk | 23:38 | |
| *** jcoufal_ has joined #openstack-infra | 23:39 | |
| *** jcoufal has quit IRC | 23:39 | |
| *** jcoufal__ has quit IRC | 23:42 | |
| *** felipemonteiro__ has joined #openstack-infra | 23:49 | |
| *** eharney has quit IRC | 23:49 | |
| *** tosky has quit IRC | 23:55 | |
| *** jcoufal has joined #openstack-infra | 23:58 | |
| *** andreas_s has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!