Monday, 2019-08-26

*** dsneddon has joined #rdo00:00
rdogerritrdo-trunk proposed rdoinfo master: Promote CBS tags update for queens-release  https://review.rdoproject.org/r/2191400:04
rdogerritrdo-trunk proposed rdoinfo master: Promote CBS tags update for rocky-release  https://review.rdoproject.org/r/2191500:05
rdogerritrdo-trunk proposed rdoinfo master: Bump rdoinfo train-uc tags to latest upper-constraints  https://review.rdoproject.org/r/2189800:05
*** dsneddon has quit IRC00:05
*** d0ugal has quit IRC00:05
*** d0ugal has joined #rdo00:21
*** dsneddon has joined #rdo00:38
*** dsneddon has quit IRC00:43
rdogerritrdo-trunk created rdoinfo master: CBS tags sync with uc for train-candidate  https://review.rdoproject.org/r/2194400:45
*** imcleod has joined #rdo00:47
*** fultonj has joined #rdo00:50
*** dsneddon has joined #rdo01:11
*** holser has joined #rdo01:11
*** imcleod has quit IRC01:15
*** dsneddon has quit IRC01:16
*** imcleod has joined #rdo01:18
*** imcleod has quit IRC01:23
*** dsneddon has joined #rdo01:50
*** imcleod has joined #rdo01:54
*** dsneddon has quit IRC01:55
*** imcleod has quit IRC02:20
*** imcleod has joined #rdo02:20
*** dsneddon has joined #rdo02:27
*** dsneddon has quit IRC02:32
*** imcleod has quit IRC02:33
*** imcleod has joined #rdo02:58
*** dsneddon has joined #rdo03:06
*** dsneddon has quit IRC03:11
*** rcernin_ has joined #rdo03:15
*** rcernin has quit IRC03:15
*** imcleod has quit IRC03:34
*** chasmo77 has quit IRC03:41
*** dsneddon has joined #rdo03:44
*** hamzy_ has joined #rdo03:48
*** aakarsh|2 has quit IRC03:49
*** dsneddon has quit IRC03:49
*** hamzy has quit IRC03:51
*** ykarel has joined #rdo03:59
*** ramishra has joined #rdo04:01
*** udesale has joined #rdo04:05
*** surpatil has joined #rdo04:18
*** ykarel has quit IRC04:19
rdogerritMerged rdoinfo master: Promote CBS tags update for queens-release  https://review.rdoproject.org/r/2191404:22
*** dsneddon has joined #rdo04:23
*** ykarel has joined #rdo04:24
*** dsneddon has quit IRC04:27
*** raukadah is now known as chkumar|rover04:37
rdogerritYatin Karel proposed openstack/ironic-distgit rpm-master: Add test dependency: ddt  https://review.rdoproject.org/r/2193904:50
rdogerritMerged rdoinfo master: Promote CBS tags update for stein-testing  https://review.rdoproject.org/r/2190104:55
*** dsneddon has joined #rdo05:02
rdogerritMerged rdoinfo master: Pin octavia-tempest-plugin to latest commit hash  https://review.rdoproject.org/r/2186805:16
*** beekneemech has quit IRC05:16
*** bnemec has joined #rdo05:20
*** aufi has joined #rdo05:27
*** dsneddon has quit IRC05:35
rdogerritMerged rdoinfo master: Promote CBS tags update for rocky-release  https://review.rdoproject.org/r/2191505:39
rdogerritMerged openstack/tempestconf-distgit rpm-master: Replace os-client-config by openstacksdk  https://review.rdoproject.org/r/2192905:50
*** jaosorior has joined #rdo05:51
*** surpatil has quit IRC06:02
*** dsneddon has joined #rdo06:06
*** dsneddon has quit IRC06:11
*** cylopez has joined #rdo06:16
*** rcernin_ has quit IRC06:18
*** ykarel is now known as ykarel|afk06:21
*** dpawlik has joined #rdo06:23
*** jcapitao|off has joined #rdo06:31
*** ykarel|afk is now known as ykarel06:32
*** takamatsu has joined #rdo06:34
*** dsneddon has joined #rdo06:37
*** holser has quit IRC06:37
*** jcapitao|off is now known as jcapitao06:41
*** holser has joined #rdo06:41
*** dsneddon has quit IRC06:41
*** takamatsu has quit IRC06:42
*** avivgts has quit IRC07:00
*** ykarel is now known as ykarel|afk07:01
*** jcapitao has quit IRC07:05
*** jlibosva has joined #rdo07:06
*** jtomasek has joined #rdo07:07
*** dsneddon has joined #rdo07:10
*** jpena|off is now known as jpena07:11
*** jcapitao has joined #rdo07:14
*** dsneddon has quit IRC07:15
*** mpeterson has quit IRC07:16
*** sshnaidm|afk is now known as sshnaidm07:16
*** dgurtner has joined #rdo07:17
*** mpeterson has joined #rdo07:18
*** mpeterson has quit IRC07:19
*** mpeterson has joined #rdo07:21
*** jfrancoa has joined #rdo07:29
rdogerritMerged openstack/ironic-distgit rpm-master: Add test dependency: ddt  https://review.rdoproject.org/r/2193907:31
*** paramite has quit IRC07:33
*** paramite has joined #rdo07:33
*** ykarel|afk is now known as ykarel07:43
*** apetrich has joined #rdo07:43
dr_gogeta86morning all07:45
*** holser has quit IRC07:46
ykareljpena, can u get https://review.opendev.org/#/c/678169/1 merged07:48
jpenaykarel: sure07:48
ykareljpena, Thanks, it should unblock phase 107:48
ykarelhttps://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo_trunk-promote-master-current-tripleo/07:49
jpenaykarel: I'm checking the scenario004 issue with stein, I think I got something last Friday07:49
ykareljpena, cool07:49
ykareljpena, is it related to eventlet + wsgi?07:50
jpenaykarel: no, it was one of the watcher tempest tests that was getting stuck07:50
*** dsneddon has joined #rdo07:50
jpenabut I want to confirm07:50
ykareljpena, okk07:50
ykareljpena, i too fired a reproducer before i left for PTO07:51
ykarellet me check if it reproduced07:51
rdogerritSagi Shnaidman created rdo-jobs master: DNM: test sa with rhel  https://review.rdoproject.org/r/2194507:53
dr_gogeta86hi guys07:53
dr_gogeta86nobody here got problems with nova_compute07:53
dr_gogeta86after a while 30minutes health check fails07:54
*** dsneddon has quit IRC07:58
*** jfrancoa has quit IRC08:03
rdogerritMerged config master: Vexxhost periodic job  https://review.rdoproject.org/r/2188108:04
ykareljpena, in my local reproducer it seems tempest returned failure after 4 days as per logs08:04
ykareli ran on 21st and failure logs are from 25th08:05
jpenaykarel: if you have a chance, try running "tempest run --regex watcher_tempest_plugin.tests.api.admin.test_action_plan.TestCreateDeleteExecuteActionPlan.test_execute_action_plan"08:05
jpenathat single test hung for me most of the times it ran08:05
jpenasometimes it just passed08:05
ykareljpena, /me running08:05
*** jpich has joined #rdo08:07
*** avivgts has joined #rdo08:08
*** derekh has joined #rdo08:09
ykareljpena, it finished but failed08:13
ykarelAssertionError08:14
jpenaykarel: hm, interesting. I'm testing on a new instance, let's see08:14
ykareljpena, ack08:15
*** jfrancoa has joined #rdo08:18
*** gfidente has joined #rdo08:18
*** alexmcleod has joined #rdo08:22
*** zerick has quit IRC08:25
*** ykarel is now known as ykarel|lunch08:26
*** dsneddon has joined #rdo08:27
*** janki has joined #rdo08:29
*** dsneddon has quit IRC08:32
*** janki has quit IRC08:32
*** janki has joined #rdo08:34
rdogerritSagi Shnaidman proposed rdo-jobs master: DNM: test sa with rhel  https://review.rdoproject.org/r/2194508:39
*** ramishra has quit IRC08:43
*** Caterpillar2 has quit IRC08:43
*** ramishra has joined #rdo08:46
*** dtantsur|afk is now known as dtantsur08:46
*** Caterpillar has joined #rdo08:49
jpenaykarel|lunch: this time, it passed https://ci.centos.org/job/weirdo-stein-promote-puppet-openstack-scenario004/148/console08:49
* jpena loves heisenbugs08:49
*** strigazi has joined #rdo08:58
*** dsneddon has joined #rdo09:01
*** avivgts has quit IRC09:03
*** dsneddon has quit IRC09:06
*** holser has joined #rdo09:07
*** ykarel|lunch is now known as ykarel09:07
ykareljpena, it fails randomly only09:07
jpenaykarel: yes, it seems so09:08
jpenaI've tried that test 10 times in a row, it always passed09:08
jpenalast Friday, it got stuck more than 50% of the times09:08
ykareljpena, can u check /var/log/httpd/watcher_wsgi_error_ssl.log09:10
ykareli noticed errors in it related to eventlet thread when it fails09:10
jpenaykarel: I'll kick it again, I have already deleted the VM09:10
ykareljpena, ack09:10
*** pppingme has quit IRC09:13
*** rcernin_ has joined #rdo09:14
*** avivgts has joined #rdo09:17
*** avivgts has quit IRC09:35
*** avivgts has joined #rdo09:36
dr_gogeta86nobody here got nova-compute stuck over 30 miniutes09:36
dr_gogeta86if i send SIGKILL doesn't work09:36
dr_gogeta86if I try to strace it the container restart itself09:37
*** chem has joined #rdo09:37
*** dsneddon has joined #rdo09:40
*** rcernin_ has quit IRC09:42
*** jpich has quit IRC09:44
*** jpich has joined #rdo09:44
*** dsneddon has quit IRC09:44
*** ccamposr has joined #rdo09:45
*** apetrich has quit IRC09:49
*** holser has quit IRC09:50
rdogerritSagi Shnaidman proposed rdo-jobs master: DNM: test sa with rhel  https://review.rdoproject.org/r/2194509:50
*** holser has joined #rdo09:50
rdogerritGabriele Cerami proposed rdo-jobs master: Move registry login integration test from config  https://review.rdoproject.org/r/2159309:55
rdogerritGabriele Cerami proposed rdo-jobs master: Move registry login integration test from config  https://review.rdoproject.org/r/2159309:58
*** jpich has quit IRC10:08
jpenaykarel: good news. I have been able to reproduce the issue on a local VM -> http://paste.openstack.org/show/764382/10:17
jpenasame eventlet-related issue as you saw10:18
ykareljpena, okk good10:18
ykarelnow we need to see why we only see it in stein10:19
*** dsneddon has joined #rdo10:19
*** dsneddon has quit IRC10:24
*** jaosorior has quit IRC10:26
*** morazi has quit IRC10:27
jpenaykarel: https://review.opendev.org/648596 is master-only10:33
ykareljpena, nice10:34
ykarelbut still why we started seeing it recently10:34
ykarelanyway good to backport eventlet and wsgi patch10:35
jpenawatcher stable/stein hasn't changed in months10:35
jpenaso it can be an external change (maybe eventlet or mod_wsgi update?)10:35
ykareli don't think we have updated those recently10:36
*** jpich has joined #rdo10:51
*** surpatil has joined #rdo10:55
*** dsneddon has joined #rdo10:59
*** dsneddon has quit IRC11:04
*** udesale has quit IRC11:04
*** jcapitao is now known as jcapitao|lunch11:06
*** tesseract has joined #rdo11:12
*** jpich has quit IRC11:21
*** ccamacho has joined #rdo11:21
*** jpena is now known as jpena|lunch11:25
*** jpich has joined #rdo11:28
*** dsneddon has joined #rdo11:30
*** dsneddon has quit IRC11:35
*** apetrich has joined #rdo11:41
*** Garyx has quit IRC11:43
*** jaosorior has joined #rdo11:44
*** jpich has quit IRC11:50
*** sasha1 has joined #rdo11:50
*** rh-jelabarre has joined #rdo11:53
*** rcernin_ has joined #rdo11:54
*** rlandy has joined #rdo11:59
*** rlandy is now known as rlandy|ruck11:59
*** derekh has quit IRC12:00
*** jcapitao|lunch is now known as jcapitao12:00
*** morazi has joined #rdo12:02
*** dsneddon has joined #rdo12:05
*** weshay_MOD is now known as weshay12:07
*** artom has joined #rdo12:09
*** dsneddon has quit IRC12:10
*** jpich has joined #rdo12:24
*** surpatil has quit IRC12:25
*** jpena|lunch is now known as jpena12:30
*** Vorrtex has joined #rdo12:31
*** rcernin_ has quit IRC12:32
*** nweinber has joined #rdo12:36
*** xek_ has joined #rdo12:42
*** dsneddon has joined #rdo12:44
*** xek_ has quit IRC12:47
*** dsneddon has quit IRC12:48
sshnaidmjpena, hi12:53
sshnaidmjpena, wrt rhel8 and python2, it's not dependency, it's installed intentionally - I sent "dnf history" in the mail12:53
sshnaidmjpena, right after rhui repos installation12:53
jpenasshnaidm: hm, then maybe it was added to the qcow2 image we are using as a base12:54
jpenatristanC: are you familiar with ^^ ?12:54
*** mcornea has joined #rdo12:55
sshnaidmit would help if we knew in which step rhui repos are installed, where is this code?12:55
*** jmlowe has quit IRC12:56
tristanCjpena: not really, but i can look, what is the affected nodepool label?12:57
jpenatristanC: upstream-rhel-8. The rhel8 image was manually modified to include the RHUI repo, and it looks like python2 was added, too12:58
rdogerritGabriele Cerami proposed rdo-infra/ci-config master: [WIP] Staging promoter provisioning  https://review.rdoproject.org/r/2190912:58
rdogerritGabriele Cerami proposed rdo-infra/ci-config master: [WIP] setup staging environment  https://review.rdoproject.org/r/2189512:58
*** slaweq has joined #rdo12:58
tristanCjpena: i see that here indeed: https://softwarefactory-project.io/cgit/config/tree/nodepool/elements/rhel-8-packages-needs/install.d/10-packages#n2812:59
tristanCthough, there is no "python2" in https://softwarefactory-project.io/nodepool-log/upstream-rhel-8-0000000069.log13:00
*** Goneri has joined #rdo13:02
rdogerritGabriele Cerami proposed rdo-jobs master: Move registry login integration test from config  https://review.rdoproject.org/r/2159313:02
rdogerritSagi Shnaidman proposed rdo-jobs master: DNM: test sa with rhel  https://review.rdoproject.org/r/2194513:07
*** eharney has quit IRC13:09
sshnaidmtristanC, where is done this step? "dnf -y install /tmp/rdo-rhui-2.1-1.noarch.rpm"13:12
*** janki has quit IRC13:12
*** jpich has quit IRC13:15
*** jpich has joined #rdo13:15
*** jmlowe has joined #rdo13:16
*** dsneddon has joined #rdo13:18
tristanCsshnaidm: where do you see that step?13:18
*** haleyb|away is now known as haleyb13:21
*** dsneddon has quit IRC13:23
*** ykarel is now known as ykarel|away13:26
sshnaidmtristanC, in dnf history on the image13:31
sshnaidmtristanC, will add you to ML13:31
sshnaidmtristanC, http://paste.openstack.org/show/764546/13:34
*** slaweq has quit IRC13:36
*** jpich has quit IRC13:43
*** jpich has joined #rdo13:43
*** imcleod has joined #rdo13:49
rdogerritSagi Shnaidman proposed rdo-jobs master: DNM: test sa with rhel  https://review.rdoproject.org/r/2194513:50
*** dsneddon has joined #rdo13:56
*** dsneddon has quit IRC14:00
*** apetrich has quit IRC14:00
*** eharney has joined #rdo14:01
tristanCsshnaidm: jpena: perhaps https://softwarefactory-project.io/r/16137 is the correct fix for rhel8 issue?14:02
*** apetrich has joined #rdo14:03
sshnaidmtristanC, well, the problem is bigger now, python2 is not only installed on the image, it's also the default python interpreter there14:06
sshnaidmtristanC, it affects our python scripts in CI14:06
sshnaidmtristanC, I suppose it will work for ansible, but still need to remove it from there14:06
chkumar|rovertristanC: sshnaidm https://softwarefactory-project.io/r/#/c/15834/ we added the same type of patch for python_path initially and then removed it after adding rhel-8 package needs14:09
sshnaidmchkumar|rover, well, there was python, not python314:10
sshnaidmpython is default for ansible anyway14:11
chkumar|roveryes, sorry14:11
*** aakarsh|2 has joined #rdo14:12
*** eharney has quit IRC14:20
*** eharney has joined #rdo14:23
rdogerritChandan Kumar created rdo-jobs master: [DNM] testing queens upgrade  https://review.rdoproject.org/r/2194614:25
*** bdodd has joined #rdo14:28
*** zigo has joined #rdo14:30
*** dsneddon has joined #rdo14:30
*** dsneddon has quit IRC14:35
*** jpich has quit IRC14:35
*** jbadiapa has quit IRC14:36
*** jpich has joined #rdo14:39
*** jbadiapa has joined #rdo14:43
*** jpich has quit IRC14:49
*** jpich has joined #rdo14:51
dr_gogeta86anybody can help me with a dying nova-compute15:04
*** jpich has quit IRC15:05
rdogerritMerged rdoinfo master: Bump Ansible to 2.8.4 for Train  https://review.rdoproject.org/r/2189415:06
*** dsneddon has joined #rdo15:08
phillwdr_gogeta86: I've done a quick dig of support channels and for nova support #openstack-nova (the development channel) says to use #openstack for questions. They should be more able to assist you.15:12
dr_gogeta86tnx15:12
*** ykarel|away has quit IRC15:12
*** dsneddon has quit IRC15:13
*** jpich has joined #rdo15:16
*** jcapitao is now known as jcapitao|off15:29
*** hamzy_ is now known as hamzy15:30
*** avivgts has quit IRC15:32
*** dsneddon has joined #rdo15:45
*** dsneddon has quit IRC15:50
*** jpich has quit IRC15:50
*** slaweq has joined #rdo15:56
*** morazi has quit IRC16:01
*** jpena is now known as jpena|off16:02
*** jfrancoa has quit IRC16:03
tristanCsshnaidm: chkumar|rover: ok, we are rebuilding the upstream-rhel-8 image without python2 package, once it's online i think we'll need https://softwarefactory-project.io/r/#/c/16137/16:05
*** morazi has joined #rdo16:06
*** sabedevops has joined #rdo16:06
*** cylopez has quit IRC16:06
*** dsneddon has joined #rdo16:08
sshnaidmtristanC, cool, but if we use zuul with ansible 2.8 we don't need this I think16:09
tristanCsshnaidm: iirc zuul still set the python_interpreter ansible variable whatever the job.ansible-version attribute is16:10
*** ramishra has quit IRC16:11
sshnaidmtristanC, hmm.. really? that's not good16:11
*** jpich has joined #rdo16:14
*** dgurtner has quit IRC16:16
*** jlibosva has quit IRC16:16
chkumar|rovertristanC: sshnaidm https://opendev.org/zuul/zuul/src/branch/master/zuul/executor/server.py#L137416:16
chkumar|roveris it causes the problem?16:16
sshnaidmchkumar|rover, well, it means we really need this patch above ^16:17
*** matbu has quit IRC16:17
chkumar|roveror we fix the zuul to point to python316:17
tristanCchkumar|rover:   sshnaidm also mentioned that python2 is the default interpreter and it affects other python scripts16:18
sshnaidmchkumar|rover, idk, may break other hosts16:19
*** sabedevops has quit IRC16:19
chkumar|roversshnaidm: or we can let ansible discover that part and set it approritaly as per ansible-2.8?16:19
sshnaidmchkumar|rover, it's supported from 2.8, so I suppose when zuul will use it as default, it's possible16:20
*** aufi has quit IRC16:26
*** chasmo77 has joined #rdo16:26
rdogerritrdo-trunk created openstack/tripleoclient-distgit rpm-master: python-tripleoclient: failed to build c513e49  https://review.rdoproject.org/r/2194716:37
*** jlibosva has joined #rdo16:43
*** jlibosva has quit IRC16:48
*** alexmcleod has quit IRC16:48
*** jlibosva has joined #rdo16:49
*** slaweq has quit IRC16:55
rdogerritrdo-trunk created openstack/tripleoclient-distgit rpm-master: python-tripleoclient: failed to build c513e497  https://review.rdoproject.org/r/2194816:56
*** tesseract has quit IRC16:57
*** jlibosva has quit IRC16:59
*** eharney has quit IRC17:00
*** slaweq has joined #rdo17:00
*** slaweq_ has joined #rdo17:05
*** slaweq has quit IRC17:05
*** avivgts has joined #rdo17:12
*** jpich has quit IRC17:12
*** morazi has quit IRC17:20
*** morazi has joined #rdo17:21
*** chkumar|rover is now known as raukadah17:21
*** jlibosva has joined #rdo17:24
*** dtantsur is now known as dtantsur|afk17:25
*** jlibosva has quit IRC17:30
rdogerritGabriele Cerami proposed rdo-infra/ci-config master: [WIP] setup staging environment  https://review.rdoproject.org/r/2189517:35
*** gfidente is now known as gfidente|sad_sum17:50
*** eharney has joined #rdo18:03
*** jlibosva has joined #rdo18:18
*** morazi has quit IRC18:20
*** dgurtner has joined #rdo18:25
openstackgerritMerged x/packstack master: Replace ceilometer central agent by polling agent  https://review.opendev.org/67816918:25
*** jlibosva has quit IRC18:25
rdogerritJon Schlueter created openstack/octavia-distgit rpm-master: Convert to autosetup  https://review.rdoproject.org/r/2194918:40
jschluetercgoncalves: ^^ patch to allow better patching with rdopkg patch for octavia that we were discussing18:42
jschlueterwe should get additional eyes on it to make sure I didn't miss anything18:42
cgoncalvesthanks!18:44
*** brault has joined #rdo18:51
*** brault has quit IRC18:56
*** xek_ has joined #rdo18:58
*** slaweq_ has quit IRC19:01
*** jcapitao|off has quit IRC19:09
*** jlibosva has joined #rdo19:09
*** jlibosva has quit IRC19:13
rdogerritrdo-trunk created rdoinfo master: CBS tags sync with uc for train-candidate  https://review.rdoproject.org/r/2195019:18
*** morazi has joined #rdo19:19
*** jlibosva has joined #rdo19:24
*** jlibosva has quit IRC19:30
*** pppingme has joined #rdo19:31
*** gfidente|sad_sum has quit IRC19:35
*** jlibosva has joined #rdo19:54
*** xek_ has quit IRC20:00
*** morazi has quit IRC20:01
*** jlibosva has quit IRC20:01
*** morazi has joined #rdo20:01
*** pppingme has quit IRC20:11
*** jlibosva has joined #rdo20:16
*** jlibosva has quit IRC20:21
*** dgurtner has quit IRC20:22
rdogerritrdo-trunk created openstack/tripleoclient-distgit rpm-master: python-tripleoclient: failed to build c513e49  https://review.rdoproject.org/r/2195120:28
*** slaweq has joined #rdo20:29
*** jmlowe has quit IRC20:38
*** aakarsh|2 has quit IRC20:40
*** Vorrtex has quit IRC20:45
*** jlibosva has joined #rdo20:51
*** nweinber has quit IRC20:55
*** jlibosva has quit IRC20:55
*** Goneri has quit IRC20:57
*** slaweq has quit IRC21:01
*** morazi has quit IRC21:04
*** morazi has joined #rdo21:17
rdogerritRafael Folco proposed rdo-infra/ci-config master: [WIP] Staging promoter provisioning  https://review.rdoproject.org/r/2190921:18
*** pppingme has joined #rdo21:21
*** jlibosva has joined #rdo21:24
*** jlibosva has quit IRC21:30
*** holser has quit IRC21:31
*** tonyb has quit IRC21:39
*** morazi has quit IRC21:51
*** morazi has joined #rdo21:57
*** morazi has quit IRC22:07
*** morazi has joined #rdo22:16
*** jlibosva has joined #rdo22:19
*** jlibosva has quit IRC22:23
*** eharney has quit IRC22:26
*** jmlowe has joined #rdo22:41
*** rcernin has joined #rdo22:45
*** morazi has quit IRC23:01
*** mcornea has quit IRC23:03
*** morazi has joined #rdo23:07
*** slaweq has joined #rdo23:11
*** jlibosva has joined #rdo23:13
*** slaweq has quit IRC23:16
*** jlibosva has quit IRC23:18
*** morazi has quit IRC23:20
*** jlibosva has joined #rdo23:24
*** morazi has joined #rdo23:25
*** imcleod has quit IRC23:27
*** jlibosva has quit IRC23:29
*** morazi has quit IRC23:33
*** morazi has joined #rdo23:37
rdogerritGabriele Cerami proposed rdo-infra/ci-config master: [WIP] setup staging environment  https://review.rdoproject.org/r/2189523:40
*** pppingme has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!