*** morazi has quit IRC | 00:00 | |
*** morazi has joined #rdo | 00:02 | |
rdogerrit | rdo-trunk created rdoinfo master: Promote CBS tags update for pike-testing https://review.rdoproject.org/r/19758 | 00:03 |
---|---|---|
rdogerrit | rdo-trunk created rdoinfo master: Bump rdoinfo pike tags to latest upper-constraints https://review.rdoproject.org/r/19759 | 00:03 |
rdogerrit | rdo-trunk created rdoinfo master: Bump rdoinfo rocky tags to latest upper-constraints https://review.rdoproject.org/r/19760 | 00:04 |
rdogerrit | rdo-trunk proposed rdoinfo master: Bump rdoinfo stein-uc tags to latest upper-constraints https://review.rdoproject.org/r/19453 | 00:05 |
rdogerrit | rdo-trunk created rdoinfo master: Promote CBS tags update for queens-testing https://review.rdoproject.org/r/19761 | 00:05 |
rdogerrit | rdo-trunk created rdoinfo master: Promote CBS tags update for rocky-testing https://review.rdoproject.org/r/19762 | 00:06 |
*** mjturek has quit IRC | 00:06 | |
*** morazi has quit IRC | 00:18 | |
*** morazi has joined #rdo | 00:20 | |
*** slaweq has joined #rdo | 00:22 | |
*** slaweq has quit IRC | 00:27 | |
*** morazi has quit IRC | 00:37 | |
*** dsneddon has quit IRC | 00:40 | |
*** morazi has joined #rdo | 00:42 | |
*** dsneddon has joined #rdo | 00:57 | |
*** wolverineav has quit IRC | 01:08 | |
*** jbadiapa has quit IRC | 01:23 | |
*** jbadiapa has joined #rdo | 01:23 | |
*** Son_Goku has joined #rdo | 01:25 | |
*** rcernin has quit IRC | 01:49 | |
*** rcernin has joined #rdo | 01:53 | |
*** morazi has quit IRC | 01:55 | |
*** Son_Goku has quit IRC | 01:57 | |
*** morazi has joined #rdo | 01:57 | |
*** Son_Goku has joined #rdo | 02:12 | |
*** wolverineav has joined #rdo | 02:34 | |
*** morazi has quit IRC | 02:37 | |
*** morazi has joined #rdo | 02:40 | |
*** ykarel|away has joined #rdo | 02:52 | |
*** ramishra has joined #rdo | 03:07 | |
*** wolverineav has quit IRC | 03:08 | |
rdogerrit | rdo-trunk created puppet/puppet-mysql-distgit rpm-master: puppet-mysql: failed to build 9075bc3 https://review.rdoproject.org/r/19763 | 03:09 |
*** apetrich has quit IRC | 03:15 | |
rdogerrit | Yatin Karel created puppet/puppet-mysql-distgit rpm-master: Revert "Add patch to support RHEL 8 packaging" https://review.rdoproject.org/r/19764 | 03:17 |
*** wolverineav has joined #rdo | 03:23 | |
*** dciabrin has joined #rdo | 03:25 | |
*** dciabrin_ has quit IRC | 03:29 | |
*** ykarel|away has quit IRC | 03:32 | |
*** dsneddon has quit IRC | 03:35 | |
*** morazi has quit IRC | 03:35 | |
*** dsneddon has joined #rdo | 03:37 | |
*** morazi has joined #rdo | 03:40 | |
*** ykarel|away has joined #rdo | 03:46 | |
*** udesale has joined #rdo | 03:46 | |
*** wolverineav has quit IRC | 03:49 | |
*** wolverineav has joined #rdo | 03:50 | |
*** wolverineav has quit IRC | 03:54 | |
*** ykarel|away is now known as ykarel | 03:57 | |
rdogerrit | Yatin Karel proposed rdoinfo master: Bump rdoinfo stein-uc tags to latest upper-constraints https://review.rdoproject.org/r/19453 | 04:00 |
*** morazi has quit IRC | 04:00 | |
*** raukadah is now known as chandankumar | 04:02 | |
ykarel | chandankumar, tempest 20.0.0 release patch merged and review being proposed in stein-rdo | 04:27 |
ykarel | https://review.rdoproject.org/r/#/c/19756/ | 04:27 |
ykarel | it's failing as tempest plugins are not ready, can you add repo_bootstrap flag | 04:28 |
ykarel | and once tempest plugins are ready, remove the flag to get openstack-tempest-all | 04:28 |
chandankumar | ykarel: ack | 04:30 |
ykarel | chandankumar, also you can propose change to rdoinfo to switch dlrn stein tags to 20.0.0 | 04:30 |
chandankumar | ykarel: you mean in master or in ftbfs itself? | 04:30 |
ykarel | chandankumar, repo_bootstrap flag to be added in https://review.rdoproject.org/r/#/c/19756/ | 04:31 |
ykarel | CBS build job failing ^^ | 04:31 |
rdogerrit | Chandan Kumar proposed openstack/tempest-distgit stein-rdo: openstack-tempest-20.0.0-1 https://review.rdoproject.org/r/19756 | 04:34 |
rdogerrit | Merged openstack/manila-distgit rocky-rdo: openstack-manila-7.2.0-1 https://review.rdoproject.org/r/19757 | 04:36 |
ykarel | chandankumar, good to add like %{!?dlrn: %global repo_bootstrap 1} | 04:38 |
ykarel | otherwise openstack-tempest-all will be removed from dlrn repo | 04:39 |
rdogerrit | Chandan Kumar created rdoinfo master: Bump tempest to 20.0.0 for stein https://review.rdoproject.org/r/19765 | 04:39 |
rdogerrit | Chandan Kumar proposed openstack/tempest-distgit stein-rdo: openstack-tempest-20.0.0-1 https://review.rdoproject.org/r/19756 | 04:40 |
*** tflink has quit IRC | 04:43 | |
ykarel | chandankumar, for rdoinfo, you need to update stein-uc and stein-py3-uc, not stein.yml | 04:43 |
*** tflink has joined #rdo | 04:44 | |
*** udesale has quit IRC | 04:44 | |
*** tflink has quit IRC | 04:44 | |
*** rh-jelabarre has quit IRC | 04:46 | |
*** udesale has joined #rdo | 04:46 | |
*** tflink has joined #rdo | 04:46 | |
*** janki has joined #rdo | 04:50 | |
rdogerrit | Chandan Kumar proposed rdoinfo master: Bump tempest to 20.0.0 for stein https://review.rdoproject.org/r/19765 | 05:09 |
chandankumar | ykarel: ^^ | 05:09 |
ykarel | chandankumar, source-branch | 05:13 |
ykarel | you added against tags | 05:13 |
chandankumar | ok | 05:23 |
rdogerrit | Merged rdoinfo master: Bump rdoinfo stein-uc tags to latest upper-constraints https://review.rdoproject.org/r/19453 | 05:49 |
rdogerrit | rdo-trunk created openstack/oslo-db-distgit stein-rdo: python-oslo-db-4.45.0-1 https://review.rdoproject.org/r/19766 | 05:52 |
rdogerrit | Chandan Kumar proposed rdoinfo master: Bump tempest to 20.0.0 for stein https://review.rdoproject.org/r/19765 | 06:04 |
chandankumar | ykarel: ^^ now ok | 06:04 |
ykarel | chandankumar, yup, rebasing | 06:05 |
rdogerrit | Yatin Karel proposed rdoinfo master: Bump tempest to 20.0.0 for stein https://review.rdoproject.org/r/19765 | 06:05 |
*** mosulica has joined #rdo | 06:12 | |
*** mosulica has quit IRC | 06:19 | |
*** mosulica has joined #rdo | 06:21 | |
*** jaosorior has quit IRC | 06:26 | |
*** jaosorior has joined #rdo | 06:28 | |
rdogerrit | Yatin Karel proposed rdoinfo master: Switch to train tags https://review.rdoproject.org/r/19744 | 06:28 |
*** quiquell|off is now known as quiquell | 06:31 | |
*** jistr is now known as jistr|doc | 06:33 | |
*** ramishra_ has joined #rdo | 06:41 | |
*** ramishra has quit IRC | 06:41 | |
*** apetrich has joined #rdo | 06:52 | |
*** ramishra_ has quit IRC | 06:53 | |
*** ramishra has joined #rdo | 06:55 | |
*** ksambor has joined #rdo | 06:59 | |
*** aufi has joined #rdo | 07:02 | |
*** ccamposr has joined #rdo | 07:02 | |
*** lennyb has joined #rdo | 07:04 | |
ykarel | jaosorior, can you review https://review.rdoproject.org/r/#/c/19736/ | 07:05 |
*** jfrancoa has joined #rdo | 07:16 | |
rdogerrit | Merged openstack/novajoin-distgit rpm-master: Requirement sync for Stein https://review.rdoproject.org/r/19736 | 07:17 |
*** slaweq has joined #rdo | 07:20 | |
*** dpawlik has quit IRC | 07:20 | |
*** gfidente has joined #rdo | 07:21 | |
rdogerrit | Merged config master: Add override-checkout for rocky containers build job https://review.rdoproject.org/r/19746 | 07:25 |
*** avivgt has joined #rdo | 07:25 | |
rdogerrit | Yatin Karel created config master: Create stein-rdo branch for some more projects https://review.rdoproject.org/r/19767 | 07:28 |
*** ykarel is now known as ykarel|lunch | 07:29 | |
*** quiquell is now known as quiquell|brb | 07:33 | |
*** rpittau|afk is now known as rpittau | 07:35 | |
*** matbu has quit IRC | 07:39 | |
*** kopecmartin|off is now known as kopecmartin | 07:43 | |
*** hseipp has joined #rdo | 07:45 | |
*** cylopez has joined #rdo | 07:45 | |
*** cylopez has quit IRC | 07:53 | |
*** amoralej|off is now known as amoralej | 07:58 | |
amoralej | good morning | 08:00 |
*** holser_ has joined #rdo | 08:05 | |
*** jlibosva has joined #rdo | 08:07 | |
*** quiquell|brb is now known as quiquell | 08:08 | |
*** avivgt has quit IRC | 08:15 | |
*** cylopez has joined #rdo | 08:17 | |
*** tosky has joined #rdo | 08:17 | |
ykarel|lunch | o/ | 08:25 |
tosky | ykarel|lunch: o/ | 08:25 |
*** ykarel|lunch is now known as ykarel | 08:25 | |
ykarel | o/ | 08:26 |
tosky | ykarel: uh, I sent the review to branch the sahara plugins, but I was kind of expecting few automatic reviews to build them on cbs - did I miss anything? | 08:26 |
ykarel | tosky, since sahara-plugins were released before creating branch | 08:26 |
ykarel | tosky, i mean openstack/releases patch | 08:27 |
ykarel | when openstack/releases patch merged, stein-rdo didn't existed so automatic build didn't happened, | 08:27 |
ykarel | now you need to push changes manually to stein-rdo branch, future releases will be auto propose patch to -rdo branches | 08:28 |
tosky | d'oh | 08:28 |
*** avivgt has joined #rdo | 08:29 | |
amoralej | tosky, we have a script to create reviews in distgits for CBS builds from patches in openstack/releases | 08:29 |
amoralej | but as ykarel explained it happens when the patch in openstack/releases is merged, if distgits are branched | 08:29 |
amoralej | otherwise we run it manually | 08:29 |
tosky | did you run it manually for sahara (core) as well? | 08:30 |
tosky | oh, well, were is the script? I would end up writing one anyway | 08:30 |
amoralej | tosky, https://github.com/rdo-infra/releng | 08:31 |
amoralej | rdo_release_review | 08:31 |
ykarel | tosky, yes sahara was done using ^^ manually | 08:32 |
tosky | ah! Because in fact the first stein version was released even before the plugins | 08:32 |
*** dtantsur|afk is now known as dtantsur | 08:32 | |
*** dpawlik has joined #rdo | 08:37 | |
tosky | does the script work with python 3? | 08:38 |
*** ccamacho has joined #rdo | 08:38 | |
ykarel | not sure, i always tried in python2 venv | 08:39 |
tosky | I get an error installing the dependencies, namely pygerrit | 08:41 |
tosky | "dist must be a Distribution instance" - on Fedora 29, with --system-site-packages enabled (and now python2) | 08:42 |
tosky | isn't that an error coming from setuptools? But it seems to be the latest version | 08:43 |
ykarel | for me on f28, it's installed but with:- pygerrit 1.0.0 has requirement requests==2.9.1, but you'll have requests 2.18.4 which is incompatible. | 08:45 |
ykarel | me tried on python3 venv with --system-site-packages | 08:46 |
tosky | ykarel: and then, can you start the command? I get an error (it fails on 'from utils import...') | 08:47 |
ykarel | ModuleNotFoundError: No module named 'utils' | 08:47 |
ykarel | need to change from utils to from .utils | 08:49 |
*** shardy has joined #rdo | 08:51 | |
amoralej | ykarel, that's for python3 compatibility? | 08:51 |
tosky | it does not help the fact that pygerrit is abandoned | 08:51 |
tosky | and pygerrit2 should be used instead with python 3 | 08:51 |
amoralej | tosky, we can try to move to pygerrit2 | 08:52 |
amoralej | i'm not sure if they maintain compatibility with pygerrit apart from the ssh option removal | 08:53 |
tosky | sure, but right now I'm going to manually create those reviews | 08:53 |
tosky | enough yak shaving, it's not even 10.00 here | 08:53 |
ykarel | hmm we need to move to python3 compatible | 08:53 |
amoralej | tosky, you can run it in any centos7 | 08:54 |
tosky | amoralej: and copy keys back and forth - no :) | 08:54 |
*** jpena|off is now known as jpena | 08:56 | |
*** pcaruana has joined #rdo | 08:57 | |
*** jpich has joined #rdo | 08:57 | |
ykarel | jpena, can you please help in understanding behavior in https://review.rdoproject.org/r/#/c/19756/ | 08:59 |
jpena | ykarel: checking | 09:00 |
*** ttsiouts has joined #rdo | 09:00 | |
ykarel | ack | 09:01 |
jpena | ykarel: the DLRN-rpmbuild job sets --order to allow it to build multiple dependant packages in the right order, and that sets repo_bootstrap=1 | 09:01 |
jpena | ykarel: https://github.com/softwarefactory-project/DLRN/blob/master/scripts/run_tests.sh#L201 | 09:03 |
ykarel | jpena, mmm, same should be happening in DLRN builder also, right? meaning openstack-tempest-all will not exist when it's build by DLRN builder | 09:03 |
ykarel | when using same spec | 09:03 |
jpena | ykarel: no. That only happens in CI and during the initial bootstrap | 09:03 |
jpena | when running normally, repo_bootstrap is not set | 09:04 |
rdogerrit | Luigi Toscano created openstack/sahara-plugin-ambari-distgit stein-rdo: python-sahara-plugin-ambari-10.0.0-0.1.0rc1 https://review.rdoproject.org/r/19770 | 09:04 |
*** ramishra_ has joined #rdo | 09:04 | |
rdogerrit | Luigi Toscano created openstack/sahara-plugin-cdh-distgit stein-rdo: python-sahara-plugin-cdh-10.0.0-0.1.0rc1 https://review.rdoproject.org/r/19771 | 09:04 |
rdogerrit | Luigi Toscano created openstack/sahara-plugin-mapr-distgit stein-rdo: python-sahara-plugin-mapr-10.0.0-0.1.0rc1 https://review.rdoproject.org/r/19772 | 09:04 |
rdogerrit | Luigi Toscano created openstack/sahara-plugin-spark-distgit stein-rdo: python-sahara-plugin-spark-10.0.0-0.1.0rc1 https://review.rdoproject.org/r/19773 | 09:04 |
*** ramishra has quit IRC | 09:04 | |
rdogerrit | Luigi Toscano created openstack/sahara-plugin-storm-distgit stein-rdo: python-sahara-plugin-storm-10.0.0-0.1.0rc1 https://review.rdoproject.org/r/19774 | 09:04 |
rdogerrit | Luigi Toscano created openstack/sahara-plugin-vanilla-distgit stein-rdo: python-sahara-plugin-vanilla-10.0.0-0.1.0rc1 https://review.rdoproject.org/r/19775 | 09:05 |
tosky | ok, hopefully it should work | 09:05 |
ykarel | jpena, okk got it https://github.com/rdo-infra/puppet-dlrn/blob/master/files/run-dlrn.sh#L34 | 09:05 |
ykarel | ^^ no --order | 09:05 |
jpena | ykarel: exact | 09:05 |
ykarel | jpena, okk then we can merge tempest patch | 09:05 |
tosky | uh, no, I forgot that we choose a different versioning | 09:06 |
tosky | grrr | 09:06 |
ykarel | jpena, Thanks for clearing | 09:08 |
jpena | no worries | 09:08 |
*** ramishra_ has quit IRC | 09:10 | |
*** ttsiouts has quit IRC | 09:10 | |
rdogerrit | Luigi Toscano proposed openstack/sahara-plugin-ambari-distgit stein-rdo: python-sahara-plugin-ambari-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19770 | 09:10 |
rdogerrit | Luigi Toscano proposed openstack/sahara-plugin-cdh-distgit stein-rdo: python-sahara-plugin-cdh-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19771 | 09:11 |
rdogerrit | Luigi Toscano proposed openstack/sahara-plugin-mapr-distgit stein-rdo: python-sahara-plugin-mapr-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19772 | 09:11 |
rdogerrit | Luigi Toscano proposed openstack/sahara-plugin-spark-distgit stein-rdo: python-sahara-plugin-spark-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19773 | 09:11 |
rdogerrit | Luigi Toscano proposed openstack/sahara-plugin-storm-distgit stein-rdo: python-sahara-plugin-storm-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19774 | 09:11 |
rdogerrit | Luigi Toscano proposed openstack/sahara-plugin-vanilla-distgit stein-rdo: python-sahara-plugin-vanilla-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19775 | 09:12 |
ykarel | tosky, you can use -u <user> -e <email> to use your intials in changelog | 09:12 |
ykarel | with rdopkg new-version command | 09:12 |
*** ttsiouts has joined #rdo | 09:13 | |
tosky | ykarel: is it important? I followed the same pattern of the reviews that you sent for sahara and sahara-ui | 09:13 |
ykarel | tosky, okk for now, in future u can use | 09:13 |
*** ramishra has joined #rdo | 09:14 | |
tosky | I just want to do things as it should have be done - should I change the name and email then? | 09:14 |
*** jistr|doc is now known as jistr | 09:15 | |
amoralej | jpena, ykarel wtyt if we update deps to start using train cbs tags also in https://review.rdoproject.org/r/#/c/19744/ ? | 09:16 |
amoralej | i think there is no problem in doing it in two steps | 09:16 |
amoralej | but it may be good to switch both | 09:16 |
tosky | ykarel: sooo... name and email change? I'd like to close this task | 09:16 |
rdogerrit | Luigi Toscano proposed openstack/sahara-plugin-ambari-distgit stein-rdo: python-sahara-plugin-ambari-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19770 | 09:17 |
rdogerrit | Luigi Toscano proposed openstack/sahara-plugin-cdh-distgit stein-rdo: python-sahara-plugin-cdh-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19771 | 09:18 |
*** d0ugal has quit IRC | 09:18 | |
rdogerrit | Luigi Toscano proposed openstack/sahara-plugin-mapr-distgit stein-rdo: python-sahara-plugin-mapr-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19772 | 09:18 |
jpena | amoralej: do we have the cbs tags already? | 09:18 |
rdogerrit | Luigi Toscano proposed openstack/sahara-plugin-spark-distgit stein-rdo: python-sahara-plugin-spark-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19773 | 09:18 |
ykarel | tosky, ^^ OKK | 09:19 |
rdogerrit | Luigi Toscano proposed openstack/sahara-plugin-storm-distgit stein-rdo: python-sahara-plugin-storm-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19774 | 09:19 |
amoralej | jpena, yes | 09:19 |
rdogerrit | Luigi Toscano proposed openstack/sahara-plugin-vanilla-distgit stein-rdo: python-sahara-plugin-vanilla-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19775 | 09:19 |
jpena | amoralej: then I'm ok with it | 09:19 |
ykarel | amoralej, you mean tag deps to train-testing? | 09:20 |
amoralej | jpena, https://bugs.centos.org/view.php?id=15931 | 09:20 |
amoralej | ykarel, yes | 09:20 |
amoralej | i mean creating the files under buildsys-tags for train | 09:20 |
amoralej | train-el7-build train-candidate and train-testing | 09:20 |
amoralej | and copy deps freom stein | 09:21 |
amoralej | then update scripts to sync deps and BRs to use train | 09:21 |
ykarel | amoralej, okk for me to do in single step | 09:21 |
*** ksambor has quit IRC | 09:22 | |
amoralej | i think it's better tbh | 09:22 |
ykarel | amoralej, sure will update the patch, amoralej can you check tempest 20.0.0 patches | 09:23 |
ykarel | https://review.rdoproject.org/r/#/c/19756/ and https://review.rdoproject.org/r/#/c/19765/ | 09:23 |
ykarel | will rebase rdoinfo patch on ^^ | 09:23 |
rdogerrit | Yatin Karel proposed config master: Create stein-rdo branch for some more projects https://review.rdoproject.org/r/19767 | 09:25 |
*** cylopez has left #rdo | 09:29 | |
rdogerrit | Félix Enrique Llorente Pastora created rdo-infra/ci-config master: [POC][rrcockpit] telegraf prometheus output plugin https://review.rdoproject.org/r/19776 | 09:35 |
rdogerrit | Merged config master: Create stein-rdo branch for some more projects https://review.rdoproject.org/r/19767 | 09:36 |
rdogerrit | Merged openstack/tempest-distgit stein-rdo: openstack-tempest-20.0.0-1 https://review.rdoproject.org/r/19756 | 09:37 |
*** dr_gogeta86 has joined #rdo | 09:38 | |
*** derekh has joined #rdo | 09:39 | |
rdogerrit | Merged rdoinfo master: Bump tempest to 20.0.0 for stein https://review.rdoproject.org/r/19765 | 09:39 |
rdogerrit | Yatin Karel proposed rdoinfo master: Switch to train tags and buildsys-tags https://review.rdoproject.org/r/19744 | 09:43 |
ykarel | amoralej, ^^ | 09:44 |
rdogerrit | Javier Peña proposed rdo-jobs master: Switch default rdoinfo tag to train-uc https://review.rdoproject.org/r/19749 | 09:45 |
rdogerrit | Yatin Karel proposed rdoinfo master: Switch to train tags and buildsys-tags https://review.rdoproject.org/r/19744 | 09:46 |
*** matbu has joined #rdo | 09:54 | |
rdogerrit | Yatin Karel created config master: Switch master release to train https://review.rdoproject.org/r/19777 | 09:56 |
*** mosulica has quit IRC | 09:57 | |
*** cylopez has joined #rdo | 10:00 | |
*** jtomasek has joined #rdo | 10:00 | |
rdogerrit | Yatin Karel created rdo-infra/puppet-dlrn master: Set master branch to train in update_deps.sh https://review.rdoproject.org/r/19778 | 10:01 |
*** cylopez has left #rdo | 10:09 | |
*** mosulica has joined #rdo | 10:11 | |
*** paramite has joined #rdo | 10:13 | |
*** dsneddon has quit IRC | 10:16 | |
*** mosulica has quit IRC | 10:19 | |
*** mosulica has joined #rdo | 10:20 | |
*** dpawlik has quit IRC | 10:34 | |
*** dpawlik has joined #rdo | 10:35 | |
rdogerrit | Merged openstack/oslo-db-distgit stein-rdo: python-oslo-db-4.45.0-1 https://review.rdoproject.org/r/19766 | 10:42 |
rdogerrit | Merged openstack/sahara-plugin-cdh-distgit stein-rdo: python-sahara-plugin-cdh-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19771 | 10:43 |
rdogerrit | Merged openstack/sahara-plugin-ambari-distgit stein-rdo: python-sahara-plugin-ambari-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19770 | 10:43 |
rdogerrit | Merged openstack/sahara-plugin-spark-distgit stein-rdo: python-sahara-plugin-spark-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19773 | 10:44 |
rdogerrit | Merged openstack/ansible-role-openstack-operations-distgit rpm-master: Add ansible-pacemaker as a dependency https://review.rdoproject.org/r/19018 | 10:45 |
*** aedc has joined #rdo | 10:46 | |
rdogerrit | Merged openstack/sahara-plugin-mapr-distgit stein-rdo: python-sahara-plugin-mapr-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19772 | 10:46 |
rdogerrit | Merged openstack/sahara-plugin-storm-distgit stein-rdo: python-sahara-plugin-storm-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19774 | 10:46 |
rdogerrit | Merged openstack/sahara-plugin-vanilla-distgit stein-rdo: python-sahara-plugin-vanilla-1.0.0-0.1.0rc1 https://review.rdoproject.org/r/19775 | 10:47 |
*** holser_ is now known as holser|lunch | 10:47 | |
*** mvkr has joined #rdo | 10:51 | |
*** rcernin has quit IRC | 10:51 | |
*** ramishra has quit IRC | 10:56 | |
*** ramishra has joined #rdo | 10:59 | |
rdogerrit | Yatin Karel created gating_scripts master: Switch master release to train for deps update https://review.rdoproject.org/r/19779 | 11:06 |
*** zbr|ssbarnea has quit IRC | 11:06 | |
*** zbr has joined #rdo | 11:07 | |
rdogerrit | Yatin Karel proposed rdoinfo master: Switch to train tags and buildsys-tags https://review.rdoproject.org/r/19744 | 11:07 |
rdogerrit | Yatin Karel proposed rdoinfo master: Switch to train tags and buildsys-tags https://review.rdoproject.org/r/19744 | 11:08 |
rdogerrit | Luigi Toscano created openstack/sahara-distgit stein-rdo: Post-boostrap, re-enable the dependency on the plugins https://review.rdoproject.org/r/19780 | 11:09 |
rdogerrit | Javier Peña proposed rdo-infra/rdo-infra-playbooks master: Use OpenShift Origin 3.11 for registry https://review.rdoproject.org/r/18876 | 11:10 |
*** jtomasek has quit IRC | 11:18 | |
*** aedc has quit IRC | 11:19 | |
rdogerrit | rdo-trunk created openstack/placement-distgit stein-rdo: openstack-placement-1.0.0-0.2.0rc2 https://review.rdoproject.org/r/19781 | 11:21 |
*** dsneddon has joined #rdo | 11:29 | |
rdogerrit | Juan Badia Payno created config master: Creates new branch rocky-rdo https://review.rdoproject.org/r/19782 | 11:32 |
*** bhavyabapna_ has joined #rdo | 11:34 | |
bhavyabapna_ | anyone here? | 11:34 |
bhavyabapna_ | need help | 11:34 |
amoralej | how can we help you bhavyabapna_ ? | 11:35 |
rdogerrit | Yatin Karel created openstack/sahara-image-elements-distgit stein-rdo: sahara-image-elements-10.0.0-0.1.0rc1 https://review.rdoproject.org/r/19783 | 11:48 |
*** rh-jelabarre has joined #rdo | 11:53 | |
*** imcleod has joined #rdo | 11:59 | |
*** morazi has joined #rdo | 11:59 | |
*** jtomasek has joined #rdo | 12:00 | |
*** number80 is now known as hguemar|lunch | 12:00 | |
*** hguemar|lunch is now known as number80 | 12:00 | |
*** quiquell is now known as quiquell|lunch | 12:01 | |
rdogerrit | Yatin Karel created openstack/ironic-staging-drivers-distgit stein-rdo: openstack-ironic-staging-drivers-0.11.0-1 https://review.rdoproject.org/r/19784 | 12:05 |
*** jtomasek has quit IRC | 12:05 | |
*** jtomasek has joined #rdo | 12:12 | |
*** rlandy has joined #rdo | 12:13 | |
*** jtomasek has quit IRC | 12:13 | |
*** trown|outtypewww is now known as trown | 12:17 | |
*** jpich has quit IRC | 12:19 | |
*** jcoufal has joined #rdo | 12:20 | |
*** dprince has joined #rdo | 12:25 | |
*** jtomasek has joined #rdo | 12:26 | |
ykarel | amoralej, jpena can we create link https://trunk.rdoproject.org/fedora28-stein/stable-base/ | 12:33 |
ykarel | to point to fedora28-master | 12:33 |
amoralej | yeah, good point | 12:33 |
jpena | sure, I'll do it | 12:33 |
ykarel | too quick :) | 12:34 |
ykarel | it's there | 12:34 |
*** jpich has joined #rdo | 12:35 | |
*** mvkr has quit IRC | 12:37 | |
ykarel | Following packages are not installed | 12:37 |
ykarel | 2019-03-27 12:36:56.193761 | rdo-centos-7 | python-dogpile-core-0.4.1-2.el7.noarch | 12:37 |
ykarel | 2019-03-27 12:36:56.193995 | rdo-centos-7 | python-subprocess32-3.2.6-4.el7.x86_64 | 12:37 |
ykarel | amoralej, switch to train failed ^^ | 12:38 |
amoralej | ykarel, let me check | 12:38 |
ykarel | and we are too close to timeout, so need to consider updating it | 12:38 |
*** pcaruana has quit IRC | 12:39 | |
amoralej | ykarel, there is newer one in base? | 12:39 |
ykarel | amoralej, yes | 12:40 |
amoralej | ok, we can remove it from train-testing then | 12:40 |
ykarel | python2-subprocess32-3.2.6-13.el7.x86_64.rpm | 12:40 |
ykarel | looking for dogpile | 12:40 |
*** pcaruana has joined #rdo | 12:42 | |
*** pcaruana has quit IRC | 12:42 | |
*** pcaruana has joined #rdo | 12:43 | |
*** kgiusti has joined #rdo | 12:45 | |
*** jpena is now known as jpena|lunch | 12:46 | |
ykarel | amoralej, python-dogpile-core is not in base | 12:46 |
amoralej | mmm | 12:46 |
amoralej | what's the problem then? | 12:46 |
amoralej | there is other dogpile, iirc | 12:47 |
amoralej | dogpile-cache or dogpile | 12:47 |
amoralej | they may have an obsoletes | 12:47 |
amoralej | on dogpile-core | 12:47 |
*** holser|lunch is now known as holser_ | 12:48 | |
*** udesale has quit IRC | 12:48 | |
*** imcleod has quit IRC | 12:48 | |
ykarel | amoralej, right:- Package python-dogpile-core is obsoleted by python2-dogpile-cache, trying to install python2-dogpile-cache-0.6.8-1.el7.noarch instead | 12:48 |
amoralej | ok, we can get rid of dogpile-core, then | 12:49 |
ykarel | Package python-subprocess32 is obsoleted by python2-subprocess32, trying to install python2-subprocess32-3.2.6-13.el7.x86_64 instead | 12:49 |
*** udesale has joined #rdo | 12:49 | |
ykarel | amoralej, okk, let's also update the timeout | 12:49 |
amoralej | ack | 12:49 |
*** mcornea has joined #rdo | 12:52 | |
*** imcleod has joined #rdo | 12:52 | |
rdogerrit | Yatin Karel created rdo-jobs master: Temporary increase timeout for validate-buildsys job https://review.rdoproject.org/r/19785 | 12:54 |
rdogerrit | Yatin Karel proposed rdoinfo master: Switch to train tags and buildsys-tags https://review.rdoproject.org/r/19744 | 12:57 |
rdogerrit | Yatin Karel created config master: Temporary increase timeout for update-buildsys job https://review.rdoproject.org/r/19786 | 13:01 |
*** quiquell|lunch is now known as quiquell | 13:02 | |
*** amoralej is now known as amoralej|lunch | 13:06 | |
sfbender | Merged rdopkg master: CLI: allow passing tool name to arg parser https://softwarefactory-project.io/r/15263 | 13:06 |
*** fkluknav has quit IRC | 13:06 | |
*** fkluknav has joined #rdo | 13:07 | |
rdogerrit | Merged openstack/sahara-image-elements-distgit stein-rdo: sahara-image-elements-10.0.0-0.1.0rc1 https://review.rdoproject.org/r/19783 | 13:08 |
*** mvkr has joined #rdo | 13:12 | |
*** aedc has joined #rdo | 13:13 | |
fultonj | ykarel: will rdo stein's default network configuration use ovn? | 13:13 |
ykarel | fultonj, sorry, context? | 13:14 |
fultonj | ceph plan is to get it working w/ ovs but i'm just wondering if ovn will come into place to replace ovs | 13:14 |
fultonj | https://review.rdoproject.org/r/#/c/18721/ | 13:14 |
ykarel | fultonj, ovn is default in tripleo for some time, may be not all jobs switched to it | 13:14 |
ykarel | in stein default is switched | 13:15 |
fultonj | fmount: ^ fyi | 13:15 |
fultonj | ykarel: that's what i thought, i was just hearing "ovs issues" and was thinking, shouldn't they be ovn issues | 13:15 |
fultonj | if https://review.rdoproject.org/r/#/c/18721 isn't using OVN shouldn't it be? | 13:16 |
fultonj | i guess what do we switch first | 13:16 |
fmount | fultonj: ykarel ack, I found also that running a mon on eth0 ip address both v1 and v2 are working (3300 and 6789 ports) | 13:17 |
*** aakarsh has quit IRC | 13:18 | |
ykarel | fultonj, so scenario001 is using ovn, but that i think is enabled later | 13:20 |
ykarel | after step2 i mean | 13:21 |
ykarel | fmount, ack | 13:21 |
fultonj | ykarel: ah! thanks for clarification | 13:21 |
fultonj | fmount: fyi ^ | 13:22 |
fmount | ykarel: ok thanks | 13:22 |
ykarel | fmount, so is reason found why it's not working with ovs interface? | 13:22 |
fultonj | that's weird | 13:22 |
fultonj | we should have working "final" networks before we configure services which use them | 13:23 |
fultonj | e.g. when we initially had step2 trigger ceph-ansible in pike we had to make sure the network ports were opened before | 13:23 |
fultonj | however, if OVN was going after ceph, it still worked witn lumionus | 13:23 |
fultonj | so maybe that's ok | 13:23 |
*** eharney has joined #rdo | 13:23 | |
fultonj | we need to know what's really going on | 13:24 |
fmount | fultonj: agree, if network is not configured yet, it shouldn't work every time | 13:25 |
*** aedc has quit IRC | 13:27 | |
fmount | fultonj: and even luminous shouldn't work if a networking issue occurred | 13:27 |
fmount | ykarel: that's weird | 13:27 |
ykarel | fultonj, fmount when you are talking about network, you mean br-ctlplane right? | 13:27 |
fmount | ykarel: yes | 13:27 |
ykarel | fmount, ack, that i think is created too early in the deployment | 13:28 |
fultonj | lumionus uses 6789 | nautilus uses 3300 and 6789 | 13:28 |
*** baha has joined #rdo | 13:31 | |
*** jpena|lunch is now known as jpena | 13:32 | |
*** mjturek has joined #rdo | 13:33 | |
*** kgiusti has left #rdo | 13:34 | |
*** matbu has quit IRC | 13:35 | |
rdogerrit | Rafael Folco proposed config master: Make containers-build-push-base job branchless https://review.rdoproject.org/r/19572 | 13:39 |
*** gfidente has quit IRC | 13:40 | |
*** matbu has joined #rdo | 13:42 | |
*** aakarsh has joined #rdo | 13:45 | |
rdogerrit | Rafael Folco proposed config master: Make containers-build-push-base job branchless https://review.rdoproject.org/r/19572 | 13:45 |
rdogerrit | Rafael Folco proposed config master: Use new containers-build-push-base branchless job https://review.rdoproject.org/r/19573 | 13:45 |
rdogerrit | Rafael Folco proposed config master: Add stein periodic jobs to openstack-periodic https://review.rdoproject.org/r/19405 | 13:45 |
rdogerrit | Rafael Folco proposed config master: Move rocky periodic jobs to the 24h pipeline https://review.rdoproject.org/r/19406 | 13:45 |
*** ykarel is now known as ykarel|away | 13:52 | |
* ykarel|away leaving, will be online after an hour | 13:52 | |
*** gfidente has joined #rdo | 13:54 | |
*** matbu has quit IRC | 13:57 | |
*** matbu has joined #rdo | 13:59 | |
*** ykarel|away has quit IRC | 13:59 | |
*** Vorrtex has joined #rdo | 14:01 | |
*** jcoufal_ has joined #rdo | 14:03 | |
*** jcoufal has quit IRC | 14:05 | |
rdogerrit | Juan Badia Payno created rdoinfo master: Add ansible-role-openstack-operations to rocky https://review.rdoproject.org/r/19787 | 14:06 |
*** fkluknav has quit IRC | 14:09 | |
*** fkluknav has joined #rdo | 14:10 | |
*** amoralej|lunch is now known as amoralej | 14:17 | |
rdogerrit | Merged config master: Creates new branch rocky-rdo https://review.rdoproject.org/r/19782 | 14:18 |
*** sshnaidm_ has joined #rdo | 14:19 | |
*** sshnaidm_ is now known as sshnaidm|bbl | 14:19 | |
*** sshnaidm|rover has quit IRC | 14:21 | |
*** sshnaidm|bbl has quit IRC | 14:22 | |
rdogerrit | Rafael Folco proposed config master: Adding myself to testproject-cores https://review.rdoproject.org/r/15825 | 14:23 |
*** mmercer has quit IRC | 14:27 | |
jpena | reminder: the RDO meeting will start in ~30 minutes, feel free to add topics to the agenda at https://etherpad.openstack.org/p/RDO-Meeting | 14:33 |
*** Son_Goku has quit IRC | 14:36 | |
*** baha has quit IRC | 14:37 | |
rdogerrit | Merged openstack/ironic-staging-drivers-distgit stein-rdo: openstack-ironic-staging-drivers-0.11.0-1 https://review.rdoproject.org/r/19784 | 14:39 |
*** janki has quit IRC | 14:41 | |
rdogerrit | Alfredo Moralejo proposed gating_scripts master: Switch master release to train for deps update https://review.rdoproject.org/r/19779 | 14:44 |
*** sshnaidm|bbl has joined #rdo | 14:48 | |
rdogerrit | Merged rdoinfo master: Add ansible-role-openstack-operations to rocky https://review.rdoproject.org/r/19787 | 14:53 |
*** ykarel|away has joined #rdo | 14:53 | |
*** derekh has quit IRC | 14:53 | |
*** baha has joined #rdo | 14:54 | |
*** ykarel|away is now known as ykarel | 14:58 | |
*** sshnaidm|bbl has quit IRC | 15:00 | |
jpena | it's meeting time | 15:00 |
jpena | #startmeeting RDO meeting - 2019-03-27 | 15:00 |
openstack | Meeting started Wed Mar 27 15:00:24 2019 UTC and is due to finish in 60 minutes. The chair is jpena. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
*** openstack changes topic to " (Meeting topic: RDO meeting - 2019-03-27)" | 15:00 | |
openstack | The meeting name has been set to 'rdo_meeting___2019_03_27' | 15:00 |
jpena | #topic roll call | 15:00 |
*** openstack changes topic to "roll call (Meeting topic: RDO meeting - 2019-03-27)" | 15:00 | |
fultonj | o/ | 15:00 |
fmount | o/ | 15:00 |
jpena | #chair fultonj | 15:00 |
openstack | Current chairs: fultonj jpena | 15:00 |
jpena | #chair fmount | 15:00 |
openstack | Current chairs: fmount fultonj jpena | 15:00 |
rdogerrit | Merged openstack/placement-distgit stein-rdo: openstack-placement-1.0.0-0.2.0rc2 https://review.rdoproject.org/r/19781 | 15:01 |
jpena | remember you can add last-minute topics to the agenda at https://etherpad.openstack.org/p/RDO-Meeting | 15:01 |
Vorrtex | o/ | 15:01 |
jpena | #chair Vorrtex | 15:01 |
openstack | Current chairs: Vorrtex fmount fultonj jpena | 15:01 |
amoralej | o/ | 15:01 |
PagliaccisCloud | finally somewhat on time! ٩( ᐛ )و | 15:01 |
jpena | #chair amoralej PagliaccisCloud | 15:01 |
openstack | Current chairs: PagliaccisCloud Vorrtex amoralej fmount fultonj jpena | 15:01 |
ykarel | o/ | 15:01 |
jpena | #chair | 15:01 |
openstack | Current chairs: PagliaccisCloud Vorrtex amoralej fmount fultonj jpena | 15:01 |
jpena | #chair ykarel | 15:02 |
openstack | Current chairs: PagliaccisCloud Vorrtex amoralej fmount fultonj jpena ykarel | 15:02 |
baha | o/ | 15:02 |
mjturek | o/ | 15:02 |
jpena | #chair mjturek baha | 15:03 |
openstack | Current chairs: PagliaccisCloud Vorrtex amoralej baha fmount fultonj jpena mjturek ykarel | 15:03 |
jpena | let's start with the topics | 15:04 |
jpena | #topic ppc64le containers build update | 15:04 |
*** openstack changes topic to "ppc64le containers build update (Meeting topic: RDO meeting - 2019-03-27)" | 15:04 | |
jpena | mjturek: we can merge your topic and mine if you're ok | 15:04 |
mjturek | yeah sure | 15:04 |
mjturek | though baha is afk for a minute | 15:04 |
mjturek | could we maybe do the next topic first? | 15:04 |
jpena | ok | 15:05 |
mjturek | thank you! | 15:05 |
jpena | #topic Ceph Nautilus update | 15:05 |
*** openstack changes topic to "Ceph Nautilus update (Meeting topic: RDO meeting - 2019-03-27)" | 15:05 | |
fmount | we're working to have Nautilus+Ansible2.7 working | 15:05 |
fmount | as per https://review.rdoproject.org/r/#/c/18721/ | 15:05 |
fmount | fultonj: we have still some networking issues that are not strictly related to the container we're using | 15:06 |
fultonj | dsavineau ^ | 15:06 |
fmount | tag: master-5d15bed-nautilus-centos-7-x86_64 | 15:06 |
fultonj | do you have what you need to figure out what the network issues are? | 15:06 |
amoralej | so, what's the problem now? sorry, i was two days on pto | 15:06 |
amoralej | network related? | 15:07 |
*** moguimar has joined #rdo | 15:07 | |
fultonj | do you think the reproducer env provided by ykarel sufficient for you to figure out the root cause of the network issue? | 15:07 |
fmount | fultonj: I'm reproducing the CI on my own env to figure out how to fix this | 15:07 |
fmount | fultonj: nope, maybe we need a fresh recheck | 15:07 |
fmount | cause we tweaked a lot with that env, for this reason I'm reproducing the issue locally | 15:08 |
fmount | (using CI conf) | 15:08 |
fultonj | fmount or dsavineau can you explain network issue to amoralej ? | 15:08 |
fmount | fultonj: sure | 15:08 |
fmount | amoralej: question is that mons don't bootstrap the cluster | 15:09 |
fmount | amoralej: and continue to send probes to an empty list | 15:09 |
fmount | amoralej: then we restarted the mon container on the eth0 dev ip address | 15:09 |
fmount | amoralej: and everything start working properly; in addition, we found that v1 on 6789 with this trick starts correctly | 15:10 |
fultonj | fmount: and that restart happens after OVN is configured? | 15:10 |
amoralej | what means "we restarted the mon container on the eth0 dep ip address" ? | 15:11 |
*** mosulica has quit IRC | 15:11 | |
fultonj | is it possible the steps in tripleo need adjusting to ensure networks are up before? | 15:11 |
* Duck o/ | 15:11 | |
*** artom has quit IRC | 15:11 | |
fmount | amoralej: it means that we stopped the mon container (the systemd unit) and run it manually on the eth0 ip addr instead of the ovs obridge | 15:11 |
amoralej | ok | 15:12 |
amoralej | got it now | 15:12 |
fultonj | amoralej: if you restart it on the ovs bridge it breaks? | 15:12 |
fmount | fultonj: good question, it could be an idea to retrigger the job | 15:12 |
amoralej | i'm not sure | 15:13 |
amoralej | but | 15:13 |
fultonj | on the same box if you flip it back it breaks | 15:13 |
fultonj | (in theory) | 15:13 |
fultonj | i mean IF on the same box if you flip it back it breaks | 15:13 |
ykarel | fultonj, you saying networks are not up till step 2? those bridges are up before in NetworkDeployment step | 15:13 |
fultonj | then diff the network settings | 15:13 |
amoralej | i'd say with a previous container from 4.0, it worked with ovn | 15:13 |
fultonj | to figure out why | 15:13 |
*** cylopez has joined #rdo | 15:13 | |
amoralej | at least it passed this point | 15:13 |
fultonj | amoralej: true | 15:13 |
fultonj | it used ceph 14.0 but now we're trying to use 14.2 | 15:13 |
amoralej | and 14.2 changed something related to this networking stuff? | 15:14 |
fultonj | 14.0 wasn't running v1 protocol on 6789 which cinder was using | 15:14 |
fultonj | 14.0 was running 3300 | 15:14 |
fultonj | v2 protocol | 15:14 |
fultonj | we want both | 15:14 |
fultonj | v1:3300 and v2:6789 | 15:14 |
fultonj | 14.2 should run both | 15:14 |
amoralej | what i don't understand well is how the fact of enabling 6789 port affects networking | 15:15 |
amoralej | but i don't know about ceph, so.. :) | 15:15 |
*** sshnaidm|bbl has joined #rdo | 15:15 | |
fultonj | fmount: but i think you said you found v1 and v2 not running on 14.2 anyway? | 15:15 |
fmount | fultonj: amoralej I also found that starting manually the mon container 6789 is up | 15:15 |
amoralej | if you can build a reproducer i can involve ovn team if needed | 15:15 |
fultonj | fmount: is it fair to say we have reproducer already in env ykarel provided | 15:16 |
fultonj | ? | 15:16 |
fmount | yes, with that trick I've seen also 6789 and yatin was able to create a volume with cinder | 15:16 |
fmount | fultonj: yes | 15:16 |
fultonj | or do you want to rekick it? and then invite ovn team to show them how you can change network and then it's "fixed"? | 15:16 |
amoralej | fmount, and we can reproduce the issue? | 15:16 |
amoralej | i man getting it to fail again? | 15:16 |
ykarel | fmount, i was able to create cinder without 6789 | 15:16 |
amoralej | s/man/mean | 15:16 |
fmount | amoralej: imho we need to rekick it and start looking with a clean env | 15:17 |
amoralej | ack, that was my understanding | 15:17 |
fultonj | fmount: sounds good to me | 15:17 |
fmount | ykarel: oh sorry yes | 15:17 |
*** shardy has quit IRC | 15:17 | |
fultonj | fmount: so what should plan be? | 15:18 |
fmount | fultonj: I propose a clean env cause now things are going to be more confused | 15:18 |
fultonj | if the same env is going to be used to overcloud delete and overcloud deploy, then rm -rf fetch dir in between | 15:19 |
fmount | fultonj: we can rekick the job, reproduce the env and investigate starting from the new understings | 15:19 |
fultonj | ykarel: do you mind helping fmount with ^ ? | 15:19 |
fultonj | not fetch dir but rekick? | 15:19 |
fmount | fultonj: fetch_dir is enough | 15:20 |
fmount | for me is all, fultonj seems we have a plan | 15:20 |
ykarel | amoralej, should we recheck and hold the node? or reproduce locally? | 15:20 |
ykarel | wdyt? | 15:20 |
amoralej | ykarel, i can't hold nodes | 15:21 |
ykarel | jpena can help i think | 15:21 |
amoralej | if we can reproduce it locally in some server in rdo-cloud it'd be great | 15:21 |
amoralej | otherwise yeah | 15:21 |
amoralej | let's ask jpena | 15:21 |
jpena | I can help if we need holding nodes in Zuul | 15:21 |
amoralej | jpena, could you hold a node in zuul to use it to troubleshoot issue in ceph update? | 15:21 |
amoralej | ok | 15:21 |
ykarel | okk good | 15:22 |
amoralej | we'll let you known then | 15:22 |
amoralej | i'm rechecking | 15:22 |
ykarel | rebase | 15:22 |
rdogerrit | Alfredo Moralejo proposed rdoinfo master: DNM - only testing - bump Ansible to 2.7 for Stein https://review.rdoproject.org/r/18721 | 15:22 |
fultonj | thanks ^ please let fmount know IP when you have it | 15:22 |
ykarel | fultonj, fmount should i try same on new environment what i did in earlier environment? | 15:23 |
ykarel | to see if ceph runs there too | 15:23 |
fultonj | ykarel: do you mean when you couldn't reproduce yesterday? | 15:24 |
ykarel | fultonj, yes | 15:24 |
ykarel | ceph + openstack both worked there | 15:24 |
ykarel | with new containers and client + ovs | 15:24 |
fultonj | ovn? | 15:24 |
ykarel | yes | 15:25 |
amoralej | ykarel, what combination worked fine? | 15:25 |
jpena | which is the job name that should be held? | 15:25 |
amoralej | jpena, rdoinfo-tripleo-master-centos-7-scenario001-standalone | 15:25 |
amoralej | for 18721,26 | 15:25 |
ykarel | amoralej, so on the environment we reproduced the issue, i tried reusing the same env to reproduce | 15:25 |
ykarel | by updating repos, removing containers, and deploying agin | 15:26 |
ykarel | and then ceph started, openstack services able to contact new ceph | 15:26 |
amoralej | ok | 15:26 |
amoralej | but was not new clean env | 15:26 |
fultonj | fmount: would that help you? ^ ykarel other env? | 15:26 |
fultonj | ykarel: i think it's an interesting datapoint. ykarel if you do please rm {{local_ceph_ansible_fetch_directory_backup}} | 15:26 |
fultonj | b4 | 15:26 |
fultonj | or at leat make sure it doesn't exist from a previous deployment | 15:26 |
fmount | fultonj: yes, it's interesting | 15:26 |
fultonj | https://review.openstack.org/#/c/618320/1/docker/services/ceph-ansible/ceph-base.yaml | 15:27 |
fultonj | fresh deployment should create new one | 15:27 |
jpena | ok, done. I'll keep it monitored | 15:27 |
*** eharney has quit IRC | 15:28 | |
ykarel | fultonj, okk will take care | 15:28 |
ykarel | fultonj, fmount i did http://paste.openstack.org/show/748485/ before running standalone with new containers:- http://paste.openstack.org/show/748485/ | 15:28 |
fmount | ykarel: for that reason I was looking for a clean environment | 15:28 |
ykarel | fmount, yes clean environment will help | 15:29 |
*** eharney has joined #rdo | 15:29 | |
ykarel | but why it worked that way is weird | 15:29 |
fmount | ykarel: it contributes to confuse me | 15:29 |
fultonj | so fmount gets new envs and continues debug. we pull in ovn team | 15:30 |
fultonj | ^ that's the plan right? | 15:30 |
fmount | fultonj: yes, it's the best solution to solve this issue | 15:31 |
amoralej | ok, let's see if we can get it working | 15:31 |
fultonj | #action fmount gets new envs and continues debug of ceph issue. we pull in ovn team if necessary | 15:32 |
fultonj | i guess we move to next topic? | 15:32 |
jpena | yep | 15:33 |
fmount | fultonj: amoralej ykarel thanks for the effort, we can move to the next topic | 15:33 |
jpena | #topic Decisions on ppc64le arch enablement for containers | 15:33 |
*** openstack changes topic to "Decisions on ppc64le arch enablement for containers (Meeting topic: RDO meeting - 2019-03-27)" | 15:33 | |
jpena | During the week we've been discussing the topic in the mailing list: https://lists.rdoproject.org/pipermail/dev/2019-March/009042.html | 15:33 |
*** matbu has quit IRC | 15:34 | |
jpena | So far, we've increased the disk in the RDO Registry VM to be able to host any additional demand, but we need to make decisions on the other topics | 15:34 |
mjturek | awesome | 15:34 |
*** udesale has quit IRC | 15:35 | |
jpena | so... for me, the first thing would be to have a clear picture of the workflow | 15:35 |
mjturek | jpena: workflow of the job itself? | 15:35 |
*** mcornea has quit IRC | 15:37 | |
amoralej | mjturek, workflow for images build (i guess that's easy, pure kolla thing), push, tag and consume | 15:37 |
*** wolverineav has joined #rdo | 15:37 | |
amoralej | so, iiuc containers for ppc64le are created in a periodic job from consistent tag | 15:37 |
jpena | mjturek: the overall workflow. I saw some discussions on the tag format, and I think that's pretty much ok. However, after finding out the issues with manifest lists and the OpenShift Registry, I wonder if we're going to push the manifests only to dockerhub, or we still need to do it on the rdo registry | 15:38 |
*** quiquell is now known as quiquell|off | 15:38 | |
mjturek | that's fair, Vorrtex I think you only needed the manifests lists on Dockerhub - is that correct? | 15:38 |
amoralej | jpena, so far the approach is to use a common namespace for x86_64 and pp64le and use different tags? | 15:38 |
jpena | amoralej: yes, that's what I understood | 15:39 |
Vorrtex | I don't know if I would say we *only* need manifests on dockerhub, I think its right to say we *definitely* need manifest lists on dockerhub. Honestly, the more identical the workflow and end result per registry the better... Any "one-off" design ideas can be problematic in future updating. | 15:39 |
amoralej | will that not break x86_64? | 15:39 |
*** matbu has joined #rdo | 15:40 | |
mjturek | fair enough Vorrtex | 15:40 |
amoralej | wouldn't be easier to avoid conflicts to use different namespaces? | 15:40 |
egonzalez | hi, when is expected to be stable stein repos created/promoted? | 15:41 |
Vorrtex | amoralej I don't think so, because the workflow will be identical no matter what architecture if you can use manifest list images, and I don't know if you can when the images are in separate namespaces, because separate namespaces are separate repositories. | 15:41 |
*** cylopez has quit IRC | 15:42 | |
Vorrtex | So the workflow desired is as follows: 1) build and upload an x86_64 image, including that architecture in the tag. 2) build and upload a ppc64le image, including that architecture in the tag. 3) create a manifest list image pointing to those two images, but mark the tag as the current default without an architecture tag. 4) As a user, "pull" the manifest list image, which will give you the correct image based on the user's | 15:43 |
Vorrtex | architecture. | 15:43 |
*** holser_ has quit IRC | 15:43 | |
amoralej | Vorrtex, then, when pulling a container, manifests are automatically used? | 15:44 |
*** mcornea has joined #rdo | 15:44 | |
amoralej | to find out the image to pull? | 15:44 |
jpena | Vorrtex: if I understood it correctly, 1 and 2 can be done first on registry.rdo, then dockerhub when the tests are successful. And then, 3 and 4 can be done in dockerhub, where users will fetch the images | 15:44 |
jpena | is this correct? | 15:44 |
mjturek | jpena can you elaorate on "when the tests are successful"? | 15:45 |
Vorrtex | amoralej if you do a pull on a manifest list image, you are returned the image that's appropriate for the requester's architecture, unless forcibly requesting a specific image. | 15:45 |
amoralej | does podman/buildah support working with manifests? | 15:45 |
*** matbu has quit IRC | 15:45 | |
Vorrtex | podman definitely does... I don't know anything about buildah as of yet. | 15:46 |
jpena | mjturek: sure. Container images are uploaded to registry.rdo to be used during the promotion pipeline, to avoid spamming dockerhub. Once the pipeline is successful, the same images are pushed to dockerhub and tagged as "current-tripleo" | 15:46 |
jpena | someone correct me if I'm wrong with ^^ | 15:46 |
Vorrtex | jpena I believe that to be a possibility, but honestly as I mentioned above, the inconsistency between registries can be problematic when updating in the future. | 15:47 |
*** holser_ has joined #rdo | 15:47 | |
mjturek | jpena: ahhh okay, so as long as the images all build successfully they can go to dockerhub | 15:47 |
amoralej | from tripleo PoV, it will use the long tags (using -<arch>) or somehow will use the manifests? | 15:47 |
amoralej | jpena, yes, that's correct | 15:48 |
jpena | here's where I'd love to have someone from the tripleo ci team | 15:48 |
baha | Vorrtex: From what I understand, the issue is that the RDO registry just does not support manifest lists currently? | 15:48 |
amoralej | not only that, who will create the manifest in docherhub? | 15:48 |
Vorrtex | baha yeah, I know, I was just mentioning the "problem" with that workflow. If the community agrees on it being the design, then no issues from me, just making sure its noted. | 15:49 |
baha | Thus the need to use separate namespaces on the RDO registry and combine to single namespace w/ manifest list for dockerhub | 15:49 |
amoralej | with current workflow, it should be done in the promoter script probably | 15:49 |
*** wolverineav has quit IRC | 15:49 | |
Vorrtex | amoralej there can be a new job created to create the manifest list image. It can likely be called or started or whatever from the existing build+upload job with another argument or something. | 15:49 |
amoralej | baha, but, are the manifests needed at all if we work with different namespaces? | 15:50 |
jpena | amoralej: the idea is to use a single namespace (at least in dockerhub) | 15:50 |
baha | amoralej: the issue is, on dockerhub, we don't want separate namespaces, from what I understand | 15:50 |
*** sshnaidm|bbl has quit IRC | 15:50 | |
baha | jpena: +1 | 15:50 |
amoralej | ok | 15:50 |
amoralej | from containers pulling, what i asked before | 15:51 |
amoralej | will tripleo need to somehow deal with manifests? | 15:51 |
amoralej | or it's transparent | 15:51 |
Vorrtex | amoralej its transparent. The 'consumer' of the image has the exact same workflow that they have today if we use manifest list iamges. | 15:52 |
Vorrtex | images*** | 15:52 |
*** stee has quit IRC | 15:52 | |
*** stee_ has joined #rdo | 15:53 | |
Vorrtex | The only "in question" parts here are how we tag and upload those images. I advocate for no different namespaces, because the difference between RDO registry (if that's the right name for it) and dockerhub will be much greater. | 15:53 |
*** holser_ has quit IRC | 15:54 | |
Vorrtex | To be more clear, if we simply append an architecture to the image tag, and account for that when consuming from the RDO registry, then anyone looking for those same images in dockerhub will likely find them, since they'll be named/tagged the same. If we have the RDO registry using a separate namespace, then the "identical" image in dockerhub doesn't have that namespace, and doesn't have the same tag. Does that make sense? | 15:55 |
jpena | yes, I see that | 15:55 |
jpena | So we're missing input from the tripleo ci team, because that'd require changes to the jobs to include the arch part in the tag | 15:55 |
Vorrtex | jpena we reached out to them yesterday, and are currently discussing any required changes in a thread with those guys. | 15:56 |
jpena | aha, that's what I didn't know :) | 15:56 |
mjturek | Vorrtex: should we maybe add amoralej and jpena? | 15:56 |
Vorrtex | mjturek will do. Though, I don't know your emails. | 15:56 |
jpena | Vorrtex: just our nicks at redhat.com | 15:56 |
mjturek | jpena and amoralej can you pm Vorrtex with that? | 15:56 |
mjturek | that works too :) | 15:57 |
mjturek | amoralej and jpena: could you both join the tripleo meeting next week? | 15:57 |
jpena | thanks, I just want to be sure that we're reaching a consensus, and then that we can support it from the RDO infra side :) | 15:57 |
mjturek | we should continue discussions there as well | 15:57 |
jpena | I'd be happy to attend, just let me know the date/time | 15:57 |
amoralej | i'm ok to attend, but tbh i think the main stakeholder is tripleo-ci | 15:58 |
Vorrtex | jpena the OOO-CI meeting happens on bluejeans right after the OOO community meeting yesterday | 15:58 |
mjturek | amoralej they have a tripleo-ci community sync after the meeting, but it's variable time as it happens right after the meeting | 15:58 |
amoralej | ok | 15:58 |
mjturek | so going to the tripleo meeting on Monday is our best bet to get us all there, let me grab the wiki | 15:58 |
baha | Tuesday! | 15:59 |
Vorrtex | Yeah, they had some concerns but overall weren't against the changes we proposed. A majority of those concerns are being addressed in the thread I added you guys on. | 15:59 |
mjturek | #info TripleO meeting is 14:00 UTC Tuesday in #tripleo | 15:59 |
jpena | #action mjturek, Vorrtex and the tripleo ci team to agree on implementation, jpena/amoralej to attend the tripleo-ci community sync next week | 15:59 |
jpena | anything else? We're running out of time | 16:00 |
Vorrtex | I think we can sync back up next week after more discussion. | 16:01 |
Duck | quack | 16:01 |
mjturek | jpena: plenty :) but we'll resume later | 16:01 |
jpena | great, thanks for the discussion :) | 16:01 |
mjturek | sorry for the long topic, thanks for the time | 16:01 |
Duck | if there's an open floor | 16:01 |
jpena | #topic chair for the next meeting | 16:01 |
*** openstack changes topic to "chair for the next meeting (Meeting topic: RDO meeting - 2019-03-27)" | 16:01 | |
jpena | Duck: yes, after this one | 16:01 |
jpena | any volunteer? | 16:01 |
ykarel | i can take | 16:02 |
jpena | thanks ykarel | 16:02 |
jpena | #action ykarel to chair next meeting | 16:02 |
jpena | #topic open floor | 16:02 |
*** openstack changes topic to "open floor (Meeting topic: RDO meeting - 2019-03-27)" | 16:02 | |
Duck | yeah! | 16:02 |
Duck | as for the mail outage | 16:02 |
Duck | Misc discovered the dhcp client was probably the service which triggered a network restart | 16:03 |
Duck | and then bad timing for the postfix to come back | 16:03 |
Duck | so normally this never happens as needrestart does not restart network related stuff | 16:03 |
Duck | but in this VM there is no networkmanager so it was not handled right | 16:04 |
Duck | I bugged upstream and I hope to have this fixed or backported soon | 16:04 |
Duck | anyway I've been using needrestart for years now and it's been a while since any problem | 16:05 |
Duck | just to let you know | 16:05 |
jpena | it's not a huge deal. I hope we can improve that with the additional monitoring | 16:05 |
Duck | yep, it was missing indeed | 16:06 |
Duck | it's always possible to add our own blacklist for any problematic service too | 16:06 |
*** artom has joined #rdo | 16:06 | |
jpena | it's only happened once, I don't think it's worth for now | 16:06 |
*** artom has quit IRC | 16:06 | |
Duck | so this does not affect my proposal to have it on all machines :-) | 16:07 |
*** artom has joined #rdo | 16:07 | |
jpena | not for me, although it highlights that we need to be aware of things like this and maybe monitor some more services | 16:07 |
Duck | yes, from the start (at least when I came in RH) needrestart was installed when it was managed by OSAS only | 16:07 |
Duck | I would say ALL services | 16:08 |
Duck | that's all for me :-) | 16:08 |
jpena | thanks! | 16:08 |
jpena | anything else before we close? | 16:08 |
jpena | 3,2,1... | 16:09 |
jpena | #endmeeting | 16:09 |
*** openstack changes topic to "RDO: An OpenStack Distribution for CentOS/RHEL | Community meeting is held here every Wednesday at 15:00UTC | Please read our IRC community guidelines: https://www.rdoproject.org/community/irc-etiquette/ | Logged at http://eavesdrop.openstack.org/irclogs/%23rdo/" | 16:09 | |
openstack | Meeting ended Wed Mar 27 16:09:17 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:09 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/rdo_meeting___2019_03_27/2019/rdo_meeting___2019_03_27.2019-03-27-15.00.html | 16:09 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/rdo_meeting___2019_03_27/2019/rdo_meeting___2019_03_27.2019-03-27-15.00.txt | 16:09 |
openstack | Log: http://eavesdrop.openstack.org/meetings/rdo_meeting___2019_03_27/2019/rdo_meeting___2019_03_27.2019-03-27-15.00.log.html | 16:09 |
jpena | thanks for attending! | 16:09 |
* Duck :-) | 16:09 | |
amoralej | egonzalez, you mean official RDO Stein repo in CentOS repos? | 16:10 |
amoralej | or rdo-trunk repo for CI? | 16:10 |
*** aufi has quit IRC | 16:16 | |
*** ykarel is now known as ykarel|away | 16:16 | |
jpena | fmount: can you send me your public ssh key? | 16:17 |
fmount | jpena: https://github.com/fmount.keys | 16:18 |
fmount | jpena: (thx) | 16:18 |
jpena | fmount: you can now try ssh zuul@38.145.33.73 | 16:18 |
jpena | the job is still running | 16:18 |
jpena | but the VM should be locked after it fails | 16:18 |
fmount | jpena: ok | 16:19 |
fmount | jpena: thanks, I'm in | 16:20 |
jpena | great | 16:20 |
ykarel|away | fultonj, so this time it reproduced in same environment | 16:21 |
ykarel|away | i mainly did the rm ceph_ansible_back thing extra this time | 16:22 |
ykarel|away | on 38.145.34.104 | 16:22 |
amoralej | ykarel|away, so it's failing with the same error? | 16:24 |
ykarel|away | amoralej, yes it's stuck waiting at quorum | 16:24 |
amoralej | ok, good | 16:24 |
amoralej | so it seems we have a way to reproduce it | 16:24 |
amoralej | ykarel|away, may i log in? | 16:25 |
ykarel|away | yes | 16:25 |
ykarel|away | amoralej, yes | 16:25 |
ykarel|away | i copied key from other env, so your keys should be there | 16:25 |
amoralej | yeah, i'm in | 16:25 |
ykarel|away | ack | 16:26 |
rdogerrit | User marios created rdo-infra/ci-config master: Readd -multinode-1ctlr-featureset030-queens to criteria https://review.rdoproject.org/r/19788 | 16:27 |
*** chandankumar is now known as raukadah | 16:28 | |
*** dsneddon has quit IRC | 16:28 | |
*** ttsiouts has quit IRC | 16:34 | |
*** ttsiouts has joined #rdo | 16:35 | |
*** trown is now known as trown|lunch | 16:35 | |
*** mcornea has quit IRC | 16:37 | |
*** ttsiouts has quit IRC | 16:40 | |
rdogerrit | Alfredo Moralejo created openstack/packstack-distgit stein-rdo: openstack-packstack-14.0.0-0.1.0rc1 https://review.rdoproject.org/r/19789 | 16:41 |
amoralej | jpena, build for stein RC ^ | 16:41 |
*** jcoufal_ has quit IRC | 16:42 | |
*** jfrancoa has quit IRC | 16:43 | |
amoralej | fmount, so in zuul@38.145.33.73 i see the issue | 16:45 |
amoralej | but i see it's listening in ports 3300 and 6789 | 16:45 |
fmount | amoralej: yes I see (I'm in tweaking with ovs cli) | 16:45 |
*** sshnaidm|bbl has joined #rdo | 16:46 | |
*** mcornea has joined #rdo | 16:51 | |
rdogerrit | Lon Hohberger proposed openstack/networking-bigswitch-distgit rpm-master: Require sqlalchemy 1.2.8 https://review.rdoproject.org/r/19752 | 16:55 |
*** dsneddon has joined #rdo | 16:55 | |
*** wolverineav has joined #rdo | 16:55 | |
*** baha has quit IRC | 16:58 | |
*** wolverineav has quit IRC | 17:00 | |
*** dsneddon has quit IRC | 17:01 | |
rdogerrit | Merged rdoinfo master: Update RabbitMQ in all active RDO releases https://review.rdoproject.org/r/15234 | 17:04 |
fultonj | ++ | 17:06 |
*** kopecmartin is now known as kopecmartin|off | 17:10 | |
*** wolverineav has joined #rdo | 17:11 | |
*** wolverineav has quit IRC | 17:13 | |
*** wolverineav has joined #rdo | 17:13 | |
*** rpittau is now known as rpittau|afk | 17:13 | |
*** bhavyabapna_ has quit IRC | 17:16 | |
*** dtantsur is now known as dtantsur|afk | 17:21 | |
rdogerrit | Merged openstack/packstack-distgit stein-rdo: openstack-packstack-14.0.0-0.1.0rc1 https://review.rdoproject.org/r/19789 | 17:23 |
*** wolverineav has quit IRC | 17:24 | |
*** hseipp has quit IRC | 17:25 | |
*** wolverineav has joined #rdo | 17:26 | |
*** jpich has quit IRC | 17:30 | |
*** wolverineav has quit IRC | 17:30 | |
*** wolverineav has joined #rdo | 17:30 | |
*** dsneddon has joined #rdo | 17:31 | |
*** ramishra has quit IRC | 17:37 | |
*** ccamposr has quit IRC | 17:38 | |
rdogerrit | Alfredo Moralejo proposed rdoinfo master: Switch to train tags and buildsys-tags https://review.rdoproject.org/r/19744 | 17:39 |
*** paramite has quit IRC | 17:39 | |
*** gfidente is now known as gfidente|afk | 17:42 | |
*** mvkr has quit IRC | 17:44 | |
*** eharney has quit IRC | 17:47 | |
*** trown|lunch is now known as trown | 17:50 | |
*** baha has joined #rdo | 17:53 | |
*** kgiusti has joined #rdo | 18:01 | |
*** jpena is now known as jpena|off | 18:03 | |
*** wolverineav has quit IRC | 18:08 | |
*** wolverineav has joined #rdo | 18:10 | |
*** wolverineav has quit IRC | 18:12 | |
*** wolverineav has joined #rdo | 18:12 | |
*** ykarel|away has quit IRC | 18:16 | |
*** holser_ has joined #rdo | 18:22 | |
*** zul has quit IRC | 18:23 | |
*** morazi has quit IRC | 18:33 | |
*** amoralej is now known as amoralej|lunch | 18:42 | |
*** eharney has joined #rdo | 18:47 | |
rdogerrit | rdo-trunk created openstack/kuryr-kubernetes-distgit stein-rdo: openstack-kuryr-kubernetes-1.0.0-1 https://review.rdoproject.org/r/19790 | 18:54 |
*** wolverineav has quit IRC | 18:55 | |
*** wolverineav has joined #rdo | 18:56 | |
*** wolverineav has quit IRC | 19:00 | |
*** artom has quit IRC | 19:06 | |
*** khyr0n has joined #rdo | 19:15 | |
*** wolverineav has joined #rdo | 19:29 | |
*** holser_ has quit IRC | 19:33 | |
*** wolverineav has quit IRC | 19:34 | |
*** baha has quit IRC | 19:39 | |
*** baha has joined #rdo | 19:46 | |
*** morazi has joined #rdo | 19:47 | |
*** wolverineav has joined #rdo | 19:51 | |
*** pcaruana has quit IRC | 19:53 | |
*** morazi has quit IRC | 20:01 | |
*** morazi has joined #rdo | 20:02 | |
*** jlibosva has quit IRC | 20:06 | |
rdogerrit | Merged rdo-infra/ci-config master: Readd -multinode-1ctlr-featureset030-queens to criteria https://review.rdoproject.org/r/19788 | 20:07 |
*** baha has quit IRC | 20:15 | |
*** dprince has quit IRC | 20:17 | |
*** jtomasek has quit IRC | 20:27 | |
*** Vorrtex has quit IRC | 20:28 | |
*** jtomasek has joined #rdo | 20:29 | |
*** mjturek has quit IRC | 20:31 | |
*** baha has joined #rdo | 20:33 | |
*** fultonj has quit IRC | 20:34 | |
*** fultonj has joined #rdo | 20:35 | |
*** jtomasek has quit IRC | 20:35 | |
rdogerrit | Rafael Folco created config master: Add a build containers job for stein https://review.rdoproject.org/r/19791 | 20:35 |
*** baha has quit IRC | 20:40 | |
*** mmercer has joined #rdo | 20:42 | |
*** wolverineav has quit IRC | 20:46 | |
rdogerrit | Rafael Folco proposed config master: Add a build containers job for stein https://review.rdoproject.org/r/19791 | 20:46 |
*** wolverineav has joined #rdo | 20:48 | |
rdogerrit | Rafael Folco proposed config master: Define a new build containers job for stein https://review.rdoproject.org/r/19791 | 20:52 |
*** trown is now known as trown|outtypewww | 20:52 | |
*** wolverineav has quit IRC | 20:53 | |
rdogerrit | Rafael Folco proposed config master: Define a new build containers job for stein https://review.rdoproject.org/r/19791 | 21:07 |
rdogerrit | Merged config master: Define a new build containers job for stein https://review.rdoproject.org/r/19791 | 21:12 |
*** wolverineav has joined #rdo | 21:12 | |
*** aedc has joined #rdo | 21:20 | |
*** jmlowe has quit IRC | 21:20 | |
*** aakarsh has quit IRC | 21:35 | |
*** rlandy is now known as rlandy|bbl | 22:08 | |
*** wolverineav has quit IRC | 22:09 | |
*** aedc has quit IRC | 22:12 | |
*** wolverineav has joined #rdo | 22:12 | |
*** wolverineav has quit IRC | 22:17 | |
*** jmlowe has joined #rdo | 22:19 | |
*** Son_Goku has joined #rdo | 22:25 | |
*** rcernin has joined #rdo | 22:31 | |
*** wolverineav has joined #rdo | 22:33 | |
*** aakarsh has joined #rdo | 22:41 | |
*** gfidente|afk has quit IRC | 22:59 | |
*** wolverineav has quit IRC | 23:19 | |
*** wolverineav has joined #rdo | 23:19 | |
*** wolverineav has quit IRC | 23:22 | |
*** wolverineav has joined #rdo | 23:22 | |
*** tosky has quit IRC | 23:27 | |
*** artom has joined #rdo | 23:32 | |
*** kgiusti has left #rdo | 23:32 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!