| *** puranamr has quit IRC | 01:35 | |
| *** chungting has joined #openstack-community | 01:41 | |
| *** hakimo_ has joined #openstack-community | 02:52 | |
| *** hakimo has quit IRC | 02:54 | |
| *** julim has joined #openstack-community | 02:54 | |
| *** julim has quit IRC | 03:13 | |
| *** julim has joined #openstack-community | 03:36 | |
| *** coolsvap|away is now known as coolsvap | 03:40 | |
| *** puranamr has joined #openstack-community | 03:46 | |
| *** julim has quit IRC | 03:56 | |
| *** puranamr has quit IRC | 04:21 | |
| *** puranamr has joined #openstack-community | 04:35 | |
| *** puranamr has quit IRC | 04:38 | |
| *** puranamr has joined #openstack-community | 04:39 | |
| *** puranamr has quit IRC | 04:55 | |
| *** yottatsa has joined #openstack-community | 05:21 | |
| *** yottatsa has quit IRC | 05:21 | |
| *** yottatsa has joined #openstack-community | 05:35 | |
| *** pcaruana has quit IRC | 06:09 | |
| *** yottatsa has quit IRC | 06:22 | |
| *** yottatsa has joined #openstack-community | 07:04 | |
| *** jtomasek has joined #openstack-community | 07:16 | |
| *** mrmartin has joined #openstack-community | 07:19 | |
| *** jcoufal has joined #openstack-community | 07:26 | |
| *** pcaruana has joined #openstack-community | 07:40 | |
| *** eject_ck has joined #openstack-community | 07:43 | |
| *** yottatsa has quit IRC | 07:57 | |
| *** mrmartin has quit IRC | 08:08 | |
| *** mrmartin has joined #openstack-community | 08:09 | |
| *** eject_ck has quit IRC | 08:45 | |
| *** eject_ck has joined #openstack-community | 08:49 | |
| *** toscalix has joined #openstack-community | 09:03 | |
| *** eject_ck has quit IRC | 09:18 | |
| *** eject_ck has joined #openstack-community | 09:40 | |
| *** jcoufal_ has joined #openstack-community | 10:02 | |
| *** yottatsa has joined #openstack-community | 10:04 | |
| *** ejat- has joined #openstack-community | 10:06 | |
| *** jcoufal has quit IRC | 10:08 | |
| *** logan2 has quit IRC | 10:08 | |
| *** mwagner_lap has quit IRC | 10:08 | |
| *** ejat has quit IRC | 10:08 | |
| *** HenryG has quit IRC | 10:08 | |
| *** HenryG has joined #openstack-community | 10:08 | |
| *** mwagner_lap has joined #openstack-community | 10:08 | |
| *** logan2 has joined #openstack-community | 10:08 | |
| *** pcaruana has quit IRC | 10:57 | |
| *** mwagner_lap has quit IRC | 10:57 | |
| *** coolsvap is now known as coolsvap|away | 11:06 | |
| *** Marga__ has quit IRC | 11:13 | |
| *** pcaruana has joined #openstack-community | 11:14 | |
| *** eject_ck has quit IRC | 11:16 | |
| *** eject_ck has joined #openstack-community | 11:41 | |
| *** julim has joined #openstack-community | 11:43 | |
| *** coolsvap|away is now known as coolsvap | 11:58 | |
| *** yottatsa_ has joined #openstack-community | 12:05 | |
| *** Marga_ has joined #openstack-community | 12:05 | |
| *** yottatsa has quit IRC | 12:06 | |
| *** eject_ck has quit IRC | 12:16 | |
| *** yottatsa_ has quit IRC | 12:24 | |
| *** yottatsa has joined #openstack-community | 12:24 | |
| *** yottatsa has quit IRC | 12:24 | |
| *** yottatsa has joined #openstack-community | 12:29 | |
| *** Marga_ has quit IRC | 12:30 | |
| *** eject_ck has joined #openstack-community | 12:34 | |
| *** eject_ck has joined #openstack-community | 12:37 | |
| *** yottatsa has quit IRC | 12:47 | |
| *** rbowen has joined #openstack-community | 12:50 | |
| *** yottatsa has joined #openstack-community | 13:01 | |
| *** zul has joined #openstack-community | 13:21 | |
| *** puranamr has joined #openstack-community | 13:22 | |
| *** mwagner_lap has joined #openstack-community | 13:39 | |
| -openstackstatus- NOTICE: The Gerrit service on review.openstack.org has been restarted in an attempt to improve performance. | 13:39 | |
| *** Marga_ has joined #openstack-community | 13:42 | |
| *** lucas___ has joined #openstack-community | 13:42 | |
| *** tiswanso has joined #openstack-community | 13:44 | |
| *** annegentle has joined #openstack-community | 13:58 | |
| *** yottatsa has quit IRC | 14:19 | |
| *** yottatsa has joined #openstack-community | 14:20 | |
| *** yottatsa has quit IRC | 14:25 | |
| *** yottatsa has joined #openstack-community | 14:26 | |
| *** lucas___ has quit IRC | 14:29 | |
| *** eject_ck has quit IRC | 14:30 | |
| *** yottatsa has quit IRC | 14:31 | |
| *** lucas___ has joined #openstack-community | 14:33 | |
| *** lucas___ has quit IRC | 14:33 | |
| *** lucas___ has joined #openstack-community | 14:33 | |
| *** yottatsa has joined #openstack-community | 14:33 | |
| *** yottatsa has quit IRC | 14:43 | |
| *** electrocucaracha has joined #openstack-community | 14:47 | |
| *** barra204 has joined #openstack-community | 14:58 | |
| *** agireud has joined #openstack-community | 15:04 | |
| *** yottatsa has joined #openstack-community | 15:08 | |
| *** barra204 has quit IRC | 15:09 | |
| *** pcaruana has quit IRC | 15:13 | |
| *** shakamunyi has joined #openstack-community | 15:14 | |
| *** shakamunyi is now known as barra204 | 15:16 | |
| *** puranamr has quit IRC | 15:19 | |
| *** barra204 has quit IRC | 15:26 | |
| *** tiswanso has quit IRC | 15:31 | |
| *** tiswanso has joined #openstack-community | 15:32 | |
| *** barra204 has joined #openstack-community | 15:41 | |
| *** puranamr has joined #openstack-community | 15:55 | |
| *** yottatsa has quit IRC | 15:57 | |
| *** lucas___ has quit IRC | 15:58 | |
| *** yottatsa has joined #openstack-community | 16:02 | |
| *** puranamr has quit IRC | 16:09 | |
| *** yottatsa has quit IRC | 16:09 | |
| *** Marga_ has quit IRC | 16:16 | |
| *** puranamr has joined #openstack-community | 16:18 | |
| *** Marga_ has joined #openstack-community | 16:27 | |
| *** jcoufal_ has quit IRC | 16:30 | |
| *** yottatsa has joined #openstack-community | 16:31 | |
| *** lucas__ has joined #openstack-community | 16:37 | |
| *** yottatsa has quit IRC | 16:39 | |
| *** tiswanso has quit IRC | 16:40 | |
| *** lucas__ has quit IRC | 16:42 | |
| *** tiswanso has joined #openstack-community | 16:43 | |
| *** puranamr has quit IRC | 16:43 | |
| *** yottatsa has joined #openstack-community | 16:44 | |
| *** yottatsa has quit IRC | 16:48 | |
| *** lucas__ has joined #openstack-community | 16:54 | |
| *** lucas__ has quit IRC | 16:55 | |
| *** lucas__ has joined #openstack-community | 16:55 | |
| *** Marga_ has quit IRC | 16:55 | |
| *** Marga_ has joined #openstack-community | 16:56 | |
| *** coolsvap is now known as coolsvap|away | 16:58 | |
| *** puranamr has joined #openstack-community | 16:58 | |
| *** pcaruana has joined #openstack-community | 17:06 | |
| *** electrocucaracha has quit IRC | 17:25 | |
| *** electrocucaracha has joined #openstack-community | 17:32 | |
| *** Piet_ has joined #openstack-community | 17:37 | |
| *** lucas__ has quit IRC | 17:49 | |
| *** lucas__ has joined #openstack-community | 17:49 | |
| *** Marga_ has quit IRC | 18:00 | |
| *** Marga_ has joined #openstack-community | 18:01 | |
| *** jtomasek has quit IRC | 18:11 | |
| *** Marga_ has quit IRC | 18:11 | |
| *** electrocucaracha has quit IRC | 18:13 | |
| reed | hi mrmartin, how are things going? | 18:33 |
|---|---|---|
| mrmartin | hi reed | 18:38 |
| mrmartin | nothing | 18:39 |
| mrmartin | :) | 18:39 |
| mrmartin | basically things are ready from my side for the ask.o.o migration | 18:39 |
| reed | is that good? | 18:39 |
| reed | oh | 18:39 |
| mrmartin | https://review.openstack.org/207472 | 18:39 |
| mrmartin | need to approve that, guys were busy last week keeping the infra together | 18:40 |
| reed | yeah | 18:40 |
| mrmartin | I guess we have only one thing left here, need to figure out what to do with CloudFlare | 18:42 |
| reed | my suggestion: drop it | 18:42 |
| reed | it's opaque | 18:42 |
| mrmartin | putting CF in front service, caused some extra issues, like puppet updates stopped to work, Jeremy had some access issues between ipv4 / ipv6 | 18:43 |
| *** doffm has joined #openstack-community | 18:43 | |
| fungi | the ipv4/v6 issue turned out to be a mis/partial configuration on tipit's part | 18:43 |
| reed | it's a lot better to fix askbot and make it work with akismet first | 18:43 |
| mrmartin | anyway, if we have problems with spams, we should use some content based filtering | 18:43 |
| fungi | after i brought it to their attention, they got ipv6 working consistently | 18:43 |
| mrmartin | like https://www.mollom.com | 18:44 |
| mrmartin | I checked the configuration, it have a built-in stopspam module, but it was never-ever enabled | 18:44 |
| reed | mrmartin, I agree... and askbot is supposed to work with akismet but somehow it doesn't work | 18:44 |
| *** doffm has left #openstack-community | 18:45 | |
| mrmartin | we never tested for akismet | 18:45 |
| fungi | mrmartin: 207472 lgtm | 18:45 |
| reed | all is waiting for the upgrade | 18:45 |
| mrmartin | fungi, what you think, when we can do the production upgrade? | 18:45 |
| reed | once we have the upgrade, we will have a system that works and we can test things | 18:45 |
| *** shakamunyi has joined #openstack-community | 18:46 | |
| mrmartin | http://answers.ros.org/question/170811/can-someone-enable-akismet-to-avoid-spam/ | 18:46 |
| mrmartin | http://akismet.com/plans/ can we go with the basic plan here? | 18:46 |
| fungi | mrmartin: did https://review.openstack.org/181894 finally get reverted, or do we need a change to do that as part of the production migration/upgrade? | 18:47 |
| mrmartin | fungi: I need to add a new change | 18:47 |
| mrmartin | but I like to see the https://review.openstack.org/#/c/207472/ landing first | 18:47 |
| fungi | mrmartin: also we need ask.o.o rebuilt on ubuntu trusty as part of the upgrade, right? | 18:48 |
| mrmartin | yeah, we need to rebuild and upgrade to trusty | 18:48 |
| mrmartin | so before that, we also need to do some backup :) | 18:48 |
| mrmartin | and restore everything into the new instance | 18:48 |
| mrmartin | so it means a little downtime for the production service | 18:48 |
| fungi | right, it'll be a brief dump, copy and import along with a dns change | 18:49 |
| mrmartin | 1-2 hours depending how fast we can deploy the new instance and do the db, upfiles backup / restore | 18:49 |
| *** jtomasek has joined #openstack-community | 18:50 | |
| fungi | well, the deploy can happen ahead of time | 18:50 |
| fungi | but the rest, yes. we'll want production offline while doing the export/dump | 18:51 |
| fungi | basically same as last time, which i think ended up being about 1-1.5 hours offline | 18:51 |
| fungi | but i don't remember exactly | 18:51 |
| mrmartin | ok, but you need to turn disable puppet agent on actual ask.o.o as a first step | 18:51 |
| mrmartin | to avoid applying the new patches on the old server | 18:52 |
| *** Marga_ has joined #openstack-community | 18:52 | |
| fungi | right, before we merge the revert of 181894 | 18:52 |
| mrmartin | ok, I can write a step-by-step guide for the upgrade, we have some differences on restore due to virtualenv | 18:54 |
| mrmartin | but if you can deploy the trusty server next to precise, it is awesome | 18:54 |
| mrmartin | so we can minimize the downtime | 18:55 |
| mrmartin | I like to see that working: https://review.openstack.org/#/c/207472/ and avoid a broken upgrade due a last-minute change | 18:59 |
| mrmartin | reed, the akismet integration seems to be implemented in askbot, we need to enable this on dev with a test key, and check how it performs https://github.com/ASKBOT/askbot-devel/search?utf8=✓&q=akismet | 19:02 |
| reed | yep | 19:02 |
| reed | IIRC last time I tried it didn't work | 19:03 |
| reed | setting the key didn't have any effect | 19:03 |
| mrmartin | ok, let's finalize the upgrade, then I can check the akismet filtering | 19:05 |
| *** zul has quit IRC | 19:11 | |
| *** Piet_ has quit IRC | 19:20 | |
| mrmartin | fungi: would we like to display a maintenance page for ask.o.o users during the backup/recovery? | 19:23 |
| *** agireud_ has joined #openstack-community | 19:29 | |
| fungi | mrmartin: i'm not opposed to it... we could just add it manually though having a specific file precreated and redirect tested in advance will help avoid delays too | 19:30 |
| *** agireud has quit IRC | 19:30 | |
| *** agireud_ is now known as agireud | 19:30 | |
| fungi | i'll go ahead and deploy the replacement ask.o.o server with trusty now | 19:30 |
| fungi | that way it'll be ready whenever we schedule the migration | 19:31 |
| mrmartin | yeap, it will prevent to make any changes on the database, and the users will see something useful instead of a simple 404 error page | 19:31 |
| *** hhuang has quit IRC | 19:36 | |
| fungi | we've been running production on a 4gb instance so far and cpu utilization has been low but ram usage is skirting the 50% mark http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2544&rra_id=all | 19:36 |
| fungi | mrmartin: do you think we need to go larger or should we stick with the same size for the replacement? | 19:36 |
| fungi | ask-staging is also running on a 4gb instance | 19:36 |
| mrmartin | the actual one performed well, I guess we had only one issue related to redis, but it was solved with a config setting | 19:37 |
| mrmartin | I think 4gb must be enough | 19:37 |
| mrmartin | :D | 19:37 |
| fungi | okay, just confirming. thanks! | 19:37 |
| *** electrocucaracha has joined #openstack-community | 19:41 | |
| mrmartin | fungi, reed: the upgrade process for askbot trusty: https://etherpad.openstack.org/p/askbot-trusty-migration | 19:47 |
| *** hhuang has joined #openstack-community | 19:52 | |
| reed | mrmartin, for the google auth stuff, I wish there was a way to pass the API keys to puppet | 19:52 |
| *** jtomasek has quit IRC | 19:52 | |
| reed | mrmartin, but if that's too complicated, we can always set those up 'manually' afterwards | 19:52 |
| *** agireud has quit IRC | 19:52 | |
| reed | I think it's a one off task anyway, and after that they'll be in the database | 19:53 |
| mrmartin | yeap, it is a new hiera parameter, and need to upgrade the puppet-askbot and system-config repos | 19:53 |
| mrmartin | 2patch | 19:53 |
| mrmartin | the approval time takes a while | 19:53 |
| fungi | mrmartin: thanks. also i've got the replacement server built now | 19:53 |
| mrmartin | but I think it is more than enough to set it manually once, because the values are going to the database, and we have a backup from the db | 19:54 |
| mrmartin | if we lost the db, the missing google plus api keys will be our smallest problems | 19:54 |
| *** agireud has joined #openstack-community | 19:54 | |
| *** Piet has joined #openstack-community | 19:58 | |
| *** mfalatic has joined #openstack-community | 20:01 | |
| fungi | i've changed the ttl on the ask.o.o v4 and v6 address records to 5 minutes so that we can change dns around more quickly when it comes time for the migration | 20:06 |
| *** puranamr has quit IRC | 20:15 | |
| *** puranamr has joined #openstack-community | 20:22 | |
| *** mrmartin has quit IRC | 20:23 | |
| *** puranamr has quit IRC | 20:27 | |
| *** puranamr has joined #openstack-community | 20:27 | |
| *** annegentle has quit IRC | 20:54 | |
| *** neeti has joined #openstack-community | 20:56 | |
| *** neeti has quit IRC | 20:57 | |
| *** lucas__ has quit IRC | 21:01 | |
| *** tiswanso has quit IRC | 21:02 | |
| *** toscalix has quit IRC | 21:03 | |
| *** Marga_ has quit IRC | 21:25 | |
| *** puranamr has quit IRC | 21:28 | |
| *** electrocucaracha has quit IRC | 21:32 | |
| *** electrocucaracha has joined #openstack-community | 21:39 | |
| *** puranamr has joined #openstack-community | 21:41 | |
| *** electrocucaracha has quit IRC | 21:43 | |
| *** annegentle has joined #openstack-community | 21:47 | |
| *** electrocucaracha has joined #openstack-community | 21:48 | |
| *** mwagner_lap has quit IRC | 21:59 | |
| *** agireud has quit IRC | 22:02 | |
| *** agireud has joined #openstack-community | 22:14 | |
| *** agireud has quit IRC | 22:18 | |
| *** annegentle has quit IRC | 22:35 | |
| *** annegentle has joined #openstack-community | 22:43 | |
| *** shakamunyi has quit IRC | 22:51 | |
| *** mwagner_lap has joined #openstack-community | 22:53 | |
| *** toscalix has joined #openstack-community | 23:04 | |
| *** electrocucaracha has quit IRC | 23:13 | |
| *** annegentle has quit IRC | 23:24 | |
| *** toscalix has quit IRC | 23:31 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!