| *** jamesmcarthur has quit IRC | 00:01 | |
| *** jamesmcarthur has joined #storyboard | 00:07 | |
| *** diablo_rojo has quit IRC | 00:48 | |
| *** jamesmcarthur has quit IRC | 00:50 | |
| *** jamesmcarthur has joined #storyboard | 01:16 | |
| *** jamesmcarthur has quit IRC | 01:18 | |
| *** jamesmcarthur has joined #storyboard | 01:19 | |
| *** jamesmcarthur has quit IRC | 01:22 | |
| *** whoami-rajat has joined #storyboard | 01:30 | |
| *** jamesmcarthur has joined #storyboard | 01:33 | |
| *** jamesmcarthur has quit IRC | 02:22 | |
| *** jamesmcarthur has joined #storyboard | 02:26 | |
| *** jamesmcarthur has quit IRC | 03:56 | |
| *** udesale has joined #storyboard | 04:00 | |
| *** jamesmcarthur has joined #storyboard | 04:00 | |
| *** jamesmcarthur has quit IRC | 04:00 | |
| *** jamesmcarthur has joined #storyboard | 04:01 | |
| *** jamesmcarthur has quit IRC | 04:05 | |
| *** jamesmcarthur has joined #storyboard | 04:27 | |
| *** scherbatsky has quit IRC | 05:13 | |
| *** tosky has joined #storyboard | 07:29 | |
| *** jpich has joined #storyboard | 07:48 | |
| *** jtomasek has quit IRC | 08:49 | |
| SotK | Rou: in boards/worklists, "user" means "able to add, move, and remove cards", and "owner" means "able to add, move, and remove cards, and also able to edit titles, permissions, lane ordering, and filters" | 08:56 |
|---|---|---|
| *** jtomasek has joined #storyboard | 09:09 | |
| *** dtantsur|afk is now known as dtantsur | 09:21 | |
| *** jtomasek has quit IRC | 11:14 | |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] Okay, thanks | 11:21 |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] I need a bit of help in something | 11:21 |
| *** jtomasek has joined #storyboard | 11:25 | |
| *** udesale has quit IRC | 11:28 | |
| *** udesale has joined #storyboard | 11:29 | |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] First of all, I'm not saying this as cliche's or to increase my chances at being accepted in Outreachy program or whatsoever. But I'm speaking honestly, and I do have to say this. I still don't know what the final application is like. | 11:34 |
| Rou | Anyway, I have been waiting for Outreachy projects' list since last of 2018, but when they are finally released, I had family issues and I wasted lots of time. And now in college, God, I barely find time and I am decreasing my GPA each day for the sake of trying to understand everything in Storyboard and contributing. But it is totally worth it to me, I have to get accepted, I don't even give myself a thought that I might not. Won't a | 11:34 |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] I have experience in lots of things, and always passionate to learn more, like really. But time.... now I noticed that the deadline for the final application in next Tuesday, and I still haven't contributed anything. So, please, please, could you help me out guiding me how to looks for bugs I can fix, and how to find them in the code? I have experience in Python actually and I can read the co | 11:35 |
| Rou | So, please, help me out? I wanna leave a mark in this project and contribute to it. | 11:35 |
| *** jpich has quit IRC | 11:42 | |
| *** jpich has joined #storyboard | 11:42 | |
| *** jpich has quit IRC | 11:49 | |
| *** jpich has joined #storyboard | 11:49 | |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] https://files.sameroom.io/L6lvFd53zbi2MaH_iTi2U01EvLh4pwpie8PmoDrYQR8/Screenshot+from+2019-03-20+14-08-00.png | 12:17 |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] So I was considering working on the things I noticed myself, but I need guidance to know where to look up in the code and how to submit them for review and merge. I think I should submit the bug first and assign it to myself? Or what? | 12:19 |
| *** jpich has quit IRC | 12:19 | |
| *** jpich has joined #storyboard | 12:20 | |
| *** jpich has quit IRC | 12:35 | |
| *** jpich has joined #storyboard | 12:35 | |
| *** jpich has quit IRC | 12:39 | |
| SotK | it'd probably be easier to help you work out where to look in the code if you create a story for it first an assign the tasks to yourself, yeah | 12:40 |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] And say I finished the task as in code, what shall I do then? | 12:41 |
| SotK | https://docs.openstack.org/infra/manual/developers.html#starting-work-on-a-new-project describes how to make and send patches | 12:46 |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] I will check it once I get home from college | 12:48 |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] what is the difference between storyboard and storyboard-webclient? | 12:57 |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] Is the webclient for the UI while the other for the API or what? | 12:57 |
| SotK | that's right, storyboard is just the api, and storyboard-webclient is a standalone web app which communicates with it] | 13:00 |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] So any code regarding retrieval of data or database should be in storyboard? | 13:06 |
| SotK | yeah | 13:06 |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] And anything regarding UI as something in Bootstrap will be in the webclient | 13:07 |
| SotK | correct | 13:07 |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] okay, one last thing for now, do suggest how do I start going through the code to understand it better? | 13:07 |
| Rou | [Radwa Khattab (radwasm), Rou's Workspace] the api | 13:07 |
| *** jpich has joined #storyboard | 13:09 | |
| *** mkarray has joined #storyboard | 13:26 | |
| SotK | I tend to read through the bits I need, starting from whichever endpoint I'm thinking about in `storyboard/api/v1/` and looking at any functions that are imported from elsewhere | 13:34 |
| SotK | https://pecan.readthedocs.io/en/latest/rest.html#writing-restful-web-services-with-restcontroller is documentation about the library we use for creating the endpoints | 13:35 |
| mkarray | I've been hearing complaints around the office here and there that storyboard has begun acting painfully slow, was there some merge that could have caused this? | 13:58 |
| SotK | I have a suspicion it was the move to have the db on the same machine as the api which has caused it | 13:58 |
| mkarray | That sounds like it would do it | 14:02 |
| SotK | fungi: how painful would it be to undo that (at least until our db is optimised a bit)? | 14:03 |
| fungi | i don't think having the db on the same server has made it slower than when it was on a remote trove instance. aside from the latency involved in communicating with the remote db, the new server instance is larger than the size of the old server instance and old trove db instance combined | 14:10 |
| fungi | another thing which changed at the same time though was moving from running on ubuntu 14.04 to 16.04 | 14:11 |
| fungi | as well as reinstalling with the latest python dependencies available, since normally they only get upgraded if the minimum requirement increases | 14:11 |
| fungi | logged into the server right now i'm running top and seeing it mostly idle most of the time. what operations are acting slow? or is it intermittently slow for all operations? | 14:12 |
| SotK | the slowness I've experienced has mostly been when navigating to or searching for stories | 14:12 |
| SotK | similar to the extreme slowness on storyboard-dev (where you click on a story and wait a non-trivial time before anything happens) but less extreme | 14:13 |
| fungi | it looks like we have a lot of cache memory pressure on the server, according to our cacti graphs | 14:14 |
| fungi | to the point where we're pushing into almost 2gb of swap even though we're only actively using 2gb of the 8gb available memory for processes | 14:14 |
| fungi | so that likely explains a lot of it. now to see what's trying to cache so much, and whether we can tune it down or need a larger instance with more available memory | 14:15 |
| fungi | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=66356&rra_id=all | 14:15 |
| fungi | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=66358&rra_id=all | 14:16 |
| fungi | so at the moment the mysqld process us consuming 3476084k and apache2 has two processes consuming 2197064k and 2183068k | 14:17 |
| fungi | corresponding resident memory for those three processes is only 350712k, 155768k and 134504k respectively though | 14:18 |
| fungi | i'm going to restart apache2 and mysqld and see what happens to memory consumption | 14:18 |
| SotK | thanks | 14:19 |
| fungi | mysqld is now at 1241908k virt 238784k res, and the apache processes are at 1368452k/73148k and 1368452k/72608k | 14:21 |
| fungi | so they spiked back up amazingly quickly | 14:21 |
| fungi | and climbing. mysqld at 1.8g virt, apache processes both back to 2.1g virt | 14:24 |
| fungi | the apache error log is accumulating quite a few wsgi errors too | 14:25 |
| *** jamesmcarthur has quit IRC | 14:25 | |
| fungi | and warnings | 14:25 |
| fungi | WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.\x1b[00m | 14:25 |
| *** jamesmcarthur has joined #storyboard | 14:25 | |
| fungi | WARNING storyboard.notifications.publisher [-] Attempted to send payload with no destination resource. | 14:25 |
| fungi | /usr/local/lib/python2.7/dist-packages/sqlalchemy/sql/sqltypes.py:255: SAWarning: Unicode type received non-unicode bind param value 'QBQo4tSFw7N8uKlDdSdMdDbKJ...'. | 14:26 |
| fungi | interestingly, the apache2/mysql restarts seem to have halved the used space on the rootfs as well: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=66359&rra_id=all | 14:28 |
| SotK | hm, interesting | 14:37 |
| *** ivy has joined #storyboard | 14:47 | |
| *** dtantsur is now known as dtantsur|bbl | 14:51 | |
| fungi | anyway, it does seem like there must be some cache memory growth at work, but for the moment the memory pressure is relieved so i'm curious whether the observed performance issues have subsided as well | 14:51 |
| fungi | if not, then obviously this was a red herring, but if things are much faster for the moment then we may need to look closer at mysql and apache cache memory use | 14:52 |
| SotK | I'm still seeing similar response times to before the restart | 14:55 |
| fungi | hrm | 15:50 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard master: Whitelist `rm` for docs target in tox.ini https://review.openstack.org/644920 | 16:15 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard master: WIP: Add docker-compose based dev setup instructions https://review.openstack.org/644921 | 16:15 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard master: WIP: rewrite/clarify non-docker dev env instructions https://review.openstack.org/644922 | 16:15 |
| SotK | the docs part of that needs a bit more tidying and I ended up almost rewriting the old installation guide, but that's a start to getting the docker-compose stuff I've been using to simplify getting my development environments up and running in-repo | 16:18 |
| *** dtantsur|bbl is now known as dtantsur | 16:22 | |
| *** altlogbot_1 has joined #storyboard | 16:41 | |
| *** altlogbot_1 has quit IRC | 16:41 | |
| *** jamesmcarthur has quit IRC | 16:52 | |
| *** jamesmcarthur has joined #storyboard | 16:53 | |
| *** udesale has quit IRC | 17:17 | |
| *** Smera has joined #storyboard | 17:19 | |
| *** altlogbot_3 has joined #storyboard | 17:27 | |
| *** altlogbot_3 has quit IRC | 17:28 | |
| *** altlogbot_3 has joined #storyboard | 17:31 | |
| *** jpich has quit IRC | 17:33 | |
| *** Smera has quit IRC | 17:43 | |
| *** Smera has joined #storyboard | 17:44 | |
| *** Smera has quit IRC | 17:52 | |
| *** Smera has joined #storyboard | 17:53 | |
| *** dtantsur is now known as dtantsur|afk | 17:53 | |
| mkarray | Will there be a meeting today? | 17:58 |
| Smera | Hey! I have a follow-up question. How do I run the webclient on localhost? I googled, but was only able to come up with generic responses. | 18:04 |
| *** mrhillsman has joined #storyboard | 18:09 | |
| mkarray | Smera: Refer to this https://docs.openstack.org/infra/storyboard/install/development.html#installing-the-javascript-based-web-client | 18:11 |
| *** irclogbot_3 has quit IRC | 18:21 | |
| *** irclogbot_2 has joined #storyboard | 18:25 | |
| clarkb | fungi: diablo_rojo_phon SotK see mkarray's question about a meeting today | 18:25 |
| diablo_rojo_phon | clarkb: yeah was debating. | 18:26 |
| diablo_rojo_phon | I think it would be good to have one if you're around SotK | 18:27 |
| *** irclogbot_2 has quit IRC | 18:27 | |
| *** irclogbot_3 has joined #storyboard | 18:30 | |
| fungi | i know mkarray had a topic to bring up about webclient handling of user objects in searches | 18:30 |
| fungi | as far as having a bit of a design discussion | 18:30 |
| fungi | i'm good with holding a meeting | 18:31 |
| mkarray | I'm okay either way, my topic doesn't necessarily require a meeting though it probably suits being in one | 18:32 |
| *** diablo_rojo has joined #storyboard | 18:33 | |
| diablo_rojo | I will update the agenda then | 18:34 |
| diablo_rojo | mkarray, was the changing query structure your topic? | 18:35 |
| mkarray | yup, If were holding one I can go into more detail | 18:35 |
| diablo_rojo | mkarray, cool. Don't need to add anything else to the agenda just was confirming thats what you wanted to talk about | 18:36 |
| SotK | Yeah let's have one | 18:36 |
| diablo_rojo | SotK, the agenda is updated I think | 18:38 |
| fungi | thanks diablo_rojo! | 18:42 |
| *** altlogbot_3 has quit IRC | 19:00 | |
| SotK | right then, meeting time | 19:01 |
| *** altlogbot_0 has joined #storyboard | 19:03 | |
| *** altlogbot_0 has quit IRC | 19:06 | |
| *** Fatema_ has joined #storyboard | 19:07 | |
| *** altlogbot_1 has joined #storyboard | 19:08 | |
| *** Smera has quit IRC | 19:12 | |
| *** Smera has joined #storyboard | 19:13 | |
| *** Fatema_ has quit IRC | 19:14 | |
| *** irclogbot_3 has quit IRC | 19:16 | |
| *** irclogbot_1 has joined #storyboard | 19:18 | |
| *** Smera has quit IRC | 19:26 | |
| *** irclogbot_1 has quit IRC | 19:30 | |
| *** irclogbot_0 has joined #storyboard | 19:32 | |
| *** altlogbot_1 has quit IRC | 19:34 | |
| *** altlogbot_0 has joined #storyboard | 19:36 | |
| *** dhellmann has quit IRC | 19:57 | |
| fungi | swap activity and disk i/o on the swap partition are definitely almost nonexistent since the mysql and apache2 restarts at ~14:20 utc | 19:58 |
| *** dhellmann has joined #storyboard | 19:59 | |
| fungi | the story view of a project-team page seems to populate fairly quickly for me | 20:00 |
| fungi | loading a random story seems to populate tasks and comments in a reasonable timeframe | 20:01 |
| * SotK tries again now he's in a different place | 20:02 | |
| fungi | mostly curious to know which particular actions (besides the automatic worklist/board lanes we already knew to be slow) are performing questionably | 20:02 |
| fungi | if nothing else it gives me something to recreate the observed problems with if i'm trying different tuning options | 20:03 |
| mkarray | I'll ask the people who mentioned complaints to me today when they are free fungi (and if the problem is persisting) | 20:03 |
| SotK | I'm seeing a delay of about 3 seconds from clicking on a link to a story in the story list to something actually happens (which is because the story is pre-loaded before the state is changed, its the request to get the story that is taking that time) | 20:04 |
| SotK | its long enough to feel like the click didn't work, which is a relatively new development | 20:04 |
| fungi | got it. i do wonder what's going on during those several seconds | 20:06 |
| fungi | some api query happening? | 20:07 |
| SotK | yeah, its a query to /v1/stories/:id | 20:13 |
| SotK | s/query/GET request/ | 20:13 |
| fungi | okay, so in theory i can debug by hitting the api directly and timing the response | 20:21 |
| *** irclogbot_0 has quit IRC | 20:45 | |
| *** irclogbot_2 has joined #storyboard | 20:48 | |
| *** altlogbot_0 has quit IRC | 20:53 | |
| *** altlogbot_1 has joined #storyboard | 20:56 | |
| *** ivy has quit IRC | 21:00 | |
| openstackgerrit | Malek Karray proposed openstack-infra/storyboard-webclient master: Flawed logic when checking for invalid query https://review.openstack.org/645008 | 21:09 |
| *** mkarray has quit IRC | 21:24 | |
| *** whoami-rajat has quit IRC | 21:29 | |
| *** jamesmcarthur has quit IRC | 23:23 | |
| *** tosky has quit IRC | 23:31 | |
| *** jamesmcarthur has joined #storyboard | 23:32 | |
| *** jamesmcarthur has quit IRC | 23:38 | |
| *** jamesmcarthur has joined #storyboard | 23:38 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
