| *** vilobhmm11 has joined #openstack-operators | 00:00 | |
| *** vilobhmm11 has quit IRC | 00:09 | |
| *** vilobhmm11 has joined #openstack-operators | 00:09 | |
| *** k_stev has quit IRC | 00:26 | |
| *** Marga_ has quit IRC | 00:53 | |
| *** vilobhmm11 has quit IRC | 01:18 | |
| *** dims has quit IRC | 01:26 | |
| *** markvoelker has quit IRC | 01:43 | |
| *** vsedelnik has joined #openstack-operators | 01:46 | |
| *** vsedelnik has quit IRC | 01:50 | |
| *** zengine has joined #openstack-operators | 02:10 | |
| *** nikhil has joined #openstack-operators | 02:25 | |
| *** chlong has joined #openstack-operators | 02:45 | |
| *** vsedelnik has joined #openstack-operators | 02:47 | |
| *** vsedelnik has quit IRC | 02:51 | |
| *** tricksters has quit IRC | 02:59 | |
| *** haukebruno has quit IRC | 03:08 | |
| *** haukebruno has joined #openstack-operators | 03:08 | |
| *** britthouser has joined #openstack-operators | 03:46 | |
| *** vsedelnik has joined #openstack-operators | 03:47 | |
| *** vsedelnik has quit IRC | 03:52 | |
| *** zengine has quit IRC | 04:02 | |
| *** Marga_ has joined #openstack-operators | 04:17 | |
| *** vsedelnik has joined #openstack-operators | 04:21 | |
| *** chlong has quit IRC | 05:12 | |
| *** vilobhmm11 has joined #openstack-operators | 05:13 | |
| *** saneax_AFK is now known as saneax | 05:25 | |
| *** chlong has joined #openstack-operators | 05:29 | |
| *** rcernin has joined #openstack-operators | 05:47 | |
| *** rcernin has quit IRC | 05:57 | |
| *** lhcheng_ has joined #openstack-operators | 06:12 | |
| *** lhcheng has quit IRC | 06:14 | |
| *** lhcheng_ has quit IRC | 06:17 | |
| *** lhcheng has joined #openstack-operators | 06:17 | |
| *** simon-AS559 has joined #openstack-operators | 06:20 | |
| *** simon-AS559 has quit IRC | 06:26 | |
| *** zhangjn has quit IRC | 07:15 | |
| *** Marga_ has quit IRC | 07:17 | |
| *** zhangjn has joined #openstack-operators | 07:20 | |
| *** liverpooler has joined #openstack-operators | 07:21 | |
| *** simon-AS559 has joined #openstack-operators | 07:22 | |
| *** armax has joined #openstack-operators | 07:25 | |
| *** chlong has quit IRC | 07:30 | |
| *** haukebruno has quit IRC | 07:31 | |
| *** haukebruno has joined #openstack-operators | 07:35 | |
| *** belmoreira has joined #openstack-operators | 07:39 | |
| *** zeih has joined #openstack-operators | 07:44 | |
| *** eddima has joined #openstack-operators | 07:47 | |
| *** zeih has quit IRC | 07:48 | |
| *** Miouge has joined #openstack-operators | 07:49 | |
| *** lhcheng has quit IRC | 08:06 | |
| *** zz9pzza has joined #openstack-operators | 08:23 | |
| *** pcaruana has joined #openstack-operators | 08:25 | |
| *** admin0 has joined #openstack-operators | 08:50 | |
| *** tricksters has joined #openstack-operators | 08:52 | |
| *** admin0 has quit IRC | 08:56 | |
| *** pilgrimstack has joined #openstack-operators | 09:00 | |
| *** admin0 has joined #openstack-operators | 09:00 | |
| *** racedo has joined #openstack-operators | 09:17 | |
| *** admin0 has quit IRC | 09:34 | |
| *** admin0 has joined #openstack-operators | 09:34 | |
| *** eddima1 has joined #openstack-operators | 09:43 | |
| *** electrofelix has joined #openstack-operators | 09:44 | |
| *** derekh has joined #openstack-operators | 09:44 | |
| *** eddima has quit IRC | 09:45 | |
| *** eddima1 is now known as eddima | 09:45 | |
| *** eddima has quit IRC | 09:46 | |
| *** eddima has joined #openstack-operators | 09:47 | |
| *** vilobhmm11 has quit IRC | 09:50 | |
| *** vsedelnik has quit IRC | 10:18 | |
| *** mdavidson has quit IRC | 10:20 | |
| *** dims_ has joined #openstack-operators | 10:41 | |
| *** eddima has quit IRC | 10:41 | |
| *** eddima has joined #openstack-operators | 10:42 | |
| *** simon-AS5591 has joined #openstack-operators | 10:45 | |
| *** chlong has joined #openstack-operators | 10:45 | |
| *** permalac has joined #openstack-operators | 10:47 | |
| *** simon-AS559 has quit IRC | 10:48 | |
| *** vsedelnik has joined #openstack-operators | 10:51 | |
| *** vsedelnik has quit IRC | 10:54 | |
| *** mdavidson has joined #openstack-operators | 10:54 | |
| *** admin0 has quit IRC | 10:55 | |
| *** admin0 has joined #openstack-operators | 11:01 | |
| *** dims_ has quit IRC | 11:09 | |
| *** dims_ has joined #openstack-operators | 11:22 | |
| *** britthouser has quit IRC | 11:26 | |
| *** britthouser has joined #openstack-operators | 11:26 | |
| *** britthouser has quit IRC | 11:27 | |
| *** britthouser has joined #openstack-operators | 11:27 | |
| *** chlong has quit IRC | 11:29 | |
| *** chlong has joined #openstack-operators | 11:42 | |
| *** jhyang_ has joined #openstack-operators | 11:45 | |
| *** jhyang_ has quit IRC | 11:45 | |
| *** jhyang_ has joined #openstack-operators | 11:46 | |
| *** saneax is now known as saneax_AFK | 11:58 | |
| *** admin0 has quit IRC | 12:09 | |
| *** vsedelnik has joined #openstack-operators | 12:12 | |
| *** vsedelnik has quit IRC | 12:13 | |
| *** vsedelnik has joined #openstack-operators | 12:13 | |
| *** cdelatte has joined #openstack-operators | 12:34 | |
| *** admin0 has joined #openstack-operators | 12:50 | |
| *** matrohon has joined #openstack-operators | 12:52 | |
| *** nikhil has quit IRC | 12:58 | |
| *** simon-AS559 has joined #openstack-operators | 13:01 | |
| *** jaypipes has joined #openstack-operators | 13:02 | |
| *** simon-AS5591 has quit IRC | 13:03 | |
| *** zengine has joined #openstack-operators | 13:04 | |
| *** simon-AS5591 has joined #openstack-operators | 13:05 | |
| *** simon-AS559 has quit IRC | 13:07 | |
| *** admin0 has quit IRC | 13:09 | |
| *** admin0 has joined #openstack-operators | 13:10 | |
| *** fubi has joined #openstack-operators | 13:21 | |
| *** dims_ has quit IRC | 13:25 | |
| *** dminer has joined #openstack-operators | 13:52 | |
| *** k_stev has joined #openstack-operators | 13:53 | |
| *** Miouge has quit IRC | 13:53 | |
| *** Miouge has joined #openstack-operators | 13:55 | |
| *** simon-AS559 has joined #openstack-operators | 14:04 | |
| *** rarcea has joined #openstack-operators | 14:05 | |
| *** simon-AS5591 has quit IRC | 14:08 | |
| *** Marga_ has joined #openstack-operators | 14:17 | |
| *** k_stev has quit IRC | 14:19 | |
| *** k_stev has joined #openstack-operators | 14:20 | |
| *** markvoelker has joined #openstack-operators | 14:28 | |
| *** vsedelnik has quit IRC | 14:28 | |
| *** VW has joined #openstack-operators | 14:33 | |
| *** markvoelker has quit IRC | 14:33 | |
| *** VW has quit IRC | 14:34 | |
| *** VW has joined #openstack-operators | 14:35 | |
| *** markvoelker has joined #openstack-operators | 14:37 | |
| *** mriedem has joined #openstack-operators | 14:42 | |
| *** markvoelker_ has joined #openstack-operators | 14:44 | |
| *** markvoelker has quit IRC | 14:47 | |
| *** jhyang_ has quit IRC | 14:51 | |
| *** admin0 has quit IRC | 14:54 | |
| *** dims has joined #openstack-operators | 14:54 | |
| *** admin0 has joined #openstack-operators | 15:05 | |
| *** mdorman has joined #openstack-operators | 15:05 | |
| *** zeih has joined #openstack-operators | 15:08 | |
| *** simon-AS559 has quit IRC | 15:11 | |
| *** simon-AS559 has joined #openstack-operators | 15:12 | |
| *** markvoelker_ has quit IRC | 15:13 | |
| *** markvoelker has joined #openstack-operators | 15:13 | |
| *** markvoelker has quit IRC | 15:14 | |
| *** markvoelker has joined #openstack-operators | 15:14 | |
| *** markvoelker has quit IRC | 15:18 | |
| *** markvoelker has joined #openstack-operators | 15:19 | |
| *** markvoelker has quit IRC | 15:19 | |
| *** ducttape_ has joined #openstack-operators | 15:25 | |
| ducttape_ | has anyone noticed glance image uploads are really slow? or perhaps there is a better / good way to upload glance images? I'm seeing 45 minutes to upload an image, and I can download that image in less than 15 minutes | 15:27 |
|---|---|---|
| *** piet has joined #openstack-operators | 15:27 | |
| *** piet has quit IRC | 15:27 | |
| *** piet has joined #openstack-operators | 15:30 | |
| haukebruno | ducttape_, it depends a lot on your infrastructure, for example your network connection and your underlaying storage | 15:36 |
| ducttape_ | I have not see our storage or infrastructure impacting anything else quite like how slow glance image uploads are, which is what is weird | 15:38 |
| haukebruno | ducttape_, you should start pointing out things using tools like atop. | 15:40 |
| *** regXboi has joined #openstack-operators | 15:41 | |
| haukebruno | ducttape_, do you upload from horizon or cli? | 15:42 |
| ducttape_ | this is all cli | 15:42 |
| ducttape_ | we are trying to get a process to keep the same image available / replicated in a multi region setup | 15:43 |
| haukebruno | ducttape_, so you are uploading between regions? are they l3 seperated? could be networking related here. we never experienced _that_ slow uploads. 45min sounds way to much for a standard cloud image | 15:44 |
| ducttape_ | so there is a WAN path this takes, which could be it. it's weird | 15:45 |
| haukebruno | ducttape_, could you fire a simple iperf from source to destination and vice versa? | 15:47 |
| ducttape_ | yeah, that can handle about 2.5 Gbps iirc | 15:48 |
| haukebruno | well, sounds good. | 15:48 |
| ducttape_ | yeah, that is not too bad | 15:48 |
| haukebruno | so I would start checking both sides while running atop when the upload runs. It could point out that there is a stressed disk or cpu, NIC whatever | 15:49 |
| *** zengine_ has joined #openstack-operators | 15:50 | |
| *** zengine has quit IRC | 15:50 | |
| *** zengine_ is now known as zengine | 15:50 | |
| ducttape_ | could be, but I doubt it. We have multiple nodes running glance api, all fairly large machines. multiple ceph osd / mon etc nodes.... we have a lot of capacity to handle a single XX GB image | 15:50 |
| ducttape_ | 100GB should be a trivial | 15:50 |
| haukebruno | ducttape_, somethings it ist just one small little thing, that causes that much trouble. you need to start investigating anyhow :p | 15:53 |
| *** zeih has quit IRC | 15:59 | |
| klindgren | Is your glance handling ssl traffic? OR did you offload that to something else? Also I would look at tcpdump on one of the session and see what your window size is. Its possible that you will need to increaces it. Though usually an iperf would show you that. | 15:59 |
| *** belmoreira has quit IRC | 16:01 | |
| *** liverpooler has quit IRC | 16:03 | |
| ducttape_ | I just saw iperf running at 3-4 Gbps.... using default options. we have tuned window sizes already. it really is a glance specific thing, I am pretty sure | 16:05 |
| *** nikhil has joined #openstack-operators | 16:06 | |
| *** ctrath has joined #openstack-operators | 16:08 | |
| *** permalac has quit IRC | 16:14 | |
| *** esker has joined #openstack-operators | 16:15 | |
| *** haukebruno has quit IRC | 16:16 | |
| *** esker has quit IRC | 16:16 | |
| *** admin0 has quit IRC | 16:23 | |
| *** klindgren has quit IRC | 16:43 | |
| *** david_lyle has quit IRC | 16:46 | |
| *** david_lyle has joined #openstack-operators | 16:46 | |
| *** zengine has quit IRC | 16:47 | |
| *** simon-AS559 has quit IRC | 16:47 | |
| *** zz9pzza has quit IRC | 16:49 | |
| *** klindgren has joined #openstack-operators | 16:50 | |
| *** matrohon has quit IRC | 16:50 | |
| *** Marga_ has quit IRC | 16:53 | |
| *** armax has quit IRC | 16:56 | |
| *** eddima has quit IRC | 16:56 | |
| *** piet has quit IRC | 17:04 | |
| *** piet has joined #openstack-operators | 17:09 | |
| *** fawadkhaliq has joined #openstack-operators | 17:11 | |
| *** apoorvad has joined #openstack-operators | 17:12 | |
| *** klindgren_ has joined #openstack-operators | 17:13 | |
| *** zengine has joined #openstack-operators | 17:13 | |
| *** klindgren has quit IRC | 17:16 | |
| *** sgordon has quit IRC | 17:18 | |
| *** Marga_ has joined #openstack-operators | 17:24 | |
| *** gyee has joined #openstack-operators | 17:25 | |
| *** zengine_ has joined #openstack-operators | 17:34 | |
| *** Marga_ has quit IRC | 17:35 | |
| *** zengine has quit IRC | 17:36 | |
| *** zengine_ is now known as zengine | 17:36 | |
| *** armax has joined #openstack-operators | 17:40 | |
| *** rarcea has quit IRC | 17:47 | |
| *** simon-AS559 has joined #openstack-operators | 17:48 | |
| *** Marga_ has joined #openstack-operators | 17:48 | |
| *** Marga_ has quit IRC | 17:51 | |
| *** Marga_ has joined #openstack-operators | 17:51 | |
| *** piet has quit IRC | 17:56 | |
| mfisch | jlk: do you have any workflows you've used to connect heat & ansible? | 17:56 |
| mfisch | for example, setting up a galera cluster in heat really sucks and is hacky | 17:56 |
| mfisch | so I'd like heat to do the infra work and then have ansible take over | 17:57 |
| jlk | mfisch: nothing good, I think we've mostly just used ansible to call heat client via command, and then figured out what the new system contact points were and touched them with ansible like normal. | 17:59 |
| *** fawadkhaliq has quit IRC | 17:59 | |
| mfisch | how did you build the inventory? | 17:59 |
| jlk | we haven't made it a priority, we only really do VM bring up for infra as part of our CI runs. | 17:59 |
| *** fawadkhaliq has joined #openstack-operators | 18:00 | |
| jlk | I think our CI scripts are doing something ugly to do multiple ansible-playbook runs and creating a static inventory based on heat results | 18:00 |
| jlk | it's not a good model. | 18:00 |
| mfisch | I'm tasked with making a model webapp to show our customers | 18:00 |
| mfisch | so I'm doing etherpad, with load balanced front/backends | 18:00 |
| mfisch | it features gems like this | 18:01 |
| mfisch | if [ "$ip$" == "10.10.0.4" ]; then | 18:01 |
| mfisch | sudo /etc/init.d/mysql bootstrap-pxc | 18:01 |
| mfisch | so that only works in a clean tenant ;) | 18:01 |
| jlk | yeah. | 18:02 |
| *** tricksters has quit IRC | 18:06 | |
| mfisch | yeah. about sums it up | 18:06 |
| *** elo has joined #openstack-operators | 18:06 | |
| mfisch | I was going to ping you on twitter but I can't ever remember your name there | 18:07 |
| jlk | @iamjkeating | 18:07 |
| jlk | it's really hard | 18:07 |
| mfisch | I always just type a name in when I cant remember but you're name is like Cloud Bike Dev Ops or something | 18:08 |
| mfisch | ah Cloud Peddler | 18:08 |
| jlk | ah | 18:09 |
| jlk | that | 18:09 |
| *** markvoelker has joined #openstack-operators | 18:10 | |
| *** harlowja has joined #openstack-operators | 18:11 | |
| *** markvoelker has quit IRC | 18:13 | |
| *** markvoelker has joined #openstack-operators | 18:13 | |
| *** lhcheng has joined #openstack-operators | 18:17 | |
| *** lhcheng has quit IRC | 18:17 | |
| *** lhcheng has joined #openstack-operators | 18:18 | |
| *** lhcheng has quit IRC | 18:21 | |
| *** lhcheng has joined #openstack-operators | 18:23 | |
| *** Marga_ has quit IRC | 18:23 | |
| *** racedo has quit IRC | 18:27 | |
| *** rarcea has joined #openstack-operators | 18:38 | |
| *** sgordon has joined #openstack-operators | 18:46 | |
| *** Marga_ has joined #openstack-operators | 18:50 | |
| *** markvoelker has quit IRC | 18:51 | |
| *** zengine has quit IRC | 18:58 | |
| *** rockyg has joined #openstack-operators | 19:02 | |
| *** vilobhmm11 has joined #openstack-operators | 19:13 | |
| *** esker has joined #openstack-operators | 19:16 | |
| *** k_stev has quit IRC | 19:31 | |
| *** VW has quit IRC | 19:34 | |
| *** VW has joined #openstack-operators | 19:36 | |
| *** VW has quit IRC | 19:36 | |
| *** VW has joined #openstack-operators | 19:37 | |
| *** admin0 has joined #openstack-operators | 19:46 | |
| *** piet has joined #openstack-operators | 19:48 | |
| *** admin0 has quit IRC | 19:49 | |
| *** rockyg has quit IRC | 19:50 | |
| *** vilobhmm11 has left #openstack-operators | 19:52 | |
| *** zeih has joined #openstack-operators | 19:57 | |
| *** apoorvad has quit IRC | 20:01 | |
| *** apoorvad has joined #openstack-operators | 20:01 | |
| *** Marga_ has quit IRC | 20:04 | |
| *** rockyg has joined #openstack-operators | 20:04 | |
| *** rockyg has quit IRC | 20:09 | |
| *** david-lyle_ has joined #openstack-operators | 20:12 | |
| *** david_lyle has quit IRC | 20:13 | |
| *** Marga_ has joined #openstack-operators | 20:15 | |
| *** harlowja has quit IRC | 20:18 | |
| *** admin0 has joined #openstack-operators | 20:23 | |
| *** zeih has quit IRC | 20:24 | |
| *** david-lyle_ is now known as david-lyle | 20:26 | |
| *** simon-AS5591 has joined #openstack-operators | 20:43 | |
| *** admin0 has quit IRC | 20:44 | |
| *** simon-AS559 has quit IRC | 20:46 | |
| *** belmoreira has joined #openstack-operators | 20:50 | |
| *** rarcea has quit IRC | 20:58 | |
| *** stevemar has quit IRC | 20:59 | |
| *** stevemar has joined #openstack-operators | 21:01 | |
| *** belmoreira has quit IRC | 21:04 | |
| *** esker has quit IRC | 21:04 | |
| *** esker has joined #openstack-operators | 21:04 | |
| *** dims has quit IRC | 21:07 | |
| *** esker has quit IRC | 21:11 | |
| *** ctrath has quit IRC | 21:17 | |
| *** ctrath has joined #openstack-operators | 21:19 | |
| *** delattec has joined #openstack-operators | 21:29 | |
| *** admin0 has joined #openstack-operators | 21:29 | |
| *** cdelatte has quit IRC | 21:32 | |
| *** derekh has quit IRC | 21:36 | |
| *** admin0 has quit IRC | 21:46 | |
| mgagne | any suggestion for a tool to automate or script image testing? Like you build a new image and you wish to test some stuff within the image to make sure it supports a minimal set of feature | 21:48 |
| *** harlowja has joined #openstack-operators | 21:52 | |
| *** krobzaur has joined #openstack-operators | 21:56 | |
| *** dims has joined #openstack-operators | 21:58 | |
| *** dims has quit IRC | 22:01 | |
| *** flwang has joined #openstack-operators | 22:01 | |
| xavpaice | mgagne: someone here has something which migtht be of interest - I've asked if he can pop in here | 22:01 |
| flwang | mgagne: hi | 22:01 |
| *** david-lyle has quit IRC | 22:02 | |
| flwang | this is flwang from Glance team | 22:02 |
| mgagne | xavpaice: I just found some test suites for Ubuntu. They have a framework able to run any scripts. But some tests are simply written in Python with paramiko | 22:02 |
| mgagne | flwang: hi! | 22:02 |
| *** david-lyle has joined #openstack-operators | 22:02 | |
| flwang | mgagne: we have a script for updating our public images automatically | 22:02 |
| mgagne | flwang: yea, that's the next step in my quest =) | 22:03 |
| flwang | the script will download images data and create image in glance, then create instance based on it, setup network, and ping it | 22:03 |
| flwang | to verify if the image is really workable | 22:03 |
| flwang | so maybe you can leverage the script to put more features on that | 22:03 |
| flwang | xavpaice: mgagne: i'm wondering if there is a repo under openstack big tent for operators | 22:04 |
| flwang | xavpaice: you know, just like the repo we have : openstack-ops-tool | 22:04 |
| flwang | so that operators can contribute script? | 22:05 |
| mgagne | yea, uploading image and booting would be common code to all images I guess. from there, maybe the tool could provide some helpers to ease SSH client creation and such | 22:05 |
| mgagne | because I think it wouldn't be that hard | 22:05 |
| mgagne | just a lot of code ahead =) | 22:06 |
| *** simon-AS5591 has quit IRC | 22:06 | |
| flwang | mgagne: yep, my script does have the SSH part, IIRC, anyway, it's easy to add | 22:06 |
| mgagne | thinking about it, writing the tests in python wouldn't be that hard | 22:07 |
| mgagne | I guess I'm just lazy on Monday and tomorrow I'll have a framework written anyway :D | 22:07 |
| xavpaice | flwang: git@github.com:openstack/osops-tools-contrib.git | 22:08 |
| flwang | xavpaice: wow, our tenant script has been there :) | 22:10 |
| xavpaice | yeah, I'm sure we discussed putting that there | 22:11 |
| flwang | xavpaice: yep, maybe we should contribute the image.py back as well | 22:11 |
| xavpaice | +1 | 22:12 |
| xavpaice | I'd like to put most of our stuff there | 22:12 |
| flwang | mgagne: are you still interested in our image script? | 22:13 |
| mgagne | flwang: maybe. talking to you gave me ideas to start =) | 22:14 |
| flwang | mgagne: ok, i will upstream our code to osops-tools-contrib | 22:14 |
| *** krobzaur has quit IRC | 22:15 | |
| *** admin0 has joined #openstack-operators | 22:19 | |
| *** VW has quit IRC | 22:22 | |
| *** k_stev has joined #openstack-operators | 22:23 | |
| *** regXboi has quit IRC | 22:29 | |
| *** mriedem is now known as mriedem_away | 22:44 | |
| *** fawadkhaliq has quit IRC | 22:54 | |
| *** fawadkhaliq has joined #openstack-operators | 22:56 | |
| *** k_stev has quit IRC | 22:58 | |
| *** krobzaur has joined #openstack-operators | 23:03 | |
| *** piet has quit IRC | 23:10 | |
| *** harlowja has quit IRC | 23:13 | |
| *** harlowja has joined #openstack-operators | 23:14 | |
| *** VW has joined #openstack-operators | 23:15 | |
| *** admin0 has quit IRC | 23:18 | |
| *** markvoelker_ has joined #openstack-operators | 23:19 | |
| *** haukebruno has joined #openstack-operators | 23:21 | |
| *** piet has joined #openstack-operators | 23:21 | |
| *** krobzaur has quit IRC | 23:23 | |
| *** piet has quit IRC | 23:27 | |
| *** britthouser has quit IRC | 23:30 | |
| *** piet has joined #openstack-operators | 23:30 | |
| *** saneax_AFK is now known as saneax | 23:35 | |
| *** ctrath has quit IRC | 23:36 | |
| *** ducttape_ has quit IRC | 23:38 | |
| *** VW has quit IRC | 23:44 | |
| *** mdorman has quit IRC | 23:47 | |
| *** k_stev has joined #openstack-operators | 23:51 | |
| *** dminer has quit IRC | 23:52 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!