| *** panda__ has joined #tripleo | 00:01 | |
| openstackgerrit | A change was merged to openstack/diskimage-builder: Implement serial-console for systemd. https://review.openstack.org/66385 | 00:03 |
|---|---|---|
| openstackgerrit | A change was merged to openstack/diskimage-builder: Wait for tgtd socket to be available https://review.openstack.org/66639 | 00:03 |
| *** panda___ has quit IRC | 00:04 | |
| *** ftcjeff has quit IRC | 00:13 | |
| *** CaptTofu has joined #tripleo | 00:17 | |
| *** panda__ has quit IRC | 00:17 | |
| *** martyntaylor has quit IRC | 00:29 | |
| *** panda__ has joined #tripleo | 00:31 | |
| *** mtaylor is now known as mordred | 00:36 | |
| *** mordred has quit IRC | 00:36 | |
| *** mordred has joined #tripleo | 00:36 | |
| *** CaptTofu has quit IRC | 00:38 | |
| StevenK | Fetched 20.5 MB in 1s (17.8 MB/s) | 00:59 |
| StevenK | Oh yes | 00:59 |
| *** panda has joined #tripleo | 01:03 | |
| openstackgerrit | Steve Kowalik proposed a change to openstack/diskimage-builder: Allow use of mirrors when building Ubuntu images https://review.openstack.org/66984 | 01:04 |
| StevenK | ^ That change makes disk-image-create take about ~50 seconds locally | 01:04 |
| *** boris-42 has quit IRC | 01:05 | |
| *** CaptTofu has joined #tripleo | 01:05 | |
| *** panda__ has quit IRC | 01:07 | |
| *** jcoufal has quit IRC | 01:08 | |
| *** newell has quit IRC | 01:17 | |
| *** nosnos has joined #tripleo | 01:33 | |
| *** panda__ has joined #tripleo | 01:35 | |
| *** xuhanp has joined #tripleo | 01:37 | |
| *** panda has quit IRC | 01:38 | |
| *** itooon has joined #tripleo | 01:42 | |
| *** itooon has quit IRC | 01:44 | |
| *** spzala has joined #tripleo | 01:52 | |
| *** julim has quit IRC | 01:54 | |
| *** ftcjeff has joined #tripleo | 02:06 | |
| mordred | StevenK: nice! | 02:08 |
| *** ftcjeff has quit IRC | 02:10 | |
| lifeless | StevenK: schaweet | 02:45 |
| *** panda__ has quit IRC | 02:47 | |
| *** panda__ has joined #tripleo | 02:51 | |
| *** bnemec has quit IRC | 03:01 | |
| *** AaronGr is now known as AaronGr_Zzz | 03:04 | |
| StevenK | lifeless: So I ran devtest.sh on my desktop yesterday, and it looked to run disk-image-create over and over until I got annoyed at it at 6pm and killed it | 03:09 |
| StevenK | And it would be nice to have the diskimage-builder change land before I try again for pure speed | 03:10 |
| *** CaptTofu has quit IRC | 03:23 | |
| *** CaptTofu has joined #tripleo | 03:26 | |
| lifeless | StevenK: you don't need that to land to use it | 03:31 |
| StevenK | lifeless: Oh? Just make sure the is in the .cache? | 03:37 |
| *** SlickNik has quit IRC | 03:41 | |
| *** SlickNik has joined #tripleo | 03:42 | |
| *** SlickNik has left #tripleo | 03:46 | |
| *** SlickNik has joined #tripleo | 03:48 | |
| *** CaptTofu has quit IRC | 03:54 | |
| lifeless | StevenK: yah, just as long as you are a strict successor of HEAD | 04:01 |
| lifeless | StevenK: see scripts/pull-tools | 04:01 |
| StevenK | Fetched 59.5 MB in 1s (36.6 MB/s) | 04:02 |
| StevenK | A local mirror is utter win. That is all. | 04:02 |
| *** weshay has quit IRC | 04:13 | |
| devananda | StevenK: awesomesauce | 04:23 |
| devananda | that will make working on a plane sooo much better | 04:23 |
| clarkb | devananda: emirates bumped me to business on the dubai seattle flight btw. It may be worth asking about on your way back as well | 04:24 |
| devananda | clarkb: whoa! nice | 04:24 |
| devananda | i'll check | 04:24 |
| StevenK | clarkb: Lie flat chair? | 04:25 |
| clarkb | StevenK: ya, I actually slept on a plane that never happens | 04:25 |
| StevenK | I have Melatonin for that. | 04:25 |
| mordred | clarkb: oh - when you say "last leg" | 04:28 |
| mordred | clarkb: I didnt' realize you were talking about business on dubai to seattle - that's a nice bump | 04:29 |
| clarkb | mordred: ya, it was pretty sweet. 14 hours | 04:29 |
| mordred | clarkb: it's all the difference isn't it? | 04:29 |
| * StevenK has yet to fly business at all | 04:29 | |
| StevenK | I've been bumped to premium economy twice, which is good | 04:30 |
| *** boris-42 has joined #tripleo | 04:30 | |
| mordred | StevenK: some of us (me) fly so much that we get bumped to business frequently - but I'm not sure the cost/benefit is really a net win | 04:30 |
| mordred | StevenK: considering that I loged 195k flight miles last year - I believe I'm getting the bad end of that deal | 04:31 |
| clarkb | I'm not sure I would pay for it. I think if I had paid for it business would've been 4x the cost (at least when I booked) | 04:31 |
| clarkb | in this case they just printed me a new boarding pass as I netered the secure gate area | 04:31 |
| mordred | I would TOTALLY pay for it if I had that kind of money | 04:31 |
| mordred | I do not have that kind of money | 04:32 |
| lifeless | mordred: your employer should :) | 04:32 |
| StevenK | I can pay points to upgrade, but it's like 75,000 points for SYD->LAX | 04:32 |
| mordred | my favorite insulting thing is when delta shows me ads for delta private jets - when I'm sitting in economy | 04:32 |
| StevenK | Hahaha | 04:32 |
| lifeless | mordred: LOL | 04:32 |
| lifeless | StevenK: so, devtest was more successful for you? | 04:32 |
| StevenK | lifeless: It's faster. Not sure if it's more successful. | 04:33 |
| lifeless | StevenK: are you trying the full thing, or the broken out bits/ | 04:33 |
| StevenK | Full thing | 04:33 |
| lifeless | it should build 5 images overall | 04:34 |
| StevenK | Ah ha, so it is supposed to run disk-image-create a lot. Right. | 04:34 |
| mordred | lifeless: I'm still a little disappointed that dib doesn't have a trendier hipster name | 04:35 |
| lifeless | seed, undercloud, overcloud control overcloud hypervisor, user | 04:35 |
| lifeless | mordred: deal | 04:35 |
| mordred | lifeless: WAAAAHHHHHHHH | 04:35 |
| clarkb | mordred: you can use packer if that is what you need | 04:36 |
| StevenK | lifeless: Pft, "Patches welcome" ? | 04:36 |
| lifeless | StevenK: on? | 04:37 |
| StevenK | lifeless: For mordred to write to give dib a hipster name ... | 04:37 |
| mordred | I mean, to be honest, turbo-hipster totally won the project naming game. | 04:38 |
| StevenK | I think 'ironic' is a close second | 04:39 |
| mordred | you know we trademarked that, right? | 04:39 |
| StevenK | Given the discussions I've had over the week at LCA, I'd be unsurprised if it hadn't been. | 04:40 |
| lifeless | StevenK: ah no. The name is. | 04:49 |
| lifeless | StevenK: *if* a compelling alternative turned up, I'd consider it | 04:50 |
| lifeless | StevenK: or someone can vote me off the island :P | 04:50 |
| StevenK | Hah | 04:53 |
| *** spzala has quit IRC | 04:53 | |
| StevenK | "Waiting for the undercloud stack to be ready" << are we there yet? | 04:53 |
| *** rushiagr has joined #tripleo | 04:54 | |
| *** coolsvap has joined #tripleo | 04:55 | |
| lifeless | StevenK: so naming is actually generally consensus; twas humour before | 05:24 |
| lifeless | StevenK: heat event-list undercloud from a terminal where you have sourced the devtest variables and sourced seedrc should let you query the undercloud deployment status | 05:25 |
| StevenK | It's doing more pip stuff now, not sure which it's doing | 05:26 |
| *** nosnos_ has joined #tripleo | 05:27 | |
| *** nosnos has quit IRC | 05:28 | |
| StevenK | Right, that's overcloud-control almost done | 05:34 |
| * SpamapS sings | 05:43 | |
| SpamapS | the neverending deeevvteeessstttt | 05:43 |
| SpamapS | it goes on and on and on.... | 05:43 |
| lifeless | right, you've now deployed three clouds | 05:50 |
| lifeless | mordred: you have the mail I promised you | 05:50 |
| *** CaptTofu has joined #tripleo | 05:55 | |
| StevenK | Hmmm. http://paste.openstack.org/show/61330/ | 05:58 |
| *** CaptTofu has quit IRC | 05:59 | |
| lifeless | StevenK: you might be thrashing | 06:00 |
| lifeless | StevenK: or, your undercloud might not be healthy | 06:00 |
| StevenK | 3539 steven 23 3 4281m 1.6g 34m S 38.4 20.8 1370:54 firefox | 06:01 |
| StevenK | 18992 libvirt- 20 0 6599m 1.5g 2564 S 0.0 19.8 6:46.18 qemu-system-x86 | 06:02 |
| StevenK | 15847 libvirt- 20 0 6614m 1.4g 2580 S 0.3 18.0 9:44.00 qemu-system-x86 | 06:02 |
| StevenK | Top three memory hogs | 06:02 |
| lifeless | vm's :) | 06:08 |
| *** nosnos_ has quit IRC | 06:10 | |
| *** nosnos has joined #tripleo | 06:10 | |
| *** coolsvap_away has joined #tripleo | 06:15 | |
| *** coolsvap has quit IRC | 06:16 | |
| *** coolsvap_away is now known as coolsvap | 06:20 | |
| *** rpodolyaka1 has joined #tripleo | 06:24 | |
| *** mikal has quit IRC | 06:35 | |
| *** mikal has joined #tripleo | 06:35 | |
| lifeless | rpodolyaka1: hey | 06:49 |
| lifeless | rpodolyaka1: I rebased and fixed conflicts with the use-ephemeral stack | 06:49 |
| lifeless | rpodolyaka1: but https://review.openstack.org/#/c/54308/ and the one above it seem to have had a semantic fault sneak in; and https://review.openstack.org/#/c/60285/25 had a tempest failure | 06:50 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Use the JSON description to probe the seed VM. https://review.openstack.org/66248 | 06:55 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Use the test env JSON to detect remote VM hosts. https://review.openstack.org/66249 | 06:55 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Cleanup use of SEED_IP. https://review.openstack.org/66256 | 06:55 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Make it possible to customise overcloud names. https://review.openstack.org/66467 | 06:55 |
| lifeless | slagle: SpamapS: ^ slagles comments addressed | 06:56 |
| StevenK | lifeless: Can I kill those two VMs, or otherwise clean up, so I can have some RAM back? | 07:00 |
| *** panda__ has quit IRC | 07:10 | |
| *** panda__ has joined #tripleo | 07:13 | |
| *** mrunge has joined #tripleo | 07:15 | |
| *** rlandy has joined #tripleo | 07:15 | |
| rpodolyaka1 | lifeless: morning! | 07:28 |
| rpodolyaka1 | lifeless: cool, I'm going to work on this today then | 07:29 |
| rpodolyaka1 | lifeless: got distracted by virtualenv 1.11 and libsqlite 3.7.16/3.8.2 nova unit-tests failures yesterday :( | 07:30 |
| *** jprovazn has joined #tripleo | 07:31 | |
| lifeless | StevenK: you can suspend to disk sanely; if you power off you have to power on from the seed on up | 07:36 |
| lifeless | because each layer is booted by the layer below | 07:37 |
| GheRivero | morning all | 07:42 |
| rpodolyaka1 | o/ | 07:42 |
| *** boris-42 has quit IRC | 07:43 | |
| *** ifarkas has joined #tripleo | 07:44 | |
| StevenK | lifeless: This is a desktop machine. Suspending doesn't happen to it. | 07:44 |
| lifeless | StevenK: not the machine, the vms | 07:44 |
| lifeless | StevenK: with virt-manager | 07:44 |
| lifeless | StevenK: freezes ram to a file on disk | 07:45 |
| StevenK | Oooh | 07:45 |
| lifeless | StevenK: right mouse, shutdown -> save | 07:45 |
| lifeless | if you do that to the seed you free up ram until the undercloud decides it needs to renew it's DHCP lease :) | 07:45 |
| StevenK | baremetal_0 and seed are Paused | 07:45 |
| lifeless | paused saves CPU, lets ram swap to disk, doesn't free it | 07:46 |
| *** rpodolyaka1 has quit IRC | 07:47 | |
| StevenK | libvirtError: operation failed: domain save job: unexpectedly failed | 07:49 |
| StevenK | Handy. | 07:49 |
| *** e0ne has joined #tripleo | 07:51 | |
| StevenK | Oh | 07:53 |
| StevenK | I know what it is | 07:53 |
| *** CaptTofu has joined #tripleo | 07:56 | |
| *** CaptTofu has quit IRC | 08:01 | |
| *** rdopieralski has joined #tripleo | 08:02 | |
| lifeless | mmm | 08:07 |
| lifeless | Connecting to cloud-images.ubuntu.com (cloud-images.ubuntu.com)|91.189.88.141|:80... connected. | 08:07 |
| lifeless | 0% [ ] 2,157,201 12.3KB/s eta 5h 36m | 08:07 |
| *** jcoufal has joined #tripleo | 08:08 | |
| *** rushiagr is now known as rushiagr_away | 08:09 | |
| lifeless | our network setup may need tuning :) | 08:09 |
| lifeless | Ng: hows it going? | 08:15 |
| lifeless | 2. g3-7.las-agg7s2-2.switchnap.com 36.1% 79389 4.1 0.3 0.2 671.6 26.1 | 08:15 |
| lifeless | 36% loss on 80K packets is a tad worrying | 08:15 |
| lifeless | zomg | 08:19 |
| lifeless | faster to wget here, then rsync it back up tan to download live on the net. | 08:19 |
| openstackgerrit | Sascha Peilicke proposed a change to openstack/python-tuskarclient: Sync with global requirements https://review.openstack.org/67051 | 08:23 |
| openstackgerrit | Sascha Peilicke proposed a change to openstack/tripleo-image-elements: Sync with global requirements https://review.openstack.org/67060 | 08:25 |
| openstackgerrit | Sascha Peilicke proposed a change to openstack/tuskar: Sync with global requirements https://review.openstack.org/67061 | 08:26 |
| openstackgerrit | Sascha Peilicke proposed a change to openstack/tuskar-ui: Sync with global requirements https://review.openstack.org/67062 | 08:26 |
| lifeless | erm | 08:27 |
| lifeless | there's automated stuff for that | 08:27 |
| *** jtomasek has joined #tripleo | 08:30 | |
| *** rushiagr_away is now known as rushiagr | 08:32 | |
| *** kpavel has joined #tripleo | 08:34 | |
| StevenK | lifeless: Looks like they've just done every single project | 08:42 |
| openstackgerrit | Jan Provaznik proposed a change to openstack/tripleo-image-elements: Add haproxy element https://review.openstack.org/61374 | 08:42 |
| openstackgerrit | Jun Jie Nan proposed a change to openstack/diskimage-builder: Move Babel and argparse from test-requirements.txt https://review.openstack.org/67070 | 08:45 |
| *** pblaho has joined #tripleo | 08:46 | |
| *** vkozhukalov has joined #tripleo | 08:48 | |
| *** jistr has joined #tripleo | 08:53 | |
| lsmola_ | NobodyCam: hello, are you around ? :-) | 08:57 |
| lsmola_ | devananda: hello, are you around? | 08:59 |
| openstackgerrit | A change was merged to openstack/tuskar-ui: Restructured overcloud views https://review.openstack.org/66933 | 09:00 |
| openstackgerrit | Jun Jie Nan proposed a change to openstack/diskimage-builder: Move Babel and argparse from test-requirements.txt https://review.openstack.org/67070 | 09:02 |
| *** markmc has joined #tripleo | 09:16 | |
| *** athomas has joined #tripleo | 09:22 | |
| *** rushiagr is now known as rushiagr_away | 09:30 | |
| marios | lsmola_: https://plus.google.com/hangouts/_/76cpjrdbh898sgq8bsiuj5rbd0?hl=en-GB | 09:33 |
| *** derekh has joined #tripleo | 09:37 | |
| *** jcoufal_ has joined #tripleo | 09:38 | |
| *** pblaho has quit IRC | 09:39 | |
| *** jcoufal has quit IRC | 09:41 | |
| *** jcoufal_ is now known as jcoufal | 09:43 | |
| *** rushiagr_away is now known as rushiagr | 09:49 | |
| *** nosnos has quit IRC | 09:51 | |
| lifeless | jcoufal: hey; now we're all back from leave we should start syncing up again | 09:53 |
| jcoufal | lifeless: hey there, I am all ready | 09:54 |
| jcoufal | lifeless: today's meeting is on | 09:54 |
| *** pblaho has joined #tripleo | 09:55 | |
| derekh | lifeless: Good morning, anything to push up or will I continue trying to get a manual end to end test working? | 09:56 |
| lifeless | jcoufal: ok cool; see you in 10hours or so :) | 09:56 |
| lifeless | derekh: I have a node I'm prepping as a slave | 09:56 |
| lifeless | derekh: I couldn't ssh into yours | 09:56 |
| derekh | lifeless: neither could I, gonna zap them now | 09:56 |
| lifeless | derekh: I've uploaded a precise image for infra | 09:57 |
| *** CaptTofu has joined #tripleo | 09:57 | |
| derekh | lifeless: ok, sounds good | 09:58 |
| lifeless | derekh: let me add your key | 09:58 |
| lifeless | derekh: 138.35.77.20 | 09:58 |
| lifeless | derekh: you can see the cache-git-repos command is running is ps | 09:59 |
| lifeless | derekh: networking is awfully slow :( | 09:59 |
| lifeless | derekh: when thats finished, ./modules/openstack_project/files/nodepool/scripts/prepare_node.sh will be completed | 09:59 |
| lifeless | derekh: (though I didn't install puppet... ) | 09:59 |
| lifeless | derekh: the next step after that is to run | 10:00 |
| lifeless | ./modules/openstack_project/files/nodepool/scripts/prepare_tripleo.sh (either by hand or just emulate it) | 10:00 |
| *** CaptTofu has quit IRC | 10:01 | |
| *** martyntaylor has joined #tripleo | 10:02 | |
| derekh | lifeless: ok, makes sense | 10:03 |
| *** boris-42 has joined #tripleo | 10:03 | |
| *** jrist has quit IRC | 10:03 | |
| lifeless | derekh: adn then after that, it should be set up as a jenkins slave, so running the jjb build for it should be the next step | 10:03 |
| lifeless | which should Just Work, of course. | 10:04 |
| derekh | lifeless: of course | 10:04 |
| lifeless | derekh: I found a bunch of glitches in the ci-overcloud, like swift being broken | 10:04 |
| lifeless | derekh: I figure it will be good enough to continue with | 10:05 |
| lifeless | derekh: but I'll try and get them all filed as bugs tomorrow | 10:05 |
| derekh | lifeless: ci-overcloud specific glitches ? I can take a look at them once we're done here | 10:05 |
| derekh | lifeless: ok | 10:05 |
| lifeless | derekh: lets get CI live :) | 10:05 |
| *** mestery_ has joined #tripleo | 10:05 | |
| * derekh nodes | 10:06 | |
| lifeless | StevenK: btw https://etherpad.openstack.org/p/tripleo-test-cluster - at the bottom is the current set of todos for wrapping up the current iteration; if you're looking for things to poke at, you could do worse than to dive into that, anyoldwhere | 10:06 |
| lifeless | ok, must sleep | 10:06 |
| lifeless | ciao | 10:07 |
| derekh | lifeless: gnight, will continue it from here | 10:07 |
| *** mestery has quit IRC | 10:08 | |
| *** max_lobur_afk is now known as max_lobur | 10:11 | |
| *** jeblair has quit IRC | 10:17 | |
| *** bauzas has joined #tripleo | 10:18 | |
| *** jeblair has joined #tripleo | 10:19 | |
| *** michchap_ has joined #tripleo | 10:26 | |
| *** michchap has quit IRC | 10:26 | |
| *** rushiagr is now known as rushiagr_away | 10:30 | |
| *** jprovazn has quit IRC | 10:33 | |
| *** rushiagr_away is now known as rushiagr | 10:33 | |
| openstackgerrit | Derek Higgins proposed a change to openstack/tripleo-incubator: Add Tripleo CI user. https://review.openstack.org/67104 | 10:43 |
| *** lucasagomes has joined #tripleo | 10:51 | |
| *** lucasagomes has quit IRC | 10:52 | |
| *** lucasagomes has joined #tripleo | 10:52 | |
| *** blamar has quit IRC | 10:58 | |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Get IP for Test Host from neutron https://review.openstack.org/66942 | 10:59 |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Get seed IPs from tripleo-bm-test https://review.openstack.org/66943 | 10:59 |
| openstackgerrit | Jiri Tomasek proposed a change to openstack/tuskar-ui: Remove Roles tab from Deployment https://review.openstack.org/67111 | 11:01 |
| *** xuhanp has quit IRC | 11:03 | |
| *** jprovazn has joined #tripleo | 11:16 | |
| *** e0ne has quit IRC | 11:22 | |
| *** e0ne has joined #tripleo | 11:22 | |
| *** e0ne_ has joined #tripleo | 11:29 | |
| *** e0ne has quit IRC | 11:29 | |
| *** e0ne_ has quit IRC | 11:35 | |
| *** rushiagr has quit IRC | 11:36 | |
| *** athomas has quit IRC | 11:37 | |
| *** weshay has joined #tripleo | 11:41 | |
| *** athomas has joined #tripleo | 11:45 | |
| *** rushiagr has joined #tripleo | 11:55 | |
| openstackgerrit | A change was merged to openstack/diskimage-builder: dib-run-parts should dereference symlinks https://review.openstack.org/66923 | 11:56 |
| openstackgerrit | A change was merged to openstack/diskimage-builder: Symlink correct element install type https://review.openstack.org/66724 | 11:56 |
| *** CaptTofu has joined #tripleo | 11:58 | |
| lsmola_ | lucasagomes: ping | 12:00 |
| *** e0ne has joined #tripleo | 12:00 | |
| *** CaptTofu has quit IRC | 12:03 | |
| *** jprovazn has quit IRC | 12:04 | |
| *** jprovazn has joined #tripleo | 12:04 | |
| *** jprovazn is now known as jprovazn_ | 12:04 | |
| *** sirushti has quit IRC | 12:05 | |
| *** sirushti has joined #tripleo | 12:05 | |
| *** weshay has quit IRC | 12:06 | |
| lucasagomes | lsmola_, pong | 12:06 |
| lsmola_ | lucasagomes: hello | 12:07 |
| lsmola_ | lucasagomes: I am trying the https://wiki.openstack.org/wiki/Ironic | 12:07 |
| lsmola_ | lucasagomes: Using Disk Image Builder section | 12:07 |
| lsmola_ | lucasagomes: now I got to point where I deploy overcloud | 12:07 |
| lsmola_ | lucasagomes: but nova scheduler filter doesn not found any valid host | 12:08 |
| *** coolsvap has quit IRC | 12:08 | |
| lsmola_ | lucasagomes: my ironic has 2 nodes that should be fine for that | 12:08 |
| lsmola_ | lucasagomes: do you know how could I debug it or persuade scheduler to pick those nodes? | 12:09 |
| *** e0ne_ has joined #tripleo | 12:09 | |
| lsmola_ | lucasagomes: it worked for me with nova baremetal setup | 12:09 |
| lucasagomes | lsmola_, so this is something that is being tested/fixed/polished right now | 12:09 |
| lucasagomes | lsmola_, ur using the ironic driver for nova? | 12:09 |
| lsmola_ | lucasagomes: yes | 12:10 |
| lsmola_ | lucasagomes: I have checked and it is correctly in the nova.conf | 12:10 |
| lucasagomes | right, cause the dpeloyment is not working yet | 12:10 |
| openstackgerrit | Dirk Mueller proposed a change to openstack/python-tuskarclient: Use implicit dependencies of Hacking for pep8, pyflakes, flake8 https://review.openstack.org/67128 | 12:10 |
| lucasagomes | this week I could get ironic to deploy a machine | 12:10 |
| lucasagomes | using devstack | 12:10 |
| lsmola_ | lucasagomes: oh, ok | 12:10 |
| lucasagomes | haven't tested the driver yet | 12:10 |
| lucasagomes | but lemme point u to some patches | 12:11 |
| lucasagomes | u might need to apply to avoid some problems with the deployment | 12:11 |
| lsmola_ | lucasagomes: ok I will gladly help you testing that | 12:11 |
| lucasagomes | lsmola_, ironic: https://review.openstack.org/#/c/66389/ https://review.openstack.org/#/c/66390/ https://review.openstack.org/#/c/66400/ | 12:11 |
| lucasagomes | lsmola_, great! | 12:11 |
| lucasagomes | lsmola_, the deploy-ironic ramdisk is currently broken | 12:11 |
| lucasagomes | so you have to patch diskimage-builder to create a ramdisk to do the ironic deployment as well | 12:12 |
| * lucasagomes lemme find the review | 12:12 | |
| *** e0ne has quit IRC | 12:12 | |
| lucasagomes | lsmola_, https://review.openstack.org/#/c/66677/ | 12:12 |
| lsmola_ | lucasagomes: ok | 12:12 |
| *** jprovazn_ is now known as jprovazn | 12:12 | |
| *** weshay has joined #tripleo | 12:13 | |
| lsmola_ | lucasagomes: ok, I am going to read it through and apply the patches | 12:13 |
| lucasagomes | lsmola_, right... I haven't tried the deployment with tripleO yet (will do once I get ironic polished) | 12:14 |
| lucasagomes | but there's some people trying it already | 12:14 |
| lsmola_ | lucasagomes: can you point me to them? | 12:14 |
| lucasagomes | lsmola_, NobodyCam is trying it out and he's also the co-author of the ironic driver for nova | 12:14 |
| lucasagomes | so he can def give you more info about it | 12:14 |
| lsmola_ | lucasagomes: great | 12:15 |
| lsmola_ | lucasagomes: I will catch him when he is awake :-) | 12:15 |
| lucasagomes | right | 12:15 |
| lsmola_ | lucasagomes: thank you very much | 12:16 |
| lucasagomes | lsmola_, np | 12:16 |
| openstackgerrit | Dirk Mueller proposed a change to openstack/tuskar: Remove dependencies on pep8, pyflakes and flake8 https://review.openstack.org/67132 | 12:17 |
| *** akuznetsov has quit IRC | 12:29 | |
| *** derekh has quit IRC | 12:29 | |
| *** akuznetsov has joined #tripleo | 12:29 | |
| openstackgerrit | Tom Hancock proposed a change to openstack/tripleo-incubator: devtest check RESET_TESTENV environment variable https://review.openstack.org/67139 | 12:30 |
| *** morazi has joined #tripleo | 12:32 | |
| *** rushiagr is now known as rushiagr_away | 12:32 | |
| *** derekh has joined #tripleo | 12:45 | |
| *** rushiagr_away is now known as rushiagr | 12:48 | |
| *** al has joined #tripleo | 13:01 | |
| Ng | morning | 13:13 |
| *** CaptTofu has joined #tripleo | 13:23 | |
| openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Deployment design form https://review.openstack.org/67155 | 13:28 |
| *** jdob has joined #tripleo | 13:30 | |
| *** panda_ has joined #tripleo | 13:42 | |
| *** panda__ has quit IRC | 13:45 | |
| *** coolsvap has joined #tripleo | 13:45 | |
| *** lucasagomes has quit IRC | 13:56 | |
| *** lucasagomes has joined #tripleo | 14:00 | |
| *** akuznetsov has quit IRC | 14:01 | |
| *** mrunge has quit IRC | 14:03 | |
| *** rushiagr has quit IRC | 14:04 | |
| *** panda__ has joined #tripleo | 14:06 | |
| openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Deployment design form https://review.openstack.org/67155 | 14:08 |
| *** panda_ has quit IRC | 14:09 | |
| openstackgerrit | Ryan Brady proposed a change to openstack/tripleo-image-elements: Adds iptables element https://review.openstack.org/67163 | 14:10 |
| *** akuznetsov has joined #tripleo | 14:12 | |
| openstackgerrit | A change was merged to openstack/tuskar-ui: Sync with global requirements https://review.openstack.org/67062 | 14:14 |
| *** jayg|g0n3 is now known as jayg | 14:16 | |
| *** lblanchard has joined #tripleo | 14:16 | |
| *** julim has joined #tripleo | 14:22 | |
| *** jayg is now known as jayg|g0n3 | 14:24 | |
| *** jayg|g0n3 is now known as jayg | 14:24 | |
| *** lucasagomes has quit IRC | 14:24 | |
| openstackgerrit | Lucas Alvares Gomes proposed a change to openstack/diskimage-builder: Fix the curl command in the ironic-deploy element https://review.openstack.org/66677 | 14:27 |
| *** lucasagomes has joined #tripleo | 14:28 | |
| *** matty_dubs|gone is now known as matty_dubs | 14:29 | |
| openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Deployment design form https://review.openstack.org/67155 | 14:31 |
| *** blamar has joined #tripleo | 14:35 | |
| *** akrivoka has joined #tripleo | 14:38 | |
| openstackgerrit | Dougal Matthews proposed a change to openstack/python-tuskarclient: Corrected a the project name in a comment. https://review.openstack.org/67174 | 14:39 |
| *** kpavel has quit IRC | 14:41 | |
| openstackgerrit | Derek Higgins proposed a change to openstack/tripleo-image-elements: Remove --system-site-packages from clients virtualenv https://review.openstack.org/67178 | 14:43 |
| rpodolyaka | derekh: hmm, interesting, I saw ^^ a similar issue yesterday in nova | 14:46 |
| rpodolyaka | derekh: so basically with virtualenv 1.11 venvs created with --system-site-packages work incorrectly, e.g. they use pip from system packages | 14:46 |
| rpodolyaka | derekh: virtualenv versions prior to 1.11 work fine, though I totally support removing of --system-site-packages :) | 14:47 |
| derekh | rpodolyaka: ahh the fun of virtual envs... | 14:48 |
| *** rushiagr has joined #tripleo | 14:50 | |
| rbrady | jprovazn: thanks | 14:52 |
| *** CaptTofu has quit IRC | 14:53 | |
| *** AaronGr_Zzz has quit IRC | 14:54 | |
| *** bnemec has joined #tripleo | 14:55 | |
| *** bnemec has quit IRC | 14:55 | |
| *** bnemec has joined #tripleo | 14:56 | |
| rpodolyaka | derekh: https://github.com/pypa/virtualenv/issues/550 | 14:57 |
| derekh | rpodolyaka: thanks | 14:59 |
| *** boris-42 has quit IRC | 15:00 | |
| *** ftcjeff has joined #tripleo | 15:02 | |
| *** oubiwann has joined #tripleo | 15:03 | |
| *** AaronGr_Zzz has joined #tripleo | 15:03 | |
| *** rlandy is now known as rlandy|afk | 15:04 | |
| openstackgerrit | Ryan Brady proposed a change to openstack/tripleo-image-elements: Adds iptables element https://review.openstack.org/67163 | 15:05 |
| jprovazn | rbrady, np | 15:06 |
| *** rwsu has joined #tripleo | 15:07 | |
| *** mestery_ is now known as mestery | 15:14 | |
| *** CaptTofu has joined #tripleo | 15:15 | |
| *** e0ne_ has quit IRC | 15:16 | |
| *** e0ne has joined #tripleo | 15:16 | |
| *** marun has joined #tripleo | 15:21 | |
| NobodyCam | lsmola_: sorry missed the ping was 1:00 am here | 15:24 |
| lsmola_ | NobodyCam: oh ;-D | 15:25 |
| NobodyCam | :) | 15:26 |
| lsmola_ | NobodyCam: so I've been continuing with https://wiki.openstack.org/wiki/Ironic | 15:26 |
| lsmola_ | NobodyCam: the devtest way | 15:26 |
| NobodyCam | awesome | 15:27 |
| lsmola_ | NobodyCam: I got to point when Nova Scheduler filter doesn't find my Ironic nodes | 15:27 |
| lsmola_ | NobodyCam: lucasagomes already sent me some patches I should try | 15:27 |
| NobodyCam | ok | 15:28 |
| *** rushiagr2 has joined #tripleo | 15:28 | |
| NobodyCam | :) | 15:28 |
| lsmola_ | NobodyCam: though ifarkas is telling me that the IronicDriver is broken now, so it shouldn't work | 15:28 |
| lsmola_ | NobodyCam: lucasagomes is testing the devstack way, so he has pointed me to you | 15:28 |
| NobodyCam | I pushed up a new version yesterday that should work | 15:29 |
| lsmola_ | NobodyCam: awesome | 15:29 |
| NobodyCam | rev 9 of the driver | 15:29 |
| lsmola_ | NobodyCam: so now I am applying this to make it work https://etherpad.openstack.org/p/ironic_deployment_story | 15:29 |
| lsmola_ | NobodyCam: do you have a link? | 15:30 |
| *** lucasagomes is now known as lucas-hungry | 15:30 | |
| *** rushiagr has quit IRC | 15:30 | |
| NobodyCam | https://review.openstack.org/#/c/51328/ | 15:30 |
| NobodyCam | for the nova driver? | 15:30 |
| ifarkas | lsmola_, I didn't tell you it's broken as it's not even merged. It's still in WIP on gerrit | 15:31 |
| NobodyCam | ya | 15:31 |
| lsmola_ | ifarkas: wip is good :-) | 15:31 |
| NobodyCam | def not merged | 15:31 |
| lsmola_ | NobodyCam: right | 15:31 |
| NobodyCam | ifarkas: it was broken yesterday | 15:32 |
| lsmola_ | NobodyCam: any other patches you know about i should apply? | 15:32 |
| ifarkas | NobodyCam, oh, I didn't know about it | 15:33 |
| *** rdopieralski has quit IRC | 15:33 | |
| lsmola_ | NobodyCam: I will have a beautiful patched devtest :-) | 15:34 |
| NobodyCam | lsmola_: do you have this patch? https://review.openstack.org/#/c/66677/ | 15:35 |
| lsmola_ | NobodyCam: yes | 15:36 |
| lsmola_ | NobodyCam: already applied, though I see there is a new patches, so I am going to rebuild it :-) | 15:37 |
| lsmola_ | NobodyCam: patchset | 15:37 |
| NobodyCam | brb .. getting coffee and a quick wlkies | 15:38 |
| *** jprovazn is now known as jprovazn_afk | 15:39 | |
| *** rushiagr2 is now known as rushiagr_away | 15:40 | |
| *** dprince has joined #tripleo | 15:41 | |
| *** e0ne_ has joined #tripleo | 15:41 | |
| *** vkozhukalov has quit IRC | 15:42 | |
| * NobodyCam is back | 15:43 | |
| *** markmc has quit IRC | 15:45 | |
| *** e0ne has quit IRC | 15:45 | |
| *** e0ne_ has quit IRC | 15:52 | |
| *** marun has quit IRC | 15:55 | |
| *** marun has joined #tripleo | 15:58 | |
| *** boris-42 has joined #tripleo | 15:59 | |
| *** dprince has quit IRC | 16:03 | |
| *** dprince has joined #tripleo | 16:04 | |
| *** ftcjeff has quit IRC | 16:07 | |
| *** ftcjeff has joined #tripleo | 16:07 | |
| *** lynxman has quit IRC | 16:12 | |
| *** lucas-hungry is now known as lucasagomes | 16:15 | |
| openstackgerrit | A change was merged to openstack/tuskar-ui: Remove Roles tab from Deployment https://review.openstack.org/67111 | 16:18 |
| openstackgerrit | A change was merged to openstack/python-tuskarclient: Sync with global requirements https://review.openstack.org/67051 | 16:19 |
| *** AaronGr_Zzz is now known as AaronGr | 16:19 | |
| openstackgerrit | A change was merged to openstack/python-tuskarclient: Adds default logging for tuskarclient.common.http https://review.openstack.org/66073 | 16:21 |
| openstackgerrit | Aaron Weitekamp proposed a change to openstack/diskimage-builder: Updated rhel element to support rhn https://review.openstack.org/67212 | 16:21 |
| *** rushiagr_away is now known as rushiagr2 | 16:24 | |
| *** lynxman has joined #tripleo | 16:26 | |
| dprince | derekh: https://review.openstack.org/#/c/67178/1 fixes the python-six issue then? | 16:28 |
| derekh | dprince: yup | 16:28 |
| derekh | dprince: total size of the venvs for the clients goes from 171M to 193M | 16:29 |
| dprince | derekh: cool. thanks for that, on my list of things to tackle today too | 16:29 |
| derekh | dprince: so I think its ok | 16:29 |
| dprince | derekh: yeah. I think we might still want to go back and revisit this for optimization but for now this is fine | 16:30 |
| * derekh nodes | 16:30 | |
| *** akrivoka has quit IRC | 16:31 | |
| SpamapS | one easier optimization is to remove the git trees | 16:33 |
| *** markmc has joined #tripleo | 16:33 | |
| *** lucasagomes is now known as lucas-afk | 16:33 | |
| *** pblaho has quit IRC | 16:34 | |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: Use the JSON description to probe the seed VM. https://review.openstack.org/66248 | 16:35 |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: Use the test env JSON to detect remote VM hosts. https://review.openstack.org/66249 | 16:35 |
| *** jprovazn_afk is now known as jprovazn | 16:36 | |
| openstackgerrit | A change was merged to openstack/python-tuskarclient: Use HTTPClient from common apiclient code https://review.openstack.org/63749 | 16:38 |
| *** rushiagr2 is now known as rushiagr | 16:42 | |
| *** lblanchard1 has joined #tripleo | 16:42 | |
| openstackgerrit | A change was merged to openstack/tuskar: Remove dependencies on pep8, pyflakes and flake8 https://review.openstack.org/67132 | 16:42 |
| *** lblanchard has quit IRC | 16:43 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Sync with global requirements https://review.openstack.org/67060 | 16:43 |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Change to tripleo-ci directory https://review.openstack.org/67221 | 16:43 |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Change path to tripleo-incubator https://review.openstack.org/67222 | 16:43 |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: devtest check RESET_TESTENV environment variable https://review.openstack.org/67139 | 16:45 |
| *** rlandy|afk is now known as rlandy | 16:45 | |
| openstackgerrit | Aaron Weitekamp proposed a change to openstack/diskimage-builder: Updated rhel element to support rhn https://review.openstack.org/67212 | 16:54 |
| derekh | SpamapS: sounds like a good idea to me, only good reason to have them there is to aid debuging | 16:56 |
| SpamapS | derekh: meh ;) | 16:58 |
| SpamapS | derekh: they're on github too :) | 16:59 |
| derekh | this is true | 16:59 |
| SpamapS | $ echo '{"subnet_id": "8eef6e2a-ec28-4f21-a937-62b23b500b72", "ip_address": "192.0.2.8"}' | jq .ip_address | 17:01 |
| SpamapS | "192.0.2.8" | 17:01 |
| SpamapS | Ok, I like jq | 17:01 |
| SpamapS | new favorite toy :) | 17:01 |
| * SpamapS goes afk for a bit | 17:01 | |
| *** jcoufal has quit IRC | 17:07 | |
| *** spzala has joined #tripleo | 17:10 | |
| *** max_lobur is now known as max_lobur_afk | 17:16 | |
| *** bauzas has quit IRC | 17:25 | |
| openstackgerrit | Derek Higgins proposed a change to openstack/tripleo-incubator: Set default for USE_CACHE https://review.openstack.org/67238 | 17:28 |
| *** jrist_ has joined #tripleo | 17:34 | |
| *** sdake has quit IRC | 17:35 | |
| lifeless | morning | 17:37 |
| lifeless | derekh: hi, how did it go? | 17:38 |
| derekh | slow | 17:38 |
| derekh | lifeless: the git cache took about 4 hours, then running jjb its started git clone all the repos again | 17:38 |
| derekh | lifeless: so I killed it did some poking at the source and figures out where to put a cache so it would take the local copy | 17:39 |
| lifeless | wheee | 17:39 |
| derekh | lifeless: then with a few tweaks it started running, everythin went through the gearmen broker fine, when it started running install-dependencies took nearly an hour | 17:40 |
| lifeless | derekh: ]o/ | 17:40 |
| derekh | lifeless: so current status is that it died because of this https://review.openstack.org/#/c/67238/ | 17:41 |
| derekh | lifeless: so in summary made progress but network really slowed it down | 17:41 |
| lifeless | yeah | 17:42 |
| lifeless | dunno wtf is up with that | 17:42 |
| lifeless | Ng: ping? | 17:42 |
| openstackgerrit | Dougal Matthews proposed a change to openstack/python-tuskarclient: Corrected the project name in a comment. https://review.openstack.org/67174 | 17:43 |
| lifeless | derekh: so its your EOD more or less; what is outstanding that I can grab on without conflicting w/you | 17:43 |
| *** derekh has quit IRC | 17:46 | |
| lifeless | hah nuts | 17:49 |
| *** dprince has quit IRC | 17:51 | |
| *** jistr has quit IRC | 17:51 | |
| openstackgerrit | Dougal Matthews proposed a change to openstack/python-tuskarclient: Corrected the project name in a comment https://review.openstack.org/67174 | 17:52 |
| *** ohadlevy has quit IRC | 17:54 | |
| *** funzo has quit IRC | 17:54 | |
| *** jrist_ has quit IRC | 17:55 | |
| *** d0ugal has quit IRC | 17:55 | |
| *** athomas has quit IRC | 17:56 | |
| *** funzo has joined #tripleo | 17:58 | |
| *** derekh has joined #tripleo | 17:59 | |
| *** lucas-afk is now known as lucasagomes | 18:00 | |
| lifeless | SpamapS: https://review.openstack.org/#/c/67238/ | 18:01 |
| *** ohadlevy has joined #tripleo | 18:01 | |
| lifeless | slagle: could you review https://review.openstack.org/#/c/58596/7 ? | 18:01 |
| *** ohadlevy is now known as Guest6919 | 18:01 | |
| *** d0ugal has joined #tripleo | 18:02 | |
| *** d0ugal has quit IRC | 18:02 | |
| *** d0ugal has joined #tripleo | 18:02 | |
| *** d0ugal has quit IRC | 18:02 | |
| derekh | lifeless: connection dropped, I also manually added this user to the ci-overcloud https://review.openstack.org/#/c/67104/ | 18:03 |
| lifeless | derekh: no worries | 18:03 |
| lifeless | derekh: maybe you can review the heat template :) | 18:03 |
| derekh | lifeless: and stuck him into the infra tenant, rc file with his creds in on ci-overcloudnotcompute /root | 18:03 |
| derekh | lifeless: yup, I gotta go and catch a train in a few minutes, will review it in a bit if it already hasn't been | 18:05 |
| *** d0ugal has joined #tripleo | 18:05 | |
| *** d0ugal has quit IRC | 18:05 | |
| *** d0ugal has joined #tripleo | 18:05 | |
| *** dprince has joined #tripleo | 18:06 | |
| slagle | lifeless: looking | 18:07 |
| *** derekh has quit IRC | 18:08 | |
| *** vipul is now known as vipul-away | 18:09 | |
| *** vipul-away is now known as vipul | 18:09 | |
| *** d0ugal has joined #tripleo | 18:09 | |
| *** d0ugal has joined #tripleo | 18:09 | |
| *** athomas has joined #tripleo | 18:11 | |
| *** vkozhukalov has joined #tripleo | 18:14 | |
| *** d0ugal has joined #tripleo | 18:14 | |
| *** d0ugal has joined #tripleo | 18:14 | |
| *** d0ugal has quit IRC | 18:14 | |
| *** jrist_ has joined #tripleo | 18:15 | |
| *** athomas has quit IRC | 18:16 | |
| *** d0ugal has joined #tripleo | 18:18 | |
| *** d0ugal has joined #tripleo | 18:18 | |
| *** d0ugal has quit IRC | 18:19 | |
| *** vipul is now known as vipul-away | 18:25 | |
| *** d0ugal has joined #tripleo | 18:25 | |
| *** d0ugal has joined #tripleo | 18:25 | |
| *** CaptTofu has quit IRC | 18:26 | |
| *** martyntaylor has left #tripleo | 18:27 | |
| *** jamezpolley has quit IRC | 18:27 | |
| *** Guest6919 has quit IRC | 18:27 | |
| *** oubiwann has quit IRC | 18:27 | |
| *** markmc has quit IRC | 18:28 | |
| *** d0ugal has joined #tripleo | 18:29 | |
| *** e0ne_ has joined #tripleo | 18:29 | |
| *** d0ugal has quit IRC | 18:30 | |
| *** jamezpolley has joined #tripleo | 18:33 | |
| *** e0ne_ has quit IRC | 18:34 | |
| *** d0ugal has joined #tripleo | 18:36 | |
| *** d0ugal has quit IRC | 18:36 | |
| *** d0ugal has joined #tripleo | 18:36 | |
| *** d0ugal has joined #tripleo | 18:37 | |
| *** d0ugal has quit IRC | 18:37 | |
| *** d0ugal has joined #tripleo | 18:37 | |
| *** oubiwann has joined #tripleo | 18:38 | |
| *** jcoufal has joined #tripleo | 18:40 | |
| *** e0ne has joined #tripleo | 18:41 | |
| *** rlandy has quit IRC | 18:41 | |
| *** markmc has joined #tripleo | 18:42 | |
| *** CaptTofu has joined #tripleo | 18:42 | |
| *** ohadlevy_ has joined #tripleo | 18:42 | |
| *** rushiagr has quit IRC | 18:50 | |
| *** vipul-away is now known as vipul | 18:50 | |
| *** openstackgerrit has quit IRC | 18:52 | |
| *** openstackgerrit has joined #tripleo | 18:52 | |
| *** rpodolyaka1 has joined #tripleo | 18:53 | |
| *** coolsvap has quit IRC | 18:54 | |
| *** jprovazn has quit IRC | 19:02 | |
| *** derekh has joined #tripleo | 19:03 | |
| *** vipul is now known as vipul-away | 19:05 | |
| *** jtomasek has quit IRC | 19:08 | |
| *** d0ugal has joined #tripleo | 19:14 | |
| *** d0ugal has quit IRC | 19:14 | |
| *** d0ugal has joined #tripleo | 19:14 | |
| *** d0ugal has quit IRC | 19:14 | |
| *** d0ugal has joined #tripleo | 19:15 | |
| *** d0ugal has quit IRC | 19:15 | |
| *** d0ugal has joined #tripleo | 19:15 | |
| *** d0ugal has quit IRC | 19:15 | |
| *** d0ugal has joined #tripleo | 19:15 | |
| *** d0ugal has joined #tripleo | 19:15 | |
| *** d0ugal has quit IRC | 19:15 | |
| *** d0ugal has joined #tripleo | 19:18 | |
| *** d0ugal has joined #tripleo | 19:18 | |
| *** sdake has joined #tripleo | 19:18 | |
| *** d0ugal has joined #tripleo | 19:21 | |
| *** d0ugal has joined #tripleo | 19:22 | |
| *** d0ugal has joined #tripleo | 19:22 | |
| *** d0ugal has joined #tripleo | 19:22 | |
| *** d0ugal has joined #tripleo | 19:22 | |
| *** d0ugal has joined #tripleo | 19:24 | |
| *** spzala has quit IRC | 19:32 | |
| *** derekh has quit IRC | 19:34 | |
| *** sdake has quit IRC | 19:38 | |
| *** sdake has joined #tripleo | 19:38 | |
| *** sdake has joined #tripleo | 19:38 | |
| Ng | lifeless: pong</lag> | 19:39 |
| lifeless | Ng: hey | 19:39 |
| lifeless | Ng: networking | 19:39 |
| lifeless | Ng: we're getting 12kbps from vms, which is atrocious; it's possible this is not related to the massive packet loss we're having | 19:39 |
| lifeless | Ng: but | 19:39 |
| lifeless | 2. g3-7.las-agg7s2-2.switchnap.com 40.0% 12031 0.3 0.3 0.2 671.6 26.1 | 19:40 |
| lifeless | losing 40% of packets ... | 19:40 |
| lifeless | Ng: so I'm wondering where that JIRA ticket is at, and how to escalate | 19:41 |
| Ng | lifeless: ugh. I've not been able to reproduce it from .4 yet, but .3 is *awful* | 19:41 |
| lifeless | Ng: right; is the ticket filed? Have we had a response - that sort of thing | 19:42 |
| Ng | lifeless: I have not yet filed a ticket, I'm trying to figure out if it's a local issue with our config first | 19:42 |
| *** marun has quit IRC | 19:43 | |
| *** marun has joined #tripleo | 19:43 | |
| lifeless | Ng: ah | 19:45 |
| lifeless | Ng: so thats super responsible of you :). However, to quote meg - escalate. | 19:45 |
| SpamapS | to be clear.. I don't see packet loss on outgoing pings.. right now | 19:46 |
| SpamapS | it definitely appears intermittent | 19:46 |
| lifeless | right | 19:46 |
| SpamapS | 2. g3-7.las-agg7s2-1.switchnap.com 0.0% 9 0.4 34.1 0.3 166.8 67.2 | 19:46 |
| Ng | lifeless: ok, I'll file a jira and ask them to check the switch while I investigate | 19:47 |
| SpamapS | I'm always suspicious of "it is that router" claims when routers tend to drop icmp echo requests first. :-P | 19:47 |
| SpamapS | but if both sides have packet loss starting/ending at a router... :) | 19:47 |
| lifeless | SpamapS: so I agree that dropping ICMP ping isn't necessarily bad | 19:48 |
| lifeless | SpamapS: but when you see 30% of such things dropped across 12 different routers | 19:48 |
| Ng | we don't have 12 different routers though | 19:49 |
| Ng | if your first router is untrusty, what mtr/traceroute tell you about ones beyond that one, is pretty much lies | 19:49 |
| SpamapS | lifeless: right we agree. I'm saying.. to actually determine if the problem is indeed routers.. we need to trace from both directions | 19:50 |
| SpamapS | Ng: it is additive, and that is useful :) | 19:50 |
| SpamapS | if there are 10 hops A<->B .. A->B will show bad traffic hops 3 -> 10 and B->A will show bad hops 7->10 .. ergo.. router at position 3/7 is the culprit. | 19:51 |
| SpamapS | I"m just suggesting without that, sometimes the routers are just telling your pings to F-off. | 19:51 |
| Ng | yes, that is a useful diagnostic | 19:51 |
| SpamapS | like level3 routers are notorious for that | 19:51 |
| SpamapS | "when my traffic hits L3 it blows up!" | 19:52 |
| NobodyCam | question: is the $JSONFILE called for in step #5 of http://docs.openstack.org/developer/tripleo-incubator/devtest_testenv.html really $TE_DATAFILE | 19:52 |
| *** vipul-away is now known as vipul | 19:54 | |
| *** e0ne has quit IRC | 19:54 | |
| *** e0ne has joined #tripleo | 19:54 | |
| SpamapS | anyway, I see g3-7.las-agg7s2-1.switchnap.com having problems going out to its next hop too | 19:55 |
| SpamapS | as in, it pings fine, but its next hop and all subsequent do not look fine | 19:55 |
| SpamapS | so.. my guess.. it is having problems | 19:55 |
| SpamapS | <-- genius | 19:55 |
| lifeless | yah | 19:56 |
| SpamapS | HOST: undercloud-notcompute-jws3a Loss% Snt Last Avg Best Wrst StDev 1.|-- ??? 100.0 100 0.0 0.0 0.0 0.0 0.0 2.|-- g3-7.las-agg7s2-1.switchn 50.0% 100 0.5 8.6 0.3 325.8 47.0 3.|-- te0-1-0-4.las-core7-1.swi 49.0% 100 1.7 2.3 0.3 4.2 1.2 | 19:57 |
| SpamapS | dohhh | 19:57 |
| NobodyCam | lifeless: was that a yah to my question? | 19:57 |
| lifeless | NobodyCam: it wasn't, but it is :) | 19:58 |
| NobodyCam | :) | 19:58 |
| NobodyCam | Ty | 19:58 |
| *** CaptTofu has quit IRC | 19:59 | |
| *** bauzas has joined #tripleo | 20:11 | |
| *** rlandy has joined #tripleo | 20:18 | |
| *** lucasagomes has quit IRC | 20:19 | |
| *** AaronGr is now known as aarongr_afk | 20:20 | |
| *** e0ne has quit IRC | 20:21 | |
| openstackgerrit | Jay Dobies proposed a change to openstack/tuskar: Tuskar domain model updates for wireframes https://review.openstack.org/66062 | 20:30 |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: Add Tripleo CI user. https://review.openstack.org/67104 | 20:36 |
| openstackgerrit | A change was merged to openstack-infra/tripleo-ci: Test environment worker template. https://review.openstack.org/58596 | 20:46 |
| *** rpodolyaka1 has quit IRC | 20:46 | |
| openstackgerrit | A change was merged to openstack-infra/tripleo-ci: Update toci_gate_test.sh to use the broker. https://review.openstack.org/61829 | 20:49 |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: Set default for USE_CACHE https://review.openstack.org/67238 | 20:52 |
| *** CaptTofu has joined #tripleo | 20:57 | |
| *** aarongr_afk is now known as AaronGr | 21:00 | |
| *** rlandy has quit IRC | 21:02 | |
| *** erwan_taf has quit IRC | 21:03 | |
| *** erwan_ta- has joined #tripleo | 21:03 | |
| *** vkozhukalov has quit IRC | 21:05 | |
| *** vipul is now known as vipul-away | 21:05 | |
| lifeless | gggaaarrr keypair-show still broken :( | 21:06 |
| *** vipul-away is now known as vipul | 21:09 | |
| SpamapS | bugs: can't deploy with 'em, can't code without 'em. | 21:09 |
| *** dprince has quit IRC | 21:09 | |
| *** marun_ has joined #tripleo | 21:13 | |
| *** marun has quit IRC | 21:14 | |
| *** marun_ is now known as marun | 21:14 | |
| *** jcoufal has quit IRC | 21:15 | |
| Ng | .3 and .4 in the rack are going to be even more unstable for a moment - Network folks are doing some testing/diagnosis | 21:17 |
| lifeless | ruh roh | 21:18 |
| SpamapS | doh | 21:18 |
| NobodyCam | Jinkies | 21:25 |
| Ng | Network guy noticed we're advertising the same MAC into two switch ports, for each of .3 and .4, so is testing what happens when we shut off one of the ports on each. So far the pings seem stable | 21:26 |
| Ng | but this is clearly not a solution | 21:26 |
| Ng | and raises the question of how we're ending up in this state | 21:26 |
| lifeless | are we physically wired into more than one switch port? | 21:30 |
| SpamapS | Ng: very weird since eth0 and eth1 are both "down" | 21:30 |
| *** julim has quit IRC | 21:30 | |
| lifeless | I'm like WAT | 21:30 |
| *** jcoufal has joined #tripleo | 21:31 | |
| NobodyCam | and no bonding going on? | 21:31 |
| Ng | lifeless: checking | 21:31 |
| lifeless | is it possible there are other machines in that rack with the same MACs ? | 21:31 |
| lifeless | s/possible/probable/ | 21:32 |
| *** e0ne has joined #tripleo | 21:32 | |
| SpamapS | hm | 21:36 |
| SpamapS | one might think there could be some arp + gre shenanigans? | 21:36 |
| SpamapS | but I don't think we have any gre tunnels for those boxes so that seems unlikely | 21:36 |
| Ng | lifeless: I've asked if their documentation shows the two ports as being connected to the same machine | 21:36 |
| *** e0ne has quit IRC | 21:36 | |
| lifeless | mmmm | 21:37 |
| Ng | lifeless: you have mellanoxes, are there any good low level tools for getting them to dump their worldview? | 21:37 |
| lifeless | in principle we could go machine A -> gre -> machine B -> switch port | 21:37 |
| lifeless | and have A turn up on B's port | 21:37 |
| lifeless | but the undercloud is a single host w/none of that, I'd hope | 21:38 |
| lifeless | hmmm | 21:38 |
| lifeless | or | 21:38 |
| lifeless | machine A-> LAN -> machine B-> vswitch -> vswitch -> LAN would do it | 21:38 |
| lifeless | if we have a cycle defined in software | 21:38 |
| lifeless | I wonder | 21:38 |
| lifeless | maybe we have vlan25 and untagged bridged together a | 21:39 |
| lifeless | and the switch considers them the same for its arp table | 21:39 |
| Ng | fwiw, ip tunnel ls on .3 shows nothing | 21:39 |
| SpamapS | lifeless: tagged and untagged would not explain "on two ports" | 21:43 |
| lifeless | SpamapS: yeah, it would | 21:45 |
| lifeless | SpamapS: untagged on the real port, tagged from a different machine which has bridged vlan25 and untagged together | 21:45 |
| Ng | (and .4) | 21:45 |
| lifeless | Ng: can they tell us what other MACs they are seeing from the ports that .3 is seen on ? | 21:46 |
| Ng | lifeless: I shall ask | 21:46 |
| Ng | I have asked | 21:46 |
| *** markmc has quit IRC | 21:46 | |
| NobodyCam | is it a ProCurve switch...? if so do we know model | 21:47 |
| Ng | NobodyCam: I'd hope we're using our own networking gear! | 21:47 |
| Ng | the port identifiers are in the x/y/z form, which is at least doesn't rule out them being ProCurves | 21:48 |
| Ng | -is | 21:48 |
| NobodyCam | I recall a issue with older (at least 4 years ago) ProCurve switches has some issue with mac appering on different ports | 21:50 |
| NobodyCam | I ran in to it with a cicco local director | 21:50 |
| NobodyCam | cisco even | 21:51 |
| NobodyCam | my fix back then was to manually assign the correct mac to the correct port | 21:51 |
| NobodyCam | again that was Years ago | 21:51 |
| lifeless | Ng: so I think this may be a footgun | 21:52 |
| SpamapS | lifeless: eh? | 21:54 |
| lifeless | 10.10.16.177 is unavailable atm | 21:55 |
| lifeless | if thats the port they blocked | 21:55 |
| lifeless | | f4aa2f1d-d1d8-474b-b9d2-23e8bda45404 | ci-overcloud-notcompute-3st54nnok5p5 | ACTIVE | None | Running | ctlplane=10.10.16.177 | | 21:55 |
| lifeless | which is a machine with a complex br-ex config | 21:55 |
| lifeless | I think the scenario I painted above about bridging untagged and tagged together | 21:56 |
| lifeless | potentially in a loop | 21:56 |
| lifeless | may be in play | 21:56 |
| lifeless | going in via console | 21:56 |
| NobodyCam | FWIW: http://h20565.www2.hp.com/portal/site/hpsc/template.PAGE/public/kb/docDisplay?javax.portlet.begCacheTok=com.vignette.cachetoken&javax.portlet.endCacheTok=com.vignette.cachetoken&javax.portlet.prp_ba847bafb2a2d782fcbb0710b053ce01=wsrp-navigationalState%3DdocId%253Demr_na-c01970537-1%257CdocLocale%253D%257CcalledBy%253D&javax.portlet.tpst=ba847bafb2a2d782fcbb0710b053ce01&ac.admitted=1389909073076.876444892.492883150#V3 | 21:56 |
| Ng | lifeless: which rack machine is that? | 21:57 |
| SpamapS | lifeless: ah so you think it is possible our arp responses are somehow getting sprayed out over on that port? | 21:57 |
| lifeless | Ng: neutron port-list | grep 177; lookip in machine-info-shared... monty0001 78:e7:d1:23:95:65 | 21:57 |
| lifeless | SpamapS: I think its possible | 21:57 |
| lifeless | SpamapS: broadcast traffic in on untagged out on vlan25 from that host | 21:57 |
| lifeless | yeah, it has eth2 and vlan25 on the same br-ex | 21:58 |
| lifeless | this is for the ci setup. fark. | 21:58 |
| SpamapS | ah so it is likely our problems started on deploy of that stack? | 21:59 |
| lifeless | yes | 21:59 |
| Ng | lifeless: so we're happy for me to have the Network guy stand down? | 21:59 |
| lifeless | Ng: no, cause the port is blocked | 21:59 |
| lifeless | let me undo the config | 21:59 |
| Ng | (and in-so-doing, reverse his temporary testing changes :) | 22:00 |
| lifeless | ok, could he please undo his port block | 22:02 |
| *** jcoufal has quit IRC | 22:03 | |
| Ng | lifeless: requested | 22:03 |
| lifeless | Ng: and then we should poke a little traffic | 22:03 |
| lifeless | Ng: and see if the multiple ports thing turns up again | 22:03 |
| Ng | I've had pings running from the bastion to .3 and .4 the whole time. after the ports were first shut down, bringing them back up immediately caused instability | 22:04 |
| openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Install environment and templates for heat-engine https://review.openstack.org/67309 | 22:05 |
| *** jdob has quit IRC | 22:05 | |
| openstackgerrit | Ryan Brady proposed a change to openstack/tripleo-image-elements: Adds iptables element https://review.openstack.org/67163 | 22:07 |
| Ng | lifeless: ports back up | 22:08 |
| Ng | .3/.4 pings are stable so far | 22:08 |
| lifeless | Ng: ok so I think that was it; please thank him for helping us diagnose this and apologise for me being an idjit | 22:09 |
| *** marun has quit IRC | 22:09 | |
| SpamapS | lifeless: can you provide a pointer to where the bad things are? I am not really following what the problem is, but I want to make sure I don't do it :) | 22:10 |
| lifeless | so this means we need a new bridge for the test network | 22:10 |
| lifeless | SpamapS: don't glue two l3 networks together by an L2 bridge if they are hosted on the same l2 network, unless you have STP on | 22:10 |
| lifeless | SpamapS: the control node for ci-overcloud needs both vlan2 and eth2 to be neutron accessible, and I put them both on br-ex | 22:12 |
| lifeless | SpamapS: bad robert. | 22:12 |
| lifeless | and in fact I have a note here I wrote yesterday: | 22:12 |
| lifeless | '... don't use br-ex, as that may be resulting in double-output on vlan25 and eth2. | 22:12 |
| lifeless | ' | 22:12 |
| lifeless | BWAHAHAHAHA | 22:12 |
| SpamapS | lifeless: velocity is a bitch sometimes. ;) | 22:13 |
| *** vipul is now known as vipul-away | 22:13 | |
| *** vipul-away is now known as vipul | 22:13 | |
| Ng | talking of STP, I noticed it seems to be off basically everywhere - should we tell some of our bridges to enable it maybe? | 22:13 |
| lifeless | Ng: probably not | 22:14 |
| lifeless | Ng: when its own you get up to 90s of no-traffic at all while it learns | 22:14 |
| lifeless | Ng: there are newer standards that make this less of an OMG event but its still pretty disruptive | 22:14 |
| lifeless | Ng: note thats 90s *across the entire L2 network* | 22:14 |
| lifeless | Ng: so imagine rebooting servers to deploy, and the network stops for 90s | 22:15 |
| lifeless | per server | 22:15 |
| lifeless | per boot | 22:15 |
| Ng | portfast! | 22:15 |
| lifeless | Cisco! | 22:16 |
| openstackgerrit | Ryan Brady proposed a change to openstack/tripleo-image-elements: Adds iptables element https://review.openstack.org/67163 | 22:19 |
| lifeless | erm wtf | 22:19 |
| lifeless | something just shut ci-overcloud-notcompute down hard | 22:19 |
| lifeless | | 6d5b684a-a030-4298-afe9-a52928413109 | ci-overcloud-NovaCompute0-bxv3lvtd6lc2 | REBUILD | rebuild_spawning | R | 22:20 |
| lifeless | !!! | 22:20 |
| openstack | lifeless: Error: "!!" is not a valid command. | 22:20 |
| Ng | your outrage is invalid | 22:20 |
| lifeless | | 2dc63cf2-611e-4263-a2c6-be4dbb5aeac2 | ci-overcloud | UPDATE_IN_PROGRESS | 2014-01-14T03:23:30Z | | 22:20 |
| lifeless | someone ran a stack-update on ci-overcloud... | 22:20 |
| lifeless | or started tripleo-cd | 22:20 |
| lifeless | yah, my patchset was still sitting there | 22:21 |
| Ng | was not me | 22:21 |
| * lifeless sobs | 22:21 | |
| lifeless | SpamapS: ^ | 22:21 |
| lifeless | don't interrupt it | 22:21 |
| lifeless | but it will be interesting to see what (if anything) I failed at documenting :) | 22:22 |
| *** lblanchard1 has quit IRC | 22:24 | |
| *** vipul is now known as vipul-away | 22:29 | |
| SpamapS | lifeless: Oh I started tripleo-cd a bit ago to test my "wait for updates" changes | 22:30 |
| SpamapS | lifeless: is tripleo-cd also poking ci-overcloud? | 22:30 |
| lifeless | SpamapS: its how I deployed it | 22:30 |
| lifeless | SpamapS: I had a local patch to change were it targeted and params etc | 22:31 |
| lifeless | SpamapS: I've stashed that now | 22:31 |
| SpamapS | alright | 22:31 |
| lifeless | mea culpa | 22:31 |
| lifeless | i didn't communicate enough | 22:31 |
| SpamapS | np I just started it after cleaning things back up | 22:31 |
| SpamapS | I was actually about to poke the topic of the channel :) | 22:31 |
| SpamapS | lifeless: couldn't you have just made a tripleo-cd2.sh ? ;) | 22:33 |
| lifeless | SpamapS: no, the changes were to devtest_overcloud.sh | 22:33 |
| lifeless | SpamapS: as I said, mea culpa. I meant to stash it when I was finished | 22:33 |
| lifeless | I forgot | 22:33 |
| *** cd-undercloud has joined #tripleo | 22:34 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 22:34 |
| *** cd-undercloud has quit IRC | 22:34 | |
| SpamapS | ooohhhhh | 22:34 |
| SpamapS | this makes so much sense now | 22:34 |
| lifeless | git stash show to see what I did | 22:34 |
| lifeless | Ng: thanks for your help ! | 22:34 |
| SpamapS | hm.. | 22:37 |
| Ng | lifeless: np. likewise! | 22:37 |
| SpamapS | resurrecting my devtest undercloud is not going well | 22:37 |
| SpamapS | undercloud box can't seem to see traffic to/from 192.0.2.1 | 22:38 |
| lifeless | mmm we're not preserving ssh host keys effectively yet | 22:38 |
| StevenK | lifeless: I think I know why things went bang yesterday | 22:38 |
| SpamapS | lifeless: https://review.openstack.org/#/c/65492/ | 22:38 |
| lifeless | because you shot them ? | 22:38 |
| StevenK | /dev/mapper/sys-var 99G 19G 75G 20% /var | 22:38 |
| SpamapS | lifeless: That's Ng's sshd preserving things | 22:38 |
| StevenK | That was a 20G partition yesterday | 22:38 |
| *** CaptTofu has quit IRC | 22:39 | |
| SpamapS | partitions are so gauche | 22:39 |
| StevenK | When I looked, it had 4K remaining | 22:39 |
| SpamapS | why don't we have ZFS-like storage zen for everything yet? | 22:39 |
| *** bauzas has quit IRC | 22:39 | |
| StevenK | SpamapS: You know, I installed this machine back with Maverick ... :-) | 22:40 |
| Ng | SpamapS: because btrfs is still craztown bonkers unstable | 22:40 |
| lifeless | SpamapS: what machine? | 22:40 |
| SpamapS | Ng: maybe it always will be. :( | 22:40 |
| StevenK | Ng: And still bonkers after the unstable bits are sorted out | 22:40 |
| SpamapS | lifeless: my local devtest | 22:40 |
| SpamapS | lifeless: I shut it all down, trying to see if you can actually resurrect it | 22:41 |
| lifeless | SpamapS: oh right | 22:41 |
| SpamapS | lifeless: ip has not moved from eth0 -> br-ctlplane yet | 22:41 |
| lifeless | SpamapS: cat /etc/os-collect-config.conf | 22:41 |
| SpamapS | lifeless: and because of that, we have no cfn.json .. and so orc scripts are failing | 22:41 |
| lifeless | SpamapS: and check the os-collect-config log | 22:41 |
| *** CaptTofu has joined #tripleo | 22:41 | |
| lifeless | Ng: do you want the sshd element picked up? maybe StevenK could do that today? | 22:42 |
| SpamapS | https://git.openstack.org/cgit/openstack/tripleo-image-elements/tree/elements/nova-baremetal/os-refresh-config/configure.d/81-nat-metadata | 22:42 |
| SpamapS | that one cannot cope with an empty $EXTERNAL_BRIDGE | 22:43 |
| lifeless | right | 22:43 |
| lifeless | SpamapS: but this is seed right ? | 22:44 |
| SpamapS | no | 22:44 |
| lifeless | SpamapS: seed doesn't have network metadata at all | 22:44 |
| SpamapS | undercloud | 22:44 |
| lifeless | oh | 22:44 |
| SpamapS | seed is working "fine" | 22:44 |
| Ng | lifeless: I am ambivalent - I'm about out of time for today, so if it is an interesting thing for StevenK to do, I will not mind at all if I wake up and it's landed :) | 22:44 |
| *** ccrouch has quit IRC | 22:45 | |
| SpamapS | hm so init-neutron-ovs is what moves the ip's.. | 22:45 |
| lifeless | Ng: pid = /stunnel4.pid | 22:47 |
| lifeless | Ng: in / ? really? | 22:47 |
| *** vipul-away is now known as vipul | 22:48 | |
| lifeless | hah | 22:48 |
| lifeless | SpamapS: ci-undercloud is now on .4 :P | 22:48 |
| openstackgerrit | Steve Kowalik proposed a change to openstack/diskimage-builder: Allow use of mirrors when building Ubuntu images https://review.openstack.org/66984 | 22:50 |
| Ng | lifeless: err, wow, that's spectacularly not what I meant to do | 22:50 |
| lifeless | we're not preserving ovs db yet either | 22:51 |
| lifeless | StevenK: ^ you were asking what was left at one point. | 22:51 |
| SpamapS | lifeless: so the problem is, I think, that the networking is setup such that it won't work until ip address is moved from eth0 -> br-ctlplane ... | 22:51 |
| SpamapS | lifeless: and that only happens _if_ you have cfn metadata | 22:51 |
| lifeless | SpamapS: so we need to cache the config locally | 22:51 |
| lifeless | SpamapS: ? | 22:51 |
| *** newell has joined #tripleo | 22:51 | |
| SpamapS | lifeless: yeah I think that may be the right answer | 22:52 |
| SpamapS | lifeless: we should use "not /var/run" for os-collect-config's data. | 22:52 |
| SpamapS | which I've actually been thinking maybe is true for a while.. but now I have confirmation.. it complicates things to lose what we had before | 22:52 |
| *** ftcjeff has quit IRC | 23:01 | |
| *** e0ne has joined #tripleo | 23:03 | |
| *** jrist_ is now known as jrist-afk | 23:04 | |
| *** jrist-afk is now known as jrist | 23:05 | |
| * Ng ejects | 23:06 | |
| *** e0ne has quit IRC | 23:06 | |
| openstackgerrit | Tzu-Mainn Chen proposed a change to openstack/tuskar-ui: Initial implementation of deployment detail pages https://review.openstack.org/67322 | 23:14 |
| *** matty_dubs is now known as matty_dubs|gone | 23:16 | |
| openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/os-collect-config: Move default cache dir to persistent location https://review.openstack.org/67323 | 23:16 |
| *** jayg is now known as jayg|g0n3 | 23:18 | |
| *** tserong_ has joined #tripleo | 23:18 | |
| openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/os-apply-config: Change default os_config_files location https://review.openstack.org/67327 | 23:19 |
| *** tserong has quit IRC | 23:22 | |
| *** cd-undercloud has joined #tripleo | 23:23 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 23:23 |
| *** cd-undercloud has quit IRC | 23:23 | |
| SpamapS | can somebody confirm for me where install lives on fedora? /usr/bin? | 23:31 |
| SpamapS | silly systemd wants absolute binary paths | 23:32 |
| * SpamapS wonders why lennart hates $PATH | 23:32 | |
| openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Make os-collect-config preserve state. https://review.openstack.org/67329 | 23:33 |
| SpamapS | hmm... | 23:36 |
| SpamapS | status=1 seems to solely be a timeout issue | 23:36 |
| SpamapS | the thing is "up" now | 23:36 |
| SpamapS | took 21 minutes | 23:37 |
| SpamapS | hm wait_for is for 220 * 10 seconds so that should have been enough | 23:38 |
| SpamapS | hm | 23:44 |
| SpamapS | I think we need to move all of /opt/stack to "somewhere under /var/lib" | 23:45 |
| lifeless | nuts | 23:46 |
| lifeless | no preserved state on ci-overcloud | 23:46 |
| *** ftcjeff has joined #tripleo | 23:47 | |
| SpamapS | lifeless: undercloud isn't patched? | 23:49 |
| lifeless | SpamapS: not enough patches in trunk at the time I guess | 23:49 |
| lifeless | SpamapS: oh, we haven't copied the updated tripleo-cd to /u/l/b | 23:49 |
| SpamapS | lifeless: I do feel like we're getting a little fast and loose with the patches without any real strategy for managing delta other than "push harder on upstream". | 23:50 |
| *** ftcjeff has quit IRC | 23:50 | |
| lifeless | SpamapS: apropos - do you know what this delta is for ? http://paste.ubuntu.com/6764889/ | 23:50 |
| SpamapS | lifeless: -u will overflow our root partition | 23:51 |
| SpamapS | lifeless: the event-list is likely just skew | 23:52 |
| SpamapS | Filesystem Size Used Avail Use% Mounted on | 23:52 |
| SpamapS | /dev/sda1 19G 16G 2.6G 86% / | 23:52 |
| SpamapS | Thats after I cleaned out 2G of logs from /var/log/upstart | 23:52 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Disable uncompressed images for tripleo-cd. https://review.openstack.org/67336 | 23:53 |
| lifeless | SpamapS: sure. but if its not committed, it will get lost | 23:53 |
| lifeless | hmm, so we do have /root/stackrc:export OVERCLOUD_IMAGE_UPDATE_POLICY=REBUILD_PRESERVE_EPHEMERAL | 23:54 |
| lifeless | so it *should* have preserved the /mnt contents | 23:54 |
| lifeless | indeeed, it did | 23:54 |
| lifeless | -rw-rw---- 1 mysql mysql 4029 Jan 13 23:26 mysql-bin.000001 | 23:54 |
| lifeless | SpamapS: ahahahahahahahah bet I know what happened | 23:54 |
| *** vipul is now known as vipul-away | 23:55 | |
| lifeless | uhm, nope, no reason for it to have inited | 23:55 |
| lifeless | and db.initialized is dated before the rebuid | 23:56 |
| lifeless | and yet: | 23:56 |
| SpamapS | lifeless: you forgot to hook up the doll? http://booksnobbery.files.wordpress.com/2012/03/you-forgot-to-hook-up-the-doll.jpg%3Fw%3D560 | 23:56 |
| lifeless | + echo 'DB files already initialized.' | 23:56 |
| lifeless | DB files already initialized. | 23:57 |
| lifeless | + service mysql restart | 23:57 |
| lifeless | stop: Unknown instance: | 23:57 |
| lifeless | mysql start/running, process 2435 | 23:57 |
| lifeless | + PATH=/usr/local/bin:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin | 23:57 |
| lifeless | + venvs=/opt/stack/venvs | 23:57 |
| lifeless | + os-db-create keystone keystone unset | 23:57 |
| lifeless | SpamapS: OK=/opt/stack/boot-stack/init-openstack.ok | 23:57 |
| *** CaptTofu has quit IRC | 23:58 | |
| SpamapS | lifeless: ahhhh | 23:58 |
| SpamapS | lifeless: we blew it all away.. again.. didn't we? | 23:58 |
| lifeless | SpamapS: indeed we did | 23:58 |
| SpamapS | shouldn't we maybe put... safeties on that? | 23:58 |
| lifeless | SpamapS: that *is* the safety | 23:58 |
| SpamapS | hrm | 23:58 |
| SpamapS | seems like _in the database_ is a better safety | 23:59 |
| lifeless | SpamapS: the path is in the image | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
