| *** epim has joined #tripleo | 00:04 | |
| *** ftcjeff has quit IRC | 00:08 | |
| *** cd-undercloud has joined #tripleo | 00:17 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 00:17 |
|---|---|---|
| *** cd-undercloud has quit IRC | 00:17 | |
| openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Create /var/run/neutron https://review.openstack.org/70023 | 00:18 |
| *** ohadlevy has quit IRC | 00:19 | |
| *** CaptTofu has joined #tripleo | 00:23 | |
| *** matsuhashi has joined #tripleo | 00:26 | |
| lifeless | pleia2: hi | 00:31 |
| lifeless | pleia2: uhm, ssh *failing* generally means a config issue :) | 00:32 |
| lifeless | pleia2: do you have any more data on the failure ? | 00:32 |
| lifeless | pleia2: one thing I did to diagnose was kill nodepool (hard :)) after it spawned the image, and check I could ssh in by hand | 00:32 |
| lifeless | pleia2: note too the user to use is fedora, not ubuntu | 00:32 |
| pleia2 | lifeless: I did that :) | 00:33 |
| pleia2 | [fedora@tripleo-fedora-1391029374 ~]$ | 00:33 |
| pleia2 | I can log in with my ssh key | 00:33 |
| lifeless | pleia2: ok, so you can log in | 00:33 |
| lifeless | pleia2: what user is nodepool trying to login with? | 00:33 |
| lifeless | pleia2: and is nodepool running in your session (so it has access to your ssh agent ?) | 00:33 |
| pleia2 | lifeless: default is jenkins, but it's not that far along in the setup, so I changed it to fedora | 00:34 |
| lifeless | pleia2: so no, jenkins is the *user* account | 00:34 |
| pleia2 | lifeless: but looking at /var/log/messages I don't even see the attempt | 00:34 |
| lifeless | you need the setup account | 00:34 |
| pleia2 | ah, ok, checking | 00:34 |
| lifeless | see bootStrapServer in nodepool.py | 00:35 |
| lifeless | the bug is super obvious | 00:35 |
| lifeless | you'll slap yourself when you see it :) | 00:35 |
| pleia2 | for username in ['root', 'ubuntu']: | 00:36 |
| pleia2 | heh | 00:36 |
| *** epim has quit IRC | 00:51 | |
| *** olaph has quit IRC | 00:51 | |
| pleia2 | lifeless: so sadly s/ubuntu/fedora (and I tried a few different combos) didn't help | 00:59 |
| pleia2 | https://review.openstack.org/#/c/69510 may be ready for some redhat networking eyeballs, working on the comment from clarkb and my first comment is addressed by https://review.openstack.org/#/c/70031/ | 01:00 |
| *** CaptTofu has quit IRC | 01:00 | |
| lifeless | pleia2: well, add fedora there | 01:01 |
| pleia2 | that's what I did | 01:02 |
| lifeless | pleia2: is that the ssh that was failing? Have you stepped through it pdb? | 01:03 |
| *** julim has joined #tripleo | 01:04 | |
| pleia2 | lifeless: hm, I didn't think there were other ssh instances, pdb time | 01:04 |
| clarkb | maybe the distros should stop being silly and add distro specific root account stand ins | 01:05 |
| clarkb | that battle seems to have been lost before I noticed there was one | 01:05 |
| pleia2 | heh | 01:06 |
| lifeless | distros...stop....being...sillly | 01:06 |
| lifeless | LOL | 01:06 |
| clarkb | the best bit is where ubuntu yells at you for logging in as root instead of the ubuntu user | 01:06 |
| clarkb | ph well | 01:06 |
| pleia2 | fedora does it now too | 01:06 |
| *** CaptTofu has joined #tripleo | 01:09 | |
| lifeless | SpamapS: https://review.openstack.org/#/c/67343/9 needs to and to unblock a tonne of stuff | 01:10 |
| lifeless | SpamapS: pretty pretty please | 01:11 |
| StevenK | lifeless: That heat bug is marked as Fix Released | 01:13 |
| *** ohadlevy has joined #tripleo | 01:13 | |
| *** ohadlevy is now known as Guest33846 | 01:14 | |
| lifeless | StevenK: 'that' ? | 01:14 |
| StevenK | lifeless: The heat bug mentioned in the commit message for 67343 | 01:14 |
| lifeless | StevenK: thats true | 01:15 |
| lifeless | StevenK: but we haven't verified that yet :) | 01:15 |
| lifeless | StevenK: I've just ported ng's manual config on the undercloud to automation | 01:16 |
| lifeless | StevenK: further iteration will definitely be needed | 01:16 |
| lifeless | StevenK: but I think we can land that review and go from there, no ? | 01:17 |
| StevenK | lifeless: Sure, I wasn't intending to block it, but the commit message is a little misleading now the heat bug is fixed | 01:17 |
| lifeless | StevenK: but we don't *know* its fixed | 01:18 |
| lifeless | StevenK: heat isn't in production anywhere. | 01:18 |
| lifeless | StevenK: we have a record of finding issues :/ | 01:18 |
| *** epim has joined #tripleo | 01:18 | |
| StevenK | Oh, it's verification versus marked as fixed. Right. | 01:18 |
| *** peoplemerge has joined #tripleo | 01:22 | |
| *** cd-undercloud has joined #tripleo | 01:22 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 01:22 |
| *** cd-undercloud has quit IRC | 01:22 | |
| lifeless | slagle: if you're around - https://review.openstack.org/#/c/69547/ | 01:25 |
| lifeless | slagle: and https://review.openstack.org/#/c/69548/ | 01:26 |
| *** lblanchard has joined #tripleo | 01:26 | |
| lifeless | ok, -> pick up C and L from airport | 01:27 |
| *** akrivoka has quit IRC | 01:30 | |
| pleia2 | airport run for me too, and dinner plans, will resume tomorrow | 01:32 |
| *** CaptTofu has quit IRC | 01:36 | |
| *** lblanchard has quit IRC | 01:38 | |
| *** nosnos has joined #tripleo | 01:38 | |
| *** mestery_ has joined #tripleo | 01:45 | |
| *** epim has quit IRC | 01:48 | |
| *** mestery has quit IRC | 01:48 | |
| *** CaptTofu has joined #tripleo | 01:57 | |
| *** vkozhukalov has joined #tripleo | 02:20 | |
| *** cd-undercloud has joined #tripleo | 02:29 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 02:29 |
| *** cd-undercloud has quit IRC | 02:29 | |
| *** CaptTofu has quit IRC | 02:32 | |
| openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Make scaling out a feature for merge.py. https://review.openstack.org/69547 | 02:43 |
| *** jcooley_ has quit IRC | 02:47 | |
| slagle | lifeless: the merge.py one looks good. but for the other one, the Makefile not updating overcloud.yaml if it needs an update at least needs a comment imo | 02:49 |
| slagle | i know it's in the commit message, but no one is going to look there since there is no indicating anything has gone wrong | 02:49 |
| slagle | *indication | 02:50 |
| *** CaptTofu has joined #tripleo | 02:52 | |
| openstackgerrit | Dan Prince proposed a change to openstack/tripleo-image-elements: Stop using all ports option w/ neutron-ovs-cleanup https://review.openstack.org/69937 | 02:58 |
| openstackgerrit | Dan Prince proposed a change to openstack/tripleo-image-elements: Write out persistent interface/bridge scripts https://review.openstack.org/69918 | 02:58 |
| clarkb | SpamapS: to avoid travel issues like we had in sunnyvale, are folks interested in collaborating around summit travel? | 03:12 |
| jamezpolley | travel issues? This sounds like a piece of history worth knowing | 03:15 |
| clarkb | jamezpolley: a bunch of us went to sunnyvale to get together to work on stuff and on board folks and we all stayed at different hotels | 03:15 |
| jamezpolley | especially since I'd prefer to avoid them on the upcoming meetup | 03:16 |
| clarkb | which over complicated getting around and stuff and we decided we should be more coordinated | 03:16 |
| jamezpolley | look for group hotel bookings so we can share cabs, etc? | 03:16 |
| StevenK | clarkb: And then the same thing happened in Perth? :-) | 03:16 |
| clarkb | well we don't need a group booking, but a bit of coordination | 03:16 |
| clarkb | StevenK: ya well that was booked far before sunnyvale happened :) | 03:16 |
| clarkb | also Atlanta has a metro which can possibly make getting to from airport and to from hotel easy if we pick hotels that are not in weird places | 03:17 |
| clarkb | anyways, thought I would throw it out there because we really derped it hard in december | 03:17 |
| jamezpolley | well that's not as exciting as it sounded | 03:19 |
| *** CaptTofu has quit IRC | 03:19 | |
| StevenK | jamezpolley: I've had a few fun travel stories, including being delayed at Heathrow for seven hours because a baggage handler drove his cart into an engine | 03:20 |
| clarkb | jamezpolley: we do have a semi exciting story from that trip though | 03:20 |
| *** markmcclain has quit IRC | 03:21 | |
| *** mestery_ is now known as mestery | 03:21 | |
| clarkb | SpamapS, cody, AaronGr and I were trying to catch caltrain to SF from MV. We missed the one we wanted that was faster then we ran to the next one but cody and AaronGr didn't run and they didn't get on the train | 03:21 |
| clarkb | and caltrain doesn't open the doors after they close | 03:21 |
| clarkb | so we split the party after already being late | 03:21 |
| *** michchap has quit IRC | 03:21 | |
| *** markmcclain has joined #tripleo | 03:21 | |
| *** michchap has joined #tripleo | 03:22 | |
| StevenK | clarkb: If you watch Top Gear, are cody and AaronGr like James May, and they won't run on television? :-P | 03:22 |
| clarkb | cody and AaronGr gave up and had dinner in MV, but SpamapS and I got to the bart transfer where we sat for forever beacuse of track issues. Finally we get into SF and start the 20 minute walk to where we were supposed to meet people. As we get there we can't find the place and are trying to get in touch with the others. Eventually mordred says oh we are at this other restaurant now (that restaurant was back | 03:22 |
| clarkb | where we started after getting off of bart) | 03:22 |
| StevenK | Haha | 03:23 |
| clarkb | at this point we say screw it and get a cab to restaurant. We have dinner and dinner ends at midnight | 03:23 |
| clarkb | now we have to get back to MV but no more caltrain so we uber the whole way back to caltrain stop then drive the rentals to hotels | 03:23 |
| clarkb | it was amazing | 03:23 |
| *** michchap has quit IRC | 03:27 | |
| jamezpolley | *applause* | 03:27 |
| *** coolsvap_away has quit IRC | 03:27 | |
| *** jcooley_ has joined #tripleo | 03:27 | |
| jamezpolley | yeah, caltrain cuts off weirdly early. The first time I was over there for El Goog I made the mistake of staying in MV | 03:28 |
| jamezpolley | later trips I always stayed in SF and used the shuttles to get to/from the office | 03:28 |
| *** matsuhashi has quit IRC | 03:29 | |
| *** jcooley_ has quit IRC | 03:34 | |
| *** jcooley_ has joined #tripleo | 03:35 | |
| *** cd-undercloud has joined #tripleo | 03:35 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 03:35 |
| *** cd-undercloud has quit IRC | 03:35 | |
| *** michchap has joined #tripleo | 03:35 | |
| lifeless | slagle: ok | 03:37 |
| *** jcooley_ has quit IRC | 03:40 | |
| *** leizhang has joined #tripleo | 03:44 | |
| StevenK | lifeless: I win re 69060, we'll see if jenkins agrees | 03:56 |
| *** olaph has joined #tripleo | 03:57 | |
| *** spzala has quit IRC | 03:59 | |
| *** leizhang has quit IRC | 04:01 | |
| *** matsuhashi has joined #tripleo | 04:02 | |
| *** jcooley_ has joined #tripleo | 04:10 | |
| *** jcooley_ has quit IRC | 04:16 | |
| *** jcooley_ has joined #tripleo | 04:17 | |
| *** ccrouch has quit IRC | 04:21 | |
| *** jcooley_ has quit IRC | 04:21 | |
| *** jcooley_ has joined #tripleo | 04:22 | |
| *** akuznetsov has joined #tripleo | 04:26 | |
| *** markmcclain has quit IRC | 04:34 | |
| *** cd-undercloud has joined #tripleo | 04:41 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 04:41 |
| *** cd-undercloud has quit IRC | 04:41 | |
| *** sameer has joined #tripleo | 05:01 | |
| *** akuznetsov has quit IRC | 05:13 | |
| *** matsuhashi has quit IRC | 05:14 | |
| *** matsuhas_ has joined #tripleo | 05:17 | |
| *** coolsvap has joined #tripleo | 05:19 | |
| *** akuznetsov has joined #tripleo | 05:26 | |
| *** rwsu has quit IRC | 05:27 | |
| *** akuznetsov has quit IRC | 05:37 | |
| lifeless | StevenK: awesome | 05:37 |
| StevenK | lifeless: I've also fixed 69108, but I'm not sure about it. | 05:38 |
| StevenK | lifeless: http://paste.openstack.org/show/62147 | 05:38 |
| *** jtomasek has quit IRC | 05:42 | |
| *** cd-undercloud has joined #tripleo | 05:48 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 05:48 |
| *** cd-undercloud has quit IRC | 05:48 | |
| lifeless | StevenK: you should add co-authored-by: | 05:56 |
| StevenK | lifeless: Yes, but I haven't pushed it up because I'm not sure if just changing that test state from ERROR to STOPPED is even valid | 05:58 |
| lifeless | StevenK: is it in _test_init_instance_reverts_crashed_migrations ? | 05:59 |
| lifeless | StevenK: so no, I don't think changing the initial status to STOPPED makes sense, though some history spelunking is probably needed | 06:00 |
| lifeless | StevenK: it look, from that test, that there is a specific recovery path where an ERROR instance from a failed migration is expected to be restarted. | 06:00 |
| lifeless | but sadly its a move, needs deep pickaxing | 06:01 |
| lifeless | before 404cd48773f841c9ace2128c25d0f0956392f655 it was in a/nova/tests/compute/test_compute.py | 06:02 |
| lifeless | -> #openstack-nova for this I think | 06:02 |
| *** akuznetsov has joined #tripleo | 06:15 | |
| *** vkozhukalov has quit IRC | 06:18 | |
| *** akuznets_ has joined #tripleo | 06:18 | |
| *** akuznetsov has quit IRC | 06:20 | |
| *** rlandy has joined #tripleo | 06:41 | |
| *** pblaho has joined #tripleo | 06:42 | |
| *** pblaho has quit IRC | 06:42 | |
| *** pblaho has joined #tripleo | 06:42 | |
| *** mrunge has joined #tripleo | 06:43 | |
| *** mrunge has quit IRC | 06:46 | |
| *** AaronGr is now known as AaronGr_zzz | 06:49 | |
| *** cd-undercloud has joined #tripleo | 06:53 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 06:53 |
| *** cd-undercloud has quit IRC | 06:53 | |
| *** jcooley_ has quit IRC | 06:59 | |
| *** jcooley_ has joined #tripleo | 07:00 | |
| *** sameer has quit IRC | 07:16 | |
| *** jcooley_ has quit IRC | 07:16 | |
| *** cwolferh has quit IRC | 07:24 | |
| *** kiall has quit IRC | 07:25 | |
| *** rdopieralski has joined #tripleo | 07:25 | |
| *** GheRivero has quit IRC | 07:25 | |
| *** Shrews has quit IRC | 07:28 | |
| *** jprovazn has joined #tripleo | 07:31 | |
| *** e0ne has joined #tripleo | 07:49 | |
| *** jcooley_ has joined #tripleo | 07:51 | |
| *** vkozhukalov has joined #tripleo | 07:57 | |
| *** cd-undercloud has joined #tripleo | 07:59 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 07:59 |
| *** cd-undercloud has quit IRC | 07:59 | |
| *** jistr has joined #tripleo | 08:02 | |
| openstackgerrit | A change was merged to openstack/diskimage-builder: Skip relabel unless SELinux is enforcing https://review.openstack.org/68632 | 08:03 |
| *** jcooley_ has quit IRC | 08:05 | |
| *** ifarkas_ has joined #tripleo | 08:09 | |
| *** vkozhukalov has quit IRC | 08:10 | |
| *** ifarkas has quit IRC | 08:13 | |
| *** GheRivero has joined #tripleo | 08:14 | |
| *** vkozhukalov has joined #tripleo | 08:19 | |
| *** bauzas has joined #tripleo | 08:23 | |
| *** e0ne_ has joined #tripleo | 08:23 | |
| *** e0ne has quit IRC | 08:27 | |
| rlandy | GheRivero : hello ... picking up from yesterday's question - any thoughts on where this should be doc'ed: https://bugs.launchpad.net/tripleo/+bug/1215298 | 08:30 |
| GheRivero | morning rlandy | 08:31 |
| GheRivero | I guess the caveats / workaround is a good place | 08:32 |
| rlandy | thanks | 08:35 |
| GheRivero | commenting both possible options: avoid tmpfs with --no-tmpfs or specifiying a minimum tmpfs size required with --min-tmpfs | 08:35 |
| rlandy | GheRivero: agreed - will ask for your review later | 08:38 |
| GheRivero | sure! | 08:39 |
| *** nosnos has quit IRC | 08:39 | |
| *** nosnos has joined #tripleo | 08:39 | |
| tzumainn | lifeless, ping | 08:41 |
| *** vkozhukalov has quit IRC | 08:43 | |
| *** markmc has joined #tripleo | 08:43 | |
| *** jcooley_ has joined #tripleo | 08:46 | |
| *** mrunge has joined #tripleo | 08:52 | |
| *** d0ugal has joined #tripleo | 08:53 | |
| *** d0ugal has joined #tripleo | 08:53 | |
| *** vkozhukalov has joined #tripleo | 08:57 | |
| *** d0ugal has quit IRC | 09:00 | |
| *** jtomasek has joined #tripleo | 09:01 | |
| *** gcha has joined #tripleo | 09:01 | |
| *** GheRiver1 has joined #tripleo | 09:14 | |
| *** GheRivero has left #tripleo | 09:16 | |
| *** GheRiver1 is now known as GheRivero | 09:16 | |
| *** jcooley_ has quit IRC | 09:16 | |
| *** jtomasek has quit IRC | 09:21 | |
| *** derekh has joined #tripleo | 09:26 | |
| derekh | lifeless: I meant to mention yesterday that the TE hosts seems to have lost both its IP addresses , I can't log in to see what happened but I just started a new one to continue handling jobs | 09:30 |
| *** matsuhas_ has quit IRC | 09:33 | |
| derekh | weird it seems to have back its 192.168.1.X address | 09:36 |
| *** matsuhashi has joined #tripleo | 09:39 | |
| *** athomas has joined #tripleo | 09:44 | |
| *** nosnos has quit IRC | 09:46 | |
| *** nosnos has joined #tripleo | 09:46 | |
| *** nosnos has quit IRC | 09:47 | |
| *** martyntaylor has joined #tripleo | 09:48 | |
| *** matsuhashi has quit IRC | 09:50 | |
| *** shardy is now known as shardy_afk | 09:53 | |
| *** kiall has joined #tripleo | 10:03 | |
| *** e0ne_ has quit IRC | 10:03 | |
| *** e0ne has joined #tripleo | 10:05 | |
| *** ifarkas_ has quit IRC | 10:08 | |
| *** jistr has quit IRC | 10:08 | |
| *** jcooley_ has joined #tripleo | 10:09 | |
| *** ifarkas has joined #tripleo | 10:11 | |
| *** jcooley_ has quit IRC | 10:14 | |
| openstackgerrit | Ronelle Landy proposed a change to openstack/tripleo-incubator: Documents workarounds for tmpfs space errors https://review.openstack.org/70080 | 10:18 |
| openstackgerrit | Ralf Haferkamp proposed a change to openstack/diskimage-builder: Add mysql mapping for Fedora https://review.openstack.org/70081 | 10:20 |
| *** GheRivero has quit IRC | 10:20 | |
| *** kiall has quit IRC | 10:21 | |
| openstackgerrit | A change was merged to openstack/diskimage-builder: Add package map for stunnel4 https://review.openstack.org/69762 | 10:23 |
| openstackgerrit | Ralf Haferkamp proposed a change to openstack/tripleo-image-elements: Fix mysql installation on openSUSE https://review.openstack.org/68278 | 10:23 |
| lifeless | derekh: there's a bug open on that | 10:23 |
| lifeless | https://bugs.launchpad.net/tripleo/+bug/1272803 | 10:23 |
| lifeless | derekh: so, since we're roughly done with this phase of CI stuff; do you have thoughts about whats next? | 10:24 |
| derekh | lifeless: ok, didn't spot that bug, I'm pretty sure yesterday it didn't have any ip address but looks like its related | 10:26 |
| derekh | lifeless: I'm going to do the pip mirror stuff was messing with it a little yesterday an know what I need to do | 10:26 |
| derekh | lifeless: then reliability | 10:27 |
| derekh | lifeless: I also think we may need/want to tweak geard a little, the order its handing out jobs in seems to be the oprder they regeistered in | 10:28 |
| *** d0ugal has joined #tripleo | 10:28 | |
| derekh | lifeless: we will never use a second TE host unless the first is busy with all jobs | 10:28 |
| *** coolsvap has quit IRC | 10:28 | |
| derekh | lifeless: once TE_1 is finished with a job it seems to go to the fron of the queue | 10:29 |
| derekh | lifeless: I'm thinking something a bit more distributed may help us spread the load instead of ffavoring a single TE host all the time | 10:29 |
| derekh | lifeless: once thats done undercloud with persistent seed? | 10:30 |
| derekh | lifeless: I'm also thinking as part of the seed job we may want to bring up and undercloud (even if we didn't build it as part of that job) | 10:30 |
| derekh | lifeless: so that we know it can actually deploy something | 10:31 |
| derekh | lifeless: I'm off in an hour or so traveling to fosdem, will probably get the pip mirror finished monday and can then take a look at some of the other points from there | 10:32 |
| lifeless | derekh: I expect the normal situation to be most hosts fully loaded, so I'd leave tuning it for now. | 10:36 |
| lifeless | derekh: yeah, undercloud with async pre-setup seed would ROCK | 10:37 |
| lifeless | derekh: re: running an underecloud on the current job - perhaps: the 'stop sourcing X' patches I've been doing have been aiming at bringing more up in either the current job or new jobs | 10:37 |
| lifeless | derekh: ok cool | 10:37 |
| *** jistr has joined #tripleo | 10:38 | |
| *** e0ne_ has joined #tripleo | 10:39 | |
| derekh | lifeless: ok, once finished with the pip stuff, I'll looking into an undercloud job | 10:39 |
| lifeless | gnight! have fun at FOSDEM | 10:41 |
| derekh | lifeless: thanks :-) | 10:41 |
| *** e0ne has quit IRC | 10:42 | |
| *** vkozhukalov has quit IRC | 10:48 | |
| *** boris-42 has quit IRC | 10:54 | |
| *** e0ne_ has quit IRC | 10:54 | |
| *** e0ne has joined #tripleo | 10:54 | |
| *** lucasagomes has joined #tripleo | 10:56 | |
| *** derekh has quit IRC | 10:58 | |
| *** vkozhukalov has joined #tripleo | 11:00 | |
| *** jcooley_ has joined #tripleo | 11:02 | |
| *** max_lobur_afk is now known as max_lobur | 11:05 | |
| *** jcooley_ has quit IRC | 11:16 | |
| *** Guest33846 is now known as ohadlevy | 11:16 | |
| *** ohadlevy is now known as ohadlevy_ | 11:16 | |
| *** ohadlevy_ is now known as ohadlevy | 11:16 | |
| *** ohadlevy has joined #tripleo | 11:16 | |
| *** gcha has quit IRC | 11:20 | |
| *** pblaho has quit IRC | 11:21 | |
| *** e0ne_ has joined #tripleo | 11:28 | |
| *** e0ne has quit IRC | 11:28 | |
| *** e0ne_ has quit IRC | 11:30 | |
| *** e0ne has joined #tripleo | 11:30 | |
| *** coolsvap has joined #tripleo | 11:31 | |
| *** e0ne has quit IRC | 11:36 | |
| *** e0ne has joined #tripleo | 11:46 | |
| *** jtomasek has joined #tripleo | 11:54 | |
| *** e0ne has quit IRC | 11:58 | |
| *** e0ne has joined #tripleo | 11:58 | |
| *** coolsvap has quit IRC | 12:20 | |
| openstackgerrit | A change was merged to openstack/tuskar-ui: Combined Instance and Node objects into Node https://review.openstack.org/69724 | 12:20 |
| *** akrivoka has joined #tripleo | 12:31 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: SSL support for openstack services. https://review.openstack.org/67343 | 12:31 |
| *** CaptTofu has joined #tripleo | 12:42 | |
| *** michchap has quit IRC | 12:44 | |
| *** michchap has joined #tripleo | 12:44 | |
| *** e0ne_ has joined #tripleo | 12:49 | |
| *** e0ne has quit IRC | 12:49 | |
| *** michchap has quit IRC | 12:49 | |
| *** jcooley_ has joined #tripleo | 12:51 | |
| *** weshay has joined #tripleo | 12:55 | |
| *** d0ugal has quit IRC | 12:59 | |
| *** mrunge has quit IRC | 13:01 | |
| *** d0ugal has joined #tripleo | 13:01 | |
| *** d0ugal has quit IRC | 13:01 | |
| *** d0ugal has joined #tripleo | 13:01 | |
| *** vkozhukalov has quit IRC | 13:03 | |
| *** GheRivero has joined #tripleo | 13:09 | |
| openstackgerrit | Ana Krivokapic proposed a change to openstack/tuskar-ui: Add node detail view https://review.openstack.org/69462 | 13:11 |
| *** e0ne_ has quit IRC | 13:14 | |
| *** e0ne has joined #tripleo | 13:15 | |
| *** michchap has joined #tripleo | 13:15 | |
| *** e0ne_ has joined #tripleo | 13:16 | |
| *** vkozhukalov has joined #tripleo | 13:17 | |
| *** e0ne has quit IRC | 13:19 | |
| *** michchap has quit IRC | 13:20 | |
| *** e0ne_ has quit IRC | 13:20 | |
| *** e0ne has joined #tripleo | 13:20 | |
| *** gcha has joined #tripleo | 13:21 | |
| *** ccrouch has joined #tripleo | 13:22 | |
| *** d0ugal has quit IRC | 13:23 | |
| *** jcooley_ has quit IRC | 13:25 | |
| openstackgerrit | A change was merged to openstack/tuskar-ui: Add node detail view https://review.openstack.org/69462 | 13:32 |
| *** mestery_ has joined #tripleo | 13:35 | |
| *** mestery has quit IRC | 13:37 | |
| *** e0ne has quit IRC | 13:37 | |
| *** e0ne_ has joined #tripleo | 13:37 | |
| *** Shrews has joined #tripleo | 13:38 | |
| Ng | morning | 13:39 |
| * Ng preps for a call | 13:40 | |
| *** CaptTofu has quit IRC | 13:40 | |
| *** e0ne_ has quit IRC | 13:41 | |
| *** e0ne has joined #tripleo | 13:41 | |
| *** e0ne has quit IRC | 13:42 | |
| *** d0ugal has joined #tripleo | 13:42 | |
| *** e0ne has joined #tripleo | 13:42 | |
| *** e0ne_ has joined #tripleo | 13:44 | |
| *** e0ne has quit IRC | 13:44 | |
| *** e0ne has joined #tripleo | 13:46 | |
| *** e0ne_ has quit IRC | 13:46 | |
| *** e0ne_ has joined #tripleo | 13:48 | |
| *** e0ne has quit IRC | 13:48 | |
| *** jdob has joined #tripleo | 13:54 | |
| *** kiall has joined #tripleo | 14:05 | |
| *** vkozhukalov has quit IRC | 14:06 | |
| *** pblaho has joined #tripleo | 14:09 | |
| *** jayg|g0n3 is now known as jayg | 14:11 | |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: Fix reference to no_proxy https://review.openstack.org/69832 | 14:13 |
| *** michchap has joined #tripleo | 14:16 | |
| *** matty_dubs|gone is now known as matty_dubs | 14:16 | |
| *** akuznets_ has quit IRC | 14:17 | |
| *** akuznetsov has joined #tripleo | 14:18 | |
| *** jcooley_ has joined #tripleo | 14:18 | |
| *** vkozhukalov has joined #tripleo | 14:19 | |
| *** lblanchard has joined #tripleo | 14:19 | |
| *** michchap has quit IRC | 14:20 | |
| *** hewbrocca has joined #tripleo | 14:21 | |
| *** rha has quit IRC | 14:23 | |
| *** CaptTofu has joined #tripleo | 14:24 | |
| *** CaptTofu has quit IRC | 14:25 | |
| *** max_lobur is now known as max_lobur_afk | 14:26 | |
| *** rha has joined #tripleo | 14:26 | |
| *** CaptTofu has joined #tripleo | 14:26 | |
| rlandy | GheRivero: hi ... for your review: https://review.openstack.org/#/c/70080/. thanks | 14:27 |
| *** jcooley_ has quit IRC | 14:27 | |
| *** akuznetsov has quit IRC | 14:28 | |
| *** CaptTofu has quit IRC | 14:31 | |
| *** michchap has joined #tripleo | 14:39 | |
| *** boris-42 has joined #tripleo | 14:41 | |
| *** michchap has quit IRC | 14:43 | |
| *** ftcjeff has joined #tripleo | 14:44 | |
| *** max_lobur_afk is now known as max_lobur | 14:56 | |
| *** mestery_ is now known as mestery | 14:56 | |
| *** spzala has joined #tripleo | 14:57 | |
| openstackgerrit | Ryan Brady proposed a change to openstack/tripleo-image-elements: Fixes tgtd restart in cinder element https://review.openstack.org/70128 | 14:59 |
| *** rdopieralski has quit IRC | 15:06 | |
| openstackgerrit | Chris Krelle proposed a change to openstack/tripleo-image-elements: Add nova-ironic element to replace nova-baremetal https://review.openstack.org/66461 | 15:23 |
| *** lucasagomes is now known as lucas-hungry | 15:24 | |
| *** rwsu has joined #tripleo | 15:24 | |
| *** markmc has quit IRC | 15:26 | |
| *** peoplemerge has quit IRC | 15:30 | |
| *** mrunge has joined #tripleo | 15:30 | |
| *** AaronGr_zzz is now known as AaronGr | 15:34 | |
| *** peoplemerge has joined #tripleo | 15:38 | |
| *** markmcclain has joined #tripleo | 15:41 | |
| *** jprovazn has quit IRC | 15:43 | |
| openstackgerrit | Ladislav Smola proposed a change to openstack/tuskar-ui: Adding nova-baremetal, heat and nova API https://review.openstack.org/68973 | 15:47 |
| openstackgerrit | Tzu-Mainn Chen proposed a change to openstack/tuskar-ui: Remove nodes method from Overcloud object https://review.openstack.org/70145 | 15:50 |
| openstackgerrit | A change was merged to openstack/diskimage-builder: Add ability to use local cloud image https://review.openstack.org/68133 | 15:51 |
| *** mrunge has quit IRC | 15:53 | |
| *** athomas has quit IRC | 16:02 | |
| *** boris-42 has quit IRC | 16:05 | |
| *** CaptTofu has joined #tripleo | 16:05 | |
| *** d0ugal has quit IRC | 16:08 | |
| openstackgerrit | Ladislav Smola proposed a change to openstack/tuskar-ui: Adding nova-baremetal, heat and nova API https://review.openstack.org/68973 | 16:09 |
| *** ifarkas has quit IRC | 16:09 | |
| *** athomas has joined #tripleo | 16:11 | |
| SpamapS | hm.. | 16:12 |
| SpamapS | git is stuck | 16:12 |
| *** jcooley_ has joined #tripleo | 16:12 | |
| SpamapS | root 21049 0.0 0.0 107220 11320 ? S 08:14 0:02 git-remote-https https://git.openstack.org/openstack/nova.git https://git.openstack.org/openstack/nova.git | 16:13 |
| SpamapS | root 21130 0.0 0.0 113880 27880 ? S 08:14 0:01 git fetch-pack --stateless-rpc --stdin --lock-pack --include-tag --thin --no-progress https://git.openstack.org/openstack/nova.git/ | 16:13 |
| SpamapS | Those two have been running for 8 hours | 16:13 |
| SpamapS | both waiting for input from the other one | 16:13 |
| SpamapS | restarted tripleo-cd | 16:18 |
| *** e0ne_ has quit IRC | 16:21 | |
| *** e0ne has joined #tripleo | 16:21 | |
| *** lucas-hungry is now known as lucasagomes | 16:24 | |
| SpamapS | NobodyCam: https://review.openstack.org/#/c/66461/ <-- -1 but I may be mistaken | 16:26 |
| * NobodyCam looks | 16:26 | |
| *** weshay has quit IRC | 16:27 | |
| *** sameer has joined #tripleo | 16:27 | |
| NobodyCam | SpamapS: in testing we (i) have been using both n-bm and ironi | 16:28 |
| NobodyCam | ironic even | 16:28 |
| NobodyCam | SpamapS: my pref wouldbe to change devtest to use the ironic key if the ironic was called for ... but am up for debate | 16:29 |
| *** weshay has joined #tripleo | 16:31 | |
| *** jprovazn has joined #tripleo | 16:31 | |
| *** martyntaylor has quit IRC | 16:33 | |
| *** martyntaylor has joined #tripleo | 16:33 | |
| SpamapS | NobodyCam: wait so you're installing both on the same box? | 16:34 |
| *** lsmola_ has quit IRC | 16:34 | |
| NobodyCam | for testing I was | 16:34 |
| SpamapS | NobodyCam: I don't think that is ever something we would suggest to people though. | 16:35 |
| NobodyCam | yes! | 16:35 |
| SpamapS | NobodyCam: and even if they are together, that shouldn't really matter.. one key will work fine. | 16:35 |
| *** jcooley_ has quit IRC | 16:35 | |
| devananda | SpamapS: so the key could be the same name, but it must be owned by different users in each chase | 16:37 |
| devananda | case | 16:37 |
| NobodyCam | ahh good point devananda | 16:38 |
| *** michchap has joined #tripleo | 16:40 | |
| *** e0ne has quit IRC | 16:42 | |
| *** michchap has quit IRC | 16:45 | |
| *** olaph has quit IRC | 16:54 | |
| *** markmc has joined #tripleo | 16:54 | |
| openstackgerrit | Chris Krelle proposed a change to openstack/tripleo-image-elements: Add nova-ironic element to replace nova-baremetal https://review.openstack.org/66461 | 16:56 |
| NobodyCam | SpamapS: ^^^^ changed key name | 16:56 |
| *** d0ugal has joined #tripleo | 16:58 | |
| *** cwolferh has joined #tripleo | 17:00 | |
| SpamapS | NobodyCam: cool +2'd | 17:02 |
| NobodyCam | :) w00 hoo :) | 17:02 |
| *** blamar has joined #tripleo | 17:06 | |
| *** martyntaylor has quit IRC | 17:07 | |
| *** pblaho has quit IRC | 17:08 | |
| *** cadenzajon has joined #tripleo | 17:09 | |
| *** matty_dubs is now known as matty_dubs|lunch | 17:12 | |
| *** boris-42 has joined #tripleo | 17:14 | |
| *** julim has quit IRC | 17:23 | |
| *** jcooley_ has joined #tripleo | 17:25 | |
| openstackgerrit | Ana Krivokapic proposed a change to openstack/diskimage-builder: Add Fedora packages mappings for snmpd https://review.openstack.org/70170 | 17:25 |
| openstackgerrit | Ana Krivokapic proposed a change to openstack/tripleo-image-elements: Account for amd64 architecture in snmpd element https://review.openstack.org/70171 | 17:25 |
| *** markmc has quit IRC | 17:26 | |
| *** gcha has quit IRC | 17:27 | |
| *** jcooley_ has quit IRC | 17:28 | |
| *** cd-undercloud has joined #tripleo | 17:30 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 17:30 |
| *** cd-undercloud has quit IRC | 17:30 | |
| *** jcooley_ has joined #tripleo | 17:34 | |
| *** coolsvap has joined #tripleo | 17:38 | |
| *** michchap has joined #tripleo | 17:41 | |
| *** michchap has quit IRC | 17:41 | |
| *** michchap has joined #tripleo | 17:42 | |
| *** akrivoka has quit IRC | 17:44 | |
| *** vkozhukalov has quit IRC | 17:44 | |
| *** michchap has quit IRC | 17:46 | |
| *** athomas has quit IRC | 17:50 | |
| *** matty_dubs|lunch is now known as matty_dubs | 17:50 | |
| *** e0ne has joined #tripleo | 17:51 | |
| openstackgerrit | Dirk Mueller proposed a change to openstack/diskimage-builder: Update openSUSE package mappings for OpenStack https://review.openstack.org/70174 | 17:53 |
| *** jistr has quit IRC | 17:53 | |
| *** rlandy is now known as rlandy|bbl | 17:56 | |
| *** jcooley_ has quit IRC | 18:00 | |
| *** jcooley_ has joined #tripleo | 18:01 | |
| *** weshay has quit IRC | 18:05 | |
| *** max_lobur is now known as max_lobur_afk | 18:08 | |
| *** sameer has quit IRC | 18:11 | |
| *** sameer has joined #tripleo | 18:12 | |
| *** bauzas has quit IRC | 18:20 | |
| fungi | our nodepool server is getting fairly consistent socket timeouts to ci-overcloud.tripleo.org:13000 for a while now. anything going on we should be aware of? | 18:22 |
| *** julim has joined #tripleo | 18:22 | |
| *** weshay has joined #tripleo | 18:34 | |
| *** sameer has quit IRC | 18:35 | |
| *** cd-undercloud has joined #tripleo | 18:36 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 18:36 |
| *** cd-undercloud has quit IRC | 18:36 | |
| *** e0ne has quit IRC | 18:37 | |
| *** e0ne has joined #tripleo | 18:37 | |
| *** michchap has joined #tripleo | 18:42 | |
| *** michchap has quit IRC | 18:42 | |
| *** michchap has joined #tripleo | 18:42 | |
| pleia2 | fungi: yeah, I've been having trouble connecting this morning as well, hopefully an admin will wake up soon to have a poke at it | 18:43 |
| fungi | okay, making sure it wasn't just me | 18:44 |
| fungi | at least now i've patched nodepool so that it doesn't give up and stop launching nodes on any of its providers when one stops responding indefinitely | 18:44 |
| pleia2 | thanks | 18:45 |
| *** michchap has quit IRC | 18:47 | |
| *** jcooley_ has quit IRC | 18:56 | |
| *** jcooley_ has joined #tripleo | 18:59 | |
| matty_dubs | Has anyone played around with diskimage-builder and EFI boxes? My results have not been good. | 19:12 |
| *** vkozhukalov has joined #tripleo | 19:19 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Add nova-ironic element to replace nova-baremetal https://review.openstack.org/66461 | 19:19 |
| devananda | woot! NobodyCam ^ | 19:22 |
| *** mrunge has joined #tripleo | 19:29 | |
| *** mrunge has quit IRC | 19:29 | |
| *** e0ne has quit IRC | 19:30 | |
| *** e0ne has joined #tripleo | 19:31 | |
| *** e0ne has quit IRC | 19:35 | |
| *** michchap has joined #tripleo | 19:43 | |
| *** michchap has quit IRC | 19:43 | |
| *** michchap has joined #tripleo | 19:43 | |
| *** cd-undercloud has joined #tripleo | 19:44 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 19:44 |
| *** cd-undercloud has quit IRC | 19:44 | |
| SpamapS | timing out a lot | 19:46 |
| *** michchap has quit IRC | 19:48 | |
| Ng | lifeless: FYI, I've had the intro call for the lab machines. Pretty impressive stuff. I'm working on a summary/howto email for the team, just got a couple of nits to work out with the admin folk about how we grab OS packages, and then we should be solid for getting a seed host up and running :) | 19:55 |
| *** peoplemerge has quit IRC | 19:58 | |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-incubator: Make devtest respect COMPUTESCALE value https://review.openstack.org/70207 | 20:00 |
| greghaynes | SpamapS: Can you let me know if that change ^ is a silly idea :) | 20:00 |
| greghaynes | also, is WIP | 20:00 |
| SpamapS | on second thought lets not go there.. it is a silly place | 20:01 |
| greghaynes | haha | 20:01 |
| *** d0ugal has quit IRC | 20:03 | |
| greghaynes | Know what the plan is for dealing with that whole computescale thing? | 20:03 |
| SpamapS | greghaynes: I think it is a good idea, but I'm not entirely sure that variable is qualified enough.. | 20:03 |
| greghaynes | the computescale var? | 20:04 |
| greghaynes | Its going to be especially fun if it also results in NOTCOMPUTESCALE ;) | 20:04 |
| *** vkozhukalov has quit IRC | 20:10 | |
| greghaynes | Oh, did you mean there should be under/overcloud specific vals? | 20:12 |
| *** lucasagomes has quit IRC | 20:14 | |
| SpamapS | slagle: btw I agree with you that notcompute should go away | 20:15 |
| SpamapS | slagle: it was a goof that I did early on and has somehow stuck around | 20:15 |
| lifeless | Ng: awesome | 20:16 |
| lifeless | Ng: note that the plan is to build images externally | 20:17 |
| Ng | lifeless: road testing my own docs by installing the seed host machine atm :) | 20:17 |
| Ng | lifeless: yeah, I'm covering that (in the sense of how to send a large file to a lab machine) | 20:17 |
| lifeless | wicked sauce | 20:20 |
| slagle | SpamapS: yea, cool :) | 20:20 |
| *** rlandy|bbl is now known as rlandy | 20:24 | |
| *** markmc has joined #tripleo | 20:25 | |
| *** jcooley_ has quit IRC | 20:31 | |
| *** jcooley_ has joined #tripleo | 20:32 | |
| openstackgerrit | Jay Dobies proposed a change to openstack/tuskar: API controllers for icehouse domain model https://review.openstack.org/68716 | 20:36 |
| tzumainn | lifeless, ping | 20:38 |
| lifeless | tzumainn: pong | 20:38 |
| tzumainn | heya, just saw your reply to shadower's email | 20:39 |
| tzumainn | so there's a concern running around in regard to managing flavors within icehouse; there's the suspicion that we don't have the time to iteratively develop and tests that feature in the icehouse timeframe | 20:39 |
| tzumainn | I don't know if you feel like that's a legitimate concern? | 20:41 |
| lifeless | tzumainn: What do you mean by managing flavors? | 20:41 |
| tzumainn | having a UI ready to do as you described in your email | 20:41 |
| lifeless | This is simply setting the Properties.flavor setting in the template; it's not about creating or managing flavors of the cloud we build | 20:41 |
| lifeless | It seems no harder to me to do it in a single global setting than in a per service-definition-or-whatever-we-call-it setting | 20:42 |
| tzumainn | lifeless, so maybe I'm a bit confused about your email - it sounded like you had expected the icehouse iteration to include everything in jarda's wireframes, including the ability to set multiple flavors per service role? | 20:43 |
| lifeless | either way you need to enumerate available flavors, let the user choose one, submit it back to the API | 20:43 |
| lifeless | no | 20:43 |
| lifeless | I'm saying *one* flavor | 20:43 |
| lifeless | the user can define multiple service roles right ? | 20:43 |
| tzumainn | one flavor per service role, or one flavor total? | 20:43 |
| lifeless | per service role | 20:43 |
| lifeless | all the scheduler complexity will turn up when we start doing N>1 flavors per service role | 20:44 |
| *** michchap has joined #tripleo | 20:44 | |
| *** sameer has joined #tripleo | 20:45 | |
| tzumainn | so you're suggesting we allow one flavor per service, and expect nodes to be homogeneous per service? | 20:45 |
| lifeless | yes | 20:46 |
| lifeless | thats what I always meant by homogeneous hardware | 20:47 |
| lifeless | since it is precisely what heat supports today | 20:47 |
| *** CaptTofu has quit IRC | 20:47 | |
| pleia2 | lifeless: not sure if you saw backlog, can you have a look at the cd cloud? been timing out for CI (and me) a lot today, been pretty much unusable | 20:47 |
| pleia2 | even just a nova list: ERROR: HTTPSConnectionPool(host='ci-overcloud.tripleo.org', port=13000): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>: [Errno 110] Connection timed out) | 20:48 |
| lifeless | pleia2: sure; you know there's a whole team of admins though, right ? :) | 20:48 |
| tzumainn | lifeless, okay, thanks for the clarification! | 20:48 |
| pleia2 | none of them seem awake :) | 20:48 |
| lifeless | tzumainn: so specifically,t o support two different sorts of hardware config for hypervisors, one would create two different hypervisor role configurations differing only by chosen flavor | 20:49 |
| *** michchap has quit IRC | 20:49 | |
| lifeless | tzumainn: this imposes an admin overhead (make config changes in multiple places) but requires no plumbing changes. | 20:49 |
| *** bauzas has joined #tripleo | 20:51 | |
| lifeless | it's lost the vlan25 address for some reason | 20:53 |
| lifeless | ah now, it's on br-ex | 20:54 |
| lifeless | pleia2: seems to be working to me now | 20:54 |
| lifeless | I toggled link on eth2 :( | 20:54 |
| *** cd-undercloud has joined #tripleo | 20:54 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 20:54 |
| *** cd-undercloud has quit IRC | 20:54 | |
| lifeless | mellafuckingnox | 20:54 |
| pleia2 | lifeless: yep, looks good, thank you! | 20:54 |
| *** michchap has joined #tripleo | 20:55 | |
| *** michchap has quit IRC | 20:56 | |
| *** michchap has joined #tripleo | 20:56 | |
| *** michchap has quit IRC | 21:01 | |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-incubator: Make devtest respect COMPUTESCALE value https://review.openstack.org/70207 | 21:03 |
| *** coolsvap is now known as coolsvap_away | 21:10 | |
| lifeless | greghaynes: that looks like https://review.openstack.org/#/c/69549/ ? | 21:15 |
| greghaynes | I have to say, the scaling code in heat-templates merge.py is amazing | 21:15 |
| lifeless | greghaynes: do you want to take over https://review.openstack.org/#/c/69549/ ? | 21:15 |
| greghaynes | lifeless: :( | 21:15 |
| greghaynes | lifeless: sure! | 21:15 |
| lifeless | greghaynes: cool, thanks! there's a small outstanding point in review on it which i think you've probably already tackled | 21:15 |
| lifeless | greghaynes: can you compare the two, and if 69549 is obsolete, I'll abandon it | 21:16 |
| greghaynes | Will do, after some lunch | 21:16 |
| greghaynes | lifeless: I do think its obsoleted, sorry about that | 21:18 |
| greghaynes | -> noms | 21:19 |
| lifeless | greghaynes: no worries at all | 21:20 |
| lifeless | greghaynes: some overlap happens when we work closely focused, but its more than made up for by working closely focused | 21:20 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Stop sourcing devtest_undercloud. https://review.openstack.org/69797 | 21:21 |
| *** rlandy has quit IRC | 21:22 | |
| *** lblanchard has quit IRC | 21:22 | |
| *** julim has quit IRC | 21:26 | |
| slagle | lifeless: whenever you have a moment...would appreciate your feedback to my last comment on https://review.openstack.org/#/c/70023/ | 21:26 |
| *** epim has joined #tripleo | 21:26 | |
| slagle | or anyone else :) | 21:26 |
| lifeless | slagle: looking | 21:27 |
| *** panda__ has joined #tripleo | 21:27 | |
| lifeless | slagle: commented | 21:29 |
| lifeless | slagle: that file you mention doesn't need to be changed; do you have any other examples? | 21:30 |
| *** panda_ has quit IRC | 21:30 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Fix exit status of haproxy install script https://review.openstack.org/69716 | 21:30 |
| *** jcooley_ has quit IRC | 21:32 | |
| slagle | lifeless: well, it is getting used. i guess there's some other config that causing it to get used? | 21:32 |
| *** jcooley_ has joined #tripleo | 21:32 | |
| slagle | b/c i get a backtrace if the path is wrong | 21:32 |
| lifeless | slagle: do you have file injection turned off ? | 21:32 |
| lifeless | slagle: is it on the seed that you see that? | 21:33 |
| slagle | lifeless: no, on the undercloud | 21:34 |
| slagle | i have use_file_injection=False in nova.conf. It's the same nova.conf as always | 21:34 |
| slagle | maybe older nova code from the packages perhaps | 21:34 |
| *** panda_ has joined #tripleo | 21:36 | |
| lifeless | slagle: may be | 21:36 |
| lifeless | slagle: or a bug | 21:36 |
| lifeless | slagle: anyhow, the default is $pybasedir/nova/virt/baremetal/net-dhcp.ubuntu.template | 21:36 |
| lifeless | which will look it up from the codepath | 21:37 |
| lifeless | unless the package is breaking things | 21:37 |
| lifeless | if the package is installing to other than pybasedir, the package should patch the code | 21:37 |
| lifeless | to make the default be where it's installing it. | 21:37 |
| lifeless | otherwise the package is broken :) | 21:37 |
| *** panda__ has quit IRC | 21:38 | |
| slagle | it's at $pybasedir/nova/virt/baremetal/net-static.ubuntu.template | 21:39 |
| slagle | static though, not dhcp | 21:39 |
| slagle | i guess the point is though that we can remove this line entirely from our templated nova.conf? | 21:39 |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Moving iptables rules to the relevant elements https://review.openstack.org/68075 | 21:41 |
| *** dougalmatthews has joined #tripleo | 21:46 | |
| *** dougalmatthews has quit IRC | 21:47 | |
| *** d0ugal has joined #tripleo | 21:48 | |
| *** d0ugal has quit IRC | 21:48 | |
| *** d0ugal has joined #tripleo | 21:48 | |
| *** d0ugal has joined #tripleo | 21:49 | |
| *** d0ugal has joined #tripleo | 21:49 | |
| lifeless | slagle: yes, no reason that its there at all | 21:52 |
| lifeless | allow me | 21:52 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Disable libvirt file injection. https://review.openstack.org/69280 | 21:53 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Source devtest_variables in tripleo-cd. https://review.openstack.org/69279 | 21:53 |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Source devtest_variables in tripleo-cd. https://review.openstack.org/69279 | 21:54 |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Disable libvirt file injection. https://review.openstack.org/69280 | 21:55 |
| SpamapS | lifeless: hah, I +2/+A'd before realizing you already +A'd | 21:56 |
| *** michchap has joined #tripleo | 21:57 | |
| *** d0ugal has quit IRC | 21:57 | |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Delete stale file injection option. https://review.openstack.org/70226 | 21:58 |
| *** jcooley_ has quit IRC | 21:58 | |
| *** rlandy has joined #tripleo | 21:59 | |
| lifeless | Ng: wicked | 22:01 |
| Ng | lifeless: yes, today has been 100% success and the lab guys are being super super helpful :D | 22:01 |
| *** michchap has quit IRC | 22:01 | |
| lifeless | slagle: I am right, aren't I - the seed is neutron based now? | 22:02 |
| *** jprovazn is now known as jprovazn_afk | 22:02 | |
| lifeless | ah yes - | 22:02 |
| slagle | yes. afaik. | 22:02 |
| lifeless | neutron-dhcp-agent | 22:02 |
| *** jdob has quit IRC | 22:04 | |
| lifeless | greghaynes: glad you like the scaling code; it's a little narrow, but it was fun writing it | 22:04 |
| greghaynes | hehe. Wondering if were just putting off templating out the heat yml? | 22:05 |
| greghaynes | or is there some other solution in mind | 22:05 |
| SpamapS | lifeless: I've been thinking about the scaling code... I wonder if we shouldn't tack uuids/random strings onto the names... | 22:05 |
| SpamapS | lifeless: I mean instead of the integer ids | 22:05 |
| greghaynes | Why not $templating the heat template yml file? | 22:06 |
| SpamapS | lifeless: because the way it works now.. we have no way to scale down and up. | 22:06 |
| lifeless | SpamapS: if you do that, what would happen when you update-stack with a different scale ? | 22:06 |
| SpamapS | lifeless: so in addition to that, you have to also make it inspect an existing template for policy correctness.. | 22:06 |
| lifeless | SpamapS: I don't follow | 22:06 |
| SpamapS | lifeless: the number you pass to merge.py is "how many I want in X class" | 22:07 |
| *** cd-undercloud has joined #tripleo | 22:07 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 22:07 |
| *** cd-undercloud has quit IRC | 22:07 | |
| lifeless | greghaynes: so the thing is that this is a templatish - but its a graph transformation, not a text macro problem | 22:07 |
| SpamapS | lifeless: so for updates to work, we need to inspect the existing template, and compare it to the requested policy of "I want Y nodes in X class" .. | 22:07 |
| lifeless | SpamapS: why? | 22:08 |
| SpamapS | lifeless: because scaling down we have to choose one to delete. | 22:08 |
| lifeless | SpamapS: why do we? | 22:08 |
| lifeless | SpamapS: doesn't heat shoot one in the head? | 22:08 |
| SpamapS | lifeless: or accept that we are going to terminate the highest number, always. | 22:08 |
| SpamapS | lifeless: the way we're doing it, Heat will shoot one in the heat if one is deleted from the template. | 22:08 |
| lifeless | SpamapS: right, thats expected until your notify-from-heat work is done | 22:09 |
| lifeless | [did you see what I did there] | 22:09 |
| SpamapS | that only covers "i just want one back" | 22:09 |
| lifeless | SpamapS: how is that different? | 22:09 |
| SpamapS | that does not cover "one is totally broken" | 22:09 |
| lifeless | SpamapS: how would uuids help with that? Other than making every update redeploy everything ? | 22:10 |
| * Ng ejects for some sleeping | 22:10 | |
| SpamapS | lifeless: the uuids wouldn't be changed for existing templates. | 22:10 |
| lifeless | SpamapS: so if they aren't changed, how does it help? | 22:10 |
| SpamapS | lifeless: scaling would add nodes, and if you went below it would refuse to delete nodes and tell you to pick one manually. | 22:11 |
| lifeless | constant value is constant value | 22:11 |
| lifeless | SpamapS: I still don't get it | 22:11 |
| SpamapS | Its ok | 22:11 |
| lifeless | SpamapS: here is whats in my head | 22:11 |
| lifeless | tell me what I have wrong | 22:11 |
| SpamapS | I'm really foggy today.. stupid muscle relaxers. | 22:11 |
| lifeless | machine X breaks | 22:11 |
| lifeless | we nova delete the instance | 22:11 |
| lifeless | heat notices the instance is gone (automatically? manually?) and spins up another to replace it (or runs out of machines and goes to _FAILED) | 22:12 |
| SpamapS | notices? | 22:13 |
| SpamapS | no | 22:13 |
| SpamapS | it never knows | 22:13 |
| lifeless | if we ran out of machines, we update with a smaller template, and it has two divergences from reality | 22:13 |
| SpamapS | we have to write that code for Heat | 22:13 |
| SpamapS | Currently Heat _only_ acts on the template. | 22:13 |
| lifeless | it has the end of the vector as one gone from the new template | 22:13 |
| SpamapS | So if the template says it should be there, Heat thinks it is there. | 22:13 |
| lifeless | and it has a hole in the vector of the failed and not-redeployed machine | 22:13 |
| lifeless | so it deletes the end one and deploys a new one | 22:14 |
| lifeless | SpamapS: isn't this 'convergence' ? | 22:14 |
| lifeless | SpamapS: also - I have a spec for diong it automatically, but that can wait | 22:14 |
| SpamapS | Yes, work you've stated is not as important as rolling updates. :) | 22:14 |
| lifeless | right, so rolling updates doesn't get us everything | 22:14 |
| lifeless | but it gets us a lot of stuff | 22:14 |
| lifeless | so, IIUC - you're saying it would make some manual stuff more possible today if we had some way of not including specific resources in the output template | 22:15 |
| SpamapS | Yeah, I'm working on resolving hot-software-config with the rolling updates story | 22:15 |
| lifeless | and one way to do that is UUIDs + template diffing | 22:15 |
| lifeless | if I can suggest another way | 22:15 |
| SpamapS | I think some of the things hot-software-config does will translate into an easier implementation for rolling updates | 22:15 |
| lifeless | what about naming the scaled units to skip | 22:15 |
| lifeless | e.g. merge --scale=NovaCompute=10 --skip-scale=NovaCompute=1,3,5 | 22:16 |
| lifeless | would output 0,2,4,6,7,8,9,10,11,12 | 22:16 |
| SpamapS | yeah that is kind of what I was thinking is the alternative. | 22:16 |
| lifeless | no diff needed | 22:16 |
| SpamapS | well.. that _is_ a diff :) | 22:16 |
| SpamapS | but.. a very simple one that is sufficient | 22:16 |
| lifeless | human can look at the current thing, pick a number and plug it in | 22:16 |
| *** epim has quit IRC | 22:17 | |
| lifeless | ture | 22:17 |
| lifeless | true | 22:17 |
| SpamapS | lifeless: ok will put it on the backburner... ideally this all happens inside Heat anyway. :) | 22:17 |
| SpamapS | lifeless: If we can get Heat to just check for already-deleted servers before scaling down, then we can use the instance group already I think (and just manually nova delete servers that we really do want dead) | 22:18 |
| lifeless | that would be much simpler | 22:19 |
| lifeless | though | 22:19 |
| lifeless | the issue is that we're not using scaling groups | 22:19 |
| lifeless | and so we've named resources | 22:19 |
| SpamapS | I think I already filed a bug and got ACK's from others about doing it that way btw. | 22:19 |
| *** rlandy has quit IRC | 22:20 | |
| SpamapS | I think the only reason we're not using scaling groups is the problem we've just been discussing. | 22:20 |
| lifeless | but I think a little API script could return the template change needed to cope with a deleted server | 22:20 |
| SpamapS | (well that and no per-server creds, but we're not doing that anyway.. so..) | 22:20 |
| lifeless | we're closer now with merge.py getting useful :) | 22:20 |
| SpamapS | yeah | 22:20 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Remove file injection config option. https://review.openstack.org/70230 | 22:21 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Update overcloud to support N compute hosts. https://review.openstack.org/69548 | 22:21 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Prep work for a scalable control plane. https://review.openstack.org/69758 | 22:21 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Remove file injection config option. https://review.openstack.org/70230 | 22:23 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Update overcloud to support N compute hosts. https://review.openstack.org/69548 | 22:23 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Prep work for a scalable control plane. https://review.openstack.org/69758 | 22:23 |
| lifeless | slagle: can I get a +2+A on https://review.openstack.org/69548 ? comment added per request | 22:23 |
| lifeless | slagle: or I can do an echo, but I don't believe anyone will see it :)( | 22:23 |
| *** panda_ has quit IRC | 22:26 | |
| SpamapS | lifeless: What do you think about using this opportunity to change 'notcompute' to 'controller' ? | 22:28 |
| SpamapS | lifeless: I really dislike the notcompute name. Total goof that just has stuck around. | 22:29 |
| *** panda_ has joined #tripleo | 22:29 | |
| lifeless | SpamapS: I reckon if you want to take over my patch that would be wicjed | 22:30 |
| lifeless | SpamapS: or you could do it as a patch after | 22:30 |
| lifeless | SpamapS: but it was tedious getting this far :> | 22:30 |
| *** cadenzajon has quit IRC | 22:32 | |
| SpamapS | lifeless: Yeah I think after will be better | 22:32 |
| openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Update overcloud to support N compute hosts. https://review.openstack.org/69548 | 22:36 |
| slagle | lifeless: ^ | 22:36 |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-incubator: Make devtest use COMPUTESCALE for overcloud https://review.openstack.org/70207 | 22:37 |
| openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Prep work for a scalable control plane. https://review.openstack.org/69758 | 22:39 |
| openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Remove file injection config option. https://review.openstack.org/70230 | 22:40 |
| *** michchap has joined #tripleo | 22:41 | |
| bnemec | Anybody booted a new seed vm lately? | 22:42 |
| bnemec | I'm seeing a Heat db error due to https://github.com/openstack/heat/commit/8edfb48d34619c72502dcfc670392cd5b1ff0305 | 22:42 |
| bnemec | When I run heat-manage db_sync I get 'ERROR: Tables "migrate_version" have non utf8 collation, please make sure all tables are CHARSET=utf8' | 22:42 |
| lifeless | slagle: \o/ | 22:43 |
| lifeless | bnemec: I haven't, no. But lets see what jenkins thinks | 22:44 |
| bnemec | Heh, that's right. We have CI now. :-) | 22:45 |
| openstackgerrit | Jan Provaznik proposed a change to openstack/tripleo-image-elements: Fix rabbitmq env file name and log path https://review.openstack.org/70236 | 22:47 |
| openstackgerrit | Jan Provaznik proposed a change to openstack/tripleo-image-elements: Update openstack config files to support rabbitmq cluster https://review.openstack.org/68393 | 22:47 |
| openstackgerrit | Jan Provaznik proposed a change to openstack/tripleo-image-elements: Add cluster support for rabbitmq element https://review.openstack.org/68392 | 22:47 |
| bnemec | Oh, but that only deploys the seed, which works fine. It's trying to use Heat on the seed that fails for me. | 22:47 |
| *** markmc has quit IRC | 22:50 | |
| openstackgerrit | Jan Provaznik proposed a change to openstack/tripleo-heat-templates: Add rabbit.cookie attribute https://review.openstack.org/70238 | 22:52 |
| lifeless | bnemec: but if the migration is failing | 23:01 |
| lifeless | bnemec: that should be picked up during deploy, no ? | 23:01 |
| lifeless | bnemec: if now, thats a bug :( | 23:01 |
| lifeless | deploy of the seed I mean | 23:01 |
| *** jprovazn_afk has quit IRC | 23:01 | |
| lifeless | ... oh but we don't have a waitcondition on it to tell. Nuts | 23:02 |
| bnemec | Yeah, it wasn't caught for me. | 23:02 |
| bnemec | But when I log in to the seed heat-engine is dead, and restarting it complains about missing tables. | 23:02 |
| lifeless | can you check the os-collect-config log | 23:02 |
| lifeless | does it complete, or bail ? | 23:02 |
| bnemec | It completed, but I see the error in the log: http://paste.openstack.org/show/62204/ | 23:05 |
| lifeless | bnemec: so can you use this as an opportunity to make us more robust? make the error visible to o-r-c so that it stops | 23:07 |
| lifeless | bnemec: I presume this means we're totally hosed right now, so we also need a fix | 23:07 |
| * lifeless blames angus :) | 23:07 | |
| bnemec | lifeless: Sure, I'll see what I can do. | 23:07 |
| lifeless | bnemec: it might be something as simple as a missing set -e somewhere | 23:08 |
| lifeless | SpamapS: hey, mr mysql. | 23:08 |
| *** jayg is now known as jayg|g0n3 | 23:08 | |
| bnemec | Yeah, I think set -e on https://github.com/openstack/tripleo-image-elements/blob/master/elements/heat-api/os-refresh-config/post-configure.d/79-heat-api would do the trick. | 23:09 |
| bnemec | Should we be enforcing set -e on element scripts somehow? | 23:09 |
| bnemec | Seems like we would always want to bail on errors. | 23:10 |
| *** sameer has quit IRC | 23:12 | |
| *** matty_dubs is now known as matty_dubs|gone | 23:18 | |
| *** cd-undercloud has joined #tripleo | 23:19 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 23:19 |
| *** cd-undercloud has quit IRC | 23:19 | |
| SpamapS | db_sync is broken? | 23:19 |
| lifeless | bnemec: that script might catch it | 23:20 |
| lifeless | bnemec: but why didn't the db migration script catch it ? | 23:20 |
| lifeless | bnemec: seems like the error should be caught closer to the source? | 23:20 |
| lifeless | SpamapS: yes, non UTF8 collations | 23:20 |
| SpamapS | lifeless: the db migration script _did_ catch it.. but orc doesn't care if bash doesn't care ;) | 23:20 |
| SpamapS | or.. is there something else I'm missing? | 23:21 |
| SpamapS | how are we ending up with non UTF8 collations btw? It hought we handled this.. though I'm forgetting how exactly. | 23:23 |
| lifeless | SpamapS: heat just landed the check to barf if a table is wrong | 23:24 |
| lifeless | SpamapS: and its barfing | 23:24 |
| SpamapS | oh we never did actually actively fix it | 23:24 |
| SpamapS | ok so my experience with this sort of problem in MySQL tells me to hit it with many hammers and be explicit about charset everywhere | 23:26 |
| SpamapS | so, we should probably set all of our database urls to include ?charset=utf8 | 23:27 |
| SpamapS | and have the mysql my.cnf file specify utf8 | 23:27 |
| SpamapS | for client and server | 23:27 |
| bnemec | So yeah, heat-manage is catching the error and exiting with a non-zero return value, so I think it's doing the right thing. | 23:28 |
| bnemec | I guess that script just needs to be set -e and a fix found for the error itself. | 23:28 |
| SpamapS | ah ok we don't have to get so weird on clients anymore. .they added character-set-client-handshake = FALSE now | 23:30 |
| openstackgerrit | Ben Nemec proposed a change to openstack/tripleo-image-elements: Add set -e to heat-api script https://review.openstack.org/70255 | 23:31 |
| lifeless | bbiab | 23:32 |
| openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Force UTF-8 charset and collation for MySQL https://review.openstack.org/70256 | 23:33 |
| lifeless | bnemec: *oh* heat-API runs the migration. Thats super odd | 23:33 |
| SpamapS | lifeless: ^^ should correct the issue | 23:33 |
| lifeless | I would have expected it to be in heat-engine. | 23:33 |
| bnemec | Yeah, me too. | 23:33 |
| SpamapS | lifeless: I would expect engine too. I think that is a bug. | 23:33 |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Force UTF-8 charset and collation for MySQL https://review.openstack.org/70256 | 23:34 |
| SpamapS | lifeless: btw, as we go HA.. how are we going to coalesce things like db_syncs that only have to happen once. Have thoughts already? | 23:34 |
| *** cwolferh has quit IRC | 23:34 | |
| lifeless | SpamapS: make them idempotent ? | 23:36 |
| lifeless | SpamapS: and file bugs if they aren't :> | 23:36 |
| *** ftcjeff has quit IRC | 23:36 | |
| SpamapS | heh | 23:36 |
| SpamapS | most of them select the version and then start mutating things immediately | 23:37 |
| SpamapS | a lot of the things they do will silently commit a transaction too. | 23:37 |
| SpamapS | so we'd need a "lock migrations" functionality.. probably have to add it to all of them. | 23:37 |
| SpamapS | oh yay, of course, it has been 5 days.. new saucy images. :-P | 23:39 |
| *** CaptTofu has joined #tripleo | 23:40 | |
| bnemec | "saucy images" means a whole different kind of thing to Linux users than it does to everyone else. ;-) | 23:40 |
| SpamapS | hey now :) | 23:41 |
| SpamapS | we really need trusty images :) | 23:41 |
| bnemec | :-) | 23:42 |
| *** cd-undercloud has joined #tripleo | 23:43 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 23:43 |
| *** cd-undercloud has quit IRC | 23:43 | |
| *** cody-somerville has joined #tripleo | 23:47 | |
| *** bauzas has quit IRC | 23:51 | |
| bnemec | lifeless: For https://review.openstack.org/#/c/70255/ would you prefer to just move it to heat-engine? I do think it belongs there. | 23:51 |
| bnemec | (I have a new patch set ready to go, but if you'd prefer I can push it as a separate change) | 23:51 |
| openstackgerrit | Ben Nemec proposed a change to openstack/tripleo-image-elements: Move heat-manage call to heat-engine https://review.openstack.org/70255 | 23:54 |
| * bnemec & | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!