| SpamapS | lifeless: I used 42 to make it obvious ;) | 00:00 |
|---|---|---|
| *** rongze has quit IRC | 00:00 | |
| *** jcooley_ has joined #tripleo | 00:01 | |
| SpamapS | woot status=0 :) | 00:05 |
| *** jcooley_ has quit IRC | 00:06 | |
| *** epim has quit IRC | 00:07 | |
| lifeless | SpamapS: yeah :) | 00:07 |
| *** w_ has joined #tripleo | 00:07 | |
| lifeless | so we should upgrade from using nova directly | 00:08 |
| lifeless | to using heat | 00:08 |
| lifeless | get more coverage | 00:08 |
| SpamapS | lifeless: agreed | 00:08 |
| *** toci-bot has joined #tripleo | 00:10 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_2zplIO5/ | 00:10 |
| *** toci-bot has quit IRC | 00:10 | |
| *** olaph has quit IRC | 00:10 | |
| *** matsuhashi has joined #tripleo | 00:12 | |
| SpamapS | TOCI: Server returned an unexpected response code. [504] | 00:17 |
| SpamapS | seems like that has boned toci quite a few times | 00:17 |
| *** epim has joined #tripleo | 00:19 | |
| lifeless | what a boner | 00:22 |
| *** cd-undercloud has joined #tripleo | 00:46 | |
| cd-undercloud | ************** overcloud complete status=42 ************ | 00:46 |
| *** cd-undercloud has quit IRC | 00:46 | |
| SpamapS | 42 again. :( | 00:52 |
| *** CaptTofu has quit IRC | 01:03 | |
| *** CaptTofu has joined #tripleo | 01:07 | |
| *** nosnos has joined #tripleo | 01:20 | |
| *** rongze has joined #tripleo | 01:26 | |
| *** rongze has quit IRC | 01:31 | |
| *** matsuhashi has quit IRC | 01:34 | |
| *** cd-undercloud has joined #tripleo | 01:35 | |
| cd-undercloud | ************** overcloud complete status=255 ************ | 01:35 |
| *** cd-undercloud has quit IRC | 01:35 | |
| lifeless | SpamapS: not 42 :P | 01:35 |
| *** arata has joined #tripleo | 01:39 | |
| *** matsuhashi has joined #tripleo | 01:51 | |
| *** UtahDave has quit IRC | 01:52 | |
| *** rongze has joined #tripleo | 02:09 | |
| *** arata has quit IRC | 02:12 | |
| *** michchap has quit IRC | 02:18 | |
| *** toci-bot has joined #tripleo | 02:19 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_nJz31Ci/ | 02:20 |
| *** toci-bot has quit IRC | 02:20 | |
| *** cd-undercloud has joined #tripleo | 02:22 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 02:22 |
| *** cd-undercloud has quit IRC | 02:22 | |
| cody-somerville | Is it just me or is OpenVPN to HP Corp slow slow slow today? | 02:35 |
| cody-somerville | ah, I'm seeing packet loss. | 02:36 |
| lifeless | oh look, we deployed. booyah. | 02:38 |
| *** epim has quit IRC | 02:51 | |
| *** matsuhashi has quit IRC | 03:00 | |
| *** rushiagr has joined #tripleo | 03:10 | |
| *** cd-undercloud has joined #tripleo | 03:13 | |
| cd-undercloud | ************** overcloud complete status=42 ************ | 03:13 |
| *** cd-undercloud has quit IRC | 03:13 | |
| *** rushiagr has quit IRC | 03:19 | |
| *** arata has joined #tripleo | 03:27 | |
| *** vkozhukalov has joined #tripleo | 03:55 | |
| *** arata has left #tripleo | 03:57 | |
| *** cd-undercloud has joined #tripleo | 04:04 | |
| cd-undercloud | ************** overcloud complete status=42 ************ | 04:04 |
| *** cd-undercloud has quit IRC | 04:04 | |
| *** toci-bot has joined #tripleo | 04:18 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_M4IcgZk/ | 04:18 |
| *** toci-bot has quit IRC | 04:18 | |
| SpamapS | lifeless: status=255 was "ssh: connect to host 138.35.77.4 port 22: Connection refused^M | 04:21 |
| SpamapS | which is... weird | 04:22 |
| *** rushiagr has joined #tripleo | 04:23 | |
| *** matsuhashi has joined #tripleo | 04:23 | |
| *** jcooley_ has joined #tripleo | 04:30 | |
| *** vkozhukalov has quit IRC | 04:42 | |
| *** rongze has quit IRC | 04:48 | |
| *** cd-undercloud has joined #tripleo | 04:54 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 04:54 |
| *** cd-undercloud has quit IRC | 04:54 | |
| lifeless | zomg | 04:54 |
| lifeless | again | 04:54 |
| lifeless | it works | 04:55 |
| lifeless | muhahahahahaha | 04:55 |
| *** vkozhukalov has joined #tripleo | 04:55 | |
| SpamapS | lifeless: seems like we definitely need to attack that neutron bug | 04:55 |
| *** rpodolyaka1 has joined #tripleo | 05:17 | |
| *** rongze has joined #tripleo | 05:18 | |
| *** rongze has quit IRC | 05:27 | |
| *** michchap has joined #tripleo | 05:34 | |
| *** rpodolyaka1 has quit IRC | 05:43 | |
| *** cd-undercloud has joined #tripleo | 05:47 | |
| cd-undercloud | ************** overcloud complete status=42 ************ | 05:47 |
| *** cd-undercloud has quit IRC | 05:47 | |
| *** akuznetsov has quit IRC | 05:49 | |
| *** vipul is now known as vipul-away | 05:52 | |
| *** w_ has quit IRC | 05:57 | |
| *** akuznetsov has joined #tripleo | 05:58 | |
| *** jcooley_ has quit IRC | 05:59 | |
| *** jcooley_ has joined #tripleo | 05:59 | |
| *** vipul-away is now known as vipul | 06:01 | |
| *** jcooley_ has quit IRC | 06:05 | |
| *** vkozhukalov has quit IRC | 06:09 | |
| *** w_ has joined #tripleo | 06:09 | |
| *** CaptTofu has quit IRC | 06:11 | |
| *** CaptTofu has joined #tripleo | 06:12 | |
| *** rongze has joined #tripleo | 06:13 | |
| *** toci-bot has joined #tripleo | 06:14 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_Sjna9k5/ | 06:14 |
| *** toci-bot has quit IRC | 06:14 | |
| *** ifarkas has joined #tripleo | 06:22 | |
| *** boris-42 has joined #tripleo | 06:30 | |
| *** nosnos_ has joined #tripleo | 06:30 | |
| *** nosnos has quit IRC | 06:34 | |
| *** Guest72480 is now known as ohadlevy | 06:36 | |
| *** ohadlevy has quit IRC | 06:36 | |
| *** ohadlevy has joined #tripleo | 06:36 | |
| *** cd-undercloud has joined #tripleo | 06:37 | |
| cd-undercloud | ************** overcloud complete status=42 ************ | 06:37 |
| *** cd-undercloud has quit IRC | 06:37 | |
| *** w_ has quit IRC | 06:45 | |
| *** olaph has joined #tripleo | 07:00 | |
| *** matsuhashi has quit IRC | 07:05 | |
| *** matsuhashi has joined #tripleo | 07:05 | |
| *** rdopieralski has joined #tripleo | 07:13 | |
| *** lsmola has joined #tripleo | 07:15 | |
| *** nosnos_ has quit IRC | 07:20 | |
| *** nosnos has joined #tripleo | 07:21 | |
| *** pblaho has joined #tripleo | 07:24 | |
| *** cd-undercloud has joined #tripleo | 07:27 | |
| cd-undercloud | ************** overcloud complete status=42 ************ | 07:27 |
| *** cd-undercloud has quit IRC | 07:27 | |
| *** jprovazn has joined #tripleo | 07:50 | |
| *** vipul is now known as vipul-away | 07:51 | |
| *** akuznetsov has quit IRC | 07:52 | |
| *** boris-42 has quit IRC | 07:59 | |
| openstackgerrit | Jun Jie Nan proposed a change to openstack/os-collect-config: Fix typo error in README.rst https://review.openstack.org/58691 | 08:01 |
| *** matsuhashi has quit IRC | 08:01 | |
| *** matsuhashi has joined #tripleo | 08:03 | |
| *** vipul-away is now known as vipul | 08:06 | |
| *** jistr has joined #tripleo | 08:07 | |
| *** toci-bot has joined #tripleo | 08:13 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_AGzPJKn/ | 08:13 |
| *** toci-bot has quit IRC | 08:13 | |
| *** marun has quit IRC | 08:18 | |
| *** vkozhukalov has joined #tripleo | 08:18 | |
| *** cd-undercloud has joined #tripleo | 08:19 | |
| cd-undercloud | ************** overcloud complete status=42 ************ | 08:19 |
| *** cd-undercloud has quit IRC | 08:19 | |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: Add DEPLOY_IMAGE_ELEMENT to tripleorc. https://review.openstack.org/58626 | 08:21 |
| *** akuznetsov has joined #tripleo | 08:21 | |
| openstackgerrit | Jun Jie Nan proposed a change to openstack/os-collect-config: Fix typo error in README.rst https://review.openstack.org/58691 | 08:26 |
| *** martyntaylor has joined #tripleo | 08:42 | |
| rpodolyaka | morning | 08:55 |
| Ng | morning | 09:01 |
| * Ng dives into a call | 09:01 | |
| *** vkozhukalov has quit IRC | 09:02 | |
| *** markmc has joined #tripleo | 09:02 | |
| *** jistr has quit IRC | 09:02 | |
| *** jcoufal has joined #tripleo | 09:05 | |
| *** derekh has joined #tripleo | 09:05 | |
| GheRivero | morning all | 09:06 |
| derekh | good morning | 09:06 |
| *** akuznetsov has quit IRC | 09:06 | |
| *** akuznetsov has joined #tripleo | 09:07 | |
| *** cd-undercloud has joined #tripleo | 09:08 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 09:08 |
| *** cd-undercloud has quit IRC | 09:08 | |
| lifeless | night y'all | 09:10 |
| rpodolyaka | night :) | 09:11 |
| rpodolyaka | overcloud complete status=42, nice, so here is the Answer | 09:12 |
| *** vkozhukalov has joined #tripleo | 09:17 | |
| ogelbukh | btw, is there a list of that status meanings? ) | 09:18 |
| ogelbukh | or they're meaningless? | 09:19 |
| derekh | ogelbukh: the majority of the exit codes will come from the command that error-ed, but I think I saw 42 explitly added over the last couple of days, one sec | 09:21 |
| derekh | ogelbukh: https://github.com/openstack/tripleo-incubator/blob/master/scripts/devtest_overcloud.sh#L216 | 09:22 |
| ogelbukh | got it ) | 09:22 |
| ogelbukh | thanks | 09:22 |
| ogelbukh | looking through the devtest_*.sh | 09:22 |
| rpodolyaka | ohh, so it's neutron policies bug | 09:22 |
| rpodolyaka | afair | 09:23 |
| derekh | Is the seed VM also busted ? | 09:23 |
| rpodolyaka | do you mean tripleo-cd cloud? or devtest story in general? | 09:25 |
| derekh | rpodolyaka: devtest in general | 09:26 |
| rpodolyaka | derekh: haven't tried today yet, going to run devtest.sh | 09:26 |
| derekh | as far as I can see the seed is throwing errors when the undercloud tries to get metadata | 09:28 |
| *** pblaho has quit IRC | 09:28 | |
| *** jistr has joined #tripleo | 09:34 | |
| *** lucasagomes has joined #tripleo | 09:37 | |
| openstackgerrit | Jun Jie Nan proposed a change to openstack/diskimage-builder: Enhance dib-run-parts usage message https://review.openstack.org/58704 | 09:41 |
| openstackgerrit | Jun Jie Nan proposed a change to openstack/diskimage-builder: Enhance dib-run-parts usage message https://review.openstack.org/58704 | 09:42 |
| markmc | derekh, is anything using the tripleo-cd element on fedora yet? | 09:47 |
| derekh | markmc: nope, not yet | 09:48 |
| markmc | derekh, ok, that explains it :) | 09:48 |
| * derekh is trying to figure out what mark might be looking at | 09:49 | |
| openstackgerrit | Mark McLoughlin proposed a change to openstack/tripleo-image-elements: Fix typo with tripleo-cd systemd unit https://review.openstack.org/58706 | 09:50 |
| *** matsuhashi has quit IRC | 09:51 | |
| derekh | markmc: hmm, yup that would be a problem | 09:51 |
| * markmc was just grepping around for os-collect-config stuff | 09:52 | |
| *** pblaho has joined #tripleo | 09:52 | |
| shadower | markmc: that'll take ages to review and test -- don't get your hopes up | 09:53 |
| *** matsuhas_ has joined #tripleo | 09:55 | |
| derekh | Unfortunatly if you tested it you'd find another problem (not with the patch but with the current systemd unit file) | 09:55 |
| *** max_lobur_afk is now known as max_lobur | 09:55 | |
| derekh | markmc: want to fix another typo in that patch? or will I follow up with another patch? | 09:56 |
| markmc | derekh, whichever, I'm fine either way | 09:56 |
| shadower | what typo? | 09:57 |
| * shadower needs to get his eyes checked | 09:57 | |
| derekh | markmc: shadower details added | 09:57 |
| shadower | ah | 09:57 |
| openstackgerrit | Mark McLoughlin proposed a change to openstack/tripleo-image-elements: Fix typo with tripleo-cd systemd unit https://review.openstack.org/58706 | 09:58 |
| markmc | derekh, thanks, I wondered about that | 09:58 |
| derekh | markmc: np | 09:59 |
| *** cd-undercloud has joined #tripleo | 09:59 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 09:59 |
| *** cd-undercloud has quit IRC | 09:59 | |
| rpodolyaka | derekh: ok ,so seed vm is broken for me, but in a different way "Conflict occurred attempting to store user. (1054, "Unknown column 'default_project_id' in 'field list'") (HTTP 409)" | 09:59 |
| derekh | rpodolyaka: havn't seen that yet (havn't run it since last night), running it now | 10:00 |
| *** jtomasek has joined #tripleo | 10:00 | |
| markmc | the run I just did got stuck at: | 10:01 |
| markmc | Waiting for cloud-init to configure/restart sshd | 10:01 |
| markmc | ... | 10:01 |
| markmc | Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). | 10:01 |
| markmc | Timing out - last probe output: | 10:01 |
| markmc | haven't started debugging yet | 10:01 |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Fix typo with tripleo-cd systemd unit https://review.openstack.org/58706 | 10:02 |
| derekh | markmc: was that for the undercloud ? | 10:02 |
| markmc | derekh, yeah, sorry | 10:02 |
| markmc | derekh, how do you start debugging at this point without a tripleorc ? | 10:02 |
| derekh | markmc: if its the same thing I was trying to figure out last night you'll see authentication errors on the nova-api (seed), | 10:02 |
| derekh | markmc: each time the undercloud tries to get metadata | 10:02 |
| derekh | markmc: you can ssh to the undercloud as the user stack | 10:03 |
| markmc | derekh, manually figure out $UNDERCLOUD_IP ? | 10:04 |
| derekh | markmc: ssh to seed | 10:04 |
| derekh | source /root/stackrc | 10:04 |
| derekh | then nova list | 10:04 |
| markmc | derekh, manually figure out $SEED_IP ? :) | 10:04 |
| derekh | 192.0.2.1 | 10:04 |
| markmc | my previous $SEED_IP was | 10:05 |
| markmc | export SEED_IP="192.168.122.159" | 10:05 |
| Ng | scripts/get-vm-ip seed | 10:05 |
| markmc | thanks, yeah | 10:05 |
| Ng | this chain of figuring out IPs manually makes me so crazy, maybe today is the day I need to make a tool for it | 10:06 |
| markmc | I guess I'm just grumbling that I'd like me a tripleorc now please :) | 10:06 |
| Ng | markmc: so I previously had a patch that wrote out a tripleorc after each relevant success, so you'd always have one with at least the data for bits that worked, but it was not viewed favourably | 10:06 |
| Ng | I believe the preference was for a tool that could just introspect what was running, to figure out the same | 10:07 |
| *** akuznetsov has quit IRC | 10:07 | |
| markmc | perfect is the enemy of good :) | 10:07 |
| *** matsuhas_ has quit IRC | 10:11 | |
| *** matsuhashi has joined #tripleo | 10:11 | |
| markmc | googling that has now lead me to learn that an informal fallacy is a type of false dichotomy | 10:11 |
| markmc | that was a couple of minutes well spent | 10:11 |
| markmc | wait, no | 10:11 |
| markmc | a false dichotomy is a type of informal fallacy | 10:12 |
| markmc | doh | 10:12 |
| *** toci-bot has joined #tripleo | 10:13 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_GaXwL6y/ | 10:13 |
| *** toci-bot has quit IRC | 10:13 | |
| marios | markmc: hey mark have a sec re https://review.openstack.org/#/c/56947/4 | 10:14 |
| markmc | marios, sure | 10:14 |
| derekh | Tcoi seems to be hitting the same issue I am | 10:15 |
| derekh | *toci | 10:15 |
| marios | markmc: so everything you're saying is ofcourse correct. I'm just not sure we are passed the 'its worth it' threshold since we all seem to agree merge.py will be moved into heat (or at least the functionality we need) | 10:15 |
| markmc | marios, it's a bit hand-wavey for my liking, given the minimal effort required to make this a library | 10:16 |
| markmc | marios, got a link to the heat blueprint? curious about ETA | 10:16 |
| markmc | marios, I can take a look at librarification if you like | 10:17 |
| marios | markmc: yes so i looked into packaging a bit. its easy enough to setup the setup.py for distutils | 10:17 |
| marios | markmc: but it means maintaining it. my main concern is the templates, we send reviews for those often. | 10:17 |
| markmc | marios, the way we manage the templates doesn't need to change, I'd say | 10:18 |
| marios | markmc: right that makes sens | 10:18 |
| marios | wanted to ask... can we just distribute merge.py | 10:18 |
| marios | and have templates live in github | 10:18 |
| marios | i.e. is that a 'done thing' | 10:18 |
| markmc | marios, don't follow those 3 sentences? | 10:19 |
| marios | i'm saying about 'the way we manage templates doesn't need to change' i was saying that i wanted to ask you that... i.e. can we have merge.py in the 'library' and then templates continue to exist on github | 10:19 |
| markmc | sure | 10:20 |
| markmc | I don't even necessarily think the merge.py code would need to move out of that repo | 10:20 |
| marios | ok then no problem. i have the setup file. just need to work out the registration. do i need to host it somewhere ? | 10:20 |
| markmc | keeping it would allow the nice and simple Makefile to keep working | 10:20 |
| openstackgerrit | Chris Jones proposed a change to openstack/diskimage-builder: Switch Ubuntu element to installing saucy. https://review.openstack.org/58714 | 10:20 |
| markmc | as in publish to pypi? | 10:20 |
| marios | yeah | 10:21 |
| markmc | take a look in openstack-infra/config at other libraries | 10:21 |
| marios | oh so you mean i can just set the url to github | 10:21 |
| *** rongze has quit IRC | 10:21 | |
| markmc | there's a way to configure jenkins to publish to pypi when you push a tag | 10:21 |
| markmc | set which url ? | 10:21 |
| marios | ok will have a look thanks for the pointers | 10:21 |
| markmc | np | 10:23 |
| markmc | pypi-upload is what you want to grep for | 10:23 |
| marios | ta | 10:23 |
| markmc | but, basically | 10:24 |
| *** vkozhukalov has quit IRC | 10:24 | |
| markmc | make it possible for 'python setup.py {sdist,install}' to work in tripleo-heat-templates | 10:24 |
| markmc | use pbr | 10:24 |
| markmc | and then, when that lands, you can add the pypi-upload jenkins job | 10:25 |
| markmc | no doubt we'll bikeshed this to death, though :) | 10:25 |
| *** rongze_ has joined #tripleo | 10:31 | |
| *** boris-42 has joined #tripleo | 10:35 | |
| *** vkozhukalov has joined #tripleo | 10:36 | |
| *** athomas has joined #tripleo | 10:46 | |
| *** akuznetsov has joined #tripleo | 10:46 | |
| *** cd-undercloud has joined #tripleo | 10:46 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 10:46 |
| *** cd-undercloud has quit IRC | 10:46 | |
| rpodolyaka | derekh: I can confirm the problem with metadata. Here is the traceback of nova-api on seed machine when undercloud one is trying to get its metadata http://paste.openstack.org/show/54045/ . Going to debug further after lunch | 10:49 |
| derekh | rpodolyaka: yup, thats the one, I'm seeing too | 10:50 |
| *** jtomasek has quit IRC | 10:58 | |
| *** rongze_ has quit IRC | 11:06 | |
| *** matsuhashi has quit IRC | 11:10 | |
| *** jtomasek has joined #tripleo | 11:11 | |
| *** rongze has joined #tripleo | 11:15 | |
| *** cd-undercloud has joined #tripleo | 11:33 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 11:33 |
| *** cd-undercloud has quit IRC | 11:33 | |
| openstackgerrit | A change was merged to openstack/diskimage-builder: Enhance dib-run-parts usage message https://review.openstack.org/58704 | 11:46 |
| *** nosnos has quit IRC | 11:53 | |
| *** jprovazn has quit IRC | 11:54 | |
| openstackgerrit | Mark McLoughlin proposed a change to openstack/tripleo-image-elements: Add some more details about os-collect-config https://review.openstack.org/58740 | 12:01 |
| openstackgerrit | Mark McLoughlin proposed a change to openstack/tripleo-image-elements: Add some more details about os-collect-config https://review.openstack.org/58740 | 12:02 |
| *** toci-bot has joined #tripleo | 12:13 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_M3MjpXK/ | 12:13 |
| *** toci-bot has quit IRC | 12:13 | |
| *** rushiagr has quit IRC | 12:15 | |
| rpodolyaka | derekh: ok, I'm almost sure it's this change https://review.openstack.org/#/c/56174/4 that broke nova | 12:19 |
| rpodolyaka | derekh: line 57 of nova/network/neutron2/__init__.py | 12:20 |
| *** akuznetsov has quit IRC | 12:21 | |
| derekh | rpodolyaka: ya I was looking at the same commit but hadn't some to any conclusion on how it was wrong | 12:22 |
| *** cd-undercloud has joined #tripleo | 12:24 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 12:24 |
| *** cd-undercloud has quit IRC | 12:24 | |
| *** akuznetsov has joined #tripleo | 12:25 | |
| openstackgerrit | Petr Blaho proposed a change to openstack/python-tuskarclient: Adds help for subcommands https://review.openstack.org/56257 | 12:26 |
| *** CaptTofu has quit IRC | 12:28 | |
| openstackgerrit | Petr Blaho proposed a change to openstack/python-tuskarclient: Adds help for subcommands https://review.openstack.org/56257 | 12:28 |
| *** CaptTofu has joined #tripleo | 12:28 | |
| rpodolyaka | derekh: it seems to me that it was a series of patches that "refactored" get_client() to the current state, when no one really understands how it must work... | 12:31 |
| derekh | So do we file a nova bug and see where they can take it? Is there one already... checking | 12:32 |
| rpodolyaka | I'm just not sure, which part is broken :) get_client() or metadata request not passing auth_token | 12:33 |
| derekh | I aint got a clue either, maybe the nova folks should take a look | 12:34 |
| *** akuznetsov has quit IRC | 12:36 | |
| *** akuznetsov has joined #tripleo | 12:37 | |
| rpodolyaka | so commit message of https://review.openstack.org/#/c/56174/4 looks pretty sane | 12:38 |
| rpodolyaka | but it seems to me that the author forgot to fix other places where get_client() is called | 12:38 |
| rpodolyaka | though, after looking at the backtrace we have, I think we have a problem with definition of is_admin flag | 12:41 |
| rpodolyaka | so if a user with admin roles makes a request to nova-api which involves a subsequent request to neutron-api, nova will make this request on behalf neutron service user, but not the original user | 12:42 |
| rpodolyaka | and that patch was trying fix this | 12:43 |
| rpodolyaka | but broke metadata, because this nova-api who wants to talk to neutron, so context.is_admin is true, but there is no auth_token yet | 12:45 |
| derekh | ahh ok, but when hitting the metadata API we have no authenticated user | 12:45 |
| *** lucasagomes is now known as lucas-hungry | 12:45 | |
| rpodolyaka | the author suggests to pass admin=True when calling get_client() | 12:46 |
| derekh | I ran devtest with that commit reverted and got as far as overcloud, running it again now to preproduce and look into it a bit more | 12:46 |
| rpodolyaka | but it's not always possible | 12:46 |
| rpodolyaka | because it is called from code, that have no idea, whether it was called from metadata api or to handle user request | 12:47 |
| rpodolyaka | cool | 12:47 |
| rpodolyaka | so we can just show this to nova guys and let them decide what to do :) | 12:47 |
| derekh | makes sense | 12:48 |
| *** jistr is now known as jistr|eng | 12:49 | |
| * Ng lunches | 12:58 | |
| *** jistr|mobile has joined #tripleo | 12:59 | |
| *** CaptTofu has quit IRC | 13:08 | |
| *** CaptTofu has joined #tripleo | 13:09 | |
| *** cd-undercloud has joined #tripleo | 13:10 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 13:10 |
| *** cd-undercloud has quit IRC | 13:10 | |
| *** marun has joined #tripleo | 13:15 | |
| *** toci-bot has joined #tripleo | 13:29 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_VERuRof/ | 13:29 |
| *** toci-bot has quit IRC | 13:29 | |
| openstackgerrit | A change was merged to openstack/diskimage-builder: Switch Ubuntu element to installing saucy. https://review.openstack.org/58714 | 13:30 |
| *** rushiagr has joined #tripleo | 13:35 | |
| *** jdob has joined #tripleo | 13:40 | |
| *** dprince has joined #tripleo | 13:43 | |
| *** ifarkas has quit IRC | 13:43 | |
| *** julim has joined #tripleo | 13:44 | |
| *** ifarkas has joined #tripleo | 13:51 | |
| *** akuznetsov has quit IRC | 13:51 | |
| *** CaptTofu has quit IRC | 13:53 | |
| *** CaptTofu has joined #tripleo | 13:53 | |
| *** cd-undercloud has joined #tripleo | 13:58 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 13:58 |
| *** cd-undercloud has quit IRC | 13:58 | |
| *** lucas-hungry is now known as lucasagomes | 13:58 | |
| *** akuznetsov has joined #tripleo | 14:03 | |
| *** michchap has quit IRC | 14:15 | |
| *** marun has quit IRC | 14:19 | |
| *** athomas has quit IRC | 14:20 | |
| *** jdob has quit IRC | 14:20 | |
| *** jdob has joined #tripleo | 14:20 | |
| *** jdob has quit IRC | 14:24 | |
| *** jdob has joined #tripleo | 14:24 | |
| *** athomas has joined #tripleo | 14:29 | |
| *** jergerber has joined #tripleo | 14:31 | |
| *** matty_dubs|gone is now known as matty_dubs | 14:32 | |
| *** jistr|eng is now known as jistr | 14:32 | |
| *** jistr|mobile has quit IRC | 14:33 | |
| *** jdob has quit IRC | 14:38 | |
| *** marun has joined #tripleo | 14:39 | |
| *** hewbrocc` has joined #tripleo | 14:43 | |
| *** hewbrocca has quit IRC | 14:45 | |
| *** jdob has joined #tripleo | 14:52 | |
| *** cd-undercloud has joined #tripleo | 14:53 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 14:53 |
| *** cd-undercloud has quit IRC | 14:53 | |
| *** hewbrocc` has quit IRC | 14:54 | |
| *** boris-42 has quit IRC | 14:54 | |
| *** hewbrocc` has joined #tripleo | 14:56 | |
| *** oubiwann has joined #tripleo | 14:59 | |
| *** dprince has quit IRC | 15:06 | |
| derekh | rpodolyaka: Did you file a bug for that error ? | 15:09 |
| rpodolyaka | derekh: not yet, got side tracked with my interns :( will do that now | 15:10 |
| derekh | cooleo, we can then point some of the nova people at it | 15:10 |
| rpodolyaka | so, the hard part to explain this right :) | 15:11 |
| *** toci-bot has joined #tripleo | 15:11 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_zdWxEIp/ | 15:11 |
| *** toci-bot has quit IRC | 15:11 | |
| derekh | rpodolyaka: ya, I think you've dug into it more then me but I can I'll add anything else I have once the bug is there | 15:12 |
| rpodolyaka | derekh: cool, I'll post a link here | 15:13 |
| NobodyCam | Good morning TripleO | 15:23 |
| *** vkozhukalov has quit IRC | 15:39 | |
| *** cd-undercloud has joined #tripleo | 15:44 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 15:44 |
| *** cd-undercloud has quit IRC | 15:44 | |
| rpodolyaka | https://bugs.launchpad.net/nova/+bug/1255577 | 15:48 |
| uvirtbot | Launchpad bug 1255577 in nova "Requests to Metadata API fail with 500 if Neutron network plugin is used" [Undecided,New] | 15:48 |
| rpodolyaka | derekh: ^^ | 15:48 |
| *** athomas has quit IRC | 15:48 | |
| derekh | rpodolyaka: thanks looking | 15:50 |
| rpodolyaka | I'm wondering how we are not hitting this issue in our gate tests | 15:51 |
| rpodolyaka | aren't we testing the case when nova + neutron boot an instance which makes requests to Metadata API? | 15:52 |
| rpodolyaka | from what I see, it seems that this has nothing to do with e.g. Nova BM features | 15:53 |
| derekh | rpodolyaka: don't know, you would think we would be | 15:53 |
| rpodolyaka | plain Nova Metadata API issue when Neutron plugin is used instead of nova-network | 15:53 |
| *** jcooley_ has joined #tripleo | 15:53 | |
| *** UtahDave has joined #tripleo | 15:55 | |
| *** rdopieralski has quit IRC | 15:56 | |
| *** athomas has joined #tripleo | 15:57 | |
| * rpodolyaka poking guys on nova channel | 15:57 | |
| derekh | rpodolyaka: ok, I've add some timeline info | 15:59 |
| rpodolyaka | derekh: cool, thanks! | 16:00 |
| *** jcoufal has quit IRC | 16:02 | |
| *** jistr has quit IRC | 16:03 | |
| *** jtomasek has quit IRC | 16:04 | |
| *** pblaho has quit IRC | 16:06 | |
| *** michchap has joined #tripleo | 16:08 | |
| *** ifarkas has quit IRC | 16:12 | |
| *** toci-bot has joined #tripleo | 16:12 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_AZK10k0/ | 16:12 |
| *** toci-bot has quit IRC | 16:12 | |
| *** tzumainn has quit IRC | 16:17 | |
| openstackgerrit | Clint Byrum proposed a change to openstack/diskimage-builder: Add a cleanup option to source-repositories https://review.openstack.org/58386 | 16:28 |
| *** akuznetsov has quit IRC | 16:33 | |
| *** cd-undercloud has joined #tripleo | 16:34 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 16:34 |
| *** cd-undercloud has quit IRC | 16:34 | |
| SpamapS | did a fix land in Neutron? | 16:35 |
| openstackgerrit | Clint Byrum proposed a change to openstack/diskimage-builder: Add a cleanup option to source-repositories https://review.openstack.org/58386 | 16:39 |
| *** rushiagr has quit IRC | 16:41 | |
| derekh | SpamapS: dunno, status has been 0 since I came in | 16:43 |
| SpamapS | derekh: every time I see toci fail and click the logs it is a bad fedora mirror problem | 16:45 |
| derekh | SpamapS: ya, its a pain in the ass, I've raised it twice on buzilla, the first was closed and can't fix | 16:46 |
| derekh | the second hasn't been replied to yet (probably 2 months) | 16:46 |
| derekh | SpamapS: but today you clicked the wronge one, we got other things break most of the toci runs | 16:47 |
| derekh | https://bugs.launchpad.net/nova/+bug/1255577 | 16:47 |
| uvirtbot | Launchpad bug 1255577 in nova "Requests to Metadata API fail with 500 if Neutron network plugin is used" [Undecided,New] | 16:47 |
| SpamapS | derekh: yeah I only click about 1 in 5 :-P | 16:47 |
| rpodolyaka | dims even made a fix for this one, not sure if it's the best way to solve this, though | 16:49 |
| *** matty_dubs is now known as matty_dubs|lunch | 16:50 | |
| rpodolyaka | nova guys should really document this admin context magic :) | 16:51 |
| *** jcoufal has joined #tripleo | 16:58 | |
| rpodolyaka | https://bugs.launchpad.net/tripleo/+bug/1254246 | 17:01 |
| uvirtbot | Launchpad bug 1254246 in tripleo "somehow getting duplicate openvswitch agents for the same host" [Critical,In progress] | 17:01 |
| rpodolyaka | should be fixed by https://review.openstack.org/#/c/58814/1 | 17:01 |
| SpamapS | rpodolyaka: I don't actually think that is the right approach. | 17:03 |
| SpamapS | rpodolyaka: well I'm not sure anyway. Is there a valid scenario where you want two L2 agents on one host? | 17:04 |
| rpodolyaka | SpamapS: that's the question I've been asking myself too :) but I think, no | 17:04 |
| rpodolyaka | SpamapS: at least, this is how neutron-server code is written right now | 17:04 |
| rpodolyaka | SpamapS: except that uniqueness is not provided by DB constraint | 17:05 |
| rpodolyaka | SpamapS: but by the code instead | 17:05 |
| rpodolyaka | https://github.com/openstack/neutron/blob/master/neutron/db/agents_db.py#L121 | 17:06 |
| rpodolyaka | one() raises an exception when more than one row is returned by SELECT | 17:07 |
| rpodolyaka | but it's worth a discussion, I think | 17:08 |
| rpodolyaka | ok, so I'm going to show this to neutron folks and let them decide :) | 17:08 |
| SpamapS | rpodolyaka: oh lovely | 17:08 |
| SpamapS | rpodolyaka: +1 from me if the code already _thinks_ it is a unique thing. | 17:09 |
| SpamapS | rpodolyaka: and it does at least make sense that it would be 1:1 with a nova-compute host | 17:09 |
| * rpodolyaka goes away for a few hours | 17:10 | |
| *** max_lobur is now known as max_lobur_afk | 17:12 | |
| *** markmc has quit IRC | 17:19 | |
| *** cd-undercloud has joined #tripleo | 17:22 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 17:22 |
| *** cd-undercloud has quit IRC | 17:22 | |
| *** ccrouch has quit IRC | 17:27 | |
| *** ccrouch has joined #tripleo | 17:27 | |
| *** toci-bot has joined #tripleo | 17:27 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_Yac2V56/ | 17:27 |
| *** toci-bot has quit IRC | 17:27 | |
| *** vkozhukalov has joined #tripleo | 17:29 | |
| *** ccrouch has quit IRC | 17:31 | |
| openstackgerrit | Marios Andreou proposed a change to openstack/tripleo-heat-templates: WIP: make merge.py installable as a package using pbr https://review.openstack.org/58823 | 17:32 |
| *** jcooley_ has quit IRC | 17:51 | |
| *** athomas has quit IRC | 17:51 | |
| *** derekh has quit IRC | 17:53 | |
| *** matty_dubs|lunch is now known as matty_dubs | 17:53 | |
| *** akuznetsov has joined #tripleo | 17:59 | |
| openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Fix case of OpenStack in templates. https://review.openstack.org/58564 | 18:00 |
| Ng | right, that's me done with interviews for the day, I'm out for dinner and suchlike, hopefully I'll be able to slot in some reviews when I get back from a very late errand run | 18:11 |
| *** cd-undercloud has joined #tripleo | 18:14 | |
| cd-undercloud | ************** overcloud complete status=42 ************ | 18:14 |
| *** cd-undercloud has quit IRC | 18:14 | |
| *** martyntaylor has quit IRC | 18:19 | |
| *** ifarkas has joined #tripleo | 18:20 | |
| cody-somerville | SpamapS: Do you usually fly out of Bob Hope Airport or LAX? | 18:28 |
| *** rpodolyaka1 has joined #tripleo | 18:31 | |
| *** martyntaylor has joined #tripleo | 18:33 | |
| *** lucasagomes is now known as lucas-dinner | 18:34 | |
| *** boris-42 has joined #tripleo | 18:54 | |
| *** cd-undercloud has joined #tripleo | 19:04 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 19:04 |
| *** cd-undercloud has quit IRC | 19:04 | |
| * lifeless does the happy happy dance | 19:07 | |
| *** jdob has quit IRC | 19:09 | |
| *** toci-bot has joined #tripleo | 19:12 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_WI94DPK/ | 19:12 |
| *** toci-bot has quit IRC | 19:12 | |
| *** lucas-dinner has quit IRC | 19:17 | |
| lifeless | rpodolyaka1: evening! | 19:19 |
| lifeless | win goto #openstack-qa | 19:19 |
| *** shakayumi has joined #tripleo | 19:20 | |
| *** jcooley_ has joined #tripleo | 19:22 | |
| *** pblaho has joined #tripleo | 19:22 | |
| *** epim has joined #tripleo | 19:26 | |
| *** rongze has quit IRC | 19:30 | |
| *** rongze has joined #tripleo | 19:31 | |
| *** CaptTofu has quit IRC | 19:34 | |
| *** CaptTofu has joined #tripleo | 19:34 | |
| *** rongze has quit IRC | 19:36 | |
| lifeless | https://review.openstack.org/#/c/58404/ Ng <- | 19:38 |
| *** pblaho has quit IRC | 19:44 | |
| *** akuznetsov has quit IRC | 19:47 | |
| *** CaptTofu has quit IRC | 19:47 | |
| *** CaptTofu has joined #tripleo | 19:48 | |
| *** jcooley_ has quit IRC | 19:49 | |
| *** cd-undercloud has joined #tripleo | 19:55 | |
| cd-undercloud | ************** overcloud complete status=42 ************ | 19:55 |
| *** cd-undercloud has quit IRC | 19:55 | |
| *** jcooley_ has joined #tripleo | 19:58 | |
| *** akuznetsov has joined #tripleo | 20:00 | |
| *** rongze has joined #tripleo | 20:01 | |
| *** akuznetsov has quit IRC | 20:05 | |
| *** vipul is now known as vipul-away | 20:06 | |
| *** vipul-away is now known as vipul | 20:06 | |
| *** rongze has quit IRC | 20:06 | |
| *** jcooley_ has quit IRC | 20:07 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Add some more details about os-collect-config https://review.openstack.org/58740 | 20:17 |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Throttle tripleo-cd.sh https://review.openstack.org/58631 | 20:19 |
| *** vipul is now known as vipul-away | 20:21 | |
| *** vkozhukalov has quit IRC | 20:23 | |
| *** jcooley_ has joined #tripleo | 20:23 | |
| *** rongze has joined #tripleo | 20:31 | |
| *** vipul-away is now known as vipul | 20:35 | |
| *** rongze has quit IRC | 20:40 | |
| *** cd-undercloud has joined #tripleo | 20:41 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 20:41 |
| *** cd-undercloud has quit IRC | 20:41 | |
| SpamapS | cody-somerville: LAX | 20:54 |
| SpamapS | cody-somerville: Burbank is way simpler, but there are tons more flights out of LAX so it is usually the more flexible option. | 20:54 |
| *** rwsu has quit IRC | 20:57 | |
| *** lsmola has quit IRC | 20:57 | |
| *** toci-bot has joined #tripleo | 21:04 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_mBedBqV/ | 21:04 |
| *** toci-bot has quit IRC | 21:04 | |
| SpamapS | damn we had another =42 fail | 21:19 |
| *** cd-undercloud has joined #tripleo | 21:32 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 21:32 |
| *** cd-undercloud has quit IRC | 21:32 | |
| *** rongze has joined #tripleo | 21:34 | |
| lifeless | jog0: hi | 21:37 |
| lifeless | jog0: are you circling back to rebuild soon, do you think? We seem pretty stalled at the moment, and I'm wondering whether to start hunting around for someone to put sustained effort into it? | 21:37 |
| *** ifarkas has quit IRC | 21:38 | |
| *** rongze has quit IRC | 21:39 | |
| jog0 | lifeless: I should be able to circle back to it next week | 21:45 |
| jog0 | I was even able to do some reviews today | 21:45 |
| lifeless | cool | 21:46 |
| jog0 | so nothing the rest of this week (thanksgiving) travel on Friday, then next week can go attack it | 21:46 |
| jog0 | assuming gate stays decent | 21:46 |
| *** jcoufal has quit IRC | 21:52 | |
| *** rpodolyaka1 has quit IRC | 21:54 | |
| *** noslzzp has quit IRC | 21:55 | |
| *** matty_dubs has quit IRC | 21:58 | |
| *** julim has quit IRC | 21:59 | |
| openstackgerrit | Chris Jones proposed a change to openstack/tripleo-incubator: Improve a boot-seed-vm status message. https://review.openstack.org/58404 | 22:00 |
| *** jcooley_ has quit IRC | 22:06 | |
| *** boris-42 has quit IRC | 22:16 | |
| *** cd-undercloud has joined #tripleo | 22:20 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 22:20 |
| *** cd-undercloud has quit IRC | 22:20 | |
| *** michchap has quit IRC | 22:30 | |
| *** michchap has joined #tripleo | 22:33 | |
| *** rongze has joined #tripleo | 22:35 | |
| *** rongze has quit IRC | 22:39 | |
| *** cd-undercloud has joined #tripleo | 23:08 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 23:08 |
| *** cd-undercloud has quit IRC | 23:08 | |
| *** max_lobur_afk has quit IRC | 23:08 | |
| *** max_lobur_afk has joined #tripleo | 23:09 | |
| *** toci-bot has joined #tripleo | 23:13 | |
| toci-bot | ERROR during toci run, see http://54.228.118.193/toci/toci_logs_UjSonPS/ | 23:13 |
| *** toci-bot has quit IRC | 23:13 | |
| *** jcooley_ has joined #tripleo | 23:14 | |
| *** jcooley_ has quit IRC | 23:21 | |
| *** rongze has joined #tripleo | 23:36 | |
| *** rongze has quit IRC | 23:40 | |
| *** cd-undercloud has joined #tripleo | 23:56 | |
| cd-undercloud | ************** overcloud complete status=0 ************ | 23:56 |
| *** cd-undercloud has quit IRC | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!