sdake_ | bmace_ maybe here: http://eavesdrop.openstack.org/irclogs/%23openstack-kolla/%23openstack-kolla.2017-02-08.log.html#t2017-02-08T13:47:44 | 00:00 |
---|---|---|
*** mannamne has joined #openstack-kolla | 00:01 | |
sdake_ | groan daily gerrit backups | 00:01 |
sdake_ | sbezverk i am attempting to reivew yoru gate patch - howeer gerrit pokey | 00:02 |
sbezverk | sdake_: it is not 100% corect, basically that traceback indicates that nova cannot get keystone url for authentication | 00:02 |
bmace_ | sdake_: well, my 3.0.2 containers are coming up at least, and keystone is working.. even if it isn't 100% the swap between 3.x and 2.x is easy enough to tweak in the devenv startup | 00:02 |
sbezverk | sdake_: we did not have too much time to go in details | 00:02 |
sdake_ | sbezverk what port is it trying to get the keystone url for? | 00:02 |
sdake_ | sbezverk port 35357? | 00:03 |
sbezverk | bmace_: the issue is visible only when you start VM | 00:03 |
bmace_ | sbezverk: i hit an issue and fixed it in my keystone startup where it was getting an internal only addr / port so if you look at my devenv change i moved it to find the external port of the keystone-admin service and that port also | 00:04 |
sbezverk | it fails to launch and nova sceduler and compute have each a traceback | 00:04 |
sbezverk | bmace_: could you please paste the link for your change? | 00:05 |
bmace_ | sbezverk: https://review.openstack.org/#/c/429295/11/tools/build_local_admin_keystonerc.sh | 00:05 |
sbezverk | sdake_: I am waiting for the gate results for refactor if it comes back relatively green, then please review | 00:05 |
bmace_ | without that the keystone test from a remote system most definitely does not work | 00:05 |
sdake_ | sbezverk will do at my folks house - going to dinner now | 00:06 |
sdake_ | bmace_ to fix that you need to set the external port config option on cloud.yaml | 00:06 |
sbezverk | bmace_: I do not tink this change has any impact on nova-compute process | 00:06 |
sdake_ | sbezverk right he is talking about a different problem - keystone endpoint list i suspect | 00:07 |
sbezverk | here if I read it right, you build keystone_rc file | 00:07 |
sdake_ | sbezverk the same problem we had with keystone endpoitn list | 00:07 |
sbezverk | sdake_: ok then it is completely different issue | 00:07 |
bmace_ | sdake_: just like horizon, why would the cluster ip not be external by default? | 00:08 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 00:08 |
sdake_ | bmace_ I had the same problem and same question | 00:11 |
sbezverk | bmace_: I would agree for horizon it makes sense to have it external.. but from security reason it is better to make the end user to do it, if he/she needs | 00:11 |
sdake_ | bmace_ i am not sure i got a suitable answer | 00:11 |
sdake_ | the problem without an externally facing keystone endpoint is that it is impossible to bootstrap openstack with things like images, networks, flavors, etc | 00:12 |
sdake_ | also keystone endpoint lsit doesn't work which means nova boot doesn't work | 00:12 |
sdake_ | nova boot depends on keystone endpoint list, not keystone catalog list | 00:12 |
sdake_ | (in newton) | 00:12 |
sdake_ | in mitaka that was not the case | 00:12 |
*** dave-mccowan has joined #openstack-kolla | 00:13 | |
sdake_ | sbezverk could you expand on the security aspect when nova booting doesn't work properly without keystone endpoint list being functional? | 00:13 |
bmace_ | also, wouldn't you need these exposed if someone plans to use the cli at all? i don't know how many people use horizon vs. cli, etc.. but external by default feels to be more likely what people want.. having a single change you can make to hide them all could be there for the paranoid folks. | 00:13 |
sdake_ | bmace_ it is configurable during helm install time | 00:13 |
sdake_ | bmace_ i think the default is wrong :) | 00:13 |
sdake_ | and i think sbezverk disagrees :) | 00:14 |
bmace_ | sdake_: sort of my points, yes, agreed | 00:14 |
bmace_ | i think the default case should == the most common case | 00:14 |
sbezverk | sdake_: in my cluster I do not have keystone admin exposed externally and nova do not have any problem with that, so I am not sure I undersatnd this problem | 00:14 |
sdake_ | nova booting may work fine with keystone, however, most people actually use the api | 00:14 |
sdake_ | sbezverk how are ou booting vms (via horizon?) | 00:14 |
sbezverk | no, cli | 00:15 |
sdake_ | hmm well maybe it needs more digging - although we do need to be able to bootstrap the cluster as well as the admin user | 00:15 |
sdake_ | and at present, there is no way to do that with the cli | 00:15 |
sdake_ | few operators bootstrap openstack via horizon | 00:16 |
sdake_ | they have scripts and more scripts and stuff :) | 00:16 |
sbezverk | sdake_: kfox1111 is an operator and I do not remeber him complaining about it | 00:17 |
*** krtaylor has joined #openstack-kolla | 00:20 | |
*** sdake_ has quit IRC | 00:20 | |
*** salv-orlando has quit IRC | 00:23 | |
*** Pavo has quit IRC | 00:24 | |
*** Pavo has joined #openstack-kolla | 00:25 | |
*** lamt has quit IRC | 00:26 | |
*** lamt has joined #openstack-kolla | 00:26 | |
*** yingjun has joined #openstack-kolla | 00:28 | |
*** lamt has quit IRC | 00:31 | |
*** mannamne has quit IRC | 00:31 | |
*** huzhengchuan has joined #openstack-kolla | 00:39 | |
openstackgerrit | Li Yingjun proposed openstack/kolla-ansible master: Fix telegraf task https://review.openstack.org/430648 | 00:45 |
*** duonghq has joined #openstack-kolla | 00:45 | |
*** duonghq__ has joined #openstack-kolla | 00:46 | |
jascott1 | my god py3 takes 13mins?! https://benchmarksgame.alioth.debian.org/u64q/performance.php?test=nbody | 00:48 |
jascott1 | hipster node only takes ~28 secs | 00:49 |
kfox1111 | hey all. | 00:53 |
jascott1 | hey kfox1111 ! | 00:54 |
jascott1 | how does it go? | 00:54 |
*** zhuzeyu has quit IRC | 00:54 | |
kfox1111 | jascott1: yeah, that isn't the best python3 app... there's math libs that would make it a lot faster I think. | 00:55 |
jascott1 | ah | 00:55 |
kfox1111 | pretty good. how about you? | 00:55 |
kfox1111 | just got prometheus figured out to the point where if my ceph drops an osd, it will ping me on slack. :) | 00:55 |
jascott1 | good, fixing up PR based on technosophos's review. almost finished | 00:55 |
kfox1111 | nice. :) | 00:56 |
jascott1 | awesome! | 00:56 |
kfox1111 | really liking prometheus. | 00:56 |
sbezverk | kfox1111: I think I found something wierd in nova config: check this out: http://paste.openstack.org/show/598154/ | 00:56 |
jascott1 | yeah after this I hope to get to checkout computekit and all the neat stuff you guys have been working on | 00:56 |
kfox1111 | sbezverk: looking | 00:56 |
sbezverk | I have never seen this config before | 00:56 |
jascott1 | i havent gotten to try it but hear good things | 00:56 |
sbezverk | especially since it point to wrong ip | 00:56 |
kfox1111 | sbezverk: yeah, thats wierd looking. where did that come from? | 00:57 |
sbezverk | must be from kolla | 00:57 |
sbezverk | it in in config generated by genconfig | 00:57 |
kfox1111 | wonder if thats a recent thing. | 00:58 |
kfox1111 | hah | 00:59 |
kfox1111 | awesome | 00:59 |
kfox1111 | https://github.com/CanonicalLtd/prometheus-openstack-exporter | 00:59 |
sbezverk | fu....g it was added feb 2nd | 01:01 |
sbezverk | facfabf3 (Jeffrey Zhang 2017-02-01 21:46:32 +0800 50) | 01:01 |
sbezverk | facfabf3 (Jeffrey Zhang 2017-02-01 21:46:32 +0800 51) - name: Creating the placement project, user, and role | 01:01 |
sbezverk | facfabf3 (Jeffrey Zhang 2017-02-01 21:46:32 +0800 52) kolla_toolbox: | 01:01 |
kfox1111 | yeah, we need to add cross repo gating asap. :/ | 01:01 |
sbezverk | I think we started see it since you unpin ansible | 01:02 |
kfox1111 | or wait to the ptg, get configmaps figured out and get out of kolla-ansible. | 01:02 |
*** cuongnv has joined #openstack-kolla | 01:03 | |
sbezverk | yeaah, we need to get away of other poeple breaking us, we can do it better ourselves ;) | 01:03 |
*** huzhengchuan has quit IRC | 01:03 | |
sbezverk | could you pin back ansible to old version we used before? | 01:03 |
sbezverk | just to prove the point | 01:03 |
kfox1111 | apply: | 01:05 |
kfox1111 | git fetch https://git.openstack.org/openstack/kolla-kubernetes refs/changes/65/427365/4 && git format-patch -1 --stdout FETCH_HEAD | patch -p1 -R | 01:05 |
openstackgerrit | Li Yingjun proposed openstack/kolla-ansible master: Fix telegraf task https://review.openstack.org/430648 | 01:06 |
sbezverk | kfox1111: thanks I will add it to the gate setup | 01:06 |
kfox1111 | full review's here: | 01:06 |
kfox1111 | https://review.openstack.org/#/c/427365/4 | 01:06 |
kfox1111 | if thats easier. | 01:06 |
*** zhubingbing_ has joined #openstack-kolla | 01:06 | |
kfox1111 | we totally need a container for prometheus-openstack-exporter | 01:07 |
sbezverk | kfox1111: again stats? | 01:10 |
kfox1111 | seems to gather some very interesting metrics. | 01:12 |
*** zhangqiankun has joined #openstack-kolla | 01:14 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 01:14 |
sbezverk | kfox1111: nice, it will make cncf people happy ;) | 01:14 |
*** Pavo has quit IRC | 01:15 | |
*** huzhengchuan has joined #openstack-kolla | 01:16 | |
kfox1111 | I've been looking for a monitoring system dynamic enough to deal with cloud stuff. | 01:17 |
kfox1111 | prometheus is the first system I've seen that can keep up with it properly. | 01:17 |
kfox1111 | not really surprising considering its to kubernetes what borgmon is to borg, and designed based on google's borgmon. | 01:18 |
sbezverk | kfox1111: interesting, when config gen problem gets resolved will try it out too | 01:18 |
kfox1111 | been using the upstream helm chart for testing. its pretty good. | 01:18 |
*** sdake has joined #openstack-kolla | 01:18 | |
sdake | sbezverk sorry had to drop off | 01:19 |
sdake | sbezverk to relocate | 01:19 |
sdake | re kfox not complaining, im not sure how he plans to bootstrap his cluster without external 35357 port access | 01:19 |
sdake | kfox1111 - if your around would love to hear how you do an operation like init-runonce | 01:19 |
*** sdake has quit IRC | 01:20 | |
*** sdake has joined #openstack-kolla | 01:21 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 01:21 |
sbezverk | sdake: we found potential out gate breakage | 01:22 |
sbezverk | in nova compute | 01:22 |
sbezverk | here is the config which got generated for us by kolla-ansible | 01:23 |
kfox1111 | sdake: whats the behavior of init-runonce? | 01:23 |
sdake | kfox1111 moment: | 01:23 |
sdake | https://github.com/openstack/kolla-ansible/blob/master/tools/init-runonce | 01:24 |
*** salv-orlando has joined #openstack-kolla | 01:24 | |
*** mgiles has quit IRC | 01:25 | |
kfox1111 | looks similar to the script that tests the system. | 01:25 |
kfox1111 | so, loads a bunch potentially useful defaults in... | 01:26 |
sdake | right - i call it clodu bootstrapping maybe it has a different name | 01:26 |
kfox1111 | yeah. | 01:26 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 01:26 |
kfox1111 | I'd think a k8s job would be well suited to run that. | 01:27 |
sdake | and it would be configured via an external configmap? | 01:28 |
kfox1111 | so maybe a kolla-simple-cloud-init helm package or something like that, with a job that sets all that stuff up? | 01:28 |
sdake | so that sounds good short-to-medium term | 01:28 |
kfox1111 | yeah. | 01:28 |
sdake | in the meantime, we need to unblock devs today | 01:28 |
sdake | and if people can't bootstrap their cloud - they hae problems | 01:29 |
*** tvignaud has joined #openstack-kolla | 01:29 | |
sdake | i'd propose changing the defaults temporarily | 01:29 |
kfox1111 | what defaults? | 01:29 |
sdake | or atleast documenting how they can be changed - i don't even recall what changes I made | 01:29 |
kfox1111 | thats registering stuff into the cloud. | 01:29 |
*** zhurong has joined #openstack-kolla | 01:29 | |
sdake | kfox1111 there is an external_port_interface thing in the keystone object | 01:29 |
*** salv-orlando has quit IRC | 01:29 | |
kfox1111 | all the things can be overridden with helm vars. | 01:29 |
sbezverk | yep, just provide your values.yaml file | 01:30 |
*** rwallner has joined #openstack-kolla | 01:30 | |
sbezverk | I think I showed you already with cloud,yaml | 01:31 |
sdake | sbezverk indeed you did | 01:31 |
sbezverk | sdake ^^ | 01:31 |
sdake | sbezverk and like a moron i didn't take notes | 01:31 |
sbezverk | but you should still that file? right | 01:31 |
sbezverk | I mean have that file | 01:31 |
sdake | i was so excited keystone was working I was not taking notes :) | 01:31 |
sdake | I may have it | 01:31 |
sdake | I dont recall how it was generated | 01:31 |
sdake | kfox1111 told me the other day | 01:32 |
sdake | don't recall that either | 01:32 |
sdake | brain = can't remember | 01:32 |
kfox1111 | tools/build_example_yaml.py | 01:32 |
sbezverk | kfox1111: it looks like this config screwes things up auth_url = http://10.10.10.254:35357 | 01:33 |
sbezverk | I am still waiting to confirm, but something tells me it should be it | 01:34 |
*** caowei has joined #openstack-kolla | 01:34 | |
*** zhurong has quit IRC | 01:35 | |
*** rwallner has quit IRC | 01:35 | |
kfox1111 | hmm... | 01:38 |
kfox1111 | is that suposed to be an external address? | 01:39 |
kfox1111 | does it have any overlap with the pod networks or service network? | 01:39 |
*** adrian_otto has quit IRC | 01:39 | |
*** yingjun has quit IRC | 01:40 | |
sbezverk | kfox1111: it does not overlap, but I think it overrides our auth_url = http://keystone-admin:35357/v3 | 01:40 |
sbezverk | kfox1111: they put default kolla's vip address | 01:41 |
sbezverk | without checking for orchestration engine | 01:41 |
kfox1111 | whats admin_port_external set to? | 01:44 |
kfox1111 | yeah, I guess in the kolla generated config files it should be: keystone_admin_url: "http://keystone-admin:35357/v3" | 01:45 |
bmace_ | that is essentially what i build dynamically in that keystonerc change. | 01:46 |
*** yingjun has joined #openstack-kolla | 01:46 | |
kfox1111 | so in the gate, we append: tests/conf/ceph-all-in-one/kolla_config to /etc/kolla/globals.yaml before running genconfig. | 01:48 |
sbezverk | bmace_: kolla gen config also adds this for us, but I guess they forgot about it when added new feature | 01:48 |
kfox1111 | was something similar being done here? | 01:48 |
kfox1111 | sbezverk: oh. is this part of the gate being broken your debugging? | 01:49 |
sbezverk | yeah, Branch 3 issue | 01:51 |
kfox1111 | ah. | 01:51 |
kfox1111 | so, we unpined on feb 5... | 01:52 |
kfox1111 | its feb 8... fantastic. | 01:52 |
kfox1111 | that didn't take long to break things. :/ | 01:52 |
bmace_ | lol | 01:53 |
kfox1111 | looks like there were 39 ps's merged in that time. | 01:54 |
kfox1111 | I'd recommend doing a bisect in the gate. | 01:54 |
kfox1111 | unless someone watching kolla-ansible knows changes that may effect this. | 01:55 |
sbezverk | yeeeesssss that was it | 01:57 |
kfox1111 | find it? | 01:58 |
sbezverk | after pinning to older version branch 3 turned to green | 01:58 |
kfox1111 | k. so then we just have to narrow down the ps then... | 01:59 |
*** adrian_otto has joined #openstack-kolla | 01:59 | |
kfox1111 | a bisect will take upwards of about 5 runs. | 01:59 |
kfox1111 | if unlucky. | 01:59 |
kfox1111 | if you do 3 at a time instead of 1, it could be done in parallel and go faster. | 02:00 |
yingjun | Hi, i got a issue when running 'kolla-build': `jinja2.exceptions.UndefinedError: 'users' is undefined`, could anyone help? | 02:01 |
yingjun | full log: http://paste.openstack.org/show/598160/ | 02:02 |
*** adrian_otto has quit IRC | 02:03 | |
*** Pavo has joined #openstack-kolla | 02:05 | |
*** david-lyle has joined #openstack-kolla | 02:06 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-ansible master: Fixing authentication url for kubernetes https://review.openstack.org/431250 | 02:07 |
sbezverk | kfox1111: https://review.openstack.org/431250 | 02:07 |
*** Pavo has quit IRC | 02:07 | |
sbezverk | I think it should do it | 02:08 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 02:08 |
*** dave-mccowan has quit IRC | 02:09 | |
sbezverk | kfox1111: bisect would be hard to do at the gate :( I will take a chance with this fix, because it is an issue for sure, then we will see.. | 02:10 |
*** wirehead_ has quit IRC | 02:12 | |
kfox1111 | k. | 02:12 |
kfox1111 | should be able to just change the git commit being checked out to each commimt a git bisect recommends. | 02:12 |
kfox1111 | yeah. that looks promising. | 02:13 |
*** wirehead_ has joined #openstack-kolla | 02:13 | |
*** yingjun has quit IRC | 02:14 | |
openstackgerrit | Wei Cao proposed openstack/kolla master: Add dragonflow container https://review.openstack.org/418193 | 02:14 |
*** Jeffrey4l has quit IRC | 02:17 | |
*** Jeffrey4l has joined #openstack-kolla | 02:20 | |
*** salv-orlando has joined #openstack-kolla | 02:26 | |
*** unicell has quit IRC | 02:26 | |
*** salv-orlando has quit IRC | 02:30 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 02:32 |
*** japestinho has joined #openstack-kolla | 02:34 | |
cliles | is there a document or something that describes how kolla handles policy.json? | 02:42 |
cliles | I found the commit, nm | 02:44 |
sdake | kfox1111 those breakages wont happen once we have cross repo gating | 02:50 |
*** duonghq__ has quit IRC | 02:57 | |
*** openstackstatus has quit IRC | 02:58 | |
*** denaitre has quit IRC | 02:59 | |
*** leseb has quit IRC | 02:59 | |
*** denaitre has joined #openstack-kolla | 03:01 | |
*** sp_ has joined #openstack-kolla | 03:01 | |
*** openstackstatus has joined #openstack-kolla | 03:01 | |
*** ChanServ sets mode: +v openstackstatus | 03:01 | |
*** saneax-_-|AFK is now known as saneax | 03:04 | |
*** leseb has joined #openstack-kolla | 03:05 | |
Jeffrey4l | zhubingbing_, please review https://review.openstack.org/430638 | 03:05 |
*** yuanying has quit IRC | 03:05 | |
zhubingbing_ | done <Jeffrey4l | 03:06 |
*** yuanying has joined #openstack-kolla | 03:07 | |
*** yuanying has quit IRC | 03:11 | |
*** MasterOfBugs has quit IRC | 03:16 | |
Jeffrey4l | thanks. | 03:17 |
*** sudipto has joined #openstack-kolla | 03:18 | |
*** sudipto_ has joined #openstack-kolla | 03:18 | |
*** rwallner has joined #openstack-kolla | 03:20 | |
*** rwallner has quit IRC | 03:25 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla master: [TEST][MASTER][KOLLA] Testing openstack ubuntu testing repo https://review.openstack.org/431289 | 03:28 |
*** goldyfruit has joined #openstack-kolla | 03:30 | |
*** saneax is now known as saneax-_-|AFK | 03:32 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: Optimize reconfigure action for horizon https://review.openstack.org/422719 | 03:32 |
openstackgerrit | Merged openstack/kolla-ansible master: Optimize reconfiguration for aodh https://review.openstack.org/423670 | 03:33 |
sbezverk | Jeffrey4l: could you workflow it please? | 03:45 |
*** sdake has quit IRC | 03:45 | |
sbezverk | https://review.openstack.org/430638 | 03:45 |
*** sayantani01 has joined #openstack-kolla | 03:45 | |
Jeffrey4l | sbezverk, done ;) | 03:45 |
sbezverk | Jeffrey4l: thanks a lot!! | 03:47 |
Jeffrey4l | np | 03:47 |
openstackgerrit | Merged openstack/kolla-ansible master: Fixing authentication url for kubernetes https://review.openstack.org/431250 | 03:48 |
*** jrobinson is now known as jrobinson-afk | 03:58 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 04:02 |
*** crushil has quit IRC | 04:04 | |
*** goldyfruit has quit IRC | 04:06 | |
*** crushil has joined #openstack-kolla | 04:17 | |
*** jrobinson-afk is now known as jrobinson | 04:28 | |
*** adrian_otto has joined #openstack-kolla | 04:29 | |
*** rwallner has joined #openstack-kolla | 04:31 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 04:31 |
*** sdake has joined #openstack-kolla | 04:34 | |
*** adrian_otto has quit IRC | 04:36 | |
*** rwallner has quit IRC | 04:36 | |
*** mdnadeem has joined #openstack-kolla | 04:39 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla master: [TEST][MASTER][KOLLA] Testing openstack ubuntu testing repo https://review.openstack.org/431289 | 04:40 |
sdake | bmace_ around? | 04:43 |
openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Change endpoint-test -1 to 1 return code https://review.openstack.org/431126 | 04:43 |
openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Document the magic in endpoint_test.sh https://review.openstack.org/431114 | 04:43 |
*** penfold has quit IRC | 04:44 | |
*** yingjun has joined #openstack-kolla | 04:50 | |
*** saneax-_-|AFK is now known as saneax | 04:51 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 05:06 |
sbezverk | sdake: gte refactor ps is ready for review.. so your chance to unblock other folks from pushing their gate ps ;) https://review.openstack.org/428150 | 05:07 |
sdake | sbezverk i reviewed it | 05:08 |
sdake | sbezverk it had a few nitpicky things - otherwise looks pretty good | 05:08 |
sdake | sbezverk i could find no errors except the magic numbers and whatnot | 05:08 |
sbezverk | hm I did not get email let me check gerrit | 05:09 |
sdake | ya patch set 77 | 05:10 |
sdake | there is a top pin on asnible 2.1 for example | 05:10 |
sdake | we should be able to run without top pins | 05:10 |
bmace_ | sdake: heading out in a minute.. going to post my latest changes.. stuff is coming up very nicely on the 2.x branch | 05:10 |
bmace_ | i think near the end of the nova / horizon stuff it started puking because my env was resource starved | 05:11 |
sdake | bmace_ good t ohear | 05:11 |
sdake | minus the puking part :) | 05:11 |
sbezverk | sdake: had to pin ansible because it breaks our gate | 05:11 |
openstackgerrit | Borne Mace proposed openstack/kolla-kubernetes master: WIP: Added support for containerized dev bringup https://review.openstack.org/429295 | 05:12 |
*** yingjun has quit IRC | 05:12 | |
bmace_ | sdake: feel free to try it out.. after you start up the container just run setup_dev_env.. it does all the ceph setup, then at the end i have a line with the syntax to be passed to ceph_workflow_service, and that should all be working also | 05:13 |
bmace_ | sdake: back in a couple of hours | 05:13 |
sdake | bmace_ it will need a rebase as soon as sbezverk 'z patch merges | 05:13 |
sdake | sbezverk how does it break the gate? | 05:14 |
sdake | sbezverk thats a problem :( | 05:14 |
sdake | sbezverk we need to get to the bottom of that - at a later point | 05:15 |
sbezverk | sdake There was a change introduced in ansible which I thought I found | 05:15 |
sbezverk | but it tuned out no | 05:15 |
*** saneax is now known as saneax-_-|AFK | 05:16 | |
sbezverk | anyway I am not goint to block other folks while chasing the issue | 05:16 |
sbezverk | it can be done in parallel | 05:16 |
sdake | right | 05:16 |
sdake | i wsn't suggesting blocking | 05:16 |
sdake | just finding the cuse at some point | 05:16 |
sdake | can you log a bug for it | 05:17 |
sdake | it maybe a kolla-ansible bug in which csae we need it fixed soon by kolla-ansible deliverable | 05:17 |
sdake | since release is coming up shortly | 05:17 |
sdake | (march 10th) | 05:17 |
*** sudipto has quit IRC | 05:18 | |
*** sudipto_ has quit IRC | 05:18 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 05:19 |
sbezverk | sdake: when gate refactor gets merged Iwill do it, right now gates and compute kit is a priority | 05:21 |
*** crushil has quit IRC | 05:21 | |
sbezverk | I am off, bye | 05:21 |
*** tvignaud has quit IRC | 05:24 | |
*** sayantani01 has quit IRC | 05:30 | |
*** unicell has joined #openstack-kolla | 05:32 | |
openstackgerrit | zhubingbing proposed openstack/kolla master: Add fluent-plugin-parser pluin https://review.openstack.org/431323 | 05:33 |
*** krtaylor has quit IRC | 05:34 | |
zhubingbing_ | sdake | 05:35 |
zhubingbing_ | https://review.openstack.org/#/c/431323/1 | 05:36 |
sdake | sup zhubingbing_ | 05:36 |
sdake | sbezverk roger | 05:36 |
zhubingbing_ | please review it | 05:36 |
zhubingbing_ | ;) | 05:36 |
sdake | sbezverk evening to ya :) | 05:36 |
*** yingjun has joined #openstack-kolla | 05:36 | |
*** sdake has quit IRC | 05:39 | |
*** sdake has joined #openstack-kolla | 05:39 | |
*** sudipto has joined #openstack-kolla | 05:40 | |
*** sudipto_ has joined #openstack-kolla | 05:40 | |
openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Fix fluentd config error https://review.openstack.org/431326 | 05:42 |
openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Fix fluentd config error https://review.openstack.org/431326 | 05:52 |
*** japestinho has quit IRC | 06:01 | |
*** saneax-_-|AFK is now known as saneax | 06:02 | |
*** yuanying has joined #openstack-kolla | 06:07 | |
*** salv-orlando has joined #openstack-kolla | 06:09 | |
*** sacharya_ has quit IRC | 06:11 | |
*** imcsk8_ has joined #openstack-kolla | 06:12 | |
*** imcsk8 has quit IRC | 06:12 | |
*** ssurana has joined #openstack-kolla | 06:13 | |
*** rwallner has joined #openstack-kolla | 06:17 | |
*** rwallner has quit IRC | 06:21 | |
*** rwallner has joined #openstack-kolla | 06:28 | |
*** NachoDuck_ has joined #openstack-kolla | 06:29 | |
*** ssurana has quit IRC | 06:29 | |
*** portdirect__ has joined #openstack-kolla | 06:30 | |
*** mgkwill_ has joined #openstack-kolla | 06:30 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: use_forwarded_for is moved to api group https://review.openstack.org/431337 | 06:30 |
*** ediardo_ has joined #openstack-kolla | 06:30 | |
*** ediardo has quit IRC | 06:33 | |
*** portdirect has quit IRC | 06:33 | |
*** denaitre has quit IRC | 06:33 | |
*** huzhengchuan has quit IRC | 06:33 | |
*** mgkwill has quit IRC | 06:33 | |
*** NachoDuck has quit IRC | 06:33 | |
*** cuongnv has quit IRC | 06:33 | |
*** denaitre has joined #openstack-kolla | 06:33 | |
*** portdirect__ is now known as portdirect | 06:33 | |
*** rwallner has quit IRC | 06:33 | |
*** ediardo_ is now known as ediardo | 06:33 | |
*** mgkwill_ is now known as mgkwill | 06:33 | |
*** NachoDuck_ is now known as NachoDuck | 06:34 | |
*** huzhengchuan has joined #openstack-kolla | 06:36 | |
openstackgerrit | Duong Ha-Quang proposed openstack/kolla-ansible master: Change Barbican default secret store to pkcs11 https://review.openstack.org/430137 | 06:38 |
openstackgerrit | Zeyu Zhu proposed openstack/kolla-kubernetes master: Fix the typo in ceph-guide.rst https://review.openstack.org/431341 | 06:38 |
*** inc0 has joined #openstack-kolla | 06:41 | |
*** cuongnv has joined #openstack-kolla | 06:43 | |
*** unicell1 has joined #openstack-kolla | 06:43 | |
*** unicell has quit IRC | 06:43 | |
openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Fix fluentd config error https://review.openstack.org/431326 | 06:48 |
*** inc0 has quit IRC | 06:51 | |
*** sdake has quit IRC | 06:56 | |
*** salv-orl_ has joined #openstack-kolla | 06:59 | |
*** salv-orlando has quit IRC | 07:02 | |
*** imcsk8_ has quit IRC | 07:04 | |
*** imcsk8 has joined #openstack-kolla | 07:04 | |
openstackgerrit | Kris proposed openstack/kolla-ansible master: Wrong type of interface in mongodb bootstrap_cluster.js template https://review.openstack.org/431348 | 07:06 |
*** satyar has joined #openstack-kolla | 07:09 | |
*** sayantani01 has joined #openstack-kolla | 07:10 | |
duonghq | zhubingbing_, do you deploy kolla-ansible recently? | 07:10 |
zhubingbing_ | yes | 07:11 |
duonghq | do you get trouble with rabbitmq? | 07:11 |
zhubingbing_ | what‘s problems? | 07:11 |
zhubingbing_ | no | 07:11 |
*** sacharya has joined #openstack-kolla | 07:12 | |
duonghq | zhubingbing_, http://paste.openstack.org/show/598180/ | 07:13 |
duonghq | it keep restart | 07:13 |
zhubingbing_ | http://paste.openstack.org/show/598181/ | 07:14 |
duonghq | I should same as your | 07:14 |
*** sacharya has quit IRC | 07:17 | |
*** tovin07_ has joined #openstack-kolla | 07:22 | |
duonghq | Jeffrey4l, are you there? | 07:23 |
*** salv-orl_ has quit IRC | 07:28 | |
*** pcaruana has joined #openstack-kolla | 07:36 | |
openstackgerrit | Wei Cao proposed openstack/kolla-ansible master: Add Octavia doc link in README.rst https://review.openstack.org/431355 | 07:37 |
*** prameswar has joined #openstack-kolla | 07:39 | |
*** Serlex has joined #openstack-kolla | 07:41 | |
openstackgerrit | Merged openstack/kolla-ansible master: Fix telegraf task https://review.openstack.org/430648 | 07:46 |
*** unicell has joined #openstack-kolla | 07:48 | |
*** unicell1 has quit IRC | 07:49 | |
*** unicell has quit IRC | 07:55 | |
*** jrobinson has quit IRC | 07:57 | |
*** matrohon has joined #openstack-kolla | 08:00 | |
*** sdake has joined #openstack-kolla | 08:05 | |
openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: test https://review.openstack.org/431365 | 08:09 |
openstackgerrit | Merged openstack/kolla master: Add fluent-plugin-parser pluin https://review.openstack.org/431323 | 08:20 |
*** dciabrin has joined #openstack-kolla | 08:21 | |
*** sdake has quit IRC | 08:24 | |
openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Add nova-serialproxy releasenotes https://review.openstack.org/431376 | 08:26 |
*** rwallner has joined #openstack-kolla | 08:31 | |
*** matrohon has quit IRC | 08:35 | |
*** rwallner has quit IRC | 08:36 | |
*** sayantani01 has quit IRC | 08:37 | |
openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Add placement-api releasenotes https://review.openstack.org/431383 | 08:37 |
*** sayantani01 has joined #openstack-kolla | 08:37 | |
*** egonzalez has joined #openstack-kolla | 08:45 | |
openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Add searchlight releasenotes https://review.openstack.org/431387 | 08:47 |
zhubingbing_ | sup egonzalez | 08:49 |
egonzalez | hey zhubingbing_ | 08:50 |
openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Add radosgw-keystone-integration releasenotes https://review.openstack.org/431390 | 08:56 |
*** openstackgerrit has quit IRC | 09:03 | |
*** openstackgerrit has joined #openstack-kolla | 09:04 | |
openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Add cinder-volume-hnas releasenotes https://review.openstack.org/431394 | 09:04 |
*** skuda has joined #openstack-kolla | 09:04 | |
openstackgerrit | zhubingbing proposed openstack/kolla master: Add zun dockerfile releasenotes https://review.openstack.org/431396 | 09:11 |
openstackgerrit | zhubingbing proposed openstack/kolla master: Add zun dockerfile releasenotes https://review.openstack.org/431396 | 09:12 |
*** Jeffrey4l has quit IRC | 09:17 | |
*** Jeffrey4l has joined #openstack-kolla | 09:17 | |
*** gfidente has joined #openstack-kolla | 09:25 | |
*** gfidente has quit IRC | 09:25 | |
*** gfidente has joined #openstack-kolla | 09:25 | |
*** mgoddard has joined #openstack-kolla | 09:31 | |
*** yingjun has quit IRC | 09:33 | |
openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Add miss releasenotes https://review.openstack.org/431376 | 09:36 |
*** sdake has joined #openstack-kolla | 09:37 | |
openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Add miss kolla-ansible releasenotes https://review.openstack.org/431376 | 09:37 |
*** japestinho has joined #openstack-kolla | 09:40 | |
*** japestinho has quit IRC | 09:41 | |
*** japestinho has joined #openstack-kolla | 09:41 | |
openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Add miss kolla-ansible releasenotes https://review.openstack.org/431376 | 09:42 |
*** hrw has quit IRC | 09:42 | |
*** hrw has joined #openstack-kolla | 09:44 | |
*** mannamne has joined #openstack-kolla | 09:49 | |
*** duonghq has quit IRC | 09:51 | |
*** wagiel has joined #openstack-kolla | 09:56 | |
*** sdake has quit IRC | 09:57 | |
*** dosaboy has joined #openstack-kolla | 09:58 | |
*** dosaboy has quit IRC | 09:58 | |
*** dosaboy has joined #openstack-kolla | 10:00 | |
*** tovin07_ has quit IRC | 10:01 | |
*** david-lyle has quit IRC | 10:02 | |
*** sp_ has quit IRC | 10:05 | |
*** klindgren_ has joined #openstack-kolla | 10:06 | |
*** cuongnv has quit IRC | 10:07 | |
*** sayantan_ has joined #openstack-kolla | 10:08 | |
*** klindgren has quit IRC | 10:08 | |
*** sayantani01 has quit IRC | 10:08 | |
*** zioproto has joined #openstack-kolla | 10:13 | |
*** proto_ has joined #openstack-kolla | 10:13 | |
*** zioproto has quit IRC | 10:14 | |
*** proto_ has quit IRC | 10:14 | |
*** zioproto has joined #openstack-kolla | 10:14 | |
openstackgerrit | zhubingbing proposed openstack/kolla master: Add kolla miss releasenotes https://review.openstack.org/431418 | 10:14 |
openstackgerrit | zhubingbing proposed openstack/kolla master: Add miss kolla releasenotes https://review.openstack.org/431418 | 10:15 |
*** sp_ has joined #openstack-kolla | 10:17 | |
zioproto | hello all, anyone knows when stable/ocata will be branched ? | 10:18 |
zioproto | I have this last patch that is importnat to me :) https://review.openstack.org/#/c/427139/ | 10:18 |
openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Add miss kolla-ansible releasenotes https://review.openstack.org/431376 | 10:19 |
*** zhubingbing_ has quit IRC | 10:21 | |
*** sambetts|afk is now known as sambetts | 10:27 | |
pbourke | any of you deploy ironic recently? | 10:29 |
*** caowei has quit IRC | 10:29 | |
*** matrohon has joined #openstack-kolla | 10:31 | |
*** pcaruana has quit IRC | 10:32 | |
*** pcaruana has joined #openstack-kolla | 10:33 | |
*** satyar has quit IRC | 10:34 | |
*** sayantani01 has joined #openstack-kolla | 10:35 | |
*** sayantan_ has quit IRC | 10:35 | |
*** yuanying has quit IRC | 10:36 | |
*** wagiel has quit IRC | 10:42 | |
n0isyn0ise | hi kolla team, I do not understand why "kolla-ansible reconfigure" is not working after my deployment, is there any adjustment to do compared to the documentation ? | 10:45 |
n0isyn0ise | i'm using the master branch | 10:45 |
egonzalez | n0isyn0ise: what is not working? what is failing? | 10:47 |
n0isyn0ise | it seems kolla-ansible it just not looking in /etc/kolla/config | 10:49 |
*** zioproto has quit IRC | 10:50 | |
n0isyn0ise | i there something more to do than enabling the node_custom_config: "/etc/kolla/config" flag ? | 10:50 |
n0isyn0ise | and adding the custom conf to that folder (as mentionned in documentation) ? | 10:51 |
*** dciabrin has quit IRC | 10:51 | |
egonzalez | n0isyn0ise: which service are using custom config and in what path? | 10:51 |
*** sdake has joined #openstack-kolla | 10:52 | |
n0isyn0ise | as i did not get any result, I try with the same example as in documentation : I try to reconfigure nova with the "scheduler_max_attemps = 100" | 10:53 |
*** dciabrin has joined #openstack-kolla | 10:54 | |
*** skramaja has quit IRC | 10:54 | |
n0isyn0ise | so I create /etc/kolla/config/nova/nova-scheduler.conf with the following insidde : [DEFAULT] | 10:54 |
n0isyn0ise | scheduler_max_attempts = 100 | 10:54 |
n0isyn0ise | enven if i found that quite strange compared to the config i can see in nova.conf on my compute nodes... | 10:55 |
n0isyn0ise | i think it would be something like : [scheduler] \ max_attemps = 100 | 10:55 |
n0isyn0ise | in a /etc/kolla/config/nova-compute folder | 10:56 |
n0isyn0ise | i tried in multiple ways but none of them worked, so I guess i should do something wrong, but don't know what... | 10:57 |
egonzalez | paths are /etc/kolla/config/nova/nova-*.conf or /etc/kolla/config/nova.conf (this to apply changes to all nova services) or /etc/kolla/config/nova/<hostname>/nova.conf | 10:58 |
egonzalez | n0isyn0ise: yeah, need the section to merge the config | 10:58 |
n0isyn0ise | k thx, i will try anew | 11:01 |
n0isyn0ise | with /etc/kolla/config/nova.conf it worked ! | 11:08 |
n0isyn0ise | thx egonzalez ! :) | 11:08 |
*** sdake has quit IRC | 11:11 | |
*** qiliang27 has quit IRC | 11:20 | |
*** qiliang27 has joined #openstack-kolla | 11:22 | |
*** zhuzeyu has joined #openstack-kolla | 11:23 | |
*** sudipto has quit IRC | 11:27 | |
*** sudipto_ has quit IRC | 11:27 | |
*** dgonzalez has quit IRC | 11:30 | |
*** prameswar has quit IRC | 11:44 | |
*** zhuzeyu has quit IRC | 11:44 | |
*** yingjun has joined #openstack-kolla | 11:48 | |
japestinho | hello everyone, is there any installaion note regarding to kolla-kubernetes? | 11:49 |
*** dgonzalez has joined #openstack-kolla | 11:51 | |
*** kwazar has quit IRC | 11:52 | |
*** zhubingbing has joined #openstack-kolla | 11:52 | |
*** fragatina has quit IRC | 12:00 | |
*** cargonza has joined #openstack-kolla | 12:01 | |
*** skramaja has joined #openstack-kolla | 12:01 | |
*** tvignaud has joined #openstack-kolla | 12:03 | |
*** pbourke has quit IRC | 12:07 | |
*** pbourke has joined #openstack-kolla | 12:07 | |
*** prameswar has joined #openstack-kolla | 12:08 | |
*** dave-mccowan has joined #openstack-kolla | 12:13 | |
openstackgerrit | Merged openstack/kolla-ansible master: Fix fluentd config error https://review.openstack.org/431326 | 12:14 |
openstackgerrit | Merged openstack/kolla-ansible master: Fix copying over nfs_shares task failure https://review.openstack.org/430638 | 12:15 |
openstackgerrit | Merged openstack/kolla-ansible master: Custom init-runonce values https://review.openstack.org/424682 | 12:16 |
*** zhangqiankun has quit IRC | 12:20 | |
*** satyar has joined #openstack-kolla | 12:30 | |
*** magicboiz has joined #openstack-kolla | 12:35 | |
*** salv-orlando has joined #openstack-kolla | 12:35 | |
des_consolado | gah how the hell do I troubleshoot this ironic_dnsmasq containers then D: | 12:43 |
*** kwazar has joined #openstack-kolla | 12:44 | |
des_consolado | I'm tcpdumping on the interface it's supposed to be using. I can see the DHCP requests coming in, broadcast packets | 12:44 |
des_consolado | the dnsmasq process is running and it just doesn't do anything. I've straced it from the host and it does nothing. It is running though. The container is running fine. | 12:45 |
des_consolado | in the logs dir I only see logs from ironic-api, -conductor and -inspector | 12:45 |
des_consolado | so there aren't any dnsmasq logs | 12:45 |
*** tvignaud has quit IRC | 12:46 | |
openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: WIP: Add cli options to cleanup-images https://review.openstack.org/431503 | 12:50 |
openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: WIP: Add cli options to cleanup-images https://review.openstack.org/431503 | 12:51 |
*** rhallisey has joined #openstack-kolla | 12:53 | |
*** salv-orl_ has joined #openstack-kolla | 12:59 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: Run simple_cell_setup after the new container is up during upgrade https://review.openstack.org/431508 | 13:00 |
*** eaguilar has quit IRC | 13:00 | |
Jeffrey4l | egonzalez, could u test https://review.openstack.org/431508 ? it works in my env during upgrade newton to ocata. | 13:01 |
*** salv-orlando has quit IRC | 13:02 | |
*** rwallner has joined #openstack-kolla | 13:02 | |
*** rwallner has quit IRC | 13:03 | |
*** Pavo has joined #openstack-kolla | 13:03 | |
*** rwallner has joined #openstack-kolla | 13:03 | |
hrw | speaking of reviews... https://review.openstack.org/#/c/430940 (non-x86 archs support) waits for skilled reviewers ;D | 13:05 |
egonzalez | Jeffrey4l: tried before and it works | 13:07 |
egonzalez | I'm going to retry | 13:07 |
Jeffrey4l | egonzalez, thanks ;) | 13:07 |
*** zioproto has joined #openstack-kolla | 13:07 | |
*** sudipto has joined #openstack-kolla | 13:11 | |
*** sudipto_ has joined #openstack-kolla | 13:11 | |
*** eaguilar has joined #openstack-kolla | 13:16 | |
*** eaguilar has quit IRC | 13:17 | |
japestinho | I got error when running kolla-ansible deploy, while starting heka container I got error "maximum retry count cannot be used with restart policy" | 13:19 |
japestinho | what's wrong with that error? | 13:19 |
Jeffrey4l | japestinho, kolla do not support docker-engine 1.13 now. try to downgrade to 1.12.x | 13:20 |
*** zioproto has quit IRC | 13:20 | |
japestinho | ah thank you Jeffrey4l I'll try to downgrade docker version on my node | 13:21 |
Jeffrey4l | np | 13:22 |
*** penfold has joined #openstack-kolla | 13:22 | |
*** huzhengchuan has quit IRC | 13:33 | |
*** tvignaud has joined #openstack-kolla | 13:37 | |
*** mdnadeem has quit IRC | 13:40 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding compute kit based on iscsi backend https://review.openstack.org/431156 | 13:43 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding compute kit based on iscsi backend https://review.openstack.org/431156 | 13:47 |
*** mgiles has joined #openstack-kolla | 13:49 | |
*** rwallner has quit IRC | 13:50 | |
*** schwicht has joined #openstack-kolla | 13:51 | |
*** yingjun has quit IRC | 13:52 | |
egonzalez | zhubingbing: around? | 13:54 |
*** eaguilar has joined #openstack-kolla | 13:58 | |
*** schwicht has quit IRC | 14:02 | |
*** rwallner has joined #openstack-kolla | 14:03 | |
*** schwicht has joined #openstack-kolla | 14:03 | |
egonzalez | Someone have faced this error in nova_compute container. stable/newton with ceph enabled | 14:04 |
egonzalez | OSError: [Errno 2] No such file or directory: '/etc/ceph/rbdmap' | 14:04 |
egonzalez | Jeffrey4l: ValidationError: Cell mappings are not created, but required for Ocata. Please run nova-manage cell_v2 simple_cell_setup before continuing. | 14:09 |
*** Pavo has quit IRC | 14:10 | |
*** saneax is now known as saneax-_-|AFK | 14:12 | |
*** Pavo has joined #openstack-kolla | 14:14 | |
*** goldyfruit has joined #openstack-kolla | 14:15 | |
*** sp__ has joined #openstack-kolla | 14:15 | |
*** sayantani01 has quit IRC | 14:17 | |
*** Pavo has quit IRC | 14:19 | |
*** schwicht has quit IRC | 14:24 | |
*** lamt has joined #openstack-kolla | 14:25 | |
*** krtaylor has joined #openstack-kolla | 14:26 | |
*** lamt has quit IRC | 14:26 | |
Jeffrey4l | egonzalez, which task raise this? | 14:29 |
egonzalez | bootstrap nova | 14:30 |
Jeffrey4l | my test is fine. hrm. | 14:30 |
Jeffrey4l | egonzalez, have u build latest nova-api container? | 14:30 |
egonzalez | used latest registry | 14:31 |
egonzalez | so, yep | 14:31 |
*** eaguilar has quit IRC | 14:31 | |
Jeffrey4l | latest registry? means? hub.docker.com? | 14:31 |
egonzalez | tarballs.o.o | 14:31 |
Jeffrey4l | egonzalez, where the newton registry come from? | 14:32 |
Jeffrey4l | newton image. | 14:32 |
egonzalez | newton is from dockerhub | 14:32 |
Jeffrey4l | ok. | 14:32 |
Jeffrey4l | egonzalez, could u post the traceback from bootstrap_nova? | 14:33 |
egonzalez | Jeffrey4l: http://paste.openstack.org/show/598247/ | 14:33 |
Jeffrey4l | and you told me this patch should work, right? | 14:34 |
egonzalez | it worked iirc, but now i doubt of it | 14:34 |
*** yingjun has joined #openstack-kolla | 14:36 | |
egonzalez | hrm, I tested with centos binary , that code was not packaged yet, in source it is | 14:40 |
Jeffrey4l | ok. | 14:42 |
egonzalez | should be, was implemented in dec | 14:42 |
Jeffrey4l | one issue is: the default database name is nova_api_cell0 in newton and nova_cell0 in ocata. | 14:43 |
* egonzalez is getting crazy | 14:43 | |
Jeffrey4l | let me try again. | 14:43 |
egonzalez | redeploying again too | 14:43 |
Jeffrey4l | if my patch do not works. another solution is: create the proper cell item by using "create_cell" and "map_cell0" and discover_hosts | 14:44 |
egonzalez | create-cell command is only in ocata | 14:44 |
Jeffrey4l | ;( | 14:44 |
egonzalez | Jeffrey4l: have you ever see this error: OSError: [Errno 2] No such file or directory: '/etc/ceph/rbdmap' | 14:47 |
egonzalez | stable/newton centos-binary | 14:47 |
Jeffrey4l | egonzalez, saw this long time ago. | 14:47 |
*** crushil has joined #openstack-kolla | 14:47 | |
egonzalez | nova_compute and cinder_volume is restarting | 14:47 |
Jeffrey4l | i never tried centos-binary. | 14:48 |
Jeffrey4l | centos+source works fine. | 14:48 |
egonzalez | Jeffrey4l: don't know if my boss will like non binary deployments ;) | 14:48 |
Jeffrey4l | ah. source is more stable, imo. ;) | 14:49 |
egonzalez | yeah, no doubt of it | 14:49 |
Jeffrey4l | /etc/ceph/rbdmap is provided by ceph-common. | 14:50 |
*** sdake has joined #openstack-kolla | 14:51 | |
Jeffrey4l | no one will remove this file. | 14:51 |
Jeffrey4l | it is wired. | 14:51 |
*** sp__ has quit IRC | 14:51 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 14:52 |
*** ipsecguy has quit IRC | 14:52 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding compute kit based on iscsi backend https://review.openstack.org/431156 | 14:53 |
*** sdake_ has joined #openstack-kolla | 14:54 | |
Jeffrey4l | egonzalez, found this http://git.openstack.org/cgit/openstack-dev/grenade/tree/projects/60_nova/from-newton/upgrade-nova#n9 | 14:54 |
*** sdake has quit IRC | 14:55 | |
*** schwicht has joined #openstack-kolla | 14:55 | |
egonzalez | Jeffrey4l: cool, seems a good option | 14:56 |
Jeffrey4l | yes. i will add it into my patch | 14:58 |
Jeffrey4l | i didn't know openstack has https://github.com/openstack-dev/grenade such a project. | 14:58 |
egonzalez | I tried something similar, instead of simple_cell_setup after map_cell0 made map_cell_and_hosts, but complains of missing db tables since after map_cell0 a db_sync must be made | 15:01 |
Jeffrey4l | nova should add this into its own upgrade releasenote. | 15:02 |
openstackgerrit | Ronan-Alexandre Cherrueau proposed openstack/kolla master: Multi-Regions Support https://review.openstack.org/431588 | 15:04 |
egonzalez | Jeffrey4l: yeah, they throw the bomb and forgot about people who uses it | 15:04 |
*** Pavo has joined #openstack-kolla | 15:06 | |
*** Pavo has quit IRC | 15:07 | |
*** fguillot has joined #openstack-kolla | 15:12 | |
*** adrian_otto has joined #openstack-kolla | 15:18 | |
egonzalez | Jeffrey4l: still having same issue centos-source 3.0.2 with ceph | 15:20 |
Jeffrey4l | egonzalez, try run a nova-compute container manually, and check whether the file exist. | 15:20 |
egonzalez | Jeffrey4l: yep, it is | 15:20 |
egonzalez | owned by root | 15:21 |
Jeffrey4l | do the nova user can read it? | 15:21 |
*** sayantani01 has joined #openstack-kolla | 15:22 | |
*** sayantani01 has quit IRC | 15:26 | |
*** saneax-_-|AFK is now known as saneax | 15:27 | |
*** jtriley has joined #openstack-kolla | 15:29 | |
*** sacharya has joined #openstack-kolla | 15:33 | |
*** eaguilar has joined #openstack-kolla | 15:35 | |
*** adrian_otto has quit IRC | 15:37 | |
*** vcn has joined #openstack-kolla | 15:37 | |
egonzalez | Jeffrey4l: set_config remove dest path if exists, rbdmap is in that path and removed | 15:43 |
*** yingjun has quit IRC | 15:43 | |
openstackgerrit | Merged openstack/kolla master: Move fluentd td.repo to base for consistency https://review.openstack.org/430193 | 15:43 |
Jeffrey4l | egonzalez, ok. that's a bug in set_config.. | 15:43 |
egonzalez | INFO:__main__:Removing existing destination: /etc/ceph/ | 15:43 |
Jeffrey4l | but why source is OK? | 15:43 |
egonzalez | Jeffrey4l: nope, deployed source (stable/newton 3.0.2) | 15:44 |
Jeffrey4l | ok. i thought you are deploying master code. | 15:44 |
egonzalez | was that fixed? | 15:45 |
Jeffrey4l | i refactored set_config in master. | 15:45 |
Jeffrey4l | i guess it is OK in master. | 15:45 |
Jeffrey4l | but i have a newton env and master env. which both work fine. | 15:45 |
Jeffrey4l | but they are all centos+source. | 15:45 |
Jeffrey4l | no idea whether it is matter. | 15:45 |
Jeffrey4l | egonzalez, may need fix this in newton. | 15:46 |
*** sayantani01 has joined #openstack-kolla | 15:46 | |
egonzalez | only have this issue when enabled_ceph, I had no other issue but this | 15:47 |
Jeffrey4l | my env are both run with enable_ceph=yes. .. | 15:47 |
egonzalez | using kolla from pip in newton or git? | 15:48 |
Jeffrey4l | git/ | 15:48 |
egonzalez | guess i have to at least build my images instead of pull from dockerhub | 15:50 |
*** zhubingbing has quit IRC | 15:50 | |
Jeffrey4l | egonzalez, not necessary. seem it is a bug. | 15:51 |
Jeffrey4l | egonzalez, it is caused by https://github.com/openstack/kolla/blob/ab364066e7ae4c87f1be53a6d7c13f9042032bb7/docker/base/set_configs.py#L72 | 15:52 |
Jeffrey4l | and https://github.com/openstack/kolla/blob/ab364066e7ae4c87f1be53a6d7c13f9042032bb7/ansible/roles/nova/templates/nova-compute.json.j2#L12 | 15:53 |
Jeffrey4l | if dest is a diretory, shoudn't remove the folder. | 15:53 |
*** prameswar has quit IRC | 15:53 | |
*** rwallner_ has joined #openstack-kolla | 15:55 | |
*** rwallner has quit IRC | 15:55 | |
*** adrian_otto has joined #openstack-kolla | 16:00 | |
openstackgerrit | Paul Bourke (pbourke) proposed openstack/kolla master: Allow the use of previously built parent images https://review.openstack.org/426322 | 16:01 |
*** zhubingbing has joined #openstack-kolla | 16:03 | |
*** adrian_otto1 has joined #openstack-kolla | 16:05 | |
*** adrian_otto has quit IRC | 16:06 | |
*** erlon has joined #openstack-kolla | 16:06 | |
*** eaguilar has quit IRC | 16:10 | |
*** saneax is now known as saneax-_-|AFK | 16:11 | |
*** eaguilar has joined #openstack-kolla | 16:11 | |
*** sacharya has quit IRC | 16:14 | |
*** sacharya has joined #openstack-kolla | 16:17 | |
*** vcn has quit IRC | 16:18 | |
*** sp__ has joined #openstack-kolla | 16:21 | |
*** fragatina has joined #openstack-kolla | 16:22 | |
*** adrian_otto1 has quit IRC | 16:26 | |
*** sacharya_ has joined #openstack-kolla | 16:27 | |
*** sacharya has quit IRC | 16:27 | |
*** adrian_otto has joined #openstack-kolla | 16:29 | |
*** srwilkers has joined #openstack-kolla | 16:38 | |
*** sayantani01 has quit IRC | 16:39 | |
*** sayantani01 has joined #openstack-kolla | 16:39 | |
*** david-lyle has joined #openstack-kolla | 16:40 | |
*** sacharya has joined #openstack-kolla | 16:40 | |
*** sacharya_ has quit IRC | 16:41 | |
*** inc0 has joined #openstack-kolla | 16:43 | |
inc0 | o/ | 16:43 |
*** zhubingbing has quit IRC | 16:44 | |
srwilkers | o/ | 16:51 |
sdake_ | morning peeps | 16:52 |
*** sp__ has quit IRC | 16:53 | |
*** penfold has quit IRC | 16:54 | |
*** penfold has joined #openstack-kolla | 16:54 | |
openstackgerrit | Merged openstack/kolla-kubernetes master: Document the magic in endpoint_test.sh https://review.openstack.org/431114 | 16:56 |
openstackgerrit | Merged openstack/kolla-kubernetes master: Change endpoint-test -1 to 1 return code https://review.openstack.org/431126 | 16:57 |
sdake_ | yay ;-) | 16:58 |
*** matrohon has quit IRC | 16:59 | |
*** david-lyle has quit IRC | 17:00 | |
*** Pavo has joined #openstack-kolla | 17:01 | |
*** skramaja has quit IRC | 17:02 | |
*** sacharya has quit IRC | 17:07 | |
*** sacharya has joined #openstack-kolla | 17:08 | |
*** Pavo has quit IRC | 17:10 | |
*** egonzalez has quit IRC | 17:12 | |
*** Pavo has joined #openstack-kolla | 17:12 | |
*** sacharya has quit IRC | 17:12 | |
*** sacharya has joined #openstack-kolla | 17:14 | |
sdake_ | is the kolla-kubernetes gate busted? | 17:15 |
sbezverk | sdake_: srwilkers: gate refactor is ready to merge. https://review.openstack.org/#/c/428150/78 | 17:15 |
sdake_ | sbezverk reivewing | 17:15 |
sdake_ | sbezverk i ntoiced the endpoint patch merged with all kinds of gate failures | 17:15 |
sbezverk | sdake_: just branch 3 is busted | 17:16 |
sdake_ | sbezverk i just wanted to verify i didn't break the gate | 17:16 |
sbezverk | the rest should work just fine | 17:16 |
sdake_ | nice | 17:16 |
*** lamt has joined #openstack-kolla | 17:18 | |
*** sacharya_ has joined #openstack-kolla | 17:18 | |
*** sacharya has quit IRC | 17:19 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding compute kit based on iscsi backend https://review.openstack.org/431156 | 17:20 |
sdake_ | sbezverk gate refactor looks fantastically good | 17:21 |
*** sacharya has joined #openstack-kolla | 17:21 | |
sdake_ | sbezverk i'm sure it will create some pain for the other rebasrs, but might as well get it done :) | 17:21 |
sdake_ | inc0 portdirect srwilkers if you guys want to have a look - that gate refactor is blocking other work https://review.openstack.org/#/c/428150/78 | 17:22 |
*** sacharya_ has quit IRC | 17:23 | |
klindgren_ | Morning - question for you guys. With kolla and building containers from source. What is the recommended way to also get kolla to install specific/patched dependent packages. | 17:24 |
klindgren_ | Like say we want it to include a patched version of oslo_messaging | 17:24 |
klindgren_ | akaik, creating a nova container using source, basically jsut does a pip install into a venv. So is the recomended path to modify requirements.txt for nova to either install the specific version that you want, and run your own pip mirror where you publish that version to? Or replace oslo_messaging entry withe an egg include to have pip fetch it from source? | 17:26 |
*** crushil has quit IRC | 17:26 | |
klindgren_ | or is their some generic way in kolla to do that, which I am not aware of? | 17:27 |
*** eaguilar has quit IRC | 17:27 | |
SamYaple | klindgren_: there are jinja2 macros that you can take advantage of | 17:28 |
openstackgerrit | Sayantani Goswami proposed openstack/kolla-ansible master: WIP Deployment Guide https://review.openstack.org/427965 | 17:28 |
SamYaple | for a more native approach, you could for nova, oslo_messaging, and openstack-requirements and point kolla to those sources | 17:28 |
SamYaple | each has thier upside | 17:29 |
*** japestinho has quit IRC | 17:29 | |
*** pcaruana has quit IRC | 17:30 | |
*** sacharya_ has joined #openstack-kolla | 17:30 | |
*** eaguilar has joined #openstack-kolla | 17:30 | |
*** sacharya has quit IRC | 17:30 | |
*** v1k0d3n has quit IRC | 17:31 | |
*** bmace_ has quit IRC | 17:32 | |
*** bmace_ has joined #openstack-kolla | 17:32 | |
klindgren_ | SamYample what jinja2 macro? would this be the "customizable("packages")) function? | 17:35 |
SamYaple | klindgren_: there are a few macros sprinkled throughout | 17:36 |
*** sudipto has quit IRC | 17:39 | |
*** sudipto_ has quit IRC | 17:39 | |
*** sacharya_ has quit IRC | 17:39 | |
*** sacharya has joined #openstack-kolla | 17:40 | |
*** crushil has joined #openstack-kolla | 17:41 | |
openstackgerrit | Ronan-Alexandre Cherrueau proposed openstack/kolla-ansible master: Multi-regions Support https://review.openstack.org/431658 | 17:42 |
*** Administrator__ has joined #openstack-kolla | 17:43 | |
*** sacharya has quit IRC | 17:44 | |
*** sacharya has joined #openstack-kolla | 17:46 | |
*** zhugaoxiao has quit IRC | 17:46 | |
*** rwallner_ has quit IRC | 17:46 | |
*** david-lyle has joined #openstack-kolla | 17:53 | |
*** mgoddard has quit IRC | 17:55 | |
*** penfold has quit IRC | 17:58 | |
*** srwilkers has quit IRC | 18:00 | |
*** sacharya has quit IRC | 18:00 | |
*** sacharya has joined #openstack-kolla | 18:00 | |
*** sambetts is now known as sambetts|afk | 18:02 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding compute kit based on iscsi backend https://review.openstack.org/431156 | 18:05 |
kfox1111 | morning | 18:07 |
openstackgerrit | Sayantani Goswami proposed openstack/kolla-ansible master: Deployment Guide https://review.openstack.org/427965 | 18:09 |
bmace_ | morning :) | 18:13 |
kfox1111 | sbezverk: reviewing | 18:14 |
*** zhugaoxiao has joined #openstack-kolla | 18:15 | |
sbezverk | kfox1111: good morning | 18:16 |
*** unicell has joined #openstack-kolla | 18:17 | |
sbezverk | kfox1111: when you finish, please check compute_kit ps specifically building keystone admin rc file bit, I would like to know what you think about this problem | 18:17 |
*** rwallner has joined #openstack-kolla | 18:17 | |
*** Administrator__ has quit IRC | 18:18 | |
*** ssurana has joined #openstack-kolla | 18:19 | |
*** mannamne has quit IRC | 18:19 | |
kfox1111 | k | 18:25 |
*** vhosakot has joined #openstack-kolla | 18:25 | |
kfox1111 | arg... | 18:26 |
bmace_ | vararg ... ;) | 18:27 |
kfox1111 | should have put in a block before I reviewed... | 18:27 |
kfox1111 | just submitted the review quick to try and block. | 18:27 |
sbezverk | kfox1111: so what should I do then? | 18:28 |
*** penfold has joined #openstack-kolla | 18:28 | |
sbezverk | It is probably gets merged as is | 18:29 |
kfox1111 | lets see what happens. | 18:29 |
kfox1111 | if it merges, we can followup patch a few things. | 18:29 |
kfox1111 | it was looking really good really. | 18:29 |
inc0 | vararg sounds like some sort of overgrown wolf | 18:30 |
sbezverk | kfox1111: thanks. meanwhile could you check compute kit piece? | 18:30 |
kfox1111 | yeah. sec | 18:30 |
kfox1111 | have the link handy? | 18:31 |
sbezverk | kfox1111: https://review.openstack.org/431156 | 18:31 |
kfox1111 | nm. found it. | 18:31 |
kfox1111 | thanks. :) | 18:31 |
sbezverk | kfox1111: about your suggestion to have 2 --values: I am not sure how it is going to work wrt to merging | 18:32 |
kfox1111 | it merges itself. | 18:33 |
kfox1111 | two values chunks works ok last I tried it. | 18:33 |
sbezverk | kfox1111: what if both chunks have common entries? | 18:33 |
kfox1111 | it merges them. | 18:33 |
kfox1111 | it uses the same merger that the packages values.yaml and the specified values.yaml files all use. | 18:33 |
*** rwallner has quit IRC | 18:38 | |
*** rwallner has joined #openstack-kolla | 18:38 | |
*** sdake_ has quit IRC | 18:38 | |
kfox1111 | sbezverk: so, what is the concern with it? why isn't keystone-admin set with an external ip? | 18:41 |
kfox1111 | its alittle hard to follow, as part of it is in the other ps, | 18:45 |
*** david-lyle has quit IRC | 18:45 | |
kfox1111 | but it looks like its sharing all the config with the iscsi stuff? | 18:45 |
*** mgoddard has joined #openstack-kolla | 18:47 | |
sbezverk | kfox1111: when I deploy compute kit I cannot get to keystone even thought keystone admin has public external | 18:47 |
sbezverk | because kestone admin rc gets always cluster IP | 18:48 |
kfox1111 | should get a cluster ip too, in addition to the external ip... | 18:49 |
kfox1111 | hmm... | 18:49 |
sbezverk | kfox1111: when it prints OS vars | 18:49 |
sbezverk | it uses keystone internal svc address | 18:50 |
kfox1111 | yeah. admin has both: http://logs.openstack.org/56/431156/7/experimental/gate-kolla-kubernetes-deploy-centos-binary-2-helm-compute-kit-nv/88076fa/logs/svc/kolla-keystone-admin.txt | 18:50 |
sbezverk | which is not accessible from outside | 18:50 |
kfox1111 | hmm... lets back up a bit. | 18:50 |
kfox1111 | can you please explain what the issue is? | 18:50 |
bmace_ | that is why i changed my code that generates the keystone admin rc file to use the keystone-admin external ip / port :) | 18:50 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding compute kit based on iscsi backend https://review.openstack.org/431156 | 18:51 |
*** sayantani01 has quit IRC | 18:51 | |
kfox1111 | ah. keystone public doesn't have an external address anymore. | 18:51 |
sbezverk | after deploying compute kit, openstack volume ist fails | 18:51 |
*** sayantani01 has joined #openstack-kolla | 18:51 | |
kfox1111 | so, yeah, keystone-public shoudl have an external ip in the gate. | 18:52 |
sbezverk | kfox1111: I added it into common workflow | 18:52 |
kfox1111 | how is this wokring with other gate jobs though.... | 18:52 |
sbezverk | kfox1111: I think other jobs are getting it from all_values.yaml | 18:53 |
kfox1111 | but then compute kit should too shouldn't it? | 18:54 |
*** jmccarthy has left #openstack-kolla | 18:54 | |
sbezverk | kfox1111: not sure why it does not get it. have meeting in 5 minutes for 1 hour after that I will apply changes from your review.. bbiab | 18:55 |
kfox1111 | k. | 18:55 |
*** krtaylor has quit IRC | 18:57 | |
*** salv-orlando has joined #openstack-kolla | 19:00 | |
*** fguillot has quit IRC | 19:00 | |
kfox1111 | sbezverk: yeah, keystone-public-svc has global.keystone.all.port_external=true | 19:01 |
*** salv-orl_ has quit IRC | 19:02 | |
*** mgoddard has quit IRC | 19:06 | |
*** markus-k has quit IRC | 19:12 | |
*** markus-k has joined #openstack-kolla | 19:14 | |
*** david-lyle has joined #openstack-kolla | 19:15 | |
*** MasterOfBugs has joined #openstack-kolla | 19:16 | |
*** tvignaud has quit IRC | 19:16 | |
*** tvignaud has joined #openstack-kolla | 19:17 | |
harlowja | anyone seen the following issue https://gist.github.com/harlowja/8521b90a06429cc8f903103d593ca1c8 ? | 19:31 |
*** sdake has joined #openstack-kolla | 19:31 | |
*** david-lyle has quit IRC | 19:31 | |
harlowja | pretty sure its related to setuptools borkage, but just wanted to see if i'm alone here | 19:31 |
*** skuda has quit IRC | 19:32 | |
harlowja | basically all builds are messed up i think due to that | 19:32 |
*** fragatina has quit IRC | 19:33 | |
*** fragatina has joined #openstack-kolla | 19:33 | |
inc0 | works for me (standard operators answer #1) | 19:34 |
*** david-lyle has joined #openstack-kolla | 19:34 | |
*** v1k0d3n has joined #openstack-kolla | 19:36 | |
*** eaguilar has quit IRC | 19:38 | |
harlowja | hmmm | 19:39 |
harlowja | what version of setuptools gets installed into yours | 19:39 |
*** david-lyle has quit IRC | 19:40 | |
*** david-lyle has joined #openstack-kolla | 19:42 | |
inc0 | harlowja, 34.0.2 | 19:43 |
*** tonanhngo has joined #openstack-kolla | 19:43 | |
harlowja | k, hmmm, i'll check what i get | 19:43 |
*** mgoddard has joined #openstack-kolla | 19:46 | |
*** srwilkers has joined #openstack-kolla | 19:47 | |
srwilkers | o/ | 19:47 |
openstackgerrit | Merged openstack/kolla master: Add miss kolla releasenotes https://review.openstack.org/431418 | 19:50 |
sdake | hey peeps - have to get the car ashed | 19:52 |
sdake | washed | 19:52 |
sdake | bbl | 19:52 |
*** inc0 has quit IRC | 19:54 | |
*** ubuntu has joined #openstack-kolla | 19:55 | |
*** ubuntu is now known as Guest72360 | 19:55 | |
*** Jeffrey4l has quit IRC | 19:57 | |
*** Jeffrey4l has joined #openstack-kolla | 19:58 | |
*** krtaylor has joined #openstack-kolla | 19:59 | |
*** Guest72360 has quit IRC | 19:59 | |
*** ubuntu1 has joined #openstack-kolla | 20:01 | |
hrw | if someone has some free time then https://review.openstack.org/#/c/430940 (non-x86 archs support) waits for skilled reviewers. Small patch, does not change much for usual targets, adds two important architectures into list of supported ones and makes it easier for those which may come | 20:02 |
harlowja | https://github.com/pypa/setuptools/issues/937 inc :-/ | 20:02 |
harlowja | not cool setuptools | 20:03 |
harlowja | lol | 20:03 |
harlowja | weird that it happened though, especially since i think kolla installs pip | 20:04 |
*** ubuntu1 has quit IRC | 20:05 | |
*** david-lyle has quit IRC | 20:06 | |
*** inc0 has joined #openstack-kolla | 20:06 | |
*** matrohon has joined #openstack-kolla | 20:06 | |
*** fguillot has joined #openstack-kolla | 20:09 | |
*** sayantani01 has quit IRC | 20:09 | |
*** gfidente is now known as gfidente|afk | 20:10 | |
*** salv-orlando has quit IRC | 20:10 | |
*** sdake has quit IRC | 20:14 | |
*** vhosakot_ has joined #openstack-kolla | 20:16 | |
*** skuda has joined #openstack-kolla | 20:16 | |
*** tonanhngo has quit IRC | 20:17 | |
*** vhosakot has quit IRC | 20:19 | |
*** tonanhngo has joined #openstack-kolla | 20:20 | |
-openstackstatus- NOTICE: Restarting gerrit due to performance problems | 20:20 | |
hrw | harlowja: you want setuptools 33.1 - 34 has issues | 20:20 |
harlowja | ya, i wonder how 34 worked for inc0 | 20:21 |
harlowja | gonna try unfreezing the packaging requirement in upper-constraints | 20:21 |
harlowja | want to see if thats causing this | 20:21 |
*** tonanhngo_ has joined #openstack-kolla | 20:21 | |
inc0 | well don't forget that setuptools will get installed before pip hence before upper-constrains | 20:21 |
*** Serlex has left #openstack-kolla | 20:22 | |
hrw | harlowja: update pip to 9.0.1 first and then upgrade setuptools? | 20:23 |
harlowja | well kolla already installs pip from the latest | 20:23 |
harlowja | https://github.com/openstack/kolla/blob/master/docker/openstack-base/Dockerfile.j2#L236-L241 | 20:24 |
*** tonanhngo has quit IRC | 20:24 | |
hrw | let me dig a moment | 20:24 |
*** mannamne has joined #openstack-kolla | 20:25 | |
hrw | harlowja: pip install --upgrade six appdirs packaging;pip install --upgrade setuptools - maybe that way | 20:26 |
*** tonanhngo_ has quit IRC | 20:26 | |
harlowja | ya, maybe | 20:26 |
hrw | I cursed a lot during creation of virtualenv for kolla | 20:26 |
*** crushil has quit IRC | 20:28 | |
*** Pavo has quit IRC | 20:28 | |
*** skuda has quit IRC | 20:31 | |
*** vhosakot_ has quit IRC | 20:33 | |
*** schwicht has quit IRC | 20:33 | |
*** vhosakot has joined #openstack-kolla | 20:34 | |
*** harlowja_ has joined #openstack-kolla | 20:35 | |
*** crushil has joined #openstack-kolla | 20:35 | |
*** tonanhngo has joined #openstack-kolla | 20:35 | |
*** lamt has quit IRC | 20:36 | |
*** adrian_otto has quit IRC | 20:36 | |
*** harlowja has quit IRC | 20:37 | |
*** satyar has quit IRC | 20:38 | |
*** tvignaud has quit IRC | 20:39 | |
*** lamt has joined #openstack-kolla | 20:39 | |
*** jtriley has quit IRC | 20:42 | |
sbezverk | kfox1111: ping | 20:46 |
kfox1111 | hey | 20:46 |
*** mgoddard has quit IRC | 20:48 | |
sbezverk | kfox1111: I am a bit worried about the change you suggested. if i make common workflow values and ceph/iscsi values independent then I cannot combine then into a single script which mean ALL even microservices need to be changed to use 2 x --values | 20:48 |
sbezverk | it becomes even bigger change :( | 20:48 |
*** jrobinson has joined #openstack-kolla | 20:48 | |
sbezverk | what if I add comments to common_workflow and ceph/iscsi explaining how it should be maintainded? | 20:49 |
kfox1111 | sbezverk: yeah. thats what I was thinking too. but it should be much less volnerable to breakages I think. | 20:50 |
kfox1111 | ok. how about this. we do that second step in a followup ps? | 20:50 |
kfox1111 | easier to review that way. but fixes the issue quickly | 20:50 |
sbezverk | my concent is with these very key changes I might end troubleshooting more time and sdake will start crtiticizing me again ;) | 20:50 |
sbezverk | kfox1111: for sure | 20:51 |
kfox1111 | yeah. I get that. | 20:51 |
kfox1111 | ok. lets go with taht plan. | 20:51 |
sbezverk | I will implement 3 others changes you suggested right after | 20:51 |
kfox1111 | k. | 20:52 |
sbezverk | kfox1111: thanks a lot | 20:52 |
*** srwilkers has quit IRC | 20:52 | |
kfox1111 | np. | 20:52 |
*** sdake has joined #openstack-kolla | 21:02 | |
*** eaguilar has joined #openstack-kolla | 21:03 | |
*** sdake_ has joined #openstack-kolla | 21:07 | |
*** sdake has quit IRC | 21:07 | |
sbezverk | kfox1111: can you remove the block then please, so we could move forward | 21:07 |
kfox1111 | k | 21:08 |
harlowja_ | hrw so ya, updating the packaging constraint fixed it | 21:09 |
harlowja_ | https://gist.github.com/harlowja/c15e75c84ed1626a1a78f115edb7a92e basically | 21:09 |
harlowja_ | updating/removing the constraint | 21:09 |
openstackgerrit | Merged openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 21:12 |
*** sdake_ has quit IRC | 21:14 | |
sbezverk | kfox1111: starting working on part 2 of gate refactoring. :) | 21:15 |
kfox1111 | cool. thanks. :) | 21:15 |
*** gfidente|afk has quit IRC | 21:15 | |
bmace_ | after i finish this pass run, and it is looking good, may wait until all gate refactoring is done before dealing w/ merge issues, etc. | 21:19 |
bmace_ | for devenv | 21:20 |
*** fragatina has quit IRC | 21:20 | |
*** srwilkers has joined #openstack-kolla | 21:20 | |
sbezverk | bmace_: next step is just few minor changes, so please go ahead, nothing major will change, all files are in now.. | 21:22 |
*** tvignaud has joined #openstack-kolla | 21:23 | |
sbezverk | bmace_: I will do just several beautifications ;) | 21:23 |
bmace_ | sbezverk: thanks, good to hear it! | 21:23 |
*** nihilifer has quit IRC | 21:30 | |
*** nihilifer has joined #openstack-kolla | 21:31 | |
*** sdake has joined #openstack-kolla | 21:31 | |
*** Jeffrey4l_ has joined #openstack-kolla | 21:35 | |
*** Jeffrey4l has quit IRC | 21:35 | |
*** krtaylor has quit IRC | 21:41 | |
*** matrohon has quit IRC | 21:44 | |
*** adrian_otto has joined #openstack-kolla | 21:45 | |
*** skuda has joined #openstack-kolla | 21:45 | |
*** penfold has quit IRC | 21:51 | |
*** penfold has joined #openstack-kolla | 21:52 | |
*** david-lyle has joined #openstack-kolla | 21:53 | |
bmace_ | well, success.. the pre-merge end to end dev env came up with at least all services running.. going to commit them as is and then work on the merge. | 21:56 |
*** penfold has quit IRC | 21:57 | |
*** harlowja_ has quit IRC | 21:58 | |
bmace_ | well, so much for that, won't let you do the review if there is a known merge conflict.. damn smart gerrit! ;) | 21:58 |
*** salv-orlando has joined #openstack-kolla | 21:59 | |
*** salv-orlando has quit IRC | 22:00 | |
*** salv-orlando has joined #openstack-kolla | 22:01 | |
*** david-lyle has quit IRC | 22:03 | |
*** david-lyle has joined #openstack-kolla | 22:04 | |
*** harlowja has joined #openstack-kolla | 22:05 | |
inc0 | back | 22:07 |
*** fragatina has joined #openstack-kolla | 22:09 | |
*** mgoddard has joined #openstack-kolla | 22:10 | |
*** schwicht has joined #openstack-kolla | 22:12 | |
kfox1111 | bmace_: great news. :) | 22:12 |
kfox1111 | bmace_: darn. that sucks. | 22:12 |
inc0 | kfox1111: you're using weechat right? | 22:12 |
kfox1111 | irssi | 22:12 |
bmace_ | kfox1111: meh, had to be done either way.. at least this way folks can start to use it right away.. well, can't merge until after the kubernetes python lib is accepted too, so still may be a few days until it can go in | 22:12 |
inc0 | aw...ok... | 22:13 |
*** fguillot has quit IRC | 22:19 | |
*** jrobinson is now known as jrobinson-afk | 22:19 | |
*** david-lyle has quit IRC | 22:20 | |
*** fragatina has quit IRC | 22:21 | |
*** sdake has quit IRC | 22:21 | |
*** david-lyle has joined #openstack-kolla | 22:28 | |
*** crushil has quit IRC | 22:33 | |
*** sdake has joined #openstack-kolla | 22:36 | |
sdake | bmace_ work on merge? | 22:38 |
bmace_ | sdake: working on merge. ran end to end flawlessly pre-merge with an 8gb master node. | 22:41 |
sdake | you mean pre-merge of the gate rework? | 22:41 |
*** vhosakot has quit IRC | 22:41 | |
bmace_ | sdake: yes, need to merge in the gate changes now. | 22:41 |
sdake | what happens with a 4gb master and 4gb minions? | 22:41 |
*** vhosakot has joined #openstack-kolla | 22:42 | |
sdake | bmace_ i present to a meetup on the 15th - may like to use the dev env for that | 22:42 |
sdake | i've invited the community to listen in | 22:42 |
bmace_ | sdake: well, i can tell you with 2gb controller pods start self terminating like crazy about mid way through neutron deploy | 22:42 |
bmace_ | sdake: i have enough mem on my box for 8gb, so i didn't do the interim 4.. might work | 22:43 |
sdake | you mena 2gb kubernetes compute nodes? | 22:43 |
bmace_ | sdake: the env that did not work was 2gb across the board, control + compute.. because control blows up. what did work was 8gb control, 2gb compute | 22:43 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Gate refactor part deux https://review.openstack.org/431765 | 22:44 |
*** mannamne has quit IRC | 22:44 | |
sdake | by control - do you mean the kubernetes compute node was labelled a controller? | 22:44 |
sdake | kubernetes has a master, and compute nodes | 22:44 |
bmace_ | sdake: and feel free to use it. not 100% sure it will be merged in depending on what happens with the kubernetes library timing but you can always run with just the patch | 22:44 |
*** fragatina has joined #openstack-kolla | 22:44 | |
sbezverk | kfox1111: can you check this ps I want to make sure it is what you meant in your comment https://review.openstack.org/431765 | 22:44 |
sdake | bmace_ cool - will need your code rebased to use it i think ;-) | 22:45 |
bmace_ | sdake: yes, obviously the one running all the control kolla pods.. | 22:45 |
sdake | bmace_ roger thanks | 22:45 |
*** jrobinson-afk is now known as jrobinson | 22:47 | |
*** mgoddard has quit IRC | 22:47 | |
*** krtaylor has joined #openstack-kolla | 22:49 | |
*** dave-mccowan has quit IRC | 22:50 | |
*** david-lyle has quit IRC | 22:50 | |
*** david-lyle has joined #openstack-kolla | 22:50 | |
sdake | https://docs.google.com/document/d/1TW3P4c8auWwYy-w_5afIPDcGNLK3LZf0m14943eVfVg/edit?ts=58877ea7 | 22:53 |
sdake | kolla cores, have a look ^ | 22:53 |
sdake | and anyone else that is curious of course :) | 22:53 |
*** adrian_otto has quit IRC | 22:55 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Gate refactor part deux https://review.openstack.org/431765 | 23:02 |
openstackgerrit | Merged openstack/kolla-ansible master: Add Octavia doc link in README.rst https://review.openstack.org/431355 | 23:05 |
*** david-lyle_ has joined #openstack-kolla | 23:06 | |
*** david-lyle has quit IRC | 23:06 | |
openstackgerrit | Merged openstack/kolla-ansible master: use_forwarded_for is moved to api group https://review.openstack.org/431337 | 23:06 |
*** david-lyle_ has quit IRC | 23:09 | |
openstackgerrit | Borne Mace proposed openstack/kolla-kubernetes master: WIP: Added support for containerized dev bringup https://review.openstack.org/429295 | 23:10 |
*** vhosakot has quit IRC | 23:10 | |
*** esmiurium has joined #openstack-kolla | 23:11 | |
*** vhosakot has joined #openstack-kolla | 23:11 | |
*** yuanying has joined #openstack-kolla | 23:12 | |
kfox1111 | sbezverk: looking | 23:13 |
kfox1111 | sbezverk: yeah. perfect. :) | 23:15 |
kfox1111 | I wont +2 until the gate passes. thats bit me too many times. :/ | 23:15 |
kfox1111 | but has my +2. :) | 23:15 |
*** rwallner has quit IRC | 23:16 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Gate refactor part deux https://review.openstack.org/431765 | 23:17 |
bmace_ | kfox1111: sbezverk: isn't "job" a strange name for it? why not $storage_type or some such? | 23:18 |
kfox1111 | bmace_: not sure what your alking about. | 23:19 |
*** lamt has quit IRC | 23:19 | |
bmace_ | kfox1111: thought you guys were talking about the part 2 gate refactor.. was talking about the ceph_workflow_service change. | 23:19 |
kfox1111 | bmace_: we are. just not sure what part of the code you are talking about. | 23:20 |
kfox1111 | file/line maybe? | 23:20 |
kfox1111 | oh. I think I see what your saying. | 23:20 |
bmace_ | ceph_workflow_service 16 + 28 | 23:20 |
bmace_ | https://review.openstack.org/#/c/431765/2/tests/bin/ceph_workflow_service.sh | 23:21 |
kfox1111 | why "ceph" getting a job value? | 23:21 |
kfox1111 | its in terms of the gate jobs. | 23:21 |
kfox1111 | I think. | 23:21 |
kfox1111 | which happens to line up to storage_type in this case. | 23:22 |
kfox1111 | hmm... | 23:23 |
kfox1111 | yeah. it lines up to the job type in the gate. | 23:23 |
kfox1111 | so, "ceph" "ceph-multi" "external-ovs" "helm-entrypoint" etc. | 23:23 |
bmace_ | i guess if is only used in the gate it makes more sense.. for someone using it anywhere else, devenv, etc.. it is pretty non-obvious without some doc | 23:24 |
kfox1111 | yeah. | 23:25 |
kfox1111 | there could be a job=devenv option. | 23:26 |
kfox1111 | or we could figure out something else to rename job too. | 23:26 |
kfox1111 | its just historical as thats what the code got written for. totally open to changing it. | 23:27 |
bmace_ | if it comes down to just reflecting storage type, that seems like a more straight forward name. it is always ceph_multi in the devenv container. | 23:27 |
kfox1111 | its not always. | 23:27 |
kfox1111 | it can be "ceph" "ceph-multi" "external-ovs" "helm-entrypoint" etc. | 23:27 |
bmace_ | not in the devenv container, unless folks want to go and hand edit stuff | 23:28 |
*** fragatin_ has joined #openstack-kolla | 23:28 | |
kfox1111 | yeah. | 23:28 |
kfox1111 | the other option is to split it out further. | 23:28 |
*** fragatin_ has quit IRC | 23:28 | |
kfox1111 | the gate job type implies a storage_type. | 23:28 |
kfox1111 | we could break those two apart and in most of the scripts require both. | 23:28 |
sbezverk | kfox1111: the only concern I have is element_name I think without pinning them, some service like cinder-volume will fail | 23:28 |
kfox1111 | so, then it woudl be 'devenv' 'ceph' | 23:28 |
kfox1111 | or something. | 23:28 |
kfox1111 | sbezverk: shouldn't, as there shoudl be a default. if it doesn't have a default, I think thats a bug? | 23:29 |
bmace_ | yeah, i see.. well, i'm ok then leaving as it for the time being :) | 23:29 |
kfox1111 | bmace_: yeah. I totally see where your coming from and agree it shoudl be fixed. just not sure when. | 23:29 |
bmace_ | not an actual functional issue anyway, just felt odd when i was looking through the changes. | 23:29 |
kfox1111 | yeah. | 23:30 |
*** fragatina has quit IRC | 23:31 | |
sbezverk | bmace_: I do not mind to change it for something else, it kind of made sense to me but I am totally opened | 23:31 |
sbezverk | I can name it gate_job | 23:32 |
*** fragatina has joined #openstack-kolla | 23:32 | |
sbezverk | in this case it should be more clear | 23:32 |
bmace_ | sbezverk: after kfox1111 gave some more background as to where it was coming from, at this point it really doesn't purely represent storage type, so unless we rework things i think it is fine as is | 23:32 |
bmace_ | sbezverk: sure | 23:32 |
bmace_ | sbezverk: definitely a bit better | 23:32 |
sbezverk | bmace_: cool will change it, I am positive more revisions are comming ;) | 23:33 |
kfox1111 | designate's not in a good place. thats sad. :/ | 23:34 |
kfox1111 | it had a lot of potential. | 23:34 |
bmace_ | sbezverk: that v2 change looked pretty good at first glance though. glad to see nothing major, as you said. probably no or very minor merge issues from it | 23:34 |
openstackgerrit | Merged openstack/kolla master: Fix pushing images to local registry https://review.openstack.org/426338 | 23:35 |
sbezverk | bmace_: my concern that this change could uncover some mini bugs we might have, where default value for element_name does not get assigned.. | 23:36 |
sbezverk | but we will see | 23:36 |
*** mgiles has quit IRC | 23:38 | |
*** skuda has quit IRC | 23:48 | |
*** fragatina has quit IRC | 23:50 | |
*** fragatina has joined #openstack-kolla | 23:50 | |
*** ipsecguy has joined #openstack-kolla | 23:52 | |
*** srwilkers has quit IRC | 23:52 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!