Wednesday, 2016-12-21

*** l4yerffeJ has quit IRC00:51
*** l4yerffeJ has joined #openstack-nimble00:51
*** kevinz has joined #openstack-nimble01:08
zhenguomorning nimble!02:07
*** yuntongjin has joined #openstack-nimble02:08
shaohe_fengzhenguo: morning02:10
zhenguoshaohe_feng: o/02:10
zhenguoshaohe_feng: have you consulted the lawyer about our new name Mogan :P02:11
*** l4yerffeJ has quit IRC02:15
zhenguoliusheng: wrt https://review.openstack.org/#/c/412350/ , why other core projects all maintain a native context ?02:15
*** l4yerffeJ has joined #openstack-nimble02:16
liushengzhenguo: I think there are two reasons:1. the project need specific requirements; 2. there is no person to update the code since many functionalities the native context implementated has been supportted in oslo_context02:17
zhenguoliusheng: hah, so we don't need specific requirements?02:18
liushengzhenguo: as I found in Nimble, all the functionlities can be directly support by oslo_context02:18
zhenguoliusheng: yes, seems not02:18
zhenguoliusheng: ok, thanks for the clean up, but I'm curious about what specific requirements like, will we need in future?02:19
liushengzhenguo: at least we don't need currently :), but if we have specifc requiremet, we should also implement based on the current oslo_context02:19
zhenguoliusheng: yes, agree02:20
liushengzhenguo: thanks for pay attention to that with your valuable time, hah :)02:21
liushengzhenguo: FYI, I am try to add support for console in Nimble02:22
zhenguoliusheng: hah, seems I'm free from the POC02:22
liushengzhenguo: really, good news02:22
zhenguoliusheng: thanks, but for console, do you plan to use nova console proxy?02:22
liushengzhenguo: I don't know, I am just starting to study the nova implementation now02:23
liushengzhenguo: do you have any suggestion ?02:23
zhenguoliusheng: in fact, I have a solution about ironic console02:24
zhenguoliusheng: and I have finished the nova proxy, and it works02:24
liushengzhenguo: really? cool02:24
zhenguoliusheng: but that based on shellinabox, and it's used in our product02:24
liushengzhenguo: how about decoup from nova-proxy02:24
zhenguoliusheng: but the community didn't accept it finally, and use another solution02:25
liushengzhenguo: :(02:25
zhenguoliusheng: I think we need to reuse the nova-proxy02:25
zhenguoliusheng: there are a few proxy types, currently ironic leverage serialconsole-proxy02:26
liushengzhenguo: so we cannot to get rid of nova-proxy ?02:26
zhenguoliusheng: unless you copy it here :P02:26
liushengzhenguo: :(02:28
zhenguoliusheng: hah02:28
zhenguoliusheng: before the console work, seems we still don't have your functional tests landed yet :(02:28
zhenguoliusheng: about the instance related tests02:29
liushengzhenguo: sounds like I should put that console task aside temporarily02:29
liushengzhenguo: yes02:29
liushengzhenguo: you mean functional tests or tempest ?02:30
zhenguoliusheng: functional02:30
liushengzhenguo: i think the tempest is realy urgent02:30
zhenguoliusheng: hah02:30
liushengzhenguo: oh, I can fix the patch later02:30
zhenguoliusheng: thanks, I will dig out why the tempest doesn't work02:31
liushengzhenguo: thanks02:31
*** l4yerffeJ has quit IRC02:32
*** l4yerffeJ_ has joined #openstack-nimble02:32
zhenguoliusheng: but maybe after I finish the current task :D02:33
* liusheng need to devote himself to coding, since he has set a big FLAG (commits 100+) :(02:34
liushengzhenguo: L)02:34
liushengzhenguo: which task is high priority now :)02:35
zhenguoliusheng: I think config drive and floating ip02:36
zhenguoliusheng: and maybe we need to add keypair related API02:37
zhenguoliusheng: does nova manage keypair itself02:37
liushengzhenguo: yes02:38
liushengzhenguo: ok, I will pick one firstly02:38
zhenguoliusheng: thanks02:38
*** yuntongjin has quit IRC03:22
zhenguoliusheng: I will try to help you reach commits 100+ ASAP :P03:34
liushengzhenguo: haha03:34
liushengzhenguo: thanks a lot03:35
shaohe_fengzhenguo: I'm back.03:35
zhenguoshaohe_feng: welcome back!!!!03:35
liushengshaohe_feng: welcome!03:35
shaohe_fengzhenguo: yutong talks with me about some nimble status.03:35
shaohe_fengzhenguo: I'm just leave an hours. so passionate welcome. Haha03:36
shaohe_fengliusheng: ^03:36
zhenguoliusheng: lol, then you are well deserved to be a nimble core!03:36
liushengzhenguo: hah, thanks03:37
zhenguoshaohe_feng:  haha03:37
liushengshaohe_feng: always welcome you03:37
liushengzhenguo: :)03:37
shaohe_fenghaha03:38
shaohe_fengzhenguo: I looks into bifrost. seems it looks like a deploying  tools.03:42
zhenguoshaohe_feng: yes, it's used to deploy for standalone mode03:44
zhenguoshaohe_feng: it seems like can also deploy node by leveraging ansible03:44
shaohe_fengzhenguo: so no configdrive  can be leveraged. :(03:45
zhenguoshaohe_feng: you can see how nova use it03:46
zhenguoshaohe_feng: with configdrive, we can support keypair and password03:47
shaohe_fengzhenguo: yes. But's sometimes I try to avoid nova. because other project launched later than nova. So They do better than nova03:47
zhenguoshaohe_feng: hah03:48
zhenguoshaohe_feng: yes, but we should stand on top of nova instead of doing everything ourselves03:48
shaohe_fengzhenguo: yes. avoid repetition of rolling03:49
zhenguoshaohe_feng: yes03:49
shaohe_fengzhenguo: we can see, such as the authorization framework and quotas, neutron has do improvement.03:50
zhenguoshaohe_feng: yes, neutron and cinder are copied from nova at first, but they both do improvement03:52
* zhenguo away03:53
shaohe_fengzhenguo: also the taskflow in cinder. :)03:57
openstackgerritMerged openstack/nimble: Fix the instance type extra related APIs  https://review.openstack.org/41305304:04
openstackgerritMerged openstack/nimble: Correct the api samples of type extra APIs  https://review.openstack.org/41305604:04
openstackgerritMerged openstack/python-nimbleclient: Remove python2.4 compatibility support  https://review.openstack.org/41269704:59
openstackgerritMerged openstack/python-nimbleclient: Add Python 3.5 classifier and venv  https://review.openstack.org/41270005:02
*** yuntongjin has joined #openstack-nimble05:21
*** yuntongjin has quit IRC05:28
*** yuntongjin has joined #openstack-nimble05:50
*** l4yerffeJ has joined #openstack-nimble06:17
*** Jeffrey4l has quit IRC06:20
*** l4yerffeJ_ has quit IRC06:21
liushengzhenguo: hi zhenguo, wichi API or command you tested with https://review.openstack.org/#/c/412350/ that show many KeyError 'user_id' ?06:21
zhenguoliusheng: when start nimble-engine it shows KeyError, seems every API can cause many errors06:25
zhenguoliusheng: it's ok in your env?06:26
liushengzhenguo: yes06:26
liushengzhenguo: I cannot find any keyerror06:27
zhenguoliusheng: oh, that's weired06:27
zhenguoliusheng: I will check again06:27
zhenguoliusheng: I have pasted the log there06:33
openstackgerritMerged openstack/nimble: Refactor network APIs  https://review.openstack.org/41315406:34
*** Jeffrey4l has joined #openstack-nimble06:35
liushengzhenguo: I can create isntance sucessfully with that patch, maybe I know the reason of the "KeyError", seems is because your log format configurations06:37
zhenguoliusheng: it doesn't affect functionalities, yes seems just when logging06:37
zhenguoliusheng: yes, I can find user_id in my loging_context_format_string06:38
liushengzhenguo: let mye try06:38
liushengzhenguo: does the user_id in your nimble.conf ?06:39
zhenguoliusheng: yes,06:39
zhenguoliusheng: but logging_context_format_string is by default06:39
liushengzhenguo: yes, but it should be user and tenant than user_id and project_id06:39
liushengzhenguo: just reference the ironic.conf06:40
liushengzhenguo: since I have removed the lines of logging format in my nimble.conf, lol06:40
zhenguoliusheng: haha06:40
zhenguoliusheng: why ironic use a different format06:41
liushengzhenguo: can your please paste the lines in nimble.conf about the logging formant ?06:41
liushengzhenguo: I don't know, but I think the ironic's configuration is correct06:42
zhenguoliusheng: user_id, project_id, instance, message06:42
zhenguoliusheng: agree, but how could we handle that06:43
liushengzhenguo: seems the lines is automatically added when installed devstack, but it won't be added in the jenkins' job's devstac, that is why the jobs didn06:45
liushengdidn't failed06:45
zhenguoliusheng: seems it is06:46
liushenglogging_exception_prefix = %(color)s%(asctime)s.%(msecs)03d TRACE %(name)s ^[[01;35m%(instance)s^[[00m06:46
liushenglogging_debug_format_suffix = ^[[00;33mfrom (pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d^[[00m06:46
liushenglogging_default_format_string = %(asctime)s.%(msecs)03d %(color)s%(levelname)s %(name)s [^[[00;36m-%(color)s] ^[[01;35m%(instance)s%(color)s%(message)s^[[00m06:46
liushenglogging_context_format_string = %(asctime)s.%(msecs)03d %(color)s%(levelname)s %(name)s [^[[01;36m%(request_id)s ^[[00;36m%(user)s %(tenant)s%(color)s] ^[[01;35m%(instance)s%(color)s%(message)s^[[00m06:46
liusheng06:46
liushengzhenguo: can please paste the lines like these in nimble.conf for me ?06:46
zhenguoliusheng: sorry, I can't copy/paste from blue cloud to yellow cloud :(06:46
liushengzhenguo: :(06:46
liushengzhenguo: you use irc in yellow cloud, lol06:47
zhenguoliusheng: seems the only different is user_id/user and project_id/project06:47
zhenguolusheng: yes, hah06:47
liushengzhenguo: yes, it is should be user and tenant than user_id and project_id06:47
liushengzhenguo: I will try to find the reason06:48
zhenguoliusheng: yes, I find glance also use user and project instead of xx_id06:48
zhenguoliusheng: aha, it's because we set user_id in our devstack plugin06:49
liushengzhenguo: where ?06:49
liusheng    if [ "$LOG_COLOR" == "True" ] && [ "$SYSLOG" == "False" ]; then06:50
liusheng        setup_colorized_logging ${NIMBLE_CONF_FILE} DEFAULT "project_id" "user_id"06:50
liusheng    fi06:50
liushengzhenguo: maybe here, hah06:50
zhenguoliusheng: yes06:50
zhenguoliusheng: please update it with your patch, hah06:51
liusheng    if [ "$LOG_COLOR" == "True" ] && [ "$SYSLOG" == "False" ]; then06:51
liusheng        setup_colorized_logging $IRONIC_CONF_FILE DEFAULT tenant user06:51
liusheng    fi06:51
liushengzhenguo: this is the ironic's06:51
liushengzhenguo: ok06:51
zhenguoliusheng: hah06:52
openstackgerritliusheng proposed openstack/nimble: Use oslo context instead of the native context implementation  https://review.openstack.org/41235006:52
liushengzhenguo: thanks for review and finding the bug :)06:53
zhenguoliusheng: hah, it's my duty :)06:54
*** openstackgerrit has quit IRC07:48
shaohe_fengzhenguo: liusheng: have you seen this provisioning states. http://docs.openstack.org/developer/ironic/dev/states.html08:11
zhenguoshaohe_feng: it's ironic's state machine08:13
shaohe_fengzhenguo: yes. it looks complex08:14
zhenguoshaohe_feng: ironic needs it08:14
shaohe_fengzhenguo:In the docs:  There are a few other API-initiated-transitions that are possible from non-stable states.08:15
shaohe_fengzhenguo: so which are thes API-initiated-transitions?08:15
shaohe_fengclean wait08:15
shaohe_fengzhenguo: clean wait08:15
shaohe_fengzhenguo: clean wait -> clean failed08:16
zhenguoshaohe_feng: means via API, hah08:16
shaohe_fengzhenguo: is an example,08:17
zhenguoshaohe_feng: you mean clean wait to clean failed is API-initiated-transition?08:18
shaohe_fengzhenguo: API-initiated-transitions from non-stable states, usually we are abort or interrupt something.08:18
shaohe_fengzhenguo: I means is API-initiated-transitions from non-stable states.08:18
shaohe_fengzhenguo: seems like nimble, the building status is non-stable states during creating .08:19
zhenguoshaohe_feng: yes, sometimes the sate is stuck on non-stable, so we should have a way to make it transition08:19
zhenguoshaohe_feng: but we are not that complex08:19
shaohe_fengzhenguo: and we can API-initiated-transitions to delete the instance.08:20
zhenguoshaohe_feng: if we can catch exceptions we can move it from building to error08:20
shaohe_fengzhenguo: yes. we have not abort operation.08:20
shaohe_fengzhenguo: yes.08:20
zhenguoshaohe_feng: and we can delete instance in any state, lol, that's the difference08:21
zhenguoshaohe_feng: ironic must follow the state machine to do delete operation08:21
shaohe_fengzhenguo: Nice, both stable and unstable state.08:21
shaohe_fengzhenguo: MAAS can not delete the instance in unstable state.08:21
zhenguoshaohe_feng: I'm now refactoring the deleting instance part08:21
shaohe_fengzhenguo: This is a good feature than MAAS.08:22
zhenguoshaohe_feng: hah, but that will bring some issues to us as well, like deleting when building08:22
shaohe_fengzhenguo: you need boast this feature  when  promoting nimble.08:23
zhenguoshaohe_feng: but nova support this as well, they will compare us with nova instead of MAAS08:24
shaohe_fengzhenguo: Yes. we need to address these issues. that's why we are better than MAAS. :)08:24
shaohe_fengzhenguo: OK. How does nova address these issues?08:25
shaohe_fengzhenguo: what's the issues?08:25
zhenguoshaohe_feng: nova check whether instance exists in every phase08:25
shaohe_fengzhenguo: o, you have mention it to me before.08:26
zhenguoshaohe_feng: not sure how to handle exception and how to revert08:26
shaohe_fengzhenguo: I"m too older to remember many things.08:27
zhenguoshaohe_feng: hah08:27
zhenguoshaohe_feng: have you started working on configdrive ?08:28
shaohe_fengzhenguo: yes.08:30
zhenguoshaohe_feng: excelent08:30
shaohe_fengzhenguo: it http://developer.openstack.org/api-ref/baremetal/?expanded=create-node-detail,change-node-provision-state-detail08:30
shaohe_fengzhenguo: provision support configdrive.08:31
shaohe_fengzhenguo: and I read up the provision docs I find this status machine08:32
zhenguoshaohe_feng: yes, you can pass configdrive with it, I would suggest you refer to nova.08:32
shaohe_fengzhenguo: for delete, I think maybe 2 ways.08:32
shaohe_fengzhenguo: 1. maybe let task flow to rember the network and other info, that need to destroy08:33
shaohe_fengif we do not support deleted fields in instance DB.08:33
shaohe_fengzhenguo: 2. add deleted fields in instance DB08:34
shaohe_fengwe delete request, destroy all and return 200, then instance in not in building.08:34
zhenguoshaohe_feng: currently I doubt whether we need to introduce taskflow to delete instance08:35
shaohe_fengreturn 201, if instance in building, and mark the deleted as Ture.08:35
zhenguoshaohe_feng: do we have to revert anything when deleting08:36
zhenguoliusheng: are you around? let's talk about deleting instance again08:36
liushengzhenguo: yes08:36
shaohe_fengdelete request again or other operations request, return No Instance if no instance in DB or deleted as Ture08:37
liushengabout instance deletion with taskflow ?08:37
zhenguoliusheng, shaohe_feng: currently, I don't think we need to introduce t taskflow to delete instnace08:37
zhenguoliusheng: yes08:37
shaohe_fengzhenguo: agree. we can introduce it on demand.08:37
zhenguoliusheng, shaohe_feng: seems we don't need to revert when there's exception when deleting an instance08:38
liushengzhenguo: shaohe_feng, hmm, I agree we can introduce anything only when we really want08:39
shaohe_fengzhenguo: an edge case maybe not in really scenario, for products have HA.08:40
liushengzhenguo: agree that seems we don't need it in deletion now08:40
zhenguoliusheng, shaohe_feng: but we really need to refactor deleting now, it's too simple.... too young08:40
liushengzhenguo: lol08:40
liushengzhenguo: we only provide functionalities now08:41
zhenguoliusheng: yes, it doesn't change since the demo08:42
shaohe_fengzhenguo: what's delete routine?  when destroy the network, something wrong with neutron08:42
zhenguoshaohe_feng: maybe just log a warning like what nova does08:43
shaohe_fengzhenguo: ignore the error, and continue?08:43
shaohe_fengzhenguo: Got it. Log("something wrong with delete network, maybe it still exist"), and continue to delete the instance.08:44
zhenguoshaohe_feng, liusheng: but there will be some potential problems, as we use MAC to create neutron port, if failed to delete it, then the ironic node will never to used again08:44
liushengshaohe_feng: that is like what Nova implemented08:44
zhenguoshaohe_feng, liusheng: and now we ignore rescheduleing for network error, so it may just raise an exception for user's create request08:45
shaohe_fengliusheng: zhenguo: so there will be some zombie resource in nova, if nova does these ways.08:46
shaohe_fengliusheng: zhenguo: and admin need to reap these zombies by manually.08:46
shaohe_fengzhenguo: zhenguo: right?08:46
zhenguoshaohe_feng: yes, I think zombie resources are OK, as long as it doesn't affect us08:47
liushengshaohe_feng, zhenguo I just think that we may don't need to sonsider too many edge scenarios ?08:47
zhenguoshaohe_feng: as we have lots and lots of resouces in a cloud, lol08:47
liushengshaohe_feng, zhenguo right ?08:47
zhenguoliusheng: agree08:47
shaohe_fengzhenguo: OK, in cloud zombie resources can not be avoided.08:48
yuntongjinwe can use periodly sync08:52
shaohe_fengzhenguo: yuntongjin tells me, nova can reap the zombies.08:52
shaohe_fengliusheng: ^08:53
zhenguoyuntongjin, shaohe_feng, liusheng: currently we delete the instance from DB, so there's no any record about what's the zombie resouces08:54
liushengzhenguo: yeah, seems nova record the resources08:59
*** openstackgerrit has joined #openstack-nimble08:59
openstackgerritMerged openstack/nimble: Use oslo context instead of the native context implementation  https://review.openstack.org/41235008:59
zhenguoliusheng: all sub resouces in nova is in a seperate db table09:00
liushengzhenguo: yes09:06
* zhenguo brb09:10
shaohe_fengliusheng: zhenguo: yuntongjin: send a email about the zombie. we can continue in the thread whenever we want to discuss it.09:23
shaohe_fengIRC is an instant messaging service, email is good to track a long term dicussion.09:26
*** yuntongjin has quit IRC09:40
shaohe_fengzhenguo: do we need to support an provision API?10:01
shaohe_fengzhenguo: http://developer.openstack.org/api-ref/baremetal/?expanded=create-node-detail,change-node-provision-state-detail10:01
shaohe_fengzhenguo: IMHO, we should not.10:01
zhenguoshaohe_feng: no, we shouldn't10:02
shaohe_fengzhenguo: but maybe we can add to split this provision API10:02
zhenguoshaohe_feng: our create and delete API is like that10:03
*** kevinz has quit IRC10:03
shaohe_fengzhenguo: confige drivers should be pass with instance create. and self-healing mechanism internal for nimble to change the provision status, for example un-stable status.10:06
shaohe_fengzhenguo: and some are need to merge the nimble instance action?10:06
zhenguoshaohe_feng: we don't quite care about ironic provision state, like it's in clean failed or something like that10:07
zhenguoshaohe_feng: that should be fixed on ironic side10:07
shaohe_fengzhenguo: call you.10:08
shaohe_fengby wechat.10:08
zhenguoshaohe_feng: we just use ironic's available nodes and release them when delete instance10:08
shaohe_fengzhenguo: who will maintain the ironic?10:09
openstackgerritliusheng proposed openstack/nimble: Add instance CURD related functional tests  https://review.openstack.org/39806810:13
zhenguoshaohe_feng: I have some internal stuff, will ping you back10:14
* zhenguo away10:14
*** Kevin_Zheng has quit IRC10:15
*** Kevin_Zheng has joined #openstack-nimble10:15
openstackgerritliusheng proposed openstack/nimble: Add support for updating instance type  https://review.openstack.org/38643910:32
*** Jeffrey4l has quit IRC11:36
*** l4yerffeJ_ has joined #openstack-nimble13:00
*** l4yerffeJ has quit IRC13:04
*** liusheng has quit IRC13:25
*** liusheng has joined #openstack-nimble13:36
*** liusheng has quit IRC15:00
*** liusheng has joined #openstack-nimble15:11
openstackgerritZhenguo Niu proposed openstack/nimble: Refactor delete_instance  https://review.openstack.org/41367715:19
*** Jeffrey4l has joined #openstack-nimble15:54
zhenguoliusheng, shaohe_feng: hi, please help to look at this https://review.openstack.org/#/c/413677/ when you are available.16:03
*** Kevin_Zheng has quit IRC16:27
*** openstackstatus has joined #openstack-nimble17:00
*** ChanServ sets mode: +v openstackstatus17:00
*** openstackstatus has quit IRC17:02
*** openstack has quit IRC17:02
*** openstack has joined #openstack-nimble17:07
-openstackstatus- NOTICE: Gerrit is being restarted to update its OpenID SSO configuration17:58
*** l4yerffeJ has joined #openstack-nimble21:32
*** Jeffrey4l has quit IRC21:35
*** l4yerffeJ_ has quit IRC21:35
*** l4yerffeJ has quit IRC23:09
*** l4yerffeJ has joined #openstack-nimble23:09

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!