*** vnogin has quit IRC | 00:18 | |
*** ykarel has joined #puppet-openstack | 01:30 | |
*** ilbot3 has quit IRC | 01:44 | |
*** ilbot3 has joined #puppet-openstack | 01:57 | |
*** ykarel has quit IRC | 02:17 | |
*** vnogin has joined #puppet-openstack | 02:42 | |
openstackgerrit | Merged openstack/puppet-zaqar master: neat: missing : in $::os_service_default https://review.openstack.org/567761 | 03:05 |
---|---|---|
openstackgerrit | Merged openstack/puppet-ceilometer master: neat: missing : in $::os_service_default https://review.openstack.org/567766 | 03:05 |
*** vnogin has quit IRC | 03:15 | |
*** vnogin_ has joined #puppet-openstack | 03:15 | |
*** vnogin_ has quit IRC | 03:20 | |
*** ykarel has joined #puppet-openstack | 04:01 | |
*** ykarel has quit IRC | 04:03 | |
*** ykarel has joined #puppet-openstack | 04:05 | |
*** armaan has joined #puppet-openstack | 04:50 | |
*** armaan has quit IRC | 04:52 | |
*** armaan has joined #puppet-openstack | 04:52 | |
*** skramaja has joined #puppet-openstack | 05:10 | |
*** skramaja_ has joined #puppet-openstack | 05:18 | |
*** skramaja has quit IRC | 05:18 | |
*** agurenko has joined #puppet-openstack | 05:24 | |
*** vnogin has joined #puppet-openstack | 05:49 | |
*** skramaja_ is now known as skramaja | 06:03 | |
*** vnogin has quit IRC | 06:07 | |
*** vnogin has joined #puppet-openstack | 06:10 | |
*** vnogin has quit IRC | 06:15 | |
*** gfidente has joined #puppet-openstack | 06:16 | |
*** gfidente has quit IRC | 06:16 | |
*** gfidente has joined #puppet-openstack | 06:16 | |
*** jtomasek has joined #puppet-openstack | 06:33 | |
*** armaan_ has joined #puppet-openstack | 07:05 | |
*** armaan has quit IRC | 07:09 | |
*** tesseract has joined #puppet-openstack | 07:10 | |
*** dpawlik has joined #puppet-openstack | 07:13 | |
*** jaganathan has joined #puppet-openstack | 07:17 | |
*** amoralej|off is now known as amoralej | 07:19 | |
*** armaan has joined #puppet-openstack | 07:29 | |
*** jaganathan has quit IRC | 07:31 | |
*** jaganathan has joined #puppet-openstack | 07:31 | |
*** armaan_ has quit IRC | 07:32 | |
*** tosky has joined #puppet-openstack | 07:37 | |
*** rcernin has quit IRC | 07:39 | |
*** ykarel is now known as ykarel|lunch | 07:49 | |
*** jpena|off is now known as jpena | 07:53 | |
*** rpittau has joined #puppet-openstack | 07:53 | |
*** olap has joined #puppet-openstack | 07:57 | |
*** salmankhan has joined #puppet-openstack | 08:12 | |
*** skramaja_ has joined #puppet-openstack | 08:14 | |
*** jaganathan_ has joined #puppet-openstack | 08:14 | |
*** jaganathan has quit IRC | 08:14 | |
*** skramaja has quit IRC | 08:14 | |
*** dtantsur|afk is now known as dtantsur | 08:17 | |
*** skramaja_ has quit IRC | 08:18 | |
*** skramaja_ has joined #puppet-openstack | 08:18 | |
*** jaganathan_ has quit IRC | 08:18 | |
*** skramaja has joined #puppet-openstack | 08:21 | |
*** skramaja_ has quit IRC | 08:25 | |
*** skramaja_ has joined #puppet-openstack | 08:25 | |
*** skramaja has quit IRC | 08:25 | |
*** derekh has joined #puppet-openstack | 08:29 | |
*** jaganathan_ has joined #puppet-openstack | 08:30 | |
*** mandre_off is now known as mandre | 08:37 | |
*** ykarel|lunch is now known as ykarel | 09:07 | |
*** dtantsur is now known as dtantsur|brb | 09:08 | |
*** dpawlik has quit IRC | 09:10 | |
*** amorin has joined #puppet-openstack | 09:10 | |
*** salmankhan has quit IRC | 09:25 | |
*** salmankhan has joined #puppet-openstack | 09:31 | |
*** armaan has quit IRC | 09:43 | |
*** armaan has joined #puppet-openstack | 09:44 | |
*** dpawlik has joined #puppet-openstack | 09:48 | |
*** dpawlik has quit IRC | 09:54 | |
*** dpawlik has joined #puppet-openstack | 09:55 | |
*** jaosorior has joined #puppet-openstack | 09:56 | |
*** chem has joined #puppet-openstack | 09:59 | |
*** chem has quit IRC | 10:04 | |
*** chem has joined #puppet-openstack | 10:15 | |
zigo | mnaser: tobasco: EmilienM: mwhahaha: I've found out that recent changes in puppet-openstack are making Debian fail, because "neutron net list" is issued before neutron-server is fully up, it then fails instead of retrying or waiting for longer. How can I fix that? I had a look into puppet-neutron, and it looks like burried in the lib/puppet folder with some weirdo ruby code that I hardly can read... | 10:32 |
*** dtantsur|brb is now known as dtantsur | 10:38 | |
*** vnogin has joined #puppet-openstack | 10:41 | |
*** atoth has quit IRC | 10:48 | |
*** armaan has quit IRC | 10:49 | |
*** armaan has joined #puppet-openstack | 10:49 | |
zigo | Also, it feels like it worked before and doesn't anymore (as in: it was retrying), but I'm not sure. | 10:56 |
*** armaan has quit IRC | 10:59 | |
*** armaan has joined #puppet-openstack | 10:59 | |
*** vnogin has quit IRC | 11:13 | |
*** dpawlik has quit IRC | 11:16 | |
*** ykarel is now known as ykarel|afk | 11:21 | |
*** dpawlik has joined #puppet-openstack | 11:23 | |
*** vnogin has joined #puppet-openstack | 11:26 | |
*** vnogin has quit IRC | 11:26 | |
*** vnogin has joined #puppet-openstack | 11:30 | |
*** jpena is now known as jpena|lunch | 11:31 | |
*** vnogin has quit IRC | 11:36 | |
*** atoth has joined #puppet-openstack | 11:44 | |
*** amoralej is now known as amoralej|lunch | 11:45 | |
*** ykarel|afk is now known as ykarel | 11:57 | |
*** gyankum has joined #puppet-openstack | 12:11 | |
*** vnogin has joined #puppet-openstack | 12:17 | |
*** jaganathan_ has quit IRC | 12:19 | |
*** skramaja_ has quit IRC | 12:19 | |
*** jaganathan_ has joined #puppet-openstack | 12:19 | |
*** vinsh has quit IRC | 12:22 | |
*** skramaja_ has joined #puppet-openstack | 12:23 | |
*** vinsh has joined #puppet-openstack | 12:23 | |
*** jpena|lunch is now known as jpena | 12:25 | |
*** trown|outtypewww is now known as trown | 12:25 | |
mwhahaha | zigo: which provider is it? there might be a missing dependency or something | 12:26 |
mwhahaha | zigo: alternatively is neutron-server just taking way to long to start? | 12:26 |
zigo | mwhahaha: It does take a long time to start indeed. | 12:26 |
zigo | mwhahaha: I'm not sure how to tell puppet-openstack to just wait ... | 12:27 |
zigo | mwhahaha: Oh, I think I probably know how to fix it at the packaging level ! :) | 12:27 |
mwhahaha | that seems odd that we don't see it in other deployments | 12:27 |
zigo | ie: use systemd notify ... | 12:27 |
zigo | mwhahaha: Do you know if systemd notify is used in Red Hat's unit? | 12:27 |
mwhahaha | unlikely | 12:28 |
mwhahaha | we don't start services in packaging | 12:28 |
zigo | mwhahaha: That's orthogonal, it's just the definition of the .service file ! | 12:28 |
mwhahaha | https://github.com/rdo-packages/neutron-distgit/blob/rpm-master/neutron-server.service | 12:29 |
mwhahaha | there is a type=notify, is that what you mean? | 12:29 |
zigo | Yeah, it is ! :) | 12:29 |
zigo | So that systemctl start doesn't say "started" before it really is. | 12:29 |
zigo | I'll switch to that, and see how it goes. | 12:29 |
zigo | Why is it *always* when starting to chat with others that I find the correct solution ... :P | 12:30 |
zigo | (even after long days scratching my head...) | 12:30 |
*** skramaja_ is now known as skramaja | 12:32 | |
zigo | mwhahaha: Is there a NotifyAccess defined as well in Red Hat? | 12:32 |
mwhahaha | https://github.com/rdo-packages/neutron-distgit/blob/dca5726154639e7ab8412982d34def59e38d0a29/neutron-server.service#L10 | 12:32 |
mwhahaha | set to all | 12:32 |
zigo | Ah, thanks. | 12:34 |
*** amoralej|lunch is now known as amoralej | 12:39 | |
*** gyankum has quit IRC | 12:42 | |
*** dmsimard is now known as dmsimard|off | 12:58 | |
* zigo restarts a scenario001 run in a VM | 13:01 | |
*** agurenko has quit IRC | 13:03 | |
*** agurenko has joined #puppet-openstack | 13:05 | |
*** rmart04 has joined #puppet-openstack | 13:20 | |
*** trozet has joined #puppet-openstack | 13:20 | |
*** vnogin has quit IRC | 13:23 | |
*** vnogin has joined #puppet-openstack | 13:34 | |
*** alee has joined #puppet-openstack | 13:39 | |
*** armaan has quit IRC | 13:42 | |
*** armaan has joined #puppet-openstack | 13:43 | |
*** armaan has quit IRC | 13:47 | |
*** armaan has joined #puppet-openstack | 13:47 | |
*** armaan has quit IRC | 13:48 | |
*** armaan has joined #puppet-openstack | 13:49 | |
*** beekneemech is now known as bnemec | 13:59 | |
*** vnogin has quit IRC | 14:00 | |
*** skramaja has quit IRC | 14:22 | |
zigo | mwhahaha: Looks like adding Type=notify isn't enough, and I still get into error because it takes too much time to get neutron-server started. | 14:28 |
zigo | How can I fix that? | 14:28 |
* mwhahaha shrugs | 14:29 | |
zigo | Best IMO would be to get these list stuff to retry a few times ... | 14:29 |
mwhahaha | what's erroring? | 14:29 |
mwhahaha | also are you running in wsgi? | 14:29 |
zigo | mwhahaha: No, it's plain eventlet standard stuff. | 14:29 |
zigo | 2018-05-14 14:21:22 +0000 Puppet::Type::Neutron_network::ProviderNeutron (notice): Unable to complete neutron request due to non-fatal error: "Execution of '/usr/bin/neutron net-list --format=csv --column=id --quote=none' returned 1: neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead. | 14:29 |
zigo | 2018-05-14 14:21:31 +0000 Puppet (err): Failed to apply catalog: Can't retrieve net-list because Neutron or Keystone API is not available. | 14:29 |
zigo | That's what I get... | 14:30 |
*** Mosibi has quit IRC | 14:30 | |
zigo | Later, if I run puppet again, then it does work until end (at least, it looks like it...). | 14:31 |
mwhahaha | not sure. seems odd to be a debian specific thing | 14:31 |
zigo | Right. | 14:31 |
zigo | I also don't have SSL working, I have to set it to false in the scenario001.pp. | 14:31 |
mwhahaha | that is a really old provider that hasn't been updated to use the opesntack client bits | 14:31 |
zigo | Not sure why... | 14:31 |
zigo | Yeah. | 14:32 |
zigo | At some point, /usr/bin/neutron wont be available ! :) | 14:32 |
zigo | But that's not the point, it should be a bit more resilient to failure. | 14:32 |
mwhahaha | yea i think we have some retry logic in the openstack stuff | 14:33 |
zigo | It would be lib/puppet/provider/neutron_network/neutron.rb right? | 14:33 |
zigo | If you give me some examples to look at, maybe I can fix things? | 14:33 |
zigo | You mean openstack_extras, right? | 14:34 |
tobasco | zigo: sorry for not checking, i've been stuck at stuff all day, i will read through asap when i get time | 14:34 |
mwhahaha | yea it needs to inherit from the openstack.rb bits and all the commands/formats need to be updated | 14:34 |
*** gyankum has joined #puppet-openstack | 14:34 | |
*** gyankum has quit IRC | 14:34 | |
mwhahaha | puppet providers are a pain | 14:35 |
mwhahaha | https://github.com/openstack/puppet-nova/blob/master/lib/puppet/provider/nova_flavor/openstack.rb | 14:35 |
mwhahaha | there's an example of an openstack version | 14:36 |
mwhahaha | basically it runs 'openstack <some arguments' | 14:36 |
mwhahaha | and the providers generate the arguments | 14:36 |
mwhahaha | so we need to convert it from neutron <args> to openstack <args> | 14:36 |
mwhahaha | and update the response parser | 14:36 |
mwhahaha | the problem usually comes in when the format is different or the command doesn't exist in the openstack client | 14:37 |
tobasco | i read through all providers a while ago and i totally understood why there was a wishlist bug to rewrite them using api calls from ruby :) | 14:37 |
mwhahaha | it would be so much more efficient but the lack of a ruby sdk and people means it'll probably never happen | 14:38 |
zigo | Well, neutron net-list --format=csv --column=id --quote=none would be: | 14:39 |
zigo | openstack network list --format=csv --column=ID --quote=none | 14:39 |
zigo | Note that the field id becomes ID, rest of is the same. | 14:39 |
*** rajinir has joined #puppet-openstack | 14:40 | |
zigo | Gosh, it doesn't look like easy to write ... :/ | 14:41 |
zigo | mwhahaha: Isn't there is just a workaround to make lib/puppet/provider/neutron_network/neutron.rb retry, instead of rewriting it all? :/ | 14:42 |
zigo | It's not laziness, just I'm scared I wont be able to rewrite it all. | 14:42 |
*** vnogin has joined #puppet-openstack | 14:42 | |
mwhahaha | you'd have to port the retry logic over | 14:42 |
mwhahaha | https://github.com/openstack/puppet-openstacklib/commit/fedb3152c9045c984b1296e435997ad7fc851b9e | 14:43 |
mwhahaha | so something like that | 14:43 |
mwhahaha | I think https://github.com/openstack/puppet-openstacklib/commit/fedb3152c9045c984b1296e435997ad7fc851b9e is what it currently looks like | 14:43 |
mwhahaha | so yes you can, it's only slightly less complex :D | 14:43 |
zigo | Right ... :( | 14:44 |
zigo | mwhahaha: How about just adding a 30 second wait time after starting neutron-server? (as a temporary solution) | 14:48 |
zigo | (and only for Debian...) | 14:48 |
mwhahaha | Yea no | 14:48 |
zigo | :) | 14:48 |
* zigo is thinking about more ways to cheat... | 14:49 | |
zigo | What I think is that the systemd notify of neutron is simply put at the wrong position. | 14:50 |
mwhahaha | We have a class that you could use for neutron to see when it's up | 14:50 |
mwhahaha | Gimme a few mins to dig it up | 14:50 |
zigo | Ah, nice. | 14:50 |
*** vnogin has quit IRC | 14:53 | |
*** vnogin has joined #puppet-openstack | 14:53 | |
*** armaan has quit IRC | 14:53 | |
*** armaan has joined #puppet-openstack | 14:53 | |
mwhahaha | https://github.com/openstack/puppet-openstacklib/blob/master/manifests/service_validation.pp#L64 | 14:54 |
mwhahaha | so you could define your own service validation and wedge it between the Service<| title == 'neutron-server'|> -> Openstacklib::Service_validation<| title == 'neutron-is-up' |> -> Neutron_network<||> | 14:55 |
mwhahaha | or something like that | 14:55 |
*** Mosibi has joined #puppet-openstack | 14:58 | |
tobasco | mwhahaha: could you check my top three here https://review.openstack.org/#/q/owner:tobias%2540busybox.se+status:open | 14:59 |
mwhahaha | k | 15:00 |
tobasco | ty | 15:02 |
zigo | mwhahaha: I don't know what you mean there... :/ | 15:03 |
zigo | (I had a look before searching for examples ...) | 15:04 |
zigo | (didn't find anything relevant) | 15:04 |
mwhahaha | zigo: so you can use the openstacklib::service_validation to run a command to check the service is up | 15:04 |
zigo | Ah. | 15:04 |
mwhahaha | zigo: then we add some ordering to ensure it runs after the service is started but use it to block the providers until it's up | 15:04 |
*** ykarel is now known as ykarel|away | 15:06 | |
zigo | mwhahaha: Something like this? https://github.com/openstack/puppet-cinder/blob/master/manifests/api.pp#L374 | 15:08 |
*** olap has quit IRC | 15:09 | |
zigo | Or this one? https://github.com/openstack/puppet-nova/blob/master/manifests/api.pp#L563 (looks the same ...) | 15:10 |
* zigo got to go fetch kids at school | 15:13 | |
* zigo then got to eat dinner and head to geneva, so will be back in about 4 hours or so ... | 15:13 | |
mwhahaha | yea | 15:14 |
mwhahaha | something like that would work | 15:14 |
*** ykarel|away is now known as ykarel | 15:15 | |
*** derekh has quit IRC | 15:17 | |
*** derekh has joined #puppet-openstack | 15:20 | |
*** derekh has quit IRC | 15:20 | |
*** derekh has joined #puppet-openstack | 15:21 | |
*** vnogin has quit IRC | 15:36 | |
*** vnogin has joined #puppet-openstack | 15:40 | |
*** vnogin has quit IRC | 15:40 | |
*** jpena is now known as jpena|brb | 15:43 | |
*** vnogin has joined #puppet-openstack | 15:50 | |
*** ykarel has quit IRC | 15:54 | |
*** vnogin has quit IRC | 15:56 | |
*** vnogin has joined #puppet-openstack | 15:56 | |
*** trown is now known as trown|lunch | 16:01 | |
openstackgerrit | Thomas Goirand proposed openstack/puppet-neutron master: Ensure neutron-server works after starting https://review.openstack.org/568324 | 16:08 |
zigo | Let's hope that works! :) | 16:08 |
*** vnogin has quit IRC | 16:10 | |
*** vnogin has joined #puppet-openstack | 16:18 | |
*** vnogin has quit IRC | 16:18 | |
*** jpena|brb is now known as jpena | 16:24 | |
*** armaan has quit IRC | 16:27 | |
*** armaan has joined #puppet-openstack | 16:28 | |
*** salmankhan has quit IRC | 16:31 | |
*** rmart04 has quit IRC | 16:33 | |
*** gfidente has quit IRC | 16:52 | |
*** derekh has quit IRC | 17:00 | |
*** trown|lunch is now known as trown | 17:00 | |
*** tesseract has quit IRC | 17:11 | |
*** dtantsur is now known as dtantsur|afk | 17:14 | |
*** jpena is now known as jpena|off | 17:19 | |
*** ykarel has joined #puppet-openstack | 17:30 | |
*** tosky has quit IRC | 17:30 | |
*** tosky has joined #puppet-openstack | 17:34 | |
*** agurenko has quit IRC | 17:50 | |
*** ykarel has quit IRC | 17:59 | |
*** amoralej is now known as amoralej|off | 17:59 | |
tobasco | zigo: some feedback on that one | 18:13 |
tobasco | have we talked about the "Replace port 35357 with 5000" changes? | 18:14 |
tobasco | are we gonna push that through | 18:14 |
tobasco | mnaser: ^ | 18:14 |
*** salmankhan has joined #puppet-openstack | 18:33 | |
tobasco | i'm thinking about writing a spec for implementing puppet data types support for all modules, is there anything i need to do or should i just start with the puppet-openstack-specs/spec/template.rst | 18:39 |
*** Guest16323 is now known as mgagne | 18:40 | |
*** mgagne has joined #puppet-openstack | 18:40 | |
*** markvoelker_ has joined #puppet-openstack | 18:42 | |
*** markvoelker has quit IRC | 18:43 | |
*** markvoelker has joined #puppet-openstack | 18:49 | |
*** markvoelker_ has quit IRC | 18:50 | |
*** trown is now known as trown|brb | 18:54 | |
*** atoth has quit IRC | 18:55 | |
*** trown|brb is now known as trown | 19:31 | |
openstackgerrit | Merged openstack/puppet-openstack-integration master: Updated from Puppet OpenStack modules constraints https://review.openstack.org/567747 | 19:37 |
*** salmankhan has quit IRC | 19:48 | |
openstackgerrit | Thomas Goirand proposed openstack/puppet-neutron master: Ensure neutron-server works after starting https://review.openstack.org/568324 | 19:59 |
*** alee is now known as alee_afk | 20:17 | |
zigo | tobasco: Thanks for your feedback, however I need to test locally if that patch works first. | 20:22 |
openstackgerrit | Alan Bishop proposed openstack/puppet-glance master: Fix syntax for setting enabled_import_methods https://review.openstack.org/568366 | 20:26 |
zigo | mwhahaha: tobasco: Here's the result of the patch: http://paste.openstack.org/show/720953/ | 20:47 |
zigo | Looking at what happens, it does work, as in, the openstack command is started, but "neutron net-list" doesn't depend on it still. | 20:48 |
zigo | How do I make it wait for the service to be up? | 20:48 |
tobasco | like mwhahaha said | 20:51 |
tobasco | Service<| title == 'neutron-server'|> -> Openstacklib::Service_validation<| title == 'neutron-server' |> -> Neutron_network<||> | 20:51 |
zigo | tobasco: Where's that? | 20:52 |
zigo | Where should I write this? | 20:53 |
zigo | In the if $validate thing? | 20:54 |
tobasco | can just place it after the create_resources call | 20:55 |
tobasco | don't think it really matters where, but it's clean to place it close to where it makes most sense | 20:56 |
openstackgerrit | Thomas Goirand proposed openstack/puppet-neutron master: Ensure neutron-server works after starting https://review.openstack.org/568324 | 20:57 |
zigo | tobasco: Like this? | 20:58 |
tobasco | yup | 20:59 |
zigo | Thanks. | 20:59 |
zigo | Will try it right away. | 20:59 |
zigo | Then will fix what you said in the comments. | 20:59 |
*** trown is now known as trown|outtypewww | 21:00 | |
*** armaan has quit IRC | 21:08 | |
*** armaan has joined #puppet-openstack | 21:08 | |
*** armaan has quit IRC | 21:11 | |
*** armaan has joined #puppet-openstack | 21:11 | |
*** bnemec has quit IRC | 21:17 | |
*** bnemec has joined #puppet-openstack | 21:18 | |
openstackgerrit | Merged openstack/puppet-ceph master: Puppet incorrectly sets rgw_keystone_revocation_interval to absent https://review.openstack.org/567301 | 21:47 |
openstackgerrit | Merged openstack/puppet-ceph stable/jewel: Update ceph-osd-check-udev to correct an awk condition https://review.openstack.org/567323 | 21:48 |
*** rcernin has joined #puppet-openstack | 21:53 | |
openstackgerrit | Thomas Goirand proposed openstack/puppet-neutron master: Ensure neutron-server works after starting https://review.openstack.org/568324 | 21:58 |
*** vnogin has joined #puppet-openstack | 21:58 | |
openstackgerrit | Merged openstack/puppet-openstack-integration master: Test horizon dashboard support https://review.openstack.org/564811 | 22:03 |
openstackgerrit | Merged openstack/puppet-openstack-integration master: Use latest puppet5 repos https://review.openstack.org/565871 | 22:03 |
*** jistr has quit IRC | 22:07 | |
*** jistr has joined #puppet-openstack | 22:10 | |
openstackgerrit | Alan Bishop proposed openstack/puppet-glance master: Fix syntax for setting enabled_import_methods https://review.openstack.org/568366 | 22:38 |
*** alee_afk is now known as alee | 22:52 | |
*** rajinir has quit IRC | 23:19 | |
*** tosky has quit IRC | 23:52 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!