Monday, 2018-05-14

*** vnogin has quit IRC00:18
*** ykarel has joined #puppet-openstack01:30
*** ilbot3 has quit IRC01:44
*** ilbot3 has joined #puppet-openstack01:57
*** ykarel has quit IRC02:17
*** vnogin has joined #puppet-openstack02:42
openstackgerritMerged openstack/puppet-zaqar master: neat: missing : in $::os_service_default  https://review.openstack.org/56776103:05
openstackgerritMerged openstack/puppet-ceilometer master: neat: missing : in $::os_service_default  https://review.openstack.org/56776603:05
*** vnogin has quit IRC03:15
*** vnogin_ has joined #puppet-openstack03:15
*** vnogin_ has quit IRC03:20
*** ykarel has joined #puppet-openstack04:01
*** ykarel has quit IRC04:03
*** ykarel has joined #puppet-openstack04:05
*** armaan has joined #puppet-openstack04:50
*** armaan has quit IRC04:52
*** armaan has joined #puppet-openstack04:52
*** skramaja has joined #puppet-openstack05:10
*** skramaja_ has joined #puppet-openstack05:18
*** skramaja has quit IRC05:18
*** agurenko has joined #puppet-openstack05:24
*** vnogin has joined #puppet-openstack05:49
*** skramaja_ is now known as skramaja06:03
*** vnogin has quit IRC06:07
*** vnogin has joined #puppet-openstack06:10
*** vnogin has quit IRC06:15
*** gfidente has joined #puppet-openstack06:16
*** gfidente has quit IRC06:16
*** gfidente has joined #puppet-openstack06:16
*** jtomasek has joined #puppet-openstack06:33
*** armaan_ has joined #puppet-openstack07:05
*** armaan has quit IRC07:09
*** tesseract has joined #puppet-openstack07:10
*** dpawlik has joined #puppet-openstack07:13
*** jaganathan has joined #puppet-openstack07:17
*** amoralej|off is now known as amoralej07:19
*** armaan has joined #puppet-openstack07:29
*** jaganathan has quit IRC07:31
*** jaganathan has joined #puppet-openstack07:31
*** armaan_ has quit IRC07:32
*** tosky has joined #puppet-openstack07:37
*** rcernin has quit IRC07:39
*** ykarel is now known as ykarel|lunch07:49
*** jpena|off is now known as jpena07:53
*** rpittau has joined #puppet-openstack07:53
*** olap has joined #puppet-openstack07:57
*** salmankhan has joined #puppet-openstack08:12
*** skramaja_ has joined #puppet-openstack08:14
*** jaganathan_ has joined #puppet-openstack08:14
*** jaganathan has quit IRC08:14
*** skramaja has quit IRC08:14
*** dtantsur|afk is now known as dtantsur08:17
*** skramaja_ has quit IRC08:18
*** skramaja_ has joined #puppet-openstack08:18
*** jaganathan_ has quit IRC08:18
*** skramaja has joined #puppet-openstack08:21
*** skramaja_ has quit IRC08:25
*** skramaja_ has joined #puppet-openstack08:25
*** skramaja has quit IRC08:25
*** derekh has joined #puppet-openstack08:29
*** jaganathan_ has joined #puppet-openstack08:30
*** mandre_off is now known as mandre08:37
*** ykarel|lunch is now known as ykarel09:07
*** dtantsur is now known as dtantsur|brb09:08
*** dpawlik has quit IRC09:10
*** amorin has joined #puppet-openstack09:10
*** salmankhan has quit IRC09:25
*** salmankhan has joined #puppet-openstack09:31
*** armaan has quit IRC09:43
*** armaan has joined #puppet-openstack09:44
*** dpawlik has joined #puppet-openstack09:48
*** dpawlik has quit IRC09:54
*** dpawlik has joined #puppet-openstack09:55
*** jaosorior has joined #puppet-openstack09:56
*** chem has joined #puppet-openstack09:59
*** chem has quit IRC10:04
*** chem has joined #puppet-openstack10:15
zigomnaser: tobasco: EmilienM: mwhahaha: I've found out that recent changes in puppet-openstack are making Debian fail, because "neutron net list" is issued before neutron-server is fully up, it then fails instead of retrying or waiting for longer. How can I fix that? I had a look into puppet-neutron, and it looks like burried in the lib/puppet folder with some weirdo ruby code that I hardly can read...10:32
*** dtantsur|brb is now known as dtantsur10:38
*** vnogin has joined #puppet-openstack10:41
*** atoth has quit IRC10:48
*** armaan has quit IRC10:49
*** armaan has joined #puppet-openstack10:49
zigoAlso, it feels like it worked before and doesn't anymore (as in: it was retrying), but I'm not sure.10:56
*** armaan has quit IRC10:59
*** armaan has joined #puppet-openstack10:59
*** vnogin has quit IRC11:13
*** dpawlik has quit IRC11:16
*** ykarel is now known as ykarel|afk11:21
*** dpawlik has joined #puppet-openstack11:23
*** vnogin has joined #puppet-openstack11:26
*** vnogin has quit IRC11:26
*** vnogin has joined #puppet-openstack11:30
*** jpena is now known as jpena|lunch11:31
*** vnogin has quit IRC11:36
*** atoth has joined #puppet-openstack11:44
*** amoralej is now known as amoralej|lunch11:45
*** ykarel|afk is now known as ykarel11:57
*** gyankum has joined #puppet-openstack12:11
*** vnogin has joined #puppet-openstack12:17
*** jaganathan_ has quit IRC12:19
*** skramaja_ has quit IRC12:19
*** jaganathan_ has joined #puppet-openstack12:19
*** vinsh has quit IRC12:22
*** skramaja_ has joined #puppet-openstack12:23
*** vinsh has joined #puppet-openstack12:23
*** jpena|lunch is now known as jpena12:25
*** trown|outtypewww is now known as trown12:25
mwhahahazigo: which provider is it? there might be a missing dependency or something12:26
mwhahahazigo: alternatively is neutron-server just taking way to long to start?12:26
zigomwhahaha: It does take a long time to start indeed.12:26
zigomwhahaha: I'm not sure how to tell puppet-openstack to just wait ...12:27
zigomwhahaha: Oh, I think I probably know how to fix it at the packaging level ! :)12:27
mwhahahathat seems odd that we don't see it in other deployments12:27
zigoie: use systemd notify ...12:27
zigomwhahaha: Do you know if systemd notify is used in Red Hat's unit?12:27
mwhahahaunlikely12:28
mwhahahawe don't start services in packaging12:28
zigomwhahaha: That's orthogonal, it's just the definition of the .service file !12:28
mwhahahahttps://github.com/rdo-packages/neutron-distgit/blob/rpm-master/neutron-server.service12:29
mwhahahathere is a type=notify, is that what you mean?12:29
zigoYeah, it is ! :)12:29
zigoSo that systemctl start doesn't say "started" before it really is.12:29
zigoI'll switch to that, and see how it goes.12:29
zigoWhy is it *always* when starting to chat with others that I find the correct solution ... :P12:30
zigo(even after long days scratching my head...)12:30
*** skramaja_ is now known as skramaja12:32
zigomwhahaha: Is there a  NotifyAccess defined as well in Red Hat?12:32
mwhahahahttps://github.com/rdo-packages/neutron-distgit/blob/dca5726154639e7ab8412982d34def59e38d0a29/neutron-server.service#L1012:32
mwhahahaset to all12:32
zigoAh, thanks.12:34
*** amoralej|lunch is now known as amoralej12:39
*** gyankum has quit IRC12:42
*** dmsimard is now known as dmsimard|off12:58
* zigo restarts a scenario001 run in a VM13:01
*** agurenko has quit IRC13:03
*** agurenko has joined #puppet-openstack13:05
*** rmart04 has joined #puppet-openstack13:20
*** trozet has joined #puppet-openstack13:20
*** vnogin has quit IRC13:23
*** vnogin has joined #puppet-openstack13:34
*** alee has joined #puppet-openstack13:39
*** armaan has quit IRC13:42
*** armaan has joined #puppet-openstack13:43
*** armaan has quit IRC13:47
*** armaan has joined #puppet-openstack13:47
*** armaan has quit IRC13:48
*** armaan has joined #puppet-openstack13:49
*** beekneemech is now known as bnemec13:59
*** vnogin has quit IRC14:00
*** skramaja has quit IRC14:22
zigomwhahaha: Looks like adding Type=notify isn't enough, and I still get into error because it takes too much time to get neutron-server started.14:28
zigoHow can I fix that?14:28
* mwhahaha shrugs14:29
zigoBest IMO would be to get these list stuff to retry a few times ...14:29
mwhahahawhat's erroring?14:29
mwhahahaalso are you running in wsgi?14:29
zigomwhahaha: No, it's plain eventlet standard stuff.14:29
zigo2018-05-14 14:21:22 +0000 Puppet::Type::Neutron_network::ProviderNeutron (notice): Unable to complete neutron request due to non-fatal error: "Execution of '/usr/bin/neutron net-list --format=csv --column=id --quote=none' returned 1: neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.14:29
zigo2018-05-14 14:21:31 +0000 Puppet (err): Failed to apply catalog: Can't retrieve net-list because Neutron or Keystone API is not available.14:29
zigoThat's what I get...14:30
*** Mosibi has quit IRC14:30
zigoLater, if I run puppet again, then it does work until end (at least, it looks like it...).14:31
mwhahahanot sure. seems odd to be a debian specific thing14:31
zigoRight.14:31
zigoI also don't have SSL working, I have to set it to false in the scenario001.pp.14:31
mwhahahathat is a really old provider that hasn't been updated to use the opesntack client bits14:31
zigoNot sure why...14:31
zigoYeah.14:32
zigoAt some point, /usr/bin/neutron wont be available ! :)14:32
zigoBut that's not the point, it should be a bit more resilient to failure.14:32
mwhahahayea i think we have some retry logic in the openstack stuff14:33
zigoIt would be lib/puppet/provider/neutron_network/neutron.rb right?14:33
zigoIf you give me some examples to look at, maybe I can fix things?14:33
zigoYou mean openstack_extras, right?14:34
tobascozigo: sorry for not checking, i've been stuck at stuff all day, i will read through asap when i get time14:34
mwhahahayea it needs to inherit from the openstack.rb bits and all the commands/formats need to be updated14:34
*** gyankum has joined #puppet-openstack14:34
*** gyankum has quit IRC14:34
mwhahahapuppet providers are a pain14:35
mwhahahahttps://github.com/openstack/puppet-nova/blob/master/lib/puppet/provider/nova_flavor/openstack.rb14:35
mwhahahathere's an example of an openstack version14:36
mwhahahabasically it runs 'openstack <some arguments'14:36
mwhahahaand the providers generate the arguments14:36
mwhahahaso we need to convert it from neutron <args> to openstack <args>14:36
mwhahahaand update the response parser14:36
mwhahahathe problem usually comes in when the format is different or the command doesn't exist in the openstack client14:37
tobascoi read through all providers a while ago and i totally understood why there was a wishlist bug to rewrite them using api calls from ruby :)14:37
mwhahahait would be so much more efficient but the lack of a ruby sdk and people means it'll probably never happen14:38
zigoWell, neutron net-list --format=csv --column=id --quote=none would be:14:39
zigoopenstack network list --format=csv --column=ID --quote=none14:39
zigoNote that the field id becomes ID, rest of is the same.14:39
*** rajinir has joined #puppet-openstack14:40
zigoGosh, it doesn't look like easy to write ... :/14:41
zigomwhahaha: Isn't there is just a workaround to make lib/puppet/provider/neutron_network/neutron.rb retry, instead of rewriting it all? :/14:42
zigoIt's not laziness, just I'm scared I wont be able to rewrite it all.14:42
*** vnogin has joined #puppet-openstack14:42
mwhahahayou'd have to port the retry logic over14:42
mwhahahahttps://github.com/openstack/puppet-openstacklib/commit/fedb3152c9045c984b1296e435997ad7fc851b9e14:43
mwhahahaso something like that14:43
mwhahahaI think https://github.com/openstack/puppet-openstacklib/commit/fedb3152c9045c984b1296e435997ad7fc851b9e is what it currently looks like14:43
mwhahahaso yes you can, it's only slightly less complex :D14:43
zigoRight ... :(14:44
zigomwhahaha: How about just adding a 30 second wait time after starting neutron-server? (as a temporary solution)14:48
zigo(and only for Debian...)14:48
mwhahahaYea no14:48
zigo:)14:48
* zigo is thinking about more ways to cheat...14:49
zigoWhat I think is that the systemd notify of neutron is simply put at the wrong position.14:50
mwhahahaWe have a class that you could use for neutron to see when it's up14:50
mwhahahaGimme a few mins to dig it up14:50
zigoAh, nice.14:50
*** vnogin has quit IRC14:53
*** vnogin has joined #puppet-openstack14:53
*** armaan has quit IRC14:53
*** armaan has joined #puppet-openstack14:53
mwhahahahttps://github.com/openstack/puppet-openstacklib/blob/master/manifests/service_validation.pp#L6414:54
mwhahahaso you could define your own service validation and wedge it between the Service<| title == 'neutron-server'|> -> Openstacklib::Service_validation<| title == 'neutron-is-up' |> -> Neutron_network<||>14:55
mwhahahaor something like that14:55
*** Mosibi has joined #puppet-openstack14:58
tobascomwhahaha: could you check my top three here https://review.openstack.org/#/q/owner:tobias%2540busybox.se+status:open14:59
mwhahahak15:00
tobascoty15:02
zigomwhahaha: I don't know what you mean there... :/15:03
zigo(I had a look before searching for examples ...)15:04
zigo(didn't find anything relevant)15:04
mwhahahazigo: so you can use the openstacklib::service_validation to run a command to check the service is up15:04
zigoAh.15:04
mwhahahazigo: then we add some ordering to ensure it runs after the service is started but use it to block the providers until it's up15:04
*** ykarel is now known as ykarel|away15:06
zigomwhahaha: Something like this? https://github.com/openstack/puppet-cinder/blob/master/manifests/api.pp#L37415:08
*** olap has quit IRC15:09
zigoOr this one? https://github.com/openstack/puppet-nova/blob/master/manifests/api.pp#L563 (looks the same ...)15:10
* zigo got to go fetch kids at school15:13
* zigo then got to eat dinner and head to geneva, so will be back in about 4 hours or so ...15:13
mwhahahayea15:14
mwhahahasomething like that would work15:14
*** ykarel|away is now known as ykarel15:15
*** derekh has quit IRC15:17
*** derekh has joined #puppet-openstack15:20
*** derekh has quit IRC15:20
*** derekh has joined #puppet-openstack15:21
*** vnogin has quit IRC15:36
*** vnogin has joined #puppet-openstack15:40
*** vnogin has quit IRC15:40
*** jpena is now known as jpena|brb15:43
*** vnogin has joined #puppet-openstack15:50
*** ykarel has quit IRC15:54
*** vnogin has quit IRC15:56
*** vnogin has joined #puppet-openstack15:56
*** trown is now known as trown|lunch16:01
openstackgerritThomas Goirand proposed openstack/puppet-neutron master: Ensure neutron-server works after starting  https://review.openstack.org/56832416:08
zigoLet's hope that works! :)16:08
*** vnogin has quit IRC16:10
*** vnogin has joined #puppet-openstack16:18
*** vnogin has quit IRC16:18
*** jpena|brb is now known as jpena16:24
*** armaan has quit IRC16:27
*** armaan has joined #puppet-openstack16:28
*** salmankhan has quit IRC16:31
*** rmart04 has quit IRC16:33
*** gfidente has quit IRC16:52
*** derekh has quit IRC17:00
*** trown|lunch is now known as trown17:00
*** tesseract has quit IRC17:11
*** dtantsur is now known as dtantsur|afk17:14
*** jpena is now known as jpena|off17:19
*** ykarel has joined #puppet-openstack17:30
*** tosky has quit IRC17:30
*** tosky has joined #puppet-openstack17:34
*** agurenko has quit IRC17:50
*** ykarel has quit IRC17:59
*** amoralej is now known as amoralej|off17:59
tobascozigo: some feedback on that one18:13
tobascohave we talked about the "Replace port 35357 with 5000" changes?18:14
tobascoare we gonna push that through18:14
tobascomnaser: ^18:14
*** salmankhan has joined #puppet-openstack18:33
tobascoi'm thinking about writing a spec for implementing puppet data types support for all modules, is there anything i need to do or should i just start with the puppet-openstack-specs/spec/template.rst18:39
*** Guest16323 is now known as mgagne18:40
*** mgagne has joined #puppet-openstack18:40
*** markvoelker_ has joined #puppet-openstack18:42
*** markvoelker has quit IRC18:43
*** markvoelker has joined #puppet-openstack18:49
*** markvoelker_ has quit IRC18:50
*** trown is now known as trown|brb18:54
*** atoth has quit IRC18:55
*** trown|brb is now known as trown19:31
openstackgerritMerged openstack/puppet-openstack-integration master: Updated from Puppet OpenStack modules constraints  https://review.openstack.org/56774719:37
*** salmankhan has quit IRC19:48
openstackgerritThomas Goirand proposed openstack/puppet-neutron master: Ensure neutron-server works after starting  https://review.openstack.org/56832419:59
*** alee is now known as alee_afk20:17
zigotobasco: Thanks for your feedback, however I need to test locally if that patch works first.20:22
openstackgerritAlan Bishop proposed openstack/puppet-glance master: Fix syntax for setting enabled_import_methods  https://review.openstack.org/56836620:26
zigomwhahaha: tobasco: Here's the result of the patch: http://paste.openstack.org/show/720953/20:47
zigoLooking at what happens, it does work, as in, the openstack command is started, but "neutron net-list" doesn't depend on it still.20:48
zigoHow do I make it wait for the service to be up?20:48
tobascolike mwhahaha said20:51
tobascoService<| title == 'neutron-server'|> -> Openstacklib::Service_validation<| title == 'neutron-server' |> -> Neutron_network<||>20:51
zigotobasco: Where's that?20:52
zigoWhere should I write this?20:53
zigoIn the if $validate thing?20:54
tobascocan just place it after the create_resources call20:55
tobascodon't think it really matters where, but it's clean to place it close to where it makes most sense20:56
openstackgerritThomas Goirand proposed openstack/puppet-neutron master: Ensure neutron-server works after starting  https://review.openstack.org/56832420:57
zigotobasco: Like this?20:58
tobascoyup20:59
zigoThanks.20:59
zigoWill try it right away.20:59
zigoThen will fix what you said in the comments.20:59
*** trown is now known as trown|outtypewww21:00
*** armaan has quit IRC21:08
*** armaan has joined #puppet-openstack21:08
*** armaan has quit IRC21:11
*** armaan has joined #puppet-openstack21:11
*** bnemec has quit IRC21:17
*** bnemec has joined #puppet-openstack21:18
openstackgerritMerged openstack/puppet-ceph master: Puppet incorrectly sets rgw_keystone_revocation_interval to absent  https://review.openstack.org/56730121:47
openstackgerritMerged openstack/puppet-ceph stable/jewel: Update ceph-osd-check-udev to correct an awk condition  https://review.openstack.org/56732321:48
*** rcernin has joined #puppet-openstack21:53
openstackgerritThomas Goirand proposed openstack/puppet-neutron master: Ensure neutron-server works after starting  https://review.openstack.org/56832421:58
*** vnogin has joined #puppet-openstack21:58
openstackgerritMerged openstack/puppet-openstack-integration master: Test horizon dashboard support  https://review.openstack.org/56481122:03
openstackgerritMerged openstack/puppet-openstack-integration master: Use latest puppet5 repos  https://review.openstack.org/56587122:03
*** jistr has quit IRC22:07
*** jistr has joined #puppet-openstack22:10
openstackgerritAlan Bishop proposed openstack/puppet-glance master: Fix syntax for setting enabled_import_methods  https://review.openstack.org/56836622:38
*** alee_afk is now known as alee22:52
*** rajinir has quit IRC23:19
*** tosky has quit IRC23:52

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!