I don't see much of an upside to an up-or-down voting feature. It definitely tends to lend itself to trolling. But do what you feel is best.
Personally, and just my opinion... but a POLLING feature would be much more of a benefit here. That type of feature encourages more positive discussion and feedback for the members. To my knowledge, we don't have that here. Or if we do - I'm not aware of it.
If you want the site to grow, foster the things that allow it to grow, that enable the posters to engage in productive discussions versus negative trolling, creating the type of atmosphere where people want to come interact with other golfers/sports fans. I don't think anyone here wants to cause issues and would prefer to interact with fellow posters in a positive and productive discussion-enhancing manner.
Society these days seems incapable of showing decency and discipline. Go to any news/sports website and read the comments section to verify. Everybody's a troll at those places.
It'd be nice to avoid that here, even if it means taking the necessary steps to not include features that have every reason to promote division.
Again, just my opinion.