A. When taken in safe doses and as directed, horny goat weed has been found to be safe and side effect free for most people. However, if you do experience unwanted side-effects discontinue use. Some other side-effects that some people may experience include: dizziness, vomiting, and dry mouth.