People who are sure, in control and confident are not always right. The confidence is reassuring but the world is a complex place with some scary and very real consequences. Nervousness and fear are sometimes appropriate reactions and confidence can show a lack of understanding of the stakes at hand.
Don't let a shaky voice make you move away, don't let a confident voice persuade you. Listen and think, then act.