For instance, if you are a smoker, the smell of tobacco can drive the trout away. One way to counter this problem is to grab a handful of dirt, and rub it into your hands before you go fishing. This neutralizes the smell of your hand, and erases the scent of any foreign substance.