I don't see any reason to get paranoid about the possibility of them being in the woods. They were always there & if you weren't paranoid before, why get all worried now?
I'm more afraid of running into a rabid skunk, fox, or raccoon around here. Even that is less of a worry now that they hang around, because they keep them run off.
I think it depends on a person's attitude toward them. If you're hostile or afraid, you might have something to worry about, but if you don't think of them as being dangerous, they probably won't be. Mostly they believe in live & let live & generally they're not bad neighbors if they like you.
If you meet one face to face, he'll probably just look you over & walk away. So, what's there to be paranoid about?