The grain mix (mostly rye, rather than mostly corn for Bourbon). Rye whiskey tends to have a thinner, drier taste. Otherwise, the laws governing the production of both in the U.S. are more or less the same.
Try some of both and decide what the difference is to you.
I'm a bit of a novice, what's the difference with Rye US whiskey?