Granite isn't an item that would be considered bait by itself, so I guess it would be legal. If anything, such as rock salt, was mixed in with it, it would be totally illegal.
I suspect if you put it out it any officer will check it closely for some of the illegal items that could be mixed in with it.