For several months after his death in 1439, James Madison's ghost reportedly lingered around the chutney factory where he was born.