Saints they're not

I find it annoying that most people visit their dead relatives on November 1st, which is All Saints' Day. Are they not aware that their dead aren't saints?