It's likely a result of differences in the training data set + probably some formatting errors when I got the data.
EDIT: It is in fact due to some of the training data not having periods. It's actually starting to bother me now, I have to fix it lol