Does Not Measure Neutrality
It is the inability of the app to detect the ideological stance, political position, or how objective a news source is.
MagPunk cannot claim that any content is politically impartial or neutral. The system only measures negative, positive, and neutral sentiment, this statistical emotional tone is not the equivalent of neutrality. A news item being intensely partisan can also be hidden by using statistically ‘neutral’ words.
Example: A group producing a text that is actually wholly one-sided and biased by choosing its words very carefully and neutrally.
Go deeper
No text produced by humans is objective in an absolute sense. Classifiers (TF/IDF weights or sentiment rule engines) can score the tone of words on the surface, but the actual intention or ideological frame (framing theory) behind the text is too complex for algorithms to reach. That is why, as per the political neutrality rule, the model refrains from interfering with political content. Admitting that neutrality is immeasurable is the first step of critical thinking.