Enhancing BoW with TF-IDF

Interactive visualization of Text Vectorization mathematics

The Corpus (N = 2)

Quick Add:

Core Mathematical Settings Crucial

Apply Logarithm to IDF: log(N / DF)

Why use Log? Without a log function, rare words receive exponentially massive weights as Corpus size (N) grows, overwhelming ML models. Log smooths out the scale so rare words remain important but manageable.

Remove Stop Words (the, a, on, at...)

Removes common grammatical words before math is applied. Notice how TF-IDF naturally mimics this manual cleanup process!

Step 1 / 5

Sort Bars by Score

Plot Vector for: