Cosine Similarity

What is Cosine Similarity?

• Cosine similarity is a measure of similarity between two non-zero vectors.

• It is used to determine the cosine of the angle between the vectors.

• It is widely used in various fields, including information retrieval, text mining, and recommendation systems.

---

Formula for Cosine Similarity

The cosine similarity between two vectors A and B is calculated using the following formula:

cos(θ) = (A • B) / (||A|| * ||B||)

• A • B represents the dot product of vectors A and B.
• ||A|| and ||B|| represent the magnitude or length of vectors A and B, respectively.

---

Understanding the Cosine Similarity

• The cosine similarity ranges from -1 to 1.

• A cosine similarity of 1 means the vectors are perfectly similar.

• A cosine similarity of -1 means the vectors are perfectly dissimilar.

• A cosine similarity of 0 means the vectors are orthogonal (perpendicular) to each other.

---

Example Calculation

Let's consider two vectors:

A = [1, 2, 3]

B = [4, 5, 6]

• Dot product (A • B) = (1 × 4) + (2 × 5) + (3 × 6) = 4 + 10 + 18 = 32
• Magnitude of A (||A||) = √(1² + 2² + 3²) = √14 ≈ 3.74
• Magnitude of B (||B||) = √(4² + 5² + 6²) = √77 ≈ 8.77

Cosine similarity = 32 / (3.74 × 8.77) ≈ 0.98

Applications of Cosine Similarity

• Text mining: Cosine similarity is commonly used to compare documents or text passages.

• Recommendation systems: It is used to find similar items or recommend items to users based on their preferences.

• Clustering: Cosine similarity is used to group similar data points together in clustering algorithms.

---

Advantages of Cosine Similarity

• It is widely used and well-established in various fields.

• It is not affected by the magnitude of the vectors, only their directions.

• It works well with high-dimensional data.

---

Limitations of Cosine Similarity

• It does not consider the semantic meaning of the vectors.

• It assumes that the vectors are independent and unrelated.

• It may not be suitable for datasets with sparse or highly skewed distributions.

---

Conclusion

• Cosine similarity is a valuable measure for comparing the similarity between vectors.

• It has applications in text mining, recommendation systems, and clustering.

• Understanding its advantages and limitations is important for accurate interpretation.