org.apdplat.word.analysis

Class CosineTextSimilarity

java.lang.Object

org.apdplat.word.analysis.TextSimilarity

org.apdplat.word.analysis.CosineTextSimilarity

All Implemented Interfaces:

Similarity, SimilarityRanker

public class CosineTextSimilarity
extends TextSimilarity

文本相似度计算 判定方式：余弦相似度，通过计算两个向量的夹角余弦值来评估他们的相似度 余弦夹角原理： 向量a=(x1,y1),向量b=(x2,y2) similarity=a.b/|a|*|b| a.b=x1x2+y1y2 |a|=根号[(x1)^2+(y1)^2],|b|=根号[(x2)^2+(y2)^2]

Author:

杨尚川

Field Summary

Fields inherited from class org.apdplat.word.analysis.TextSimilarity

filterStopWord, LOGGER

Fields inherited from interface org.apdplat.word.analysis.Similarity

thresholdRate

Constructor Summary

Constructors

Constructor and Description
CosineTextSimilarity()

Method Summary

Modifier and Type	Method and Description
static void	main(String[] args)
protected double	scoreImpl(List<Word> words1, List<Word> words2) 判定相似度的方式：余弦相似度 余弦夹角原理： 向量a=(x1,y1),向量b=(x2,y2) similarity=a.b/|a|*|b| a.b=x1x2+y1y2 |a|=根号[(x1)^2+(y1)^2],|b|=根号[(x2)^2+(y2)^2]

Methods inherited from class org.apdplat.word.analysis.TextSimilarity

setSegmentationAlgorithm, similarScore, similarScore, taggingWeightWithWordFrequency, toFastSearchMap

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apdplat.word.analysis.SimilarityRanker

rank, rank

Methods inherited from interface org.apdplat.word.analysis.Similarity

isSimilar, isSimilar, isSimilar, isSimilar, similarScore, similarScore

Constructor Detail

CosineTextSimilarity

public CosineTextSimilarity()

Method Detail

scoreImpl

protected double scoreImpl(List<Word> words1,
                           List<Word> words2)

判定相似度的方式：余弦相似度 余弦夹角原理： 向量a=(x1,y1),向量b=(x2,y2) similarity=a.b/|a|*|b| a.b=x1x2+y1y2 |a|=根号[(x1)^2+(y1)^2],|b|=根号[(x2)^2+(y2)^2]

Specified by:

scoreImpl in class TextSimilarity

Parameters:

words1 - 词列表1

words2 - 词列表2

Returns:

相似度分值

main

public static void main(String[] args)