org.apdplat.word.analysis

Class SimpleTextSimilarity

java.lang.Object

org.apdplat.word.analysis.TextSimilarity

org.apdplat.word.analysis.SimpleTextSimilarity

All Implemented Interfaces:

Similarity, SimilarityRanker

public class SimpleTextSimilarity
extends TextSimilarity

文本相似度计算 判定方式：简单共有词，通过计算两篇文档共有的词的总字符数除以最长文档字符数来评估他们的相似度 算法步骤描述： 1、分词 2、求交集（去重），累加交集的所有的词的字符数得到 intersectionLength 3、求最长文本字符数 Math.max(words1Length, words2Length) 4、2中的值除以3中的值 intersectionLength/(double)Math.max(words1Length, words2Length) 完整计算公式： double score = intersectionLength/(double)Math.max(words1Length, words2Length);

Author:

杨尚川

Field Summary

Fields inherited from class org.apdplat.word.analysis.TextSimilarity

filterStopWord, LOGGER

Fields inherited from interface org.apdplat.word.analysis.Similarity

thresholdRate

Constructor Summary

Constructors

Constructor and Description
SimpleTextSimilarity()

Method Summary

Modifier and Type	Method and Description
static void	main(String[] args)
protected double	scoreImpl(List<Word> words1, List<Word> words2) 计算相似度分值

Methods inherited from class org.apdplat.word.analysis.TextSimilarity

setSegmentationAlgorithm, similarScore, similarScore, taggingWeightWithWordFrequency, toFastSearchMap

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apdplat.word.analysis.SimilarityRanker

rank, rank

Methods inherited from interface org.apdplat.word.analysis.Similarity

isSimilar, isSimilar, isSimilar, isSimilar, similarScore, similarScore

Constructor Detail

SimpleTextSimilarity

public SimpleTextSimilarity()

Method Detail

scoreImpl

protected double scoreImpl(List<Word> words1,
                           List<Word> words2)

计算相似度分值

Specified by:

scoreImpl in class TextSimilarity

Parameters:

words1 - 词列表1

words2 - 词列表2

Returns:

相似度分值

main

public static void main(String[] args)