util

Class SynonymsHelper

java.lang.Object

util.SynonymsHelper

public class SynonymsHelper
extends java.lang.Object

Constructor Summary

Constructors

Constructor and Description
SynonymsHelper()

Method Summary

Methods

Modifier and Type	Method and Description
static java.util.HashMap<java.lang.String,java.lang.String>	buildSynonymMap(java.util.Map<java.lang.String,Synonyms> syns)
static Synonyms	getAllSynClasses_indirect(Synonyms s, java.util.Map<java.lang.String,Synonyms> syns) For a synonym, this function populates the synonym with all the indirect synonyms of its co-occurring terms.
static Synonyms	getAllSynClasses(java.lang.String s, java.util.Map<java.lang.String,Synonyms> syns) For a synonym, this function populates the synonym with all the direct synonyms of its co-occurring terms.
static Synonyms	getFinal(java.util.Map<java.lang.String,Synonyms> syns, java.util.regex.Pattern pat_all, java.util.regex.Pattern pat, java.util.HashMap<java.lang.String,java.lang.Double> cash_corr, java.lang.String name) Method for making sure that we choose a synonym that 1.
static double	getjaccardofTerms(java.lang.String[] term1, java.lang.String[] term2)
static double	getoverlapofTerms(java.lang.String[] term1, java.lang.String[] term2)
static double	getUnion(java.util.ArrayList<java.lang.String> arrayList, java.util.ArrayList<java.lang.String> arrayList2)
static boolean	isSoftSubTerm(java.lang.String[] first, java.lang.String[] longer, Synonyms syn1, Synonyms syn2, java.util.HashSet<java.lang.String> stopwords)
static boolean	isSubTerm_soft(Synonyms syn1, Synonyms syn2, java.util.HashSet<java.lang.String> stopwords) Class for finding out if the representatives of two synonyms should be merged or not as a consequence of the terms being "soft" sub-terms.
static boolean	isSubTerm(Synonyms syn1, Synonyms syn2) Class for finding out if the representatives of two synonyms should be merged or not as a consequence of the terms being sub-terms.
static Synonyms	mergeAllSynClasses_indirect(Synonyms syn, java.util.Map<java.lang.String,java.util.Set<java.lang.String>> indirectSynsOfCoOccrSet) For use when merging two synonyms.
static Synonyms	mergeAllSynClasses(Synonyms syn, java.util.Map<java.lang.String,java.util.Set<java.lang.String>> directSynsOfCoOccrSet) For use when merging two synonyms.
static void	printFinal(java.util.Map<java.lang.String,Synonyms> syns, java.util.regex.Pattern pat_all)
static void	printIndex(java.util.Map<java.lang.String,java.util.TreeSet<java.lang.String>> index, java.util.HashMap<java.lang.String,java.lang.Double> dict)
static void	testPrint_Syns(java.util.Map<java.lang.String,java.lang.String> syns)
static void	testPrint(java.util.Map<java.lang.String,Synonyms> syns)
static void	update(java.util.Map<java.lang.String,java.util.TreeSet<java.lang.String>> index, java.lang.String word, java.lang.String term, java.util.Set<java.lang.String> stopwords)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SynonymsHelper

public SynonymsHelper()

Method Detail

isSubTerm

public static boolean isSubTerm(Synonyms syn1,
                Synonyms syn2)

Class for finding out if the representatives of two synonyms should be merged or not as a consequence of the terms being sub-terms. The conditions for being a sub term is for the shorter term to contain only terms from the longer term in right order: E.g., Cardinal Ratzinger is a sub-term of Cardinal Joseph Ratzinger NOT USED: Hard requirements: No term with Mr can be merged with Mrs or Ms in the representative or the synonym sets.

Parameters:

syn1 - First synonym to be compared

syn2 - Second synonym to be compared

Returns:

True if syn1 is subterm of syn2 or vice versa. False otherwise.

isSubTerm_soft

public static boolean isSubTerm_soft(Synonyms syn1,
                     Synonyms syn2,
                     java.util.HashSet<java.lang.String> stopwords)

Class for finding out if the representatives of two synonyms should be merged or not as a consequence of the terms being "soft" sub-terms. The conditions for being a sub term is for the shorter term to contain only terms from the longer term with the exception of stopwords and without the requirement of terms in right order: E.g., Illinois_Democrat is a sub-term of Democrat_of_Illinois.

Parameters:

syn1 - First synonym to be compared

syn2 - Second synonym to be compared

stopwords - a HashSet with all stopwords that we want to disregard during matching

Returns:

True if syn1 is subterm of syn2 or vice versa. False otherwise.

isSoftSubTerm

public static boolean isSoftSubTerm(java.lang.String[] first,
                    java.lang.String[] longer,
                    Synonyms syn1,
                    Synonyms syn2,
                    java.util.HashSet<java.lang.String> stopwords)

getUnion

public static double getUnion(java.util.ArrayList<java.lang.String> arrayList,
              java.util.ArrayList<java.lang.String> arrayList2)

getoverlapofTerms

public static double getoverlapofTerms(java.lang.String[] term1,
                       java.lang.String[] term2)

getjaccardofTerms

public static double getjaccardofTerms(java.lang.String[] term1,
                       java.lang.String[] term2)

update

public static void update(java.util.Map<java.lang.String,java.util.TreeSet<java.lang.String>> index,
          java.lang.String word,
          java.lang.String term,
          java.util.Set<java.lang.String> stopwords)

printIndex

public static void printIndex(java.util.Map<java.lang.String,java.util.TreeSet<java.lang.String>> index,
              java.util.HashMap<java.lang.String,java.lang.Double> dict)

testPrint_Syns

public static void testPrint_Syns(java.util.Map<java.lang.String,java.lang.String> syns)

printFinal

public static void printFinal(java.util.Map<java.lang.String,Synonyms> syns,
              java.util.regex.Pattern pat_all)

testPrint

public static void testPrint(java.util.Map<java.lang.String,Synonyms> syns)

buildSynonymMap

public static java.util.HashMap<java.lang.String,java.lang.String> buildSynonymMap(java.util.Map<java.lang.String,Synonyms> syns)

getFinal

public static Synonyms getFinal(java.util.Map<java.lang.String,Synonyms> syns,
                java.util.regex.Pattern pat_all,
                java.util.regex.Pattern pat,
                java.util.HashMap<java.lang.String,java.lang.Double> cash_corr,
                java.lang.String name)

Method for making sure that we choose a synonym that 1. has a representative that is allUpperCase 2. matches fully to the query term or if no such exist, 3. matches partially.

Parameters:

syns -

pat_all -

pat -

cash_corr -

name -

Returns:

getAllSynClasses

public static Synonyms getAllSynClasses(java.lang.String s,
                        java.util.Map<java.lang.String,Synonyms> syns)

For a synonym, this function populates the synonym with all the direct synonyms of its co-occurring terms.

Parameters:

s - - representative of the synonym that should be returned.

syns - - synonym map mapping all representatives to their synonyms

Returns:

a synonym with its direct synonyms of the co-occur set populated

getAllSynClasses_indirect

public static Synonyms getAllSynClasses_indirect(Synonyms s,
                                 java.util.Map<java.lang.String,Synonyms> syns)

For a synonym, this function populates the synonym with all the indirect synonyms of its co-occurring terms.

Parameters:

s - - representative of the synonym that should be returned.

syns - - synonym map mapping all representatives to their synonyms

Returns:

a synonym with its direct synonyms of the co-occur set populated

mergeAllSynClasses

public static Synonyms mergeAllSynClasses(Synonyms syn,
                          java.util.Map<java.lang.String,java.util.Set<java.lang.String>> directSynsOfCoOccrSet)

For use when merging two synonyms. For a synonym, this function populates the synonym with all the direct synonyms of its co-occurring terms by merging them with a directSyns of the synonym that it has been merged with.

Parameters:

syn - - the synonym that should be returned.

directSynsOfCoOccrSet - - the direct syns of the co-occur set that should be merged with syn

Returns:

a synonym with its direct synonyms of the co-occur set populated

mergeAllSynClasses_indirect

public static Synonyms mergeAllSynClasses_indirect(Synonyms syn,
                                   java.util.Map<java.lang.String,java.util.Set<java.lang.String>> indirectSynsOfCoOccrSet)

For use when merging two synonyms. For a synonym, this function populates the synonym with all the direct synonyms of its co-occurring terms by merging them with a directSyns of the synonym that it has been merged with.

Parameters:

syn - - the synonym that should be returned.

directSynsOfCoOccrSet - - the direct syns of the co-occur set that should be merged with syn

Returns:

a synonym with its direct synonyms of the co-occur set populated