ivory.lsh.projection

Class ComputeSignaturesSimhash

java.lang.Object

org.apache.hadoop.conf.Configured

edu.umd.cloud9.util.PowerTool

ivory.lsh.projection.ComputeSignaturesSimhash

All Implemented Interfaces:

Configurable, Tool

public class ComputeSignaturesSimhash
extends PowerTool

A Hadoop task to compute signatures from document vectors.

Author:

ferhanture

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ComputeSignaturesSimhash.MyMapper Simhash implementation, as explained in Manku et al's Detecting near-duplicates for web crawling (WWW07)

Field Summary

Fields

Modifier and Type	Field and Description
static String[]	RequiredParameters

Constructor Summary

Constructors

Constructor and Description
ComputeSignaturesSimhash(Configuration conf)

Method Summary

Methods

Modifier and Type	Method and Description
String[]	getRequiredParameters()
int	runTool()

Methods inherited from class edu.umd.cloud9.util.PowerTool

run, run

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

RequiredParameters

public static final String[] RequiredParameters

Constructor Detail

ComputeSignaturesSimhash

public ComputeSignaturesSimhash(Configuration conf)

Method Detail

getRequiredParameters

public String[] getRequiredParameters()

Specified by:

getRequiredParameters in class PowerTool

runTool

public int runTool()
            throws Exception

Specified by:

runTool in class PowerTool

Throws:

Exception