org.apache.spark.mllib.feature

Class HashingTF

java.lang.Object

org.apache.spark.mllib.feature.HashingTF

All Implemented Interfaces:

java.io.Serializable

public class HashingTF
extends java.lang.Object
implements scala.Serializable

Maps a sequence of terms to their term frequencies using the hashing trick.

param: numFeatures number of features (default: 2^20^)

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HashingTF()
HashingTF(int numFeatures)

Method Summary

Methods

Modifier and Type	Method and Description
int	indexOf(java.lang.Object term) Returns the index of the input term.
int	numFeatures()
Vector	transform(java.lang.Iterable<?> document) Transforms the input document into a sparse term frequency vector (Java version).
Vector	transform(scala.collection.Iterable<java.lang.Object> document) Transforms the input document into a sparse term frequency vector.
<D extends java.lang.Iterable<?>> JavaRDD<Vector>	transform(JavaRDD<D> dataset) Transforms the input document to term frequency vectors (Java version).
<D extends scala.collection.Iterable<java.lang.Object>> RDD<Vector>	transform(RDD<D> dataset) Transforms the input document to term frequency vectors.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HashingTF

public HashingTF(int numFeatures)

HashingTF

public HashingTF()

Method Detail

numFeatures

public int numFeatures()

indexOf

public int indexOf(java.lang.Object term)

Returns the index of the input term.

Parameters:

term - (undocumented)

Returns:

(undocumented)

transform

public Vector transform(scala.collection.Iterable<java.lang.Object> document)

Transforms the input document into a sparse term frequency vector.

Parameters:

document - (undocumented)

Returns:

(undocumented)

transform

public Vector transform(java.lang.Iterable<?> document)

Transforms the input document into a sparse term frequency vector (Java version).

Parameters:

document - (undocumented)

Returns:

(undocumented)

transform

public <D extends scala.collection.Iterable<java.lang.Object>> RDD<Vector> transform(RDD<D> dataset)

Transforms the input document to term frequency vectors.

Parameters:

dataset - (undocumented)

Returns:

(undocumented)

transform

public <D extends java.lang.Iterable<?>> JavaRDD<Vector> transform(JavaRDD<D> dataset)

Transforms the input document to term frequency vectors (Java version).

Parameters:

dataset - (undocumented)

Returns:

(undocumented)