BlockMatrix

Instance Constructors

new BlockMatrix(blocks: RDD[((Int, Int), Matrix)], rowsPerBlock: Int, colsPerBlock: Int)

Alternate constructor for BlockMatrix without the input of the number of rows and columns.
Alternate constructor for BlockMatrix without the input of the number of rows and columns.
blocks
The RDD of sub-matrix blocks ((blockRowIndex, blockColIndex), sub-matrix) that form this distributed matrix. If multiple blocks with the same index exist, the results for operations like add and multiply will be unpredictable.
rowsPerBlock
Number of rows that make up each block. The blocks forming the final rows are not required to have the given number of rows
colsPerBlock
Number of columns that make up each block. The blocks forming the final columns are not required to have the given number of columns

Annotations
@Since( "1.3.0" )
new BlockMatrix(blocks: RDD[((Int, Int), Matrix)], rowsPerBlock: Int, colsPerBlock: Int, nRows: Long, nCols: Long)

blocks
The RDD of sub-matrix blocks ((blockRowIndex, blockColIndex), sub-matrix) that form this distributed matrix. If multiple blocks with the same index exist, the results for operations like add and multiply will be unpredictable.
rowsPerBlock
Number of rows that make up each block. The blocks forming the final rows are not required to have the given number of rows
colsPerBlock
Number of columns that make up each block. The blocks forming the final columns are not required to have the given number of columns
nRows
Number of rows of this matrix. If the supplied value is less than or equal to zero, the number of rows will be calculated when numRows is invoked.
nCols
Number of columns of this matrix. If the supplied value is less than or equal to zero, the number of columns will be calculated when numCols is invoked.

Annotations
@Since( "1.3.0" )

Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def add(other: BlockMatrix): BlockMatrix

Adds the given block matrix other to this block matrix: this + other.
Adds the given block matrix other to this block matrix: this + other. The matrices must have the same size and matching rowsPerBlock and colsPerBlock values. If one of the blocks that are being added are instances of SparseMatrix, the resulting sub matrix will also be a SparseMatrix, even if it is being added to a DenseMatrix. If two dense matrices are added, the output will also be a DenseMatrix.

Annotations
@Since( "1.3.0" )
final def asInstanceOf[T0]: T0

Definition Classes
Any
val blocks: RDD[((Int, Int), Matrix)]

The RDD of sub-matrix blocks ((blockRowIndex, blockColIndex), sub-matrix) that form this distributed matrix.
The RDD of sub-matrix blocks ((blockRowIndex, blockColIndex), sub-matrix) that form this distributed matrix. If multiple blocks with the same index exist, the results for operations like add and multiply will be unpredictable.

Annotations
@Since( "1.3.0" )
def cache(): BlockMatrix.this.type

Caches the underlying RDD.
Caches the underlying RDD.

Annotations
@Since( "1.3.0" )
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
val colsPerBlock: Int

Number of columns that make up each block.
Number of columns that make up each block. The blocks forming the final columns are not required to have the given number of columns

Annotations
@Since( "1.3.0" )
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def equals(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
def hashCode(): Int

Definition Classes
AnyRef → Any
def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean = false): Boolean

Attributes
protected
Definition Classes
Logging
def initializeLogIfNecessary(isInterpreter: Boolean): Unit

Attributes
protected
Definition Classes
Logging
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
def isTraceEnabled(): Boolean

Attributes
protected
Definition Classes
Logging
def log: Logger

Attributes
protected
Definition Classes
Logging
def logDebug(msg: ⇒ String, throwable: Throwable): Unit

Attributes
protected
Definition Classes
Logging
def logDebug(msg: ⇒ String): Unit

Attributes
protected
Definition Classes
Logging
def logError(msg: ⇒ String, throwable: Throwable): Unit

Attributes
protected
Definition Classes
Logging
def logError(msg: ⇒ String): Unit

Attributes
protected
Definition Classes
Logging
def logInfo(msg: ⇒ String, throwable: Throwable): Unit

Attributes
protected
Definition Classes
Logging
def logInfo(msg: ⇒ String): Unit

Attributes
protected
Definition Classes
Logging
def logName: String

Attributes
protected
Definition Classes
Logging
def logTrace(msg: ⇒ String, throwable: Throwable): Unit

Attributes
protected
Definition Classes
Logging
def logTrace(msg: ⇒ String): Unit

Attributes
protected
Definition Classes
Logging
def logWarning(msg: ⇒ String, throwable: Throwable): Unit

Attributes
protected
Definition Classes
Logging
def logWarning(msg: ⇒ String): Unit

Attributes
protected
Definition Classes
Logging
def multiply(other: BlockMatrix, numMidDimSplits: Int): BlockMatrix

Left multiplies this BlockMatrix to other, another BlockMatrix.
Left multiplies this BlockMatrix to other, another BlockMatrix. The colsPerBlock of this matrix must equal the rowsPerBlock of other. If other contains SparseMatrix, they will have to be converted to a DenseMatrix. The output BlockMatrix will only consist of blocks of DenseMatrix. This may cause some performance issues until support for multiplying two sparse matrices is added. Blocks with duplicate indices will be added with each other.
other
Matrix B in A * B = C
numMidDimSplits
Number of splits to cut on the middle dimension when doing multiplication. For example, when multiplying a Matrix A of size m x n with Matrix B of size n x k, this parameter configures the parallelism to use when grouping the matrices. The parallelism will increase from m x k to m x k x numMidDimSplits, which in some cases also reduces total shuffled data.

Annotations
@Since( "2.2.0" )
def multiply(other: BlockMatrix): BlockMatrix

Left multiplies this BlockMatrix to other, another BlockMatrix.
Left multiplies this BlockMatrix to other, another BlockMatrix. The colsPerBlock of this matrix must equal the rowsPerBlock of other. If other contains SparseMatrix, they will have to be converted to a DenseMatrix. The output BlockMatrix will only consist of blocks of DenseMatrix. This may cause some performance issues until support for multiplying two sparse matrices is added.

Annotations
@Since( "1.3.0" )
Note
The behavior of multiply has changed in 1.6.0. multiply used to throw an error when there were blocks with duplicate indices. Now, the blocks with duplicate indices will be added with each other.
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
val numColBlocks: Int

Annotations
@Since( "1.3.0" )
def numCols(): Long

Gets or computes the number of columns.
Gets or computes the number of columns.

Definition Classes
BlockMatrix → DistributedMatrix
Annotations
@Since( "1.3.0" )
val numRowBlocks: Int

Annotations
@Since( "1.3.0" )
def numRows(): Long

Gets or computes the number of rows.
Gets or computes the number of rows.

Definition Classes
BlockMatrix → DistributedMatrix
Annotations
@Since( "1.3.0" )
def persist(storageLevel: StorageLevel): BlockMatrix.this.type

Persists the underlying RDD with the specified storage level.
Persists the underlying RDD with the specified storage level.

Annotations
@Since( "1.3.0" )
val rowsPerBlock: Int

Number of rows that make up each block.
Number of rows that make up each block. The blocks forming the final rows are not required to have the given number of rows

Annotations
@Since( "1.3.0" )
def subtract(other: BlockMatrix): BlockMatrix

Subtracts the given block matrix other from this block matrix: this - other.
Subtracts the given block matrix other from this block matrix: this - other. The matrices must have the same size and matching rowsPerBlock and colsPerBlock values. If one of the blocks that are being subtracted are instances of SparseMatrix, the resulting sub matrix will also be a SparseMatrix, even if it is being subtracted from a DenseMatrix. If two dense matrices are subtracted, the output will also be a DenseMatrix.

Annotations
@Since( "2.0.0" )
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def toCoordinateMatrix(): CoordinateMatrix

Converts to CoordinateMatrix.
Converts to CoordinateMatrix.

Annotations
@Since( "1.3.0" )
def toIndexedRowMatrix(): IndexedRowMatrix

Converts to IndexedRowMatrix.
Converts to IndexedRowMatrix. The number of columns must be within the integer range.

Annotations
@Since( "1.3.0" )
def toLocalMatrix(): Matrix

Collect the distributed matrix on the driver as a DenseMatrix.
Collect the distributed matrix on the driver as a DenseMatrix.

Annotations
@Since( "1.3.0" )
def toString(): String

Definition Classes
AnyRef → Any
def transpose: BlockMatrix

Transpose this BlockMatrix.
Transpose this BlockMatrix. Returns a new BlockMatrix instance sharing the same underlying data. Is a lazy operation.

Annotations
@Since( "1.3.0" )
def validate(): Unit

Validates the block matrix info against the matrix data (blocks) and throws an exception if any error is found.
Validates the block matrix info against the matrix data (blocks) and throws an exception if any error is found.

Annotations
@Since( "1.3.0" )
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

Related Doc: package distributed

class BlockMatrix extends DistributedMatrix with Logging

Instance Constructors

new BlockMatrix(blocks: RDD[((Int, Int), Matrix)], rowsPerBlock: Int, colsPerBlock: Int)

new BlockMatrix(blocks: RDD[((Int, Int), Matrix)], rowsPerBlock: Int, colsPerBlock: Int, nRows: Long, nCols: Long)

Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

def add(other: BlockMatrix): BlockMatrix

final def asInstanceOf[T0]: T0

val blocks: RDD[((Int, Int), Matrix)]

def cache(): BlockMatrix.this.type

def clone(): AnyRef

val colsPerBlock: Int

final def eq(arg0: AnyRef): Boolean

def equals(arg0: Any): Boolean

def finalize(): Unit

final def getClass(): Class[_]

def hashCode(): Int

def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean = false): Boolean

def initializeLogIfNecessary(isInterpreter: Boolean): Unit

final def isInstanceOf[T0]: Boolean

def isTraceEnabled(): Boolean

def log: Logger

def logDebug(msg: ⇒ String, throwable: Throwable): Unit

def logDebug(msg: ⇒ String): Unit

def logError(msg: ⇒ String, throwable: Throwable): Unit

def logError(msg: ⇒ String): Unit

def logInfo(msg: ⇒ String, throwable: Throwable): Unit

def logInfo(msg: ⇒ String): Unit

def logName: String

def logTrace(msg: ⇒ String, throwable: Throwable): Unit

def logTrace(msg: ⇒ String): Unit

def logWarning(msg: ⇒ String, throwable: Throwable): Unit

def logWarning(msg: ⇒ String): Unit

def multiply(other: BlockMatrix, numMidDimSplits: Int): BlockMatrix

def multiply(other: BlockMatrix): BlockMatrix

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

val numColBlocks: Int

def numCols(): Long

val numRowBlocks: Int

def numRows(): Long

def persist(storageLevel: StorageLevel): BlockMatrix.this.type

val rowsPerBlock: Int

def subtract(other: BlockMatrix): BlockMatrix

final def synchronized[T0](arg0: ⇒ T0): T0

def toCoordinateMatrix(): CoordinateMatrix

def toIndexedRowMatrix(): IndexedRowMatrix

def toLocalMatrix(): Matrix

def toString(): String

def transpose: BlockMatrix

def validate(): Unit

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from Logging

Inherited from DistributedMatrix

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped