org.apache.spark.storage

StorageStatus

class StorageStatus extends AnyRef

:: DeveloperApi :: Storage information for each BlockManager.

This class assumes BlockId and BlockStatus are immutable, such that the consumers of this class cannot mutate the source of the information. Accesses are not thread-safe.

Annotations
@DeveloperApi()
Source
StorageUtils.scala
Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. StorageStatus
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new StorageStatus(bmid: BlockManagerId, maxMem: Long, initialBlocks: Map[BlockId, BlockStatus])

    Create a storage status with an initial set of blocks, leaving the source unmodified.

  2. new StorageStatus(blockManagerId: BlockManagerId, maxMem: Long)

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. val blockManagerId: BlockManagerId

  8. def blocks: Map[BlockId, BlockStatus]

    Return the blocks stored in this block manager.

    Return the blocks stored in this block manager.

    Note that this is somewhat expensive, as it involves cloning the underlying maps and then concatenating them together. Much faster alternatives exist for common operations such as contains, get, and size.

  9. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  10. def containsBlock(blockId: BlockId): Boolean

    Return whether the given block is stored in this block manager in O(1) time.

    Return whether the given block is stored in this block manager in O(1) time. Note that this is much faster than this.blocks.contains, which is O(blocks) time.

  11. def diskUsed: Long

    Return the disk space used by this block manager.

  12. def diskUsedByRdd(rddId: Int): Long

    Return the disk space used by the given RDD in this block manager in O(1) time.

  13. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  14. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  15. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  16. def getBlock(blockId: BlockId): Option[BlockStatus]

    Return the given block stored in this block manager in O(1) time.

    Return the given block stored in this block manager in O(1) time. Note that this is much faster than this.blocks.get, which is O(blocks) time.

  17. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  18. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  19. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  20. val maxMem: Long

  21. def memRemaining: Long

    Return the memory remaining in this block manager.

  22. def memUsed: Long

    Return the memory used by this block manager.

  23. def memUsedByRdd(rddId: Int): Long

    Return the memory used by the given RDD in this block manager in O(1) time.

  24. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  25. final def notify(): Unit

    Definition Classes
    AnyRef
  26. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  27. def numBlocks: Int

    Return the number of blocks stored in this block manager in O(RDDs) time.

    Return the number of blocks stored in this block manager in O(RDDs) time. Note that this is much faster than this.blocks.size, which is O(blocks) time.

  28. def numRddBlocks: Int

    Return the number of RDD blocks stored in this block manager in O(RDDs) time.

    Return the number of RDD blocks stored in this block manager in O(RDDs) time. Note that this is much faster than this.rddBlocks.size, which is O(RDD blocks) time.

  29. def numRddBlocksById(rddId: Int): Int

    Return the number of blocks that belong to the given RDD in O(1) time.

    Return the number of blocks that belong to the given RDD in O(1) time. Note that this is much faster than this.rddBlocksById(rddId).size, which is O(blocks in this RDD) time.

  30. def offHeapUsed: Long

    Return the off-heap space used by this block manager.

  31. def offHeapUsedByRdd(rddId: Int): Long

    Return the off-heap space used by the given RDD in this block manager in O(1) time.

  32. def rddBlocks: Map[BlockId, BlockStatus]

    Return the RDD blocks stored in this block manager.

    Return the RDD blocks stored in this block manager.

    Note that this is somewhat expensive, as it involves cloning the underlying maps and then concatenating them together. Much faster alternatives exist for common operations such as getting the memory, disk, and off-heap memory sizes occupied by this RDD.

  33. def rddBlocksById(rddId: Int): Map[BlockId, BlockStatus]

    Return the blocks that belong to the given RDD stored in this block manager.

  34. def rddStorageLevel(rddId: Int): Option[StorageLevel]

    Return the storage level, if any, used by the given RDD in this block manager.

  35. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  36. def toString(): String

    Definition Classes
    AnyRef → Any
  37. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  38. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  39. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped