pyspark.sql.types.
StructField
A field in StructType.
StructType
name of the field.
DataType
DataType of the field.
whether the field can be null (None) or not.
a dict from string to simple type that can be toInternald to JSON automatically
Examples
>>> (StructField("f1", StringType(), True) ... == StructField("f1", StringType(), True)) True >>> (StructField("f1", StringType(), True) ... == StructField("f2", StringType(), True)) False
Methods
fromInternal(obj)
fromInternal
Converts an internal SQL object into a native Python object.
fromJson(json)
fromJson
json()
json
jsonValue()
jsonValue
needConversion()
needConversion
Does this type needs conversion between Python object and internal SQL object.
simpleString()
simpleString
toInternal(obj)
toInternal
Converts a Python object into an internal SQL object.
typeName()
typeName
Methods Documentation
This is used to avoid the unnecessary conversion for ArrayType/MapType/StructType.