object SparkSession extends SparkSessionCompanion with Serializable
- Source
- SparkSession.scala
- Alphabetic
- By Inheritance
- SparkSession
- Serializable
- SparkSessionCompanion
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Type Members
- class Builder extends SparkSessionBuilder
- type Session = SparkSession
- Definition Classes
- SparkSession → SparkSessionCompanion
Value Members
- def active: Session
Returns the currently active SparkSession, otherwise the default one.
Returns the currently active SparkSession, otherwise the default one. If there is no default SparkSession, throws an exception.
- Definition Classes
- SparkSessionCompanion
- Since
2.4.0
- def builder(): Builder
Creates a SparkSessionBuilder for constructing a SparkSession.
Creates a SparkSessionBuilder for constructing a SparkSession.
- Definition Classes
- SparkSession → SparkSessionCompanion
- def clearActiveSession(): Unit
Clears the active SparkSession for current thread.
Clears the active SparkSession for current thread. Subsequent calls to getOrCreate will return the first created context instead of a thread-local override.
- Definition Classes
- SparkSessionCompanion
- Since
2.0.0
- def clearDefaultSession(): Unit
Clears the default SparkSession that is returned by the builder.
Clears the default SparkSession that is returned by the builder.
- Definition Classes
- SparkSessionCompanion
- Since
2.0.0
- def getActiveSession: Option[SparkSession]
Returns the active SparkSession for the current thread, returned by the builder.
Returns the active SparkSession for the current thread, returned by the builder.
- Definition Classes
- SparkSession → SparkSessionCompanion
- def getDefaultSession: Option[SparkSession]
Returns the default SparkSession that is returned by the builder.
Returns the default SparkSession that is returned by the builder.
- Definition Classes
- SparkSession → SparkSessionCompanion
- def setActiveSession(session: SparkSession): Unit
Changes the SparkSession that will be returned in this thread and its children when SparkSession.getOrCreate() is called.
Changes the SparkSession that will be returned in this thread and its children when SparkSession.getOrCreate() is called. This can be used to ensure that a given thread receives a SparkSession with an isolated session, instead of the global (first created) context.
- Definition Classes
- SparkSession → SparkSessionCompanion
- def setDefaultSession(session: SparkSession): Unit
Sets the default SparkSession that is returned by the builder.
Sets the default SparkSession that is returned by the builder.
- Definition Classes
- SparkSession → SparkSessionCompanion