Runtime configuration interface for the Spark Session

Retrieves or sets runtime configuration entries for the Spark Session

spark_session_config(sc, config = TRUE, value = NULL)

Arguments

sc

A spark_connection.

config

The configuration entry name(s) (e.g., "spark.sql.shuffle.partitions"). Defaults to NULL to retrieve all configuration entries.

value

The configuration value to be set. Defaults to NULL to retrieve configuration entries.

See also

Other Spark runtime configuration: spark_adaptive_query_execution(), spark_advisory_shuffle_partition_size(), spark_auto_broadcast_join_threshold(), spark_coalesce_initial_num_partitions(), spark_coalesce_min_num_partitions(), spark_coalesce_shuffle_partitions()