Skip to contents

Convert column(s) from avro format

Source: R/sdf_interface.R
sdf_from_avro.Rd

Convert column(s) from avro format

Usage

sdf_from_avro(x, cols)

Arguments

x

An object coercible to a Spark DataFrame

cols

Named list of columns to transform from Avro format plus a valid Avro schema string for each column, where column names are keys and column schema strings are values (e.g., c(example_primitive_col = "string", example_complex_col = "{\"type\":\"record\",\"name\":\"person\",\"fields\":[ {\"name\":\"person_name\",\"type\":\"string\"}, {\"name\":\"person_id\",\"type\":\"long\"}]}")