Skip to main content

Parquet-Avro

The supported PARQUET-AVRO types are: strings, booleans, ints, longs, doubles, floats, dates, time, timestamps, records, arrays and nulls.

NOTE:

  • Time and timestamps are supported only with milli-second precision, parquet files with micro-second precision will fail to read.
  • Union types are only supported between null and another type which will be mapped to a nullable type in RAW.
  • Enums, maps, decimal, fixed and duration types are not supported.

Avro arrays will be converted to RAW collections.

Multiple variants are supported:

  • if connection or other problems trigger a runtime error or return null;
  • if reading a single location or, in the case of file systems read directories or wildcards and merge their contents;
  • if inference is used or whether the type and format properties are specified.