Skip to main content

Accessing data from data lakes

Learn how to access data stored in data lakes.

info

If you want to try this example, you can deploy the following endpoint:

Serve data from S3 buckets across separate AWS accounts
Learn how to serve data live from two S3 buckets in separate AWS accounts.

Usage:

/hostnames-s3-multiple-buckets

Introduction‚Äč

Snapi supports reading data directly from S3.

To do so, you must first build a location and then read the file. For example, the following code reads a CSV file from S3:

let
location = S3.Build("s3://my-bucket/data.csv", accessKey = "<AWS ACCESS KEY>", secretKey = "<AWS SECRET KEY>")
in
Csv.InferAndRead(location)

You can use wildcards in the S3 location.

note

If you want to access data from other data lakes that are not yet supported, reach out to us.