Skip to main content

Real-time data integration

Learn how to use RAW to integrate data in real-time without having to build ETL/ELT pipelines.

To get started, see the Examples section below.

RAW allows you to integrate data in real-time without having to build ETL/ELT pipelines. This is in contrast with a traditional ETL or ELT scenario where data is first stored in a data warehouse. However, for many scenarios, ETL/ELT leads to data duplication, loss of data or of precision, and moreover, introduces a latency in the data availability, which prevents real-time analysis. By contrast, real-time data integration, often used in conjuction with data streaming architectures, addresses all of these inneficiencies and allow businesses to have real-time data access.

To integrate data in RAW, you start by building REST APIs. These REST APIs are developed using RAW's built-in language called Snapi. Snapi is a low-code scripting language that provides advanced querying capabilities. Snapi allows you to quickly build REST APIs that query data directly at source from databases, data lakes, file stores or even web services. Snapi allows you to transform and join data in complex ways, all within a single solution. This avoids having to build and maintain dedicated ETL/ELT pipelines, which in turn means you get to deliver projects faster. Instead, data is queried and transform in real-time, and published as web services, which can be easily consumed by other users or applications.

How does it work?

  1. Create/Design an API in RAW.
  2. Write the Snapi code to power that API.
  3. Deploy!

Because the RAW platform also hosts these APIs as a service, you do not have to worry about operations. You also get access to RAW's built-in monitoring tools, as well as RAW's built-in API catalog. As a result, you have a leaner and faster data integration platform with a secure, single access point of data with very little development and operational effort.

Examples

To learn how to integrate data in real-time in RAW, we have compiled a few examples to get started. Click below, follow the instructions to clone the example, create your own RAW account if you do not have one, and get started using RAW today!

Next Steps

If you want to learn more: