Skip to main content

What is RAW?

RAW is a platform to enable fast and easy access, integration, delivery and sharing of data services as APIs. This includes:

  1. Query multiple data sources in real-time including files, data lakes, databases and APIs;
  2. Integrate and transform data in real-time;
  3. Deliver and manage the data product output as APIs;
  4. Share access to the APIs with any number of users or applications.

RAW's use cases cover the entire data chain from acquisition, transformation as well as sharing.

info

If you prefer a hands-on approach, visit our Guides to find examples to get started now.

RAW main features are:

  • Runs in the Cloud in a scalable infrastructure that is fully managed for you.
  • Uses a low-code data-oriented scripting language called Snapi that is easy to get started and powerful enough for the most complex data integration scenarios.
  • Built for "developers first", with best-in-class development experience on the browser and through a VS Code extension.
  • Is DataOps-ready and "automation friendly", including Git integration and a built-in CI/CD infrastructure for testing and hosting data APIs.

If you have questions/comments, join us on Discord or contact us.

Use Cases

RAW is a comprehensive platform that accelerates data engineering projects by allowing developers to easily access, integrate, and deliver data services as APIs. The scenarios covered by RAW are:

  • Real-time Data Integration. Integrate data in real-time without ETL/ELT pipelines by building APIs that join and serve data in real-time. No need to build data lakes or data warehouse, or using tools such as DBT, Denodo or MuleSoft.
  • Real-time Data Augmentation. Augment your existing data integration ETL/ELT pipelines with real-time data using RAW. More powerful than FiveTran or DBT, safer and more maintenable than Python scripts.
  • Real-time Data Sharing. Share data in real-time as APIs to internal or external users and applications. Safer than custom coding. Avoid creating new data pipelines or extend existing ones.

Real-time Data Integration

👉 Learn how to use RAW to integrate and serve data in real-time. 👈

  • Building ETL/ELT pipelines is a complex, expensive and time-consuming process. ETL/ELT pipelines can also lead to data duplication, increased latency and potential loss of data or precision during the transformation processes.
  • The ability to build and serve datasets quickly can be instrumental to your developer and business teams. This can lead to happier developers and faster business decisions!
  • With RAW you quickly build and deploy APIs - called Snapis - that directly query and integrate data from your operational systems and deliver real-time results all without ETL/ELT pipelines.
Stories from users

Learn how we created a live business dashboard using RAW and avoiding creating a data warehouse in the process.

How does it work?

To integrate data in RAW, you build APIs using RAW's built-in language called Snapi. Snapi is a low-code scripting language that provides advanced querying capabilities. Snapi allows you to quickly build APIs that query data directly at source from databases, data lakes, file stores or even web services. Snapi allows you to transform and join data in complex ways, all within a single solution.

As a result, you no longer have to build and maintain dedicated ETL/ELT pipelines for many use cases. Instead, data is queried and transform in real-time, and published as web services, which can be easily consumed by other users or applications. This in turn means you get to deliver projects faster.

Other Benefits

Since the RAW platform hosts these APIs as a service, you do not have to worry about operations. You also get access to RAW's built-in monitoring tools, as well as RAW's built-in API catalog. As a result, you have a leaner and faster data integration platform with a secure, single access point of data with very little development and operational effort.

Real-time Data Augmentation

👉 Learn how to use RAW to augment your data pipelines in real-time. 👈

  • Augmenting your pipelines with real-time information is key to many use cases. For instance, you may need to enrich datasets with publicly available data, build a service that reacts to information that is available externally or process your data using external data cleaning or transformation services.
  • The ability to augment data quickly and efficiently, and without rebuilding ELT/ETL pipelines can mean the difference between delivering results to your users quickly or losing an opportunity.
  • With RAW, you quickly build and deploy APIs - called Snapis - that directly deliver real-time data and integrate seamlessly with your existing data pipelines.

How does it work?

To augment your data pipelines with RAW, you start by building REST APIs. These REST APIs are developed using RAW's built-in language called Snapi. Snapi is a low-code scripting language that provides advanced querying and transformation capabilities over atabases, data lakes, files or web services. Once you've built the REST API in RAW that provides your desired real-time data, you then integrate this API with your existing data tools, whether ETL/ELT tools like DBT, MuleSoft, Denodo, or visualization tools like Tableau or others.

As a result, you do not have to build or modify existing data pipelines, which in turn means you get to deliver projects faster and with access to real-time data.

Other Benefits

Since the RAW platform hosts these APIs as a service, you do not have to worry about operations. You also get access to RAW's built-in monitoring tools, as well as RAW's built-in API catalog. As a result, you have a leaner and faster data integration platform with a secure, single access point of data with very little development and operational effort.

Real-time Data Sharing

👉 Learn how to use RAW to share data in real-time from a database, data lake, files or even web services. 👈

  • Sharing data with internal or external teams is difficult to do in a secure manner and with proper governance.
  • Sharing data can yield significant returns: internal teams can quickly build new products or services with the newly-available data; organizations can share data with partners, suppliers or customers for new business opportunities.
  • RAW allows you to share data from a single platform and stay in control of how data is consumed. Development, hosting, invitations to internal or external users, management of API keys, data consistency and cataloguing are all provided out-of-the-box in an easy-to-use all-in-one platform.

How does it work?

To share data in RAW, you start by building REST APIs. These REST APIs are developed using RAW's built-in language called Snapi. Snapi is a low-code scripting language that provides advanced querying capabilities. Snapi allows you to quickly build REST APIs that query data directly at source from databases, data lakes, file stores or even web services. Snapi allows you to transform data in complex ways, which means your REST APIs can even provide a "last mile" real-time transformation step such as filtering out records based on user roles/scopes, or even join data from multiple systems, all in real-time.

As a result, you do not have to build and maintain dedicated data pipelines for data sharing, which in turn means you get to deliver projects faster.

Other Benefits

Since the RAW platform hosts these APIs as a service, you do not have to worry about operations. You also get access to RAW's built-in monitoring tools, as well as RAW's built-in API catalog. As a result, you have a leaner and faster data integration platform with a secure, single access point of data with very little development and operational effort.

Next Steps

As the next step we recommend browsing through the Guides section to find how RAW can solve specific engineering problems.

If you have questions/comments, join us on Discord or contact us.