Data warehouse

Scaling Data Transformations with DBT: Strategies for High-Volume Data Engineering

by Bhavesh Shah|16 December 202416 December 2024|big data, Cloud Computing, Data Engineering, Data warehouse

As data volumes grow and become more complex, managing large-scale data transformations has become a critical challenge for data engineers. DBT (Data Build Tool) has emerged as a powerful solution for transforming raw data into meaningful insights within a data...

Building an Agile Data Lake

by Pranav Shukla|06 June 201613 May 2019|big data, Data warehouse, Hadoop

Starting a data lake initiative is often a big step for an organization. There are many logical ways in which organizations can move towards fact-based decision making. Traditional way of EDW and BI tools have worked for many years. These systems...

Hadoop, Spark and effect on Data Warehousing/BI

by Pranav Shukla|10 May 201611 May 2019|big data, Data warehouse, Hadoop, Spark

The nature of data that enterprises have been dealing with has been changing in the last few years. It is no longer just transactional data. Volume, velocity, and variety of data is increasing steadily. Why should you care? If your...

Role of hadoop in today’s data warehouses

by Krishna Meet|30 November 201511 May 2019|big data, Data warehouse, Hadoop, Uncategorized

Over the last decade organisations have done substantial investments in their data warehouses in terms of setting up hardware infrastructure, software licenses, BI tools and man-power to harvest huge amount of data and gain insights. However, with escalating data volume...