Overview: It is sometimes important to figure out how much it will cost to run BigQuery and how to optimize the cost. Google has provided tools to estimate how many slots you would need and how to manage cost once you have some workloads (data and processing i.e. queries, reports…

Problem Statement: If we do a little calculation we find that it cost $26,000/month for storing 1 PB of data in a US multi-region standard bucket. Google Cloud storage provides 11 9’s durability. So it is important to store only the data that we need to reduce Google Cloud Storage cost. When…

Partition is one of the most important feature for BigQuery performance consideration. BigQuery supports several partitioning schemes including: Date or Time unit columns Ingestion time Integer range columns Sometimes we need to find out how many records are there in the latest partition. In the article we will see how…

Overview: As many organizations use BigQuery for Modern Data Warehouse system, it is very important for any Enterprise Data Warehouse (EDW) systems to support batch jobs that have strict Service Level Agreement SLA (for batch windows). …

Resource labels are used in Google Cloud Platform for grouping resources. These labels are passed along to Google Cloud billing. This is very helpful if you want to allocate cost across various business units or environments (e.g. Development, Test, Production etc.). The official documentation states that you can label the…

Are you confused by the multitude of Google Cloud persistence layer options available to you when designing or migrating your applications to Google Cloud? …