AWS GLUE pricing calculation

The video titled "AWS Glue pricing calculation" provides a detailed tutorial on how to calculate the costs associated with running AWS Glue jobs. The speaker emphasizes the importance of understanding Glue costs, particularly for developers who may inadvertently use inefficient configurations that lead to higher expenses over time.

Key Points Covered:

• Understanding AWS Glue Jobs:
  • The speaker demonstrates navigating the AWS console to access Glue services and ETL jobs.
  • There is a lack of direct visibility into costs incurred for specific job runs, making it essential to understand how to calculate these costs.
• Data Processing Unit (DPU):
  • The concept of DPU is introduced, defined as a measure of processing power equivalent to four virtual CPUs and 16 GB of memory.
  • The speaker explains how to determine the number of DPUs based on the worker type selected (e.g., g1x, g2x, g4x, g8x) and the number of workers.
• Worker and DPU Mapping:
  • Each worker type corresponds to a specific number of DPUs (e.g., g1x = 1 DPU, g2x = 2 DPUs, etc.).
  • The speaker provides examples of how to calculate the total number of DPUs based on the configuration chosen.
• AWS Glue Pricing:
  • Pricing is discussed in terms of DPU hours, with standard execution costing $0.44 per DPU hour and flexible execution costing $0.29 per DPU hour.
  • Billing occurs per second with a minimum charge of one minute.
• Cost Calculation Formula:
  • The speaker outlines a formula for calculating Glue costs based on the number of workers, mapping units, job duration, and the applicable DPU hour rate.
  • Multiple examples are provided to illustrate how to apply the formula in different scenarios, including both standard and flexible executions.
• Practical Demonstration:
  • The speaker conducts a practical demonstration of running a Glue job and observing the DPU usage in real-time.

Main Speakers/Sources:

• The video is presented by an unnamed speaker who is providing a tutorial based on their experience with AWS Glue. They reference AWS documentation for definitions and pricing information.