Data Engineering and Architecture · Physical, Online
SQL for Data Engineering Training Workshop
5 Days4 sessions available Certificate on completion
SQL for Data Engineering Training Workshop is a practical programme designed to develop the advanced SQL skills required to build, transform, validate and optimise data pipelines and analytical data platforms.
Unlike general SQL courses that focus primarily on querying databases, this workshop focuses on how SQL is used by data engineers in real-world data workflows. Participants learn how to use SQL for data extraction, cleansing, transformation, deduplication, incremental loading, data validation, analytical modelling and production ETL/ELT pipelines.
Course objectives
Apply advanced SQL techniques to extract, transform, clean, validate and integrate data from multiple sources. Develop SQL-based ETL and ELT workflows using CTEs, window functions, joins, MERGE/UPSERT operations and reusable transformation logic.
Implement reliable data-engineering patterns including incremental loading, deduplication, Slowly Changing Dimensions, reconciliation and data-quality validation.
Optimise SQL workloads for large datasets using execution plans, indexing, partitioning, query optimisation and efficient data-transformation techniques.
Optimise SQL workloads for large datasets using execution plans, indexing, partitioning, query optimisation and efficient data-transformation techniques.
Develop production-ready SQL solutions that integrate with modern data platforms, analytics engineering tools, cloud warehouses, lakehouses and automated data pipelines.
Who should attend
Data Engineers, Aspiring Data Engineers, ETL Developers, ELT Developers, Data Analysts, Analytics Engineers, Database Administrators, Database Developers, SQL Developers, Business Intelligence Developers, Data Architects, Data Warehouse Developers, Data Scientists, Machine Learning Engineers, Software Developers, Back-end Developers, Cloud Data Engineers, Data Platform Engineers, BI Professionals, IT Managers, ICT Managers, Technology Professionals, Research Data Professionals, and professionals transitioning from data analysis or database administration into data engineering.
Course content
Module 1: SQL Foundations for Data Engineering Role of SQL in data engineering, SQL and relational databases, OLTP versus OLAP, SQL data-engineering lifecycle, source systems, staging systems, analytical systems, data warehouses, data lakes, lakehouses,
Module 2: Advanced SQL Querying SELECT statements, filtering, sorting, aliases, expressions, CASE statements, NULL handling, data types, string functions, date and time functions, mathematical functions, conditional logic, DISTINCT, LIMIT/TOP, query comp
Module 3: Joins & Data Integration with SQL INNER JOIN, LEFT JOIN, RIGHT JOIN, FULL OUTER JOIN, CROSS JOIN, SELF JOIN, multi-table joins, anti-joins, semi-joins, joining datasets from different business domains, join conditions, duplicate records after j
Module 4: Aggregation & Analytical SQL GROUP BY, HAVING, aggregate functions, conditional aggregation, distinct counts, grouped calculations, analytical metrics, summary tables, aggregation strategies, business metrics, data profiling using SQL and aggre
Module 5: Subqueries, CTEs & Modular SQL Subqueries, correlated subqueries, Common Table Expressions, recursive CTEs, multiple CTEs, nested transformations, reusable SQL logic, modular SQL design, readable SQL, transformation pipelines using CTEs and deb
Module 17: SQL for Big Data & Spark Spark SQL fundamentals, SQL over large datasets, DataFrames and SQL, distributed SQL processing, partitioning, large-scale joins, aggregations, Spark SQL optimisation, SQL with Delta Lake, lakehouse queries and integra
Module 18: Production SQL, Automation & Data Pipeline Reliability Production SQL standards, parameterisation, reusable scripts, idempotency, error handling, transaction management, logging, data reconciliation, retry and recovery strategies, SQL testing,
Module 19: SQL for Analytics, BI & AI-Ready Data Building analytical tables, data marts, semantic datasets, BI-ready datasets, Power BI integration, reporting tables, feature datasets, machine-learning data preparation, AI-ready datasets, data aggregatio
Module 20: End-to-End SQL Data Engineering Capstone Source-system analysis, raw data ingestion, staging-layer development, SQL cleansing, transformation, deduplication, incremental loading, dimensional modelling, data-quality validation, analytical-layer
General notes
SQL Server, PostgreSQL, MySQL, Oracle, Microsoft Fabric, Snowflake, BigQuery, Amazon Redshift, Databricks SQL, Apache Spark/Spark SQL, dbt, Python, Power BI, Git/GitHub, cloud data warehouses, data lakes, lakehouses and SQL development environments such as SSMS, Azure Data Studio and DBeaver.
The workshop is ideal for data engineers, aspiring data engineers, ETL/ELT developers, data analysts, analytics engineers, database administrators, BI professionals, data architects, data warehouse developers, data scientists and IT professionals who want to develop advanced SQL skills for modern data engineering
Participants will learn how to use SQL for data extraction, cleansing, transformation, integration, validation, ETL/ELT pipeline development, incremental data processing, analytical modelling and data-quality management. Advanced SQL techniques such as CTEs, joins, window functions and performance optimisation are also covered.
Yes. The workshop focuses strongly on using SQL to build ETL and ELT workflows, including staging, data transformation, incremental loading, MERGE/UPSERT operations, data validation, source-to-target reconciliation and reusable SQL transformation pipelines.
The training can be delivered using platforms such as SQL Server, PostgreSQL, MySQL, Oracle, Microsoft Fabric, Snowflake, BigQuery, Amazon Redshift, Databricks SQL and Spark SQL, depending on the organisation's requirements.
Yes. The workshop is hands-on and project-oriented. Participants work with realistic datasets and develop practical solutions such as SQL transformation pipelines, ETL/ELT workflows, data-quality validation queries, incremental loading processes, analytical data marts and performance-optimised SQL solutions.