Description
As a Tech Lead Data Engineer, you will be responsible for designing, building, and maintaining advanced data pipelines that process batch or near-real-time data within our data platform. These pipelines feed into the data lake and data warehouse (DWH) and support various data products for AI/ML, BI, and data integration use cases. Data is processed from a landing zone (AWS S3) and made available in the cloud-based data lake and warehouse.
You will lead our scrum team of data engineers in designing, implementing and maintaining high-quality, scalable and robust data solutions. You will act as a bridge between the team and solution architects and you will interact with different stakeholders, both from the business and IT. With your strong communication skills, you will work closely with solution architects to translate business requirements into effective technical solutions, ensuring alignment with business goals. You will guide the team in adhering to architectural standards and guidelines and you will serve as a coach and mentor to other data engineers.
You will work in an agile environment, focused on continuous improvement and high-quality delivery.
Responsibilities as Tech Lead
- Structuring and modelling data, such as schema design, dimensional and Data Vault modelling.
- Designing technical solutions for data products that support AI, BI, and data integration use cases.
- Setting up, maintaining, and executing end-to-end data pipelines according to architectural guidelines and best practices.
- Defining and enforcing development standards, guidelines and best practices.
- Taking ownership of the quality of delivery and support of the data products of the team.
Technical Skills
Hands-on experience with the fundamentals of:
- SQL
- Python & PySpark
- Snowflake
- Airflow
- JSON, Parquet
- Data modelling, including dimensional and Data Vault modelling
- Building data pipelines with Dbt
- Data processing in an AWS cloud environment (S3, Glue, Athena, AppFlow, DMS, IAM)
- Agile working methods, CI/CD, Git
Excellent communication skills, both verbal and written in English (Dutch or French is a plus).
Preferred experience or interest in
- Qlik
- Data ingestion (e.g., CDC, APIs)
- Apache Kafka
- Apache Iceberg
- Event-based data processing
- Data product architectures
- Data quality metrics
- Data catalog and data lineage tools (e.g., DataHub)
In this role, you will combine technical expertise with leadership and communication skills, ensuring the team works together effectively to deliver high-quality data solutions that directly contribute to the organization’s strategic goals.
