Data Engineer (Brussels)
KNOWLEDGE AND SKILLS Following skills and knowledge are required for the performance of the above listed tasks:
- Core Engineering Languages: Expert proficiency in SQL and Python (PySpark); strong working knowledge of Java for backend data processing or SDK integrations.
- Generic Data Engineering: Solid understanding of Software Engineering principles applied to data (DRY code, modularity, error handling, and logging).
- Data Structures: Proficiency in working with structured, semi-structured (JSON/XML), and unstructured data formats.
- DevOps & CI/CD: Practical experience with Git, branching strategies, and automating deployments through Azure DevOps or GitHub Actions.
- Distributed Computing: Strong grasp of Apache Spark internals, memory management, and execution plans.
- Languages: Good knowledge of written/spoken English (working language). Knowledge of French is an asset
SPECIFIC EXPERTISE
- Fabric Delta Lake Management: Expertise in optimizing and managing transaction logs within the Fabric Lakehouse.
- Multi-stack Integration: Proven ability to connect Fabric with non-Microsoft tools, utilizing generic JDBC/ODBC drivers or REST APIs.
- Performance Tuning: Deep experience in identifying bottlenecks in data flows and optimizing code for low-latency processing.
- Data Design Patterns: Practical experience implementing standard patterns like SCD (Slowly Changing Dimensions), Change Data Capture ingestion and idempotency in a Delta Lake environment.
CERTIFICATIONS & STANDARDS:
- Microsoft Focus: DP-700 (Microsoft Certified: Fabric Data Engineer Associate) – required.
- Generic/Cloud Focus: DP-203 (Azure Data Engineer) or equivalent certifications from Databricks (Data Engineer Associate) or AWS – a plus.
What can you expect from us? Mind-blowing workplace culture. You will be integrated in a professional, dynamic and collaborative team. 100% Remote opportunities We want you to have the flexibility to work where you feel most comfortable and productive. International Career You can expect professional growth and to be connect with the world. We are represented in Portugal, Belgium, Luxembourg, and Denmark. And with projects in many other countries: Netherlands, Luxembourg, Singapore and in the United States of America (and a lot more is coming…) Extra Benefits & Perks If you wish to work with us and you are outside European Union (good news…) we are a Tech Visa Company, We will help! As a plus, we provide Health and Life Insurance.