Description
Responsibilities
- Design, implement, and maintain data pipelines and transformations on Databricks and Synapse.
- Develop and manage reusable, high-performance data products across bronze, silver, and gold layers.
- Integrate structured and unstructured data from diverse sources (e.g., SAP, Salesforce, external systems).
- Ensure data quality, lineage, and compliance with governance and security standards.
- Optimize data processing for scalability, performance, and cost efficiency.
- Collaborate with the Data architect, Business Analysts and Business stakeholders to translate requirements into
technical solutions. - Automate workflows, testing, and deployment via CI/CD pipelines
Requirements
Years of experience: 5+ years of proven experience as a Data Engineer.
Functional Skills
- Strong understanding of modern data architectures.
- Ability to work cross-functionally with data, IT, and business teams.
- Knowledge of data modeling techniques and data lifecycle management.
- Experience with Agile and DevOps delivery approaches.
- Focus on standardization, documentation, and reusability of data components.
Technical Skills
- Languages & Frameworks: Python, PySpark, SQL.
- Platforms: Azure Databricks, Azure Synapse, Azure Data Lake Storage, Azure Data Factory.
- Data Modeling: Data Vault, Dimensional, and Entity-Relationship modeling.
- Automation & DevOps: CI/CD (e.g., Azure DevOps, Git), Infrastructure-as-Code (e.g., Terraform).
- Data Governance: Familiarity with Microsoft Purview & Databricks Unity Catalog or comparable metadata/lineage
tools.
Soft Skills
- Strong problem-solving and analytical mindset.
- High reliability and ownership for data quality and delivery.
- Collaborative, open communicator across technical and business teams.
- Proactive, curious, and eager to continuously learn new technologies.
- Structured and autonomous working style in agile environments.
Desired Certifications - Databricks related certifications.
Languages
- English – C1
- Portuguese – B2
Benefits
The benefits will be determined after the contractual conditions have been defined.
