Data Engineer - Mid-senior (Lisbon)

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same. 

YOUR ROLE:

We are looking for a Data Engineer with experience in data ingestion, processing, and management in cloud environments, especially within the Azure ecosystem. The ideal candidate should be proactive and able to work in agile teams using methodologies like Scrum.

Responsibilities:
• Develop and manage data pipelines with Azure Data Factory (ADF).
• Process, transform, and optimize data using Databricks.
• Collaborate with Product Owners and Tech Leaders to define and implement data solutions in agile sprints.
• Store and organize data in Azure Storage Accounts.
• Automate workflows and processes to optimize data ingestion and processing.
• Document processes and implement best practices throughout the data pipeline.
Skills:
• Ingest data using tools such as Informatica PowerCenter (PWC).

• Knowledge in Azure Data Factory (ADF) for orchestration and automation of data pipelines.
  ---> Proven experience in pipeline construction;
• Practice in Databricks with Python and SQL for processing and analyzing large volumes of data.
  ---> Proven experience in ETL development and generation of partitioned parquet files;
• Experience in working with SQL and selects in various formats.
  ---> Proven experience in developing more complex select's;
•Experience working with Resource Groups, Azure Storage Accounts, Containers, storing and reading files and database and data organization.
• Knowledge in data formats such as Parquet and experience in data transfer with SFTP.
• Ability to work in agile teams using methodologies such as Scrum.
•Experience working with Azure DevOps.

• Ingest data from SAP R/3 systems via IDocs.
• Knowledge of different data integration and automation tools.
• Experience in data security practices and data management in cloud environments.
• Experience with Informatica PowerCenter (PWC) for data integration and processing; though "nice to have," it will be essential for development.
• Familiarity with other storage and processing technologies in Azure environments.
• Experience with Jira, Confluence, WinSCP or FileZilla, Control-M.
Additional Skills:
• Clear communication and collaboration with cross-functional teams.
• Proactive in documenting and improving data workflows.
• Teamwork, commitment, and dedication.
• Bachelor in Informatic sciences.
• English level B2.

• Join a multicultural and inclusive team environment.
• Enjoy a supportive atmosphere promoting work-life balance.
• Engage in exciting national and international projects.
• Hybrid work.
• Your career growth is central to our mission. Our array of career growth programs and diverse professionals are crafted to support you in exploring a world of opportunities.
• Training and certifications programs.
• Health and life insurance.
• Referral program with bonuses for talent recommendations.
• Great office locations.