Data Engineer (W/M)

You will be part of a central data enterprise team within the data technology pillar that aims at building the best data technology solutions for the client. You will work with other engineers and product teams to create the best-in-class data platform with leading capabilities to support the business solve the most critical challenges through data solutions.

Your Role:

• You will be executing testing, including mocking external API's for effective unit testing and integration testing;
• Responsible for building data pipelines using Python;
• Responsible to help with refinement/requirements gathering;
• And linting and code formatting.

• More than 3 years of experience;
• English (Advanced/Fluent);
• Extensive knowledge of Python, including: object oriented programming (OOP), decorators, generators, comprehensions, docstrings and doc generation, packaging: wheel creation. Testing (unittest), including mocking external API's for effective unit testing and integration testing. Optimization: using generators, avoiding for loops understand memory and time complexity of code linting and code formatting, flake8, black;
• Deep knowledge of modern DevOps/TDD workflow, using Git version control;
• Intimate with Azure DevOps CI/CD, familiar with pull requests, pipeline YAML definitions and link work items to branches and PR's;
• Experience with SCRUM;
• Deep knowledge of Azure, understand of ADLSv2, Key Vault ADF. Streaming analytics with IoT/time series is a must;
• Knowledge of Databricks;
• Spark (Pyspark API), understand Spark SQL, DAG optimization, lazy evaluation and distributed computing;
• Basic IT/networking knowledge.

Referral bonuses for recommending your friends to Capgemini Engineering;

Continuous training on Next*;

Offices in a great location;

Participation in international projects;

Integration in a multinational company;

Career Evolution.