Data Engineer/Wrangler (RE1)

Context And Mission

At the Data Analytics and Visualization Group of the BSC, we are looking for a software engineer to work with us to develop infrastructure and to manage the data ingestion and collection for our data pipelines, specially digital twins. The position involves developing and deploying data ingestion, cleaning, preparation, and storage pipelines, and make It available to machine learning and interface layers.
The developments will be developed to run in internal High-Performance Computing as well as cloud architectures. The candidate will work in close collaboration with multiple projects and other members of the team in developing these tools.

Key Duties

- Develop the data processing layer of a platform for urban digital twins
- Implement usable tools to control and monitor all steps of the pipelines
- Document all the data preparation and processing steps to ensure traceability of the data
- Produce documentation of the code


Requirements

. Education
- Bachelor’s degree in Software Engineering or equivalent
. Essential Knowledge and Professional Experience
- Expert knowledge of Python and C++
- Master’s degree in Computer Science or equivalent. Alternatively, 1-year experience as a software engineer/developer
- Experience on virtualization, communication, and storage platforms
. Additional Knowledge and Professional Experience
- Experience working with Apache Kafka, Spark
- Experience with some orchestrating software
- Experience in workflow software
- Interest in science, research, and engineering a plus
. Competences
- Self-organization and problem-solving
- Proactive, ability to take initiative and prioritize tasks
- Ability to work independently
- Good written and verbal communication skills


Conditions

- The position will be located at BSC within the CASE Department
- We offer a full-time contract (37.5h/week), a good working environment, a highly stimulating environment with state-of-the-art infrastructure, flexible working hours, extensive training plan, restaurant tickets, private health insurance, support to the relocation procedures
- Duration: Open-ended contract due to technical and scientific activities linked to the project and budget duration
- Holidays: 23 paid vacation days plus 24th and 31st of December per our collective agreement
- Salary: we offer a competitive salary commensurate with the qualifications and experience of the candidate and according to the cost of living in Barcelona
- Starting date: asap