Informationen zur Anzeige:

Data Engineer (m/f/d)
Berlin, Neckarsulm
Aktualität: 29.11.2021

Anzeigeninhalt:

29.11.2021, Lidl Digital
Berlin, Neckarsulm
Data Engineer (m/f/d)
Company Environment . You are part of the Shopping Platform Data Integration Team and will be responsible for activating and modelling large datasets (100+ TB) Work together . Data ingestion, CRM analytics and Business Intelligence teams. With your technical expertise you will drive best data practices across the organization and develop pipelines (real time + batch) to get the most from our data. You will also have exposition and have the change to contribute to solutions developed with machine learning technologies Technologies . You work in a multi-cloud environment (GCP and Azure) with data transformation tools for the entire value chain: Data Lakes, Streams, Databricks, Functions, Orchestrators, Relational databases, etc.
Educational background . You have completed your Bachelor or Master studies in Computer Sciences, Software Development or in a similar field Professional background . 4+ Experience in software development, 2+ experience in big data frameworks (Spark, Kafka, Kubernetes, Hive). contribution in open source projects is a plus Development . You have experience in Python (required), Scala (preferred) and SQL. Also .NET or Java are appreciated. Experience in agile software development is also valued Data bases : relational and non-relational (MongoDB, ELK, Cassandra) Curious mindset . You are interested in making sense of (un)structured datasets, basic ETL processes are in your toolbox. We will value your experience in machine learning tools as well (scikit-learn, pandas, spark ML, mlflow...) Keep learning . Passion for learning new tools, programming languages and frameworks. Ability to be creative and innovation-minded, self-motivated and proactive Languages . Fluent in English to work in a multi-cultural environment.

Berufsfeld

Standorte

Die aktuellsten Lidl Digital Angebote: