Web studio MCODLAB
Business
Limited Liability Partnership
Data engineer ID: 253
Work Experience: More than 6 years
Employment type: Full employment
Education: Higher
Work schedule: Full day
Responsibilities
Design, build and maintain infrastructure for data collection, storage and processing.
Optimize ETL processes for efficient processing of big data.
Set up and monitor data lakes, data warehouses.
Develop and maintain data conveyors to ensure their integrity and availability. Working with large amounts of data and ensuring high system performance. Working with teams of analysts and data scientists to create user-friendly solutions. Ensuring data quality, setting up monitoring and alerting systems.
Requirements
2 years of experience as a Data Engineer.
Deep knowledge of database design and management (SQL, NoSQL).
Experience with ETL tools (Airflow, Talend, Apache NiFi).
Experience with big data (Hadoop, Spark). Experience with cloud platforms (AWS, GCP, Azure). Skills with containers and orchestration (Docker, Kubernetes). Understanding of the principles of real-time data processing and integration (Kafka, RabbitMQ). Ability to work with version control systems (Git).
Conditions
Working at a leading technology company with innovative projects.
Ability to work in a flexible schedule and remotely.
Competitive salary and bonuses for work.
Opportunities for professional development and certifications.
Participation in international projects and work with large clients. Access to advanced technology and equipment.
Key skills
ETL processes
Hadoop