We’re looking for a Senior Cloud Data Engineer to support the development, implementation, integration and configuration in AWS Cloud (Amazon Web Services). You will be working closely with Architects, Data Analysts, Business Analysts and cross-functional teams. This role involves the design and development of ETL packages and Data APIs using Python as well as creating ETL Design Specifications and frameworks.
You will utilize Machine Learning, DevOps and CI/CD tools and be comfortable analyzing and translating requirements into solution designs. You will need to be able to effectively communicate these design and development activities. You will participate in the full software development life cycle from concept through to implementation, testing and support using Agile/Scrum methodology.
Responsibilities
- Use AWS Cloud-based (Amazon Web Services) technologies to support data needs.
- Store data in AWS Cloud platform and develop transformational logic based on business rules.
- Create and maintain optimal data pipeline architecture.
- Design and develop enterprise infrastructure and platforms required for data engineering.
- Create methods and routines to transition data from on-premises / on-prem systems to the Cloud.
- Support the data needs of cross-functional teams, systems, and products.
- Assemble large, complex data sets that meet functional & non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal ETL/ELT (extraction, transformation, and loading) of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
- Test and implement data environments, utilizing highly analytical skills.
- Work with Software Developers, Database Architects, Data Analysts, and Data Scientists on data initiatives.
- Collaborate with stakeholders including Executive Leadership, Product Management, and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Requirements
- 5+ years of experience as a Cloud Engineer, AWS Engineer, Data Engineer, or Software Developer.
- AWS Lambda, AWS S3 (triggers), and AWS Cloud services: Glue, Macie EMR, DMS, Redshift.
- AWS Code Management (CodeCommit, CodePipeline, CodeDeploy, etc.).
- Data pipeline & workflow management tools: Airflow, etc. ETL / ELT (extract, transform, load) data.
- Experience in developing, debugging and maintaining code in Spark & Python. Use SQL Server databases & SQL Scripting.
- Message queuing, stream processing, highly scalable ‘big data’ data storage, and data warehouse experience.
- Bachelor’s degree in Computer Science or related field preferred.
- AWS Certification preferred.
What’s in it for me?
- Competitive offer package including multisport card, health insurance & vouchers.
- The best medical coverage on the market with free dental care.
- Annual bonus plan.
- Remote work from home.
- One extra day annually to use for holiday.
- Opportunity to contribute to developing and maintaining a live platform product making an impact on people’s lives.