What you will do
- Build the underneath data platform and maintain data processing pipelines using best in class technologies.
- Special focus on R&D to challenge status-quo and build the next generation data mesh that is efficient and cost effective.
- Translate complex technical and functional requirements into detailed designs.
Who you are
- At least 6+ years of professional experience as a software engineer or data engineer
- Education: Bachelor’s degree or higher in Computer Science, Data Science, Engineering, or a related technical field.
- Strong programming skills (Python, Java, and Scala)
- Experience writing SQL, structuring data, and data storage practices
- Experience with data modeling
- Knowledge of data warehousing concepts
- Experienced building data pipelines and micro services
- Experience with Spark, Airflow and other streaming technologies to process incredible volumes of streaming data
- A willingness to accept failure, learn and try again
- An open mind to try solutions that may seem impossible at first
- Strong understanding of data structures, algorithms, multi-threaded programming, and distributed computing concepts
- Experience working on Amazon Web Services (EMR, Kinesis, RDS, S3, SQS and the like)
Sorry! This job has expired.