Desired Skills and Experience
- Collaborate with Video organization leaders to align goals and affect a migration to a common streaming data platform
- Select the most efficient and impactful software design, coding standards, and industry best practices to deliver production quality software components
- Define the requirements and architect SaaS components to expand the feature set of an existing large scale streaming data platform based on Spark, Kafka and AWS Kinesis
- Asses and leverage technological advancements of the fast growing big data ecosystem to develop innovative data products
- Bachelor’s degree or equivalent work experience
- 10+ years of experience developing enterprise software solutions
- 7+ years of experience object oriented programming in Java or functional programming in Scala
- Familiarity with statistical software, advanced analytics, or machine learning
- Academic or equivalent work experience in software engineering, computer science, or mathematics
- 5+ years of professional experience with distributed system design and development of large scale data engineering components
- 5+ years of professional experience developing MapReduce applications with Hadoop
- 2+ years of experience working with Amazon Web Services (EMR, Lambda, S3, Kinesis)
- 2+ years of experience developing Spark applications
- Familiarity with distributed and NoSQL databases (Redis, MemSQL, DynamoDB)
- Familiarity with serialization frameworks such as Avro, Thrift, Google Protocol Buffers, and Kryo
- Familiarity with container technologies (Docker/Kubernetes)
Apply