DataOps Consultant

With Pythian in Hyderabad - IN

More jobs from Pythian

Posted on January 08, 2020

About this job

Job type: Full-time
Role: Database Administrator


cloud, etl, hadoop

Job description

Job Description: [

Data Ops Consultant

India | Remote | Work from home

Why you?

Are you a Big Data Engineer or Developer who wants to work with the latest Big Data technologies? Do you want to work remotely for a North American company as a member of their Site Reliability Engineering (SRE) Practice, and specifically the Data Ops Team, to implement and help maintain a cutting edge Big Data solutions, managing and creating data pipelines which we have built to migrate data from customers on-prem systems and load it into a cloud hosted Enterprise Data Platform? Do you want to work on large scale custom Big Data consulting projects? If you have a passion for big data and solving complex problems then this could be the job for you!

What will you be doing?

Working with the Data Architects to implement data pipelines
Working on complex and varied Data Ops projects including tasks such as collecting, parsing, managing, analyzing, and visualizing very large datasets.
Translating complex functional and technical requirements into detailed designs.
Writing high-performance, reliable and maintainable code.
Performing data processing requirements analysis.
Performance tuning for batch and real-time data processing.
Securing components of clients’ Big Data platforms.
Diagnostics and troubleshooting of operational issues.
Health-checks and configuration reviews.
Data pipelines development – ingestion, transformation, cleansing.
Data flow integration with external systems.
Integration with data access tools and products.
Assisting application developers and advising on efficient data access and manipulations.
Defining and implementing efficient operational processes
Participating equally in your team’s regular on-call rotation, which will generally be one week per month. On-call services will be provided on a 24-hour basis and may be outside of your usual hours of work.

What do we need from you?

While we realise you might not have everything on the list to be the successful candidate for the Data Ops job you will likely have most of the following skills;

Experience building data pipelines in any public cloud (GCP Dataflow, Glue, Azure DataFactory) or any equivalent
Experience writing ETL (Any popular tools)
Experience in data modeling, data design and persistence (e.g. warehousing, data marts, data lakes).
Strong Knowledge of Big Data architectures and distributed data processing frameworks: Hadoop, Spark, Kafka, Hive
Experience and working knowledge of various development platforms, frameworks and languages such as Java, Python, Scala and SQL
Experience with Apache Airflow, Oozie and Nifi would be great
General knowledge of modern data-center and cloud infrastructure including server hardware, networking and storage.
Strong written and verbal English communication skills


Experience with BI platforms, reporting tools, data visualization products, ETL engines.
Experience with data streaming frameworks.
DevOps experience with a good understanding of continuous delivery and deployment patterns and tools (Jenkins, Artifactory, Maven, etc)
Experience with Hbase.
Experience in data management best practices, real-time and batch data integration, and data rationalization

What do you get in return?

Competitive total rewards package
Flexible work environment: Why commute? Work remotely from your home, there’s no daily travel requirements to an office!
Substantial training allowance: Hone your skills or learn new ones; participate in professional development days, attend conferences, become certified, whatever you like!
Office Allowance: A device of your choosing and personalise your work environment!

Why Pythian?

Pythian excels at helping businesses use their data and cloud to transform how they compete and win in this ever-changing environment by delivering advanced on-prem, hybrid, cloud and multi-cloud solutions to solve the toughest data challenges faster and better than anyone else. Founded and headquartered in Ottawa, Canada in 1997, Pythian now has more than 400 employees located around the globe with over 350 clients spanning industries from SaaS; media; gaming; financial services; e-commerce and more. Pythian is known for its technology-enabled data expertise covering everything from ETL to ML. We pride ourselves on our ability to deliver innovative solutions that meet the specific data goals of each client and have built meaningful partnerships with major cloud vendors AWS, Google and Microsoft. The powerful combination of our extensive expertise in data and cloud and our ability to keep on top of the latest bleeding edge technologies make us the perfect partner to help mid and large-sized businesses transform to stay ahead in today’s rapidly changing digital economy. If you are a Data Ops Consultant; live in India; love your data and want to love your career then join us!

Intrigued to see what a job is like at Pythian or check us out @Pythian and #pythianlife. Follow @PythianJobs on Twitter and @loveyourdata on Instagram!

Not the right job for you? Check out what other great jobs Pythian has open around the world! Pythian Careers


For this job an equivalent combination of education and experience, which results in demonstrated ability to apply skills will also be considered.
Pythian is an equal opportunity employer and welcomes applications from people with disabilities. Accommodations are available upon request for candidates taking part in all aspects of the selection process.
The successful applicant will need to fulfill the requirements necessary to obtain a background check.
Applicants must be legally authorized to work in their country of residence permanently– Pythian will not relocate, sponsor, or file petitions of any kind on behalf of a foreign worker to gain a work visa, become a permanent resident based on a permanent job offer, or to otherwise obtain authorization to work.
No Recruitment Agencies

Apply here