Big data Engineer
Soothsayer is seeking Big data Engineer who has an interest in solving challenging ML / AI problems in the Big data Environment.
Freshers need not apply for this role, apply for this role, only if have hands on industry experience in Big data.
Job Description:
- Solve cutting edge, challenging problems working alongside a great team of world class data scientists and analytics experts
- Having a passion for solving interesting and challenging big data problems
- Communicate results to scientific, business, and stakeholders
- Collaborate with other engineers, data scientists
Education and Experience:
- PhD in computer science, Physics, Statistics, applied Mathematics, or other quantitative/ Computational discipline or Master's with over 2 year of real time relevant real-time Industry experience as a Big data Engineer is a MUST.
- Experience in architecting Big Data infrastructure and building end-to-end pipelines in Cloudera Distribution Hadoop.
- Familiarity with data ingestion from structured data sources such as SAP, excel files and unstructured data such as pdf, images.
- Expertise in data storage components in Hadoop such as HDFS, Hive and HBASE
- Experience implementing search solutions
- Familiarity with Lucene/SOLR or other enterprise search/indexing technologies
- Familiarity with Graph databases such as Janus graphs
- Familiar with DevOps experience (CI/CD) and best practices.
- Experience in unit testing, integration testing and stress testing
- Setting up data authentication and role-based authorization protocols with Apache Kerberos and Apache Sentry.
- Knowledge / experience using AG web methods for orchestration
- Excellent data presentation skills
THIS IS NOT AN INTERNSHIP POSITION AND IMMEDIATE NEED. MINIMUM QUALIFICATION IS PhD or Master's with at least 2 year of real-time relevant Industry experience as a Big data Engineer.
PLEASE READ THE MINIMUM QUALIFICATIONS BEFORE APPLYING.
Covid-19 update: Currently work remotely, please be ready to start working from our office in Detroit, from April 15, 2021.