Job Summary

Hadoop Engineer

  • Location:
    Pleasanton, California
  • Job reference:
  • Category:
    Information Systems
  • Contract Type:

**Please call Aparna Sreeraman at 415 228 4275 if you have any questions about the opportunity or email aparna.sreeraman at**
The tasks for the Hadoop Engineer include, but are not limited to, the following:
• Translate client user requirements into technical architecture vision and implementation plan
• Design and implement an integrated Big Data platform and analytics solution
• Design and implement data collectors to collect and transport data to the Big Data Platform.
• Implement monitoring solution(s) for the Big Data platform to monitor health on the infrastructure.
Technical Knowledge and Skills:
Consultant resources shall possess most of the following technical knowledge and experience:
• 2+ years of hands-on development, Deployment and production Support experience in Hadoop environment.
• 4-5 years of programming experience in Java, Scala, Spark, Python.  
• Proficient in SQL and relational database design and methods for data retrieval.
• Knowledge of NoSQL systems like HBase or Cassandra
• Hands-on experience in Cloudera Ddistribution 5.x ,Java and Solr.
• Hands-on experience in creating, indexing Solr collections in Solr Cloud environment.
• Hands-on experience building data pipelines using Hadoop components Sqoop, Hive, Pig, Solr, MR, Spark, Spark SQL.
• Must have experience with developing Hive QL, UDF’s for analyzing semi structured/structured datasets.
• Must have experience with Spring framework.
• Hands-on experience ingesting and processing various file formats like Avro/Parquet/Sequence Files/Text Files etc.
• Must have working experience in the data warehousing and Business Intelligence systems.
• Expertise in Unix/Linux environment in writing scripts and schedule/execute jobs.
• Successful track record of building automation scripts/code using Java, Bash, Python etc. and experience in production support issue resolution process.
Nice-To-Have Skills
• Hands-on experience working in Real-Time analytics like Spark/Kafka/Storm
• Working knowledge of Aspire Content Processing Platform and Query Processing Language(QPL)
• Experience working with users on requirements gathering
• Agile development methodologies.

Apply Below


Note: Required fields marked with an asterisk (*).


Primary Number
[Ctrl (Cmd Mac) + Click] to select multiple industries
Upload your resume
Terms of Use


Upload your resume using

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.

Equal employment opportunity information:
EEO is the Law (poster) | EEO is the Law (poster supplement) | Reaffirmation of Affirmative Action Policy Statement