Hiring Big Data Developer's (Spark** & Scala**) – Permanent

From 4 to 8 year(s) of experience
₹ Not Disclosed by Recruiter

Job Description

Kindly go through the JD attached below and send your updated resume with below details at shivanik@headhuntershr.com

Total Experience:

Relevant Experience:

Exp in Spark:

Exp in Scala:

Current CTC:

Expected CTC:

Notice Period: Negotiable or not

Current Location:

Preferred Location:

Job Description: Spark & Scala

Location: Bangalore

Notice Period: Immediate to 30 Days only


4-8 years of development experience in object oriented applications with 2-4 years of experience in Scala. This on priority.


- Hadoop/Big Data


- Scala

- Spark

- Hive

- Kafka

- Shell Scripting

- Java experience is a plus

- GIT Version control tool knowledge,Jenkins and Scheduling tools Airflow & ESP

1.In depth understanding/knowledge of Hadoop & spark Architecture and its components such as HDFS, Job Tracker, Task Tracker,executor cores and memory params.

2.Experience in Hadoop development, working experience on SPARK, SCALA is mandatory and Database exposure is must

3.Hands on experience in Spark and Spark Streaming creating RDD's, applying operations -Transformation and Actions.

4.Experience in code optimize to fine tune the applications.

5.Expertise in writing Hadoop/spark Jobs for analyzing data using Spark, Scala, Hive, Kafka and Python

6.Experienced with streaming work flow operations.

7.Experience with developing large-scale distributed applications and developing solutions to analyze large data sets efficiently.

8.Integration with Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions. Experience in Data Warehousing and ETL processes.

9.Strong database, SQL, ETL and data analysis skills.

10.Knowledge in Maintaining the Log and Audit information in Hive/SQL tables, Experienced in providing Logging, Error Handling

11.Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.

12.Configured Spark Streaming to receive real time data from the Apache Kafka and store the stream data to HDFS using Scala.

13.Experienced Scheduling jobs using Airflow/ESP.

14.Experienced in developing scripts for doing transformations using Scala.

15.Involved in developing Shell scripts to orchestrate execution of all other scripts and move the data files within and outside of HDFS.

16.Using Kafka on publish-subscribe messaging as a distributed commit log, have experienced in its fast, scalable and durability.

17.Implemented Kerberos Security Authentication protocol for existing cluster

18.To be able to understand existing business logic & implement the business changes

19.Working with business and peers to define, estimate, and deliver functionality.

20.Should have gone through entire development life cycle including system integration testing

11.Provide Production Support for any issues raised by the Business and experience on Production/Integration release management

22.Experience with GIT, Jenkins, test frameworks.

Soft skills:

1.Right communication skills to be able to work with Business.

2.Good logical reasoning, analytical abilities.Recommend changes to client software based on information such as client feedback, language changes and new technology.

3.Experience working with remote teams.

4.Work to become the trusted partner of the Architects by regular engagement and proposals on best development practices which can be implemented and would bring change to the process

5.Excellent Performance and Technical Skills, Attend required training and support peers by sharing knowledge and mentoring.

6.Taking up training programs within your team to ensure understanding of BDF.

Agile skills:

1.Experienced in Agile development methodology.

2.Create the required technical tasks in backlog and update status regularly.

3.Participate in all Agile ceremony meetings and update task status and adher to timelines and quality standards for the task.

Role:Full Stack Developer

Salary: Not Disclosed by Recruiter

Industry:IT Services & Consulting

Functional Area:Engineering - Software

Role Category:Software Development

Employment Type:Full Time, Permanent

Key Skills
Skills highlighted with ‘‘ are preferred keyskills


UG:Any Graduate

PG:Any Postgraduate

Doctorate:Doctorate Not Required

Company Profile

Symphoni HR Private Limited

This year marked the birth Of Symphoni HR and the beginning of a new chapter - to provide search solutions for C-Suite, Senior Management and niche mandates for our Tier-1 Clients, and for organisations in emerging sectors and technologies. In partnership with our sister concerns and our partners, Symphoni HR offers solutions from Retained & Contingent Search, Workforce Planning and Search Advisory, Market Intelligence and Deep Competency Mapping. 

Company Info
View Contact Details+

Contact Company:Symphoni HR Private Limited