Hadoop Developer Resume Sample

These are some examples of job descriptions we have handpicked from real Hadoop Developer resumes for your reference.

Hadoop Developer

  • Working with multiple teams and understanding their business requirements for understanding data in the source files.
  • Creating end to end Spark applications using Scala to perform various data cleansing, validation, transformation and summarization activities according to the requirement.
  • Exploring with the Spark for improving the performance and optimization of the existing algorithms in Hadoop using Spark Context, Spark-SQL, Data Frame, Pair RDD’s, YARN.
  • Worked collaboratively to manage build outs of large data clusters and real time streaming with Spark.

Hadoop Developer

  • Assisted in upgrading, configuration and maintenance of various Hadoop infrastructures like Pig, Hive, and Hbase.
  • Developed and executed custom MapReduce programs, PigLatin scripts and HQL queries.
  • Developed Schedulers that communicated with the Cloud based services (AWS) to retrieve the data.
  • Used Hadoop FS scripts for HDFS (Hadoop File System) data loading and manipulation.

Hadoop Developer

  • Helping this firm developing, installing and configuring Hadoop ecosystem components that moved data from individual servers to HDFS.
  • Responsible for coding Java Batch, Restful Service, Map Reduce program, Hive query’s, testing, debugging, Peer code review, troubleshooting and maintain status report.
  • Developed automated scripts to install Hadoop clusters. Monitored Hadoop cluster job performance and capacity planning.

Hadoop Developer

  • Managed and reviewed Hadoop log files. Tested raw data and executed performance scripts.
  • Developed Map Reduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables in the EDW.
  • Created Hive queries that helped market analysts spot emerging trends by comparing fresh data with EDW reference tables and historical metrics.
  • Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System and PIG to pre-process the data.

Hadoop Developer

  • Involved in installing and configuration of Hadoop distribution systems as a Hortonworks Distribution (HDP).
  • Involved in requirement gathered, narrates the stories, reviewing and merging the codes of development teaminto Dev repositories and follow the agile methodologies of SDLC.
  • Importing of data from various data sources, performed transformations using Hive, loaded data into HDFS and extracted the data from SQL Server into HDFS using Sqoop.
  • Exporting the analyzing data to the relational databases using for visualization and to generate reports for the BI team.

Hadoop Developer

  • Used HAPI parser to parse FHIR Resource Bundle (in JSON) and stored data on Hadoop cluster using MapReduce programs.
  • Used JAXB parser to parse semi-structured survey data, stored in XML file and ingested to Hadoop cluster.
  • Wrote MapReduce programs using java to process data ingested to cluster.
  • MapReduce program to eliminate duplicate records by, to store incremental/updated data, to read data from one file format to other to meet some business requirement.

Hadoop Developer

  • Data (flat files) which we are getting in different format were converted into CSV using Map-reduce framework.
  • Implemented pre-defined operators in spark such as map, reduce, sample, filter, count, cogroup, groupBy, sort, reduceByKey, take, groupByKey, union, leftOuterJoin, rightOuterJoin, and etc.
  • Used Flume to collect, aggregate, and store the web log data from different sources like web servers, mobile and network devices and pushed to HDFS.

Hadoop Developer

  • Involved in extracting customer’s big data from various data sources into Hadoop HDFS.
  • This included data from mainframes, databases and also logs data from servers.
  • Used Sqoop to efficiently transfer data between databases and HDFS and used Flume to stream the log data from servers.
  • Developed MapReduce programs to cleanse the data in HDFS obtained from heterogeneous data sources to make it suitable for ingestion into Hive schema for analysis.

Hadoop Developer

  • Experienced in loading data from different relational databases to HDFS using Sqoop.
  • Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
  • Developed MapReduce programs to cleanse the data in HDFS obtained from heterogeneous data sources to make it suitable for ingestion into Hive schema for analysis.
  • Developed Hive and Pig custom UDF’s to maintain unique date format across the HDFS.
  • Responsible for creating Hive External tables and loading the data in to tables and query data using Hive.

Hadoop Developer

  • Developed simple and complex MapReduce programs in Java for Data Analysis on different data formats.
  • Developed MapReduce programs that filter bad and un-necessary claim records and find out unique records based on account type.
  • Implemented Daily Cron jobs that automate parallel tasks of loading the data into HDFS and pre-processing with Pig using Oozie co-ordinator jobs.

Hadoop Developer

  • Transmission of processed data from HDFS to RDBMS or any other external file systems was carried out using Sqoop.
  • Developed data pipeline expending Pig and Java MapReduce to consume customer behavioral data and financial antiquities into HDFS for analysis.
  • Extracted and restructured the data into MongoDB using MongoDB import and export command line utility tool.

Hadoop Developer

  • Handling importing of data from various data sources, performed transformations using Hive, Pig and loaded data into HDFS for aggregations.
  • Working closely with the business analysts to convert the Business Requirements into Technical Requirements and prepared low and high level documentation.
  • Worked hand-in-hand with the Architect; enhanced and optimized product Spark code to aggregate, group and run data mining tasks using Spark framework.

Leave a Comment

Your email address will not be published. Required fields are marked *

Read previous post:
Fitness Instructor Resume Sample

These are some examples of job descriptions we have handpicked from real Fitness Instructor resumes for your reference. Fitness Instructor...

Close