Professional Documents
Culture Documents
Bigdata Profile - Kanchana-Updated - Dec
Bigdata Profile - Kanchana-Updated - Dec
Email: bigdatadeveloper0909@gmail.com
PROFFESSIONAL SUMMARY
Having about 4.3 years of experience in Big data technologies such Spark, Scala , hive, Sqoop ,
Kafka for data streaming , data processing ,ETL pipeline from different data sources into Hadoop
eco system
Data ingestion by using Importing & exporting data from Sqoop & flume to Hive tables , in HDFS eco
system
creating tables hive tables, internal & external tables for large data sets as per business
specifications
data processing by using Hive tables for large data sets into HDFS eco system.
worked on partitions , bucketing for static & dynamic tables in Hive tables
Data streaming by using Kafka with spark for consumption API
Creating RDD, for large data sets for data processing after importing data sources
Worked on data frames for data sets for data processing
worked on Spark RDD transformations such as filter, flat Map, Map partition, group by, ,union, Join
etc
worked different types of data formats CSV, ORC , Parquet formats as business specifications after
data processing into HDFS eco system.
Importing data from Amazon S3 into HDFS eco system using spark, Scala
worked on AWS services such as EC2, Elastic search, Lambda, S3 etc.
Support activities such as daily job monitoring, bug fixes
scheduling the jobs on Control M and Autosys
knowledge on performance tuning for optimizing Spark jobs
worked on Agile methodology, daily meetings, client interaction, stand up calls
daily job monitoring, bug fixes, debugging, ticketing tool using Service now.
worked on SQL , Oracle data bases.
SKILL SUMMARY:
Tools PL/SQL Developer, Kibana, Control M, WinSCP, putty, Jenkins, GIT, Bit Bucket,
Intellij, Gradle
1|Page
Scripting Unix
TECHNICAL EXPERTISE
Involved in Requirement Gathering, Application development and Implementation.
Sound Technical Knowledge in Apache Spark , Scala, Hive and Oracle SQL,
Knowledge of the System Development Life Cycle and its implementation from requirements,
design, coding, Unit testing and production support.
Extensive Knowledge in preparation of Low Level Design.
EMPLOYMENT HISTORY
Currently working as software Engineer in HCL Tech pvt ltd from Nov 2018 to till date.
Worked as LAB assistant in one of the local colleges from 2012 from Nov 2017.
EDUCATIONAL QUALIFICATION
PROJECTS INVOLVED
PROJECT#3
Client : Vestas
Platform : Windows
Technologies : Apache Spark, Hive, HDFS, Scala, postgress
Tools : JIRA, Kibana, Control M, WinSCP, putty, Jenkins, GIT, GitHub, Intellij
Scripting Language : Unix Shell Scripting
Back End : Hive , postgressSql
Team Size : 7(onsite),3(offiste)
Description
Vestas Wind Systems A/S is a Danish manufacturer, seller, installer, and servicer of wind turbines .
The company operates manufacturing plants in Denmark, Germany, the Netherlands. It has different types
of data marts in data warehouse and It has different types of applications for making data processing into
Hadoop eco system.
Job Responsibilities:
Requirement gathering.
Data Manipulation, Business logic implementation (ETL Development)
Unit Testing & Implementation
Raised change request to deploy code fix in Productions and given Walkthrough’s.
PROJECT#2
Client : Nestle
Platform : Windows
2|Page
Technologies : Apache Spark, Hive, HDFS, Scala, Elasticsearch
Tools : JIRA, Kibana, Control M, WinSCP, putty, Jenkins, GIT, Bit Bucket, Intellij, Gradle
Scripting Language : Unix Shell Scripting
Back End : Hive ,ElasticSearch
Team Size : 8(Offshore),4(onsite)
Description
Nestle is a Swiss multinational food and drink processing conglomerate corporation headquartered in
Vevey, Vaud, Switzerland. It is the largest publicly held food company in the world, It has different types data
marts in data warehouse
Job Responsibilities:
Requirement gathering.
Data Manipulation, Business logic implementation (ETL Development)
Unit Testing & Implementation
Production Bug fix
Raised change request to deploy code fix in Productions and given Walkthrough’s.
Writing and executing Hive queries for BA team analysis.
3|Page