* Expertise knowledge on Hadoop framework In-depth understanding of HDFS & MapReduce architecture. * Excellent knowledge on Spark components like Spark Core, Spark SQL and Spark Streaming. Experience on Spark Core, Scala and creating RDD to perform aggregations, grouping, etc. in Spark. * Data migration from RDBMS, flat files to Hadoop file system using Sqoop jobs. * Hands on experience on Integrating Hive with Spark to perform HQL in Spark. * Optimizing Impala / Hive Queries with Partitions and Bucketing. * Writing Impala queries for Text DataMart job and calling them through SQL. * Used Sqoop to Import the RDBMS data into Hadoop File System * Analysing the real time processing problems / root cause analysis / finding - suggesting workaround in sev1 situations. * Validating the hive table's data by using spark sql. * Develop different test cases and scripts to valida
Cognizant is a provider of information technology, consulting, and business process outsourcing services.