Sign In
 [New User? Sign Up]
Mobile Version

Data Engineer

Job Code:
Applying for this job will take you to an external site
  • Shortlist
  • Email Friend
  • Print

Job Details

Job SpecificationMinimum 6 years of experienceStrong UNIX/Linux knowledge including the ability to understand the interaction between applications, HW, and operating system and to provide recommendations and suggestions related to troubleshooting and performance improvementA deep understanding of Hadoop design principals, cluster connectivity, security and the factors that affect distributed system performance.Must have good exposure to Red Hat or CentOS LinuxMust have good exposure to shell scriptingInstallation & Configuration, upgrades/migration, performance tuning & troubleshooting Management of a single and multi-node Hadoop cluster.Administration experience in any of the following Big Data related technologiesHadoop Technologies MapReduce, Yarn, HDFS, Pig, HBase, Hive, Zookeeper, Spark, Sqoop, Flume, Impala.Hadoop Platforms Cloudera, Hortonworks and MapRNoSQL Databases MongoDB and CassandraExperience working with integration of structured and unstructured data using enterprise databases (RDMBS, NoSQL).Applying security (Kerberos / Open Ldap) linking with Active Directory and/or LDAP.Able to deploy Hadoop cluster, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name-node high availability, schedule and configure it .Experience in database shading, replication, recovery, and performance optimizations.Work with vendor on all issues, apply upgrades and security patches.Disk space management, Backup and Recovery.Knowledge in performance troubleshooting and tuning Hadoop ClustersMonitor Hadoop cluster for job performance and capacity planning.Automate common maintenance and installation mechanisms.Onboarding users to use Hadoop configuration, access control, disk quota, permissions etc.Data migration and minimization of downtime supporting an SLA.Must have experience with monitoring frameworks like Ganglia and NagiosWork closely with the Infrastructure Management teams (Storage, Network, Unix, Backup) to develop a support model for Hadoop Cluster platform and services .Assemble newly bought hardware into racks with switches, assign IP addresses properly, firewalling, enable/disable ports, VPN etc.
Additional Degree: BE/ B.Tech (Engineering)

Experience: 6-11


Data Warehousing | Database Administration (DBA) | Software Engineer
Applying for this job will take you to an external site


© Copyright 2015 Al Nisr Publishing LLC - powered by Gulf News