Big Data Engineer-Madison WI - Georgia IT Inc.
Madison, WI
About the Job
Urgent requirement
Big Data Engineer
Position : Fulltime
Location : Madison WI
Rate : DOE
US Citizen, Green Card, TN, GC EAD only No Third-party agencies.
Corp to corp available.
Job role:
Big Data Engineer
Position : Fulltime
Location : Madison WI
Rate : DOE
US Citizen, Green Card, TN, GC EAD only No Third-party agencies.
Corp to corp available.
Job role:
- Big Data Engineer builds what the big data solutions architect has designed. Data engineers develop, maintain, test and evaluate big data solutions within organizations. Most of the time they are also involved in the design of big data solutions, because of the experience they have with Hadoop based technologies such as Map Reduce, Hive Mongo DB or Cassandra. A big data engineer builds large-scale data processing systems, is an expert in data warehousing solutions and should be able to work with the latest (NoSQL) database technologies.
- Experience with Hadoop (HDinsight). [Mandatory]
- Experience with Map-Reduce, Zookeeper, HDFS, Pig, Sqoop and Hive. [Mandatory]
- Experience with Azure cloud services. [Mandatory]
- Experience with scheduling tools like Control-M and Oozie. [Mandatory]
- Experience monitoring Hadoop cluster performance. [Preferred]
- Experience with SSIS and SQL Server. [Preferred]
- Experience with programming language like Python or C#. [Preferred]
- Knowledge of Linux system monitoring and analysis. [Preferred]
- Understanding of ETL principles and how to apply them within Hadoop. [Preferred]
- Knowledge of Spark and understanding of DAGs a plus. [Preferred]
Source : Georgia IT Inc.
