Hadoop Developer - Diverse Lynx
Richmond, VA
About the Job
Job Description
"We are looking for a candidate who will be part of Data Gateway Services team and is well-versed in test data protection and provisioning. Will be responsible to protect confidential data across the test lanes and will also enable functional test data provisioning for applications
Responsibilities
Strong work ethic and highly self-motivated to work in a challenging integrated team environment
Understanding the business requirements
Building the workflow configurations
Data Sanitization executions and validations for Non RPSWT LOB s (GMOT, GBT, GMT, EET, ERFT).
Provides regular progress updates to leadership team
Primary
" 6 + years of IT experience
" Strong in UNIX programming/scripting
" Hadoop architecture/ecosystem experience
" Experience in HIVE, HDFS (AVRO, PARQUET, QRC formats)
" Experience with MapReduce/Spark concepts
" IEDPS Data Sanitization Workflow
" Knowledge about File extraction/Data access processes including performing file-splits at row and column levels
" Ability to monitor Hadoop clusters
" Database Management experience any RDBMS like DB2, SQL, ORACLE, NETEZZA, SYBASE, SIEBEL, TERADATA, MYSQL
" Some ETL (extract transform load) experience (can be any tool datastage, informatica, Teradata+unix)
" Scheduling/Automation exposure using AUTOSYS
" Exposure to data connection methods via JDBC, ODBC
" Knowledge about File extraction/Data access processes
" Strong communication skills
Secondary
" Database Management experience any RDBMS
" Data Discovery knowledge of confidential data
" Bank experience : Dev role for AITs under GBT, GMOT, GMT, EET, ERFT
" KAFKA knowledge "
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
"We are looking for a candidate who will be part of Data Gateway Services team and is well-versed in test data protection and provisioning. Will be responsible to protect confidential data across the test lanes and will also enable functional test data provisioning for applications
Responsibilities
Strong work ethic and highly self-motivated to work in a challenging integrated team environment
Understanding the business requirements
Building the workflow configurations
Data Sanitization executions and validations for Non RPSWT LOB s (GMOT, GBT, GMT, EET, ERFT).
Provides regular progress updates to leadership team
Primary
" 6 + years of IT experience
" Strong in UNIX programming/scripting
" Hadoop architecture/ecosystem experience
" Experience in HIVE, HDFS (AVRO, PARQUET, QRC formats)
" Experience with MapReduce/Spark concepts
" IEDPS Data Sanitization Workflow
" Knowledge about File extraction/Data access processes including performing file-splits at row and column levels
" Ability to monitor Hadoop clusters
" Database Management experience any RDBMS like DB2, SQL, ORACLE, NETEZZA, SYBASE, SIEBEL, TERADATA, MYSQL
" Some ETL (extract transform load) experience (can be any tool datastage, informatica, Teradata+unix)
" Scheduling/Automation exposure using AUTOSYS
" Exposure to data connection methods via JDBC, ODBC
" Knowledge about File extraction/Data access processes
" Strong communication skills
Secondary
" Database Management experience any RDBMS
" Data Discovery knowledge of confidential data
" Bank experience : Dev role for AITs under GBT, GMOT, GMT, EET, ERFT
" KAFKA knowledge "
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Source : Diverse Lynx