Big Data Engineer/Developer - Diverse Linx
Tampa, FL
About the Job
Role name: Big Data Engineer/Developer
Location- Tampa, FL
Responsibilities
Develop and maintain data pipelines using ETL processes
Take responsibility for Apache Hadoop development and implementation
Work closely with data science team to implement data analytics pipelines
Help define data governance policies and support data-versioning processes
Maintain security and data privacy, working closely with data protection officer
Analyze vast number of data stores to uncover insights
Competencies: Digital : Apache Spark, Digital : PySpar
Required skills and qualifications.
Experience with Python, Spark, and Hive.
Understanding of data-warehousing and data-modeling techniques.
Knowledge of industry-wide visualization and analytics tools (ex: Tableau, R)
Strong data engineering skills with Azure cloud platform.
Experience with streaming frameworks such as Kafka.
Knowledge of Core Java, Linux, SQL, and any scripting language.
Good interpersonal skills and positive attitude.
Preferred skills and qualifications.
Degree in computer science, mathematics, or engineering.
Expertise in ETL methodology for corporate-wide solution design using DataStage.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location- Tampa, FL
Responsibilities
Develop and maintain data pipelines using ETL processes
Take responsibility for Apache Hadoop development and implementation
Work closely with data science team to implement data analytics pipelines
Help define data governance policies and support data-versioning processes
Maintain security and data privacy, working closely with data protection officer
Analyze vast number of data stores to uncover insights
Competencies: Digital : Apache Spark, Digital : PySpar
Required skills and qualifications.
Experience with Python, Spark, and Hive.
Understanding of data-warehousing and data-modeling techniques.
Knowledge of industry-wide visualization and analytics tools (ex: Tableau, R)
Strong data engineering skills with Azure cloud platform.
Experience with streaming frameworks such as Kafka.
Knowledge of Core Java, Linux, SQL, and any scripting language.
Good interpersonal skills and positive attitude.
Preferred skills and qualifications.
Degree in computer science, mathematics, or engineering.
Expertise in ETL methodology for corporate-wide solution design using DataStage.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Source : Diverse Linx
