Sr Data Engineer - Diverse Linx
Philadelphia, PA
About the Job
Job Title: Sr Data Engineer
Philadelphia PA
Fulltime
Relevant Experience
(in Yrs) 10-12 years
Technical/Functional Skills Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins,
Experience Required 10 - 12 Years
Roles & Responsibilities 1. Hands-on architecture/development of ETL pipelines using our internal framework written in Java.
2. Hands-on architecture of real time REST APIs or other solutions for streaming data from Graph using Spark
3. Interpret data, analyze results using statistical techniques and provide ongoing reports.
4. Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality.
5. Experienced with Databricks
6. Acquire data from primary or secondary data sources and maintain databases/data systems.
7. Identify, analyze, and interpret trends or patterns in complex data sets.
8. Filter and clean data by reviewing reports and performance indicators to locate and correct problems.
9. Work with management to prioritize business and information needs.
10. Locate and define new process improvement opportunities
Generic Managerial Skills Motivated team player with excellent communication, interpersonal, analytical and problem solving skills.
Work Location Philadelphia
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Philadelphia PA
Fulltime
Relevant Experience
(in Yrs) 10-12 years
Technical/Functional Skills Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins,
Experience Required 10 - 12 Years
Roles & Responsibilities 1. Hands-on architecture/development of ETL pipelines using our internal framework written in Java.
2. Hands-on architecture of real time REST APIs or other solutions for streaming data from Graph using Spark
3. Interpret data, analyze results using statistical techniques and provide ongoing reports.
4. Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality.
5. Experienced with Databricks
6. Acquire data from primary or secondary data sources and maintain databases/data systems.
7. Identify, analyze, and interpret trends or patterns in complex data sets.
8. Filter and clean data by reviewing reports and performance indicators to locate and correct problems.
9. Work with management to prioritize business and information needs.
10. Locate and define new process improvement opportunities
Generic Managerial Skills Motivated team player with excellent communication, interpersonal, analytical and problem solving skills.
Work Location Philadelphia
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Source : Diverse Linx
