Big DATA Developer - ClifyX, INC

Job Description:

The Data Engineering Technology is a senior level position responsible for establishing and implementing new or revised data platform eco systems and programs in coordination with the Technology team The overall objective of this role is to lead data engineering team to implement the business requirements

Responsibilities

• Design build and maintain batch or realtime data pipelines in data platform
• Maintain and optimize the data infrastructure required for accurate extraction transformation and loading of data from a wide variety of data sources
• Develop ETL extract transform load processes to help extract and manipulate data from multiple sources
• Automate data workflows such as data ingestion aggregation and ETL processing
• Prepare raw data in Data Warehouses into a consumable dataset for both technical and nontechnical stakeholders
• Partner with data scientists and functional leaders in sales marketing and product to deploy machine learning models in production
• Build maintain and deploy data products for analytics and data science teams on data platform
• Ensure data accuracy integrity privacy security and compliance through quality control procedures
• Monitor data systems performance and implement optimization strategies
• Leverage data controls to maintain data privacy security compliance and quality for allocated areas of ownership
• Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
• Resolve variety of high impact problemsprojects through indepth evaluation of complex business processes system processes and industry standards
• Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
• Utilize advanced knowledge of system flow and develop standards for coding testing debugging and implementation
• Develop comprehensive knowledge of how areas of business such as architecture and infrastructure integrate to accomplish business goals
• Provide indepth analysis with interpretive thinking to define issues and develop innovative solutions
• Serve as advisor or coach to midlevel developers and analysts allocating work as necessary
• Appropriately assess risk when business decisions are made demonstrating particular consideration for the firms reputation and safeguarding Banking its clients and assets by driving compliance with applicable laws rules and regulations adhering to Policy applying sound ethical judgment regarding personal behavior conduct and business practices and escalating managing and reporting control issues with transparency

Qualifications

• 6 years of total experience 6 years relevant experience in Data engineering role
• Advanced SQL skills and experience with relational databases and database design
• Strong proficiency in objectoriented languages PythonPyspark is must
• Experience working with data ingestion tools such as Talend Ab Initio
• Experience working with data lakehouse architecture such as IcebergStarburst
• Strong proficiency in scripting languages like Bash
• Strong proficiency in data pipeline and workflow management tools
• Strong proficiency in scripting languages like Bash
• Strong project management and organizational skills
• Excellent problemsolving communication and organizational skills
• Proven ability to work independently and with a team
• Experience in managing and implementing successful projects
• Ability to adjust priorities quickly as circumstances dictate
• Demonstrated leadership and project management skills
• Consistently demonstrates clear and concise written and verbal communication

Education

• Bachelors degreeUniversity degree or equivalent experience
• Masters degree preferred