Data Engineer II (Onsite) - Brasfield & Gorrie, LLC

We’re growing and currently looking for Data Engineer II to join our data engineering team.  Our data engineering team utilize various tools and technologies to transform raw data into formats useful for analysts and business users to gain insights and business intelligence.  We are seeking a team focused individual, who can lead by example in a fast-paced environment while producing readable and maintainable code.

Responsibilities and Essential Duties include the following (other duties may be assigned):

• Execute day-to-day development operations in fulfillment of product features and stories.
• Independent Problem Solver capable of executing a plan with little direction.
• Assist in diagnosing and remediating critical business issues.
• Ability to size, estimate, and break down large work items using story points, t-shirt sizing and task planning.
• Assist in training new hires and co-ops.
• Collaborate with developers, analysts, and designers in conceptualizing and development of new data models.
• Clean, Prepare and Model raw data from varying sources to create specific use case datasets as well as wider departmental and businesses focused data models.
• Develop business understanding of complex and varying data sources.  Interpret data for use by varied audiences within the company.
• Develop and implement methods to improve data quality, reliability, and accessibility.  
• Researching and designing solutions to implement business requirements.
• Participate in peer review, pull requests, and collaborative discussions with other developers and engineers.
• Work and communicate effectively in a collaborative team environment.
• Evaluating code to ensure that it is valid, structured property, and meets industry standards.
• Participate in planning and sizing of user stories.
• Maintain an understanding of the latest software tools, technologies, and programing practices through education, study, research, conferences, workshops, and/or groups.
• Manual testing of data model to verify requirements are met.
• Resolve problems uncovered by customer feedback and testing by correcting or referring problems to appropriate personnel for correction.
• Work with support personnel to resolve issues and assist end users in issues related to systems maintained by the data engineering group.
• Work with network administrators, systems analysts, and software engineers to assist in resolving problems related to databases, warehouses, and other related software systems.
• Develop and maintain user documentation as needed.
• Support other BI users within the organization

• College diploma or university degree in the field of Computer Science, Information Systems, Software Engineering or Management Information Systems preferred or a related field of study.

Knowledge & Experience:

• 6-8 years of practical hands-on experience.
• Experience with data ingestion, processing, transformation, and storage processes.
• 2+ years of experience with using Databricks.
• 3-4 years of knowledge of programming languages (e.g. SQL, Python, Spark, Scala).
• Relational database design, querying, and programing concepts.
• Experience creating or working with DevOps automation (Pipelines, CI\CD, Deployments).
• Azure Technologies (Azure Data Factory, Azure Data Lake, Synapse Data Warehouse, Databricks).

Personal Attributes:

• Able to communicate effectively with non-technical staff and with members of interdisciplinary teams.
• Able to solve complex problems.
• Flexible and adaptable in regard to learning and understanding new technologies.
• Strong written, oral, and interpersonal communication skills.
• Highly self-motivated and directed.
• Attention to detail.
• Analytical and problem-solving abilities.
• Ability to effectively prioritize and execute tasks in a high-pressure environment.
• Ability to work both independently and in a team-oriented, collaborative environment.