Senior Data Engineer ( Toyota Connected) - Shiftcode Analytics, Inc
Plano, TX
About the Job
USC & GC Only
ROLE SUMMARY The Sr Engineer role plans, designs, develops and tests high-quality, innovative and fully performing software systems or applications for software enhancements and new products. Key responsibilities include: " Contribute to full software development life cycle " Write maintainable, extensible, tested code, while complying with coding standards " Produce specifications and determine operational feasibility " Continuously Integrate and deliver software components into a fully functional software system " Facilitate end to end user testing with customers " Troubleshoot, debug and upgrade existing systems CAREER LEVEL SUMMARY " Proficiency: Fully mastered in immediate function/domain and has developed competent skills in complimentary functions or domains. Is able to train junior members in mastered domain knowledge. " Direction: Is largely autonomous, working on a day to day basis without supervision or support. Occasionally checks in with manager for questions, direction. Provides support or direction to more junior members.
Show Less
Additional Skills & Qualifications
" 8+ years of total development experience " 5+ years of experience as a Data Engineer with large, complex data sources " Experience designing, building and operationalizing large scale enterprise data solutions and applications using AWS data and analytics services in combination with other services/platforms Spark, EMR, RedShift, Kinesis, Kinesis Firehose, Athena, Lambda & AWS Glue " Experience with data pipeline and workflow management tools: Airflow, Step Functions etc " Ability to implement both batch and streaming data pipelines in the AWS and change data capture (CDC) experience " Advanced working SQL knowledge and experience working with relational databases and NOSQL databases. " Experience designing and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Scala. " Experience with infrastructure-as-code tools such as Terraform (preferably) or CloudFormation " Kubernetes experience for developing, deploying, and orchestrating micro-services is plus " Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations " Understanding of concepts regarding security, privacy, performance, etc
Show Less
Employee Value Proposition (EVP)
Work Environment
hybrid work environment
ROLE SUMMARY The Sr Engineer role plans, designs, develops and tests high-quality, innovative and fully performing software systems or applications for software enhancements and new products. Key responsibilities include: " Contribute to full software development life cycle " Write maintainable, extensible, tested code, while complying with coding standards " Produce specifications and determine operational feasibility " Continuously Integrate and deliver software components into a fully functional software system " Facilitate end to end user testing with customers " Troubleshoot, debug and upgrade existing systems CAREER LEVEL SUMMARY " Proficiency: Fully mastered in immediate function/domain and has developed competent skills in complimentary functions or domains. Is able to train junior members in mastered domain knowledge. " Direction: Is largely autonomous, working on a day to day basis without supervision or support. Occasionally checks in with manager for questions, direction. Provides support or direction to more junior members.
Show Less
Additional Skills & Qualifications
" 8+ years of total development experience " 5+ years of experience as a Data Engineer with large, complex data sources " Experience designing, building and operationalizing large scale enterprise data solutions and applications using AWS data and analytics services in combination with other services/platforms Spark, EMR, RedShift, Kinesis, Kinesis Firehose, Athena, Lambda & AWS Glue " Experience with data pipeline and workflow management tools: Airflow, Step Functions etc " Ability to implement both batch and streaming data pipelines in the AWS and change data capture (CDC) experience " Advanced working SQL knowledge and experience working with relational databases and NOSQL databases. " Experience designing and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Scala. " Experience with infrastructure-as-code tools such as Terraform (preferably) or CloudFormation " Kubernetes experience for developing, deploying, and orchestrating micro-services is plus " Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations " Understanding of concepts regarding security, privacy, performance, etc
Show Less
Employee Value Proposition (EVP)
Work Environment
hybrid work environment
Source : Shiftcode Analytics, Inc
