Lead, Cloud Data Engineer - Georgia IT Inc.
Redwood City, CA
About the Job
Client : Shutterfly
Position Title : Lead, Cloud Data Engineer
Location : Redwood City, CA
Salary : Market Rate
Lead Cloud Data Engineer Job Description
Lead Cloud Data Engineer with Software Engineering skills for Cloud Data Warehouse Development team.
The lead will, manage and drive end-to-end solutions and data architecture, will work with analytics and business partners to deliver data services solutions in support of insights and analysis of a multi-million customer ecommerce business with both internal and external data by applying expertise knowledge with data-warehousing technical concepts, CS fundamentals and data and system architecture to multi-terabyte, multi-source data.
Responsibilities:
Build Cloud data expertise and own data quality for the cloud data pipelines you build
Cloud Data Warehouse Architect, build and launch new data models and data marts that provide intuitive analytics to your customers
Design, build and launch extremely efficient & reliable Cloud data pipelines to move data (both large and small amounts) into and out of the Data Warehouse
Design and develop new systems and tools to enable folks to consume and understand data faster
Use your coding skills across a number of languages including Python, Shell Scripting, PL/SQL, AI PDL.
Have a clear understanding of the reports/analyses/insights to be driven by data and build data solutions to optimally support the analytics needs
Integrate third party/vendor data to enrich our cloud data warehouse environment and enable new analytic perspectives
Work across multiple teams in high visibility roles and own solutions end-to-end
Work with technical program managers, project managers, business partners and other engineers to develop and prioritize project plans
Must Have Skills
Very good hands on experience in building, maintaining and automating reliable and efficient ETL, ELT jobs
1- 2 year hands on experience with Cloud Data Warehouse, AWS Redshift , AWS IAM Roles. Terraform. CloudFormation. Glue, EC2, S3 and Redshift
Hands-On experience with Apache Spark, including manipulating data with Sql/Python
Hands-On experience with ETL tools Informatica 9/10.x Power Center,Ab Initio 3.x GDE, AI Control Center and Shell Scripting.
Strong CS fundamentals and experience developing with object-oriented programming Python & Java
Expertise with dimensional warehouse data models (dynamo, star, snowflake schemas)
Experience with multi-Terabyte MPP relational databases, such as My Sql, Oracle, Teradata
Experience in automation and orchestration platforms such as Airflow, Automic or Control M
Understanding of streaming technologies and concepts used with data warehouses, is preferred
Good to have skills-Other Cloud Datawarehouse , Hive, Hadoop, Datalake, Databricks, JIRA experience
Keywords
Cloud Data Warehouse, Amazon (AWS) Redshift, Hive, Python, Airflow, Automic, Data Warehouse, SQL, Databricks, Data lake, ETL, Ab Initio
Position Title : Lead, Cloud Data Engineer
Location : Redwood City, CA
Salary : Market Rate
Lead Cloud Data Engineer Job Description
Lead Cloud Data Engineer with Software Engineering skills for Cloud Data Warehouse Development team.
The lead will, manage and drive end-to-end solutions and data architecture, will work with analytics and business partners to deliver data services solutions in support of insights and analysis of a multi-million customer ecommerce business with both internal and external data by applying expertise knowledge with data-warehousing technical concepts, CS fundamentals and data and system architecture to multi-terabyte, multi-source data.
Responsibilities:
Build Cloud data expertise and own data quality for the cloud data pipelines you build
Cloud Data Warehouse Architect, build and launch new data models and data marts that provide intuitive analytics to your customers
Design, build and launch extremely efficient & reliable Cloud data pipelines to move data (both large and small amounts) into and out of the Data Warehouse
Design and develop new systems and tools to enable folks to consume and understand data faster
Use your coding skills across a number of languages including Python, Shell Scripting, PL/SQL, AI PDL.
Have a clear understanding of the reports/analyses/insights to be driven by data and build data solutions to optimally support the analytics needs
Integrate third party/vendor data to enrich our cloud data warehouse environment and enable new analytic perspectives
Work across multiple teams in high visibility roles and own solutions end-to-end
Work with technical program managers, project managers, business partners and other engineers to develop and prioritize project plans
Must Have Skills
Very good hands on experience in building, maintaining and automating reliable and efficient ETL, ELT jobs
1- 2 year hands on experience with Cloud Data Warehouse, AWS Redshift , AWS IAM Roles. Terraform. CloudFormation. Glue, EC2, S3 and Redshift
Hands-On experience with Apache Spark, including manipulating data with Sql/Python
Hands-On experience with ETL tools Informatica 9/10.x Power Center,Ab Initio 3.x GDE, AI Control Center and Shell Scripting.
Strong CS fundamentals and experience developing with object-oriented programming Python & Java
Expertise with dimensional warehouse data models (dynamo, star, snowflake schemas)
Experience with multi-Terabyte MPP relational databases, such as My Sql, Oracle, Teradata
Experience in automation and orchestration platforms such as Airflow, Automic or Control M
Understanding of streaming technologies and concepts used with data warehouses, is preferred
Good to have skills-Other Cloud Datawarehouse , Hive, Hadoop, Datalake, Databricks, JIRA experience
Keywords
Cloud Data Warehouse, Amazon (AWS) Redshift, Hive, Python, Airflow, Automic, Data Warehouse, SQL, Databricks, Data lake, ETL, Ab Initio
Source : Georgia IT Inc.