Databricks Architect - Capgemini
Kansas City, KS
About the Job
Sogeti is a leading provider of professional technology services, specializing in Application Management, Infrastructure Management and High-Tech Engineering. Sogeti offers cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud and Security, combining world class methodologies and the global delivery model, Rightshore®. Sogeti brings together more than 20,000 professionals in 15 countries and is present in over 100 locations in Europe, the US and India. Sogeti is a wholly-owned subsidiary of Cap Gemini S.A., listed on the Paris Stock Exchange.
At Sogeti USA, we are committed to building a long and enduring relationship with our employees and to creating an environment that rewards and empowers. Our mission is to constantly exceed our employees' expectations in the same way that we strive to exceed our clients' expectations. We offer an environment that celebrates innovation and helps you to achieve a good balance between your professional and personal life. We strive to be an employer of choice!
What You-ll Do
+ 10+ years Data Architecture design and implementation experience
+ Banking/financial service domain experience is a big plus
+ Responsible for architecture, design, and development of end-to-end pipelines on Azure using ADF for orchestration and Databricks for writing necessary business logic using PySpark, SQL.
+ Experience and familiarity with Azure services such as Synapse, Azure Functions, Monitors, ADLS, Data Lakehouse, Medallion Architecture etc.,
+ Ability to develop and enhance custom frameworks using Databricks notebooks using Python, Spark to implement more efficient ELT processes.
+ Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
+ Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
+ Working with stakeholders including data, design, product, and executive teams and assisting them with data-related technical issues.
+ Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing for greater scalability, etc.
+ Experience working with and supporting cross-functional teams (Data Scientists, Architects, Analytics SMEs etc.,) in a dynamic environment.
+ Build processes supporting data transformation, data structures, metadata, dependency, and workload management -
+ Databricks - Compute cluster configuration options, best practices, guidance, etc. -
+ Databricks - Performance and Optimization options (optimize, z-order, liquid clustering, etc.)
+ Databricks - Business continuity / disaster recovery / data backups -
+ Databricks - Environment management (dev/qa/prod/etc.)
+ Databricks- DBA-like operations (vacuum file cleanup, partitioning, file size tuning, etc.) -
+ Databricks - Expertise with architecture/admin/advance usage skillsets - Experience working with Azure Stream Analytics - Good to have
+ Experience working with Azure Machine Learning & MLFlow - - Good to have
Minimum education qualification
+ Bachelor's Degree in Computer Science, Computer Engineering, MIS or related field.
The benefits our employees enjoy:
+ 401(k) Savings Plan- Matched 150% up to 6%. (Our 401k is in the top 1% of 401(k) plans offered in the US!)
+ Medical/Prescription/Dental/Vision Coverage!
+ Low-premium and deductible. Plan with free preventive care.
+ $12,000 in Tuition Reimbursement
+ 100% Company-paid mobile phone plan
+ Personal Time Off (PTO)- Ensuring a balance of work and home life
Sogeti is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
At Sogeti USA, we are committed to building a long and enduring relationship with our employees and to creating an environment that rewards and empowers. Our mission is to constantly exceed our employees' expectations in the same way that we strive to exceed our clients' expectations. We offer an environment that celebrates innovation and helps you to achieve a good balance between your professional and personal life. We strive to be an employer of choice!
What You-ll Do
+ 10+ years Data Architecture design and implementation experience
+ Banking/financial service domain experience is a big plus
+ Responsible for architecture, design, and development of end-to-end pipelines on Azure using ADF for orchestration and Databricks for writing necessary business logic using PySpark, SQL.
+ Experience and familiarity with Azure services such as Synapse, Azure Functions, Monitors, ADLS, Data Lakehouse, Medallion Architecture etc.,
+ Ability to develop and enhance custom frameworks using Databricks notebooks using Python, Spark to implement more efficient ELT processes.
+ Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
+ Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
+ Working with stakeholders including data, design, product, and executive teams and assisting them with data-related technical issues.
+ Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing for greater scalability, etc.
+ Experience working with and supporting cross-functional teams (Data Scientists, Architects, Analytics SMEs etc.,) in a dynamic environment.
+ Build processes supporting data transformation, data structures, metadata, dependency, and workload management -
+ Databricks - Compute cluster configuration options, best practices, guidance, etc. -
+ Databricks - Performance and Optimization options (optimize, z-order, liquid clustering, etc.)
+ Databricks - Business continuity / disaster recovery / data backups -
+ Databricks - Environment management (dev/qa/prod/etc.)
+ Databricks- DBA-like operations (vacuum file cleanup, partitioning, file size tuning, etc.) -
+ Databricks - Expertise with architecture/admin/advance usage skillsets - Experience working with Azure Stream Analytics - Good to have
+ Experience working with Azure Machine Learning & MLFlow - - Good to have
Minimum education qualification
+ Bachelor's Degree in Computer Science, Computer Engineering, MIS or related field.
The benefits our employees enjoy:
+ 401(k) Savings Plan- Matched 150% up to 6%. (Our 401k is in the top 1% of 401(k) plans offered in the US!)
+ Medical/Prescription/Dental/Vision Coverage!
+ Low-premium and deductible. Plan with free preventive care.
+ $12,000 in Tuition Reimbursement
+ 100% Company-paid mobile phone plan
+ Personal Time Off (PTO)- Ensuring a balance of work and home life
Sogeti is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
Source : Capgemini