Data DevOps Engineer - VIZIO, Inc.
Denver, CO 80206
About the Job
Looking for a highly technical, hands-on Data DevOps Engineer for our Data Lake Team that can independently lead data engineering projects and strive to proactively improve process efficiency, making recommendations for process and system improvements where applicable.
You will be assisting in the design and architecture of highly scalable, fault tolerant infrastructure capable of processing millions of operations per minute coming from millions of TVs, efficiently store petabytes of data and provide fast insights from the data. You will also be working with teams across the Vizio enterprise to bring their data into our Big Data ecosystem, monitor data quality for cleanliness and fix discrepancies. Ensure data accuracy through validation tasks, perform root cause analysis and implement solutions for data prep and cleanliness, review data at all granular/aggregate levels, and versioning.
What You Will Do:
- Experience or knowledge of relational SQL and NoSQL databases
- High proficiency in Python, Pyspark, SQL and/or Scala
- Experience in designing and implementing ETL processes
- Strong understanding of in-memory processing and data formats (Avro, Parquet, Json etc.)
- Experience or knowledge of AWS cloud services: EC2, MSK, S3, RDS, SNS, SQS
- Experience or knowledge of stream-processing systems: i.e., Storm, Spark-Structured-Streaming, Kafka consumers.
- Experience or knowledge of big data tools: i.e., Hadoop, Spark, Kafka.
- Experience or knowledge of software engineering tools/practices: i.e., Github, VSCode, CI/CD
- Experince or knowledge in data observability and monitoring
- Hands-on experience in designing and maintaining data schema life-cycles.
- Infrastructure as Code (IaC):
- Automating the provisioning of infrastructure using tools like Terraform, Ansible, or CloudFormation.
- Managing cloud resources (AWS, Azure, GCP).
- Data Pipeline Automation:
- Building and maintaining data pipelines using tools like Apache Airflow, Prefect, or AWS Step Functions.
- Ensuring data pipelines are reliable, scalable, and efficient.
- Continuous Integration and Continuous Deployment (CI/CD):
- Implementing CI/CD practices for data applications.
- Using tools like Jenkins, GitLab CI, or CircleCI to automate testing and deployment.
- Monitoring and Logging:
- Setting up monitoring and alerting for data infrastructure using tools like Prometheus, Grafana, or ELK stack.
- Ensuring logs and metrics are collected and analyzed to identify and resolve issues.
- Building and maintaining data pipelines using tools like Apache Airflow, Prefect, or AWS Step Functions.
- Data Security and Compliance:
- Implementing security best practices for data storage and processing.
- Ensuring compliance with data regulations such as GDPR, CCPA, or HIPAA.
- Collaboration:
- Working closely with data scientists, analysts, and software engineers to understand data needs and requirements.
- Facilitating collaboration between development and operations teams.
- Performance Optimization:
- Analyzing and improving the performance of data infrastructure.
- Ensuring efficient use of resources and cost optimization.
- Bonus - Experience in tools like Databricks, Snowflake
- You have a BS or MS in Computer Science or similar relevant field
- You work well in a collaborative, team-based environment
- You are an experienced engineering with 2+ years of experience
- You have a passion for big data structures
- You possess strong organizational and analytical skills related to working with structured and unstructured data operations
- You have experience implementing and maintaining high performance / high availability data structures
- You are most comfortable operating within cloud based eco systems
- You enjoy leading projects and mentoring other team members
We are Beautifully Simple.
Headquartered in Irvine, California, VIZIO is a leading HDTV brand in America and the #1 Sound Bar Brand in America. VIZIO's mission is to deliver high performance, smarter products with the latest innovations at a significant savings that we can pass along to our consumers. Our loyal following and industry-wide praise continues to grow as we redefine what it means to be smart.
VIZIO, Inc. is an Equal Opportunity Employer committed to diversity in the workplace. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, gender expression, national origin, protected veteran status, or any other basis protected by applicable law, and will not be discriminated against on the basis of disability.
We do not accept unsolicited agency resumes. We will not pay fees to any third-party agency, outside recruiter or firm without a mutually agreed-upon contract and will not be responsible for any agency fees associated with unsolicited resumes. Unsolicited resumes will be considered our property and will be processed accordingly.
For Colorado-based employment: The target salary range is $86,000 - $112,000. In addition to base salary, the compensation package also includes eligibility for an annual bonus, as well as equity and a range of medical, dental, vision and other benefits.