Databricks Administrator - Open Systems Technologies Corporation

Open Systems Technologies Corporation is looking for a Databricks Administrator to join our team of experts to assist with building state of the art data platforms for the Department of Defense's premier data analytics platform.

Responsibilities:

• Manage and Administer Databricks Environment: Oversee the Databricks environment, including clusters, workspaces, jobs, and notebooks, to ensure optimal performance, reliability, and scalability.
• Configure and Optimize Databricks Clusters: Adjust and optimize Databricks clusters and resources based on workload requirements and best practices.
• Workspace Management: Create and manage workspaces and permissions.
• Identity Management: Understand and craft all applicable AWS IAM roles and policies necessary for program use cases.
• Monitor Account Usage Logs: Inspect Databricks logs for auditing and cost reporting.
• Ensure Security: Understand and execute DoD security best practices across the Databricks platform.
• Collaborate with Teams: Work closely with Advana teams to ensure smooth operation and physical design of databases, clusters, jobs, and workspaces.
• Support: Provide support to data engineers, data scientists, and analysts, enabling them to leverage the full potential of Databricks for analytics and machine learning.
• Manage Multiple Environments - maintain and support configuration management across unclasssified and classified environments

Required Skills:

• Clearance: TS/SCI w Poly

• Minimum 2+ years of hands-on administration experience, from setting up the Databricks environment to successfully administering it (AWS preferred)
• Experience as the Databricks account owner, managing workspaces, AWS accounts, audit logs, and high-level usage monitoring
• Experience as Databricks workspace admin, managing workspace users and groups including single sign-on, provisioning, access control, and workspace storage.
• Experience managing S3 access across a large user base
• Experience managing cluster and jobs configuration options
• Experience with Databricks security and privacy setup
• Experience troubleshooting end user and platform-level issues
• Experience delivering client presentations and demos
• Experience optimizing usage for performance and cost preferred
• Ability to multitask and reprioritize tasking on the fly according to the needs of a growing platform and its stakeholders
• Strong coding skills in SQL and Python (PySpark) with experience optimizing code
• Documented experience with AWS, EC2, S3, and/or RDS
• BA or BS degree

Preferred Skills:

• Experience with Qlik dashboarding and development functions
• Experience with facilitating BI tool training
• Experience in using DoD Data Management to manipulate and integrate databases with SQL, SAS, or other languages
• Knowledge of Big Data systems, including Hadoop, HDFS, Hive, or Cloudera
• Able to discern stakeholder needs, effectively communicate development plans, and track progress milestones
• Excellent organizational and time management skills to handle multiple tasks simultaneously
• Excellent critical thinking skills to assess numbers, trends, and data to reach new conclusions based on findings
• Excellent quantitative skills, including statistical analysis, process design, and data management

BENEFITS

OST has been operating since 1996 and has various contracts with Government agencies. We offer a comprehensive benefits package that includes 3 weeks paid time off, 11 Federal Holidays, medical/dental coverage, STD, LTD, Life Insurance, AD&D, 401k with up to 4% match, and end-of-year profit sharing.