Data Engineer - Bitwerx Inc
Lexington, KY
About the Job
Who are we?
Bitwerx, Inc. is a team of industry experts focused on designing, building, and supporting innovative software solutions that leverage data to improve the customer journey. Our experience spans many industries with a focus on veterinary and dental, and our partners range from startups trying to bring a new idea to market to Fortune 500 companies looking to become more agile.
About This Position
We are looking for a Data Engineer to join our growing team!
Our ideal candidate is curious, always looking for new ways to solve problems, and has the aptitude to implement complex technologies quickly and effectively. In addition, you are collaborative and can make a well-rounded contribution to the team.
You will design and build systems for collecting, storing, and analyzing data at scale. Focusing on technologies like Databricks, PostgreSQL, and CosmosDB, the Data Engineer is accountable for ensuring that data is in a highly usable state and accessible for use across the company. Responsible for managing and maintaining data storage systems and pipelines. Using data engineering best practices to ensure data is available, secure, and performant while striving for cost efficiency.
This is a full-time position out of our Lexington, KY office and can be on-site, hybrid, or remote. If remote, you can expect to visit the office for new hire orientation and typically for team meetings once a quarter.
What You'll Do:
- Assemble large, complex sets of data that meet non-functional and functional business requirements in an optimal data storage and pipeline architecture
- Develop algorithms to transform data into useful, actionable information
- Identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
- Collaborate with management, commercial, product, and development teams to understand and achieve company objectives
- Ensure compliance with data governance and security policies
What We're Looking For:
- Experience with cloud-based data technologies (Azure preferred)
- 4 years of data engineering experience leveraging technologies such as Azure Functions, Databricks, Data Factory, Logic Apps (Azure Databricks preferred)
- Ability to build processes that support data transformation, workload management, data structures, dependency and metadata
- Understand the pros and cons, and best practices of implementing Azure managed databases, Databricks, and vector databases
- Experience working with NoSQL databases such as Redis, Mongo DB, Cosmos DB
- Creation of distributed systems utilizing tools such as Apache Hadoop, Spark or Kafka
- Experience with Python in a data engineering context. Ex: Pandas, PySpark, Petl
- Experience with AI/ML
- Experience with source control tools (Git preferred)
- Working experience in Agile Scrum environments
- A passion for learning and keeping up to date with the latest tools and technologies
- A strong work ethic and attention to detail
Bonus points for:
- BS in Computer Science, Engineering, or related subject
- Proficiency in computer technology and programming languages
- Experience with Databricks and PostgreSQL
- Familiarity working with large data solutions
- Experience in veterinary (preferred), or health, dental, or other vertical markets
You must physically live in the United States to be considered for this position at Bitwerx.
What We Offer:
- 100% company-paid health, vision, and dental insurance
- 401(k) with company match
- Flexible PTO policy
- Company provided lunches on-site every Friday
Bitwerx, Inc. is an Equal Opportunity Employer. Your application will be considered regardless of race, color, national origin, age, disability, gender, sexual orientation, gender identity or expression, marital status, or veteran status. You must be legally authorized to work in the U.S.