Senior Data Engineer - Bitcoin Devs Company

Overview:

The Senior Data Engineer plays a crucial role in our organization, responsible for designing and implementing scalable and reliable data pipelines, as well as optimizing data flow and collection for various cross-functional teams. This position is vital in ensuring data accessibility and usability for data scientists, analysts, and other business stakeholders. As a Senior Data Engineer, you will work closely with the data architecture, data science, and business intelligence teams to support our overarching data infrastructure and contribute to the development of cutting-edge data solutions.

Key Responsibilities:

Building data pipelines, alerting, and reporting for trade and blockchain data.

Designing data pipelines and automating ETL processes and SQL optimization, which will influence the “next generation” for ledger reconciliation processes and reporting.

Partnering with teams throughout the organization for all types of data reconciliation – both ad hoc and scheduled.

Creating data validation processes, customized reporting, and investigating the underlying root cause for exception reports.

Required Qualifications:

5+years implementing a reconciliation system while improving existing data pipelines.

Experience building real-time data solutions and processes.

Experience building and integrating web analytics solutions.

Advanced SQL skills is a must.

Experience and expertise in Databricks, Spark, Hadoop etc.

Skilled in programming languages Python and/or Java.

Experience with one or more MPP databases(Redshift, Bigquery, Snowflake, etc).

Able to identify gaps in existing reconciliation processes.

Extensive ETL and database experience with financial transaction systems for (banking systems, exchange systems).

Experience with Datadog or other alert monitoring systems.

Preferred Qualifications:

Familiarity with reading and decoding FIX and REST messages.

Financial certifications are not required, but encouraged. Understanding the regulatory landscape in traditional financial markets will lend well as the digital asset space evolves.

Financial Reporting Requirements for publicly traded companies.