Remote Senior Data Engineer at DRW
Join our Unified Platform team as a Senior Data Engineer and take on a pivotal role in designing and developing a cutting-edge data platform. This platform is essential for Traders, Quantitative Researchers, and Back-Office teams to analyze financial markets, identify trading opportunities, create new strategies, and ensure seamless back-office operations.
Key Technical Requirements:
- Proven experience in designing and building distributed systems focused on data processing
- Hands-on experience with modern batch and streaming data ecosystems
- Expertise in Java/Scala or Python, along with proficiency in SQL and Bash
- Ability to lead, organize, and drive team projects to completion
- Experience contributing to project management and reporting
- Strong leadership skills to mentor junior team members on engineering best practices and code quality
Your Responsibilities:
- Collaborate on the design, development, and management of DRW's Unified Data Platform, ensuring it meets user needs
- Partner with Traders and Researchers to identify and integrate new data sources, enabling advanced analysis and uncovering trading opportunities
- Develop data solutions to manage data discovery, acquisition, organization, usage tracking, rights management, and quality control for various trading teams and strategies
- Monitor data ingestion pipelines and ensure data quality, stability, and reliability. Contribute to the development of monitoring and quality control tools and processes
What You Bring to the Role:
- 7+ years of experience working with modern data technologies or building data-intensive distributed systems
- Advanced skills in Java/Scala or Python, with a track record of delivering high-quality, maintainable code
- Strong command of SQL and Bash
- Experience with cloud-native technologies for scalable data processing
- Familiarity with both batch and streaming systems, including their limitations
- Proficiency with data processing tools like Flink, Spark, Polars, Dask, etc.
- Experience with data storage technologies such as S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, etc.
- Knowledge of data formats and serialization systems like Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, etc.
- Experience managing complex ETL pipelines using tools like Kubernetes, Argo Workflows, Airflow, Prefect, Dagster, etc.
- Understanding of schema governance and schema evolution
- Experience developing data quality control processes to identify gaps or inaccuracies
- A passion for mentoring junior team members and advocating for engineering best practices and high code quality
- Strong problem-solving skills and the ability to thrive in a fast-paced, agile environment
- Proven ability to prioritize tasks and manage multiple projects in a trading environment
The annual base salary for this role ranges from $180k to $250k, depending on experience, qualifications, and skills. This position is also eligible for an annual discretionary bonus. Additionally, DRW offers a comprehensive benefits package, including medical, dental, and vision insurance, 401k with employer match, short and long-term disability coverage, life and AD&D insurance, health savings accounts, and flexible spending accounts.