Data Engineer

With market and regulatory momentum driving demand, Agio Ratings is entering a new phase of growth. We're seeking an energetic, creative, and experienced Data Engineer to scale mission-critical capabilities and help us win the market.

• Design and implement scalable ETL pipelines using Apache Spark or Apache Flink
• Build real-time streaming data pipelines to ingest blockchain transaction data
• Create data validation and QA frameworks to ensure pipeline reliability
• Design and optimize data schemas for high volume analytical databases
• Integrate with node APIs (Bitcoin Core, Geth, etc.) and 3rd party data vendors
• Implement horizontal scaling strategies for compute-intensive data processing algorithms
• Design fault-tolerant systems with proper error handling and recovery mechanisms
  
  This role is only open to candidates based in or willing to commute to London, UK at least 3 days a week.
In addition, you must have a minimum 3 years' experience in each of the following:
• Distributed computing: Apache Spark (PySpark/Scala), Apache Flink or equivalent
• Data warehousing: ClickHouse/Snowflake, or similar DBs
• Data lakes: AWS S3/Glue, Azure Data Lake, GCP BigQuery
• Programming: Python, Scala, or Java for data pipeline development
• Streaming: Kafka, Pulsar, or other streaming platforms
• Cloud Platforms: AWS, Azure, or GCP data services
• Knowledge of blockchain data formats and parsing techniques
• Experience working with blockchain node APIs and RPC interfaces
• Knowledge of data modelling for graph-based analysis
• Understanding of data compression and storage optimization techniques
• Competitive pay starting at £70,000 per year
  
  Agio Ratings is a VC-backed risk analysis firm focused on the digital asset market. Founded in 2022, our all-star team of PhDs developed advanced models that capture the market's unique risk factors. We were early in flagging FTX's high risk and in recognizing Bybit's resilience following a $1.5B hack. Today, our ratings power risk teams at top trading firms, insurance companies, and banks worldwide.