Senior Data Engineer

Finlync Company Limited • Full Time • Hong Kong, HK • 9h ago

About the Company

We are looking for a Senior Data Engineer with strong hands-on engineering skills and a solid understanding of modern data architecture.

About the Role

You will be responsible for designing, building, and improving scalable data platforms and pipelines using Databricks and AWS. In addition to implementation, you will contribute to architectural decisions around data modelling, ingestion, storage, processing, governance, reliability, and platform scalability. This role is suitable for someone who enjoys building production systems but is also comfortable stepping back to think about the broader data platform architecture.

Responsibilities

Design, build, and maintain scalable batch and streaming data pipelines using Databricks.
Develop reliable ETL/ELT pipelines for ingesting data from databases, APIs, Kafka/event streams, files, and other enterprise systems.
Design and maintain data lake / lakehouse architecture on AWS and Databricks.
Build and optimise Bronze, Silver, and Gold data layers using Delta Lake and Medallion Architecture principles.
Work with stakeholders and engineering teams to define appropriate data models, schemas, and data contracts.
Participate in architectural discussions and help define standards for: Data ingestion, Data storage, Data modelling, Streaming architecture, Data quality, Data governance, Security and access control, Scalability and performance
Design solutions that balance performance, maintainability, cost, and operational complexity.
Build reusable data frameworks, libraries, and platform components rather than one-off pipelines.
Improve pipeline performance through partitioning, clustering, query optimisation, caching, and efficient Spark processing.
Implement monitoring, alerting, logging, lineage, and data quality checks across data pipelines.
Troubleshoot production data issues and perform root-cause analysis.
Ensure data platforms are resilient, observable, and recoverable.
Work closely with Software Engineers, Data Analysts, BI teams, DevOps/Platform Engineers, and Solution Architects.
Contribute to technical design reviews and provide guidance to other Data Engineers.
Support CI/CD, infrastructure automation, testing, and release practices for data workloads.
Continuously evaluate improvements to the data platform, engineering standards, and architecture.

Qualifications

5+ years of experience in Data Engineering, Data Platform Engineering, or a similar role.
Strong hands-on experience with Databricks and Apache Spark / PySpark.
Strong SQL and Python development skills.
Experience building production-grade ETL/ELT pipelines at scale.
Strong understanding of Delta Lake and Lakehouse architecture.
Good understanding of data modelling and data warehouse concepts.
Experience working with AWS data services, particularly S3, IAM, Glue, and related services.
Experience designing pipelines for large-volume datasets.
Good understanding of distributed data processing and its performance considerations.
Experience with orchestration, scheduling, dependency management, monitoring, and failure recovery.
Understanding of data quality, lineage, governance, and access-control concepts.
Experience implementing CI/CD and software engineering practices for data pipelines.
Ability to independently analyse technical problems and propose scalable solutions.
Ability to explain architectural decisions and their trade-offs clearly.

Required Skills

Strong technical skills and remains hands-on.
Thinks beyond individual pipelines and considers the overall platform.
Understands the trade-offs between different architectural approaches.
Builds systems that other engineers can maintain and extend.
Takes ownership of production reliability and data quality.
Can work independently on complex technical problems.
Is comfortable challenging existing designs and proposing better approaches.
Can translate business requirements into practical, scalable data solutions.
Communicates effectively with both technical and non-technical stakeholders.

Preferred Skills

Experience with every technology is not mandatory, but strong experience with Databricks, Spark, Python, SQL, and AWS is expected.

Similar Jobs

Staff Engineer, Security Platform Development

OKX • Full Time • Hong Kong, HK • 9h ago

Engineering Full Time

Who We Are At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access...

9h ago

Apply

Senior/Staff Engineer, Security Platform Development

OKX • Full Time • Hong Kong, HK • 10h ago

Engineering Full Time

OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa. Who We Are At OKX, we believe that the future will be reshaped by crypto, and ultimately...

10h ago

Apply

Platform / Site Reliability Engineer

Millennium • Full Time • Hong Kong, HK • 11h ago

Engineering Python Kubernetes Full Time

About Millennium Millennium is a global, diversified alternative investment firm, founded in 1989. Defined by evolution, innovation and focus, Millennium’s mission is to deliver results for our investors. Our people are...

11h ago

Apply

Network Engineer - Leading Hedge Fund - Hong Kong

Mondrian Alpha • Full Time • Hong Kong, HK • 11h ago

Engineering Full Time

My client, a leading global hedge fund, is seeking an experienced Network Engineer to join their technology team in Hong Kong. The successful candidate will play a key role in designing, implementing, troubleshooting, an...

11h ago

Apply

Front-end Engineer-React Native

RedotPay • Full Time • Hong Kong, HK • 12h ago

Engineering Full Time

岗位综述在React Native 跨端开发、原生安全防御（iOS/Android）以及 Web3 基础设施领域具备深厚技术积淀。负责公司海外稳定币交易与发卡 App 的客户端架构搭建。既能用React Native 实现极速的业务迭代与热更新，又能深入iOS (Swift/...

12h ago

Apply

Platform Engineer – Leading Financial Institution

PFCC Group • Full Time • Hong Kong, HK • 14h ago

Engineering Kubernetes Full Time

Our client, a leading financial institution, is investing heavily in its next-generation Data & Analytics Platform as part of a multi-year digitalisation and transformation programme. We are looking for a hands-on Da...

14h ago

Apply

Data Engineer – Leading Financial Institution

PFCC Group • Full Time • Hong Kong, HK • 18h ago

Engineering AWS Data Analyst Full Time

Our client, a leading digital financial institution, is seeking a Data Engineer to join its Data Services team. This role focuses on designing, maintaining, and improving data platforms and infrastructure that support cr...

18h ago

Apply

Site Reliability Engineer – Elite Quant Fund – Hong Kong- Up to $2,400,000+ Exceptional benefits/bonus package

Hunter Bond • Full Time • Hong Kong, HK • 1d ago

Engineering Trading Platform Full Time

🚀 Site Reliability Engineer 💰 Up to $2.4M HKD Base + Bonus 🏦Leading Global Quantitative Trading Firm 📍 Hong Kong (Hybrid, 3–4 Days Onsite) Want to build the infrastructure backbone of a global quant trading powerhouse? 🌏...

1d ago

Apply

Senior / Staff Data Engineer (BI) – CEG Team

Agoda • Full Time • Hong Kong, HK • 1d ago

Engineering Full Time

About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore...

1d ago

Apply

Senior Network Engineer

Stanford Black Limited • Full Time • Hong Kong, HK • HK$ 850,000 - HK$ 1,500,000 / year • 1d ago

Engineering Full Time

Senior Network Engineer - Global Hedge Fund | Hong Kong A leading global hedge fund is seeking an experienced Network Engineer to join its growing technology function in Hong Kong. This is a broad, hands-on networking ro...

1d ago

Apply