Senior Data Engineer (2 positions), Digital Bank, Tokyo

AWS Databricks Delta Lake Unity Catalog Apache Spark Terraform
日本, 東京都 ハイブリッド (出社+在宅) ビッグデータ/データサイエンス&分析 正社員
45666 | アビール株式会社 | 投稿 2026/10/05
応募 友人に送信
概要

ROLE CONDITIONS
Japan residency required: this role does not include relocation or visa sponsorship. Applications from outside Japan cannot be considered.
Japanese is spoken daily on this role: JLPT N2 or N3 is the level we aim for, not a hard prerequisite. Strong Databricks expertise combined with banking, financial services, insurance or fintech background opens the discussion. What really matters is being able to go and ask the business teams your questions in Japanese once you are settled into the team and working on your own pipelines, so it is everyday speaking comfort rather than a certificate.
Two positions open. Hybrid: at least 2 days a week on site in Tokyo (Minato-ku), 3 or more encouraged.

CONTEXT
Our client is building a new digital bank in Tokyo, born from a joint venture between a major Japanese fintech player and a leading banking group. The mission: build embedded financial products from the ground up, with a strong focus on supporting small and medium-sized businesses (SMBs).

TEAM
Small agile team of 11 engineers, working in close collaboration with banking-side stakeholders.

スキル・資格

PROFILE
• Currently based in Japan with valid work authorization, no relocation or visa sponsorship from overseas for this role
• Japanese spoken on the job: JLPT N2 or N3 preferred, negotiable for a candidate with strong Databricks skills and banking or financial domain experience
• 5+ years in data engineering or analytics engineering
• Strong proficiency in SQL and Python
• Hands-on experience building data pipelines with modern tools (Databricks, Spark, or similar)
• Banking, financial services, insurance or fintech background (core banking, payments, regulatory reporting, AML, cross-system reconciliation): strongly valued, it offsets a lighter Japanese level
• Experience with cloud data platforms (AWS, Azure, GCP) and storage (S3, ADLS, GCS)
• Strong data modeling: dimensional modeling, data vault, or event-driven architectures
• Experience with data quality validation and testing frameworks
• Proven ability to debug and optimize slow queries and data processing jobs
• Version control (Git) and CI/CD pipelines
• Data governance concepts: access control, audit logging, data lineage
• Strong problem-solving, ability to work independently
• Experience mentoring junior or mid-level engineers
• Bachelor's degree in CS, Engineering or related, or equivalent practical experience

NICE TO HAVE
English business level (TOEIC 700+) · financial services / fintech / regulated industries · banking domain (core banking, payments, regulatory reporting, AML) · regulatory-compliant data platforms (FISC, FSA/BOJ, GDPR, APPI) · Databricks hands-on (AutoLoader, Unity Catalog, DLT, Databricks SQL, Workflows) · cross-system reconciliation for financial data · Databricks performance tuning and cost management · REST APIs with Python (FastAPI, Flask) · streaming ingestion (Kafka, Kinesis) · open-source contributions.

業務内容

ABOUT THE ROLE
As a Senior Data Engineer on the Data Platform team, you will build and maintain the central data hub connecting most systems inside this new digital bank. You will ingest data from banking systems, apply business logic, then serve it to downstream systems for enterprise management, regulatory reporting and risk management. This is a senior individual contributor role: you will design and implement complex data pipelines, mentor mid-level engineers, and participate in architecture decisions for the platform.

RESPONSIBILITIES
1. Design and implement data pipelines ingesting from multiple source systems via REST APIs or database connections
2. Build and maintain Bronze/Silver/Gold transformations ensuring data quality, consistency and performance
3. Implement data quality checks and cross-system reconciliation logic
4. Develop and optimize SQL queries and transformations using Databricks SQL/notebooks or Delta Live Tables
5. Design data models for analytics and reporting, with a primary focus on CRM data integration alongside regulatory reporting and downstream risk-management exports
6. Build REST APIs or data serving layers for downstream consumers
7. Participate in architecture decisions for data platform components
8. Write unit, integration and data quality tests for pipelines
9. Monitor pipeline performance, troubleshoot failures, implement improvements
10. Optimize query performance (partitioning, Z-ordering, query tuning)
11. Implement infrastructure as code using Terraform
12. Set up CI/CD for automated testing and deployment
13. Mentor mid-level engineers, conduct code reviews

その他

TECHNOLOGY STACK
• Cloud: AWS (Tokyo region), S3 data lake, VPC networking, IAM
• Databricks lakehouse: Delta Lake (ACID, time-travel, schema evolution), Bronze/Silver/Gold medallion architecture, Unity Catalog
• Orchestration & processing: Databricks Workflows, Apache Spark, batch and streaming ingestion with AutoLoader
• Transformation: Delta Live Tables, SQL and Python, incremental materialization
• Analytics: Databricks SQL, auto-scaling SQL warehouses, REST APIs for data serving
• Dev & DevOps: SQL, Python, GitHub, GitHub Actions, Terraform, AI-assisted tooling (Claude Code, GitHub Copilot)

HIRING PROCESS
1. Document screening or casual interview
2. First interview (a technical assignment may come before it)
3. Several interviews, including an online aptitude test of about 20 minutes
4. Final interview, reference check possible
5. Offer
If you have already applied to this role through another channel, tell us in your first message.

Full job page: https://abbeal.com/en/careers/senior-data-engineer-digital-bank-tokyo
Questions: recrutement@abbeal.com


勤務地情報
ハイブリッド (出社+在宅)
国 / 地域
日本
都道府県
東京都
勤務地(住所)
Minato-ku
1-23-5 Higashi-Azabu

応募 友人に送信
掲載企業
Abbeal K.K.
この求人を共有

✖