Liam Liu
Flagship systems

Regulated data · Databricks and Delta Lake

TD Insurance Enterprise Data Platform

A layered data platform that turns operational insurance records into governed regulatory products.

40% less investigation
System architecture01 — 05
01Source Systems
02Integrated Entities
03Temporal Facts
04Regulatory Products
05DQ & Outbound

My scope

The boundary I owned.

I worked in the data-product layer on privacy eligibility, historical corrections, reconciliation, metadata, and delivery controls.

  • PySpark
  • Spark SQL
  • Databricks
  • Delta Lake
  • ADLS
  • Data Quality

Engineering evidence

  1. Implemented Law 25 purge-eligibility logic across accounts, policies, claims, and contacts with relational evidence outputs.
  2. Corrected historical RSP exclusions and grain mismatches that affected downstream data quality and reconciliation.
  3. Mapped and documented more than 200 metadata fields while validating counts, financial measures, regional rules, and outbound contracts.
OutcomeCleaner audit evidence and faster investigation across regulated datasets.