BLUEPRINT UNITY CATALOG MIGRATION SNAPSHOT

A prominent marketing technology agency

A seamless Unity Catalog migration enabled a marketing ad agency to optimize Lakehouse spend and enhance data governance, resulting in significant cost savings and improved efficiency. Blueprint facilitated the rapid migration, delivering 143 refactored notebooks and comprehensive training within six weeks.

Client snapshot

Industry:

Marketing technology

Migration scope

Workspaces:

1 main workspace

Notebooks:

143 notebooks migrated

Duration

6 Weeks, including 1 week for an assessment

Key achievements:

Data optimization:

The strategy focused on identifying and excluding decommissioned or duplicative data from migration, ensuring deprecated or unused objects were not included.

Time savings:

Data movement is largely automated; however, notebooks often require some level of refactoring.

Noteworthy aspects:

  • Completed the UC Migration ahead of schedule allowing our teams to work on additional components.
  • The migration was within budget with no issues slowing it down.
  • Beyond the initial scope, the team also helped with refactoring, data migration, quality assurance, and post-migration training.

Scenario

A prominent marketing technology digital agency specializing in data-driven fundraising and marketing, successfully partnered with Blueprint to migrate to Unity Catalog within six weeks. This migration enables our client to leverage Databricks’ advanced features, including Unified Governance and Serverless Jobs, while optimizing their Lakehouse spend with the newly installed Lakehouse Optimizer.

Challenges

Our client’s internal team initially handled the migration, but due to time constraints and the need to focus on client projects, the effort fell short. Realizing it’d be worth it to partner with a Unity Catalog migration specialist, they turned to Databricks for guidance. Databricks recommended Blueprint as the preferred external partner to ensure the migration was completed efficiently and accurately.

Solution

Blueprint initiated an assessment of their existing Hive Metastore using the Lakehouse Optimizer Unity Catalog Module, followed by the migration to Unity Catalog within their workspaces. A comprehensive knowledge transfer on the target state was also conducted. Beyond the initial scope, the team also helped with refactoring, data migration, quality assurance, and post-migration training. The entire migration was completed within six weeks, ahead of schedule and within budget. This allowed us to include these additional components, thanks to the Blueprint team’s expertise, ensuring a seamless process with no issues.

Results

By migrating to Unity Catalog, our client can now achieve cost savings by leveraging Serverless Jobs for their most impactful workloads and gain improved visibility into their data lineage. Unity Catalog also positions them to adopt future roadmap features, including GenAI tools. With the Lakehouse Optimizer deployed, they can receive near real-time recommendations on how to optimize their lakehouse for improved efficiency, performance, and orchestration. The Blueprint team exceeded expectations by 238% with the initial target of migrating 60 notebooks and delivering 143.

Discover how you can become our next success story

Get started with us today.