Skip to main content
DatabricksPySparkSnowflakeApache Airflow
ENH-2026-001

Customer Segmentation Integration

You have been assigned a production enhancement request from the Sales Analytics organization. Review the business requirements and understand stakeholder expectations before beginning technical implementation.

Priority
HIGH
Status
Analysis Phase
Assigned Role
Senior Data Engineer
Target Release
Sprint 14

Stakeholder Communication Center

Sales Director
Business Stakeholder
We need customer segmentation available in executive dashboards before the quarterly business review.
Finance Lead
Reporting Consumer
Revenue reporting currently requires manual categorization which is impacting monthly reporting efficiency.
Engineering Manager
Data Platform
Please assess downstream impacts across Databricks, Snowflake and reporting layers before implementation.

Change Request Summary

Request Title
Customer Segmentation Integration
Change Type
Schema Enhancement
Requested By
Sales Analytics Team
Business Value
Segment Wise Revenue Reporting
Acceptance Criteria
✓
Bronze Layer Updated
✓
Silver Layer Updated
✓
Gold Layer Updated
✓
Snowflake Updated
✓
Dashboard Updated
✓
Historical Data Validated

Business Impact Dashboard

Affected Pipelines
4
Affected Tables
7
Affected Dashboards
3
Business Users
145
Expected ROI
HIGH
Deployment Risk
MEDIUM

Impact Analysis Board

Databricks Impact

●bronze_customer
●silver_customer
●gold_customer_revenue

Snowflake Impact

●DIM_CUSTOMER
●FACT_REVENUE

Airflow Impact

●customer_ingestion_dag
●revenue_reporting_dag

Dashboard Impact

●Executive Revenue Dashboard
●Finance KPI Dashboard

Engineering Assessment Decision

Before implementing the enhancement, determine the most appropriate first engineering activity.

Proposed Solution Architecture

Based on impact analysis, determine the safest implementation strategy for introducing the new customer_segment column.

Proposed Architecture Flow
Source System
↓
Bronze Customer Table
↓
Silver Customer Table
↓
Gold Revenue Mart
↓
Snowflake Reporting Layer
↓
Executive Dashboards

Choose the Safest Implementation Strategy

Technical Design Review

Before implementation begins, review all affected assets and identify the correct starting point for the enhancement.

Databricks Assets

●bronze_customer_ingestion
●silver_customer_transform
●gold_customer_revenue

Snowflake Assets

●DIM_CUSTOMER
●FACT_REVENUE

Airflow Assets

●customer_ingestion_dag
●customer_reporting_dag

Which Asset Should Be Updated First?

Implementation Phase Approval

All planning, impact assessment and design reviews have been completed. The enhancement request is now approved for development.

Status
DESIGN APPROVED
Change Request
READY FOR DEVELOPMENT
Environment
DATABRICKS DEV
Development Authorization Granted
You may now begin implementation activities within the Databricks Development Workspace.
Next Opening Databricks Workspace Below

Databricks Workspace

Review the current schema before implementing the enhancement request.

Current Bronze Schema

customer_id
customer_name
country
signup_date

Requested Schema

customer_id
customer_name
country
signup_date
customer_segment

Bronze Layer Notebook Review

Open the ingestion notebook and review the existing implementation before applying the enhancement.

📒 bronze_customer_ingestion
Cluster Running
source_df = (
    spark.read.format("csv")
    .option("header", True)
    .load(source_path)
)

bronze_df = source_df.select(
    "customer_id",
    "customer_name",
    "country",
    "signup_date"
)
Engineering Observation
Business requested the new customer_segment column, but the notebook currently selects only four columns from the source file.

What modification is required?

Code Modification Workspace

Review the proposed notebook modification before submitting the change.

Current Implementation

bronze_df = source_df.select(
    "customer_id",
    "customer_name",
    "country",
    "signup_date"
)

Proposed Implementation

bronze_df = source_df.select(
    "customer_id",
    "customer_name",
    "country",
    "signup_date",
    "customer_segment"
)

Change Summary

✓ Added customer_segment column
✓ Supports sales segmentation reporting
✓ Required for downstream propagation

Bronze Layer Validation Workspace

The notebook execution completed successfully. Validate the enhancement before promoting the change downstream.

Schema ValidationPASSED
Row Count ValidationPASSED
Null ValidationPASSED
Duplicate ValidationPASSED

Sample Data Preview

customer_id
customer_name
customer_segment
1001
John Smith
Premium
1002
Maria Garcia
Standard

Which validation is MOST important?

✓ Bronze Layer Complete

The new customer_segment column has been successfully ingested and validated within the Bronze layer.

🔓 Silver Layer Unlocked