E2e Medallion Architecture
Plans and builds end-to-end Fabric data platforms on the Bronze, Silver, and Gold...
Install
npx skills add microsoft/skills-for-fabric --skill e2e-medallion-architecture -g -a claude-code -y- Repository
- microsoft/skills-for-fabric1.3k
- Category
- Design
- Updated
- 6d ago
- License
- MIT
- Context cost
- Mediumabout 3,000 tokens
- Runs scripts
- No, instructions only
What it does
Plans and builds end-to-end Fabric data platforms on the Bronze, Silver, and Gold medallion pattern: ingestion to analytics, PySpark and Delta layers, pipeline orchestration, per-layer Spark tuning, Materialized Lake View versus notebook choices for Silver and Gold, and Direct Lake handoff. Use for layered architecture design, planning and recommendations. For questions over an existing Power BI report use fabriciq.
Telemetry, MANDATORY. Every
api.fabric.microsoft.comcall must carryx-ms-fabric-skill: e2e-medallion-architecture(az rest:--headers "x-ms-fabric-skill=e2e-medallion-architecture"), including every LRO poll,fabric_lroand retry. Snippets omit it, add it anyway.
CRITICAL NOTES
- To find the workspace details (including its ID) from workspace name: list all workspaces and, then, use JMESPath filtering
- To find the item details (including its ID) from workspace ID, item type, and item name: list all items of that type in that workspace and, then, use JMESPath filtering
End-to-End Medallion Architecture
Prerequisite Knowledge
Read these companion documents, they contain the foundational context this skill depends on:
- COMMON-CORE.md, Fabric REST API patterns, authentication, token audiences, item discovery
- COMMON-CLI.md,
az rest,az login, token acquisition, Fabric REST via CLI - SPARK-AUTHORING-CORE.md, Notebook deployment, lakehouse creation, job execution
- notebook-api-operations.md, Required for notebook creation,
.ipynbstructure requirements, cell format,getDefinition/updateDefinitionworkflow
For Spark-specific optimization details, see data-engineering-patterns.md.
Architecture Overview
Medallion Architecture is a data lakehouse pattern with three progressive layers:
