learning-data-mesh

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

learning-data-mesh

★ 37 Open GitHub ↗

Repo with resources for learning Data Mesh

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Learning Data Mesh

- :tv: YouTube Playlist of our bookclub meetings (each meeting is ~1 hr) --> [link](https://www.youtube.com/playlist?list=PL4Q4HssKcxYunGOPCphuUmilOhIrN-JUq), each weekly meeting is around one hour long.
    - Intro to bookclub - 4 min
    - Ch 0 - Prologue
    - Ch 1 (pt1) - DataMesh in a Nutshell
    - Ch 1 (pt2) - DataMesh in a Nutshell w/ intro demo to GCP DataPlex
    - Ch 2 - Principle of Domain Ownership w/ intro demo to AWS DataZone
    - Ch 3 - Data as a Product
    - Ch 4 (pt1) - Self-serve data platform
    - Ch 4 (pt2) - Self-serve data platform
    - Ch 5 - Federated Computational Governance w/discussion of GCP Organizational Hierarchies
    - Ch 6/7/8 - "Why Data Mesh?"
    - Ch 9 - "The Logical Architecture" w/ demo of GCP DataPlex Data Catalog
    - Ch 10 - Design for Users w/demo of AWS DataZone and of ChatGPT Advanced Data Analytics
    - Ch 11/Ch 12 (pt1) - Design Data Products
    - Ch 12 (pt2) - Design Consuming, Transforming, Serving Data w/demo of GCP transform job scaling architectures

Repo with resources for learning Data Mesh implementations and patterns - image and much more info at [link](https://www.k2view.com/platform/data-mesh-architecture/)

NOTE: To request to join the currently running **book club**, please DM me with your email (for a Slack invite) on Linked In.  The first book will be 'O'Reilly's "Data Mesh" (link below)

### Core Links
- 📘 Book "Data Mesh: Delivering Data-Driven Value at Scale" - [link](https://www.amazon.com/Data-Mesh-Delivering-Data-Driven-Value/dp/1492092398)
- :tv: Talk "Data Mesh, Now – Zhamak Dehgani" 30 minutes - [link](https://www.youtube.com/watch?v=VKDMz8op3VM)
- 🔖 Substack Article "Getting Started with Data Mesh" - [link](https://datameshlearning.substack.com/p/get-started-with-data-mesh)
- 🔖 DataMesh Learning, community site - [link](https://datameshlearning.com/)
- 📚Example architecture patterns at `datamesh-architecture.com` - [link](https://github.com/datamesh-architecture/datamesh-architecture.com)
- 🔖 List of links `awesome-datamesh` on GitHub - [link](https://github.com/JacekMajchrzak/awesome-datamesh)

### Core Patterns
Image from linked talk (above), shows 4 key prinicipals of data mesh as described by Zhamak Dehgani:

## Cloud Data Mesh Patterns

### GCP DataMesh

- GCP *"Data Mesh with DataPlex"* - my content and links - [link](https://github.com/lynnlangit/gcp-essentials/tree/master/4_big%20data_and_genomics/4k_BigLake_%26_Dataplex)

### AWS DataMesh
- AWS Docs *"Data Mesh w/Lake Formation and AWS Glue"* - blog at [link](https://aws.amazon.com/blogs/big-data/design-a-data-mesh-architecture-using-aws-lake-formation-and-aws-glue/)
- AWS Blog *"Architecting a DataMesh"* - [link](https://aws.amazon.com/blogs/architecture/lets-architect-architecting-a-data-mesh/)
- AWS Announcement *"Amazon DataZones"* - [link](https://aws.amazon.com/about-aws/whats-new/2023/03/aws-amazon-datazone-preview/)

### Azure DataMesh
- Azure Medium article *"Building a Data Mesh on Azure"* - [link](https://medium.com/codex/building-a-data-mesh-on-microsoft-azure-2eb533b5b834)
- Azure docs *"What is a Data Mesh?"* - [link](https://learn.microsoft.com/en-us/azure/cloud-adoption-framework/scenarios/cloud-scale-analytics/architectures/what-is-data-mesh)

learning-data-mesh

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README