When we don’t do Partition & do Sharding (Matrix 3rd quadrant) then it is complete data replica. It totally depends on your business requirements, Quadrant 3 is more suitable when data can be fit in single database server but read traffic is high & you need data base availability.
Stumbled onto this article searching for something completely different (sharding can mean breaking up rocks), but I was drawn in by how understandable this article is. Great job writing this.
Really confused about the difference, could it be correct if i say database sharding is database replication, However, if i say that, it would be wrong because a shard might contain records not available in another shard.
Th final matrix is totally on point, Vivek!
Thankyou Raul 🙌
Very insightful 👍!!
Detailed and Very clearly broken down, Thank you for sharing this Vivek
Revisiting the article and found out I missed to like it :D
Thanks for this one!
Informative & succinct, Vivek !
So, it means that in sharding, we are just having replica of data while in partitioning, the dataset is divided ?
When we don’t do Partition & do Sharding (Matrix 3rd quadrant) then it is complete data replica. It totally depends on your business requirements, Quadrant 3 is more suitable when data can be fit in single database server but read traffic is high & you need data base availability.
Designing Data-Intensive Applications - Pg.199
Terminological confusion
What we call a partition here is called a shard in MongoDB, Elasticsearch,
and SolrCloud; it’s known as a region in HBase, a tablet
in Bigtable, a vnode in Cassandra and Riak, and a vBucket in
Couchbase. However, partitioning is the most established term, so
we’ll stick with that.
This was very insightful. Thanks for sharing!
Very insightful. Thank you 👏👏
Quadrant 3 <Sharding: Yes & Partitioning: No>
In this scenario we can also say that master slave design correct me if I am wrong.
Nice post by the way.
Stumbled onto this article searching for something completely different (sharding can mean breaking up rocks), but I was drawn in by how understandable this article is. Great job writing this.
++ Good Post, Also, start here stock market, AI research, Crash Courses, 100+ Most Asked ML System Design Case Studies and LLM System Design
Stock Market
https://open.substack.com/pub/stockmarketanalysis04/p/important-stock-market-post-04-which?r=14q3sp&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false
https://open.substack.com/pub/stockmarketanalysis04/p/important-stock-market-analysis-which?r=14q3sp&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false
https://open.substack.com/pub/stockmarketanalysis04/p/important-stock-market-post-02-understand?r=14q3sp&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false
https://open.substack.com/pub/stockmarketanalysis04/p/important-stock-market-post-03-this?r=14q3sp&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false
Crash Courses
https://open.substack.com/pub/crashcourses/p/crash-course-02-a-complete-crash?r=14q3sp&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false
https://open.substack.com/pub/crashcourses/p/crash-course-01-a-complete-crash?r=14q3sp&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false
AI/ML Research
https://open.substack.com/pub/airesearch04/p/ai-research-2-kimi-k2-thinking-a?r=14q3sp&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false
https://open.substack.com/pub/airesearch04/p/ai-research-1-the-transformer-revolution?r=14q3sp&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false
LLM System Design
https://open.substack.com/pub/naina0405/p/most-important-llm-system-design-b31?r=14q3sp&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false
https://naina0405.substack.com/p/launching-llm-system-design-large?r=14q3sp
https://naina0405.substack.com/p/launching-llm-system-design-2-large?r=14q3sp
[https://open.substack.com/pub/naina0405/p/llm-system-design-3-large-language?r=14q3sp&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false
https://open.substack.com/pub/naina0405/p/important-llm-system-design-4-heart?r=14q3sp&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false
System Design
https://open.substack.com/pub/naina0405/p/system-design-tech-case-study-pulse-862?r=14q3sp&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false
https://open.substack.com/pub/naina0405/p/system-design-tech-case-study-pulse-b3c?r=14q3sp&utm_campaign=post&utm_medium=web
https://open.substack.com/pub/naina0405/p/system-design-tech-case-study-pulse-135?r=14q3sp&utm_campaign=post&utm_medium=web
https://open.substack.com/pub/naina0405/p/system-design-tech-case-study-pulse-007?r=14q3sp&utm_campaign=post&utm_medium=web
Appreciate the breakdown!
It’s very insightful 😇
Really confused about the difference, could it be correct if i say database sharding is database replication, However, if i say that, it would be wrong because a shard might contain records not available in another shard.
Yes replication can not be called shardjng.