![]() Please note that FDW based sharding the approach that PostgreSQL community is following in order to implement this feature. This enables the heavy query processing to be done on the shards and only results of the query are sent back to the primary node. ![]() Using the FDW based sharding, the data is partitioned to the shards, in order to optimise the query for the sharded table, various parts of the query i.e aggregates, join etc are pushed down to the shards. PostgreSQL provides number of foreign data wrapper (FDW’s) that are used for accessing external data sources, the postgres_fdw is used for accessing Postgres database running on external server i.e. The build-in sharding feature in PostgreSQL is using the FDW based approach, the FDW’s are based on sql/med specification that defines how an external data source can be accessed from the PostgreSQL server. Sharding allows the table to be partitioned in a way that the partitions live on external foreign servers and the parent table lives on the primary node where the user is creating the distributed table. While declarative partitioning feature allows the user to partition the table into multiple partitioned tables living on the same database server. It is the mechanism to partition a table across one or more foreign servers. Just to recap, sharding in database is the ability to horizontally partition the data across one more database shards. ![]() Last but not the least the blog will continue to emphasise the importance of this feature in the core of PostgreSQL. The blog also mentions some features that are far fetched and potentially not needed for MVP however they are really important for enterprise level deployment of a distributed cluster solution. Little has happened since then, the purpose of this blog is discuss the important missing pieces of the puzzle, what are the minimum set of features needed to get to MVP (minimum viable product) and most importantly which efforts are currently going on to get to the MVP of Sharding in PostgreSQL core. ![]() Back in August 2019, I wrote multiple blogs with the title of “Horizontal scalability with Sharding in PostgreSQL – Where it is going Part 1. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |