Proposal for Improvement of BNB Greenfield System
Current Situation
In the BNB Greenfield system, the current configuration of Erasure Coding (EC) replication is set to 4+2, which effectively results in a 3-factor replication scheme. However, it has been observed that in storing EC parts, only secondary storage providers participate, leaving the primary storage provider copy out of the replication scheme. Although a copy of the primary storage provider can be utilized for reliability restoration, the system’s potential replication factor remains at 4, even though the desired replication factor is 3. This results in an inherent overhead, affecting costs for both storage providers and users.
Proposed Solution
1. Improved Restoration Algorithm:
The first step involves enhancing the restoration algorithm to incorporate the copy of the primary storage provider. By doing so, the replication factor of the system will effectively increase to 4. This means that in the event of data loss, the primary storage provider’s copy will also be utilized, further enhancing the system’s reliability.
2. EC Configuration Adjustment:
To align with the desired replication factor of 3 and to reduce the inherent overhead in the system, the EC configuration can be adjusted from the current 4+2 to 4+1. This means that for every 4 data chunks, only 1 parity chunk will be generated. This adjustment will effectively reduce the replication factor from 4 to the desired 3 while maintaining the desired level of data reliability.
Expected Outcomes
The proposed transition will lead to several positive outcomes:
1. Reduced Storage Costs for Users:
By reducing the replication factor from 4 to 3, the number of stored chunks will decrease from 6 to 5. This reduction, when coupled with the current configuration of secondary storage provider price ratios, which is set at 12%, will result in a reduction of the overall price for users by approximately 7%. This reduction in costs will be advantageous for both end-users and businesses utilizing the BNB Greenfield system.
2. Maintained Data Reliability:
Despite the reduction in the replication factor, the proposed changes will not compromise the reliability of the system. The utilization of the primary storage provider’s copy in the restoration algorithm ensures that data integrity and restoration capabilities are preserved.
Conclusion:
The proposed solution involves a two-fold approach to improve the BNB Greenfield system. By enhancing the restoration algorithm to incorporate the primary storage provider’s copy and adjusting the EC configuration from 4+2 to 4+1, the replication factor can be aligned with the desired level of 3. This transition will lead to reduced storage costs for users while maintaining the system’s reliability. The implementation of this proposal stands to benefit both storage providers and users, making the BNB Greenfield system more cost-efficient and dependable.