Fly.io公司为其Sprites产品开发了新的文件系统——Sprites块设备(SBD),用以替代此前基于JuiceFS修改的复杂存储方案。1原有方案包含三个独立维护的组件:块、元数据数据库和检查点数据库,任何一个组件的数据不同步都会导致系统故障。1在约5000个测试周期中,400个JuiceFS Sprites中有非零数量永久丧失了检查点能力。1
新的SBD方案通过简化架构解决了这一可靠性问题。1该系统仅包含一个守护进程和一个对象存储桶,元数据与块数据一起存储在桶中,大幅消减了多层元数据同步的复杂性。1SBD每次读取块时都会对照写入的内容进行校验,确保数据完整性。1经过大规模压力测试验证,SBD的可靠性相比原有方案提升了数个数量级。1
2024年10月6日前创建的Sprites可按说明进行迁移至新系统。1
Fly.io has unveiled Sprites Block Device (SBD), a new filesystem designed to replace its previous storage architecture based on a modified JuiceFS implementation.1 The move addresses critical reliability issues stemming from the complexity of the earlier system, which relied on three independently maintained components: a block layer, a metadata database, and a checkpoint database.1 Any desynchronization among these components could trigger failures, and across approximately 5,000 test cycles, a non-zero number of the 400 JuiceFS Sprites instances permanently lost checkpoint capability.1
The new SBD architecture significantly simplifies the design by consolidating to a single daemon process and an object storage bucket, with metadata stored alongside blocks within the bucket.1 This streamlined approach has demonstrated reliability improvements of multiple orders of magnitude compared to the previous solution.1 To ensure data integrity, SBD verifies each block read against its written contents, providing an additional layer of protection.1 Sprites created before October 6, 2024, may be migrated according to provided guidelines.1
评论
还没有评论,欢迎留下第一条。