FastCFS V3.0 released, supporting 10 billion of massive files

After five months of dedicated development, FastCFS 3.0 was finally released. Main improvements of FastCFS 3.0: FastDIR which is the core component, implements the data storage engine through plugin. Binlog + storage engine plugin is used to load inode data on demand. The single machine supports 10 billion massive files with limited memory (such as 64GB).

It is easy to realize data persistence through binlog. When the program restarts, all inode data is loaded into memory through binlog replay. There are two problems in storing massive files in this way:

  1. Long time for program startup readiness;
  2. Very high requirements for memory.

V3.0 introduces the storage engine plugin, which solves the two major problems of data persistence only through binlog. The following technical articles will introduce the principle and characteristics of FastDIR storage engine in detail. Please look forward to it.

In addition, FastCFS 3.0 fixes the following three bugs:

   [fdir] increase/decrease parent's nlink on rename operation
   [fdir] set dentry->kv_array->count to 0 correctly
   [fstore] should init barray->count to 0

Welcome to install and use the latest version of FastCFS. If you have any questions and suggestions, please feel free to communicate.