README
¶
ContainerFS
Overview
ContainerFS is a container-native distributed filesystem as a unified platform for unstructured data storage.
-
unlimited small files and large files.
-
append-only or random writes
-
scale-out metadata management
-
strong consistency
-
multi-tenancy: millions of filesystem volumes
-
POSIX-compatible
Containerfs has been built and deployed in production since 2013.
Concepts
volume
inode
directory
blob
extent
Architecture
CFS consists of several components:
-
the cluster master. single raft replication, managing volumes, metanodes, datanodes, meta-partitions and data-partitions
-
metanode. multi-raft replication, a meta partition (inode range) per replication state machine
-
datanode. de-clustering of data partitions, two storage engines - Blob Store (BS) and Extent Store (ES), optimized for small and large files respectively.
-
client interfaces: FUSE, Java SDK, Go SDK, Linux kernel
replication
master: single-raft
metadata partition: multi-raft
data partition: chained append-only replication for append operations; multi-raft for extent updates
Usage
- mounted by containers for decoupling storage from compute
integrated with Kubernetes to run various workloads from application microservices to complex databases e.g., HBase, MyRocks, ElasticSearch, and ChuBao DB
- Image Store
based on the namespace-less key-file interface, nginx integration
- Object Store
integration with minio
Deployment
rack
set
License
Licensed under the Apache License, Version 2.0. For detail see LICENSE and NOTICE.
Directories
¶
| Path | Synopsis |
|---|---|
|
Package fuse enables writing FUSE file systems on Linux, OS X, and FreeBSD.
|
Package fuse enables writing FUSE file systems on Linux, OS X, and FreeBSD. |
|
examples/clockfs
Clockfs implements a file system with the current time in a file.
|
Clockfs implements a file system with the current time in a file. |
|
examples/hellofs
Hellofs implements a simple "hello world" file system.
|
Hellofs implements a simple "hello world" file system. |
|
fs/bench
Package bench contains benchmarks.
|
Package bench contains benchmarks. |
|
syscallx
Package syscallx provides wrappers that make syscalls on various platforms more interoperable.
|
Package syscallx provides wrappers that make syscalls on various platforms more interoperable. |
|
sdk
|
|
|
btree
Package btree implements in-memory B-Trees of arbitrary degree.
|
Package btree implements in-memory B-Trees of arbitrary degree. |
|
gorocksdb
Package gorocksdb provides the ability to create and access RocksDB databases.
|
Package gorocksdb provides the ability to create and access RocksDB databases. |