cubefs

module
v1.34.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Oct 9, 2024 License: Apache-2.0

README

CubeFS

CNCF Status Build Status LICENSE Language Go Report Card Docs CII Best Practices OpenSSF Scorecard Codecov Artifact HUB CLOMonitor FOSSA Status Release Tag

 Community Meeting
The CubeFS Project holds bi-weekly community online meeting. To join or watch previous meeting notes and recordings, please see meeting schedule and meeting minutes.
CubeFS

Overview

CubeFS ("储宝" in Chinese) is an open-source cloud-native file storage system, hosted by the Cloud Native Computing Foundation (CNCF) as an incubating project.

What can you build with CubeFS

As an open-source distributed storage, CubeFS can serve as your datacenter filesystem, data lake storage infra, and private or hybrid cloud storage. In particular, CubeFS enables the separation of storage/compute architecture for databases and AI/ML applications.

Some key features of CubeFS include:

  • Multiple access protocols such as POSIX, HDFS, S3, and its own REST API
  • Highly scalable metadata service with strong consistency
  • Performance optimization of large/small files and sequential/random writes
  • Multi-tenancy support with better resource utilization and tenant isolation
  • Hybrid cloud I/O acceleration through multi-level caching
  • Flexible storage policies, high-performance replication or low-cost erasure coding
CubeFS Architecture

Documents

Community

Partners and Users

There is the list of users and success stories ADOPTERS.md.

Reference

Haifeng Liu, et al., CFS: A Distributed File System for Large Scale Container Platforms. SIGMOD‘19, June 30-July 5, 2019, Amsterdam, Netherlands.

For more information, please refer to https://dl.acm.org/citation.cfm?doid=3299869.3314046 and https://arxiv.org/abs/1911.03001

License

CubeFS is licensed under the Apache License, Version 2.0. For detail see LICENSE and NOTICE.

Note

The master branch may be in an unstable or even broken state during development. Please use releases instead of the master branch in order to get a stable set of binaries.

Star History

Star History Chart

Directories

Path Synopsis
cli
cli/common/cfmt
Package cfmt provides fmt string for all struct in blobstore
Package cfmt provides fmt string for all struct in blobstore
clustermgr/mock
Package mock is a generated GoMock package.
Package mock is a generated GoMock package.
cmd
proxy/mock
Package mock is a generated GoMock package.
Package mock is a generated GoMock package.
testing
Package testing for mocking interfaces with `go generate`
Package testing for mocking interfaces with `go generate`
testing/mocks
Package mocks is a generated GoMock package.
Package mocks is a generated GoMock package.
testing/nolog
Package nolog for dummy logger in testing cases.
Package nolog for dummy logger in testing cases.
util/taskpool
Package taskpool is a generated GoMock package.
Package taskpool is a generated GoMock package.
cli
api
cmd
common
Package taskpool provides limited pool running task
Package taskpool provides limited pool running task
fs
cmd
depends
bazil.org/fuse
Package fuse enables writing FUSE file systems on Linux, OS X, and FreeBSD.
Package fuse enables writing FUSE file systems on Linux, OS X, and FreeBSD.
bazil.org/fuse/examples/clockfs
Clockfs implements a file system with the current time in a file.
Clockfs implements a file system with the current time in a file.
bazil.org/fuse/examples/hellofs
Hellofs implements a simple "hello world" file system.
Hellofs implements a simple "hello world" file system.
bazil.org/fuse/fs/bench
Package bench contains benchmarks.
Package bench contains benchmarks.
bazil.org/fuse/syscallx
Package syscallx provides wrappers that make syscalls on various platforms more interoperable.
Package syscallx provides wrappers that make syscalls on various platforms more interoperable.
spf13/pflag
Package pflag is a drop-in replacement for Go's flag package, implementing POSIX/GNU-style --flags.
Package pflag is a drop-in replacement for Go's flag package, implementing POSIX/GNU-style --flags.
jacobsa/fuse Module
cmd
sdk
test
tool
btree
Package btree implements in-memory B-Trees of arbitrary degree.
Package btree implements in-memory B-Trees of arbitrary degree.
buf
flowctrl
Package ratelimit RateLimit Algorithm Based on Token Bucket
Package ratelimit RateLimit Algorithm Based on Token Bucket
log
mocktest/raftstore
Package raftstoremock is a generated GoMock package.
Package raftstoremock is a generated GoMock package.
sys
ump

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL