SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

大数たいすう据すえ入にゅう门指南しなん ⭐

Ceph is a distributed object, block, and file storage platform

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

专注大数たいすう据すえ学がく习面试，大数たいすう据すえ成なり神しん之の路みち开启。Flink/Spark/Hadoop/Hbase/Hive...

Utils for streaming large files (S3, HDFS, gzip, bz2...)

The Universal Storage Engine

🎯 🌟[大数たいすう据すえ面めん试题]分ぶん享とおる自己じこ在ざい网络上じょう收集しゅうしゅう的てき大数たいすう据すえ相しょう关的面めん试题以及自己じこ的てき答案とうあん总结.目前もくぜん包含ほうがんHadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框かまち架か的てき面めん试题知ち识总结

大数たいすう据すえ知ち识仓库涉及到数すう据すえ仓库建けん模も、实时计算、大数たいすう据すえ、数かず据すえ中台ちゅうたい、系けい统设计、Java、算法さんぽう等とう。

A native go client for HDFS

Addax is a versatile open-source ETL tool that can seamlessly transfer data between various RDBMS and NoSQL databases, making it an ideal solution for data migration.

A pure python HDFS client

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

💎🔥大数たいすう据すえ学がく习笔记

Real Time Analytics and Data Pipelines based on Spark Streaming

Web tool for Kafka Connect |

CloudEon uses Kubernetes to install and deploy open-source big data components, enabling the containerized operation of an open-source big data platform. This allows you to reduce your focus on underlying resource management and maintenance.

Big Data Ecosystem Docker

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Fundamentals of Spark with Python (using PySpark), code examples