SQL Query on MinIO
Full fledged analytical applications, AI, ML workloads, dashboards - need a high performance query engine, that understands standard SQL parlance.
SQL Query on Parquet Files with DataFusion
Rust big data ecosystem is all set for bigtime - with Arrow and surrounding
ecosystem (DataFusion, Ballista) leading the pack.
Big Data ecosystem turning to Rust: an overview
Java is synonymous with last generation of Big Data tools and technologies. But
a lot has changed since 2000s. Latest
The Curious Case of Small Files
Background
Most of the files, by the virtue of their average size and usage patterns are
clearly cut out for
Streaming Data Tools & Techniques
Introduction
Streaming data is exactly what it sounds like, a continuously flowing stream of
data generated by one or multiple
Deploy Spark on Kubernetes
Introduction
Yarn has been the default orchestration platform for tools from Hadoop
ecosystem. This has started changing in recent times.
Modern Data Lakes Overview
Background
As Data volumes grow to new, unprecedented levels, new tools and techniques are
coming into picture to handle this
Persist Kafka Messages to MinIO
Learn how to use Kafka and MinIO to ingest huge data volumes and store it in persistent manner to ensure data is available for later analysis and consumption.