This post explores the reading and writing aspects of Apache Arrow, a cross-language development platform for in-memory data. It discusses the main file formats associated with Arrow, such as Parquet, Arrow/Feather, and CSV. It also explains Hive partitioning, a method used to split a table into multiple files based on partition keys.
