The ingestion mechanism used is the flume service. Apache Flume is a tool/service/data ingestion mechanism for collecting aggregating and transporting large amounts of streaming data such as log. When using the ARGO Messaging API for ingestion in-front of the compute engine, a broker network is needed for the relay of messages and an ingestion mechanism for storing the data on HDFS. A flume is a human-made channel for water, in the form of an open declined gravity chute whose walls are raised above the surrounding terrain, in contrast. It is typically constructed of concrete, steel, or wood, and can be found in a variety of settings, including hydroelectric power plants, water treatment facilities, and irrigation systems. Flumes are often used in the hydroelectric power industry to transport water to turbines, or in irrigation systems to distribute water to crops. A flume is a man-made channel or chute that is used to transport water or other fluids from one point to another. It is typically made of concrete or metal and can be either open or closed.

Flumes are generally used to transport things like logs, or to measure the flow of water. Using a custom flume interceptor while ingesting data from kafka to hdfs Description A flume is a man-made channel or chute that is used to transport water from one place to another. A flume is a raised channel or chute that has water flowing through it. Compute Engine Ingestion | Flume Decode Interceptor

Define flume