AIOT data collection
AIOT is the combination of AI and IOT. Three major steps for AIOT: data, intelligence, actions mean data collection, smart data intelligence, then actions accordingly. For data collection, IOT devices events and user behaviorial events might be collected via several approaches. Here we focus on the approaches of data collections and aggreagration.
via InfluxDB
Data collection, or IOT devices and user behaviorial events collection, can be formulated as time series or events and and stored in times series database (TSDB)
a time series or event can be in the form of
measurement tag fields timestamp
andd an example as
temperature,device=device1,buidling=b1 internal=80,external=18 1443782126
influxDB is the top solution for (TSDB) as collectors, aggregators and visualizer and its block digram as below.
A showcase of IOT data collection architecture via influxDB.
A detailed pipeline for telegraf plugins: Inputs, outputs, processors plugins to process the data.
An example show how FLUX to handle the data source buckets, pipe, and forward operator, and tables.
from(bucket:"mongo")
|> range(start:-1h)
|> filter(fn:(r) =>
r._measurement == "cpu" and
r.cpu == "cpu-total"
)
|> aggregateWindow(every: 1m, fn: mean)
References
- How To Install InfluxDB Telegraf and Grafana on Docker
- Nextcloud to influxDB (Grafana for display) with telegraf
- Cassandra vs. InfluxDB vs. MongoDB
- Flux Windowing and Aggregation
- GJSON PLAYGROUND
- influxdata/telegraf- HTTP Input Plugin
- IoT - Home sensor data monitoring with MQTT, InfluxDB and Grafana