Skip to content

AIOT data collection

AIOT data collection

AIOT is the combination of AI and IOT. Three major steps for AIOT: data, intelligence, actions mean data collection, smart data intelligence, then actions accordingly. For data collection, IOT devices events and user behaviorial events might be collected via several approaches. Here we focus on the approaches of data collections and aggreagration.

via InfluxDB

Data collection, or IOT devices and user behaviorial events collection, can be formulated as time series or events and and stored in times series database (TSDB)

a time series or event can be in the form of

1
measurement tag fields timestamp
andd an example as 
1
temperature,device=device1,buidling=b1 internal=80,external=18 1443782126

influxDB is the top solution for (TSDB) as collectors, aggregators and visualizer and its block digram as below.

A showcase of IOT data collection architecture via influxDB.

A detailed pipeline for telegraf plugins: Inputs, outputs, processors plugins to process the data.

An example show how FLUX to handle the data source buckets, pipe, and forward operator, and tables.

1
2
3
4
5
6
7
from(bucket:"mongo")
  |> range(start:-1h)
  |> filter(fn:(r) =>
    r._measurement == "cpu" and
    r.cpu == "cpu-total"
  )
  |> aggregateWindow(every: 1m, fn: mean)

References