2023-05-12 Demo

[ngjaying]

Recording: https://zoom.us/rec/share/9xgQEcClPTXhg53kSIElvcSsGfaXB9Lrfh7RbFvDE1FRDhYOiTSsp0hjTu4FJAGZ.gVBbDFl3lMBPA7bd?startTime=1683858523000

• Demo: Sink batch send to reduce edge/cloud io @Yisaer
• Demo: Graph API supports stream/table join to allow stream/batch integration @ngjaying
• Project Update: Introduce lint ci for better code quality, talk about the lint rules and local configuration @xjasonlyu

Join Zoom Meeting: May 12th 10:30AM UTC+8

https://zoom.us/j/95097577087?pwd=azZaOXpXWmFoOXpqK293RFp0N1pydz09

Meeting ID: 950 9757 7087

Passcode: 998285

[ngjaying]

Stream/Table/Rules for demo2 Graph API

### Demo 2.1, graph rule refers to stream definition

### 
POST http://{{host}}/streams
Content-Type: application/json

{"sql" : "create stream demo () WITH (DATASOURCE=\"demo\", TYPE=\"mqtt\")"}


### rule to access stream
POST http://{{host}}/rules
Content-Type: application/json

{
  "id": "rule1",
  "name": "简单规则",
  "graph": {
    "nodes": {
      "demo": {
        "type": "source",
        "nodeType": "mqtt",
        "props": {
          "sourceType": "stream",
          "sourceName": "demo"
        }
      },
      "log": {
        "type": "sink",
        "nodeType": "log",
        "props": {}
      }
    },
    "topo": {
      "sources": ["demo"],
      "edges": {
        "demo": ["log"]
      }
    }
  }
}

### Demo 2.2 stream/table join with graph API
### 1. Stream to update alert value in memory table
POST http://{{host}}/streams
Content-Type: application/json

{"sql":"CREATE STREAM alertStream() WITH (DATASOURCE=\"scene1/alert\", FORMAT=\"json\", TYPE=\"mqtt\")"}

### 2. Rule to update memory table
POST http://{{host}}/rules
Content-Type: application/json

{
  "id": "ruleUpdateAlert",
  "sql":"SELECT * FROM alertStream",
  "actions":[
    {
      "memory": {
        "keyField": "id",
        "rowkindField": "action",
        "topic": "alertVal",
        "sendSingle": true
      }
    }
  ]
}

### 3. Memory lookup table for alert values
POST http://{{host}}/tables
Content-Type: application/json

{"sql":"CREATE TABLE alertTable() WITH (DATASOURCE=\"alertVal\", TYPE=\"memory\", KIND=\"lookup\", KEY=\"id\")"}

### 4. Rule to join stream and table
POST http://{{host}}/rules
Content-Type: application/json

{
  "id": "ruleAlert",
  "graph": {
    "nodes": {
      "demo": {
        "type": "source",
        "nodeType": "mqtt",
        "props": {
          "sourceType": "stream",
          "sourceName": "demo"
        }
      },
      "alertTable": {
        "type": "source",
        "nodeType": "memory",
        "props": {
          "sourceType": "table",
          "sourceName": "alertTable"
        }
      },
      "joinop": {
        "type": "operator",
        "nodeType": "join",
        "props": {
          "from": "demo",
          "joins": [
            {
              "name": "alertTable",
              "type": "inner",
              "on": "demo.deviceKind = alertTable.id"
            }
          ]
        }
      },
      "log": {
        "type": "sink",
        "nodeType": "log",
        "props": {}
      }
    },
    "topo": {
      "sources": ["demo", "alertTable"],
      "edges": {
        "demo": ["joinop"],
        "alertTable": ["joinop"],
        "joinop": ["log"]
      }
    }
  }
}