创建项目，版本1.0.0.2020.02.15

Author: jiangdongguo

ReadMe.md

@@ -0,0 +1,133 @@
+# RASA中文聊天机器人项目
+
+
+
+**RASA 开发中文指南系列博文：**
+
+- [Rasa中文聊天机器人开发指南(1)：入门篇](https://jiangdg.blog.csdn.net/article/details/104328946)
+- Rasa中文聊天机器人开发指南(2)：NLU篇
+- Rasa中文聊天机器人开发指南(3)：Core篇
+- Rasa中文聊天机器人开发指南(4)：RasaX篇
+
+
+
+# 1. 安装rasa
+
+## 1.1 环境要求
+
+- python 3.6 +
+- mitie
+- jieba
+
+## 1.2 安装步骤
+
+**1. 安装rasa**
+
+```shell
+# 当前版本为1.7.0
+# 该命令运行时间较长，会安装完所有的依赖
+pip --default-timeout=500 install -U rasa
+```
+
+**2. 安装mitie**
+
+```shell
+# 在线安装Mitie
+pip install git+https://github.com/mit-nlp/MITIE.git
+pip install rasa[mitie]  # 注：由于第一步始终没成功过，没尝试过这个命令的意义
+```
+ 由于自己在线安装尝试了很多次都拉不下来，因此只能走离线安装的方式，有三个步骤：
+
+- 首先，下载[MITIE源码](https://github.com/mit-nlp/MITIE)和中文词向量模型[total_word_feature_extractor_zh.dat(密码：p4vx)](https://pan.baidu.com/s/1kNENvlHLYWZIddmtWJ7Pdg)，这里需要将该模型拷贝到创建的python项目data目录下(可任意位置)，后面训练NLU模型时用到；
+
+- 其次，安装[Visual Studio 2017](https://blog.csdn.net/qq_42276781/article/details/88594870) ，需要勾选“`用于 CMake 的 Visual C++ 工具`”，因为编译MITIE源码需要Cmake和Visual C++环境。安装完毕后，将`C:\Program Files (x86)\Microsoft Visual Studio\2017\Community\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin`添加到环境变量中，再重启电脑使之生效；
+
+- 从Pycharm的命令终端进行Mitie源码根目录，执行下面的命令：
+
+  > python setup.py build  
+  > python setup.py install
+  
+
+**3. 安装jieba**  
+
+```shell
+# 安装Jieba中文分词
+pip install jieba
+```
+
+# 2. 训练模型  
+
+ 当所有样本和配置文件准备好后，接下来就是训练模型了，打开命令终端执行下面的命令，该命令会同时训练NLU和Core模型，具体如下：
+```shell
+python -m rasa train --config configs/config.yml --domain configs/domain.yml --data data/
+```
+
+# 3. 运行服务  
+
+**（1）启动Rasa服务**
+
+ 在命令终端，输入下面命令：
+
+```shell
+# 启动rasa服务
+# 该服务实现自然语言理解(NLU)和对话管理(Core)功能
+# 注：该服务的--port默认为5005，如果使用默认则可以省略
+python -m rasa run --port 5005 --endpoints configs/endpoints.yml --credentials configs/credentials.yml --debug
+```
+
+**（2）启动Action服务**
+
+在命令终端，输入下面命令：
+
+```shell
+# 启动action服务
+# 注：该服务的--port默认为5055，如果使用默认则可以省略
+Python -m rasa run actions --port 5055 --actions actions --debug 
+```
+
+**（3）启动server.py服务**
+
+```shell
+python server.py
+```
+
+当**Rasa Server**、**Action Server**和**Server.py**运行后，在浏览器输入：
+
+` http://127.0.0.1:8088/ai?content="查询广州明天的天气"`
+
+返回的结果为：
+
+![入门7](https://img-blog.csdnimg.cn/20200215154508497.png)
+
+# 4. 更新日志
+
+
+
+**（1）V1.0.0.2020.02.15**
+
+- 创建项目，模型训练成功；
+- 前端访问Rasa服务器正常响应；
+- 对接图灵闲聊机器人、心知天气API，便于测试；
+
+
+
+# 5. License
+
+
+
+> ```
+> Copyright 2020 Jiangdongguo
+> 
+> Licensed under the Apache License, Version 2.0 (the "License");
+> you may not use this file except in compliance with the License.
+> You may obtain a copy of the License at
+> 
+>    http://www.apache.org/licenses/LICENSE-2.0
+> 
+> Unless required by applicable law or agreed to in writing, software
+> distributed under the License is distributed on an "AS IS" BASIS,
+> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+> See the License for the specific language governing permissions and
+> limitations under the License.
+> ```
+

actions/ChatApis.py

@@ -0,0 +1,59 @@
+# 访问图灵机器人openapi
+# -*- coding: utf-8 -*-
+"""
+    ChatApis.py
+    ~~~~~~~~~
+
+    图灵机器人(公司)闲聊系统API对接
+    免费版只限每天调用100次，需联外网
+
+    :date: 2020-02-10 15:56:00
+    :author: by jiangdg
+"""
+import requests
+import json
+
+
+def get_response(msg):
+    """
+        访问图灵机器人openApi
+
+        :param msg 用户输入的文本消息
+        :return string or None
+    """
+    apiurl = "http://openapi.tuling123.com/openapi/api/v2"
+    # 构造请求参数实体
+    params = {"reqType": 0,
+              "perception": {
+                  "inputText": {
+                      "text": msg
+                  }
+              },
+              "userInfo": {
+                  "apiKey": "ca7bf19ac0e644c38cfbe9d6fdc08de1",
+                  "userId": "439608"
+              }}
+    # 将表单转换为json格式
+    content = json.dumps(params)
+
+    # 发起post请求
+    r = requests.post(url=apiurl, data=content, verify=False).json()
+    print("r = " + str(r))
+
+    # 解析json响应结果
+    # {'emotion':{
+    #               'robotEmotion': {'a': 0, 'd': 0, 'emotionId': 0, 'p': 0},
+    #               'userEmotion': {'a': 0, 'd': 0, 'emotionId': 10300, 'p': 0}
+    #            },
+    #  'intent': {
+    #       'actionName': '',
+    #       'code': 10004,
+    #       'intentName': ''
+    #       },
+    #  'results': [{'groupType': 1, 'resultType': 'text', 'values': {'text': '欢迎来到本机器人的地盘。'}}]}
+    code = r['intent']['code']
+    if code == 10004 or code == 10008:
+        message = r['results'][0]['values']['text']
+        return message
+    return None
+

actions/WeatherApis.py

@@ -0,0 +1,54 @@
+# 访问openapi
+# -*- coding: utf-8 -*-
+"""
+    WeatherApis.py
+    ~~~~~~~~~
+
+    使用心知天气数据查询天气
+
+    :date: 2020-02-10 15:56:00
+    :author: by jiangdg
+"""
+
+import requests
+import json
+
+KEY = 'rmhrne8hal69uwyv'  # API key(私钥)
+UID = ""  # 用户ID, TODO: 当前并没有使用这个值,签名验证方式将使用到这个值
+
+LOCATION = 'beijing'  # 所查询的位置，可以使用城市拼音、v3 ID、经纬度等
+API = 'https://api.seniverse.com/v3/weather/daily.json'  # API URL，可替换为其他 URL
+UNIT = 'c'  # 单位
+LANGUAGE = 'zh-Hans'  # 查询结果的返回语言
+
+
+def fetch_weather(location, start=0, days=15):
+    result = requests.get(API, params={
+        'key': KEY,
+        'location': location,
+        'language': LANGUAGE,
+        'unit': UNIT,
+        'start': start,
+        'days': days
+    }, timeout=2)
+    return result.json()
+
+
+def get_weather_by_day(location, day=1):
+    result = fetch_weather(location)
+    normal_result = {
+        "location": result["results"][0]["location"],
+        "result": result["results"][0]["daily"][day]
+    }
+
+    return normal_result
+
+
+if __name__ == '__main__':
+    default_location = "合肥"
+    result = fetch_weather(default_location)
+    print(json.dumps(result, ensure_ascii=False))
+
+    default_location = "合肥"
+    result = get_weather_by_day(default_location)
+    print(json.dumps(result, ensure_ascii=False))

actions/__init__.py

@@ -0,0 +1,120 @@
+from typing import Dict, Text, Any, List
+
+from rasa_sdk import Tracker, Action
+from rasa_sdk.events import UserUtteranceReverted, Restarted
+from rasa_sdk.executor import CollectingDispatcher
+from rasa_sdk.forms import FormAction
+
+from actions import ChatApis
+from actions.WeatherApis import get_weather_by_day
+from requests import (
+    ConnectionError,
+    HTTPError,
+    TooManyRedirects,
+    Timeout
+)
+
+
+class WeatherForm(FormAction):
+
+    def name(self) -> Text:
+        """Unique identifier of the form"""
+
+        return "weather_form"
+
+    @staticmethod
+    def required_slots(tracker: Tracker) -> List[Text]:
+        """A list of required slots that the form has to fill"""
+
+        return ["date-time", "address"]
+
+    def submit(
+            self,
+            dispatcher: CollectingDispatcher,
+            tracker: Tracker,
+            domain: Dict[Text, Any],
+    ) -> List[Dict]:
+        """Define what the form has to do
+            after all required slots are filled"""
+        address = tracker.get_slot('address')
+        date_time = tracker.get_slot('date-time')
+
+        date_time_number = text_date_to_number_date(date_time)
+
+        if isinstance(date_time_number, str):  # parse date_time failed
+            dispatcher.utter_message("暂不支持查询 {} 的天气".format([address, date_time_number]));
+        else:
+            weather_data = get_text_weather_date(address, date_time, date_time_number)
+            dispatcher.utter_message(weather_data);
+        return [Restarted()]
+
+
+def get_text_weather_date(address, date_time, date_time_number):
+    try:
+        result = get_weather_by_day(address, date_time_number)
+    except (ConnectionError, HTTPError, TooManyRedirects, Timeout) as e:
+        text_message = "{}".format(e)
+    else:
+        text_message_tpl = """
+            {} {} ({}) 的天气情况为：白天：{}；夜晚：{}；气温：{}-{} °C
+        """
+        text_message = text_message_tpl.format(
+            result['location']['name'],
+            date_time,
+            result['result']['date'],
+            result['result']['text_day'],
+            result['result']['text_night'],
+            result['result']["high"],
+            result['result']["low"],
+        )
+
+    return text_message
+
+
+def text_date_to_number_date(text_date):
+    if text_date == "今天":
+        return 0
+    if text_date == "明天":
+        return 1
+    if text_date == "后天":
+        return 2
+
+    # Not supported by weather API provider freely
+    if text_date == "大后天":
+        # return 3
+        return text_date
+
+    if text_date.startswith("星期"):
+        # TODO: using calender to compute relative date
+        return text_date
+
+    if text_date.startswith("下星期"):
+        # TODO: using calender to compute relative date
+        return text_date
+
+    # follow APIs are not supported by weather API provider freely
+    if text_date == "昨天":
+        return text_date
+    if text_date == "前天":
+        return text_date
+    if text_date == "大前天":
+        return text_date
+
+
+class ActionDefaultFallback(Action):
+    """Executes the fallback action and goes back to the previous state
+    of the dialogue"""
+
+    def name(self):
+        return 'action_default_fallback'
+
+    def run(self, dispatcher, tracker, domain):
+
+        # 访问图灵机器人API(闲聊)
+        text = tracker.latest_message.get('text')
+        message = ChatApis.get_response(text)
+        if message is not None:
+            dispatcher.utter_message(message)
+        else:
+            dispatcher.utter_template('utter_default', tracker, silent_fail=True)
+        return [UserUtteranceReverted()]

actions/action.py

@@ -0,0 +1,21 @@
+language: "zh"
+
+pipeline:
+- name: "MitieNLP"
+  model: "data/total_word_feature_extractor_zh.dat"
+- name: "JiebaTokenizer"
+- name: "MitieEntityExtractor"
+- name: "EntitySynonymMapper"
+- name: "RegexFeaturizer"
+- name: "MitieFeaturizer"
+- name: "SklearnIntentClassifier"
+
+policies:
+  - name: KerasPolicy
+    epochs: 500
+    max_history: 5
+  - name: FallbackPolicy
+    fallback_action_name: 'action_default_fallback'
+  - name: MemoizationPolicy
+    max_history: 5
+  - name: FormPolicy