EasyAIoT (Cloud-Edge-Device Integrated Collaborative Algorithm Application Platform)

My vision is for this system to be accessible worldwide, achieving truly zero barriers to AI. Everyone should experience the benefits of AI, not just a privileged few.

English | 简体中文 | 繁體中文 | Русский | Français | 한국어

🌟 Some Thoughts on the Project

📍 Project Positioning

EasyAIoT is a cloud-edge-device integrated intelligent IoT platform that focuses on the deep integration of AI and IoT. Through core capabilities such as algorithm task management, real-time stream analysis, and model service cluster inference, the platform achieves a complete closed-loop from device access to data collection, AI analysis, and intelligent decision-making, truly realizing interconnected everything and intelligent control of everything.

🧠 AI Capabilities

• Real-Time Camera AI Analysis: Supports AI intelligent analysis of real-time camera feeds. Performs AI algorithm processing such as object detection, behavior analysis, and anomaly recognition on real-time video streams, providing millisecond-level response real-time analysis results, supporting concurrent analysis of multiple video streams
• Cloud-Edge-Device Integrated Algorithm Alert Monitoring Dashboard: Provides a unified cloud-edge-device integrated algorithm alert monitoring dashboard that displays key information in real-time, including device status, algorithm task operations, alarm event statistics, and video stream analysis results. Supports multi-dimensional data visualization, achieving unified monitoring and management of cloud, edge, and device layers, providing decision-makers with a global perspective intelligent monitoring command center
• Device Detection Region Drawing: Provides a visual device detection region drawing tool that supports drawing rectangular and polygonal detection regions on device snapshot images, supports flexible association configuration between regions and algorithm models, supports visual management, editing, and deletion of regions, supports keyboard shortcuts to improve drawing efficiency, enabling precise region detection configuration and providing accurate detection range definitions for algorithm tasks
• Large-Scale Camera Management: Supports access to hundreds of cameras, providing end-to-end services including collection, annotation, training, inference, export, analysis, alerting, recording, storage, and deployment
• Algorithm Task Management: Supports creation and management of two types of algorithm tasks, each task can flexibly bind frame extractors and sorters to achieve precise video frame extraction and result sorting
  • Real-Time Algorithm Tasks: Used for real-time video analysis, supporting RTSP/RTMP stream real-time processing with millisecond-level response capabilities, suitable for monitoring, security, and other real-time scenarios
  • Snapshot Algorithm Tasks: Used for snapshot image analysis, performing intelligent recognition and analysis on captured images, suitable for event backtracking, image retrieval, and other scenarios
• Model Service Cluster Inference: Supports distributed model inference service clusters, achieving intelligent load balancing, automatic failover, and high availability guarantees, significantly improving inference throughput and system stability
• Defense Time Period Management: Supports two defense strategies: full defense mode and half defense mode, allowing flexible configuration of defense rules for different time periods, achieving precise time-based intelligent monitoring and alerting
• OCR and Speech Recognition: High-precision text recognition based on PaddleOCR with speech-to-text functionality, providing multi-language recognition capabilities
• Multimodal Vision Large Models: Supports various vision tasks including object recognition and text recognition, providing powerful image understanding and scene analysis capabilities
• LLM Large Language Models: Supports intelligent analysis and understanding of multiple input formats including RTSP streams, video, images, audio, and text, achieving multimodal content understanding
• Model Deployment and Version Management: Supports rapid deployment and version management of AI models, enabling one-click model deployment, version rollback, and gray release
• Multi-Instance Management: Supports concurrent operation and resource scheduling of multiple model instances, improving system utilization and resource efficiency
• Camera Snapshot: Supports real-time camera snapshot functionality with configurable snapshot rules and trigger conditions, achieving intelligent snapshot capture and event recording
• Snapshot Storage Space Management: Provides storage space management for snapshot images with quota and cleanup policy support, ensuring rational utilization of storage resources
• Video Storage Space Management: Provides storage space management for video files with automatic cleanup and archiving, achieving intelligent storage resource management
• Snapshot Image Management: Supports full lifecycle management of snapshot images including viewing, searching, downloading, and deletion, providing convenient image management functionality
• Device Directory Management: Provides hierarchical device directory management with device grouping, multi-level management, and permission control, achieving organized and fine-grained device management
• Alarm Recording: Supports automatic recording triggered by alarm events. When abnormal events are detected, relevant video clips are automatically recorded, providing a complete alarm evidence chain. Supports viewing, downloading, and management of alarm recordings
• Alarm Events: Provides comprehensive alarm event management functionality, supporting real-time alarm event push, historical query, statistical analysis, event processing, and status tracking, achieving full lifecycle management of alarms
• Video Playback: Supports fast retrieval and playback of historical recordings, providing convenient operations such as timeline positioning, variable speed playback, and keyframe jumping. Supports synchronized playback of multiple video streams, meeting event backtracking and analysis needs

🌐 IoT Capabilities

• Device Access and Management: Device registration, authentication, status monitoring, lifecycle management
• Product and Thing Model Management: Product definition, thing model configuration, product management
• Multi-Protocol Support: Multiple IoT protocols including MQTT, TCP, HTTP
• Device Authentication and Dynamic Registration: Secure access, identity authentication, dynamic device registration
• Rule Engine: Data flow rules, message routing, data transformation
• Data Collection and Storage: Device data collection, storage, query, and analysis
• Device Status Monitoring and Alert Management: Real-time monitoring, anomaly alerts, intelligent decision-making
• Notification Management: Supports 7 notification methods including Feishu, DingTalk, Enterprise WeChat, Email, Tencent Cloud SMS, Alibaba Cloud SMS, and Webhook, enabling flexible and multi-channel alert notifications

💡 Technical Philosophy

We believe no single programming language excels at everything, but through the deep integration of three programming languages, EasyAIoT leverages the strengths of each to build a powerful technical ecosystem.

Java excels at building stable and reliable platform architectures but is not suitable for network programming and AI development; Python excels at network programming and AI algorithm development but has bottlenecks in high-performance task execution; C++ excels at high-performance task execution but is less suitable than the other two for platform development and AI programming. EasyAIoT adopts a tri-lingual mixed programming architecture, fully leveraging the strengths of each language to build an AIoT platform that's challenging to implement but extremely easy to use.

🔄 Module Data Flow

🤖 Zero-Shot Labeling Technology

Innovatively leveraging large models to construct a zero-shot labeling technical system (ideally completely eliminating manual labeling, achieving full automation of the labeling process), this technology generates initial data through large models and completes automatic labeling via prompt engineering. It then ensures data quality through optional human-machine collaborative verification, thereby training an initial small model. This small model, through continuous iteration and self-optimization, achieves co-evolution of labeling efficiency and model accuracy, ultimately driving continuous improvement in system performance.

🏗️ Project Architecture Features

EasyAIoT is not actually one project; it is seven distinct projects.

What's the benefit? Suppose you are on a resource-constrained device (like an RK3588). You can extract and independently deploy just one of those projects. Therefore, while this project appears to be a cloud platform, it simultaneously functions as an edge platform.

🌟 Genuine open source is rare. If you find this project useful, please star it before leaving - your support means everything to us!
(In an era where fake open-source projects are rampant, this project stands out as an exception.)

🌍 Localization Support

EasyAIoT actively responds to localization strategies, providing comprehensive support for localized hardware and operating systems, delivering secure and controllable AIoT solutions for users:

🖥️ Server-Side Support

• Full compatibility with Hygon x86 architecture processors
• Support for localized server hardware platforms
• Targeted performance optimization solutions
• Ensures stable operation of enterprise applications

📱 Edge-Side Support

• Comprehensive support for Rockchip ARM architecture chips
• Perfect adaptation to mainstream edge computing platforms like RK3588
• Deep optimization for edge scenarios
• Enables lightweight deployment of edge intelligence

🖱️ Operating System Support

• Compatible with Kylin operating system
• Support for localized Linux distributions like Founder
• Adaptation to mainstream localized operating systems like UOS
• Provides complete localized deployment solutions

🎯 Application Scenarios

🧩 Project Structure

EasyAIoT consists of five core projects:

Module	Description
WEB Module	Frontend management interface based on Vue, providing a unified user interaction experience
DEVICE Module	Technical Advantages: Based on JDK21, providing better performance and modern features Device Management: Device registration, authentication, status monitoring, lifecycle management Product Management: Product definition, thing model management, product configuration Protocol Support: Multiple IoT protocols including MQTT, TCP, HTTP Device Authentication: Device dynamic registration, identity authentication, secure access Rule Engine: Data flow rules, message routing, data transformation Data Collection: Device data collection, storage, query, and analysis
VIDEO Module	Stream Processing: Supports RTSP/RTMP stream real-time processing and transmission Algorithm Task Management: Supports real-time algorithm tasks and snapshot algorithm tasks, used for real-time video analysis and snapshot image analysis respectively Frame Extractor and Sorter: Supports flexible frame extraction strategies and result sorting mechanisms, each algorithm task can bind independent frame extractors and sorters Defense Time Period: Supports time-based configuration for full defense mode and half defense mode
AI Module	Intelligent Analysis: Responsible for video analysis and AI algorithm execution Model Service Cluster: Supports distributed model inference services, achieving load balancing and high availability Real-Time Inference: Provides millisecond-level response real-time intelligent analysis capabilities Model Management: Supports model deployment, version management, and multi-instance scheduling
TASK Module	C++-based high-performance task processing module responsible for compute-intensive task execution

🖥️ Cross-Platform Deployment Advantages

EasyAIoT supports deployment on Linux, Mac, and Windows, providing flexible and convenient deployment solutions for users in different environments:

🐧 Linux Deployment Advantages

• Ideal for production environments, stable and reliable with low resource consumption
• Supports Docker containerized deployment with one-click service startup
• Perfect compatibility with servers and edge computing devices (such as RK3588 and other ARM architecture devices)
• Provides complete automated installation scripts to simplify deployment

🍎 Mac Deployment Advantages

• Suitable for development and testing environments with deep macOS integration
• Supports local development and debugging for rapid feature validation
• Provides convenient installation scripts compatible with package managers like Homebrew

🪟 Windows Deployment Advantages

• Suitable for Windows server environments, reducing learning curve
• Supports PowerShell automation scripts to simplify deployment operations
• Compatible with both Windows Server and desktop Windows systems
• Provides graphical installation wizards for user-friendly experience

⚠️ Windows Deployment Notice: The Windows one-click deployment script currently has issues that will not be resolved in the short term. Windows users are advised to refer to the deployment documentation for manual deployment, or use Linux/Mac environments for deployment.

Unified Experience: Regardless of the operating system chosen, EasyAIoT provides consistent installation scripts and deployment documentation, ensuring a uniform cross-platform deployment experience.

☁️ EasyAIoT = AI + IoT = Cloud-Edge Integrated Solution

Supports thousands of vertical scenarios with customizable AI models and algorithm development.

Deep Integration Empowers Intelligent Vision for Everything

EasyAIoT constructs an efficient access and management network for IoT devices (especially massive cameras). We deeply integrate real-time streaming technology with cutting-edge AI to create a unified service core. This solution not only enables interoperability across heterogeneous devices but also deeply integrates HD video streams with powerful AI analytics engines, giving surveillance systems "intelligent eyes" – accurately enabling facial recognition, abnormal behavior analysis, risk personnel monitoring, and perimeter intrusion detection.

The platform supports two types of algorithm tasks: real-time algorithm tasks for real-time video analysis of RTSP/RTMP streams, providing millisecond-level response capabilities; snapshot algorithm tasks for intelligent analysis of captured images, supporting event backtracking and image retrieval. Through algorithm task management, flexible frame extraction and sorting strategies are achieved, with each task able to bind independent frame extractors and sorters. Combined with model service cluster inference capabilities, millisecond-level response and high availability are ensured. Additionally, two defense strategies are provided: full defense mode and half defense mode, allowing flexible configuration of monitoring rules for different time periods, achieving precise time-based intelligent monitoring and alerting.

In terms of IoT device management, EasyAIoT provides comprehensive device lifecycle management capabilities, supporting multiple IoT protocols (MQTT, TCP, HTTP) to achieve rapid device access, secure authentication, real-time monitoring, and intelligent control. Through the rule engine, intelligent data flow and processing of device data are realized, combined with AI capabilities for in-depth analysis of device data, achieving full-process automation from device access, data collection, intelligent analysis to decision execution, truly realizing interconnected everything and intelligent control of everything.

⚠️ Disclaimer

EasyAIoT is an open-source learning project unrelated to commercial activities. Users must comply with laws and regulations and refrain from illegal activities. If EasyAIoT discovers user violations, it will cooperate with authorities and report to government agencies. Users bear full legal responsibility for illegal actions and shall compensate third parties for damages caused by usage. All EasyAIoT-related resources are used at the user's own risk.

📚 Deployment Documentation

• Platform Deployment Documentation

🎮 Demo Environment

• Demo URL: http://36.111.47.113:8888/
• Username: admin
• Password: admin123

⚙️ Project Repositories

• Gitee: https://gitee.com/soaring-xiongkulu/easyaiot
• Github: https://github.com/soaring-xiongkulu/easyaiot

📸 Screenshots

🛠️ Service Support

We offer various service options to help you gain an in-depth understanding of the EasyAIoT platform and its code. Through product documentation, technical exchange groups, paid tutorials, and more, you will receive the following services:

Service Item	Service Content	Service Fee	Service Method
System Deployment	Complete EasyAIoT deployment in the customer-specified network and hardware environment	¥500	Online Deployment Support
Technical Support	Provide solutions for issues encountered during deployment and functional usage	¥200	Online Remote Support within 30 Minutes
Other Services	Customized development for vertical industry solutions; tailored duration and functional services	Negotiable	Negotiable

📞 Contact Information (After adding WeChat, please follow the official account to join the technical exchange group)

👥 Official Account

🪐 Knowledge Planet:

💰 Sponsorship

🙏 Acknowledgements

Thanks to the following contributors for code, feedback, donations, and support (in no particular order):

大饼	山寒	放学丶别走	春和	章鱼小丸子	Catwings	小工头	西乡一粒沙	玖零。
金鸿伟	李江峰	Best Yao	无为而治	shup	也许	⁰ʚᦔrꫀꪖꪑ⁰ɞ .	逆	廖东旺
黄振	春生	贵阳王老板	hao_chen	尽千	yuer629	kong	岁月静好	Kunkka
灬	Mr.LuCkY	泓	i	依依	小菜鸟先飞	追溯未来	青衫	Fae
憨憨	文艺小青年	lion	汪汪队立大功	wcj	怒放de生命	蓝速传媒	Achieve_Xu	NicholasLD
ADVISORYZ	take your time or	碎碎念.	北街	Dorky TAT	右耳向西	派大星	棒槌	信微输传助手
一往无前	Charon	赵WIFI.	Chao.	城市稻草人	Bug写手墨白	kevin	童年	sherry金
℡夏别	翠翠草原	慕容曦	Tyrion	大漠孤烟	Return	一杯拿铁	Thuri	Liu
三金	ZPort	Li	嘉树	俊采星驰	oi	ZhangY_000	℡夏别	张瑞麟
Lion King	Frank	徐梦阳	九月	tangl伟	冯瑞伦	杨林	梧桐有语。	歌德de花烛
泥嚎	翠翠草原	胡泽龙	苏叶	裴先生	谭远彪	陈祺	零点就睡	风之羽
王守仁	狼图腾	马到成功	做生活的高手	清欢之恋	绝域时空	风雨	Nicola	云住
Mr.Zhang	剑	shen	嗯	周华	太阳鸟	了了	第七次日落	npc
承担不一样的天空	铁木	Orion	森源-金福洪	薛继超	虎虎虎	Everyman	NXL	孙涛
hrsjw1	linguanghuan	YiYaYiYaho	慢慢慢	lilOne

💡 Expectations

We welcome suggestions for improvement to help refine easyaiot.

📄 Copyright

Soaring Xiongkulu / easyaiot is licensed under the APACHE LICENSE 2.0. When using the product, please note the following:

1. Do not modify the source code header comments or attribution of the product-related code.
2. Do not use the product for any actions that endanger national security, honor, and interests, or for any illegal purposes.

🌟 Star Growth Trend Chart