NADEEF Dashboard Overview
NADEEF dashboard is a HTML5 web front-end to help user clean and analyze their data using NADEEF technology.
The vision of NADEEF dasboard is to
- Make data cleaning an analytic work. Data cleaning is used to be a tedious manual investment but now user can use NADEEF to do all the detect/repair while only focusing on understanding the data and designing cleaning rules.
- Provide the full stack cleaning tools from data profiling to data cleaning.
- Provide an extensible framework for data cleaning in the sense of supporting different algorithms and abstractions (e.g. FD, MD, DC rules).
- Provide a scalable and cloud deployment ready data cleaning solution.
The high level design of NADEEF architecture is as the following picture
At the top there is the HTML5 client for the GUI. The GUI is communicating with the web server which is a thin layer providing Restful API. At the back there is a NADEEF service which serves as a job scheduler to handle requests from different clients. The NADEEF service is built using Thrfit which means that it is also very easy to integrate other applications using NADEEF.
| Major Component | Technology |
|---|---|
| HTML5 client | Javascript, HTML5, JS libraries used are D3.js, Require.js, JQuery, and Bootstrap |
| Dashboard Web server | Java, Spark |
| NADEEF Service | Java, Thrfit |
| NADEEF | Java |