Data Science Scopus Project

Project Information

Group project for 2190513 Data Science, Year 2 Semester 1
Objective: to analyse, visualise, and predict data of research papers from Scopus
To run the demo, please download the cleaned dataset first, then run python -m streamlit run streamlit_app.py. You can also visit the website here.

It must include the following three components:
1. Data module: Data collection, data preparation, and data analysis.
2. AI module: An AI model implementation, such as text classification, clustering, etc.
3. Visualization module: Visualization using a tool like Streamlit or other BI dashboard tools.
The primary data requirement is to focus on analyzing the provided data from Scopus.
Each group must also use web scraping or an API to add at least 1,000 additional papers from external sources, such as Scopus, DBLP, or Google Scholar.
Incorporating additional data sources, such as author locations or affiliation coordinates, will enhance the project’s appeal and may earn extra points.

Name		Name	Last commit message	Last commit date
Latest commit History 13 Commits
csv_and_json		csv_and_json
1_add_papers.ipynb		1_add_papers.ipynb
2_add_variables.ipynb		2_add_variables.ipynb
3_clean_data.ipynb		3_clean_data.ipynb
4_prepare_dashboard.ipynb		4_prepare_dashboard.ipynb
5_create_MLP_model.ipynb		5_create_MLP_model.ipynb
README.md		README.md
fundingMLP.model		fundingMLP.model
streamlit_app.py		streamlit_app.py