- Index crawler
- Articles crawler
- Stock information crawler (Brief information about corporates and their financial data)
First, clone git repository
git clone [url]
And then, move to the project directory
cd swpp-2025-project-team-12
Then switch to the 'iteration-1-demo' branch
git checkout iteration-1-demo
Create a new environment with Anaconda3 and activate it You can set the environment name freely
conda create -n myenv
conda activate myenv
Move to the demo directory named MnA_BE
cd MnA_BE
Install the modules needed
pip install -r requirements.txt
Make sure you have activated the virtual environment and switched to the branch
And you have to be: .../swpp-2025-project-team-12/MnA_BE
...so it will be like
(myenv) ~/swpp-2025-project-team-12/MnA_BE git:(iteration-1-demo)
python -c "from apps.MarketIndex.stockindex_manager import setup_initial_data; setup_initial_data()"
You can check the results at:
.../swpp-2025-project-team-12/MnA_BE/apps/MarketIndex/stockindex/KOSPI.json
.../swpp-2025-project-team-12/MnA_BE/apps/MarketIndex/stockindex/KOSDAQ.json
cat apps/MarketIndex/stockindex/KOSPI.json
cat apps/MarketIndex/stockindex/KOSDAQ.json
python apps/articles/crawler_main.py
You can check the results at: .../swpp-2025-project-team-12/MnA_BE/apps/articles/[date]/business_top50.json [date] is the date today (e.g. 20251005)
python apps/Finance/finance_crawler.py
You can check the result just at the terminal (will be printed out)
You can check the demo video for each feature here
swpp25 team12 iteration 1 demo - 1. Index crawler
swpp25 team12 iteration 1 demo - 2. Articles crawler
swpp25 team12 iteration 1 demo - 3. Stock information crawler