Skip to content

測試#8

Closed
yenslife wants to merge 2 commits into
gdg-on-campus-ncku:mainfrom
yenslife:test0421
Closed

測試#8
yenslife wants to merge 2 commits into
gdg-on-campus-ncku:mainfrom
yenslife:test0421

Conversation

@yenslife
Copy link
Copy Markdown
Contributor

No description provided.

Refactor the course crawler scripts to improve data handling and
incorporate text summarization using OpenAI's GPT models. The changes
include:

- Adding text summarization of course reviews using OpenAI's GPT models.
- Improving data aggregation by updating course information if a course
  already exists in the list, specifically appending new time slots.
- Converting 'got', 'sweet', and 'cold' values to appropriate types
  (float or None) for better data consistency.
- Implementing periodic saving of data every 300 courses to prevent
  data loss.
- Adding comprehensive error handling and logging.
- Updating comments and docstrings for clarity.

These changes enhance the crawler's functionality by providing
summarized course reviews and improving data management.
@yenslife yenslife closed this Apr 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant