Skip to content

Add complete TikTok Scraper Platform for Vercel deployment#1

Draft
Merluzzo93 wants to merge 4 commits into
hksvn:mainfrom
Merluzzo93:claude/analyze-repo-platform-011CUrckXvWoCDUJSErM8iuy
Draft

Add complete TikTok Scraper Platform for Vercel deployment#1
Merluzzo93 wants to merge 4 commits into
hksvn:mainfrom
Merluzzo93:claude/analyze-repo-platform-011CUrckXvWoCDUJSErM8iuy

Conversation

@Merluzzo93

Copy link
Copy Markdown

Features:

  • Next.js 14 platform with Tailwind CSS
  • Neon PostgreSQL database integration with schema
  • OpenAI GPT-4 audio transcription with detailed analysis
  • Complete project management system
  • TikTok video scraping (username, keyword, region)
  • Bulk video selection and saving
  • Video/audio/cover download and processing
  • Three video categories: main_videos, competitor_videos, competitor_user_videos
  • Settings page for API keys configuration
  • Full REST API with documentation
  • Vercel deployment ready with vercel.json
  • Comprehensive README and API documentation

Technical stack:

  • Next.js 14 with React 18
  • PostgreSQL (Neon) for data storage
  • OpenAI API for transcription
  • FFmpeg for audio/video processing
  • tiktok-hks library integration
  • Tailwind CSS for UI

Features:
- Next.js 14 platform with Tailwind CSS
- Neon PostgreSQL database integration with schema
- OpenAI GPT-4 audio transcription with detailed analysis
- Complete project management system
- TikTok video scraping (username, keyword, region)
- Bulk video selection and saving
- Video/audio/cover download and processing
- Three video categories: main_videos, competitor_videos, competitor_user_videos
- Settings page for API keys configuration
- Full REST API with documentation
- Vercel deployment ready with vercel.json
- Comprehensive README and API documentation

Technical stack:
- Next.js 14 with React 18
- PostgreSQL (Neon) for data storage
- OpenAI API for transcription
- FFmpeg for audio/video processing
- tiktok-hks library integration
- Tailwind CSS for UI
@Merluzzo93 Merluzzo93 marked this pull request as draft November 6, 2025 14:44
Remove @database_url and @openai_api_key secret references that were causing deployment errors. Environment variables should be configured directly in the Vercel dashboard instead (Settings > Environment Variables).

Required environment variables:
- DATABASE_URL: PostgreSQL connection string
- OPENAI_API_KEY: OpenAI API key for transcriptions
Update installCommand in vercel.json to install dependencies in both root directory and platform directory. This ensures that the tiktok-hks package (referenced as "file:../") has its dependencies (lodash, axios) properly installed before building.

This resolves the webpack errors:
- Module not found: Can't resolve 'lodash'
- Module not found: Can't resolve 'axios'
Major changes:
1. Moved vercel.json to repository root for proper monorepo configuration
2. Updated vercel.json to handle monorepo structure with correct paths
3. Changed all tiktok-hks imports to direct relative imports (../../../../index)
4. Removed "tiktok-hks": "file:../" dependency from platform/package.json
5. Keep axios and lodash as direct dependencies in platform

This resolves the webpack errors:
- Module not found: Can't resolve 'lodash'
- Module not found: Can't resolve 'axios'

By importing directly from the source files, we avoid the complexity of
managing local package dependencies and ensure all dependencies are
properly resolved during the Vercel build process.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants