Skip to content

Commit

Permalink
Troubleshooting substack.
Browse files Browse the repository at this point in the history
  • Loading branch information
ashryanbeats committed Feb 23, 2025
1 parent a675715 commit 1c1c3da
Show file tree
Hide file tree
Showing 2 changed files with 60 additions and 351 deletions.
30 changes: 1 addition & 29 deletions .github/workflows/deploy.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,10 +17,6 @@ jobs:
runs-on: ubuntu-latest
env:
NODE_OPTIONS: "--max-http-header-size=16384"
# Add these to help with feed fetching
UV_THREADPOOL_SIZE: "64"
FETCH_RETRY_COUNT: "5"
FETCH_TIMEOUT: "30000"
steps:
- uses: actions/checkout@v4

Expand All @@ -31,32 +27,8 @@ jobs:
- name: Install dependencies
run: npm ci

- name: Test Substack feeds
run: |
echo "Testing Substack feeds with curl..."
curl -v -A "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.0.0 Safari/537.36" \
-H "Accept: application/rss+xml, application/xml, text/xml, application/atom+xml" \
-H "Accept-Language: en-US,en;q=0.9" \
-H "Cache-Control: no-cache" \
-H "Pragma: no-cache" \
-H "Sec-Fetch-Dest: document" \
-H "Sec-Fetch-Mode: navigate" \
-H "Sec-Fetch-Site: none" \
-H "Sec-Fetch-User: ?1" \
--connect-timeout 20 \
--max-time 30 \
--retry 3 \
--retry-delay 5 \
--retry-max-time 60 \
https://theunderlying.substack.com/feed > substack_test.xml
echo "Substack feed content:"
cat substack_test.xml
- name: Fetch new feeds
run: |
# Add delay between retries
sleep 3
npm run refresh
run: npm run refresh

- name: Configure Git
run: |
Expand Down
Loading

0 comments on commit 1c1c3da

Please sign in to comment.