[Bug]: WinSCP download issue

[jafetarcha]

What happened?

Hello,

I'm getting an error for WinSCP app. It stopped in resolving the URL:

Do you know what may cause this issue ?

Thanks.

Version

2507.2318

What PowerShell edition/s are you running Evergreen on?

Windows PowerShell

Which operating system/s are you running Evergreen on?

Windows Server 2016+

Have you reviewed the documentation?

• Troubleshooting at: https://stealthpuppy.com/evergreen/troubleshoot/
• Known issues at: https://stealthpuppy.com/evergreen/issues/

Verbose output

PS H:\> Get-EvergreenApp -Name WinSCP -Verbose
VERBOSE: Function path: C:\Program Files\WindowsPowerShell\Modules\Evergreen\2507.2318\Apps\Get-WinSCP.ps1
VERBOSE: Function exists: C:\Program Files\WindowsPowerShell\Modules\Evergreen\2507.2318\Apps\Get-WinSCP.ps1.
VERBOSE: Dot sourcing: C:\Program Files\WindowsPowerShell\Modules\Evergreen\2507.2318\Apps\Get-WinSCP.ps1.
VERBOSE: Get-FunctionResource: read application resource strings from [C:\Program Files\WindowsPowerShell\Modules\Evergreen\2507.2318\Manifests\WinSCP.json]
VERBOSE: Calling: Get-WinSCP.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: UseBasicParsing: True.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: MaximumRedirection: 2.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: DisableKeepAlive: True.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: UserAgent: Evergreen/2507.2318.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: Method: Default.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: Uri: https://sourceforge.net/projects/winscp/best_release.json.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: ContentType: application/json; charset=utf-8.
VERBOSE: GET https://sourceforge.net/projects/winscp/best_release.json with 0-byte payload
VERBOSE: received 3392-byte response of content type application/json; charset=utf-8
VERBOSE: Get-SourceForgeRepoRelease: Validating SourceForge release object.
VERBOSE: Get-SourceForgeRepoRelease: Property validation succeeded.
VERBOSE: Get-SourceForgeRepoRelease: Capture version number from: /WinSCP/6.5.3/WinSCP-6.5.3-Setup.exe.
VERBOSE: Get-SourceForgeRepoRelease: Found filename: [WinSCP-6.5.3-Setup.exe].
VERBOSE: Get-SourceForgeRepoRelease: Found folder:   [/WinSCP/6.5.3/].
VERBOSE: Get-SourceForgeRepoRelease: Found version:  [6.5.3].
VERBOSE: Resolve-SystemNetWebRequest: Attempting to resolve: http://downloads.sourceforge.net/project/winscp/WinSCP/6.5.3/WinSCP-6.5.3-Setup.exe?ts=gAAAAABod78mCOZGBrdD-jIk3o5KrV5yKmCYFDI-wTVF194ARqaIqMe6U0Iy_cuSmmMWvsv_m-F-Wj3b1DwWVY705DC-KY-ewA%3D%3D.
WARNING: Resolve-SystemNetWebRequest: Return code: [], with: http://downloads.sourceforge.net/project/winscp/WinSCP/6.5.3/WinSCP-6.5.3-Setup.exe?ts=gAAAAABod78mCOZGBrdD-jIk3o5KrV5yKmCYFDI-wTVF194ARqaIqMe6U0Iy_cuSmmMWvsv_m-F-Wj3b1DwWVY705DC-KY-ewA%3D%3D.
WARNING: Resolve-SystemNetWebRequest: For troubleshooting steps see: https://stealthpuppy.com/evergreen/troubleshoot/.
WARNING: Run 'Get-EvergreenApp -Name "WinSCP" -Verbose' to review additional details for troubleshooting.

[aaronparker]

Do you get the same issue in PowerShell 7?

[jafetarcha]

Yes. Same issue in powershell 7.

[aaronparker]

I'm not sure what's going on then - working OK here on PowerShell 7 on macOS (I haven't retried on Windows yet).

Get-EvergreenApp -Name WinSCP -Verbose
VERBOSE: Function path: /Users/aaron/projects/evergreen/Evergreen/Apps/Get-WinSCP.ps1
VERBOSE: Function exists: /Users/aaron/projects/evergreen/Evergreen/Apps/Get-WinSCP.ps1.
VERBOSE: Dot sourcing: /Users/aaron/projects/evergreen/Evergreen/Apps/Get-WinSCP.ps1.
VERBOSE: Get-FunctionResource: read application resource strings from [/Users/aaron/projects/evergreen/Evergreen/Manifests/WinSCP.json]
VERBOSE: Calling: Get-WinSCP.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: Uri: https://sourceforge.net/projects/winscp/best_release.json.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: UserAgent: Evergreen/2507.2318.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: DisableKeepAlive: True.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: ContentType: application/json; charset=utf-8.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: MaximumRedirection: 2.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: UseBasicParsing: True.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: Method: Default.
VERBOSE: Requested HTTP/1.1 GET with 0-byte payload
VERBOSE: Received HTTP/1.1 response of content type application/json of unknown size
VERBOSE: Content encoding: utf-8
VERBOSE: Get-SourceForgeRepoRelease: Validating SourceForge release object.
VERBOSE: Get-SourceForgeRepoRelease: Property validation succeeded.
VERBOSE: Get-SourceForgeRepoRelease: Capture version number from: /WinSCP/6.5.3/WinSCP-6.5.3-Setup.exe.
VERBOSE: Get-SourceForgeRepoRelease: Found filename: [WinSCP-6.5.3-Setup.exe].
VERBOSE: Get-SourceForgeRepoRelease: Found folder:   [/WinSCP/6.5.3/].
VERBOSE: Get-SourceForgeRepoRelease: Found version:  [6.5.3].
VERBOSE: Resolve-SystemNetWebRequest: Attempting to resolve: http://downloads.sourceforge.net/project/winscp/WinSCP/6.5.3/WinSCP-6.5.3-Setup.exe?ts=gAAAAABod78mCOZGBrdD-jIk3o5KrV5yKmCYFDI-wTVF194ARqaIqMe6U0Iy_cuSmmMWvsv_m-F-Wj3b1DwWVY705DC-KY-ewA%3D%3D.
VERBOSE: Resolve-SystemNetWebRequest: Resolved to: [http://ixpeering.dl.sourceforge.net/project/winscp/WinSCP/6.5.3/WinSCP-6.5.3-Setup.exe?viasf=1].
VERBOSE: Get-SourceForgeRepoRelease: Resolve mirror to: ixpeering.dl.sourceforge.net.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: Uri: https://sourceforge.net/projects/winscp/rss?path=/WinSCP/6.5.3/.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36 Edg/134.0.3124.85.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: DisableKeepAlive: True.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: ContentType: application/rss+xml; charset=utf-8.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: MaximumRedirection: 2.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: UseBasicParsing: True.
VERBOSE: Invoke-EvergreenRestMethod: Invoke-RestMethod parameter: Method: Default.
VERBOSE: Requested HTTP/1.1 GET with 0-byte payload
VERBOSE: Received HTTP/1.1 response of content type application/rss+xml of unknown size
VERBOSE: Get-SourceForgeRepoRelease: found 2 items.
VERBOSE: Get-SourceForgeRepoRelease: matched: https://sourceforge.net/projects/winscp/files/WinSCP/6.5.3/WinSCP-6.5.3.msi/download.
VERBOSE: Get-SourceForgeRepoRelease: file: /WinSCP/6.5.3/WinSCP-6.5.3.msi
VERBOSE: Get-Architecture: Architecture not found in https://ixpeering.dl.sourceforge.net/project/winscp/WinSCP/6.5.3/WinSCP-6.5.3.msi, defaulting to x86.
VERBOSE: Get-SourceForgeRepoRelease: matched: https://sourceforge.net/projects/winscp/files/WinSCP/6.5.3/WinSCP-6.5.3-Setup.exe/download.
VERBOSE: Get-SourceForgeRepoRelease: file: /WinSCP/6.5.3/WinSCP-6.5.3-Setup.exe
VERBOSE: Get-Architecture: Architecture not found in https://ixpeering.dl.sourceforge.net/project/winscp/WinSCP/6.5.3/WinSCP-6.5.3-Setup.exe, defaulting to x86.

Version      : 6.5.3
Architecture : x86
Type         : msi
Size         : 30486528
Md5          : e0bae7b665d37416892ed6b1555525c6
FileName     : WinSCP-6.5.3.msi
URI          : https://ixpeering.dl.sourceforge.net/project/winscp/WinSCP/6.5.3/WinSCP-6.5.3.msi?viasf=1

Version      : 6.5.3
Architecture : x86
Type         : exe
Size         : 12236344
Md5          : 764804f9ea2ffa1b1548beac4391a4ce
FileName     : WinSCP-6.5.3-Setup.exe
URI          : https://ixpeering.dl.sourceforge.net/project/winscp/WinSCP/6.5.3/WinSCP-6.5.3-Setup.exe?viasf=1

[jafetarcha]

I have tried from home and from office from 2 different customers all on Windows. All ended up with error.

[jafetarcha]

Correction: From home it's possible without errors. So it means that maybe proxy is filtering somehow the requests ? But why it's working for rest apps like Adobe Reader ?

[JimMoyle]

Evergreen just points to the vendors download site, so each download is from a different place. Just because a proxy doesn't filter adobe.com doesn't mean it it won't filter sourceforge.net (which is where WinSCP is hosted).

[aaronparker]

The fact that it's working elsewhere but not your corporate environment, should reasonably indicate a network issue in that environment (which could be filtering etc.), or SourceForge having an issue with the source IP from your corporate environment.

It's also possible that SourceForge is a great big pile of 💩.

[jafetarcha]

Finally I have resolved this issue by replacing the method [System.Net.WebRequest]::Create($Uri) by [System.Net.HttpWebRequest]::Create($Uri) in Resolve-SystemNetWebRequest function + replacing Invoke-RestMethod @params by [System.Net.Http.HttpRequestMessage]::new() method in Invoke-EvergreenRestMethod function

Seems this is able to pass thru FW and proxy.
Anyway you're right about sourceforge. It's unreliable. Even from home sometimes https://sourceforge.net/projects/winscp/best_release.json is working and sometimes it ends up with timeout error.

[aaronparker]

@jafetarcha thanks. I think the way Evegreen requests URLs needs a general update, so I'll take at these approaches when I can.

[aaronparker]

@jafetarcha do you have a full listing of the code you've changed? I'd like to improve these internal functions that make web requests.

[jafetarcha]

Edit them by your need.

Functions.zip

[aaronparker]

Thank-you