Allow HTTP/HTTPS URIs that do not end in .zip

[ndoo]

Malaysia's GTFS feeds neither returns a ''Content-Type: application/zip'' header nor ends in a .zip extension (the API server performs 2 HTTP redirects which then contains the .zip extension).

URLs for testing can be found here: https://developer.data.gov.my/realtime-api/gtfs-static

Thus, the following line of code rejects GTFS API URLs for Malaysia if configured in ''build-config.json''.

OpenTripPlanner/application/src/main/java/org/opentripplanner/datastore/https/HttpsDataSourceRepository.java

Line 68 in 6e8ccff

if (httpsDataSourceMetadata.isZipContentType() || uri.getPath().endsWith(".zip")) {

There are some workarounds;

1. Manually downloading the files with ''wget --trust-server-names'' before building
2. Using the redirect destination URL https://openapi-malaysia-transport.s3.ap-southeast-1.amazonaws.com/mybas-johor/gtfs_mybas.zip which is not guaranteed to be stable

I have some suggestions to make this work:

1. I have written to the Malaysian government to request addition of the Content-Type: application/zip header
2. Add a flag to build-config.json -> transitFeeds -> ? e.g. ignoreFileExtension perhaps
3. Perform URI validation later in the process, after any redirections have taken place

[vpaturet]

We have discussed this issue today during the developer meeting (which you are welcome to attend if you wish).
We do not plan to fix this any time soon due to limited development resources. We recommend that you either use one of the workarounds you suggested, or create a pull request to perform URI validation later in the process.

[ndoo]

Thank you, I've written to the government provider of the GTFS feed to return the correct content-type and if I don't make any progress there I'll dive into the code.

[github-actions]

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 30 days