CSV Streaming results in incorrect number of rows

[marcesher]

http://www.consumerfinance.gov/hmda/explore#!/as_of_year=2012,2011&action_taken=1&respondent_id=22-3887207&select=as_of_year,count&section=summary

Shows 8,966 records.

Clicking to download the full results as CSV would inconsistently produce a spreadsheet with 5 fewer rows. I observed this behavior over the course of an hour or so. Clicking on "labels and codes" would consistently get me a spreadsheet with the right number of rows, and clicking on "labels" would return 8991 probably 90% of the time. Then, eventually, it simply started working consistently as expected.

The only difference is that "labels" passes the full "$select" statement to include just the fields it needs, and "labels and codes" passes an empty $select. I doubt that matters.

@cndreisbach , can you think of anything in the CSV streaming bits that would cause this behavior? Nothing in the logs indicated a problem when I observed this behavior.

[cndreisbach]

@marcesher I wish I had an answer here. I can't see any reason this would happen.

[marcesher]

Thanks @cndreisbach . We're currently stumped by this one. The behavior we witnessed today was that the first access of the link would result in 5 fewer records, and subsequent accesses would be OK. A real head-scratcher, this one.