Skip to content

Switch from readr to vroom #280

@peterdesmet

Description

@peterdesmet

Readr uses vroom under the hood, so why switch? It has three direct advantages:

  1. support for big integers (use vroom::col_big_integer() for integers to avoid overflow? #212)
  2. read multiple files directly (rather than calling read function multiple times)

Longer term (especially with Data Package v2 fieldMatch) I think it will be useful to be closer to the vroom dependency.

Reading

  • Use vroom::vroom() instead of readr::read_delim()

  • Organize arguments vs vroom() not read_delim()

  • Don't call vroom::vroom() for each path, but pass it directly

  • Run tests

  • Update documentation

  • Investigate if this applies to vroom (in table-schema.Rmd):

    It relies on readr::read_delim() instead, which interprets line terminator LF and CRLF automatically and does not support CR (used by Classic Mac OS, final release 2001).

  • Investigate if this applies to vroom (in table-schema.Rmd):

    since readr::write_csv() used by write_package() formats those to ISO8601, which is considered the default.

Writing

  • Use vroom::vroom_write()
  • Investigate if this applies to vroom:

    Output is written as UTF-8

  • Run tests
  • Update documentation

Encoding

  • Can we get rid of readr::guess_encoding()?
  • Update in data-resource.Rmd

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions