Skip to content

Commit 25d696a

Browse files
GjjvdBurgGjjvdBurg
committed
CleverCSV Release v0.8.0
* Improve median runtime by ~68% (~52% on average) by: 1) more caching, 2) implementing a heavy function in C. * Redesign computation of consistency measure to a class: `ConsistencyDetector`. * Fix potential memory leak in C code for base abstraction * Fixes to escape sequences in regexes (thanks to @JakobGM!) * Various improvements to code quality * Switch documentation style to [furo](https://pypi.org/project/furo/).
1 parent 2fa357e commit 25d696a

File tree

11 files changed

+46
-18
lines changed

11 files changed

+46
-18
lines changed

‎CHANGELOG.md‎

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,16 @@
11
# Changelog
22

3+
## Version 0.8.0
4+
5+
* Improve median runtime by ~68% (~52% on average) by: 1) more caching, 2)
6+
implementing a heavy function in C.
7+
* Redesign computation of consistency measure to a class:
8+
`ConsistencyDetector`.
9+
* Fix potential memory leak in C code for base abstraction
10+
* Fixes to escape sequences in regexes (thanks to @JakobGM!)
11+
* Various improvements to code quality
12+
* Switch documentation style to [furo](https://pypi.org/project/furo/).
13+
314
## Version 0.7.7
415

516
* Use r-prefix for regex patterns (thanks to @JakobGM!)

‎README.md‎

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -226,8 +226,10 @@ with open("data.csv", "r", newline="") as fp:
226226
rows = list(reader)
227227
```
228228

229-
For **large files**, you can speed up detection by supplying a smaller sample
230-
to the sniffer, for example:
229+
Since CleverCSV v0.8.0, dialect detection is a lot faster than in previous
230+
versions. However, for **large files**, you can speed up detection even more
231+
by supplying a sample of the document to the sniffer instead of the whole
232+
file, for example:
231233
```python
232234
dialect = clevercsv.Sniffer().sniff(fp.read(10000))
233235
```

‎docs/CHANGELOG.rst‎

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,19 @@
22
Changelog
33
=========
44

5+
Version 0.8.0
6+
-------------
7+
8+
9+
* Improve median runtime by ~68% (~52% on average) by: 1) more caching, 2)
10+
implementing a heavy function in C.
11+
* Redesign computation of consistency measure to a class:
12+
``ConsistencyDetector``.
13+
* Fix potential memory leak in C code for base abstraction
14+
* Fixes to escape sequences in regexes (thanks to @JakobGM!)
15+
* Various improvements to code quality
16+
* Switch documentation style to `furo <https://pypi.org/project/furo/>`_.
17+
518
Version 0.7.7
619
-------------
720

‎docs/README.rst‎

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -242,8 +242,10 @@ the Python CSV module:
242242
reader = clevercsv.reader(fp, dialect)
243243
rows = list(reader)
244244
245-
For **large files**\ , you can speed up detection by supplying a smaller sample
246-
to the sniffer, for example:
245+
Since CleverCSV v0.8.0, dialect detection is a lot faster than in previous
246+
versions. However, for **large files**\ , you can speed up detection even more
247+
by supplying a sample of the document to the sniffer instead of the whole
248+
file, for example:
247249

248250
.. code-block:: python
249251

‎man/clevercsv-code.1‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,12 +2,12 @@
22
.\" Title: clevercsv-code
33
.\" Author: G.J.J. van den Burg
44
.\" Generator: Wilderness <https://pypi.org/project/wilderness>
5-
.\" Date: 2023-04-07
5+
.\" Date: 2023-04-08
66
.\" Manual: clevercsv Manual
77
.\" Source: clevercsv 0.8.0
88
.\" Language: English
99
.\"
10-
.TH "CLEVERCSV-CODE" "1" "2023\-04\-07" "Clevercsv 0\&.8\&.0" "Clevercsv Manual"
10+
.TH "CLEVERCSV-CODE" "1" "2023\-04\-08" "Clevercsv 0\&.8\&.0" "Clevercsv Manual"
1111
.\" -----------------------------------------------------------------
1212
.\" * Define some portability stuff
1313
.\" -----------------------------------------------------------------

‎man/clevercsv-detect.1‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,12 +2,12 @@
22
.\" Title: clevercsv-detect
33
.\" Author: G.J.J. van den Burg
44
.\" Generator: Wilderness <https://pypi.org/project/wilderness>
5-
.\" Date: 2023-04-07
5+
.\" Date: 2023-04-08
66
.\" Manual: clevercsv Manual
77
.\" Source: clevercsv 0.8.0
88
.\" Language: English
99
.\"
10-
.TH "CLEVERCSV-DETECT" "1" "2023\-04\-07" "Clevercsv 0\&.8\&.0" "Clevercsv Manual"
10+
.TH "CLEVERCSV-DETECT" "1" "2023\-04\-08" "Clevercsv 0\&.8\&.0" "Clevercsv Manual"
1111
.\" -----------------------------------------------------------------
1212
.\" * Define some portability stuff
1313
.\" -----------------------------------------------------------------

‎man/clevercsv-explore.1‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,12 +2,12 @@
22
.\" Title: clevercsv-explore
33
.\" Author: G.J.J. van den Burg
44
.\" Generator: Wilderness <https://pypi.org/project/wilderness>
5-
.\" Date: 2023-04-07
5+
.\" Date: 2023-04-08
66
.\" Manual: clevercsv Manual
77
.\" Source: clevercsv 0.8.0
88
.\" Language: English
99
.\"
10-
.TH "CLEVERCSV-EXPLORE" "1" "2023\-04\-07" "Clevercsv 0\&.8\&.0" "Clevercsv Manual"
10+
.TH "CLEVERCSV-EXPLORE" "1" "2023\-04\-08" "Clevercsv 0\&.8\&.0" "Clevercsv Manual"
1111
.\" -----------------------------------------------------------------
1212
.\" * Define some portability stuff
1313
.\" -----------------------------------------------------------------

‎man/clevercsv-help.1‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,12 +2,12 @@
22
.\" Title: clevercsv-help
33
.\" Author: G.J.J. van den Burg
44
.\" Generator: Wilderness <https://pypi.org/project/wilderness>
5-
.\" Date: 2023-04-07
5+
.\" Date: 2023-04-08
66
.\" Manual: clevercsv Manual
77
.\" Source: clevercsv 0.8.0
88
.\" Language: English
99
.\"
10-
.TH "CLEVERCSV-HELP" "1" "2023\-04\-07" "Clevercsv 0\&.8\&.0" "Clevercsv Manual"
10+
.TH "CLEVERCSV-HELP" "1" "2023\-04\-08" "Clevercsv 0\&.8\&.0" "Clevercsv Manual"
1111
.\" -----------------------------------------------------------------
1212
.\" * Define some portability stuff
1313
.\" -----------------------------------------------------------------

‎man/clevercsv-standardize.1‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,12 +2,12 @@
22
.\" Title: clevercsv-standardize
33
.\" Author: G.J.J. van den Burg
44
.\" Generator: Wilderness <https://pypi.org/project/wilderness>
5-
.\" Date: 2023-04-07
5+
.\" Date: 2023-04-08
66
.\" Manual: clevercsv Manual
77
.\" Source: clevercsv 0.8.0
88
.\" Language: English
99
.\"
10-
.TH "CLEVERCSV-STANDARDIZE" "1" "2023\-04\-07" "Clevercsv 0\&.8\&.0" "Clevercsv Manual"
10+
.TH "CLEVERCSV-STANDARDIZE" "1" "2023\-04\-08" "Clevercsv 0\&.8\&.0" "Clevercsv Manual"
1111
.\" -----------------------------------------------------------------
1212
.\" * Define some portability stuff
1313
.\" -----------------------------------------------------------------

‎man/clevercsv-view.1‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,12 +2,12 @@
22
.\" Title: clevercsv-view
33
.\" Author: G.J.J. van den Burg
44
.\" Generator: Wilderness <https://pypi.org/project/wilderness>
5-
.\" Date: 2023-04-07
5+
.\" Date: 2023-04-08
66
.\" Manual: clevercsv Manual
77
.\" Source: clevercsv 0.8.0
88
.\" Language: English
99
.\"
10-
.TH "CLEVERCSV-VIEW" "1" "2023\-04\-07" "Clevercsv 0\&.8\&.0" "Clevercsv Manual"
10+
.TH "CLEVERCSV-VIEW" "1" "2023\-04\-08" "Clevercsv 0\&.8\&.0" "Clevercsv Manual"
1111
.\" -----------------------------------------------------------------
1212
.\" * Define some portability stuff
1313
.\" -----------------------------------------------------------------

0 commit comments

Comments
 (0)