Skip to content

Tags: databrickslabs/dataframe-rules-engine

Tags

2_12-0.2.0

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Enable streaming (#24)

* enable streaming

* scaffolding for simpleExpr validation

* completed refactor -- tests outstanding

* refactor and enablement complete

* updated readme

* added implicit boolean

* added filter for summary report

* Update ValidatorTestSuite (#19)

* Update Validator tests with API changes.

* Add tests for implicit and explicit expression rules.

* imported outstanding spark sql functions

* Add test suite for Rules class.

* Add tests for RuleSet class.

* Add test for complex expressions on aggregates.

* Fix isGrouped bug when groupBys array is empty by default or explicitly set.

* Fix overloaded add function that merges 2 RuleSets.

* Add ignoreCase and invertMatch to ValidateStrings and ValidateNumerics rule types.

* Update documentation with latest features in categorical Rules.

Co-authored-by: Daniel Tomes [GeekSheikh] <10840635+geeksheikh@users.noreply.github.com>

* Update sbt (#23)

* simple update to build sbt

* Add scoverage.

Co-authored-by: Will Girten <will.girten@databricks.com>

* removed unused imports

* Accept expanded sequence of Rules to RuleSet Class.

* cleaning up (#30)

* cleaning up

* removed dependencies from assembly

* Fix whitespaces and special characters in Rule Names (#25)

* Parse white spaces and special characters in failure report.

* Update variable name with more meaningful name.

* Add  method to remove whitespace and special characters from Rule names.

* Simplify ruleName public accessor.

* Change special character replacement to underscores.

* Update warning messages and assign private ruleName only once.

* Update demo notebook (#33)

* Update demo notebook with examples of latest features added.

* added scala demo example

Co-authored-by: Daniel Tomes [GeekSheikh] <10840635+geeksheikh@users.noreply.github.com>

* implemented new inclusive boundaries option (#32)

* implemented new inclusive boundaries option

* enhanced logic for upper and lower inclusivity

* readme updated

* Update validation logic for Bounds class. Add test case for inclusive boundary rules. (#35)

Co-authored-by: Will Girten <47335283+goodwillpunning@users.noreply.github.com>

Co-authored-by: Will Girten <47335283+goodwillpunning@users.noreply.github.com>
Co-authored-by: Will Girten <will.girten@databricks.com>

2_12-0.1.1

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
scala 2_12 and spark 3 support added (#11)

* scala 2_12 and spark 3 support added

* correct namespace and rev version

* updated scalatest namespace

2_11-0.1.1

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
revving version

adding dot release to apply hotfix

2_11-0.1

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Update README.md