Skip to content

[FEATURE]: JSON Validation Checks #595

@ghanse

Description

@ghanse

Is there an existing issue for this?

  • I have searched the existing issues

Problem statement

Validating ingested JSON is a common requirement for many ETL scenarios. Deserialization and other downstream processing are often broken when JSON is malformed or missing expected fields

Proposed Solution

Add several built-in check functions to validate JSON strings:

  • is_valid_json to detect the validity of a JSON string
  • has_json_keys to detect if 1 or more keys are present in a JSON string
  • has_json_schema to detect if a JSON string matches an expected Spark DDL schema

Additional Context

No response

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions