-
Notifications
You must be signed in to change notification settings - Fork 58
Open
Labels
bugSomething isn't workingSomething isn't working
Description
ISSUE
While maybe not the best practice, databricks does allow columns to have "." in the name. When doing a resample with interporlate, this results in a cannot resolve column name error
How to reproduce
resample_tsdf = base_tsdf.resample(freq="30 seconds", func="mean").interpolate(method="ffill")An error is produced
AnalysisException: Cannot resolve column name "Bundler.Status.CurMachSpeed" among (site, line, ts, Bundler.Status.CurMachSpeed, Bundler.Status.MachSpeed, agg_key); did you mean to quote the Bundler.Status.CurMachSpeed column?
Workaround
Rename the columns before resampling / interpolate
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working
