Factor in story/story points no longer being default

Author: fivetran-avinash

CHANGELOG.md

@@ -1,17 +1,19 @@
 # dbt_jira v1.7.0
 
-[PR #](https://github.com/fivetran/dbt_jira/pull/) includes the following updates:
+[PR #175](https://github.com/fivetran/dbt_jira/pull/175) includes the following updates:
 
 ## Schema/Data Change (--full-refresh required after upgrading)
 **3 total changes • 3 possible breaking changes**
 
 | Data Model(s) | Change type | Old | New | Notes |
 | ---------- | ----------- | -------- | -------- | ----- |
-| `jira__daily_issue_field_history`, `jira__issue_enhanced` | Removed default columns (**Breaking Change**) | `story_points` and `story_point_estimate` included by default | Columns only included when added to `var('issue_field_history_columns')` | These fields are Scrum-specific custom fields not universally used. Add the relevant fields to the `issue_field_history_columns` variable to retain them. |
-| `jira__sprint_enhanced` | Removed default columns (**Breaking Change**) | `story_points_committed`, `story_points_end`, `story_points_completed`, `story_point_estimate_committed`, `story_point_estimate_end`, and `story_point_estimate_completed` included by default | Columns only included when `'story points'` and/or `'story point estimate'` are added to `var('issue_field_history_columns')` | These metrics depend on `story_points`/`story_point_estimate` being tracked in field history. Add the relevant fields to the `issue_field_history_columns` variable to retain them. |
+| `jira__daily_issue_field_history` <br> `jira__daily_sprint_issue_history` <br> `jira__issue_enhanced` | Removed default columns (**Breaking Change**) | `story_points` and `story_point_estimate` included by default | Columns only included when added to `var('issue_field_history_columns')` | These fields are Scrum-specific custom fields not universally used. Add the relevant fields to the `issue_field_history_columns` variable to retain them. |
+| `jira__sprint_enhanced` | Removed default columns (**Breaking Change**) | `story_points_committed`, `story_points_end`, `story_points_completed`, `story_point_estimate_committed`, `story_point_estimate_end`, and `story_point_estimate_completed` included by default | Columns only included when `story points` and/or `story point estimate` are added to `var('issue_field_history_columns')` | These metrics depend on `story_points`/`story_point_estimate` being tracked in field history. Add the relevant fields to the `issue_field_history_columns` variable to retain them. |
+| `jira__daily_sprint_issue_history` <br> `jira__sprint_enhanced` | Column type change | `story_points` and `story_point_estimate` cast as `float` | Cast as `numeric` | Improves precision for fractional story point values. |
 
 ## Documentation
-- Updated model descriptions for `jira__daily_issue_field_history`, `jira__timestamp_issue_field_history`, `jira__daily_sprint_issue_history`, and `jira__issue_enhanced` to remove static documentation for `story_points`, `story_point_estimate`, and `team` columns. Removed story point column documentation from `jira__sprint_enhanced` as these columns are dynamic and only present when added to `var('issue_field_history_columns')`.
+- Updates model descriptions to remove static documentation for `story_points`, `story_point_estimate`, and `team` columns. Removes story point-related column documentation from `jira__sprint_enhanced` as these columns are dynamic and only present when added to `var('issue_field_history_columns')`. 
+  - To retain story point data, add `story points` and/or `story point estimate` to the `issue_field_history_columns` variable in your `dbt_project.yml` ([See the README for details](https://github.com/fivetran/dbt_jira?tab=readme-ov-file#define-daily-issue-field-history-columns)). Quickstart users can add these fields in the Issue Field History Columns setting. 
 
 # dbt_jira v1.6.0
 

macros/split_sprint_ids.sql

@@ -17,10 +17,10 @@
         daily_issue_field_history.status,
         {{ "daily_issue_field_history.team," if using_teams }}
         {% if include_story_points %}
-        cast(daily_issue_field_history.story_points as {{ dbt.type_float() }}) as story_points,
+        cast(daily_issue_field_history.story_points as {{ dbt.type_numeric() }}) as story_points,
         {% endif %}
         {% if include_story_point_estimate %}
-        cast(daily_issue_field_history.story_point_estimate as {{ dbt.type_float() }}) as story_point_estimate,
+        cast(daily_issue_field_history.story_point_estimate as {{ dbt.type_numeric() }}) as story_point_estimate,
         {% endif %}
         sprints as sprint_id
 
@@ -42,10 +42,10 @@
         daily_issue_field_history.status,
         {{ "daily_issue_field_history.team," if using_teams }}
         {% if include_story_points %}
-        cast(daily_issue_field_history.story_points as {{ dbt.type_float() }}) as story_points,
+        cast(daily_issue_field_history.story_points as {{ dbt.type_numeric() }}) as story_points,
         {% endif %}
         {% if include_story_point_estimate %}
-        cast(daily_issue_field_history.story_point_estimate as {{ dbt.type_float() }}) as story_point_estimate,
+        cast(daily_issue_field_history.story_point_estimate as {{ dbt.type_numeric() }}) as story_point_estimate,
         {% endif %}
         sprints.value as sprint_id
 
@@ -67,10 +67,10 @@
         unnest_sprint_id_array.status,
         {{ "unnest_sprint_id_array.team," if using_teams }}
         {% if include_story_points %}
-        unnest_sprint_id_array.story_points,
+        cast(unnest_sprint_id_array.story_points as {{ dbt.type_numeric() }}) as story_points,
         {% endif %}
         {% if include_story_point_estimate %}
-        unnest_sprint_id_array.story_point_estimate,
+        cast(unnest_sprint_id_array.story_point_estimate as {{ dbt.type_numeric() }}) as story_point_estimate,
         {% endif %}
         cast(sprint_id as {{ dbt.type_string() }}) as sprint_id
     from (
@@ -82,10 +82,10 @@
             daily_issue_field_history.status,
             {{ "daily_issue_field_history.team," if using_teams }}
             {% if include_story_points %}
-            cast(daily_issue_field_history.story_points as {{ dbt.type_float() }}) as story_points,
+            cast(daily_issue_field_history.story_points as {{ dbt.type_numeric() }}) as story_points,
             {% endif %}
             {% if include_story_point_estimate %}
-            cast(daily_issue_field_history.story_point_estimate as {{ dbt.type_float() }}) as story_point_estimate,
+            cast(daily_issue_field_history.story_point_estimate as {{ dbt.type_numeric() }}) as story_point_estimate,
             {% endif %}
             split_to_array(sprint, ', ') as super_sprint_ids
 
@@ -106,10 +106,10 @@
         daily_issue_field_history.status,
         {{ "daily_issue_field_history.team," if using_teams }}
         {% if include_story_points %}
-        cast(daily_issue_field_history.story_points as {{ dbt.type_float() }}) as story_points,
+        cast(daily_issue_field_history.story_points as {{ dbt.type_numeric() }}) as story_points,
         {% endif %}
         {% if include_story_point_estimate %}
-        cast(daily_issue_field_history.story_point_estimate as {{ dbt.type_float() }}) as story_point_estimate,
+        cast(daily_issue_field_history.story_point_estimate as {{ dbt.type_numeric() }}) as story_point_estimate,
         {% endif %}
         sprints as sprint_id
 
@@ -132,10 +132,10 @@
         daily_issue_field_history.status,
         {{ "daily_issue_field_history.team," if using_teams }}
         {% if include_story_points %}
-        cast(daily_issue_field_history.story_points as {{ dbt.type_float() }}) as story_points,
+        cast(daily_issue_field_history.story_points as {{ dbt.type_numeric() }}) as story_points,
         {% endif %}
         {% if include_story_point_estimate %}
-        cast(daily_issue_field_history.story_point_estimate as {{ dbt.type_float() }}) as story_point_estimate,
+        cast(daily_issue_field_history.story_point_estimate as {{ dbt.type_numeric() }}) as story_point_estimate,
         {% endif %}
         sprints as sprint_id
     from daily_issue_field_history

models/jira.yml

@@ -3,6 +3,8 @@ version: 2
 models:
   - name: jira__daily_issue_field_history
     description: >
+      Each record represents a daily snapshot of an issue's field values (status and sprint by default,
+      plus any fields added to the `issue_field_history_columns` variable).
       Each issue will have a record for every day in which it was open and/or being updated.
       For currently open issues, the latest date will be the current date, and for closed issues,
       this will be the last time the issue was resolved OR updated in any way (plus a configurable buffer afterward,
@@ -113,7 +115,7 @@ models:
       - name: time_spent_seconds
         description: The time that was spent working on this issue, in seconds.
       - name: status
-        description: The name of the status that an issue has on a given day. 
+        description: The name of the status that an issue has on a given day.
       - name: is_sprint_active
         description: Boolean indicating if the sprint is currently active (started but not completed).
       - name: is_sprint_completed

models/jira__sprint_enhanced.sql

@@ -58,8 +58,12 @@ sprint_start_metrics as (
         source_relation,
         sprint_id,
         {{ "team," if using_teams }}
-        {{ "sum(case when story_points is null then 0 else story_points end) as story_points_committed," if include_story_points }}
-        {{ "sum(case when story_point_estimate is null then 0 else story_point_estimate end) as story_point_estimate_committed," if include_story_point_estimate }}
+        {% if include_story_points %}
+        sum(case when story_points is null then 0 else story_points end) as story_points_committed,
+        {% endif %}
+        {% if include_story_point_estimate %}
+        sum(case when story_point_estimate is null then 0 else story_point_estimate end) as story_point_estimate_committed,
+        {% endif %}
         count(distinct issue_id) as issues_committed
     from daily_sprint_issue_history
     -- to capture both sprints that have started or will start in the future
@@ -73,15 +77,15 @@ sprint_end_metrics as (
 
     select
         source_relation,
-        sprint_id,
-        {{ "team," if using_teams }}
+        sprint_id
+        {{ ", team" if using_teams }}
         {% if include_story_points %}
-        sum(case when story_points is null then 0 else story_points end) as story_points_end,
-        sum(case when is_issue_resolved_in_sprint then story_points else 0 end) as story_points_completed{{ "," if include_story_point_estimate }}
+        , sum(case when story_points is null then 0 else story_points end) as story_points_end
+        , sum(case when is_issue_resolved_in_sprint then story_points else 0 end) as story_points_completed
         {% endif %}
         {% if include_story_point_estimate %}
-        sum(case when story_point_estimate is null then 0 else story_point_estimate end) as story_point_estimate_end,
-        sum(case when is_issue_resolved_in_sprint then story_point_estimate else 0 end) as story_point_estimate_completed
+        , sum(case when story_point_estimate is null then 0 else story_point_estimate end) as story_point_estimate_end
+        , sum(case when is_issue_resolved_in_sprint then story_point_estimate else 0 end) as story_point_estimate_completed
         {% endif %}
     from daily_sprint_issue_history
     where date_day = cast(sprint_ended_at as date)
@@ -99,12 +103,16 @@ final as (
         sprint_metrics_grouped.sprint_ended_at,
         sprint_metrics_grouped.sprint_completed_at,
         sprint_metrics_grouped.board_id,
-        {{ "sprint_start_metrics.story_points_committed," if include_story_points }}
-        {{ "sprint_start_metrics.story_point_estimate_committed," if include_story_point_estimate }}
-        {{ "sprint_end_metrics.story_points_end," if include_story_points }}
-        {{ "sprint_end_metrics.story_point_estimate_end," if include_story_point_estimate }}
-        {{ "sprint_end_metrics.story_points_completed," if include_story_points }}
-        {{ "sprint_end_metrics.story_point_estimate_completed," if include_story_point_estimate }}
+        {% if include_story_points %}
+        sprint_start_metrics.story_points_committed,
+        sprint_end_metrics.story_points_end,
+        sprint_end_metrics.story_points_completed,
+        {% endif %}
+        {% if include_story_point_estimate %}
+        sprint_start_metrics.story_point_estimate_committed,
+        sprint_end_metrics.story_point_estimate_end,
+        sprint_end_metrics.story_point_estimate_completed,
+        {% endif %}
         sprint_issue_metrics.sprint_assignees,
         sprint_issue_metrics.sprint_issues,
         sprint_start_metrics.issues_committed,