Remove Broadband Service from SGID

[jacobdadams]

Summary

• Internal Dataset Name: Utilities.BroadbandService
• External Dataset Name: Utah Broadband Service
• ArcGIS Online Url: https://utah.maps.arcgis.com/home/item.html?id=2b479a30791c445eb135e05acf77dbcc

Broadband Service is going to be replaced by Broadband Service Areas (#432). Deprecating this service layer will allow us to retire the databases used for updating it and the current residential broadband map.

Migration Guide

Users should switch over to the new Utah Broadband Service Areas layer, which will be available in all the usual SGID places.

The new layer is greatly simplified by using the H3 level 8 hex IDs available through the FCC data. See #432 for more information about how the new layer is created.

The new layer will not have mobile wireless coverage due to how the FCC provides mobile wireless coverage data (they don't include provider information).

Action items

1. Assign a person who should complete the task by replacing name with their github @name.
2. Check [x] the box when the task is completed and add the date of completion.
3. Strike out all items that do not apply.

Soft Delete

The purpose of the soft delete is to ensure that all of our users and applications have gracefully migrated off of the dataset. Soft deletes will remain in effect for 14 days. During this time, we will have the ability to restore the dataset to its original SGID offering(s). After these 14 days, the item is then ready for a hard delete.

Note: If this dataset is being replaced, then wait until the new data is publicly available before completing these steps:

• Append "(Mature Support)" to the end of the item title in the SGID.META.AGOLItems table (@jacobdadams completed: 2025/11/21)
• Remove all tags other than "Deprecated" in the SDE metadata (@jacobdadams completed: 2025/11/21)
• Add note to SDE description noting when layer will be deleted and any replacement layer (@jacobdadams completed: 2025/11/21)
• Update the SGID Index row as deprecated by pasting the related Porter issue URL in the "porterUrl" field and setting the value of the "indexStatus" field as "removed". Also update the "refreshCycle" field (@jacobdadams completed: 2025/11/21)
• Change Authoritative field to d in SGID.META.AGOLItems to automatically set the Deprecated AGOL flag. Allow the d to persist through one run of Auditor - currently, Auditor runs daily at 5:00am (@jacobdadams completed: 2025/11/21)
  • After at least one successful run of Auditor:
    • Remove the row from the SGID.META.AGOLItems table. This will trigger the removal of this item in Open SGID (@jacobdadams completed: 2025/11/25)
    • Unshare the item from its SGID group, which will remove it from the SGID on ArcGIS (@jacobdadams completed: 2025/11/25)
• Check if this layer in the base maps. If so, work with Zach to develop a path forward before you proceed with a Hard Delete (@jacobdadams completed: 2025/12/09).

Hard Delete

Target Date: 2025/12/08

Hard deletes are final. It is recommended to complete the soft delete process before moving on to these steps. If you decide to skip the soft delete, note that you will need to incorporate some of those steps here.

• Manually remove data from the Internal SGID (@stdavis completed: 2025/12/15)
  • Deprecated database layers should be backed up on Google Drive > AGRC Projects > SGID > deprecated layers > internal_db_sgid_layers (@jacobdadams completed: 2025/11/21).
• Remove ArcGIS Online item: (@jacobdadams completed: 2025/00/00)
  • Set sharing to private (@jacobdadams, completed: 2025/12/09)
  • Manually delete the AGOL item
    - -OR-
    - Unshare by changing the AGOL_ITEM_ID field in SGID.META.AGOLItems to something other than an Item ID and manually changing the sharing settings (remove the item from all SGID groups, remove Public sharing),
    - -OR-
    - Shelve the data by copying the row from SGID.META.AGOLItems to the AGOLItems_shelved table in AGOL and changing the AGOL_ITEM_ID field in SGID.META.AGOLItems to shelved or some other note.
    - Deprecated AGOL items can be backed up on Google Drive > AGRC Projects > SGID > deprecated layers > agol_sgid_layers.
    - [ ] Remove Farm from AGOL connection (name, completed: 2025/00/00)
• Update the SGID Index fields: "arcGisOnline", "openSgid", "openSgidTableName" (@jacobdadams completed: 2025/12/09)
• Update relevant gis.utah.gov product pages (including downloadMetadata.ts and public/_redirects) (@jacobdadams completed: 2025/12/09)
• [ ] Update SGID.META.AGOLItems table (@jacobdadams completed: 2025/00/00)
• Delete Google Drive data (@stdavis, completed: 2025/12/15)
• Remove row from SGID.META.ChangeDetection (@stdavis, completed: 2025/12/15)
• Remove data from forklift hashing and receiving (@stdavis, completed: 2025/00/00)
• Remove row from data/hashed/changedetection.gdb/TableHashes (@stdavis, completed: 2025/12/15)
  - [ ] Remove data from record series with archives (@eneemann, completed: 2025/00/00)
• [ ] Delete MS SQL databases (UBBMap, FiberVerification (sp?)) (@MichaelAGRC completed: 2025/00/00)
  • @MichaelAGRC, coordinate with @jacobdadams and @stdavis on this to make sure the broadband app is down first.

🤖 Automation validation

1. Assign yourself or someone to check the item by replacing name with their github @name.
2. Check [x] the box and add the date of verification 2025/01/01 when the task is verified.
3. Strike out all items that do not apply.

• Remove data from Open SGID (@stdavis on 2025/12/22)
• sgid-index (@stdavis on 2025/12/22)
• Auditor sets appropriate Deprecated information (@jacobdadams on 2025/11/22)

Are there service dependencies

• Are clients querying this data with the UGRC API search endpoint? This dashboard may be helpful.
  - [ ] Notify Don Jackson (don.jackson1 at motorolasolutions.com) if the data is in the Next-Generation 911 Motorola Aware Map? (@mhchou on 2025/00/00)
• Does any other application depend on this data?
  • Utah Residential Broadband Map- New map has been created that points to the new dataset.
  • locate.utah.gov- gets its data directly from UBBMAP db, not Internal, so we can delete the SDE layer.

Notification

• X (@steveoh)

Group Task Assignments

1. Check [x] the box when you have assigned all the tasks relevant to your group.

• Data Team (@eneemann)
• Dev Team (@steveoh)
• Cadastre Team (@rkelson)

[stdavis]

Yes, please don't remove the UBBMAP database until the residential broadband map has been deprecated. It depends on that DB.

[agrc-conductor]

conductor results for tasks - 433

check	status
@jacobdadams has completed 0 out of 15 tasks	⛔
@eneemann has completed 0 out of 2 tasks	⛔
@MichaelAGRC has completed 0 out of 1 tasks	⛔
@steveoh has completed 0 out of 3 tasks	⛔
@mhchou has completed 0 out of 1 tasks	⛔
@rkelson has completed 0 out of 1 tasks	⛔

[agrc-conductor]

conductor results for Utilities.BroadbandService

check	status
internal sgid	⛔
meta table	⛔
open sgid	⛔
open data	⛔
arcgis online	⛔
SGID Index
- porter issue link	⛔

[agrc-conductor]

conductor results for tasks - 433

check	status
@jacobdadams has completed 0 out of 15 tasks	⛔
@eneemann has completed 0 out of 2 tasks	⛔
@MichaelAGRC has completed 0 out of 1 tasks	⛔
@steveoh has completed 0 out of 3 tasks	⛔
@mhchou has completed 0 out of 1 tasks	⛔
@rkelson has completed 0 out of 1 tasks	⛔

[agrc-conductor]

conductor results for Utilities.BroadbandService

check	status
internal sgid	⛔
meta table	⛔
open sgid	⛔
open data	⛔
arcgis online	⛔
SGID Index
- porter issue link	⛔

[stdavis]

@jacobdadams I wonder if this issue should be labeled as "blocked" until the current residential map is deprecated?

[jacobdadams]

Good idea, I'll add that tag.

[jacobdadams]

@stdavis , now that the new app is up, are there any other steps that need to happen before we can unblock this?

[stdavis]

The only concern that I have is that locate.utah.gov still depends on UBBWEB. If that database is not involved with this issue, then I'm good with it proceeding.

[jacobdadams]

k, I'm removing the step of removing UBBWEB from this issue and will open a separate issue for that.