Skip to content

[IMP] account_statement_import_sheet_file_bg: Filter empty rows by date column#354

Closed
rov-adhoc wants to merge 1 commit intoingadhoc:18.0from
adhoc-dev:18.0-h-108505-rov
Closed

[IMP] account_statement_import_sheet_file_bg: Filter empty rows by date column#354
rov-adhoc wants to merge 1 commit intoingadhoc:18.0from
adhoc-dev:18.0-h-108505-rov

Conversation

@rov-adhoc
Copy link
Copy Markdown
Contributor

Stop processing Excel rows when timestamp column is empty

Previously, the import would process all rows in the Excel file until the end, including thousands of empty rows. This caused performance issues and unnecessary data processing.

Now the system:

  • Identifies the date/timestamp column from sheet_mapping_id configuration
  • Only processes rows where the timestamp column has a value
  • Stops processing at the first empty timestamp row

This prevents importing empty rows and improves performance when handling Excel files with many empty rows at the end.

Copilot AI review requested due to automatic review settings January 22, 2026 19:24
@roboadhoc
Copy link
Copy Markdown
Contributor

Pull request status dashboard

Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Este PR mejora el rendimiento del módulo account_statement_import_sheet_file_bg al filtrar filas vacías en archivos Excel basándose en la columna de fecha/timestamp. Anteriormente, se procesaban todas las filas del archivo, incluyendo miles de filas vacías al final, causando problemas de rendimiento.

Changes:

  • Se agregó filtrado de filas por columna de fecha en el método split_base64_excel
  • Se implementaron dos nuevos métodos auxiliares: _get_date_column_index y _filter_rows_with_date
  • El procesamiento ahora se detiene al encontrar la primera fila con timestamp vacío

start_row_index = end_row_index
return output_base64_list

def _get_date_column_index(self, header_rows):
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pasar a pase header

…te column

Stop processing Excel rows when timestamp column is empty

Previously, the import would process all rows in the Excel file until
the end, including thousands of empty rows. This caused performance
issues and unnecessary data processing.

Now the system:
- Identifies the date/timestamp column from sheet_mapping_id configuration
- Only processes rows where the timestamp column has a value
- Stops processing at the first empty timestamp row

This prevents importing empty rows and improves performance when
handling Excel files with many empty rows at the end.
@maq-adhoc
Copy link
Copy Markdown
Contributor

@roboadhoc r+

roboadhoc pushed a commit that referenced this pull request Jan 23, 2026
…te column

Stop processing Excel rows when timestamp column is empty

Previously, the import would process all rows in the Excel file until
the end, including thousands of empty rows. This caused performance
issues and unnecessary data processing.

Now the system:
- Identifies the date/timestamp column from sheet_mapping_id configuration
- Only processes rows where the timestamp column has a value
- Stops processing at the first empty timestamp row

This prevents importing empty rows and improves performance when
handling Excel files with many empty rows at the end.

closes #354

Signed-off-by: Filoquin adhoc <maq@adhoc.com.ar>
@roboadhoc roboadhoc closed this Jan 23, 2026
@roboadhoc roboadhoc deleted the 18.0-h-108505-rov branch January 23, 2026 15:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants