[IMP] export_bg: Enhance data export functionality with chunking and …#343
Closed
lef-adhoc wants to merge 1 commit intoingadhoc:18.0from
Closed
[IMP] export_bg: Enhance data export functionality with chunking and …#343lef-adhoc wants to merge 1 commit intoingadhoc:18.0from
lef-adhoc wants to merge 1 commit intoingadhoc:18.0from
Conversation
Contributor
|
|
joa-adhoc
reviewed
Jan 19, 2026
joa-adhoc
reviewed
Jan 19, 2026
joa-adhoc
reviewed
Jan 19, 2026
joa-adhoc
reviewed
Jan 19, 2026
lef-adhoc
force-pushed
the
18.0-h-108220-lef2
branch
6 times, most recently
from
5dc9236 to
b8b5e52
Compare
joa-adhoc
reviewed
Jan 21, 2026
joa-adhoc
reviewed
Jan 21, 2026
joa-adhoc
reviewed
Jan 21, 2026
joa-adhoc
reviewed
Jan 21, 2026
There was a problem hiding this comment.
Pull request overview
Este PR mejora significativamente la funcionalidad de exportación en background mediante la implementación de procesamiento por lotes (chunking) y un sistema de encadenamiento de jobs. La mejora permite manejar exportaciones grandes dividiendo los datos en múltiples jobs que se ejecutan secuencialmente.
Changes:
- Implementación de sistema de batching con campos
batch_keyynext_job_idpara vincular jobs relacionados - Refactorización de la API de enqueue:
bg_enqueueahora delega abg_enqueue_recordsque soporta división por threshold - Nueva lógica de exportación por chunks que genera attachments intermedios y los combina al final
- Cancelación automática de jobs subsiguientes cuando un job del batch falla
- Amplia cobertura de tests para las nuevas funcionalidades de batching
Reviewed changes
Copilot reviewed 9 out of 9 changed files in this pull request and generated 16 comments.
Show a summary per file
| File | Description |
|---|---|
| base_bg/models/base_bg.py | Refactoriza bg_enqueue para soportar batching con thresholds, añade bg_enqueue_records y helper is_serializable |
| base_bg/models/bg_job.py | Agrega campos batch_key, next_job_id y cancel_time; implementa encadenamiento de jobs y cancelación en cascada |
| export_bg/models/export_bg_mixin.py | Reemplaza métodos monolíticos de export por sistema de chunks con _export_chunk_bg y _combine_chunks |
| export_bg/static/src/views/list_controller.js | Simplifica llamada al backend usando nuevo método unificado web_export |
| base_bg/views/bg_job_views.xml | Añade campos de batch, nuevo botón para ver jobs del batch, filtros adicionales y remueve readonly de campos |
| base_bg/tests/test_bg_job.py | Añade 12 nuevos tests para batching, linking, cancelación y helpers; elimina 1 test de prioridad |
| base_bg/migrations/18.0.1.0.2/post-migration.py | Script para popular batch_key en jobs existentes con UUIDs únicos |
| base_bg/demo/bg_job_demo.xml | Actualiza datos demo para mostrar batches completos, fallidos y jobs individuales |
| base_bg/manifest.py | Incrementa versión a 18.0.1.0.2 |
lef-adhoc
force-pushed
the
18.0-h-108220-lef2
branch
5 times, most recently
from
edfa1cd to
9a1b0df
Compare
…ectly when using a template
lef-adhoc
force-pushed
the
18.0-h-108220-lef2
branch
from
9a1b0df to
53e4d3a
Compare
Contributor
|
@roboadhoc r+ |
roboadhoc
pushed a commit
that referenced
this pull request
Jan 22, 2026
…ectly when using a template closes #343 Signed-off-by: Joaquín Arroyo (ADV) <joa@adhoc.inc>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
…improved record handling