Review API data import architecture for ERP integration #194
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Phase 1 - Database Schema: - Add external_id, external_source, synced_at, sync_hash columns to jobs, parts, operations, resources, cells - Add composite unique indexes for upsert by external_id - Add soft delete columns (deleted_at, deleted_by) - Add sync_imports table for tracking import batches Phase 2 - REST API Sync Endpoints: - Create new api-resources endpoint with full CRUD + sync - Add PUT /sync and POST /bulk-sync to api-jobs (with nested parts/operations) - Add PUT /sync and POST /bulk-sync to api-parts - Add PUT /sync and POST /bulk-sync to api-operations - Add PUT /sync and POST /bulk-sync to api-cells Features: - Upsert by external_id for ERP integration - Bulk sync supports up to 1000 records per request - Lookup by external_id or name for related entities - Change detection via sync_hash - Import logging to sync_imports table
- Create DataImport.tsx with 6-step import wizard (select, upload, map, preview, import, complete) - Add Papa Parse CSV parsing with auto field mapping - Add validation preview with error highlighting - Add downloadable CSV templates for each entity type (jobs, parts, operations, cells, resources) - Support upsert via external_id for ERP integration - Add chunked import processing (100 records per batch) - Add route /admin/data-import and navigation link under Integrations - Add i18n translations for all import UI strings This complements the REST API sync endpoints for batch data imports.
- Fix generateSyncHash to use SHA-256 instead of MD5 (MD5 not supported by Web Crypto API) - Truncate hash to 32 chars for brevity (same length as MD5 output) - Add missing i18n translations for DataImport component
- Add "ERP Sync" and "Resources" tags - Document sync endpoints: PUT /sync (single) and POST /bulk-sync (batch) - Add endpoints for jobs, parts, operations, resources, and cells - Add schema definitions for all sync request/response types - Add examples for nested sync (job with parts and operations) - Document BulkSyncResponse with created/updated/errors counts
- Add new "ERP Integration" tab to Help.tsx with: - Two-way sync architecture overview - API sync endpoint examples with code samples - CSV import step-by-step guide - Field reference tables - Best practices - Create markdown documentation in docs/: - docs/ERP_INTEGRATION.md - Architecture overview - docs/API_SYNC.md - Detailed API endpoint reference - docs/CSV_IMPORT.md - CSV import field reference and templates
SheetMetalConnect
deleted the
claude/review-api-import-architecture-01Y1vZZpMemBw56eLWYXznZi
branch
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.