Feature/OCR Scan

[TheoAtTechStack]

PR Summary – OCR Integration & Encounter Form

Overview

This PR adds full support for capturing images from the webcam, uploading PDFs or multiple PNG/JPG images, sending them to the OCR service, and populating the Encounter form with normalized FHIR R4 data, including attaching the uploaded files to the encounter.

Key Features

• Capture / Upload

  • Live camera capture (up to 30 images).
  • “Capture Next Image” button for sequential captures.
  • Upload multi-page PDFs or multiple PNG/JPG files.
  • Preview images before sending to OCR.

• Send to OCR

  • Converts captured images/files to actual File objects and sends all at once to the OCR service.
  • Backend proxies files to OCR and returns recognized JSON.

• Encounter Form Population

  • Automatically fills form fields (practitioners, organizations, medications, etc.).
  • Uploaded images/PDFs are attached as files to the encounter (attachments array).

• Preview & Edit

  • Navigate captured pages/images.
  • Edit OCR results before final submission.

Data Normalization

Ensures all resources conform to FHIR R4 structure:

• Flattened text fields.
• ISO 8601 date strings.
• Arrays for addresses.
• Names properly split for practitioners.

Benefits

• Simplifies digitization of medical records.
• Reduces manual entry and errors.
• Supports multiple images, PDFs, and live camera capture.
• Uploaded files are preserved as attachments in the encounter.
• Fully compatible with backend and FHIR R4 expectations.

PR.PDF.scan.DEMO.1.mov

[TheoAtTechStack]

Hey @AnalogJ ! I opened the PR with the OCR scan flow. It's in draft until further feedback. Let me know if you have any notes or takes on this one, thanks!

[socket-security]

Warning

Review the following alerts detected in dependencies.

According to your organization's Security Policy, it is recommended to resolve "Warn" alerts. Learn more about Socket for GitHub.

Action	Severity	Alert  (click "▶" to expand/collapse)
Warn		npm/elliptic@6.5.0 has a Critical CVE. CVE: GHSA-vjh7-7g9h-fjfh Elliptic's private key extraction in ECDSA upon signing a malformed input (e.g. a string) (CRITICAL) Affected versions: < 6.6.1 Patched version: 6.6.1 From: frontend/yarn.lock → npm/elliptic@6.5.0 ℹ Read more on: This package | This alert | What is a critical CVE? Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev. Suggestion: Remove or replace dependencies that include known critical CVEs. Consumers can use dependency overrides or npm audit fix --force to remove vulnerable dependencies. Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore npm/elliptic@6.5.0. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.
Warn		npm/webpack@5.74.0 has a Critical CVE. CVE: GHSA-hc6q-2mpp-qw7j Cross-realm object access in Webpack 5 (CRITICAL) Affected versions: >= 5.0.0 < 5.76.0 Patched version: 5.76.0 From: frontend/yarn.lock → npm/webpack@5.74.0 ℹ Read more on: This package | This alert | What is a critical CVE? Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev. Suggestion: Remove or replace dependencies that include known critical CVEs. Consumers can use dependency overrides or npm audit fix --force to remove vulnerable dependencies. Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore npm/webpack@5.74.0. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.
Warn		npm/pdf-lib@1.17.1 has Obfuscated code. Confidence: 0.90 Location: Package overview From: frontend/package.json → npm/pdf-lib@1.17.1 ℹ Read more on: This package | This alert | What is obfuscated code? Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev. Suggestion: Packages should not obfuscate their code. Consider not using packages with obfuscated code. Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore npm/pdf-lib@1.17.1. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.
Warn		npm/safer-buffer@2.1.2 has Obfuscated code. Confidence: 0.94 Location: Package overview From: frontend/yarn.lock → npm/safer-buffer@2.1.2 ℹ Read more on: This package | This alert | What is obfuscated code? Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev. Suggestion: Packages should not obfuscate their code. Consider not using packages with obfuscated code. Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore npm/safer-buffer@2.1.2. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.
Warn		npm/webcrypto-liner@1.4.0 has an HTTP dependency. Dependency: elliptic@https://github.com/mahrud/elliptic Location: Package overview From: frontend/package.json → npm/webcrypto-liner@1.4.0 ℹ Read more on: This package | This alert | What are http dependencies? Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev. Suggestion: Publish the HTTP URL dependency to npm or a private package repository and consume it from there. Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore npm/webcrypto-liner@1.4.0. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

View full report

[socket-security]

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff	Package	Supply Chain Security	Vulnerability	Quality	Maintenance	License
	npm/​webpack@​5.74.0
	npm/​elliptic@​6.5.0
	npm/​esbuild-darwin-64@​0.15.5
	npm/​esbuild-android-arm64@​0.15.5
	npm/​esbuild-darwin-arm64@​0.15.5
	npm/​esbuild-freebsd-64@​0.15.5
	npm/​esbuild-freebsd-arm64@​0.15.5
	npm/​esbuild-linux-32@​0.15.5
	npm/​esbuild-linux-64@​0.15.5
	npm/​esbuild-linux-arm@​0.15.5
	npm/​has@​1.0.3
	npm/​side-channel@​1.0.4
	npm/​is-unicode-supported@​0.1.0
	npm/​gopd@​1.0.1
	npm/​is-interactive@​1.0.0
	npm/​has-property-descriptors@​1.0.0
	npm/​has-tostringtag@​1.0.0
	npm/​which-collection@​1.0.1
	npm/​isarray@​1.0.0
	npm/​is-weakmap@​2.0.1
	npm/​functions-have-names@​1.2.3
	npm/​es-get-iterator@​1.1.3
	npm/​object-keys@​1.1.1
	npm/​object-is@​1.1.5
	npm/​deep-equal@​1.1.1 ⏵ 2.2.1			+8
	npm/​is-date-object@​1.0.5
	npm/​has-symbols@​1.0.3
	npm/​is-shared-array-buffer@​1.0.2
	npm/​is-bigint@​1.0.4
	npm/​is-weakset@​2.0.2
	npm/​internal-slot@​1.0.5
	npm/​is-arguments@​1.1.1
	npm/​regexp.prototype.flags@​1.5.0
See 297 more rows in the dashboard

View full report