Inconsistent data serialization for images in MessageSerializer

[xprojects-de]

If an image is attached to a UserPrompt using Image::fromFile($localPath), stored in a MariaDB via the MessageSerializer, and subsequently deserialized, an "invalid data format" error occurs.

If you modify the MessageSerializer as follows, everything works smoothly.

    public function denormalize(mixed $data, string $type, ?string $format = null, array $context = []): mixed
    {
        ... 

        $message = match ($dataType) {
            SystemMessage::class => new SystemMessage($content),
            AssistantMessage::class => new AssistantMessage(...self::denormalizeAssistantParts($data)),
            UserMessage::class => new UserMessage(...array_map(
                static fn(array $part): ContentInterface => match ($part['type']) {
                    File::class, Document::class, Image::class, Audio::class => $part['type']::fromDataUrl($part['content']),
                    Text::class => new Text($part['content']),
                    ImageUrl::class => new ImageUrl($part['content']),
                    DocumentUrl::class => new DocumentUrl($part['content']),
                    default => throw new LogicException(\sprintf('Unknown content type "%s".', $part['type'])),
                },
                $contentAsBase64,
            )),

            ...
    }

     public function normalize(mixed $data, ?string $format = null, array $context = []): array
    {
       ...

        return [
                $context['identifier'] ?? 'id' => $data->getId()->toRfc4122(),
            'type' => $data::class,
            'content' => $content,
            'contentAsBase64' => ($data instanceof UserMessage && [] !== $data->getContent()) ? array_map(
                static fn(ContentInterface $content) => [
                    'type' => $content::class,
                    'content' => match ($content::class) {
                        Text::class => $content->getText(),
                        File::class, Document::class, Image::class, Audio::class => $content->asDataUrl(),
                        ImageUrl::class,
                        DocumentUrl::class => $content->getUrl(),
                        default => throw new LogicException(\sprintf('Unknown content type "%s".', $content::class)),
                    },
                ],
                $data->getContent(),
            ) : [],
            'toolsCalls' => $toolsCalls,
            'parts' => $parts,
            'metadata' => $data->getMetadata()->all(),
            'addedAt' => (new \DateTimeImmutable())->getTimestamp(),
        ];
    }

There must be an inconsistency here between the stored and read data formats.

[xprojects-de]

Another issue when using Gemini-Flash-Image and manipulating images is that the AssistantMessage's image response is sometimes located in the content field rather than in the parts.

So this part for serialization is not working:

if ($data instanceof AssistantMessage) {
            $content = $data->asText() ?? ''; // Not working because could be Image/Binary, etc
            $parts = $this->normalizeAssistantParts($data, $format, $context);
            if ($data->hasToolCalls()) {
                $toolsCalls = $this->normalizer->normalize($data->getToolCalls(), $format, $context);
            }
        }