Problem using visualize_documents() on Streamlit

[DWHowes]

I have a problem with displaying the Plotly Figure object returned by visualize_documents() in Streamlit. The following code illustrates the problem.

from bertopic import BERTopic
import json
import streamlit as st

from umap import UMAP
from hdbscan import HDBSCAN
from sentence_transformers import SentenceTransformer
from sklearn.feature_extraction.text import CountVectorizer

from bertopic import BERTopic
from bertopic.representation import KeyBERTInspired
from bertopic.vectorizers import ClassTfidfTransformer

# Add your own document file here
with open("vol7.json", "r", encoding="utf-8") as f:
    docs = json.load(f)["descriptions"]

embedding_model = SentenceTransformer("all-MiniLM-L6-v2")
embeddings = embedding_model.encode(docs, show_progress_bar=False)

umap_model = UMAP(n_neighbors=15, n_components=5, min_dist=0.1, metric='cosine')

hdbscan_model = HDBSCAN(min_cluster_size=80, metric='euclidean', cluster_selection_method='eom', prediction_data=True)

vectorizer_model = CountVectorizer(stop_words="english")

ctfidf_model = ClassTfidfTransformer()

representation_model = KeyBERTInspired()

topic_model = BERTopic(embedding_model=embedding_model, umap_model=umap_model, hdbscan_model=hdbscan_model, 
                       vectorizer_model=vectorizer_model, ctfidf_model=ctfidf_model, representation_model=representation_model)

topics, probs = topic_model.fit_transform(docs)

reduced = UMAP(n_neighbors=5, n_components=2, min_dist=0.0, metric='cosine', random_state=42).fit_transform(embeddings)
fig_reduce = topic_model.visualize_documents(docs, reduced_embeddings=reduced)
fig_orig = topic_model.visualize_documents(docs, embeddings=embeddings)

st.plotly_chart(fig_orig, theme=None)
st.plotly_chart(fig_reduce, theme=None)

Using either the original embeddings or the reduced embeddings the result is the same. The list of topics is displayed, but the plot of documents isn't (as shown in the image).

I have no problem displaying any other the other BERTopic visualizations I've tried, just this one.

In case it matters, my browser is Firefox 141.0.3 (current version).

Any help is appreciated.

[MaartenGr]

That's odd! Can you still see the figure if you are not using streamlit? That helps me understand whether this is a plotly or streamlit issue.

[DWHowes]

It used to work in a Jupyter notebook, but I upgraded both plotly and matplotlib yesterday in order to correct some other visualization problems. Now the behavior in the notebook is the same as in streamlit, I see the legend but no graphic.

[MaartenGr]

Hmmm, this is annoying because it seems to be related to streamlit then. Reading through the code I'm not seeing anything special happening there so it must be because of a streamlit update. When I have the time, I'll check it out but it will most likely relate to some functionality that was updated between streamlit versions.