Docker development question: unable to view products after production data import? #14112
Unanswered
jayaddison
asked this question in
Q&A
Replies: 1 comment
|
This may have been due to existing/stale data in my Docker environment. After stopping all containers and recreating 100-product dev environment, I encountered the same After a subsequent complete prune of all containers and also all volumes (e.g. persistent Docker storage), I do not encounter the problem in a fresh 100-product dev env. At some point soon I will re-attempt the complete 4M+ dataset in a completely fresh environment (after again removing all persistent Docker volumes/storage). |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hello OpenFoodFacts community,
I use Docker for local software development of OpenFoodFacts.
Usually I use the small sample dataset of ~100 products -- not the entire OpenFoodFacts database (4,000,000+ products!).
Yesterday to investigate #14058 I began a complete production import using
make import_prod_data.The import completed after roughly 1 hour and 30 minutes.
Now I can query the OFF MongoDB database, and it shows that the entire product dataset is loaded:
However.. when I try to browse one of the products using the local web interface, I get an error message saying that no product data is found.
For example, when I visit this URL: http://world.openfoodfacts.localhost/product/8719587326060/skyr-albert-heijn
...I get a message saying
Error - No product listed for barcode 8719587326060.(screenshot below).Does anyone know what causes this?
Some debugging I have attempted:
I increased the log verbosity, because I found that mentioned in the Docker development guide: https://github.com/openfoodfacts/openfoodfacts-server/blob/main/docs/dev/how-to-develop-using-docker.md#increasing-log-verbosity
...and then I noticed some errors/messages in the logs saying that the product files cannot be found on the filesystem. I'm not sure this is relevant, but maybe it is?
There are not many files under
/mnt/podata/products-- certainly not 4 million. And the product's path does not exist at all:Have I missed a step in the production data import process that should fill the
/mnt/podata/productsdirectory with product data files?Thank you!
James
All reactions