Allow for multiple meshes

[NexTechAR-Scott]

I believe this was raised once before but am now struggling to remember the search query that led me to it.

Scenario: Capturing from multiple sides to get for example a complete shoe.

We have great success with elevating objects on a transparent platform, doing a rotation then rotating the object 90 degrees and doing another rotation.

So lets say that is a 300 image set with 200 cameras for one rotation and 100 for the second.

During SFM 200 may not align but 100 do so what is can be processed as a model is only 100 cameras.

The assumption up till now has always been that the 200 cameras simply could not be aligned.

OK, make a new project and ONLY use the 200 cameras that failed to align and viola, they all align and look great.

That's a bit of a head scratcher until we realize that what is happening is that we are essentially getting two distinct image sets that can't align to each other so MR is eliminating one of them.

If you run that same 300 data set through Reality Captured you will get two (or more) components that can be meshed and realigned manually.

It seems that MR tries really hard to generate one complete mesh and if it can't use some cameras (even thought those cameras on their own do align) it just ignores them.

I have tried SFM augmentation as has often been suggested but continue to end up with the same result, only a portion of the cameras available for meshing.

In summation, it does not appear that cameras simply can't be aligned due to poor quality or lack of features rather in certain circumstances sets (consisting of cameras that align within the set) can't algin.

Make sense?

[fabiencastan]

Yes.
It would be great to be able to generate multiple scenes from the SfM when all cameras cannot be aligned altogether. And then create a mesh for each part.

[natowi]

...and then align the meshes alicevision/AliceVision#425

[NexTechAR-Scott]

Yes.
It would be great to be able to generate multiple scenes from the SfM when all cameras cannot be aligned altogether. And then create a mesh for each part.

Hi Fabien, are you agreeing with me or saying this can already be done?

[NexTechAR-Scott]

Yes.
It would be great to be able to generate multiple scenes from the SfM when all cameras cannot be aligned altogether. And then create a mesh for each part.

Hi Fabien, are you agreeing with me or saying this can already be done?

Hmm, i think I see where you are going here.

Duplicate the graph at the SFM node will result in two paths that both generate meshes.

How to force first SFM to model to one set and SFM2 to the other set.

Or am I looking to duplicate nodes for the second line at one of the Feature Nodes?

[fabiencastan]

Unfortunately it is not possible to that in Meshroom but I agree with the need.
Your issue was only talking about Meshing, but we will need to support the notion of multiple 3D scene in one dataset in all nodes from SfM to Texturing.

[NexTechAR-Scott]

Unfortunately it is not possible to that in Meshroom but I agree with the need.
Your issue was only talking about Meshing, but we will need to support the notion of multiple 3D scene in one dataset in all nodes from SfM to Texturing.

Thank you for the reply.

Actually we can do it, sorta, in a roundabout way.

300 image data set, 200 will align with themselves and 100 will align with themselves which really means two data sets that don't align together.

So if we add one set, say the 200 set, run the graph then go back and augment with the 2nd set we get a Camera Inits with two distinct data sets.

Now delete ImageMatchingMultiSFM and replace with standard ImageMatching Node chained normally as in the default graph.

Now you have two independent graphs that are processing two different image sets and end up with two (separate) models which can then be realigned externally in say MeshLab.

End of day that result could also be achieved simply by running each set in its own project file.

But we still need to run the initial graph so we can determine which cameras set is not being merged with the other, delete them and add them to a new project.

Unless we can do a twist on augmentation where we determine which camera set was not aligned with the other and add that set by itself to a second group.

Now to figure out scale and aligning of the two resulting models

[natowi]

determine which cameras set is not being merged with the other, delete them and add them to a new project

We could move the images to a new Image Group as it is being done when using Augment Reconstruction. For that we need to take care of this #510

Could be combined with #514

[NexTechAR-Scott]

........We could move the images to a new Image Group as it is being done when using Augment Reconstruction......

That's exactly what I was thinking, suggesting.

I had the augment node loaded and it occurred to me that there was a specific CameraInit with a unique image set.

Unchaining imageMatchingMultiSFM from the original graph and replacing it with standard ImageMatching Node gets you tow separate graphs with unique image sets.

[skinkie]

Wouldn't it already help a lot when you could register relative positions within a image set, without the need to redo the product of combinations between the entire set. And then mark the two (or more) images between the two image set as connection point?

[nufanDK]

I'm somewhat having a similar issue. I have a top and a bottom half. I load images from one half then augment with images from second half. Normal setup with ImageMatchMultiSfM node. In SfM for first half, all cameras are registered and SfM shows fine for that half, then the second half registers fine in the SfM node for those images (through the ImageMatchMultiSfM node), but only the second half. Thus it is not combining the two SfM nodes. So I figure it can't find the connection between the two sets. But if I load the SfM node from first half into the viewer, and then also load the SfM from the second half into the viewer, they are aligned perfectly, and I'm just missing a way to merge the two separate SfM's into a single one for further processing in DepthMap and meshing. Does anyone know if this is possible?

[skinkie]

@nufanDK is it able to find a connection if you would only load the "connection" side?

[NexTechAR-Scott]

Why not load top and bottom at the same time?

I find Meshroom handles this very well if you provide overlap.

What is the object and what is your setup, turntable in a light box or "in the wild"?