Paraview recipe #39

biddisco · 2023-08-23T08:58:00Z

This PR builds a minimal paraview using EGL on daint and eiger.

jfavre · 2024-02-07T06:50:36Z

installation on ALPS will require two additional items for run-time enabling of the NVIDIA IndeX libraries and license.

The lib package can be found in https://www.paraview.org/files/dependencies/nvidia-index-libs-5.12.0.20231121-linux-aarch64.tar.bz2. untar-ing the file can be done anywhere (presumably under the ParaView install tree), as long as the lib is found in LD_LIBRARY_PATH.
Access and installation of the license file (which is obtained by private request to NVIDIA using my email) is documented at https://confluence.cscs.ch/display/VCUE/NVIDIA+IndeX. Thus, the environment variable NVINDEX_PVPLUGIN_HOME shall be set where the file nvindex_config.xml gets installed.

biddisco · 2024-08-30T13:14:51Z

The PR can now be considered for merging. We support

eiger: zen2 : 
  paraview with OSMESA offscreen headless rendering, 
  python, 
  CDI for icon support, 
  raycasting with TBB  
  VTK-m filters using TBB
  + lots lots more

daint: gh200 : 
  paraview with EGL headless accelerated rendering, 
  nvidia index plugin, 
  python, 
  CDI support for icon
  TBB and raycasting
  CUDA enabled VTK-m filters 
  + more

simonpintarelli · 2024-08-30T13:57:23Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.0

simonpintarelli · 2024-08-30T13:57:39Z

cscs-ci run alps;system=eiger;uarch=zen2;uenv=paraview:5.13.0

simonpintarelli · 2024-09-03T07:32:28Z

cscs-ci run alps;system=eiger;uarch=zen2;uenv=paraview:5.13.0

simonpintarelli · 2024-09-03T07:32:36Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.0

simonpintarelli · 2024-09-03T09:11:43Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.0

biddisco · 2024-09-03T11:07:42Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.0

biddisco · 2024-09-03T11:18:43Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.0

simonpintarelli · 2024-09-03T12:55:58Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.0

simonpintarelli · 2024-09-03T12:56:26Z

cscs-ci run alps;system=eiger;uarch=zen2;uenv=paraview:5.13.0

simonpintarelli · 2024-09-03T14:16:08Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.0

biddisco · 2024-11-20T10:50:44Z

Please test this and consider it for deployment on our clusters

simonpintarelli · 2024-11-20T10:51:44Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.0

simonpintarelli · 2024-11-20T10:51:54Z

cscs-ci run alps;system=eiger;uarch=zen2;uenv=paraview:5.13.0

biddisco · 2024-11-20T13:05:15Z

cscs-ci run alps;system=eiger;uarch=zen2;uenv=paraview:5.13.1

biddisco · 2024-11-20T13:05:51Z

please note, paraview release has been bumped from 5.13.0 to 5.13.1

simonpintarelli · 2024-11-20T13:11:34Z

cscs-ci run alps;system=eiger;uarch=zen2;uenv=paraview:5.13.1

simonpintarelli · 2024-11-20T16:28:15Z

cscs-ci run alps;system=todi;uarch=gh200;uenv=paraview:5.13.1

simonpintarelli · 2024-11-25T15:54:36Z

cscs-ci run alps;system=eiger;uarch=zen2;uenv=paraview:5.13.1

simonpintarelli · 2024-11-25T15:54:40Z

cscs-ci run alps;system=todi;uarch=gh200;uenv=paraview:5.13.1

simonpintarelli · 2024-11-25T16:56:03Z

I've just tried to build it manually on eiger, there is an error compiling h5hut on zen2 too.

biddisco · 2025-05-21T12:24:46Z

PR comments addressed (hopefully) in commits pushed just now.

albestro

Thanks for all the hard work in figuring out all the details of this build! 💪

We are not going to polish this to be optimal, we will have a follow up PR in case to refine details (e.g. conduit spack package changes can be pushed to the public repo) and complete the cleanup.

I know we are targeting to merge a Paraview recipe as soon as possible, and I know it took very long to get here.

Thanks again!

recipes/paraview/5.13.2/gh200/environments.yaml

albestro · 2025-05-22T06:51:55Z

recipes/paraview/5.13.2/gh200/environments.yaml

+  - blaspp
+  - eigen
+  - fftw
+  - lapackpp
+  - openblas
+  - proj


are blaspp, lapackpp, openblas, ... paraview dependencies? Or are there for another legit reason?

Proj is needed, eigen is needed, the others were snuck in as part of my testing, but they don't do any harm. They can be removed, but IMHO they are harmless and useful for people creating plugins that need them.

albestro · 2025-05-22T06:57:59Z

recipes/paraview/5.13.2/repo/packages/cdi/package.py

not needed, right?

https://github.com/spack/spack/blob/195b869e1c5f0f850fe16ca1cc0c77fc71f5fcd6/var/spack/repos/builtin/packages/cdi/package.py

I don't know what you mean...but CDI is required to build the ICON reader

I mean it is already in the spack official repo, this seems just a superfluous clone of it. In case it is not, it can stay here.

The main problem is that this was added before the CDI was available/functional in the general spack repo, if we remove this and switch to the built in one, then we needd to do a round of testing and checking to make sure that the cdi parallel load client/server etc etc works ok. It would be better to commit this stuff "as is" - and when we have reframe testing setup, remove all the obsolete things we added one by one as need/requests arise

albestro · 2025-05-22T07:06:48Z

recipes/paraview/5.13.2/zen2/compilers.yaml

@@ -0,0 +1,5 @@
+bootstrap:
+  spec: gcc@11


is there any legit reason why we bootstrap gcc@12 with gcc@11?

Suggested change

spec: gcc@11

spec: gcc@12

it couold be updated, it was there since the original 2023 PR commits, if we change it, we ought to rerun tests etc etc -- can we just leave it alone.

aha - that's the eiger build only - the gh200 build was updated with gcc12, but I vaguely remember that eiger needed 11 - I will update it and trigger builds and see if all works.

recipes/paraview/5.13.2/zen2/environments.yaml

albestro · 2025-05-22T07:16:16Z

recipes/paraview/5.13.2/scripts/job-build-daint.sh

@@ -0,0 +1,90 @@
+#!/bin/bash


I agree with @msimberg on this.

My 2cents

Does it do any harm to have them in the repo?

We might end up with tens of different scripts (there are already a good amount to support the point), one per system, that no one will maintain and probably use because they would have to study/change/update them first. So, maybe they look unharmful, but they already are harmful to the cleanliness of the recipe.

recipes/paraview/5.13.2/gh200/modules.yaml

biddisco · 2025-05-23T10:27:50Z

cscs-ci run alps;system=eiger;uarch=zen2;uenv=paraview:5.13.2

biddisco · 2025-05-23T10:28:08Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.2

albestro

Everything considered, I agree with what @biddisco said

It would be better to commit this stuff "as is" - and when we have reframe testing setup, remove all the obsolete things we added one by one as need/requests arise

as soon as reframe tests will be ready, we can eventually fix/cleanup/refine this in a next PR.

…mits

biddisco · 2025-05-23T15:04:30Z

cscs-ci run alps;system=eiger;uarch=zen2;uenv=paraview:5.13.2

biddisco · 2025-05-23T15:33:01Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.2

…envs are not stored

biddisco · 2025-05-24T08:55:47Z

I tried adding openvdb, ( c.f. https://jira.cscs.ch/browse/SD-65739 )but it did not work, I have removed that commit and will work on that separately.

biddisco · 2025-05-24T08:55:59Z

cscs-ci run alps;system=eiger;uarch=zen2;uenv=paraview:5.13.2

biddisco · 2025-05-24T08:56:13Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.2

biddisco · 2025-05-26T13:37:58Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.2

biddisco · 2025-05-26T13:38:16Z

cscs-ci run alps;system=eiger;uarch=zen2;uenv=paraview:5.13.2

msimberg · 2025-05-27T07:18:32Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.2

msimberg · 2025-05-27T07:18:42Z

cscs-ci run alps;system=eiger;uarch=zen2;uenv=paraview:5.13.2

biddisco · 2025-05-27T11:49:23Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.2

biddisco · 2025-05-27T13:11:53Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.2

biddisco · 2025-05-28T07:44:02Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.2

biddisco · 2025-05-28T13:47:50Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.2

biddisco · 2025-05-28T21:12:19Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.2

biddisco · 2025-06-02T08:21:48Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.2

biddisco · 2025-06-04T08:44:32Z

cscs-ci run alps;system=daint;uarch=gh200;uenv=paraview:5.13.2

biddisco force-pushed the paraview branch from 0af747a to 0688c04 Compare August 23, 2023 09:03

biddisco force-pushed the paraview branch from 96e8c61 to 98362e9 Compare September 5, 2023 07:51

biddisco force-pushed the paraview branch from 98362e9 to 41e09f6 Compare February 26, 2024 22:01

RMeli added app paraview labels Jun 4, 2024

biddisco force-pushed the paraview branch from 41e09f6 to 14406cb Compare August 30, 2024 13:09

biddisco force-pushed the paraview branch from f50b5e0 to f4e8ed0 Compare November 20, 2024 08:51

simonpintarelli self-requested a review November 25, 2024 20:38

albestro reviewed May 22, 2025

View reviewed changes

albestro reviewed May 23, 2025

View reviewed changes

recipes/paraview/5.13.2/gh200/modules.yaml Outdated Show resolved Hide resolved

biddisco added 2 commits May 23, 2025 12:25

remove modules.yaml as it is not used

a166c20

bump boootstrap to gcc@12

860e2ed

albestro approved these changes May 23, 2025

View reviewed changes

Fix gcc and env setup for post install scripts broken by last few com…

cc5c218

…mits

Add set-e to post install scripts to make sure that if build fails, u…

03996e1

…envs are not stored

biddisco force-pushed the paraview branch from 195a7aa to 03996e1 Compare May 24, 2025 08:48

Fixes to post install to ensure build completes ok

1b74f9f

Change nvindex plugin tarball to aarch64 version for gh200

e3b4799

Fix jfrog nvidia index access for aarch64 and regular linux files

e3c4370

Paraview recipe #39

Are you sure you want to change the base?

Paraview recipe #39

Uh oh!

Conversation

biddisco commented Aug 23, 2023 • edited by msimberg Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jfavre commented Feb 7, 2024

Uh oh!

biddisco commented Aug 30, 2024

Uh oh!

simonpintarelli commented Aug 30, 2024

Uh oh!

simonpintarelli commented Aug 30, 2024

Uh oh!

simonpintarelli commented Sep 3, 2024

Uh oh!

simonpintarelli commented Sep 3, 2024

Uh oh!

simonpintarelli commented Sep 3, 2024

Uh oh!

biddisco commented Sep 3, 2024

Uh oh!

biddisco commented Sep 3, 2024

Uh oh!

simonpintarelli commented Sep 3, 2024

Uh oh!

simonpintarelli commented Sep 3, 2024

Uh oh!

simonpintarelli commented Sep 3, 2024

Uh oh!

biddisco commented Nov 20, 2024

Uh oh!

simonpintarelli commented Nov 20, 2024

Uh oh!

simonpintarelli commented Nov 20, 2024

Uh oh!

biddisco commented Nov 20, 2024

Uh oh!

biddisco commented Nov 20, 2024

Uh oh!

simonpintarelli commented Nov 20, 2024

Uh oh!

simonpintarelli commented Nov 20, 2024

Uh oh!

simonpintarelli commented Nov 25, 2024

Uh oh!

simonpintarelli commented Nov 25, 2024

Uh oh!

simonpintarelli commented Nov 25, 2024

Uh oh!

biddisco commented May 21, 2025

Uh oh!

albestro left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

biddisco commented Aug 23, 2023 •

edited by msimberg

Loading