Unable to build from source

[oroppas]

Hi,

I have trouble building grCUDA from source. Any help will be greatly appreciated.
Thanks in advance.

Here's what I did:

$ git clone https://github.com/oracle/graal.git
$ git clone https://github.com/graalvm/mx.git
$ git clone https://github.com/NVIDIA/grcuda.git

Following the build instruction leads to

Component Polyglot Launcher does not specify dependencies
Components: ['Truffle', 'LLVM.org toolchain', 'Truffle NFI', 'Polyglot Launcher', 'Graal SDK']
Components: ['Truffle', 'LLVM.org toolchain', 'Truffle NFI', 'Polyglot Launcher', 'Graal SDK']
No dist name for ['bpolyglot', 'llp', 'nfi', 'poly', 'sdk', 'tfl']
env MX__SUITEMODEL=sibling MX_PRIMARY_SUITE_PATH=/home/ryuta/packages/graal/mx \
git --no-pager show -s '--format=%an <%ae>|||%at|||%cn <%ce>|||%ct|||%s' HEAD
# Directory: /home/ryuta/packages/graal/graal
env MX__SUITEMODEL=sibling MX_PRIMARY_SUITE_PATH=/home/ryuta/packages/graal/mx \
git --no-pager show -s '--format=%an <%ae>|||%at|||%cn <%ce>|||%ct|||%s' HEAD
# Directory: /home/ryuta/packages/graal/graal
env MX__SUITEMODEL=sibling MX_PRIMARY_SUITE_PATH=/home/ryuta/packages/graal/mx \
git --no-pager show -s '--format=%an <%ae>|||%at|||%cn <%ce>|||%ct|||%s' HEAD
Adding Graal SDK (GraalVmJreComponent) to the GRAALVM_591BD358E0_JAVA11 GraalVmLayoutDistribution
Adding LLVM.org toolchain (GraalVmJreComponent) to the GRAALVM_591BD358E0_JAVA11 GraalVmLayoutDistribution
Adding Polyglot Launcher (GraalVmJreComponent) to the GRAALVM_591BD358E0_JAVA11 GraalVmLayoutDistribution
Adding Truffle (GraalVmJreComponent) to the GRAALVM_591BD358E0_JAVA11 GraalVmLayoutDistribution
Adding Truffle NFI (GraalVmLanguage) to the GRAALVM_591BD358E0_JAVA11 GraalVmLayoutDistribution
[project com.oracle.truffle.api.jdk8 was removed as JDK 1.8 is not available]
[com.oracle.truffle.api.jdk8 was removed from distribution TRUFFLE_API]
[project com.nvidia.grcuda was removed as JDK 1.8 is not available]
[project com.oracle.graalvm.locator.jdk8 was removed as JDK 1.8 is not available]
[com.oracle.graalvm.locator.jdk8 was removed from distribution LOCATOR]
[project com.nvidia.grcuda.test was removed as JDK 1.8 is not available]
[com.nvidia.grcuda was removed from distribution GRCUDA]
[distribution GRCUDA was removed as all its dependencies were removed]
[com.nvidia.grcuda.test was removed from distribution GRCUDA_UNIT_TESTS]
[GRCUDA was removed from distribution GRCUDA_UNIT_TESTS]
[distribution GRCUDA_UNIT_TESTS was removed as all its dependencies were removed]
JAVA_HOME: /home/ryuta/packages/graal/labsjdk-ce-11.0.7-jvmci-20.1-b02
Dependencies removed from build:
 project com.oracle.truffle.api.jdk8 was removed as JDK 1.8 is not available
 project com.nvidia.grcuda was removed as JDK 1.8 is not available
 project com.oracle.graalvm.locator.jdk8 was removed as JDK 1.8 is not available
 project com.nvidia.grcuda.test was removed as JDK 1.8 is not available
 distribution GRCUDA was removed as all its dependencies were removed
 distribution GRCUDA_UNIT_TESTS was removed as all its dependencies were removed
Starting daemon for /home/ryuta/packages/graal/labsjdk-ce-11.0.7-jvmci-20.1-b02/bin/java []
[all files are up to date - skipping com.oracle.mxtool.compilerserver]
/home/ryuta/packages/graal/mx/mxbuild/java/com.oracle.mxtool.compilerserver/bin com.oracle.mxtool.compilerserver.JavacDaemon -v -j 24
Started server on port 45554 [24 threads]
[Started javac-daemon on port 45554 for Java 11.0.7 (11) from /home/ryuta/packages/graal/labsjdk-ce-11.0.7-jvmci-20.1-b02]
[all files are up to date - skipping org.graalvm.word]
[all files are up to date - skipping com.oracle.truffle.api.jdk11]
[all files are up to date - skipping com.oracle.mxtool.compilerserver]
[skipping polyglot.image-bash]
[skipping TRUFFLE_GRAALVM_SUPPORT]
[all files are up to date - skipping org.graalvm.collections]
[all files are up to date - skipping com.oracle.graalvm.locator.jdk11]
[all files are up to date - skipping com.oracle.mxtool.webserver]
[skipping TRUFFLE_NFI_GRAALVM_SUPPORT]
Checking whether to build com.nvidia.grcuda.parser.antlr with GNU Make
[all files are up to date - skipping com.oracle.truffle.dsl.processor]
[all files are up to date - skipping org.graalvm.options]
  File "/home/ryuta/packages/graal/mx/mx.py", line 16875, in <module>
    main()
  File "/home/ryuta/packages/graal/mx/mx.py", line 16856, in main
    retcode = c(command_args)
  File "/home/ryuta/packages/graal/mx/mx_commands.py", line 147, in __call__
    return self.command_function(*args, **kwargs)
  File "/home/ryuta/packages/graal/mx/mx.py", line 13767, in build
    task.proc.start()
  File "/usr/lib64/python2.7/multiprocessing/process.py", line 130, in start
    self._popen = Popen(self)
  File "/usr/lib64/python2.7/multiprocessing/forking.py", line 126, in __init__
    code = process_obj._bootstrap()
  File "/usr/lib64/python2.7/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/usr/lib64/python2.7/multiprocessing/process.py", line 114, in run
    self._target(*self._args, **self._kwargs)
  File "/home/ryuta/packages/graal/mx/mx.py", line 13748, in executeTask
    task.execute()
  File "/home/ryuta/packages/graal/mx/mx.py", line 4771, in execute
    buildNeeded, reason = self.needsBuild(newestInput)
  File "/home/ryuta/packages/graal/mx/mx.py", line 7827, in needsBuild
    cmdline, cwd, env = self._build_run_args()
  File "/home/ryuta/packages/graal/mx/mx.py", line 7815, in _build_run_args
    env.update(self.subject.getBuildEnv())
  File "/home/ryuta/packages/graal/mx/mx.py", line 7720, in getBuildEnv
    ret[key] = replaceVar.substitute(value, dependency=self)
  File "/home/ryuta/packages/graal/mx/mx_subst.py", line 86, in substitute
    return re.sub(r'<([\w\-]+?)(:(.+?))?>', lambda m: self._replace(m, self.skip_unknown_substitutions, **kwArgs), string)
  File "/usr/lib64/python2.7/re.py", line 151, in sub
    return _compile(pattern, flags).sub(repl, string, count)
  File "/home/ryuta/packages/graal/mx/mx_subst.py", line 86, in <lambda>
    return re.sub(r'<([\w\-]+?)(:(.+?))?>', lambda m: self._replace(m, self.skip_unknown_substitutions, **kwArgs), string)
  File "/home/ryuta/packages/graal/mx/mx_subst.py", line 67, in _replace
    return fn(arg)
  File "/home/ryuta/packages/graal/grcuda/mx.grcuda/mx_grcuda.py", line 38, in _get_src_dir
    mx.abort("Could not find src dir for project %s" % projectname)
  File "/home/ryuta/packages/graal/mx/mx.py", line 3856, in abort
    traceback.print_stack()
Could not find src dir for project com.nvidia.grcuda
[all files are up to date - skipping com.oracle.mxtool.checkcopy]
[all files are up to date - skipping org.graalvm.collections.test]
[all files are up to date - skipping com.oracle.mxtool.junit]
Building com.nvidia.grcuda.parser.antlr with GNU Make failed
[Stopped javac-daemon on port 45554 for Java 11.0.7 (11) from /home/ryuta/packages/graal/labsjdk-ce-11.0.7-jvmci-20.1-b02]
Shutting down
  File "/home/ryuta/packages/graal/mx/mx.py", line 16875, in <module>
    main()
  File "/home/ryuta/packages/graal/mx/mx.py", line 16856, in main
    retcode = c(command_args)
  File "/home/ryuta/packages/graal/mx/mx_commands.py", line 147, in __call__
    return self.command_function(*args, **kwargs)
  File "/home/ryuta/packages/graal/mx/mx.py", line 13810, in build
    abort('{0} build tasks failed'.format(len(failed)))
  File "/home/ryuta/packages/graal/mx/mx.py", line 3856, in abort
    traceback.print_stack()
1 build tasks failed

[printcap]

grCUDA currently builds for JDK1.8. In order to build with JDK11 change the suite as follows:

diff --git a/mx.grcuda/suite.py b/mx.grcuda/suite.py
index 3c79d82..862c965 100644
--- a/mx.grcuda/suite.py
+++ b/mx.grcuda/suite.py
@@ -109,7 +109,7 @@ suite = {
             "subDir": "projects",
             "license": ["BSD-3"],
             "sourceDirs": ["src"],
-            "javaCompliance": "1.8",
+            "javaCompliance": "11",
             "annotationProcessors": ["truffle:TRUFFLE_DSL_PROCESSOR"],
             "dependencies": [
                 "truffle:TRUFFLE_API",
@@ -128,7 +128,7 @@ suite = {
                 "truffle:TRUFFLE_TEST"
             ],
             "checkstyle": "com.nvidia.grcuda",
-            "javaCompliance": "1.8",
+            "javaCompliance": "11",
             "annotationProcessors": ["truffle:TRUFFLE_DSL_PROCESSOR"],
             "workingSets": "Truffle,CUDA",
             "testProject": True,

With this change, I am able to build grCUDA with labsjdk-ce-11.0.10-jvmci-21.0-b05 and run the unittests successfully.

@akshaysubr @lukasstadler Maybe one can move grCUDA forward to JDK11. The extended language tests for the Graal languages are also passing in GraalVM-CE-Java11-20.3.0.

[oroppas]

@printcap Thank you. Now I'm able to build with JDK 11.