GraalVM: Micronaut and Quarkus examples for native builds

[vaslabs]

Background

After the work (but not limited to) in #6359, #6315 and #6315 it should be possible now to extend our examples to more advanced configurations and look into the possibility that Quarkus Java apps are supported as well.

Steps

• Demonstrate (or extend graalvm support further) that micronaut native builds are possible with mill - added examples
• Add basic Quarkus examples as part of Add hello-world and todo-mvc Quarkus examples #3549
• Extend Quarkus examples to demonstrate native builds are possible

Micronaut getting Native Images get started guide

• https://guides.micronaut.io/latest/micronaut-creating-first-graal-app.html

Quarkus get started flow:

• https://quarkus.io/get-started/

Building native executables with Quarkus

• https://quarkus.io/guides/building-native-image

[vaslabs]

@lihaoyi are we also looking to support Quarkus cli functionality via mill? I'd at least test interoperability between mill builds and quarkus cli, atm I'm not sure whether it's needed for fully supporting Quarkus dev flows but I'll find out

(e.g. https://quarkus.io/guides/maven-tooling#dev-mode)

[lihaoyi]

@vaslabs good question. I'm not familiar with the quarkus CLI, but I guess the question is how much of it is covered by Mill's existing featureset, and how much of it is not and maybe we need to support explicitly

[vaslabs]

Yes, I imagine supporting it explicitly is the end goal, one reason would be to sync the JVM environment, versions etc.

In any case, I'll start to cover the base and see what we discover along the way

[vaslabs]

For micronaut so far I've discovered the following.

AOT

Micronaut, like spring boot also has AOT, running it is straightforward:

Details

def aotConfigFile: T[PathRef] = Task {
    val file = Task.dest / "micronaut-aot.properties"
    os.write(file,
      """|logback.xml.to.java.enabled=true
         |netty.properties.enabled=true
         |deduce.environment.enabled=true
         |graalvm.config.enabled=true
         |serviceloading.native.enabled=false
         |precompute.environment.properties.enabled=true
      """.stripMargin)
    PathRef(file)
  }

  def micronautProcessAOT: T[PathRef] = Task {
    val dest = Task.dest

    val args = Seq(
      "--classpath", (runClasspath() ++ resolvedMicronautAotCli()).map(_.path).mkString(":"),
      "--package", "hello.world",
      "--runtime", "native",
      "--config", aotConfigFile().path.toString,
      "--output", dest.toString
    )

    Jvm.callProcess(
      mainClass = "io.micronaut.aot.cli.Main",
      mainArgs = args,
      classPath = resolvedMicronautAotCli().map(_.path)
    )

    PathRef(dest)
  }

The AOT can be run in combination with native - as with spring boot - and it seems to generate a few native related things which seem useful (such as the native image properties file and does several optimisations)

The configuration reference is: https://micronaut-projects.github.io/micronaut-aot/latest/guide/configurationreference.html

I've setup a small micronaut project with:

mn create-app hello-world

and ran

./gradlew nativeCompile

With debug I managed to extract the following configuration:

Details

/home/vnicolaou/.sdkman/candidates/java/current/bin/native-image \
--exclude-config \
\Q/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.2.7.Final/83ea548981d0d8c4a98027cc1a6f9624f902e142/netty-transport-4.2.7.Final.jar\E \
^/META-INF/native-image/.* \
--exclude-config \
\Q/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.2.7.Final/b734c108854099c421fd94d92d9f865e4d4da853/netty-codec-http-4.2.7.Final.jar\E \
^/META-INF/native-image/.* \
--exclude-config \
\Q/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.2.7.Final/11aa30df26af4fca3239ac1917f303a280f301e1/netty-common-4.2.7.Final.jar\E \
^/META-INF/native-image/.* \
--exclude-config \
\Q/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.2.7.Final/7ad8a1f851e2e6fe93cdd091871fda2b81c03b5b/netty-handler-4.2.7.Final.jar\E \
^/META-INF/native-image/.* \
--exclude-config \
\Q/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.2.7.Final/5555ff561643bf2f8430fb57c24403c0efe15994/netty-buffer-4.2.7.Final.jar\E \
^/META-INF/native-image/.* \
--exclude-config \
\Q/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.2.7.Final/ce3234f38c9b7a5f625bc75765fa9b62c99d7f71/netty-codec-http2-4.2.7.Final.jar\E \
^/META-INF/native-image/.* \
-cp \
/home/vnicolaou/micronaut-examples/hello-world/build/libs/hello-world-0.1.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut.serde/micronaut-serde-jackson/2.16.2/302ace067efaa3433e59af73671f884fbc0c50ac/micronaut-serde-jackson-2.16.2.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut.serde/micronaut-serde-support/2.16.2/b5d479ac98e2c8de9f33691641b0013ded80e5dd/micronaut-serde-support-2.16.2.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut.serde/micronaut-serde-api/2.16.2/891d3467372c9520fadd34fac3da1fd5d1f2f15e/micronaut-serde-api-2.16.2.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-http-server-netty/4.10.9/8065e400628fd70dc2ccd999b5d3f8e4f8845555/micronaut-http-server-netty-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-http-server/4.10.9/58b0e33e03bb84444ea0e8cd92b7b040432dc540/micronaut-http-server-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-http-netty/4.10.9/ca8bfe989f876bbb8aeff1f5b3a8600fdc553637/micronaut-http-netty-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-router/4.10.9/93483b096ce9d972d2def9ac9efc3b4490712e63/micronaut-router-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-jackson-core/4.10.9/5bce5c880279bd1c2054bbeeaf0daaa33330ffa2/micronaut-jackson-core-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-json-core/4.10.9/ba75e881638cb99dafb4e8c9bbd3482079450363/micronaut-json-core-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-http/4.10.9/9624cd6d736b19327f57e683b626fe3543a3f2b3/micronaut-http-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-context-propagation/4.10.9/bf3ac264d2cd42c84ed323479f73ac9db27b5f3c/micronaut-context-propagation-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-context/4.10.9/fe218ee617679b275f1a70f36970f2acdf9b1296/micronaut-context-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-buffer-netty/4.10.9/58c20e9b56d8fc2ffff62f77b90c4fd982e54002/micronaut-buffer-netty-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-aop/4.10.9/20589c9ad5988536b2c6c209a9ef5921b4b785db/micronaut-aop-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-inject/4.10.9/cadbbdda1e23499ed2a5e2b5f7b5cfc221773999/micronaut-inject-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/ch.qos.logback/logback-classic/1.5.19/227519801110b803afd68449f11209bb60703630/logback-classic-1.5.19.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.19.2/c5381f11988ae3d424b197a26087d86067b6d7d/jackson-annotations-2.19.2.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.19.2/50f3b4bd59b9ff51a0ed493e7b5abaf5c39709bf/jackson-core-2.19.2.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/jakarta.annotation/jakarta.annotation-api/2.1.1/48b9bda22b091b1f48b13af03fe36db3be6e1ae3/jakarta.annotation-api-2.1.1.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.2.7.Final/ce3234f38c9b7a5f625bc75765fa9b62c99d7f71/netty-codec-http2-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.2.7.Final/b734c108854099c421fd94d92d9f865e4d4da853/netty-codec-http-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-compression/4.2.7.Final/572341bc1ca90fd9d6e47f1d2694aab5258566e9/netty-codec-compression-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.2.7.Final/7ad8a1f851e2e6fe93cdd091871fda2b81c03b5b/netty-handler-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-base/4.2.7.Final/915e381ebabcf115f1c7ff7032d55c48afb50210/netty-codec-base-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.2.7.Final/89953f04259ea7502cffb313630dd51e00e60669/netty-transport-native-unix-common-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.2.7.Final/83ea548981d0d8c4a98027cc1a6f9624f902e142/netty-transport-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.2.7.Final/5555ff561643bf2f8430fb57c24403c0efe15994/netty-buffer-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.2.7.Final/5f3e5ef8de03992cd4fb46960dc0085ec1a12a12/netty-resolver-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.2.7.Final/11aa30df26af4fca3239ac1917f303a280f301e1/netty-common-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.7.12/fa00bcb9c8c50c430f1c3930dca28ddc9a888e18/reactor-core-3.7.12.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-core-reactive/4.10.9/dfc8b80aa292fc69d70633427d8d410f46c6b4d3/micronaut-core-reactive-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-core/4.10.9/c6497df7a530bef51e249b98e0045206f3795cde/micronaut-core-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/ch.qos.logback/logback-core/1.5.19/8847d9fcb02c62c338ba26e2b28059dd585ea1a9/logback-core-1.5.19.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/2.0.17/d9e58ac9c7779ba3bf8142aff6c830617a7fe60f/slf4j-api-2.0.17.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/jakarta.inject/jakarta.inject-api/2.0.1/4c28afe1991a941d7702fe1362c365f0a8641d1e/jakarta.inject-api-2.0.1.jar \
--no-fallback \
-o \
/home/vnicolaou/micronaut-examples/hello-world/build/native/nativeCompile/hello-world \
-H:ConfigurationFileDirectories=/home/vnicolaou/micronaut-examples/hello-world/build/native/generated/generateResourcesConfigFile,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/io.netty/netty-codec-http/4.1.80.Final,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/io.netty/netty-common/4.1.115.Final,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/io.netty/netty-buffer/4.1.80.Final,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/io.netty/netty-transport/4.1.115.Final,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/io.netty/netty-handler/4.1.80.Final,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/io.netty/netty-codec-http2/4.1.80.Final,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/ch.qos.logback/logback-classic/1.4.9 \
hello.world.Application

This shows that:

1. Gradle excludes native image configs from jars if they are found in the repository metadata repo
2. Not all of the -H:ConfigurationFileDirectories exist, perhaps this is a red herring

My work in progress micronaut configuration is as follows

Details

package build
import mill.*
import javalib.*
import mill.api.{PathRef, Task}
import mill.util.Jvm
import os.zip.ZipSource

import java.util.jar.JarInputStream

object `package` extends MavenModule { outer =>

  override def bomMvnDeps = Seq(
    mvn"io.micronaut.platform:micronaut-platform:4.10.3"
  )

  def resolvedMicronautAotCli: T[Seq[PathRef]] = defaultResolver().classpath(
    Seq(
      mvn"io.micronaut.aot:micronaut-aot-cli:2.9.0",
      mvn"io.micronaut.aot:micronaut-aot-api:2.9.0",
      mvn"io.micronaut.aot:micronaut-aot-core:2.9.0",
      mvn"io.micronaut.aot:micronaut-aot-std-optimizers:2.9.0"
    )
  )

  def aotConfigFile: T[PathRef] = Task {
    val file = Task.dest / "micronaut-aot.properties"
    os.write(file,
      """|logback.xml.to.java.enabled=true
         |netty.properties.enabled=true
         |deduce.environment.enabled=true
         |graalvm.config.enabled=true
         |serviceloading.native.enabled=false
         |precompute.environment.properties.enabled=true
      """.stripMargin)
    PathRef(file)
  }

  def micronautProcessAOT: T[PathRef] = Task {
    val dest = Task.dest

    val args = Seq(
      "--classpath", (runClasspath() ++ resolvedMicronautAotCli()).map(_.path).mkString(":"),
      "--package", "hello.world",
      "--runtime", "native",
      "--config", aotConfigFile().path.toString,
      "--output", dest.toString
    )

    Jvm.callProcess(
      mainClass = "io.micronaut.aot.cli.Main",
      mainArgs = args,
      classPath = resolvedMicronautAotCli().map(_.path)
    )

    PathRef(dest)
  }

  object native extends MavenModule, NativeImageModule {

    def moduleDeps = Seq(outer)

    override def nativeUseLatestConfigWhenVersionIsUntested = true
    override def moduleDir: os.Path = outer.moduleDir

    def jvmVersion = outer.jvmVersion

    override def resources: Task.Simple[Seq[PathRef]] = Task {
      outer.resources()
    }
    override def forkArgs = super.forkArgs() ++ Seq("-Dspring.aot.enabled=true")

    override def runClasspath: Task.Simple[Seq[PathRef]] = Task {
      val aotClasses = Seq(PathRef(outer.micronautProcessAOT().path / "classes"))
      super.runClasspath() ++ aotClasses
    }

    val containedNativeImageConfig = "META-INF/native-image/"
    
    val banned = Set(
      "netty-transport-4.2.7.Final.jar",
      "netty-codec-http-4.2.7.Final.jar",
      "netty-common-4.2.7.Final.jar",
      "netty-handler-4.2.7.Final.jar",
      "netty-buffer-4.2.7.Final.jar",
      "netty-codec-http2-4.2.7.Final.jar"
    )

    def jarHasNativeImageDir(pr: PathRef): Boolean = {
      scala.util.Using.resource(new JarInputStream(java.nio.file.Files.newInputStream(pr.path.toNIO))) { jis =>
        Iterator
          .continually(jis.getNextJarEntry)
          .takeWhile(_ != null)
          .exists { e =>
            val name = e.getName
            name != null && name.startsWith(containedNativeImageConfig)
          }
      }
    }

    def excludeDepNativeConfigs = Task {
      defaultResolver().classpath(nettyDeps(), boms = outer.allBomDeps())
        .filter(_.path.ext == "jar")
        .filter(jarHasNativeImageDir)
        .filter(pr => banned.exists(p => pr.path.toString.contains(p)))
        .flatMap(file => Seq("--exclude-config", s"\\Q${file.path.toString}\\E", s"^${containedNativeImageConfig}.*"))
        
    }

    def nettyDeps: T[Seq[Dep]] = Seq(
      mvn"io.micronaut:micronaut-http-server-netty",
    )

    override def nativeImageOptions: Task.Simple[Seq[String]] = Task {
      val configurationsPath = outer.micronautProcessAOT().path / "classes/META-INF"
      excludeDepNativeConfigs() ++ super.nativeImageOptions() ++ Seq(
        "--no-fallback",
        "--configurations-path",
        configurationsPath.toString
      )
    }

  }


  def mvnDeps = Seq(
    mvn"io.micronaut:micronaut-http-client",
    mvn"io.micronaut.serde:micronaut-serde-jackson"
  )

  def jvmVersion = "graalvm-community:25.0.1"

  def finalMainClass = "hello.world.Application"


  def annotationProcessorsMvnDeps = Seq(
    mvn"io.micronaut:micronaut-http-validation",
    mvn"io.micronaut.serde:micronaut-serde-processor",
  )

  override def annotationProcessorsJavacOptions = super.annotationProcessorsJavacOptions() ++ Seq(
    "-Amicronaut.processing.incremental=true",
    "-Amicronaut.processing.annotations=hello.world.*"
  )

  def javacOptions = super.javacOptions() ++ Seq(
    "-parameters"
  )

  def compileMvnDeps = Seq(
    mvn"io.micronaut:micronaut-http-client"
  )

  override def runMvnDeps = Seq(
    mvn"io.micronaut:micronaut-http-server-netty",
    mvn"ch.qos.logback:logback-classic"
  )

}

par a few hacks here and there that I was trying to imitate the gradle run, I always get the same error:

1-122] 2 fatal errors detected:
1-122] Fatal error: com.oracle.graal.pointsto.constraints.UnsupportedFeatureException: Detected a native MemorySegment in the image heap. A native MemorySegment has a pointer to unmanaged C memory, and C memory from the image generator is not available at image runtime. If these objects should not be stored in the image heap, you can use 
1-122] 
1-122]     '--trace-object-instantiation=jdk.internal.foreign.NativeMemorySegmentImpl'
1-122] 
1-122] to find classes that instantiate these objects. Once you found such a class, you can mark it explicitly for run time initialization with 
1-122] 
1-122]     '--initialize-at-run-time=<culprit>'

I need to dig deeper and find the differences in classpaths and make sure everything is passed properly.

I did found a few other small issues that I'm pushing a fix for

The script that works (extracted from gradle)

Details

/home/vnicolaou/.sdkman/candidates/java/current/bin/native-image \
--exclude-config \
\\Q/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.2.7.Final/83ea548981d0d8c4a98027cc1a6f9624f902e142/netty-transport-4.2.7.Final.jar\\E \
^/META-INF/native-image/.* \
--exclude-config \
\\Q/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.2.7.Final/b734c108854099c421fd94d92d9f865e4d4da853/netty-codec-http-4.2.7.Final.jar\\E \
^/META-INF/native-image/.* \
--exclude-config \
\\Q/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.2.7.Final/11aa30df26af4fca3239ac1917f303a280f301e1/netty-common-4.2.7.Final.jar\\E \
^/META-INF/native-image/.* \
--exclude-config \
\\Q/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.2.7.Final/7ad8a1f851e2e6fe93cdd091871fda2b81c03b5b/netty-handler-4.2.7.Final.jar\\E \
^/META-INF/native-image/.* \
--exclude-config \
\\Q/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.2.7.Final/5555ff561643bf2f8430fb57c24403c0efe15994/netty-buffer-4.2.7.Final.jar\\E \
^/META-INF/native-image/.* \
--exclude-config \
\\Q/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.2.7.Final/ce3234f38c9b7a5f625bc75765fa9b62c99d7f71/netty-codec-http2-4.2.7.Final.jar\\E \
^/META-INF/native-image/.* \
-cp \
/home/vnicolaou/micronaut-examples/hello-world/build/libs/hello-world-0.1.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut.serde/micronaut-serde-jackson/2.16.2/302ace067efaa3433e59af73671f884fbc0c50ac/micronaut-serde-jackson-2.16.2.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut.serde/micronaut-serde-support/2.16.2/b5d479ac98e2c8de9f33691641b0013ded80e5dd/micronaut-serde-support-2.16.2.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut.serde/micronaut-serde-api/2.16.2/891d3467372c9520fadd34fac3da1fd5d1f2f15e/micronaut-serde-api-2.16.2.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-http-server-netty/4.10.9/8065e400628fd70dc2ccd999b5d3f8e4f8845555/micronaut-http-server-netty-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-http-server/4.10.9/58b0e33e03bb84444ea0e8cd92b7b040432dc540/micronaut-http-server-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-http-netty/4.10.9/ca8bfe989f876bbb8aeff1f5b3a8600fdc553637/micronaut-http-netty-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-router/4.10.9/93483b096ce9d972d2def9ac9efc3b4490712e63/micronaut-router-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-jackson-core/4.10.9/5bce5c880279bd1c2054bbeeaf0daaa33330ffa2/micronaut-jackson-core-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-json-core/4.10.9/ba75e881638cb99dafb4e8c9bbd3482079450363/micronaut-json-core-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-http/4.10.9/9624cd6d736b19327f57e683b626fe3543a3f2b3/micronaut-http-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-context-propagation/4.10.9/bf3ac264d2cd42c84ed323479f73ac9db27b5f3c/micronaut-context-propagation-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-context/4.10.9/fe218ee617679b275f1a70f36970f2acdf9b1296/micronaut-context-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-buffer-netty/4.10.9/58c20e9b56d8fc2ffff62f77b90c4fd982e54002/micronaut-buffer-netty-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-aop/4.10.9/20589c9ad5988536b2c6c209a9ef5921b4b785db/micronaut-aop-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-inject/4.10.9/cadbbdda1e23499ed2a5e2b5f7b5cfc221773999/micronaut-inject-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/ch.qos.logback/logback-classic/1.5.19/227519801110b803afd68449f11209bb60703630/logback-classic-1.5.19.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.19.2/c5381f11988ae3d424b197a26087d86067b6d7d/jackson-annotations-2.19.2.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.19.2/50f3b4bd59b9ff51a0ed493e7b5abaf5c39709bf/jackson-core-2.19.2.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/jakarta.annotation/jakarta.annotation-api/2.1.1/48b9bda22b091b1f48b13af03fe36db3be6e1ae3/jakarta.annotation-api-2.1.1.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.2.7.Final/ce3234f38c9b7a5f625bc75765fa9b62c99d7f71/netty-codec-http2-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.2.7.Final/b734c108854099c421fd94d92d9f865e4d4da853/netty-codec-http-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-compression/4.2.7.Final/572341bc1ca90fd9d6e47f1d2694aab5258566e9/netty-codec-compression-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.2.7.Final/7ad8a1f851e2e6fe93cdd091871fda2b81c03b5b/netty-handler-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-base/4.2.7.Final/915e381ebabcf115f1c7ff7032d55c48afb50210/netty-codec-base-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.2.7.Final/89953f04259ea7502cffb313630dd51e00e60669/netty-transport-native-unix-common-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.2.7.Final/83ea548981d0d8c4a98027cc1a6f9624f902e142/netty-transport-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.2.7.Final/5555ff561643bf2f8430fb57c24403c0efe15994/netty-buffer-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.2.7.Final/5f3e5ef8de03992cd4fb46960dc0085ec1a12a12/netty-resolver-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.2.7.Final/11aa30df26af4fca3239ac1917f303a280f301e1/netty-common-4.2.7.Final.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.7.12/fa00bcb9c8c50c430f1c3930dca28ddc9a888e18/reactor-core-3.7.12.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-core-reactive/4.10.9/dfc8b80aa292fc69d70633427d8d410f46c6b4d3/micronaut-core-reactive-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/io.micronaut/micronaut-core/4.10.9/c6497df7a530bef51e249b98e0045206f3795cde/micronaut-core-4.10.9.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/ch.qos.logback/logback-core/1.5.19/8847d9fcb02c62c338ba26e2b28059dd585ea1a9/logback-core-1.5.19.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/2.0.17/d9e58ac9c7779ba3bf8142aff6c830617a7fe60f/slf4j-api-2.0.17.jar:/home/vnicolaou/.gradle/caches/modules-2/files-2.1/jakarta.inject/jakarta.inject-api/2.0.1/4c28afe1991a941d7702fe1362c365f0a8641d1e/jakarta.inject-api-2.0.1.jar \
--no-fallback \
-o \
/home/vnicolaou/micronaut-examples/hello-world/build/native/nativeCompile/hello-world \
-H:ConfigurationFileDirectories=/home/vnicolaou/micronaut-examples/hello-world/build/native/generated/generateResourcesConfigFile,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/io.netty/netty-codec-http/4.1.80.Final,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/io.netty/netty-common/4.1.115.Final,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/io.netty/netty-buffer/4.1.80.Final,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/io.netty/netty-transport/4.1.115.Final,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/io.netty/netty-handler/4.1.80.Final,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/io.netty/netty-codec-http2/4.1.80.Final,/home/vnicolaou/.gradle/native-build-tools/repositories/e9790c7797027769f26f2d1a01f8c1857716d125/exploded/ch.qos.logback/logback-classic/1.4.9 \
hello.world.Application

[vaslabs]

oh by writing this I think actually found the issue:

I think I've messed up the classpath, I'll change it to similar flow as with spring -> module -> aot module -> native module and see what happens

[vaslabs]

I have also not yet fully captured this gradle config in mill

micronaut {
    runtime("netty")
    testRuntime("junit5")
    processing {
        incremental(true)
        annotations("hello.world.*")
    }
    aot {
        // Please review carefully the optimizations enabled below
        // Check https://micronaut-projects.github.io/micronaut-aot/latest/guide/ for more details
        optimizeServiceLoading = false
        convertYamlToJava = false
        precomputeOperations = true
        cacheEnvironment = true
        optimizeClassLoading = true
        deduceEnvironment = true
        optimizeNetty = true
        replaceLogbackXml = true
    }
}

[vaslabs]

actually I had a typo here

.flatMap(file => Seq("--exclude-config", s"\\Q${file.path.toString}\\E", s"^${containedNativeImageConfig}.*"))

->

.flatMap(file => Seq("--exclude-config", s"\\Q${file.path.toString}\\E", s"^/${containedNativeImageConfig}.*"))

with this it works

so I'll summarise what we need to do in the next comment

[vaslabs]

right now, the important bit that makes this work is

val banned = Set(
      "netty-transport-4.2.7.Final.jar",
      "netty-codec-http-4.2.7.Final.jar",
      "netty-common-4.2.7.Final.jar",
      "netty-handler-4.2.7.Final.jar",
      "netty-buffer-4.2.7.Final.jar",
      "netty-codec-http2-4.2.7.Final.jar"
    )

    def jarHasNativeImageDir(pr: PathRef): Boolean = {
      scala.util.Using.resource(new JarInputStream(java.nio.file.Files.newInputStream(pr.path.toNIO))) { jis =>
        Iterator
          .continually(jis.getNextJarEntry)
          .takeWhile(_ != null)
          .exists { e =>
            val name = e.getName
            name != null && name.startsWith(containedNativeImageConfig)
          }
      }
    }

    def excludeDepNativeConfigs = Task {
      defaultResolver().classpath(nettyDeps(), boms = outer.allBomDeps())
        .filter(_.path.ext == "jar")
        .filter(jarHasNativeImageDir)
        .filter(pr => banned.exists(p => pr.path.toString.contains(p)))
        .flatMap(file => Seq("--exclude-config", s"\\Q${file.path.toString}\\E", s"^/${containedNativeImageConfig}.*"))
    }

it seems that the "banned" list is constructed such that:

If a dependency is found in the reachability metadata, then we need to add an exclusion rule in native image (with --exclude-config). If we just exclude everything, it still doesn't work, it segfaults.

We can add this logic in mill -> not micronaut specific

[vaslabs]

I suspect the exclusion is purely done on the override flag from the reachability metadata