bazel: align Linux MKL release parity (#3662)

* bazel: align Linux MKL release parity

Align Bazel Linux MKL release output with Make by fixing oneAPI, parameter, threading, ELF metadata, algorithm coverage, and Linux release packaging boundaries.

Validation on onedal-build:
- bazelisk clean
- bazelisk build //:release --backend_config=mkl --release_dpc=false --jobs=8 --verbose_failures
- passed in 327.09s, 3179 actions

Final compare vs Make MKL release:
- release tree: only_make 0, only_bazel 0
- libonedal_core: members 1919/1919, exports 8545/8545, MKL exports 0
- libonedal_thread: members 2/2, exports 319/319, MKL exports 0
- libonedal: exports 3422/3422, MKL exports 0
- libonedal_parameters: members 8/8, exports 71/71, MKL exports 0
- SONAME/DT_NEEDED match for checked libs; RUNPATH absent

Report:
- /home/ubuntu/onedal-mkl-rootcause-20260614-223805/mkl-close-gaps-final-report.txt

* bazel: fix PR parity CI issues

Add missing license headers for new files.

Use Linux release SONAME symlinks in @onedal_release imports so release-dynamic Bazel example tests can resolve libonedal*.so.4 from _solib runfiles while release artifacts stay RUNPATH-free.

Let only the DPC dynamic oneAPI library include DAAL-tagged objects needed by DPC host helpers, without restoring DAAL object leakage to the host libonedal.so.

* bazel: address MKL parity review findings

* bazel: share release metadata checks

* ci: avoid GitHub API in Bazelisk bootstrap

* ci: compare Make and Bazel release artifacts

* ci: restore Bazelisk release metadata lookup

* bazel: hardcode binary ABI version

* ci: fix Bazel and Conda PR checks

* bazel: fix release dynamic linkage

* bazel: align release metadata generation

* bazel: match release config metadata

* bazel: resolve Windows onedal services link

* bazel: embed DAAL objects into Windows onedal.dll

The previous attempt to bring in DAAL symbols on Windows via
`core_embed` + `core_dynamic` host_deps only re-added the services
+ data_management + DLL shim and the onedal_core import library, but
the Windows linker still saw unresolved DAAL classes consumed
object-locally inside onedal.dll: PCA `interface3::BatchParameter`
ctor / `check()`, PCA `BatchKernel<...>::compute(...)`, covariance
`interface1::Batch` ctor / `Input::set` / `Input::~Input`, and zscore
`interface3::Batch` ctor — none of which onedal_core.dll exports.
lld-link emits hundreds of "undefined symbol" errors and fails the
release build with "too many errors emitted".

Linux .so links are tolerant of unresolved externals and resolve
those DAAL symbols at runtime via DT_NEEDED libonedal_core.so.
Windows DLLs must resolve everything at link time.

Restore link-time resolution by selecting "daal" into the host
`lib_tags` on Windows, mirroring the DPC variant. The DAAL-tagged
objects then flow into onedal.dll directly. Drop the now-unneeded
core_embed module and the core_dynamic host_dep, and keep only
services_win_dll_shim (delay-loads the threading entry points the
embedded kernels reference). On Linux the host build keeps
lib_tags=["dal"] so DAAL is not duplicated into libonedal.so.

* bazel: restore MKL link inputs for DPC DLL

* bazel: fix Windows DPC parameters linkage

* bazel: embed MKL into Windows onedal DLL

* bazel: fix Windows host parameters linkage

* bazel: link LR optimizer into Windows parameters DLL

* conda: avoid timestamped TBB staging path

* ci: normalize build date in release compare

* ci: use package-aware oneDAL setup

Author: napetrov

.ci/pipeline/ci.yml

@@ -415,7 +415,7 @@ jobs:
       # Display oneDAL build configuration
       bazel build @config//:dump
       echo
-      cat bazel-bin/external/+_repo_rules+config/config.json
+      cat bazel-bin/external/+declare_onedal_config+config/config.json
       echo
     displayName: 'bazel-configure'
 
@@ -524,10 +524,12 @@ jobs:
     displayName: 'Clean Bazel cache (expunge)'
 
   - script: |
+      . "$(DALROOT)/env/vars.sh"
       bazel test //examples/daal/cpp:all \
                  --test_link_mode=release_dynamic \
                  --test_thread_mode=par \
-                 --test_env DALROOT
+                 --test_env DALROOT \
+                 --test_env LD_LIBRARY_PATH
     displayName: 'daal-cpp-examples-thread-release-dynamic'
 
   - script: |
@@ -536,10 +538,12 @@ jobs:
     displayName: 'Clean Bazel cache (expunge)'
 
   - script: |
+      . "$(DALROOT)/env/vars.sh"
       bazel test //examples/oneapi/cpp:all \
                  --test_link_mode=release_dynamic \
                  --test_thread_mode=par \
-                 --test_env DALROOT
+                 --test_env DALROOT \
+                 --test_env LD_LIBRARY_PATH
     displayName: 'cpp-examples-thread-release-dynamic'
 
   - script: |
@@ -593,6 +597,27 @@ jobs:
       fi
     displayName: 'bazel-cache-limit'
 
+- job: 'LinuxReleaseCompare'
+  dependsOn:
+  - LinuxMakeGNU_MKL
+  - LinuxBazel
+  pool:
+    vmImage: '$(VM_IMAGE)'
+  steps:
+  - task: DownloadPipelineArtifact@2
+    inputs:
+      artifact: 'lnx32e build'
+      path: '$(Pipeline.Workspace)/make'
+  - task: DownloadPipelineArtifact@2
+    inputs:
+      artifact: 'lnx32e Bazel build'
+      path: '$(Pipeline.Workspace)/bazel'
+  - script: |
+      python3 dev/release_tests/compare_release_trees.py \
+        --platform linux \
+        --make "$(Pipeline.Workspace)/make/daal/latest" \
+        --bazel "$(Pipeline.Workspace)/bazel"
+    displayName: 'Compare Make and Bazel release trees'
 
 - job: 'WindowsBazel'
   timeoutInMinutes: 0
@@ -849,6 +874,12 @@ jobs:
       call %TEMP%\oneapi\setvars.bat --force
       .\.ci\scripts\build.bat onedal_dpc icx avx2
     displayName: 'make onedal_dpc'
+  - task: PublishPipelineArtifact@1
+    inputs:
+      artifactName: '$(platform.type) icx build'
+      targetPath: '$(Build.Repository.LocalPath)/$(release.dir)'
+    displayName: 'Upload Intel build artifacts'
+    continueOnError: true
   - script: |
       call %TEMP%\oneapi\setvars.bat --force
       .\.ci\scripts\test.bat daal\cpp lib icx cmake
@@ -866,6 +897,30 @@ jobs:
       ls -lh __nuget/inteldal*.nupkg
     displayName: 'nuget pkg'
 
+- job: 'WindowsReleaseCompare'
+  dependsOn:
+  - WindowsMakeIntel
+  - WindowsBazel
+  pool:
+    vmImage: '$(WIN_VM_IMAGE)'
+  steps:
+  - task: DownloadPipelineArtifact@2
+    inputs:
+      artifact: 'win32e icx build'
+      path: '$(Pipeline.Workspace)\make'
+  - task: DownloadPipelineArtifact@2
+    inputs:
+      artifact: 'win32e Bazel icx build'
+      path: '$(Pipeline.Workspace)\bazel'
+  - powershell: |
+      python dev/release_tests/compare_release_trees.py `
+        --platform windows `
+        --structure-only `
+        --make "$(Pipeline.Workspace)\make\daal\latest" `
+        --bazel "$(Pipeline.Workspace)\bazel"
+    displayName: 'Compare Make and Bazel release tree structure'
+    continueOnError: true
+
 
 - job: WindowsSklearnex
   dependsOn: WindowsMakeVC

BUILD

@@ -4,8 +4,10 @@ load("@onedal//dev/bazel:release.bzl",
     "release_extra_file",
 )
 load("@onedal//dev/bazel:scripts.bzl",
-    "generate_vars_sh",
+    "generate_cmake_config",
+    "generate_modulefile",
     "generate_pkgconfig",
+    "generate_vars_sh",
 )
 
 config_setting(
@@ -18,6 +20,11 @@ generate_vars_sh(
     out = "env/vars.sh",
 )
 
+generate_modulefile(
+    name = "release_modulefile_dal",
+    out = "modulefiles/dal",
+)
+
 generate_pkgconfig(
     name = "release_pkgconfig",
     out = "lib/pkgconfig/onedal.pc",
@@ -39,14 +46,16 @@ filegroup(
     srcs = ["@onedal//cpp/oneapi/dal:public_includes"],
 )
 
-filegroup(
+generate_cmake_config(
     name = "release_cmake_config",
-    srcs = ["cmake/templates/oneDALConfig.cmake.in"],
+    template = "cmake/templates/oneDALConfig.cmake.in",
+    out = "lib/cmake/oneDAL/oneDALConfig.cmake",
 )
 
-filegroup(
+generate_cmake_config(
     name = "release_cmake_config_version",
-    srcs = ["cmake/templates/oneDALConfigVersion.cmake.in"],
+    template = "cmake/templates/oneDALConfigVersion.cmake.in",
+    out = "lib/cmake/oneDAL/oneDALConfigVersion.cmake",
 )
 
 filegroup(
@@ -64,14 +73,22 @@ filegroup(
     srcs = ["deploy/nuget/inteldal.nuspec.tpl"],
 )
 
+filegroup(
+    name = "release_mpi_daal_lst_linux",
+    srcs = ["samples/daal/cpp/mpi/daal_lnx.lst"],
+)
+
+filegroup(
+    name = "release_mpi_makefile_linux",
+    srcs = ["samples/daal/cpp/mpi/makefile_lnx"],
+)
+
 filegroup(
     name = "release_package_files",
     srcs = glob([
         "examples/cmake/setup_examples.cmake",
         "samples/cmake/*.cmake",
         "samples/daal/cpp/mpi/CMakeLists.txt",
-        "samples/daal/cpp/mpi/daal.lst.bat",
-        "samples/daal/cpp/mpi/launcher.bat",
         "samples/daal/cpp/mpi/license.txt",
         "samples/daal/cpp/mpi/resources/*",
         "samples/daal/cpp/mpi/sources/*.cpp",
@@ -82,7 +99,13 @@ filegroup(
         "samples/oneapi/cpp/mpi/CMakeLists.txt",
         "samples/oneapi/cpp/mpi/sources/*.cpp",
         "samples/oneapi/cpp/mpi/sources/*.hpp",
-    ]),
+    ]) + select({
+        ":windows": glob([
+            "samples/daal/cpp/mpi/daal.lst.bat",
+            "samples/daal/cpp/mpi/launcher.bat",
+        ]),
+        "//conditions:default": [],
+    }),
 )
 
 release(
@@ -123,17 +146,21 @@ release(
         "//data:datasets",
         ":release_package_files",
         "//examples/daal/cpp:release_files",
+        "//examples/oneapi/cpp:release_files",
     ],
     extra_files = [
         release_extra_file(":release_vars_sh", "env/vars.sh", windows_dst_path = "env/vars.bat"),
-        release_extra_file(":release_pkgconfig", "lib/pkgconfig/onedal.pc", windows_dst_path = ""),
-        release_extra_file(":release_pkgconfig_dynamic_threading_host", "", windows_dst_path = "lib/pkgconfig/dal-dynamic-threading-host.pc"),
-        release_extra_file(":release_pkgconfig_static_threading_host", "", windows_dst_path = "lib/pkgconfig/dal-static-threading-host.pc"),
+        release_extra_file(":release_pkgconfig", "", windows_dst_path = "lib/pkgconfig/onedal.pc"),
+        release_extra_file(":release_pkgconfig_dynamic_threading_host", "lib/pkgconfig/dal-dynamic-threading-host.pc", windows_dst_path = ""),
+        release_extra_file(":release_pkgconfig_static_threading_host", "lib/pkgconfig/dal-static-threading-host.pc", windows_dst_path = ""),
         release_extra_file("//deploy/local:config_file", "config/config.txt"),
+        release_extra_file(":release_modulefile_dal", "modulefiles/dal", windows_dst_path = ""),
+        release_extra_file(":release_mpi_daal_lst_linux", "samples/daal/cpp/mpi/daal.lst", windows_dst_path = ""),
+        release_extra_file(":release_mpi_makefile_linux", "samples/daal/cpp/mpi/makefile", windows_dst_path = ""),
         release_extra_file(":release_cmake_config", "lib/cmake/oneDAL/oneDALConfig.cmake"),
         release_extra_file(":release_cmake_config_version", "lib/cmake/oneDAL/oneDALConfigVersion.cmake"),
-        release_extra_file(":release_nuspec_devel", "nuspec/inteldal.devel.win-x64.nuspec", windows_dst_path = "nuspec/inteldal.devel.win-x64.nuspec"),
-        release_extra_file(":release_nuspec_redist", "nuspec/inteldal.redist.win-x64.nuspec", windows_dst_path = "nuspec/inteldal.redist.win-x64.nuspec"),
-        release_extra_file(":release_nuspec_static", "nuspec/inteldal.static.win-x64.nuspec", windows_dst_path = "nuspec/inteldal.static.win-x64.nuspec"),
+        release_extra_file(":release_nuspec_devel", "nuspec/inteldal.devel.linux.nuspec", windows_dst_path = "nuspec/inteldal.devel.win-x64.nuspec"),
+        release_extra_file(":release_nuspec_redist", "nuspec/inteldal.redist.linux.nuspec", windows_dst_path = "nuspec/inteldal.redist.win-x64.nuspec"),
+        release_extra_file(":release_nuspec_static", "nuspec/inteldal.static.linux.nuspec", windows_dst_path = "nuspec/inteldal.static.win-x64.nuspec"),
     ],
 )

conda-recipe/build.sh

@@ -27,10 +27,11 @@ export DPL_ROOT=$PREFIX
 # libtbbmalloc.so.<N>, etc.) while oneDAL Make expects unversioned names in
 # TBBROOT/lib prerequisites.  Mirror the full libtbb* tree into a staging dir,
 # adding unversioned symlinks where missing.
-# Keep the staging path outside $SRC_DIR: conda-build can create source work
-# directories with shell/make-special characters on rebuilds (for example
-# ".../work(1)"), and oneDAL Make uses TBBROOT in prerequisites.
-export TBBROOT="$BUILD_PREFIX/__onedal_tbbroot"
+# Keep the staging path outside conda-build work/build prefixes:
+# oneDAL Make escapes parentheses as "222" internally, so timestamped conda
+# paths containing that digit sequence can be decoded into bogus parentheses
+# when used in prerequisites.
+export TBBROOT="/tmp/onedal-tbbroot"
 rm -rf "$TBBROOT"
 mkdir -p "$TBBROOT/lib"
 

conda-recipe/meta.yaml

@@ -159,6 +159,7 @@ outputs:
       source_files:
         - examples
         - data
+        - dev/release_tests/package_metadata_test.sh
         - .ci/env/MKLConfig.cmake
       script: test-devel.sh  # [linux]
     about:

conda-recipe/test-devel.sh

@@ -16,8 +16,7 @@ set -eu
 # limitations under the License.
 #===============================================================================
 
-test -f $CONDA_PREFIX/lib/pkgconfig/dal-dynamic-threading-host.pc
-test -f $CONDA_PREFIX/lib/pkgconfig/dal-static-threading-host.pc
+./dev/release_tests/package_metadata_test.sh "$CONDA_PREFIX"
 
 # Load oneDAL environment helpers required by pkg-config/CMake example builds.
 . "$CONDA_PREFIX/env/vars.sh"

cpp/daal/BUILD

@@ -156,6 +156,7 @@ daal_module(
 daal_module(
     name = "threading_tbb",
     srcs = glob(["src/threading/**/*.cpp"]),
+    visibility_hidden = False,
     local_defines = [
         "__TBB_NO_IMPLICIT_LINKAGE",
         "__TBB_LEGACY_MODE",
@@ -227,6 +228,7 @@ daal_algorithms(
         "objective_function/cross_entropy_loss",
         "objective_function/logistic_loss",
         "objective_function/mse",
+        "objective_function/precomputed",
         "optimization_solver",
         "optimization_solver/lbfgs",
         "optimization_solver/coordinate_descent",
@@ -238,6 +240,7 @@ daal_algorithms(
         "ridge_regression",
         "svd",
         "svm",
+        "tsne",
     ],
 )
 
@@ -259,6 +262,10 @@ daal_static_lib(
     ],
 )
 
+exports_files([
+    "thread_dynamic.lds",
+])
+
 daal_dynamic_lib(
     name = "core_dynamic",
     lib_name = "onedal_core",
@@ -282,6 +289,7 @@ daal_dynamic_lib(
 daal_dynamic_lib(
     name = "thread_dynamic",
     lib_name = "onedal_thread",
+    linker_scripts = [":thread_dynamic.lds"],
     deps = [
         ":threading_tbb",
     ],

cpp/daal/src/algorithms/tsne/BUILD

@@ -0,0 +1,26 @@
+#===============================================================================
+# Copyright contributors to the oneDAL project
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#===============================================================================
+
+package(default_visibility = ["//visibility:public"])
+load("@onedal//dev/bazel:daal.bzl", "daal_module")
+
+daal_module(
+    name = "kernel",
+    auto = True,
+    deps = [
+        "@onedal//cpp/daal:core",
+    ],
+)

cpp/daal/thread_dynamic.lds

@@ -0,0 +1,22 @@
+/*
+ * Copyright contributors to the oneDAL project
+ *
+ * Licensed under the Apache License, Version 2.0 (the "License");
+ * you may not use this file except in compliance with the License.
+ * You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+{
+    local:
+        __bss_start;
+        _edata;
+        _end;
+};