Getting Illegal instruction (core dumped) exec bin/glean-server --db-root db --schema schema/source --port 12345

[humanbeeng]

Reproduce steps:

1. Pull demo docker image
2. Run docker run -it -p 8888:8888 ghcr.io/facebookincubator/glean/demo:latest

[simonmar]

What hardware are you running this on?

[humanbeeng]

CPU: AMD FX8350
OS: Ubuntu 22

[humanbeeng]

Hey Simon!
Do you need any additional info ?

[simonmar]

Glean is built with -march=haswell and uses AVX2, it's possible this isn't compatible with your CPU but I'm not sure.

[humanbeeng]

Attaching build logs for reference.

[94/351] Generating python files. Output: /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation
FAILED: thrift/annotation/gen-cpp2/python_constants.h thrift/annotation/gen-cpp2/python_data.h thrift/annotation/gen-cpp2/python_metadata.h thrift/annotation/gen-cpp2/python_types.h thrift/annotation/gen-cpp2/python_types.tcc thrift/annotation/gen-cpp2/python_constants.cpp thrift/annotation/gen-cpp2/python_data.cpp thrift/annotation/gen-cpp2/python_types.cpp /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/python_constants.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/python_data.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/python_metadata.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/python_types.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/python_types.tcc /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/python_constants.cpp /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/python_data.cpp /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/python_types.cpp 
cd /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation && /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/bin/thrift1 --gen mstch_cpp2:templates,no_metadata,include_prefix=thrift/annotation -o /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation -I /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/repos/github.com-facebook-fbthrift.git /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/repos/github.com-facebook-fbthrift.git/thrift/annotation/python.thrift
Illegal instruction (core dumped)
[95/351] Generating scope files. Output: /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation
FAILED: thrift/annotation/gen-cpp2/scope_constants.h thrift/annotation/gen-cpp2/scope_data.h thrift/annotation/gen-cpp2/scope_metadata.h thrift/annotation/gen-cpp2/scope_types.h thrift/annotation/gen-cpp2/scope_types.tcc thrift/annotation/gen-cpp2/scope_constants.cpp thrift/annotation/gen-cpp2/scope_data.cpp thrift/annotation/gen-cpp2/scope_types.cpp /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/scope_constants.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/scope_data.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/scope_metadata.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/scope_types.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/scope_types.tcc /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/scope_constants.cpp /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/scope_data.cpp /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/scope_types.cpp 
cd /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation && /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/bin/thrift1 --gen mstch_cpp2:templates,no_metadata,include_prefix=thrift/annotation -o /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation -I /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/repos/github.com-facebook-fbthrift.git /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/repos/github.com-facebook-fbthrift.git/thrift/annotation/scope.thrift
Illegal instruction (core dumped)
[96/351] Generating thrift files. Output: /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation
FAILED: thrift/annotation/gen-cpp2/thrift_constants.h thrift/annotation/gen-cpp2/thrift_data.h thrift/annotation/gen-cpp2/thrift_metadata.h thrift/annotation/gen-cpp2/thrift_types.h thrift/annotation/gen-cpp2/thrift_types.tcc thrift/annotation/gen-cpp2/thrift_constants.cpp thrift/annotation/gen-cpp2/thrift_data.cpp thrift/annotation/gen-cpp2/thrift_types.cpp /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/thrift_constants.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/thrift_data.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/thrift_metadata.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/thrift_types.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/thrift_types.tcc /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/thrift_constants.cpp /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/thrift_data.cpp /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/thrift_types.cpp 
cd /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation && /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/bin/thrift1 --gen mstch_cpp2:templates,no_metadata,include_prefix=thrift/annotation -o /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation -I /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/repos/github.com-facebook-fbthrift.git /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/repos/github.com-facebook-fbthrift.git/thrift/annotation/thrift.thrift
Illegal instruction (core dumped)
[97/351] Generating cpp files. Output: /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation
FAILED: thrift/annotation/gen-cpp2/cpp_constants.h thrift/annotation/gen-cpp2/cpp_data.h thrift/annotation/gen-cpp2/cpp_metadata.h thrift/annotation/gen-cpp2/cpp_types.h thrift/annotation/gen-cpp2/cpp_types.tcc thrift/annotation/gen-cpp2/cpp_constants.cpp thrift/annotation/gen-cpp2/cpp_data.cpp thrift/annotation/gen-cpp2/cpp_types.cpp /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/cpp_constants.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/cpp_data.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/cpp_metadata.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/cpp_types.h /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/cpp_types.tcc /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/cpp_constants.cpp /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/cpp_data.cpp /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation/gen-cpp2/cpp_types.cpp 
cd /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation && /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/bin/thrift1 --gen mstch_cpp2:templates,no_metadata,include_prefix=thrift/annotation -o /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift/thrift/annotation -I /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/repos/github.com-facebook-fbthrift.git /tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/repos/github.com-facebook-fbthrift.git/thrift/annotation/cpp.thrift
Illegal instruction (core dumped)
ninja: build stopped: subcommand failed.
Command '['/usr/bin/cmake', '--build', '/tmp/fbcode_builder_getdeps-ZhomeZhumanbeengZprojectsZread-onlyZGleanZhsthriftZbuildZfbcode_builder/build/fbthrift', '--target', 'install', '--config', 'Release', '-j', '4']' returned non-zero exit status 1.
!! Failed

My CPU does not support AVX2. I ran grep avx2 /proc/cpuinfo and it returned nothing. But anyways, thanks for the response.

[simonmar]

It is possible to build Glean without the AVX dependency; we do it for ARM platforms. It requires some changes to the codebase though, all the bits are #ifdef __x86_64__ at the moment, e.g. https://github.com/facebookincubator/Glean/blob/main/glean/rts/ownership/setu32.h#L20

So my guess is you would need to change those ifdefs and then remove -march=haswell from the build system glean.cabal.in and hsthrift/build.sh.