ninja fatal error on sgx.h. linux/bits.h: File or directory not found

[MatheusB4]

Hello,

I’m using ninja to build dcap enabled gramine. However, upon using the command, ninja -C build/ I get the following prompt:

ninja: Entering directory `build/'
[1/252] Compiling C object pal/src/h...ffsets-print.p/generated_offsets.c.o
FAILED: pal/src/host/linux-sgx/pal-sgx-generated-offsets-print.p/generated_offsets.c.o
cc -Ipal/src/host/linux-sgx/pal-sgx-generated-offsets-print.p -Ipal/src/host/linux-sgx -I../pal/src/host/linux-sgx -Ipal/include -I../pal/include -I../pal/include/pal -I../pal/include/arch/x86_64 -Icommon/include -I../common/include -I../common/include/arch/x86_64 -I../pal/include/arch/x86_64/linux -I../pal/include/host/linux-common -fdiagnostics-color=always -D_FILE_OFFSET_BITS=64 -Wall -Winvalid-pch -std=c11 -O3 -Wa,--noexecstack -Wall -Wextra -Wmissing-prototypes -Wstrict-prototypes -Wwrite-strings -Wtrampolines -Wnull-dereference -DIN_PAL -ffreestanding -fPIC -DHOST_TYPE=Linux-SGX -Wno-gnu-alignof-expression -MD -MQ pal/src/host/linux-sgx/pal-sgx-generated-offsets-print.p/generated_offsets.c.o -MF pal/src/host/linux-sgx/pal-sgx-generated-offsets-print.p/generated_offsets.c.o.d -o pal/src/host/linux-sgx/pal-sgx-generated-offsets-print.p/generated_offsets.c.o -c ../pal/src/host/linux-sgx/generated_offsets.c
In file included from pal/src/host/linux-sgx/host_sgx_driver.h:16,
                 from ../pal/src/host/linux-sgx/generated_offsets.c:4:
/usr/src/linux-hwe-5.13-headers-5.13.0-52/arch/x86/include/asm/sgx.h:10:10: fatal error: linux/bits.h: File or directory not found
   10 | #include <linux/bits.h>
      |          ^~~~~~~~~~~~~~
compilation terminated.
[2/252] Generating libos/include/gramine_hash.h with a custom command
ninja: build stopped: subcommand failed.

Using the locate command, I could find the absolute path to linux/bits.h:

>> locate linux/bits.h
/usr/src/linux-headers-5.4.0-162/include/linux/bits.h
/usr/src/linux-hwe-5.11-headers-5.11.0-46/include/linux/bits.h
/usr/src/linux-hwe-5.13-headers-5.13.0-52/include/linux/bits.h
/usr/src/linux-hwe-5.15-headers-5.15.0-82/include/linux/bits.h
/usr/src/linux-hwe-5.15-headers-5.15.0-83/include/linux/bits.h
/usr/src/linux-hwe-5.8-headers-5.8.0-59/include/linux/bits.h

I tried adding the path to linux/bits.h to the CPATH variable, but it didn’t help.

Furthermore, i tried checking the standard directories the compiler was accessing to execute the include directive using the command gcc -E -Wp,-v - and got:

ignoring nonexistent directory "/usr/local/include/x86_64-linux-gnu"
ignoring nonexistent directory "/usr/lib/gcc/x86_64-linux-gnu/9/include-fixed"
ignoring nonexistent directory "/usr/lib/gcc/x86_64-linux-gnu/9/../../../../x86_64-linux-gnu/include"
#include "..." search starts here:
#include <...> search starts here:
 /usr/src/linux-hwe-5.13-headers-5.13.0-52/include/linux
 /usr/lib/gcc/x86_64-linux-gnu/9/include
 /usr/local/include
 /usr/include/x86_64-linux-gnu
 /usr/include
End of search list.

Then I tried following the tutorial on https://stackoverflow.com/questions/5493895/how-to-permanently-adding-directories-to-the-gcc-include-search-path, as a workaround, but that doesn't seem to work either.

Is the problem coming from ninja, my environment or meson misconfiguration? Can someone help me?

I’m getting too many “File or directory not found” errors even thought the files are present while building gramine. Is there something obvious I might be missing?

[dimakuv]

@MatheusB4 Looks like you specify a wrong path of the SGX driver when configuring Meson.

Please check the discussion starting from here: #895 (comment)

[MatheusB4]

Thank you Mr. Dmitrii.