Android 64 bits ARM build config

[danielweck]

Android launcher app:
in feature/arm64 branch:
https://github.com/readium/readium-sdk/commits/feature/arm64
3bc240f

OpenSSL:
in feature/arm64 branch:
https://github.com/readium/openssl-android/commits/feature/arm64
https://github.com/readium/openssl-android/commit/3c01400f78ba1e7bb29e51832f530959534e9664
Once compiled, copy static lib to:
https://github.com/readium/readium-sdk/tree/develop/ePub3/ThirdParty/openssl-android/lib

ICU4C:
TODO: https://github.com/readium/readium-sdk/blob/develop/ePub3/ThirdParty/icu4c/lib/README.md
https://github.com/membase/icu4c
Once compiled, copy static lib to:
https://github.com/readium/readium-sdk/tree/develop/ePub3/ThirdParty/icu4c/lib

[danielweck]

Could this help for ICU? https://github.com/ericwlange/hemroid/tree/master/packages/icu
https://github.com/android/platform_external_icu4c

[naveenrajproject]

Checked out feature/arm64 branch and run it in Android Studio 2.2 preview.

"Already compiled icu4c, openssl and boost for arm64 and x86_64.
Copied those static libs inside
for icu4c: ePub3/ThirdParty/icu4c/lib/arm64-v8a/libicuuc.a, libicudata.a, libicui18n.a, libicuio.a
And similarly for openssl: ePub3/ThirdParty/openssl-android/lib/arm64-v8a/libcrypto.a, libssl.a
And for boost: ePub3/ThirdParty/boost/lib/arm64-v8a/libboost_regex.a"

After build, Got below Error:

/.../readium-sdk-arm64/ePub3/utilities/CPUCacheUtils.c
Error:(31) undefined reference to epub_sys_cache_flush' Error:(28) undefined reference toepub_sys_cache_invalidate'
Error:error: ld returned 1 exit status
make: *** [/.../readium-sdk-arm64/Platform/Android/epub3/obj/local/arm64-v8a/libepub3.so] Error 1
:epub3:buildMk FAILED
Error:Execution failed for task ':epub3:buildMk'.

Process 'command '/.../.../Android-SDK/ndk-bundle/ndk-build'' finished with non-zero exit value 2

It's same error which i have posted here
readium/SDKLauncher-Android#96 (2 days ago)

I think, It is missing the file similar as ePub3/utilities/CPUCacheUtils_arm.S

however I tried to compiled by adding "|| defined(_ aarch64 _)" in CPUCacheUtils_arm.S file then it's throws

[arm64-v8a] Compile : epub3 <= CPUCacheUtils_arm.S
././../../../ePub3/utilities/CPUCacheUtils_arm.S: Assembler messages:
Error:Error: operand 1 should be an integer register -- mov r3,#0' Error:Error: operand 1 should be an integer register --mov r12,#0x80000000'
Error:Error: unknown mnemonic swi' --swi #0x80'
Error:Error: unknown mnemonic bx' --bx lr'
Error:Error: operand 1 should be an integer register -- mov r3,#1' Error:Error: operand 1 should be an integer register --mov r12,#0x80000000'
Error:Error: unknown mnemonic swi' --swi #0x80'
Error:Error: unknown mnemonic bx' --bx lr'

[danielweck]

Well, unless ENABLE_SYS_CACHE_FLUSH is defined, the "CPU cache util" stuff should not be included in the build:
https://github.com/readium/readium-sdk/blob/develop/ePub3/utilities/byte_buffer.cpp#L27

#ifdef ENABLE_SYS_CACHE_FLUSH
#include "CPUCacheUtils.h"
#endif //ENABLE_SYS_CACHE_FLUSH
...
...

void ByteBuffer::Clean(unsigned char *ptr, size_t len)
{
    bzero(ptr, len);

#ifdef ENABLE_SYS_CACHE_FLUSH
    epub_sys_cache_flush(ptr, len);
#endif //ENABLE_SYS_CACHE_FLUSH
}

See:
0c6c54f

Also see:
readium/SDKLauncher-iOS#38 (comment)

Ah, I see that the "CPU Cache Utils" are included in the build (they can be removed, as they are unused):

https://github.com/readium/readium-sdk/blob/develop/Platform/Android/epub3/Stable.mk#L242
https://github.com/readium/readium-sdk/blob/develop/Platform/Android/epub3/Experimental.mk#L241

LOCAL_SRC_FILES := \
...
    $(EPUB3_PATH)/utilities/CPUCacheUtils_arm.S \
    $(EPUB3_PATH)/utilities/CPUCacheUtils_i386.S \
    $(EPUB3_PATH)/utilities/CPUCacheUtils_x64.S \
    $(EPUB3_PATH)/utilities/CPUCacheUtils.c \

[danielweck]

@naveenrajproject Boost is not needed anymore in Android (develop branch)

[danielweck]

@naveenrajproject can you please explain how you built ICU4C for arm64-v8a (so we can add the instructions in this issue's description)

[naveenrajproject]

Build process for icu4c 64 bit(arm and x86_64)
Reference from : http://wudev.digitaltorque.com/2014/03/building-readium-for-x86-android.html

arm64-v8a_AND_ x86_64.zip

1. Download source code from http://site.icu-project.org/download/57#TOC-ICU4C-Download for your host operating system.
   As I am using Mac, i used http://download.icu-project.org/files/icu4c/57.1/icu4c-57_1-src.tgz
2. extract it.

STEP 1: configure and build for your own machine (we'll build for Android afterwards). You can run these commands individually or past them into a shell script.

ICU$ mkdir build_icu_osx
ICU$ cd build_icu_osx
ICU/build_icu_osx$ export BASE_ICU_DIR = the parent ICU dir where you downloaded icu
ICU/build_icu_osx$ export ICU_SOURCES=$BASE_ICU_DIR/icu-57.1
ICU/build_icu_osx$ export CPPFLAGS="-O3 -DU_USING_ICU_NAMESPACE=1 -fno-short-enums
-DU_HAVE_NL_LANGINFO_CODESET=0 -D__STDC_INT64__ -DU_TIMEZONE=0
-DUCONFIG_NO_LEGACY_CONVERSION=1 -DUCONFIG_NO_BREAK_ITERATION=1
-DUCONFIG_NO_COLLATION=1 -DUCONFIG_NO_FORMATTING=1 -DUCONFIG_NO_TRANSLITERATION=0
-DUCONFIG_NO_REGULAR_EXPRESSIONS=1"
ICU/build_icu_osx$ sh $ICU_SOURCES/source/runConfigureICU Linux --prefix=$PWD/icu_build --enable-extras=no
--enable-strict=no -enable-static --enable-shared=no --enable-tests=no
--enable-samples=no --enable-dyload=no
ICU/build_icu_osx$ make -j4
ICU/build_icu_osx$ make install
ICU/build_icu_osx$ cd ..

STEP 2: Configure and build for Android. Note that the first two lines here may need to be altered for your system, platform, and NDK (to support 64 bit, we need NDK version more than r10c, recomended latest one).
ICU$ mkdir build_icu_android
ICU$ cd build_icu_android
ICU/build_icu_android$ export NDK_ROOT= NDK full path (/Users/smishra/Developement/Android-NDK)
ICU/build_icu_android$ export NDK_TOOLCHAIN_BIN=$NDK_ROOT/toolchains/aarch64-linux-android-4.9/prebuilt/darwin-x86_64/bin
ICU/build_icu_android$ export SDK_ROOT=$NDK_ROOT/platforms/android-21/arch-arm64
ICU/build_icu_android$ export ICU_PATH=path of icu source code. (e.g: /Users/smishra/Readium-Thirdparty/ICU/icu-57.1)
ICU/build_icu_android$ export ICU_CROSS=path of host build icu (result of step 1) (e.g:/Users/smishra/Readium-Thirdparty/ICU/build_icu_osx)
ICU/build_icu_android$ export ICU_FLAGS="-I$ICU_PATH/source/common/ -I$ICU_PATH/source/tools/tzcode/"

ICU/build_icu_android$ export CPPFLAGS="-fno-exceptions --sysroot=$SDK_ROOT -D__STDC_INT64__ $ICU_FLAGS -I$SDK_ROOT/usr/include/ -I$NDK_ROOT/platforms/android-21/arch-arm64/usr/include -I$NDK_ROOT/sources/cxx-stl/gnu-libstdc++/4.9/include -I$NDK_ROOT/sources/cxx-stl/gnu-libstdc++/4.9/libs/arm64-v8a/include"

ICU/build_icu_android$ export LDFLAGS="-lsupc++ -lgnustl_static --sysroot=$SDK_ROOT -L$NDK_ROOT/sources/cxx-stl/gnu-libstdc++/4.9/libs/arm64-v8a/ -Wl,-rpath-link=$NDK_ROOT/platforms/android-21/arch-arm64/usr/lib/"
ICU/build_icu_android$ export CC=$NDK_TOOLCHAIN_BIN/aarch64-linux-android-gcc
ICU/build_icu_android$ export CXX=$NDK_TOOLCHAIN_BIN/aarch64-linux-android-g++
ICU/build_icu_android$ export RANLIB=$NDK_TOOLCHAIN_BIN/aarch64-linux-android-gcc-ranlib
ICU/build_icu_android$ export AR=$NDK_TOOLCHAIN_BIN/aarch64-linux-android-ar
ICU/build_icu_android$ export LD=$NDK_TOOLCHAIN_BIN/aarch64-linux-android-ld
ICU/build_icu_android$ sh $ICU_PATH/source/configure --host=arm-v8a-linux-android --enable-extras=no --enable-strict=no --enable-static --enable-shared=no --enable-tests=no --enable-samples=no --enable-dyload=no --with-cross-build=$ICU_CROSS --prefix $PWD/icu_build

OR you can execute the attached script file to build for android, as in step 2

STEP 3: Remove compiling ICU tools from the Makefile. Open the Makefile that the configure call created and search for the word "tools." Remove it from the line setting the SUBDIRS variable.

STEP 4: Build ICU
ICU/build_icu_android$ make -j4
ICU/build_icu_android$ make install