Having an issue with testing alluxio

[rudi-romania]

I had posted an issue on this today, but thought I should also start a discussion. I am unable to successfully test the alluxio magpie configuration in my test environment. The problem I am having starts with the magpie/conf/alluxio-env.sh script not exporting its environment variables, but it does not end there. Even after correcting my copy of this file, I found that the ALLUXIO_CONF_DIR is being set on the worker nodes to point to the alluxio installation directory conf area and not the worker tmp area containing the alluxio-env.sh script, thus causing the environment variable for alluxio and java not to be set.

I attempted to also override the ALLUXIO_CONF_DIR in my batch submission script, but it was not propagated to the worker nodes.

The log file on the submission master node indicates also that the /tmp area does not exist on the master node.

Sorry to hit you with multiple alluxio issues, but I hope this helps with the resolution.