Package a swi-prolog binary with the binary wheels

[rmanhaeve]

Hi

Thank you for your work on Janus and SWI-Prolog in general.

I was wondering if you had considered packaging a (minimal) binary of SWI-Prolog along with the binary distributions of this package. This would greatly simplify the installation procedure (especially for other projects that have janus_swi as a dependency), and I would imagine this could also boost the popularity of SWI-Prolog as an easy to install package along all platforms.

Kind regards,
Robin Manhaeve

[JanWielemaker]

Thanks for the heads up and suggestion. Considered? Sort of 😄 There are many possible installation targets though and it is hard to me to judge the value and costs of all the alternatives. I've spent some time turning SWI-Prolog into an (ana)conda package. It sort of works with some limitations and getting it all setup and distributed seems a lot of work.

Binary wheels also come with their issues on the various platforms. I have very limited understanding of the Python binary package management. If people want to set this up, I'm happy to help from the Prolog side.

I heard some rumours that the wheel could also download and install the regular binary? Do you have any insight in that?

[rmanhaeve]

I'm not an expert myself, but I have a bit of experience in compiling external dependencies for binary wheels. We can make use of cibuildwheel and the Github-hosted runners to build the binary for basically all common platform.

Is there a way to build SWI Prolog with minimal dependencies?

[JanWielemaker]

Is there a way to build SWI Prolog with minimal dependencies?

Configure using cmake -DSWIPL_PACKAGES=OFF -DUSE_GM=OFF ... Then the only dependency is zlib.

I'm still a bit in doubt on how good an idea this is as it results in a quite crippled SWI-Prolog version. Possibly a better choice is to select all packages that do not pull in new dependencies. That can be done using cmake -DSWIPL_PACKAGE_LIST="clib;plunit;sgml;semweb;chr;clpqr;nlp;yaml;swipy" -DUSE_GM=OFF ... With a bit of tweaking we can probably get in some more (might even have forgotton some).

If you can get this working (even without any packages), I'm happy to jump in and try to add some more functionality.

[rmanhaeve]

I'll try to get a minimal case working in a fork, I'll update here when I've made some progress.

[rmanhaeve]

Which files from the build directory need to be included?

[JanWielemaker]

Which files from the build directory need to be included?

You need to run make install (or ninja install). Set -DCMAKE_INSTALL_PREFIX=dir to control the base location. I'd assume there are more examples around of creating wheels from cmake configured applications.

[JanWielemaker]

This issue has been mentioned on SWI-Prolog. There might be relevant details there:

https://swi-prolog.discourse.group/t/installing-janus-swi-on-windows/8629/10

[JanWielemaker]

Hi @rmanhaeve , Any progress on this? It may help automating the build for janus-swi. Possibly we can do a shared session? With some knowledge on both ends it is probably done quickly 😄 Please contact me on mail or using a private message on Discourse if you like this.

[rmanhaeve]

Hi @JanWielemaker.

I was playing around with it a bit, and got the building working. However, there were some linking issues in the end.
I think I now have a better idea of how to go around it, but I haven't had the time yet to try.

I'll make some time soon, and I'll be in contact when I have an update.

Kind regards,
Robin

[rmanhaeve]

I'm a bit stuck at the moment. The issue I'm running into is that the manylinux build environment includes libraries for building modules (Development.Module) but not for embedding (Development.Embed).
I'm thus able to build the Python package, but it cannot build the Janus SWI-Prolog package.

I'm not sure why this is exactly yet (probably for a good reason), and whether this can be fixed. I'll look deeper into the issue.

[JanWielemaker]

Thanks. If I can access your work I'm happy to have a look. Not that I'm a pip or Python expert ... I learned a little writing Janus though 😄

[rmanhaeve]

I've forked it here https://github.com/rmanhaeve/packages-swipy

I've also asked for help here: pypa/manylinux#1724

[rmanhaeve]

Also, to make sure I understand properly, it is impossible to use the Python package with library(janus) being available in SWI-Prolog?