llama-swap as a service in MacOS (Apple) with launchctl

[xezpeleta]

If you're using llama-swap in a Mac and you want to configure it as a service using launchctl, you can follow these instructions:

Generate service file

# Create the directory
mkdir -p ~/Library/LaunchAgents

# Create the file
nano ~/Library/LaunchAgents/com.llamaswap.server.plist

The content of the file (you will need to adapt username, paths...)

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<dict>
    <key>Label</key>
    <string>com.llamaswap.server</string>

    <key>ProgramArguments</key>
    <array>
        <string>/opt/homebrew/bin/llama-swap</string>
        <string>--config</string>
        <string>/Users/myuser/llama-swap/config.yaml</string>
        <string>--listen</string>
        <string>0.0.0.0:8080</string>
    </array>

    <key>EnvironmentVariables</key>
    <dict>
        <key>PATH</key>
        <string>/opt/homebrew/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin</string>
        <key>HOME</key>
        <string>/Users/myuser</string>
    </dict>

    <key>RunAtLoad</key>
    <true/>

    <key>KeepAlive</key>
    <true/>

    <key>StandardOutPath</key>
    <string>/tmp/llamaswap.log</string>

    <key>StandardErrorPath</key>
    <string>/tmp/llamaswap.error.log</string>

    <key>WorkingDirectory</key>
    <string>/Users/myuser/Dev/llama-swap</string>
</dict>
</plist>

Managing the service

For starting/stopping the service, use the following commands:

launchctl load ~/Library/LaunchAgents/com.llamaswap.server.plist
launchctl unload ~/Library/LaunchAgents/com.llamaswap.server.plist

To verify the service it's running:

launchctl list | grep llamaswap