pushing the tango container

Author: SafiullahOmar

tango_container/README.md

@@ -0,0 +1 @@
+files downloaded during build process will be put here

tango_container/dt4cc-tango/Dockerfile.app

@@ -0,0 +1,53 @@
+# Dockerfile.app
+# - Creates Conda env from tango.yaml
+# - Installs Poetry into that env (no separate venvs)
+# - Clones & installs:
+#     hz-b/lat2db
+#     hz-b/bact-device-models
+#     hz-b/bact-twin-architecture
+#   (each via `poetry install`)
+# - Clones hz-b/dt4acc (no install step shown, change if needed)
+
+FROM condaforge/mambaforge:24.3.0-0
+
+ARG CONDA_ENV=tangoenv
+ENV CONDA_ENV=${CONDA_ENV}
+
+SHELL ["/bin/bash", "-c"]
+
+# Copy your environment file into the image (make sure tango.yaml is in the same folder as this Dockerfile)
+COPY tango.yaml /tmp/tango.yaml
+
+# Create the Conda environment
+RUN mamba env create -f /tmp/tango.yaml -n ${CONDA_ENV} && \
+    echo "source /opt/conda/etc/profile.d/conda.sh && conda activate ${CONDA_ENV}" >> /etc/bash.bashrc
+
+# System deps + Poetry in the Conda env
+# (git is needed for cloning; build-essentials are handy for projects with native builds)
+RUN apt-get update && \
+    apt-get install -y --no-install-recommends git build-essential && \
+    rm -rf /var/lib/apt/lists/* && \
+    conda run -n ${CONDA_ENV} python -V && \
+    conda run -n ${CONDA_ENV} pip install --no-cache-dir poetry && \
+    # Make Poetry install into the active Conda env instead of its own venv
+    conda run -n ${CONDA_ENV} poetry config virtualenvs.create false
+
+WORKDIR /opt
+
+
+# Clone repos
+RUN git clone https://github.com/hz-b/lat2db.git && \
+    git clone https://github.com/hz-b/bact-device-models.git && \
+    git clone https://github.com/hz-b/bact-twin-architecture.git && \
+    git clone --branch backup-before-filterrepo --single-branch https://github.com/hz-b/dt4acc.git
+
+# Install Poetry projects INTO the Conda env
+RUN conda run -n ${CONDA_ENV} poetry -C /opt/lat2db install && \
+    conda run -n ${CONDA_ENV} poetry -C /opt/bact-device-models install && \
+    conda run -n ${CONDA_ENV} poetry -C /opt/bact-twin-architecture install
+
+# Expose the env on PATH for interactive shells
+ENV PATH="/opt/conda/envs/${CONDA_ENV}/bin:${PATH}"
+
+# Default command: keep container alive for interactive work
+CMD ["bash", "-lc", "echo 'Container ready. Run: conda activate ${CONDA_ENV}'; tail -f /dev/null"]

tango_container/dt4cc-tango/README-container.md

@@ -0,0 +1,231 @@
+# DT4CC Tango Container Setup and Usage Guide
+
+This guide provides step-by-step instructions for running the DT4CC Tango containers with MySQL database and Tango DataBaseDS.
+
+## Prerequisites
+
+- Docker and Docker Compose installed on your system
+- Local MySQL/MariaDB service should be **stopped** to avoid port conflicts
+
+## Quick Start
+
+### 1. Stop Local Database Services
+
+Before starting the containers, ensure your local MySQL or MariaDB service is stopped to avoid port conflicts:
+
+**On macOS:**
+```bash
+# Stop MySQL if running via Homebrew
+brew services stop mysql
+
+# Or stop MariaDB
+brew services stop mariadb
+```
+
+**On Linux:**
+```bash
+# Stop MySQL
+sudo systemctl stop mysql
+# or
+sudo systemctl stop mariadb
+```
+
+**On Windows:**
+- Stop MySQL/MariaDB service from Services management console
+
+### 2. Start the Database and Tango DataBaseDS
+
+Navigate to the `tango-mysql` directory and start the database services:
+
+```bash
+cd tango-mysql
+docker compose up -d
+```
+
+This will start:
+- MySQL 8.0 database on port 3306
+- Tango DataBaseDS on port 10000
+- Both services will be connected via the `tango-net` network
+
+Wait for the services to be healthy (check with `docker compose ps`).
+
+### 3. Build and Start the Application Container
+
+Return to the main directory and build the application container:
+
+```bash
+cd ..
+docker compose -f docker-compose.app.yml build
+docker compose -f docker-compose.app.yml up -d
+```
+
+This will:
+- Build the application container with Conda environment `tangoenv1`
+- Install all required Python packages and dependencies
+- Clone and install the required repositories (lat2db, bact-device-models, bact-twin-architecture, dt4acc)
+
+### 4. Start the Tango Server
+
+Access the application container and start the Tango server:
+
+```bash
+docker exec -it tango_app bash
+```
+
+Inside the container, activate the Conda environment and start the server:
+
+```bash
+conda activate tangoenv1
+cd /opt/dt4acc
+python scripts/dt4acc_enhanced_tango.py
+```
+
+You should see server startup messages and confirmation that the Tango server is running.
+
+## Testing the Setup
+
+### Basic Device Testing
+
+Open a **new terminal** and access the container again:
+
+```bash
+docker exec -it tango_app bash
+conda activate tangoenv1
+```
+
+Test basic device connectivity:
+
+```python
+python
+```
+
+In the Python shell:
+
+```python
+from tango import DeviceProxy
+
+# Test power converter device
+dev = DeviceProxy("SimpleTangoServer/test/power_converter_Q3P2T6R")
+dev.current_setpoint = 5.1
+
+# You should see logs showing twiss and orbit calculations
+```
+
+### Using Test Scripts
+
+Navigate to the test examples directory:
+
+```bash
+cd /opt/dt4acc/tests/example
+```
+
+#### Available Test Scripts
+
+1. **Check Device Status:**
+   ```bash
+   python check_device_status.py SimpleTangoServer/test/magnet_VS3M2T8R
+   ```
+
+2. **Show Device Values:**
+   ```bash
+   python show_device_values.py SimpleTangoServer/test/power_converter_Q3P2T1R
+   ```
+
+3. **List All Devices:**
+   ```bash
+   python list_all_devices.py
+   ```
+
+4. **List All Servers:**
+   ```bash
+   python list_all_servers.py
+   ```
+
+5. **Update Device Value:**
+   ```bash
+   python update_device_value.py <device_name> <attribute> <value>
+   ```
+
+6. **Check Mapped Properties:**
+   ```bash
+   python check_mapped_properties.py <device_name>
+   ```
+
+## Container Management
+
+### View Running Containers
+```bash
+docker ps
+```
+
+### View Container Logs
+```bash
+# Application container logs
+docker logs tango_app
+
+# Database logs
+docker logs tango-mysql-mysql-1
+
+# DataBaseDS logs
+docker logs tango-mysql-databaseds-1
+```
+
+### Stop All Services
+```bash
+# Stop application container
+docker compose -f docker-compose.app.yml down
+
+# Stop database services
+cd tango-mysql
+docker compose down
+```
+
+### Restart Services
+```bash
+# Restart database services
+cd tango-mysql
+docker compose restart
+
+# Restart application container
+cd ..
+docker compose -f docker-compose.app.yml restart
+```
+
+## Troubleshooting
+
+### Port Conflicts
+If you encounter port conflicts:
+- Ensure local MySQL/MariaDB is stopped
+- Check if ports 3306 or 10000 are already in use: `lsof -i :3306` or `lsof -i :10000`
+
+
+
+### Tango Server Issues
+If the Tango server doesn't start:
+1. Check that DataBaseDS is running and healthy
+2. Verify the TANGO_HOST environment variable
+3. Check the server logs for specific error messages
+
+## Environment Details
+
+- **Conda Environment:** `tangoenv1`
+- **Database:** MySQL 8.0
+- **Tango DataBaseDS:** 
+- **Application:** DT4CC with enhanced Tango integration
+
+
+## File Structure
+
+```
+dt4cc-tango/
+├── docker-compose.yml          # Full stack (DB + App)
+├── docker-compose.app.yml      # App only (requires external DB)
+├── Dockerfile.app              # Application container definition
+├── tango.yaml                  # Conda environment specification
+├── tango-mysql/
+│   ├── compose.yaml            # Database services
+│   └── init/                   # SQL initialization scripts
+└── README.md                   # This guide
+```
+
+

tango_container/dt4cc-tango/docker-compose.app.yml

@@ -0,0 +1,31 @@
+# docker-compose.app.yml
+# Use this together with tango_mysql/compose.yaml to run only the app container.
+# Assumes the DB service is named "mysql" on network "tango-net".
+
+services:
+  app:
+    build:
+      context: .
+      dockerfile: Dockerfile.app
+      args:
+        CONDA_ENV: tangoenv1
+    container_name: tango_app
+    environment:
+      CONDA_ENV: tangoenv1
+      TANGO_HOST: databaseds:10000
+      DB_HOST: mysql           
+      DB_NAME: tango
+      DB_USER: tango
+      DB_PASSWORD: ${DB_APP_PASSWORD:-Tango@1234!}
+    networks:
+      - tango-net
+    volumes:
+      - app_data:/workspace
+    command: ["bash", "-lc", "tail -f /dev/null"]
+
+networks:
+  tango-net:
+    external: true
+
+volumes:
+  app_data:

tango_container/dt4cc-tango/docker-compose.yml

@@ -0,0 +1,50 @@
+# docker-compose.yml
+# Starts MariaDB and an app container built from Dockerfile.app.
+# MariaDB runs your init SQL scripts automatically.
+
+services:
+  db:
+    image: mariadb:11
+    container_name: tango_db
+    environment:
+      MARIADB_ROOT_PASSWORD: ${DB_ROOT_PASSWORD:-rootpw}
+      MARIADB_DATABASE: tango
+      MARIADB_USER: tango
+      MARIADB_PASSWORD: ${DB_APP_PASSWORD:-Tango@1234!}
+    ports:
+      - "3306:3306"
+    volumes:
+      # Place your SQL files in ./sql next to this compose file
+      - db_data:/var/lib/mysql
+      - ./sql/00-create-and-grant.sql:/docker-entrypoint-initdb.d/00-create-and-grant.sql:ro
+      - ./sql/01-load-schema.sql:/docker-entrypoint-initdb.d/01-load-schema.sql:ro
+      - ./sql/10-bootstrap-ds.sql:/docker-entrypoint-initdb.d/10-bootstrap-ds.sql:ro
+    healthcheck:
+      test: ["CMD-SHELL", "mysqladmin ping -h localhost -u root -p${DB_ROOT_PASSWORD:-rootpw} --silent"]
+      interval: 5s
+      timeout: 3s
+      retries: 30
+
+  app:
+    build:
+      context: .
+      dockerfile: Dockerfile.app
+      args:
+        CONDA_ENV: tangoenv1
+    container_name: tango_app
+    depends_on:
+      db:
+        condition: service_healthy
+    environment:
+      CONDA_ENV: tangoenv
+      DB_HOST: db
+      DB_NAME: tango
+      DB_USER: tango
+      DB_PASSWORD: ${DB_APP_PASSWORD:-Tango@1234!}
+    volumes:
+      - app_data:/opt
+    command: ["bash", "-lc", "tail -f /dev/null"]
+
+volumes:
+  db_data:
+  app_data: