Add Spark example using ask-and-tell interface

[dhyeyinf]

Overview

This PR adds an example that demonstrates how to use Optuna's ask-and-tell interface with Apache Spark to distribute trial evaluations in parallel using PySpark's RDD API.

The script defines a simple quadratic objective function and evaluates it across Spark worker nodes. It shows how ask-and-tell can be used with a distributed engine without requiring integration with external orchestrators.

Motivation

The example is inspired by multiple user questions regarding Spark integration, as discussed in optuna/optuna#6077. While the functionality already exists via ask() and tell(), this example provides a hands-on script for users working with Spark.

Notes

• This script is placed in the spark/ directory.
• Includes fallback if PySpark is not installed.
• Lightly formatted and runnable standalone (not Sphinx-bound).

Please let me know if you'd like the example adjusted further.

[dhyeyinf]

Summary

• ✅ Fixed isort import ordering in spark/ask_and_tell_spark.py
• 📦 Added requirements.txt for the Spark ask-and-tell example

This ensures the example follows code style guidelines and includes required dependencies (optuna, pyspark) for easier execution.

Let me know if anything else should be added or refined!

[nabenabe0928]

I cannot make your code work.
Could you please modify your code so that your code works without any modifications?
For example, an obvious bug is optuna.seed, which does not exist.

[dhyeyinf]

Thanks for pointing that out! I've removed the invalid optuna.seed() line. The script now runs as-is with no modifications. Let me know if there’s anything else to adjust.

[dhyeyinf]

Hi @nabenabe0928, just following up on this PR — I made the changes you suggested a few days ago (removed the invalid optuna.seed() and ensured the script runs without any modifications). Please let me know if there's anything else you'd like me to address.

Appreciate your time and feedback! 🙇‍♂️

[github-actions]

This pull request has not seen any recent activity.

[dhyeyinf]

Thank you! I've applied your suggested changes

[nabenabe0928]

I missed one thing, could you please reduce the indents?
Please see my comment for more details.

[dhyeyinf]

Thank you for catching that! I've committed the suggested indentation fix.

[github-actions]

This pull request has not seen any recent activity.

[dhyeyinf]

Thank you for catching that! I've committed the suggested indentation fix.

[github-actions]

This pull request has not seen any recent activity.

[nabenabe0928]

Sorry for the late response, LGTM!