[META] Improve presentation and UX around Apache Flink

[amotl]

Maintenance

• crate-jdbc: Address Dependabot updates at https://github.com/crate/crate-jdbc/pulls.
• crate-jdbc: Update to recent pgJDBC, see https://github.com/crate/crate-jdbc/tree/master/pg.

Documentation

• Transfer (updated?) article Build a data ingestion pipeline using Kafka, Flink, and CrateDB to https://community.crate.io/.
• Add introduction/summary, cross-link all relevant resources, and give a concise introduction into the topic.
  • https://crate.io/blog/cratedb-community-day-2nd-edition-summary-and-highlights
  • https://crate.io/event/cratedb-community-day-2023
  • => https://community.crate.io/t/cratedb-community-day-2/1415

Examples

• Demonstrate all examples, including the runJob examples, with CrateDB Cloud.
• How to generate test data using the datagen and flink-faker connectors.
  • https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/datagen/
  • https://flink-packages.org/packages/flink-faker
  • https://www.ververica.com/blog/flink-sql-match_recognize
• How to import Parquet files, and how to ingest from AMQP and MQTT.
• Demonstrate PyFlink with CrateDB.
• Because CrateDB does not have a CDC interface, the CDC Connectors for Apache Flink can't be used. So, at least demonstrate how to use the GetInData CDC by JDBC Connector, which allows to read data from SQL databases by periodically reading data from tables, see Change Data Capture by JDBC with FlinkSQL.

More

• Follow up with the Flink JDBC Connector » CrateDB support patch. PR has been merged. When a new version including the support for CrateDB is merged, use static version, instead of jitpack dependency on main branch.
• Currently, the test harness for the runJob examples need to spin up a CrateDB instance using Docker, both locally and on CI. What about using the new "testcontainer"-based implementation? PR to support CrateDB has been merged, follow: https://github.com/testcontainers/testcontainers-java/releases for the next release which contains it.
• Question: Should the infrastructure from kafka-flink be just hosted within this repository instead?