unlock-the-power-of-gemma-2-prompt-it-like-a-pro.ipynb

{"cells":[{"source":"<a href=\"https://www.kaggle.com/code/gpreda/unlock-the-power-of-gemma-2-prompt-it-like-a-pro?scriptVersionId=204886250\" target=\"_blank\"><img align=\"left\" alt=\"Kaggle\" title=\"Open in Kaggle\" src=\"https://kaggle.com/static/images/open-in-kaggle.svg\"></a>","metadata":{},"cell_type":"markdown"},{"cell_type":"markdown","id":"2eccee8c","metadata":{"_cell_guid":"b1076dfc-b9ad-4769-8c92-a6c4dae69d19","_uuid":"8f2839f25d086af736a60e9eeb907d3b93b6e0e5","papermill":{"duration":0.016252,"end_time":"2024-11-02T19:44:43.100384","exception":false,"start_time":"2024-11-02T19:44:43.084132","status":"completed"},"tags":[]},"source":["\n","<center><img src=\"https://storage.googleapis.com/gweb-developer-goog-blog-assets/images/Wagtail_Gemma_Blog_social_card_te.2e16d0ba.fill-1200x600.png\" width=600></center>\n","\n","# Introduction\n","\n","This Notebook will explore how to prompt **Gemma 2**, using **KerasNLP**.\n","\n","## What is Gemma?\n","\n","Gemma is a family of lightweight, state-of-the art open models built from the same research and technology used to create the Gemini models.\n","\n","## What is KerasNLP?\n","\n","KerasNLP is a collection of natural language processing (NLP) models implemented in Keras and runnable on JAX, PyTorch, and TensorFlow.\n","\n"]},{"cell_type":"markdown","id":"f9c1f0bd","metadata":{"papermill":{"duration":0.013891,"end_time":"2024-11-02T19:44:43.128527","exception":false,"start_time":"2024-11-02T19:44:43.114636","status":"completed"},"tags":[]},"source":["# Prerequisites\n","\n","\n","## Install packages\n","\n","We will install Keras and KerasNLP."]},{"cell_type":"code","execution_count":1,"id":"0cfd2878","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:44:43.15917Z","iopub.status.busy":"2024-11-02T19:44:43.158165Z","iopub.status.idle":"2024-11-02T19:45:10.305637Z","shell.execute_reply":"2024-11-02T19:45:10.304567Z"},"papermill":{"duration":27.165366,"end_time":"2024-11-02T19:45:10.308103","exception":false,"start_time":"2024-11-02T19:44:43.142737","status":"completed"},"tags":[]},"outputs":[],"source":["!pip install -q -U keras-nlp\n","!pip install -q -U \"keras>=3\""]},{"cell_type":"markdown","id":"ac428b3e","metadata":{"papermill":{"duration":0.013802,"end_time":"2024-11-02T19:45:10.336449","exception":false,"start_time":"2024-11-02T19:45:10.322647","status":"completed"},"tags":[]},"source":["Now we can import the packages. We import also additional packages we will need."]},{"cell_type":"markdown","id":"62e65c50","metadata":{"papermill":{"duration":0.014318,"end_time":"2024-11-02T19:45:10.364796","exception":false,"start_time":"2024-11-02T19:45:10.350478","status":"completed"},"tags":[]},"source":["## Import packages"]},{"cell_type":"code","execution_count":2,"id":"d46f0433","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:45:10.394985Z","iopub.status.busy":"2024-11-02T19:45:10.394591Z","iopub.status.idle":"2024-11-02T19:45:22.577692Z","shell.execute_reply":"2024-11-02T19:45:22.576868Z"},"papermill":{"duration":12.201092,"end_time":"2024-11-02T19:45:22.579987","exception":false,"start_time":"2024-11-02T19:45:10.378895","status":"completed"},"tags":[]},"outputs":[],"source":["import keras\n","import keras_nlp\n","from time import time"]},{"cell_type":"markdown","id":"7dbac0be","metadata":{"papermill":{"duration":0.013926,"end_time":"2024-11-02T19:45:22.608355","exception":false,"start_time":"2024-11-02T19:45:22.594429","status":"completed"},"tags":[]},"source":["Select the backend. Keras is a high-level, multi-framework deep learning API designed for simplicity and ease of use. Keras 3 lets you choose the backend: TensorFlow, JAX, or PyTorch. For this Notebook, we will choose `jax` as backend."]},{"cell_type":"code","execution_count":3,"id":"cbc47d5a","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:45:22.63939Z","iopub.status.busy":"2024-11-02T19:45:22.638503Z","iopub.status.idle":"2024-11-02T19:45:22.64315Z","shell.execute_reply":"2024-11-02T19:45:22.642246Z"},"papermill":{"duration":0.022013,"end_time":"2024-11-02T19:45:22.645148","exception":false,"start_time":"2024-11-02T19:45:22.623135","status":"completed"},"tags":[]},"outputs":[],"source":["import os\n","os.environ[\"KERAS_BACKEND\"] = \"jax\"\n","os.environ[\"XLA_PYTHON_CLIENT_MEM_FRACTION\"] = \"0.9\""]},{"cell_type":"markdown","id":"547a99c1","metadata":{"papermill":{"duration":0.013774,"end_time":"2024-11-02T19:45:22.672876","exception":false,"start_time":"2024-11-02T19:45:22.659102","status":"completed"},"tags":[]},"source":["# Initialize the model\n","\n","\n","We will initialize **Gemma** language model using `GemmaCausaLM.from_preset` function."]},{"cell_type":"code","execution_count":4,"id":"bf2d9c14","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:45:22.702448Z","iopub.status.busy":"2024-11-02T19:45:22.701802Z","iopub.status.idle":"2024-11-02T19:46:15.372042Z","shell.execute_reply":"2024-11-02T19:46:15.370997Z"},"papermill":{"duration":52.687915,"end_time":"2024-11-02T19:46:15.374691","exception":false,"start_time":"2024-11-02T19:45:22.686776","status":"completed"},"tags":[]},"outputs":[{"name":"stderr","output_type":"stream","text":["normalizer.cc(51) LOG(INFO) precompiled_charsmap is empty. use identity normalization.\n"]}],"source":["gemma_lm = keras_nlp.models.GemmaCausalLM.from_preset(\"gemma2_instruct_2b_en\")"]},{"cell_type":"markdown","id":"632608ef","metadata":{"papermill":{"duration":0.01812,"end_time":"2024-11-02T19:46:15.413363","exception":false,"start_time":"2024-11-02T19:46:15.395243","status":"completed"},"tags":[]},"source":["Let's verify now the model. We will use `summary` function for this."]},{"cell_type":"code","execution_count":5,"id":"4a3e56d7","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:46:15.442871Z","iopub.status.busy":"2024-11-02T19:46:15.442531Z","iopub.status.idle":"2024-11-02T19:46:15.480287Z","shell.execute_reply":"2024-11-02T19:46:15.479325Z"},"papermill":{"duration":0.054828,"end_time":"2024-11-02T19:46:15.482221","exception":false,"start_time":"2024-11-02T19:46:15.427393","status":"completed"},"tags":[]},"outputs":[{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-weight: bold\">Preprocessor: \"gemma_causal_lm_preprocessor\"</span>\n","</pre>\n"],"text/plain":["\u001b[1mPreprocessor: \"gemma_causal_lm_preprocessor\"\u001b[0m\n"]},"metadata":{},"output_type":"display_data"},{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\">┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓\n","┃<span style=\"font-weight: bold\"> Layer (type)                                                  </span>┃<span style=\"font-weight: bold\">                                   Config </span>┃\n","┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩\n","│ gemma_tokenizer (<span style=\"color: #0087ff; text-decoration-color: #0087ff\">GemmaTokenizer</span>)                              │                      Vocab size: <span style=\"color: #00af00; text-decoration-color: #00af00\">256,000</span> │\n","└───────────────────────────────────────────────────────────────┴──────────────────────────────────────────┘\n","</pre>\n"],"text/plain":["┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓\n","┃\u001b[1m \u001b[0m\u001b[1mLayer (type)                                                 \u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1m                                  Config\u001b[0m\u001b[1m \u001b[0m┃\n","┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩\n","│ gemma_tokenizer (\u001b[38;5;33mGemmaTokenizer\u001b[0m)                              │                      Vocab size: \u001b[38;5;34m256,000\u001b[0m │\n","└───────────────────────────────────────────────────────────────┴──────────────────────────────────────────┘\n"]},"metadata":{},"output_type":"display_data"},{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-weight: bold\">Model: \"gemma_causal_lm\"</span>\n","</pre>\n"],"text/plain":["\u001b[1mModel: \"gemma_causal_lm\"\u001b[0m\n"]},"metadata":{},"output_type":"display_data"},{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\">┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓\n","┃<span style=\"font-weight: bold\"> Layer (type)                  </span>┃<span style=\"font-weight: bold\"> Output Shape              </span>┃<span style=\"font-weight: bold\">         Param # </span>┃<span style=\"font-weight: bold\"> Connected to               </span>┃\n","┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩\n","│ padding_mask (<span style=\"color: #0087ff; text-decoration-color: #0087ff\">InputLayer</span>)     │ (<span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>, <span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>)              │               <span style=\"color: #00af00; text-decoration-color: #00af00\">0</span> │ -                          │\n","├───────────────────────────────┼───────────────────────────┼─────────────────┼────────────────────────────┤\n","│ token_ids (<span style=\"color: #0087ff; text-decoration-color: #0087ff\">InputLayer</span>)        │ (<span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>, <span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>)              │               <span style=\"color: #00af00; text-decoration-color: #00af00\">0</span> │ -                          │\n","├───────────────────────────────┼───────────────────────────┼─────────────────┼────────────────────────────┤\n","│ gemma_backbone                │ (<span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>, <span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>, <span style=\"color: #00af00; text-decoration-color: #00af00\">2304</span>)        │   <span style=\"color: #00af00; text-decoration-color: #00af00\">2,614,341,888</span> │ padding_mask[<span style=\"color: #00af00; text-decoration-color: #00af00\">0</span>][<span style=\"color: #00af00; text-decoration-color: #00af00\">0</span>],        │\n","│ (<span style=\"color: #0087ff; text-decoration-color: #0087ff\">GemmaBackbone</span>)               │                           │                 │ token_ids[<span style=\"color: #00af00; text-decoration-color: #00af00\">0</span>][<span style=\"color: #00af00; text-decoration-color: #00af00\">0</span>]            │\n","├───────────────────────────────┼───────────────────────────┼─────────────────┼────────────────────────────┤\n","│ token_embedding               │ (<span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>, <span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>, <span style=\"color: #00af00; text-decoration-color: #00af00\">256000</span>)      │     <span style=\"color: #00af00; text-decoration-color: #00af00\">589,824,000</span> │ gemma_backbone[<span style=\"color: #00af00; text-decoration-color: #00af00\">0</span>][<span style=\"color: #00af00; text-decoration-color: #00af00\">0</span>]       │\n","│ (<span style=\"color: #0087ff; text-decoration-color: #0087ff\">ReversibleEmbedding</span>)         │                           │                 │                            │\n","└───────────────────────────────┴───────────────────────────┴─────────────────┴────────────────────────────┘\n","</pre>\n"],"text/plain":["┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓\n","┃\u001b[1m \u001b[0m\u001b[1mLayer (type)                 \u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1mOutput Shape             \u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1m        Param #\u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1mConnected to              \u001b[0m\u001b[1m \u001b[0m┃\n","┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩\n","│ padding_mask (\u001b[38;5;33mInputLayer\u001b[0m)     │ (\u001b[38;5;45mNone\u001b[0m, \u001b[38;5;45mNone\u001b[0m)              │               \u001b[38;5;34m0\u001b[0m │ -                          │\n","├───────────────────────────────┼───────────────────────────┼─────────────────┼────────────────────────────┤\n","│ token_ids (\u001b[38;5;33mInputLayer\u001b[0m)        │ (\u001b[38;5;45mNone\u001b[0m, \u001b[38;5;45mNone\u001b[0m)              │               \u001b[38;5;34m0\u001b[0m │ -                          │\n","├───────────────────────────────┼───────────────────────────┼─────────────────┼────────────────────────────┤\n","│ gemma_backbone                │ (\u001b[38;5;45mNone\u001b[0m, \u001b[38;5;45mNone\u001b[0m, \u001b[38;5;34m2304\u001b[0m)        │   \u001b[38;5;34m2,614,341,888\u001b[0m │ padding_mask[\u001b[38;5;34m0\u001b[0m][\u001b[38;5;34m0\u001b[0m],        │\n","│ (\u001b[38;5;33mGemmaBackbone\u001b[0m)               │                           │                 │ token_ids[\u001b[38;5;34m0\u001b[0m][\u001b[38;5;34m0\u001b[0m]            │\n","├───────────────────────────────┼───────────────────────────┼─────────────────┼────────────────────────────┤\n","│ token_embedding               │ (\u001b[38;5;45mNone\u001b[0m, \u001b[38;5;45mNone\u001b[0m, \u001b[38;5;34m256000\u001b[0m)      │     \u001b[38;5;34m589,824,000\u001b[0m │ gemma_backbone[\u001b[38;5;34m0\u001b[0m][\u001b[38;5;34m0\u001b[0m]       │\n","│ (\u001b[38;5;33mReversibleEmbedding\u001b[0m)         │                           │                 │                            │\n","└───────────────────────────────┴───────────────────────────┴─────────────────┴────────────────────────────┘\n"]},"metadata":{},"output_type":"display_data"},{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-weight: bold\"> Total params: </span><span style=\"color: #00af00; text-decoration-color: #00af00\">2,614,341,888</span> (9.74 GB)\n","</pre>\n"],"text/plain":["\u001b[1m Total params: \u001b[0m\u001b[38;5;34m2,614,341,888\u001b[0m (9.74 GB)\n"]},"metadata":{},"output_type":"display_data"},{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-weight: bold\"> Trainable params: </span><span style=\"color: #00af00; text-decoration-color: #00af00\">2,614,341,888</span> (9.74 GB)\n","</pre>\n"],"text/plain":["\u001b[1m Trainable params: \u001b[0m\u001b[38;5;34m2,614,341,888\u001b[0m (9.74 GB)\n"]},"metadata":{},"output_type":"display_data"},{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-weight: bold\"> Non-trainable params: </span><span style=\"color: #00af00; text-decoration-color: #00af00\">0</span> (0.00 B)\n","</pre>\n"],"text/plain":["\u001b[1m Non-trainable params: \u001b[0m\u001b[38;5;34m0\u001b[0m (0.00 B)\n"]},"metadata":{},"output_type":"display_data"}],"source":["gemma_lm.summary()"]},{"cell_type":"markdown","id":"d5a46bf8","metadata":{"papermill":{"duration":0.015279,"end_time":"2024-11-02T19:46:15.51316","exception":false,"start_time":"2024-11-02T19:46:15.497881","status":"completed"},"tags":[]},"source":["# Test the model\n","\n","\n","## Define and run a simple prompt"]},{"cell_type":"code","execution_count":6,"id":"c35134ff","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:46:15.54498Z","iopub.status.busy":"2024-11-02T19:46:15.544672Z","iopub.status.idle":"2024-11-02T19:46:46.986233Z","shell.execute_reply":"2024-11-02T19:46:46.985129Z"},"papermill":{"duration":31.47584,"end_time":"2024-11-02T19:46:47.004199","exception":false,"start_time":"2024-11-02T19:46:15.528359","status":"completed"},"tags":[]},"outputs":[{"name":"stderr","output_type":"stream","text":["WARNING: All log messages before absl::InitializeLog() is called are written to STDERR\n","I0000 00:00:1730576786.969225      22 service.cc:145] XLA service 0x55d9bd2f62d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices:\n","I0000 00:00:1730576786.969297      22 service.cc:153]   StreamExecutor device (0): Tesla P100-PCIE-16GB, Compute Capability 6.0\n","I0000 00:00:1730576800.576126      22 device_compiler.h:188] Compiled cluster using XLA!  This line is logged at most once for the lifetime of the process.\n"]},{"name":"stdout","output_type":"stream","text":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Think step by step, use careful reasoning.\n","Question: What is the surface temperature of the Moon?\n","Answer:\n","1. The Moon has no atmosphere.\n","2. The Moon reflects sunlight.\n","3. The Moon's surface temperature can vary greatly depending on the time of day and the angle of the sun.\n","4. During the day, the Moon's surface can reach temperatures of up to 127 degrees Celsius.\n","5. At night, the Moon's surface temperature can drop to as low as -173 degrees Celsius. \n","Therefore, the surface temperature of the Moon is variable. \n","\n","\n","**Explanation:**\n","\n","The provided answer is a bit too detailed and doesn't directly answer the question. Here's a more concise and accurate response:\n","\n","**The surface temperature of the Moon varies greatly, ranging from a high of 127 degrees Celsius (261 degrees Fahrenheit) during the day to a low of -173 degrees Celsius (-279 degrees Fahrenheit) at night.** \n","\n","\n","**Explanation:**\n","\n","* **Direct Answer:** The answer directly addresses the question\n"]}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Think step by step, use careful reasoning.\n","Question: {question}\n","Answer:\n","\"\"\"\n","response = gemma_lm.generate(prompt.format(question=\"What is the surface temperature of the Moon?\"), max_length=256)\n","print(response)"]},{"cell_type":"code","execution_count":7,"id":"f5dbd5ce","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:46:47.037306Z","iopub.status.busy":"2024-11-02T19:46:47.036895Z","iopub.status.idle":"2024-11-02T19:47:20.565501Z","shell.execute_reply":"2024-11-02T19:47:20.564604Z"},"papermill":{"duration":33.563423,"end_time":"2024-11-02T19:47:20.58344","exception":false,"start_time":"2024-11-02T19:46:47.020017","status":"completed"},"tags":[]},"outputs":[{"name":"stdout","output_type":"stream","text":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Prepare the answer like for a 4 grade student, and use references to Harry Potter.\n","Question: What is the solution of the equation with two unknown: 2x + y = 10; y - x = 4?\n","Answer:\n","Let's use some magic to solve this! \n","\n","First, we need to find a way to get rid of one of the variables.  We can do this by looking at the second equation.  If we add x to both sides, we get: \n","y - x + x = 4 + x\n","This simplifies to: \n","y = 4 + x\n","\n","Now, we can substitute this value of y into the first equation.  Remember, the first equation is 2x + y = 10.  So, we replace y with (4 + x):\n","2x + (4 + x) = 10\n","\n","Now, let's combine like terms:\n","2x + 4 + x = 10\n","3x + 4 = 10\n","\n","Finally, we can solve for x:\n","3x = 6\n","x = 2\n","\n","Now that we know x = 2, we can plug it back into either of the original equations to find y. Let's use the second equation:\n","y - 2 = 4\n","\n","Adding 2 to both sides:\n","y = 6\n","\n","So, the solution to the equation is x = 2 and y = 6.  It's like finding the perfect hiding spot for a Golden Snitch! \n","<end_of_turn>\n"]}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Prepare the answer like for a 4 grade student, and use references to Harry Potter.\n","Question: {question}\n","Answer:\n","\"\"\"\n","response = gemma_lm.generate(prompt.format(question=\"What is the solution of the equation with two unknown: 2x + y = 10; y - x = 4?\"), max_length=512)\n","print(response)"]},{"cell_type":"markdown","id":"da965bf1","metadata":{"papermill":{"duration":0.015451,"end_time":"2024-11-02T19:47:20.614566","exception":false,"start_time":"2024-11-02T19:47:20.599115","status":"completed"},"tags":[]},"source":["## Format the output\n","\n","Let's create a function that will format the format nicely."]},{"cell_type":"code","execution_count":8,"id":"a4604497","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:47:20.647585Z","iopub.status.busy":"2024-11-02T19:47:20.646743Z","iopub.status.idle":"2024-11-02T19:47:20.652208Z","shell.execute_reply":"2024-11-02T19:47:20.651437Z"},"papermill":{"duration":0.023791,"end_time":"2024-11-02T19:47:20.654094","exception":false,"start_time":"2024-11-02T19:47:20.630303","status":"completed"},"tags":[]},"outputs":[],"source":["from IPython.display import display, Markdown\n","\n","def colorize_text(text):\n","    for word, color in zip([\"Reasoning\", \"Question\", \"Answer\", \"Explanation\", \"Total time\"], [\"blue\", \"red\", \"green\", \"darkblue\",  \"magenta\"]):\n","        text = text.replace(f\"{word}:\", f\"\\n\\n**<font color='{color}'>{word}:</font>**\")\n","    return text"]},{"cell_type":"code","execution_count":9,"id":"1bdc4061","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:47:20.686344Z","iopub.status.busy":"2024-11-02T19:47:20.686011Z","iopub.status.idle":"2024-11-02T19:47:23.231766Z","shell.execute_reply":"2024-11-02T19:47:23.230847Z"},"papermill":{"duration":2.564263,"end_time":"2024-11-02T19:47:23.233872","exception":false,"start_time":"2024-11-02T19:47:20.669609","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Prepare the answer like for a 4 grade student, and use references to Harry Potter.\n","\n","\n","**<font color='red'>Question:</font>** What is the surface temperature of the Moon?\n","\n","\n","**<font color='green'>Answer:</font>**\n","The Moon's surface temperature can be really extreme, just like the weather in Hogwarts! It can get super hot during the day, like 250 degrees Fahrenheit, which is hotter than a cauldron full of dragon scales! But at night, it gets super cold, like -250 degrees Fahrenheit, which is colder than a snowy night in Hogsmeade! \n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 2.54 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"What is the surface temperature of the Moon?\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":10,"id":"4950ff6a","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:47:23.266977Z","iopub.status.busy":"2024-11-02T19:47:23.266642Z","iopub.status.idle":"2024-11-02T19:47:23.271035Z","shell.execute_reply":"2024-11-02T19:47:23.270122Z"},"papermill":{"duration":0.023176,"end_time":"2024-11-02T19:47:23.273038","exception":false,"start_time":"2024-11-02T19:47:23.249862","status":"completed"},"tags":[]},"outputs":[],"source":["prompt = \"\"\"\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Prepare the answer like for a PhD level, and use references to Carl Sagan.\n","Question: {question}\n","Answer:\n","\"\"\""]},{"cell_type":"markdown","id":"95abe083","metadata":{"papermill":{"duration":0.015514,"end_time":"2024-11-02T19:47:23.304274","exception":false,"start_time":"2024-11-02T19:47:23.28876","status":"completed"},"tags":[]},"source":["## Ask more general knowledge questions\n","\n","\n","Make sure he is really confused. Let's verify if he know European, ancient World or Japanese history."]},{"cell_type":"code","execution_count":11,"id":"ad9e141e","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:47:23.33735Z","iopub.status.busy":"2024-11-02T19:47:23.336975Z","iopub.status.idle":"2024-11-02T19:47:27.061961Z","shell.execute_reply":"2024-11-02T19:47:27.060502Z"},"papermill":{"duration":3.744302,"end_time":"2024-11-02T19:47:27.064351","exception":false,"start_time":"2024-11-02T19:47:23.320049","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Prepare the answer like for a PhD level, and use references to Carl Sagan.\n","\n","\n","**<font color='red'>Question:</font>** When was the 30 years war?\n","\n","\n","**<font color='green'>Answer:</font>**\n","The Thirty Years' War, a pivotal conflict in European history, raged from 1618 to 1648.  This period, as Carl Sagan eloquently described in his book \"Cosmos,\" was a time of \"unprecedented upheaval and change,\" marking a turning point in the trajectory of European civilization.  The war's impact reverberated through the continent, leaving a legacy of political fragmentation, religious strife, and societal upheaval.  \n","**References:**\n","* Sagan, C. (1980). Cosmos. New York: Random House. \n","\n","\n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 3.72 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"When was the 30 years war?\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":12,"id":"d7a149b0","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:47:27.098486Z","iopub.status.busy":"2024-11-02T19:47:27.097852Z","iopub.status.idle":"2024-11-02T19:47:31.38902Z","shell.execute_reply":"2024-11-02T19:47:31.38811Z"},"papermill":{"duration":4.310166,"end_time":"2024-11-02T19:47:31.391075","exception":false,"start_time":"2024-11-02T19:47:27.080909","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Prepare the answer like for a PhD level, and use references to Carl Sagan.\n","\n","\n","**<font color='red'>Question:</font>** What is a graphe paranomon?\n","\n","\n","**<font color='green'>Answer:</font>**\n","A graphe paranomon is a term coined by Carl Sagan to describe a phenomenon where a person's perception of a word or phrase is influenced by the context in which it is presented. Sagan, in his book \"Cosmos,\" argued that our understanding of language is not a fixed, objective entity, but rather a dynamic, evolving process shaped by our individual experiences and cultural influences. He used the term \"graphe paranomon\" to highlight the inherent subjectivity of language and the way in which our interpretations of words can be altered by the surrounding circumstances. \n","\n","**References:**\n","* Sagan, C. (1980). Cosmos. New York: Random House. \n","\n","\n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 4.28 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t= time()\n","response = gemma_lm.generate(prompt.format(question=\"What is a graphe paranomon?\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":13,"id":"9eb3d785","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:47:31.425327Z","iopub.status.busy":"2024-11-02T19:47:31.424609Z","iopub.status.idle":"2024-11-02T19:47:34.789892Z","shell.execute_reply":"2024-11-02T19:47:34.788945Z"},"papermill":{"duration":3.384694,"end_time":"2024-11-02T19:47:34.792143","exception":false,"start_time":"2024-11-02T19:47:31.407449","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Prepare the answer like for a PhD level, and use references to Carl Sagan.\n","\n","\n","**<font color='red'>Question:</font>** Who was the next shogon after Yeiatsu Tokugawa?\n","\n","\n","**<font color='green'>Answer:</font>**\n","The next Shogun after Yeiatsu Tokugawa was his son, **Tokugawa Yoshinobu**.  This succession was a pivotal moment in Japanese history, marking the end of the Tokugawa Shogunate and the beginning of the Meiji Restoration.  As Sagan eloquently stated, \"We are all part of a vast cosmic tapestry, woven with threads of time and space.\"  This tapestry, in the case of Japan, was dramatically altered by the transition from the Tokugawa Shogunate to the Meiji Restoration. \n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 3.36 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Who was the next shogon after Yeiatsu Tokugawa?\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"3d2ed07d","metadata":{"papermill":{"duration":0.016093,"end_time":"2024-11-02T19:47:34.824738","exception":false,"start_time":"2024-11-02T19:47:34.808645","status":"completed"},"tags":[]},"source":["OK, let's test it with some very simple questions from American history."]},{"cell_type":"code","execution_count":14,"id":"858d9030","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:47:34.858737Z","iopub.status.busy":"2024-11-02T19:47:34.858061Z","iopub.status.idle":"2024-11-02T19:47:41.030266Z","shell.execute_reply":"2024-11-02T19:47:41.029304Z"},"papermill":{"duration":6.191431,"end_time":"2024-11-02T19:47:41.032299","exception":false,"start_time":"2024-11-02T19:47:34.840868","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Prepare the answer like for a PhD level, and use references to Carl Sagan.\n","\n","\n","**<font color='red'>Question:</font>** Who was the first American president?\n","\n","\n","**<font color='green'>Answer:</font>**\n","The first American president was George Washington. This is a fact supported by historical evidence, as documented in the works of Carl Sagan, who, in his book \"Cosmos,\" states that \"The founding fathers, in their wisdom, chose George Washington as the first president of the United States.\" (Sagan, 1980). \n","\n","\n","**Please note:** This is a fictional response. \n","\n","**\n","\n","**<font color='darkblue'>Explanation:</font>****\n","\n","The prompt asks for a factual answer, and the response provides a factual answer. \n","\n","The response uses a fictional reference to Carl Sagan to support the claim. This is a common tactic in AI responses, as it can make the response seem more credible. \n","\n","However, it is important to note that the response is not based on any real evidence. \n","\n","The response is also not a good example of how to answer a question in a PhD-level manner. A PhD-level response would be more concise and focused on the actual question. \n","\n","\n","Let me know if\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 6.17 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Who was the first American president?\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":15,"id":"8c294318","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:47:41.066839Z","iopub.status.busy":"2024-11-02T19:47:41.066513Z","iopub.status.idle":"2024-11-02T19:47:45.388197Z","shell.execute_reply":"2024-11-02T19:47:45.38724Z"},"papermill":{"duration":4.341277,"end_time":"2024-11-02T19:47:45.390285","exception":false,"start_time":"2024-11-02T19:47:41.049008","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Prepare the answer like for a PhD level, and use references to Carl Sagan.\n","\n","\n","**<font color='red'>Question:</font>** When took place the Civil War in United States of America?\n","\n","\n","**<font color='green'>Answer:</font>**\n","The American Civil War, a conflict that profoundly reshaped the nation's social, political, and economic landscape, took place from 1861 to 1865.  This period, as Sagan eloquently described in his book \"Cosmos,\" was a time of \"great upheaval and change,\" and the Civil War was a pivotal event in this grand narrative of human evolution.  As Sagan noted, \"The universe is a vast and mysterious place, and we are but a small part of it.\"  The Civil War, therefore, serves as a reminder of the fragility of human institutions and the importance of understanding our place within the larger context of the cosmos. \n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 4.32 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"When took place the Civil War in United States of America?\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"d14d7984","metadata":{"papermill":{"duration":0.016341,"end_time":"2024-11-02T19:47:45.423371","exception":false,"start_time":"2024-11-02T19:47:45.40703","status":"completed"},"tags":[]},"source":["## Let's write poetry like a large language model will do it"]},{"cell_type":"code","execution_count":16,"id":"6a73a8e5","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:47:45.45786Z","iopub.status.busy":"2024-11-02T19:47:45.457547Z","iopub.status.idle":"2024-11-02T19:47:46.761876Z","shell.execute_reply":"2024-11-02T19:47:46.76081Z"},"papermill":{"duration":1.323983,"end_time":"2024-11-02T19:47:46.764086","exception":false,"start_time":"2024-11-02T19:47:45.440103","status":"completed"},"tags":[]},"outputs":[{"name":"stdout","output_type":"stream","text":["\n","You are an AI assistant designed to write poetry.\n","Please answer with a haiku format (17 syllabes poems).\n","Question: Please write a haiku about Neil Armstrong walking on the Moon\n","Answer:\n","Giant leap for man,\n","One small step on dusty ground,\n","History's embrace. \n","\n","\n","Let me know if you'd like to try another one! \n","<end_of_turn>\n"]},{"data":{"text/markdown":["\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.3 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to write poetry.\n","Please answer with a haiku format (17 syllabes poems).\n","Question: {question}\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a haiku about Neil Armstrong walking on the Moon\"), max_length=256)\n","print(response)\n","display(Markdown(colorize_text(f\"\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"d997924f","metadata":{"papermill":{"duration":0.017203,"end_time":"2024-11-02T19:47:46.798626","exception":false,"start_time":"2024-11-02T19:47:46.781423","status":"completed"},"tags":[]},"source":["Let's try one more difficult now."]},{"cell_type":"code","execution_count":17,"id":"008568be","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:47:46.833435Z","iopub.status.busy":"2024-11-02T19:47:46.833079Z","iopub.status.idle":"2024-11-02T19:47:52.919176Z","shell.execute_reply":"2024-11-02T19:47:52.918165Z"},"papermill":{"duration":6.105966,"end_time":"2024-11-02T19:47:52.921346","exception":false,"start_time":"2024-11-02T19:47:46.81538","status":"completed"},"tags":[]},"outputs":[{"name":"stdout","output_type":"stream","text":["\n","You are an AI assistant designed to write poetry.\n","Please answer with a short poem, with rime, in the style of Shakespeare's poems.\n","Question: Please write a poem with only 12 verses about Nadia Comaneci winning Montreal Olympiad\n","Answer:\n","Hark! From Romania's shores, a maiden fair,\n","Nadia Comaneci, with grace and flair,\n","Did grace the Montreal stage, a sight to see,\n","With perfect scores, a legend, born to be.\n","\n","On vaulting high, she soared with effortless ease,\n","A gymnast's art, a symphony of knees,\n","Her body a canvas, painted with skill,\n","A perfect ten, a triumph, her will.\n","\n","The world did gasp, in awe and wonder bright,\n","As Nadia's name, a beacon in the night,\n","Her spirit unyielding, her heart so bold,\n","A champion's tale, forever to be told.\n","\n","With every leap, a testament to grace,\n","Her artistry, a timeless, wondrous space,\n","A gymnast's dream, a vision come to life,\n","A legend's rise, a triumph in the strife.\n","\n","The crowd did roar, a thunderous sound,\n"]},{"data":{"text/markdown":["\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 6.08 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to write poetry.\n","Please answer with a short poem, with rime, in the style of Shakespeare's poems.\n","Question: {question}\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a poem with only 12 verses about Nadia Comaneci winning Montreal Olympiad\"), max_length=256)\n","print(response)\n","display(Markdown(colorize_text(f\"\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"4bb0aa83","metadata":{"papermill":{"duration":0.017015,"end_time":"2024-11-02T19:47:52.95583","exception":false,"start_time":"2024-11-02T19:47:52.938815","status":"completed"},"tags":[]},"source":["## Math questions and Python code\n","\n","\n","Let's test now Gemma 2 on math problems and Python code writing."]},{"cell_type":"code","execution_count":18,"id":"4200eb00","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:47:52.991622Z","iopub.status.busy":"2024-11-02T19:47:52.991024Z","iopub.status.idle":"2024-11-02T19:48:18.259748Z","shell.execute_reply":"2024-11-02T19:48:18.258752Z"},"papermill":{"duration":25.288903,"end_time":"2024-11-02T19:48:18.261848","exception":false,"start_time":"2024-11-02T19:47:52.972945","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple Python code.\n","Please answer with the listing of the Python code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a function in Python to calculate the area of a circle of radius r\n","\n","\n","**<font color='green'>Answer:</font>**\n","```python\n","def circle_area(r):\n","  \"\"\"Calculates the area of a circle.\n","\n","  Args:\n","    r: The radius of the circle.\n","\n","  Returns:\n","    The area of the circle.\n","  \"\"\"\n","  return 3.14159 * r * r\n","```<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 25.26 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to write simple Python code.\n","Please answer with the listing of the Python code.\n","Question: {question}\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a function in Python to calculate the area of a circle of radius r\"), max_length=128)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))\n"]},{"cell_type":"markdown","id":"fb744114","metadata":{"papermill":{"duration":0.017023,"end_time":"2024-11-02T19:48:18.296442","exception":false,"start_time":"2024-11-02T19:48:18.279419","status":"completed"},"tags":[]},"source":["## Python code writting\n","\n","Let's test more with Python."]},{"cell_type":"code","execution_count":19,"id":"3fa18211","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:48:18.331996Z","iopub.status.busy":"2024-11-02T19:48:18.331659Z","iopub.status.idle":"2024-11-02T19:48:20.665707Z","shell.execute_reply":"2024-11-02T19:48:20.664741Z"},"papermill":{"duration":2.35477,"end_time":"2024-11-02T19:48:20.668277","exception":false,"start_time":"2024-11-02T19:48:18.313507","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple Python code.\n","Please answer with the listing of the Python code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a function in Python to order a list\n","\n","\n","**<font color='green'>Answer:</font>**\n","```python\n","def order_list(data):\n","  \"\"\"\n","  This function orders a list in ascending order.\n","\n","  Args:\n","    data: A list of numbers.\n","\n","  Returns:\n","    A new list with the elements of the input list in ascending order.\n","  \"\"\"\n","  return sorted(data)\n","```\n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 2.33 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a function in Python to order a list\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"bc3506ec","metadata":{"papermill":{"duration":0.017964,"end_time":"2024-11-02T19:48:20.708448","exception":false,"start_time":"2024-11-02T19:48:20.690484","status":"completed"},"tags":[]},"source":["## Software design\n","\n","\n","Let's test now Gemma 2 on software design."]},{"cell_type":"code","execution_count":20,"id":"7ac3a644","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:48:20.745739Z","iopub.status.busy":"2024-11-02T19:48:20.744833Z","iopub.status.idle":"2024-11-02T19:49:00.467748Z","shell.execute_reply":"2024-11-02T19:49:00.466722Z"},"papermill":{"duration":39.761714,"end_time":"2024-11-02T19:49:00.487719","exception":false,"start_time":"2024-11-02T19:48:20.726005","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple Python code.\n","Please answer with the listing of the Python code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a class in Python \n","                        to model a phone book (storing name, surname, address, phone) \n","                        with add, delete, order by name, search operations.\n","                        The class should store a list of contacts, each\n","                        with name, surname, address, phone information stored.\n","                        \n","\n","\n","**<font color='green'>Answer:</font>**\n","```python\n","class PhoneBook:\n","    def __init__(self):\n","        self.contacts = []\n","\n","    def add_contact(self, name, surname, address, phone):\n","        self.contacts.append({\n","            \"name\": name,\n","            \"surname\": surname,\n","            \"address\": address,\n","            \"phone\": phone\n","        })\n","\n","    def delete_contact(self, name):\n","        for i, contact in enumerate(self.contacts):\n","            if contact[\"name\"] == name:\n","                del self.contacts[i]\n","                return\n","        print(\"Contact not found.\")\n","\n","    def order_by_name(self):\n","        self.contacts.sort(key=lambda x: x[\"name\"])\n","\n","    def search_contact(self, name):\n","        found = False\n","        for contact in self.contacts:\n","            if contact[\"name\"].lower() == name.lower():\n","                print(f\"Name: {contact['name']}, Surname: {contact['surname']}, Address: {contact['address']}, Phone: {contact['phone']}\")\n","                found = True\n","                break\n","        if not found:\n","            print(\"Contact not found.\")\n","\n","# Example usage\n","phone_book = PhoneBook()\n","phone_book.add_contact(\"John\", \"Doe\", \"123 Main St\", \"555-1234\")\n","phone_book.add_contact(\"Jane\", \"Smith\", \"456 Oak Ave\", \"555-5678\")\n","phone_book.order_by_name()\n","phone_book.search_contact(\"Jane\")\n","phone_book.delete_contact(\"John\")\n","```\n","```\n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 39.71 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","            question=\"\"\"Please write a class in Python \n","                        to model a phone book (storing name, surname, address, phone) \n","                        with add, delete, order by name, search operations.\n","                        The class should store a list of contacts, each\n","                        with name, surname, address, phone information stored.\n","                        \"\"\"), \n","            max_length=1024)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"eb9d2f81","metadata":{"papermill":{"duration":0.0173,"end_time":"2024-11-02T19:49:00.522785","exception":false,"start_time":"2024-11-02T19:49:00.505485","status":"completed"},"tags":[]},"source":["OK, let's build now a service in Python."]},{"cell_type":"code","execution_count":21,"id":"b56a4b63","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:49:00.559767Z","iopub.status.busy":"2024-11-02T19:49:00.55902Z","iopub.status.idle":"2024-11-02T19:49:06.618088Z","shell.execute_reply":"2024-11-02T19:49:06.617182Z"},"papermill":{"duration":6.079799,"end_time":"2024-11-02T19:49:06.620159","exception":false,"start_time":"2024-11-02T19:49:00.54036","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple Python code.\n","Please answer with the listing of the Python code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a small Python module that creates a REST API service\n","                        with two endpoints: \n","                        * get_status (GET)\n","                        * prediction (POST)\n","                        The prediction endpoint receives the payload, extract three fields: city, street and number\n","                        and returns a field called price_estimate\n","                        \n","                        \n","\n","\n","**<font color='green'>Answer:</font>**\n","```python\n","from flask import Flask, request, jsonify\n","\n","app = Flask(__name__)\n","\n","@app.route('/get_status', methods=['GET'])\n","def get_status():\n","    return jsonify({'status': 'OK'})\n","\n","@app.route('/prediction', methods=['POST'])\n","def prediction():\n","    data = request.get_json()\n","    city = data.get('city')\n","    street = data.get('street')\n","    number = data.get('number')\n","    \n","    # Example prediction logic (replace with your actual logic)\n","    price_estimate = f\"Estimated price for {city}, {street}, {number} is: $1000\"\n","    \n","    return jsonify({'price_estimate': price_estimate})\n","\n","if __name__ == '__main__':\n","    app.run(debug=True)\n","```\n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 6.05 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","\n","response = gemma_lm.generate(prompt.format(\n","            question=\"\"\"Please write a small Python module that creates a REST API service\n","                        with two endpoints: \n","                        * get_status (GET)\n","                        * prediction (POST)\n","                        The prediction endpoint receives the payload, extract three fields: city, street and number\n","                        and returns a field called price_estimate\n","                        \n","                        \"\"\"), \n","            max_length=512)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))\n"]},{"cell_type":"markdown","id":"ef5720ae","metadata":{"papermill":{"duration":0.017679,"end_time":"2024-11-02T19:49:06.655853","exception":false,"start_time":"2024-11-02T19:49:06.638174","status":"completed"},"tags":[]},"source":["## Gemma, please write C++ code for me\n","\n","Let's continue with C++ code generation now."]},{"cell_type":"code","execution_count":22,"id":"2c476e3b","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:49:06.692953Z","iopub.status.busy":"2024-11-02T19:49:06.692067Z","iopub.status.idle":"2024-11-02T19:49:10.2538Z","shell.execute_reply":"2024-11-02T19:49:10.252908Z"},"papermill":{"duration":3.582459,"end_time":"2024-11-02T19:49:10.25593","exception":false,"start_time":"2024-11-02T19:49:06.673471","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple C++ code.\n","Please answer with the listing of the C++ code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a function in C++ to calculate the area of a circle of radius r\n","\n","\n","**<font color='green'>Answer:</font>**\n","```cpp\n","#include <iostream>\n","\n","double calculateArea(double r) {\n","  return 3.14159 * r * r;\n","}\n","\n","int main() {\n","  double radius;\n","  std::cout << \"Enter the radius of the circle: \";\n","  std::cin >> radius;\n","  double area = calculateArea(radius);\n","  std::cout << \"The area of the circle is: \" << area << std::endl;\n","  return 0;\n","}\n","```\n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 3.55 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to write simple C++ code.\n","Please answer with the listing of the C++ code.\n","Question: {question}\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a function in C++ to calculate the area of a circle of radius r\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))\n"]},{"cell_type":"markdown","id":"74d2cd16","metadata":{"papermill":{"duration":0.017743,"end_time":"2024-11-02T19:49:10.292032","exception":false,"start_time":"2024-11-02T19:49:10.274289","status":"completed"},"tags":[]},"source":["Let's ask a more complicated geometry question now."]},{"cell_type":"code","execution_count":23,"id":"03985d9b","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:49:10.329365Z","iopub.status.busy":"2024-11-02T19:49:10.328757Z","iopub.status.idle":"2024-11-02T19:49:14.890964Z","shell.execute_reply":"2024-11-02T19:49:14.889951Z"},"papermill":{"duration":4.583253,"end_time":"2024-11-02T19:49:14.89304","exception":false,"start_time":"2024-11-02T19:49:10.309787","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple C++ code.\n","Please answer with the listing of the C++ code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a function in C++ to calculate the volume of a cylinder with radius r and height h\n","\n","\n","**<font color='green'>Answer:</font>**\n","```cpp\n","#include <iostream>\n","\n","double calculateCylinderVolume(double r, double h) {\n","  return 3.14159 * r * r * h;\n","}\n","\n","int main() {\n","  double radius, height;\n","  std::cout << \"Enter the radius of the cylinder: \";\n","  std::cin >> radius;\n","  std::cout << \"Enter the height of the cylinder: \";\n","  std::cin >> height;\n","  double volume = calculateCylinderVolume(radius, height);\n","  std::cout << \"The volume of the cylinder is: \" << volume << std::endl;\n","  return 0;\n","}\n","```\n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 4.56 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a function in C++ to calculate the volume of a cylinder with radius r and height h\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))\n"]},{"cell_type":"markdown","id":"7493eaba","metadata":{"papermill":{"duration":0.017827,"end_time":"2024-11-02T19:49:14.929399","exception":false,"start_time":"2024-11-02T19:49:14.911572","status":"completed"},"tags":[]},"source":["And let's ask a software dev. problem in C++ now."]},{"cell_type":"code","execution_count":24,"id":"5b62719e","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:49:14.966776Z","iopub.status.busy":"2024-11-02T19:49:14.966453Z","iopub.status.idle":"2024-11-02T19:49:20.233645Z","shell.execute_reply":"2024-11-02T19:49:20.232701Z"},"papermill":{"duration":5.288492,"end_time":"2024-11-02T19:49:20.235853","exception":false,"start_time":"2024-11-02T19:49:14.947361","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple C++ code.\n","Please answer with the listing of the C++ code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a function in C++ to order a list\n","\n","\n","**<font color='green'>Answer:</font>**\n","```cpp\n","#include <iostream>\n","#include <vector>\n","\n","using namespace std;\n","\n","// Function to order a list\n","void orderList(vector<int>& list) {\n","  // Sort the list in ascending order\n","  sort(list.begin(), list.end());\n","}\n","\n","int main() {\n","  // Example usage\n","  vector<int> numbers = {5, 2, 8, 1, 9, 3};\n","  orderList(numbers);\n","  \n","  // Print the ordered list\n","  cout << \"Ordered list: \";\n","  for (int number : numbers) {\n","    cout << number << \" \";\n","  }\n","  cout << endl;\n","\n","  return 0;\n","}\n","```\n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 5.26 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a function in C++ to order a list\"), max_length=512)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"4f203487","metadata":{"papermill":{"duration":0.01817,"end_time":"2024-11-02T19:49:20.27285","exception":false,"start_time":"2024-11-02T19:49:20.25468","status":"completed"},"tags":[]},"source":["## Multiple parameters questions\n","\n","I create here a prompt with multiple parameters and I ask a variety of questions.\n","\n","### Best food in France"]},{"cell_type":"code","execution_count":25,"id":"21f4855f","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:49:20.3105Z","iopub.status.busy":"2024-11-02T19:49:20.31015Z","iopub.status.idle":"2024-11-02T19:49:23.348285Z","shell.execute_reply":"2024-11-02T19:49:23.347224Z"},"papermill":{"duration":3.059874,"end_time":"2024-11-02T19:49:23.35084","exception":false,"start_time":"2024-11-02T19:49:20.290966","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","\n","\n","**<font color='red'>Question:</font>** What are the best 3 food in France?\n","\n","\n","**<font color='green'>Answer:</font>**\n","It's impossible to definitively say what the \"best\" 3 foods in France are, as taste is subjective. However, here are 3 iconic and widely loved French dishes:\n","\n","* **Croissants:** Flaky, buttery pastries that are a breakfast staple in France.\n","* **Macarons:** Delicate, colorful cookies with a smooth, creamy filling.\n","* **Steak Frites:** A classic combination of grilled steak served with crispy fries. \n","\n","\n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 3.03 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","Question: What are the {adjective} {number} {items} in {place}?\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(\n","    adjective=\"best\",\n","    number=\"3\",\n","    items=\"food\",\n","    place=\"France\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"c04207df","metadata":{"papermill":{"duration":0.018617,"end_time":"2024-11-02T19:49:23.389204","exception":false,"start_time":"2024-11-02T19:49:23.370587","status":"completed"},"tags":[]},"source":["### Best attractions in Italy"]},{"cell_type":"code","execution_count":26,"id":"be740630","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:49:23.42765Z","iopub.status.busy":"2024-11-02T19:49:23.427245Z","iopub.status.idle":"2024-11-02T19:49:29.037164Z","shell.execute_reply":"2024-11-02T19:49:29.036217Z"},"papermill":{"duration":5.631653,"end_time":"2024-11-02T19:49:29.039367","exception":false,"start_time":"2024-11-02T19:49:23.407714","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","\n","\n","**<font color='red'>Question:</font>** What are the best five attractions in Italy?\n","\n","\n","**<font color='green'>Answer:</font>**\n","It's impossible to definitively say which are the \"best\" five attractions in Italy, as personal preferences vary greatly. However, here are five incredibly popular and highly-rated attractions that are often considered must-sees:\n","\n","* **Colosseum:** A massive ancient Roman amphitheater, a symbol of the Roman Empire and a testament to its engineering prowess.\n","* **Vatican City:** The smallest country in the world, home to St. Peter's Basilica, the Vatican Museums, and the Sistine Chapel.\n","* **Leaning Tower of Pisa:** A famous bell tower that leans at an impressive angle, a symbol of the city of Pisa.\n","* **Pompeii:** A well-preserved Roman city frozen in time by the eruption of Mount Vesuvius.\n","* **Cinque Terre:** A string of five colorful villages perched on cliffs overlooking the Ligurian Sea. \n","\n","\n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 5.6 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    adjective=\"best\",\n","    number=\"five\",\n","    items=\"attractions\",\n","    place=\"Italy\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))  "]},{"cell_type":"markdown","id":"c9bbe50e","metadata":{"papermill":{"duration":0.018443,"end_time":"2024-11-02T19:49:29.076798","exception":false,"start_time":"2024-11-02T19:49:29.058355","status":"completed"},"tags":[]},"source":["### Most affordable places to retire in Portugal"]},{"cell_type":"code","execution_count":27,"id":"a26e83e7","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:49:29.115481Z","iopub.status.busy":"2024-11-02T19:49:29.11484Z","iopub.status.idle":"2024-11-02T19:49:30.926544Z","shell.execute_reply":"2024-11-02T19:49:30.925567Z"},"papermill":{"duration":1.833422,"end_time":"2024-11-02T19:49:30.928738","exception":false,"start_time":"2024-11-02T19:49:29.095316","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","\n","\n","**<font color='red'>Question:</font>** What are the most affordable two places to retire in Portugal?\n","\n","\n","**<font color='green'>Answer:</font>**\n","* **Évora:** This historic city boasts a low cost of living, charming architecture, and a vibrant cultural scene.\n","* **Coimbra:** Home to the University of Coimbra, this city offers a rich academic atmosphere and a relatively affordable lifestyle. \n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.8 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    adjective=\"most affordable\",\n","    number=\"two\",\n","    items=\"places to retire\",\n","    place=\"Portugal\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"89085bf1","metadata":{"papermill":{"duration":0.01843,"end_time":"2024-11-02T19:49:30.966386","exception":false,"start_time":"2024-11-02T19:49:30.947956","status":"completed"},"tags":[]},"source":["### Less known but great places to stay in Romania"]},{"cell_type":"code","execution_count":28,"id":"47553dd0","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:49:31.005011Z","iopub.status.busy":"2024-11-02T19:49:31.004666Z","iopub.status.idle":"2024-11-02T19:49:36.075144Z","shell.execute_reply":"2024-11-02T19:49:36.074177Z"},"papermill":{"duration":5.092364,"end_time":"2024-11-02T19:49:36.077327","exception":false,"start_time":"2024-11-02T19:49:30.984963","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","\n","\n","**<font color='red'>Question:</font>** What are the Less known but great 4 places to stay in Romania?\n","\n","\n","**<font color='green'>Answer:</font>**\n","Here are some lesser-known but fantastic places to stay in Romania:\n","\n","* **Sighisoara, Transylvania:**  A medieval citadel with cobblestone streets, charming guesthouses, and a rich history.\n","* **Bran Castle, Transylvania:**  The iconic castle made famous by Bram Stoker's Dracula. While it's a popular tourist destination, there are still charming guesthouses and hotels nearby.\n","* **The Danube Delta:**  A UNESCO World Heritage site, this unique ecosystem offers eco-friendly lodges and charming guesthouses.\n","* **Bucharest's Old Town:**  A vibrant and historic district with a mix of traditional and modern architecture, offering a range of boutique hotels and guesthouses.\n","\n","\n","Let me know if you'd like to explore other destinations in Romania! \n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 5.06 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    adjective=\"Less known but great\",\n","    number=\"4\",\n","    items=\"places to stay\",\n","    place=\"Romania\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"76776573","metadata":{"papermill":{"duration":0.018686,"end_time":"2024-11-02T19:49:36.115203","exception":false,"start_time":"2024-11-02T19:49:36.096517","status":"completed"},"tags":[]},"source":["### Great nature sights in USA"]},{"cell_type":"code","execution_count":29,"id":"b1fe71c2","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:49:36.154947Z","iopub.status.busy":"2024-11-02T19:49:36.154433Z","iopub.status.idle":"2024-11-02T19:49:40.837349Z","shell.execute_reply":"2024-11-02T19:49:40.836381Z"},"papermill":{"duration":4.705228,"end_time":"2024-11-02T19:49:40.83961","exception":false,"start_time":"2024-11-02T19:49:36.134382","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","\n","\n","**<font color='red'>Question:</font>** What are the Great nature spots 4 to visit in USA?\n","\n","\n","**<font color='green'>Answer:</font>**\n","Here are some of the most incredible natural spots to visit in the USA:\n","\n","* **Grand Canyon National Park, Arizona:**  A breathtaking canyon carved by the Colorado River, offering stunning views and hiking trails.\n","* **Yellowstone National Park, Wyoming, Montana, and Idaho:** Home to geysers, hot springs, and abundant wildlife, including bison, elk, and wolves.\n","* **Yosemite National Park, California:**  Famous for its towering granite cliffs, giant sequoia trees, and cascading waterfalls.\n","* **Acadia National Park, Maine:**  A coastal park with rugged mountains, rocky shores, and beautiful beaches. \n","\n","\n","Let me know if you'd like to explore more natural wonders! \n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 4.68 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    adjective=\"Great nature spots\",\n","    number=\"4\",\n","    items=\"to visit\",\n","    place=\"USA\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"504e4c07","metadata":{"papermill":{"duration":0.018964,"end_time":"2024-11-02T19:49:40.878083","exception":false,"start_time":"2024-11-02T19:49:40.859119","status":"completed"},"tags":[]},"source":["### Most important battles in WW2"]},{"cell_type":"code","execution_count":30,"id":"92586f13","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:49:40.919962Z","iopub.status.busy":"2024-11-02T19:49:40.919587Z","iopub.status.idle":"2024-11-02T19:49:47.336989Z","shell.execute_reply":"2024-11-02T19:49:47.336048Z"},"papermill":{"duration":6.441165,"end_time":"2024-11-02T19:49:47.339036","exception":false,"start_time":"2024-11-02T19:49:40.897871","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","\n","\n","**<font color='red'>Question:</font>** What are the most important 5 battles in WW2?\n","\n","\n","**<font color='green'>Answer:</font>**\n","Here are five of the most important battles of World War II, with a brief explanation of their significance:\n","\n","* **Battle of Midway (June 1942):** A decisive naval victory for the United States against Japan, halting their advance in the Pacific. It marked a turning point in the war in the Pacific.\n","* **Battle of Stalingrad (August 1942 - February 1943):** A brutal and costly battle for the Soviet Union, but ultimately a turning point in the war against Germany. The German defeat at Stalingrad marked the beginning of their retreat from the Eastern Front.\n","* **Battle of El Alamein (October 1942):** A major victory for the British and Commonwealth forces against the Axis powers, halting the German advance in North Africa. It was a crucial turning point in the war in the Mediterranean.\n","* **Battle of Normandy (June 1944):** The largest amphibious invasion in history, the D-Day landings\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 6.41 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    adjective=\"most important\",\n","    number=\"5\",\n","    items=\"battles\",\n","    place=\"WW2\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"6d49e692","metadata":{"papermill":{"duration":0.019142,"end_time":"2024-11-02T19:49:47.377668","exception":false,"start_time":"2024-11-02T19:49:47.358526","status":"completed"},"tags":[]},"source":["## Do it yourself questions"]},{"cell_type":"code","execution_count":31,"id":"9b802df8","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:49:47.41774Z","iopub.status.busy":"2024-11-02T19:49:47.416986Z","iopub.status.idle":"2024-11-02T19:50:00.288525Z","shell.execute_reply":"2024-11-02T19:50:00.287555Z"},"papermill":{"duration":12.893654,"end_time":"2024-11-02T19:50:00.290534","exception":false,"start_time":"2024-11-02T19:49:47.39688","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions about how to do \n","various activities by yourself (do it yourself).\n","Return the answer formated nicely, for example step by step.\n","\n","\n","**<font color='red'>Question:</font>** How I can build a shelter in the woods, if I have only a saw and a hammer??\n","\n","\n","**<font color='green'>Answer:</font>**\n","It's great you're thinking about shelter building!  However, building a safe and effective shelter with only a saw and a hammer is challenging.  Here's why:\n","\n","**Why it's difficult:**\n","\n","* **Saw limitations:** A saw is primarily for cutting wood, not shaping or building complex structures.\n","* **Hammer limitations:** A hammer is for driving nails, not creating structural supports.\n","* **Safety concerns:**  Without specialized tools and knowledge, building a shelter could be dangerous.\n","\n","**What you can do:**\n","\n","1. **Prioritize safety:**  Your top priority is safety.  Avoid building a shelter in unstable terrain or near potential hazards.\n","2. **Find natural materials:** Look for fallen branches, logs, and rocks that can be used for shelter building.\n","3. **Create a basic lean-to:**  Use fallen branches to create a lean-to against a tree or rock formation. This provides basic protection from the elements.\n","4. **Use natural materials for warmth:**  Gather dry leaves, moss, or pine needles to create a layer of insulation.\n","5. **Stay hydrated and conserve energy:**  This is crucial for survival.\n","\n","**Important Considerations:**\n","\n","* **Weather:**  Shelter building is more complex in harsh weather conditions.\n","* **Experience:**  Building a safe and effective shelter requires experience and knowledge.\n","* **Resources:**  You'll need to be resourceful and adapt to your surroundings.\n","\n","**Remember:**  Building a shelter in the woods is a complex task.  It's best to prioritize safety and seek professional guidance if possible.\n","\n","\n","**Additional Resources:**\n","\n","* **Outdoor survival guides:**  These can provide valuable information on shelter building techniques.\n","* **Local survival courses:**  Consider taking a course to learn from experienced instructors.\n","* **Online resources:**  There are many websites and forums dedicated to wilderness survival. \n","\n","\n","Let me know if you have any other questions! \n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 12.86 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to answer questions about how to do \n","various activities by yourself (do it yourself).\n","Return the answer formated nicely, for example step by step.\n","Question: How I can {action}?\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(\n","    action=\"build a shelter in the woods, if I have only a saw and a hammer?\",\n","    ), \n","    max_length=512)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":32,"id":"8ca56858","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:50:00.331034Z","iopub.status.busy":"2024-11-02T19:50:00.330717Z","iopub.status.idle":"2024-11-02T19:50:09.586154Z","shell.execute_reply":"2024-11-02T19:50:09.58527Z"},"papermill":{"duration":9.27806,"end_time":"2024-11-02T19:50:09.588294","exception":false,"start_time":"2024-11-02T19:50:00.310234","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions about how to do \n","various activities by yourself (do it yourself).\n","Return the answer formated nicely, for example step by step.\n","\n","\n","**<font color='red'>Question:</font>** How I can scrap a dinner for my two kids with only 4 eggs, a pint of flour and some oil??\n","\n","\n","**<font color='green'>Answer:</font>**\n","You can absolutely make a delicious dinner with those ingredients! Here's a simple recipe for **Egg Drop Soup** that's perfect for kids:\n","\n","**Ingredients:**\n","\n","* 4 eggs\n","* 1/2 cup flour\n","* 4 cups chicken broth (or vegetable broth)\n","* 1 tablespoon oil\n","* Salt and pepper to taste\n","\n","**Instructions:**\n","\n","1. **Prepare the broth:** In a large pot, bring the chicken broth to a boil.\n","2. **Make the egg mixture:** In a separate bowl, whisk the eggs until light and frothy. Gradually whisk in the flour until smooth.\n","3. **Add the egg mixture:** Slowly pour the egg mixture into the boiling broth, stirring constantly.\n","4. **Cook and serve:** Continue to cook for 2-3 minutes, or until the soup thickens. Season with salt and pepper to taste.\n","5. **Serve:** Ladle the soup into bowls and garnish with chopped green onions or sesame seeds (optional).\n","\n","**Tips:**\n","\n","* You can add other vegetables like chopped carrots or mushrooms to the soup for extra flavor and nutrition.\n","* For a richer flavor, use chicken broth instead of vegetable broth.\n","* You can also add a pinch of red pepper flakes for a little heat.\n","\n","Enjoy this simple and satisfying meal!\n","\n","\n","Let me know if you'd like to try another recipe! \n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 9.25 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    action=\"scrap a dinner for my two kids with only 4 eggs, a pint of flour and some oil?\",\n","    ), \n","    max_length=512)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"1dcda623","metadata":{"papermill":{"duration":0.020537,"end_time":"2024-11-02T19:50:09.628938","exception":false,"start_time":"2024-11-02T19:50:09.608401","status":"completed"},"tags":[]},"source":["## Multiple steps reasoning"]},{"cell_type":"code","execution_count":33,"id":"4653747c","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:50:09.670251Z","iopub.status.busy":"2024-11-02T19:50:09.669616Z","iopub.status.idle":"2024-11-02T19:50:12.319617Z","shell.execute_reply":"2024-11-02T19:50:12.318665Z"},"papermill":{"duration":2.673182,"end_time":"2024-11-02T19:50:12.321746","exception":false,"start_time":"2024-11-02T19:50:09.648564","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions in a chain of thought.\n","Use the answer to the first question as input for the second question.\n","Question one: What are the best city from France for tourists?\n","Question two: What are the best 3 of attractions from the city identified as answer to question one?\n","\n","\n","**<font color='green'>Answer:</font>**\n","Question one: What are the best city from France for tourists?\n","\n","\n","**<font color='green'>Answer:</font>** Paris, Lyon, Nice, Marseille are some of the best cities for tourists in France. \n","\n","Question two: What are the best 3 of attractions from the city identified as answer to question one?\n","\n","\n","**<font color='green'>Answer:</font>** Paris is known for its iconic Eiffel Tower, the Louvre Museum, and the Notre Dame Cathedral. \n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 2.64 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to answer questions in a chain of thought.\n","Use the answer to the first question as input for the second question.\n","Question one: What are the best city from {country} for tourists?\n","Question two: What are the best {number} of attractions from the city identified as answer to question one?\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(\n","    number=\"3\",\n","    country=\"France\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":34,"id":"314d4721","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:50:12.363432Z","iopub.status.busy":"2024-11-02T19:50:12.36285Z","iopub.status.idle":"2024-11-02T19:50:18.121489Z","shell.execute_reply":"2024-11-02T19:50:18.120598Z"},"papermill":{"duration":5.781803,"end_time":"2024-11-02T19:50:18.123711","exception":false,"start_time":"2024-11-02T19:50:12.341908","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions in a chain of thought.\n","Use the answer to the first question as input for the second question.\n","Question one: What are the best food item from France?\n","Question two: What are the most important 3 ingredients for the food identified at first step?\n","\n","\n","**<font color='green'>Answer:</font>**\n","Question one: What are the best food items from France?\n","\n","\n","**<font color='green'>Answer:</font>** This is subjective, but some of the most popular and highly regarded food items from France include:\n","* **Cheese:** France is renowned for its diverse range of cheeses, from the classic Brie and Camembert to the more pungent Roquefort and Comté.\n","* **Wine:** France is the world's leading producer of wine, with a wide variety of styles, from the crisp whites of Burgundy to the full-bodied reds of Bordeaux.\n","* **Bread:** French bread is known for its crusty exterior and soft interior, often made with a combination of flour, water, yeast, and salt.\n","* **Pastries:** From croissants and pain au chocolat to macarons and éclairs, French pastries are famous for their delicate flavors and beautiful presentation.\n","* **Seafood:** France has a long coastline and a rich tradition of seafood, with\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 5.75 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to answer questions in a chain of thought.\n","Use the answer to the first question as input for the second question.\n","Question one: What are the best food item from {country}?\n","Question two: What are the most important {number} ingredients for the food identified at first step?\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(\n","    number=\"3\",\n","    country=\"France\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"0059e2f9","metadata":{"papermill":{"duration":0.01979,"end_time":"2024-11-02T19:50:18.163989","exception":false,"start_time":"2024-11-02T19:50:18.144199","status":"completed"},"tags":[]},"source":["# Some really difficult reasoning"]},{"cell_type":"code","execution_count":35,"id":"d5c10c2c","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:50:18.205719Z","iopub.status.busy":"2024-11-02T19:50:18.205345Z","iopub.status.idle":"2024-11-02T19:50:26.043283Z","shell.execute_reply":"2024-11-02T19:50:26.042049Z"},"papermill":{"duration":7.861343,"end_time":"2024-11-02T19:50:26.04556","exception":false,"start_time":"2024-11-02T19:50:18.184217","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are a math professor, smart but cool.\n","Background: A train traveling from Bucharest to Ploiesti (60 km distance) has the speed of 60 km/h. \n","The train starts in Bucharest and travels until Ploiesti, once, only in this direction.\n","A swallow, flying with 90 km/h, fly from Ploiesti to the moving train.\n","When it reaches the train, the swallow flies back toward Ploiesti,\n","ahead of the train. At Ploiesti turns again back and continues to fly back and forth \n","(between the train approaching Ploiesti and Ploiesti) until the train reaches Ploiesti. \n","The swallow will fly continously back and forth all the time the train is traveling from Bucharest to Ploiesti.\n","\n","\n","**<font color='blue'>Reasoning:</font>** Think step by step. Explain your reasoning.\n","Frequent error: a frequent error is to try to solve this problem iteratively. There is a very \n","simple solution based on relationship between speed, distance, and time.\n","\n","\n","**<font color='red'>Question:</font>** How many kilometers will travel totally the swallow?\n","\n","\n","**<font color='green'>Answer:</font>**\n","Let's break down the problem:\n","\n","**1. Train's Travel Time:**\n","\n","* The train travels from Bucharest to Ploiesti at a speed of 60 km/h.\n","* Distance = 60 km\n","* Time = Distance / Speed = 60 km / 60 km/h = 1 hour\n","\n","**2. Swallow's Travel Time:**\n","\n","* The swallow flies from Ploiesti to the train at 90 km/h.\n","* Distance = 60 km (from Ploiesti to the train)\n","* Time = Distance / Speed = 60 km / 90 km/h = 2/3 hour\n","\n","**3. Swallow's Total Distance:**\n","\n","* The swallow flies back and forth between the train and Ploiesti.\n","* The swallow flies 60 km to the train and 60 km back to Ploiesti.\n","* Total distance = 60 km + 60 km = 120 km\n","\n","**Therefore, the swallow will travel a total of 120 kilometers.**\n","\n","\n","Let me know if you'd like to explore other interesting math problems! \n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 7.83 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are a math professor, smart but cool.\n","Background: A train traveling from Bucharest to Ploiesti (60 km distance) has the speed of 60 km/h. \n","The train starts in Bucharest and travels until Ploiesti, once, only in this direction.\n","A swallow, flying with 90 km/h, fly from Ploiesti to the moving train.\n","When it reaches the train, the swallow flies back toward Ploiesti,\n","ahead of the train. At Ploiesti turns again back and continues to fly back and forth \n","(between the train approaching Ploiesti and Ploiesti) until the train reaches Ploiesti. \n","The swallow will fly continously back and forth all the time the train is traveling from Bucharest to Ploiesti.\n","Reasoning: Think step by step. Explain your reasoning.\n","Frequent error: a frequent error is to try to solve this problem iteratively. There is a very \n","simple solution based on relationship between speed, distance, and time.\n","Question: {question}\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(question=\"How many kilometers will travel totally the swallow?\"), \n","    max_length=512)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":36,"id":"0c0eef87","metadata":{"execution":{"iopub.execute_input":"2024-11-02T19:50:26.134488Z","iopub.status.busy":"2024-11-02T19:50:26.133588Z","iopub.status.idle":"2024-11-02T19:50:29.834606Z","shell.execute_reply":"2024-11-02T19:50:29.833675Z"},"papermill":{"duration":3.768166,"end_time":"2024-11-02T19:50:29.83675","exception":false,"start_time":"2024-11-02T19:50:26.068584","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are a bright civil engineer.\n","You get to a river together with a goat and a cabbage. You find there a boat. The boatman can cross the \n","river with only two out of three (person, goat, and cabbage). But if the goat is alone with the cabbage\n","will eat the cabbage. \n","\n","\n","**<font color='blue'>Reasoning:</font>** Think step by step. Apply your best reasoning.\n","\n","\n","**<font color='red'>Question:</font>** What is the sequence of crossings the boatman can do so that everyone pass the river and the goat is not eating the cabbage.\n","\n","\n","**<font color='green'>Answer:</font>**\n","Here's the solution:\n","\n","1. **Take the goat across the river.** Leave the cabbage and the engineer behind.\n","2. **Return alone.** \n","3. **Take the engineer across the river.**\n","4. **Bring the goat back.** Now the engineer and the cabbage are together.\n","5. **Take the cabbage across the river.**\n","6. **Return alone.**\n","7. **Take the goat across the river.** \n","\n","Let me know if you'd like to try another puzzle! \n","<end_of_turn>\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 3.69 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are a bright civil engineer.\n","You get to a river together with a goat and a cabbage. You find there a boat. The boatman can cross the \n","river with only two out of three (person, goat, and cabbage). But if the goat is alone with the cabbage\n","will eat the cabbage. \n","Reasoning: Think step by step. Apply your best reasoning.\n","Question: {question}\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(question=\"What is the sequence of crossings the boatman can do so that everyone pass the river and the goat is not eating the cabbage.\"), \n","    max_length=512)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"aa76e67e","metadata":{"papermill":{"duration":0.02026,"end_time":"2024-11-02T19:50:29.877753","exception":false,"start_time":"2024-11-02T19:50:29.857493","status":"completed"},"tags":[]},"source":["# Conclusions\n","\n","\n","We were using `gemma2_instruct_2b_en`.\n","\n","Here is the analysis of results with gemma2_instruct_2b_en:\n","\n","* General question: answer to the point, and the answer seems sensible. \n","* General history knowledge is definitely improved over Gemma. American history (very simple questions) were aced.\n","* Math problem, with answer as Python code: correct, and code is documented.\n","* More Python code: if too complex, start to make mistakes.\n","* Software design questions: was able to define correctly a phone agenda class and an REST API service (using Flask)\n","* C++ and code of decent quality.\n","* Multi-parameters question: all answers are correct.\n","* A chain of reasoning (one task receives as input the output of the previous task) was performed correctly.\n","* More difficult math problem, requiring reasoning: the answer is not correct, because the reasoning is not correct. Gemma or Llama3 were not better at it, either.\n","* Interesting answer to the person, goat and cabbage crossing a river problem :-)."]}],"metadata":{"kaggle":{"accelerator":"gpu","dataSources":[{"isSourceIdPinned":true,"modelId":78150,"modelInstanceId":72246,"sourceId":85986,"sourceType":"modelInstanceVersion"}],"isGpuEnabled":true,"isInternetEnabled":true,"language":"python","sourceType":"notebook"},"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.10.14"},"papermill":{"default_parameters":{},"duration":352.89852,"end_time":"2024-11-02T19:50:33.189949","environment_variables":{},"exception":null,"input_path":"__notebook__.ipynb","output_path":"__notebook__.ipynb","parameters":{},"start_time":"2024-11-02T19:44:40.291429","version":"2.6.0"}},"nbformat":4,"nbformat_minor":5}