Homework

Author: sshilpika

05_llm_part2/Intro_to_Prompt_Engineering.ipynb

@@ -5,7 +5,7 @@
     "colab": {
       "provenance": [],
       "gpuType": "T4",
-      "authorship_tag": "ABX9TyOEwj0AKeV1VsbV3PwMuA5l",
+      "authorship_tag": "ABX9TyN+XRFlRwLZE3HNnHPE06NT",
       "include_colab_link": true
     },
     "kernelspec": {
@@ -47,6 +47,13 @@
         "id": "riLhjz2ZzQVX"
       }
     },
+    {
+      "cell_type": "markdown",
+      "source": [],
+      "metadata": {
+        "id": "OJLHB31RZLA9"
+      }
+    },
     {
       "cell_type": "code",
       "source": [
@@ -68,7 +75,7 @@
         "id": "T45bdyH2zRRm",
         "outputId": "58caed83-a9f2-4bc5-a729-6483ef6d53a0"
       },
-      "execution_count": 5,
+      "execution_count": null,
       "outputs": [
         {
           "output_type": "stream",
@@ -251,7 +258,7 @@
         "id": "DIqIqNCSzmUH",
         "outputId": "62dd5c81-c756-4ce9-fdc7-4dfc6115ce6a"
       },
-      "execution_count": 6,
+      "execution_count": null,
       "outputs": [
         {
           "name": "stdout",
@@ -304,7 +311,7 @@
       "metadata": {
         "id": "pGVwRvNd1lbd"
       },
-      "execution_count": 7,
+      "execution_count": null,
       "outputs": []
     },
     {
@@ -344,7 +351,7 @@
       "metadata": {
         "id": "ZsoDNet42sRA"
       },
-      "execution_count": 8,
+      "execution_count": null,
       "outputs": []
     },
     {
@@ -430,7 +437,7 @@
         "id": "Std04T8_2vhG",
         "outputId": "702f883f-a16c-4e2a-8f0c-e72dc1ba0d88"
       },
-      "execution_count": 9,
+      "execution_count": null,
       "outputs": [
         {
           "output_type": "stream",
@@ -494,7 +501,7 @@
         "id": "bXAdCaEs3DYQ",
         "outputId": "02f65733-21a3-4d4c-d658-2c4219a8a89e"
       },
-      "execution_count": 10,
+      "execution_count": null,
       "outputs": [
         {
           "output_type": "stream",
@@ -544,7 +551,7 @@
         "id": "gdZUAuCe3Irb",
         "outputId": "062adfc9-06a9-4f88-bd6d-e1ea9837d802"
       },
-      "execution_count": 11,
+      "execution_count": null,
       "outputs": [
         {
           "output_type": "stream",
@@ -1305,7 +1312,7 @@
       "metadata": {
         "id": "ha3h7QcZ_BSB"
       },
-      "execution_count": 12,
+      "execution_count": null,
       "outputs": []
     },
     {
@@ -2169,14 +2176,64 @@
         "id": "MekoIU8SlqIY"
       }
     },
+    {
+      "cell_type": "markdown",
+      "source": [
+        "**Solution**"
+      ],
+      "metadata": {
+        "id": "lHq_9HUGZMrp"
+      }
+    },
     {
       "cell_type": "code",
-      "source": [],
+      "source": [
+        "few_shot_COT_prompt =  \"\"\"You are a mathematical genius.\n",
+        "The template of the question is given as Q: [question]. The template of the answer is given as A: [answer].\n",
+        "Help me solve the problem below using the examples given.\n",
+        "\n",
+        "Examples:\n",
+        "Q: The odd numbers in this group add up to an even number: 4, 8, 9, 15, 12, 2, 1.\n",
+        "A: The given numbers are: (4, 8, 9, 15, 12, 2, 1). Next select the odd numbers (9, 15, 1).  Adding all the selected odd numbers (9, 15, 1) gives 25. 25 is an odd number, hence the answer is False.\n",
+        "\n",
+        "Q: The odd numbers in this group add up to an even number: 17, 10, 19, 4, 8, 12, 24.\n",
+        "A: The given numbers are: (17, 10, 19, 4, 8, 12, 24). Next select the odd numbers (17, 19).  Adding all the selected odd numbers (17, 19) gives 36. 36 is an even number, hence the answer is True.\n",
+        "\n",
+        "Q: The odd numbers in this group add up to an even number: 16, 11, 14, 4, 8, 13, 24.\n",
+        "A: The given numbers are: (16, 11, 14, 4, 8, 13, 24). Next select the odd numbers (11, 13).  Adding all the selected odd numbers (11, 13) gives 24. 24 is an even number, hence the answer is True.\n",
+        "\n",
+        "Q: The odd numbers in this group add up to an even number: 17, 9, 10, 12, 13, 4, 2.\n",
+        "A: The given numbers are: (17, 9, 10, 12, 13, 4, 2). Next select the odd numbers (17, 9, 13).  Adding all the selected odd numbers (17, 9, 13) gives 39. 39 is an odd number, hence the answer is False.\n",
+        "\n",
+        "Problem:\n",
+        "Q: The odd numbers in this group add up to an even number: 15, 32, 5, 13, 82, 7, 1.\n",
+        "A:\n",
+        "\"\"\"\n",
+        "#15 + 5 + 13 + 7 + 1 = 41\n",
+        "few_shot_COT_prompt_explanation = get_completion_falcon(few_shot_COT_prompt, **kwargs)\n",
+        "print(few_shot_COT_prompt_explanation)\n",
+        "\n"
+      ],
       "metadata": {
-        "id": "T-zkEEeKlmRR"
+        "id": "jB_QBqufZQa0"
       },
       "execution_count": null,
       "outputs": []
+    },
+    {
+      "cell_type": "markdown",
+      "source": [
+        "Falcon-7B-Instruct is a 7B parameters causal decoder-only model built by TII based on Falcon-7B and finetuned on a mixture of chat/instruct datasets. The model, is not very efficient at identifying odd numbers. However, it does generate the correct sum in most cases. Although, continously prompting using few-shot chain-of-thought prompting to get the sum of odd numbers from a list of integers, did result in the correct result. The effort for this simple math task is tedious. However, using the newer Chatgpt 4o did result in the correct answer using zero-shot prompting.\n",
+        "\n",
+        "\n",
+        "The temperature parameter in large language models, including those accessible via Hugging Face, controls the randomness of the models responses. It adjusts the probability distribution of the generated tokens, resulting in how \"creative\" or \"conservative\" the output is.\n",
+        "\n",
+        "- Low Temperature (near 0): The model becomes more deterministic (more probable tokens are chosen). This is great for tasks which require high accuracy and reliability, like factual answers or code generation.\n",
+        "- High Temperature (near 1 or above): The model generates more creative responses (less probable tokens are chosen). This can lead to more imaginative and varied outputs, which can be useful in creative writing or brainstorming.\n"
+      ],
+      "metadata": {
+        "id": "hrV_EiogZWZ3"
+      }
     }
   ]
 }