Keep seller_country as a market signal (regional pricing), no longer stripped

Country is coarse and not tied to any identifier, so it's kept while all
seller-identifying fields stay stripped. Useful long-term for regional price
analysis.

- contribute.py: seller_country moved from FORBIDDEN to KEEP
- scrape.py (kyurish + apify) and import_profile.py now capture seller_country
- merge_kaggle canonical fields + benchmarks.sample.json backfilled (null)
- DATA_POLICY.md updated: country kept, rationale documented; identifiers
  still dropped
- tests assert country is kept/validated and captured (suite 69/69)

Verified live: fresh scrape captured seller_country (PK) for the rag niche.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

Author: Ahad690

DATA_POLICY.md

@@ -8,10 +8,15 @@ user account data, and it never scrapes by default.
 When you use the live scrape (opt-in, your own key) or contribute data, only
 **public listing metadata** is processed. The canonical record (PRD §7.1) is:
 
-`scraped_at, category, subcategory, title, seller_level, rating, review_count,
-basic_price, standard_price, premium_price, basic_delivery_days,
-standard_delivery_days, premium_delivery_days, tags, gig_count_in_search,
-currency, original_currency`.
+`scraped_at, category, subcategory, title, seller_level, seller_country,
+rating, review_count, basic_price, standard_price, premium_price,
+basic_delivery_days, standard_delivery_days, premium_delivery_days, tags,
+gig_count_in_search, currency, original_currency`.
+
+`seller_country` is a coarse market signal (a country code) kept for regional
+pricing analysis. It is *not* tied to a username, profile, or any other
+identifier — those are always stripped (below) — so a row cannot be traced back
+to a specific seller.
 
 ## What is kept vs stripped on contribution
 
@@ -20,8 +25,8 @@ Contribution is **opt-in** and defaults to nothing. When you contribute,
 seller-identifying fields before anything leaves your machine:
 
 **Dropped (hard requirement):** seller username, seller display name, profile
-URL, gig URL, profile photo URL, seller country, any free-text review content,
-any image URLs, any ID fields.
+URL, gig URL, seller profile URL, profile photo URL, any free-text review
+content, any image URLs, any ID fields.
 
 A PII guard (`assert_no_pii`) runs before any upload and aborts if a non-keep
 field is present. Use `contribute.py --dry-run` to inspect the exact cleaned,

skills/fiverr-gig-optimizer/references/benchmarks.sample.json

@@ -5,6 +5,7 @@
     "subcategory": "AI Development > AI Chatbots",
     "title": "I will build a custom AI chatbot for your website with openai",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.9,
     "review_count": 847,
     "basic_price": 75,
@@ -30,6 +31,7 @@
     "subcategory": "AI Development > AI Chatbots",
     "title": "I will create an ai chatbot using openai and langchain",
     "seller_level": "level_one_seller",
+    "seller_country": null,
     "rating": 4.8,
     "review_count": 312,
     "basic_price": 60,
@@ -55,6 +57,7 @@
     "subcategory": "AI Development > AI Chatbots",
     "title": "I will develop ai chatbot and n8n automation workflows",
     "seller_level": "top_rated_seller",
+    "seller_country": null,
     "rating": 5.0,
     "review_count": 1203,
     "basic_price": 120,
@@ -80,6 +83,7 @@
     "subcategory": "AI Development > AI Chatbots",
     "title": "I will make a whatsapp ai chatbot with openai gpt",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.7,
     "review_count": 198,
     "basic_price": 90,
@@ -105,6 +109,7 @@
     "subcategory": "AI Development > AI Chatbots",
     "title": "I will build an ai customer support chatbot with automation",
     "seller_level": "level_one_seller",
+    "seller_country": null,
     "rating": 4.6,
     "review_count": 87,
     "basic_price": 50,
@@ -130,6 +135,7 @@
     "subcategory": "AI Development > AI Chatbots",
     "title": "I will create a rag ai chatbot trained on your data",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.9,
     "review_count": 534,
     "basic_price": 110,
@@ -155,6 +161,7 @@
     "subcategory": "Logo & Brand Identity > Logo Design",
     "title": "I will design a modern minimalist logo for your brand",
     "seller_level": "top_rated_seller",
+    "seller_country": null,
     "rating": 5.0,
     "review_count": 2890,
     "basic_price": 25,
@@ -180,6 +187,7 @@
     "subcategory": "Logo & Brand Identity > Logo Design",
     "title": "I will create a professional logo design with source files",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.8,
     "review_count": 1450,
     "basic_price": 20,
@@ -205,6 +213,7 @@
     "subcategory": "Logo & Brand Identity > Logo Design",
     "title": "I will do a hand drawn vintage logo design",
     "seller_level": "level_one_seller",
+    "seller_country": null,
     "rating": 4.7,
     "review_count": 410,
     "basic_price": 35,
@@ -230,6 +239,7 @@
     "subcategory": "Search > SEO",
     "title": "I will do complete on page seo optimization for your website",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.9,
     "review_count": 980,
     "basic_price": 45,
@@ -255,6 +265,7 @@
     "subcategory": "Search > SEO",
     "title": "I will be your seo expert for keyword research and strategy",
     "seller_level": "top_rated_seller",
+    "seller_country": null,
     "rating": 5.0,
     "review_count": 1670,
     "basic_price": 60,
@@ -280,6 +291,7 @@
     "subcategory": "Search > SEO",
     "title": "I will write seo optimized blog articles and content",
     "seller_level": "level_one_seller",
+    "seller_country": null,
     "rating": 4.6,
     "review_count": 220,
     "basic_price": 30,
@@ -305,6 +317,7 @@
     "subcategory": "Data Scraping",
     "title": "do web scraping and data scraping using python",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.9,
     "review_count": 1547,
     "basic_price": 30.0,
@@ -330,6 +343,7 @@
     "subcategory": "Data Scraping",
     "title": "do python web scraping, data extraction and automation",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.9,
     "review_count": 949,
     "basic_price": 30.0,
@@ -355,6 +369,7 @@
     "subcategory": "Data Scraping",
     "title": "do website scraping, data extraction, mining, collection, python web scraping",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.8,
     "review_count": 82,
     "basic_price": 30.0,
@@ -380,6 +395,7 @@
     "subcategory": "Data Scraping",
     "title": "do web scraping, website scraping, web scraper in python",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.8,
     "review_count": 1353,
     "basic_price": 30.0,
@@ -405,6 +421,7 @@
     "subcategory": "Data Scraping",
     "title": "do python web scraping, data scraping, and data mining",
     "seller_level": "top_rated_seller",
+    "seller_country": null,
     "rating": 4.9,
     "review_count": 464,
     "basic_price": 100.0,
@@ -430,6 +447,7 @@
     "subcategory": "Data Scraping",
     "title": "provide professional web scraping services using python",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.9,
     "review_count": 78,
     "basic_price": 100.0,
@@ -455,6 +473,7 @@
     "subcategory": "Data Scraping",
     "title": "do python web scraping, data scraping from any websites",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 5.0,
     "review_count": 46,
     "basic_price": 30.0,
@@ -480,6 +499,7 @@
     "subcategory": "Data Processing",
     "title": "do web scraping data extraction automation using python",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.9,
     "review_count": 108,
     "basic_price": 30.0,
@@ -505,6 +525,7 @@
     "subcategory": "Data Scraping",
     "title": "do web scraping and automation using python",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 5.0,
     "review_count": 471,
     "basic_price": 100.0,
@@ -530,6 +551,7 @@
     "subcategory": "Data Scraping",
     "title": "do python web scraping, data scraping, and data mining",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.9,
     "review_count": 29,
     "basic_price": 30.0,
@@ -555,6 +577,7 @@
     "subcategory": "Software Development",
     "title": "do web automation and web scraping using python",
     "seller_level": null,
+    "seller_country": null,
     "rating": 5.0,
     "review_count": 4,
     "basic_price": 10.0,
@@ -580,6 +603,7 @@
     "subcategory": "Data Scraping",
     "title": "do python web scraping, data mining, and web automation",
     "seller_level": "top_rated_seller",
+    "seller_country": null,
     "rating": 5.0,
     "review_count": 21,
     "basic_price": 30.0,
@@ -605,6 +629,7 @@
     "subcategory": "Data Scraping",
     "title": "do professional python web scraping and automation",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.9,
     "review_count": 332,
     "basic_price": 30.0,
@@ -630,6 +655,7 @@
     "subcategory": "Data Scraping",
     "title": "conduct web scraping using python",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.9,
     "review_count": 442,
     "basic_price": 100.0,
@@ -655,6 +681,7 @@
     "subcategory": "Data Scraping",
     "title": "do fast python web scraping, data extraction and automation",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 5.0,
     "review_count": 45,
     "basic_price": 30.0,
@@ -680,6 +707,7 @@
     "subcategory": "Data Scraping",
     "title": "do python web scraping data scraping website scraping data mining",
     "seller_level": "level_one_seller",
+    "seller_country": null,
     "rating": 5.0,
     "review_count": 38,
     "basic_price": 30.0,
@@ -705,6 +733,7 @@
     "subcategory": "Data Entry",
     "title": "web scraping, python, data scraping, web scraper",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 5.0,
     "review_count": 11,
     "basic_price": 50.0,
@@ -730,6 +759,7 @@
     "subcategory": "Data Scraping",
     "title": "web scraping and crawling with python",
     "seller_level": "level_one_seller",
+    "seller_country": null,
     "rating": 5.0,
     "review_count": 34,
     "basic_price": 30.0,
@@ -755,6 +785,7 @@
     "subcategory": "Data Processing",
     "title": "do python web scraping and web crawling for data extraction",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.9,
     "review_count": 102,
     "basic_price": 10.0,
@@ -780,6 +811,7 @@
     "subcategory": "Data Scraping",
     "title": "do python web scraping and data mining",
     "seller_level": "top_rated_seller",
+    "seller_country": null,
     "rating": 5.0,
     "review_count": 1162,
     "basic_price": 40.0,
@@ -803,6 +835,7 @@
     "subcategory": "Data Scraping",
     "title": "do data scraping, web crawling, and automation services in python",
     "seller_level": "level_one_seller",
+    "seller_country": null,
     "rating": 4.8,
     "review_count": 2,
     "basic_price": 30.0,
@@ -827,6 +860,7 @@
     "subcategory": "Data Scraping",
     "title": "web scraping, python web scraper, data scraping from any website",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.9,
     "review_count": 147,
     "basic_price": 30.0,
@@ -852,6 +886,7 @@
     "subcategory": "Data Scraping",
     "title": "do web scraping and automation python",
     "seller_level": "level_one_seller",
+    "seller_country": null,
     "rating": 4.6,
     "review_count": 24,
     "basic_price": 30.0,
@@ -877,6 +912,7 @@
     "subcategory": "Software Development",
     "title": "do python web scraping, data scraping, data mining",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 5.0,
     "review_count": 136,
     "basic_price": 25.0,
@@ -902,6 +938,7 @@
     "subcategory": "Data Scraping",
     "title": "do python web scraping, web automation, web crawling",
     "seller_level": "level_two_seller",
+    "seller_country": null,
     "rating": 4.8,
     "review_count": 64,
     "basic_price": 30.0,

skills/fiverr-gig-optimizer/scripts/contribute.py

@@ -23,15 +23,16 @@
 # §7.3 — the ONLY fields that may ever leave the user's machine.
 KEEP = [
     "scraped_at", "category", "subcategory", "title", "seller_level",
-    "rating", "review_count", "basic_price", "standard_price", "premium_price",
+    "seller_country", "rating", "review_count",
+    "basic_price", "standard_price", "premium_price",
     "basic_delivery_days", "standard_delivery_days", "premium_delivery_days",
     "tags", "gig_count_in_search", "currency", "original_currency",
 ]
 # §7.3 — must NEVER appear in output (asserted before any upload).
 FORBIDDEN = [
     "seller_username", "seller_name", "seller_display_name", "profile_url",
     "gig_url", "seller_url", "profile_photo_url", "freelancers_link",
-    "seller_country", "review_text", "reviews", "image_url", "image_urls",
+    "review_text", "reviews", "image_url", "image_urls",
     "id", "gig_id", "seller_id",
 ]
 

skills/fiverr-gig-optimizer/scripts/import_profile.py

@@ -65,6 +65,7 @@ def map_existing_gig(detail, fx):
         "category": detail.get("category"),
         "subcategory": detail.get("sub_category"),
         "seller_level": (detail.get("seller") or {}).get("level"),
+        "seller_country": (detail.get("seller") or {}).get("country"),
         "rating": detail.get("rating"),
         "review_count": detail.get("reviews_count"),
         "tags": [t.lower() for t in (detail.get("tags") or []) if t],

skills/fiverr-gig-optimizer/scripts/scrape.py

@@ -120,6 +120,7 @@ def map_kyurish(search_item, detail, total_results, category_override, fx, today
         "subcategory": detail.get("sub_category"),
         "title": detail.get("title") or search_item.get("title"),
         "seller_level": seller.get("level") or search_item.get("seller_level") or None,
+        "seller_country": seller.get("country") or None,
         "rating": detail.get("rating") if detail.get("rating") else search_item.get("rating"),
         "review_count": detail.get("reviews_count")
         if detail.get("reviews_count") is not None else search_item.get("reviews_count"),
@@ -163,6 +164,7 @@ def map_apify(item, total_results, category_override, fx, today):
         "subcategory": item.get("subCategoryId") or item.get("subcategory"),
         "title": item.get("title"),
         "seller_level": item.get("sellerLevel") or item.get("seller_level"),
+        "seller_country": item.get("sellerCountry") or item.get("seller_country"),
         "rating": item.get("sellerRating") or item.get("rating"),
         "review_count": item.get("sellerReviewCount") or item.get("review_count"),
         **tiers,

skills/fiverr-gig-optimizer/scripts/seed/merge_kaggle.py

@@ -27,7 +27,8 @@
 
 CANONICAL_FIELDS = [
     "scraped_at", "category", "subcategory", "title", "seller_level",
-    "rating", "review_count", "basic_price", "standard_price", "premium_price",
+    "seller_country", "rating", "review_count",
+    "basic_price", "standard_price", "premium_price",
     "basic_delivery_days", "standard_delivery_days", "premium_delivery_days",
     "tags", "gig_count_in_search", "currency", "original_currency",
 ]