added get google page ranking tutorial

x4nth055 · x4nth055 · commit 64d5b81f1e73 · 2020-08-16T15:16:36.000+02:00
diff --git a/README.md b/README.md
@@ -112,6 +112,7 @@ This is a repository of all the tutorials of [The Python Code](https://www.thepy
     - [How to Use Google Drive API in Python](https://www.thepythoncode.com/article/using-google-drive--api-in-python). ([code](general/using-google-drive-api))
     - [How to Translate Text in Python](https://www.thepythoncode.com/article/translate-text-in-python). ([code](general/using-google-translate-api))
     - [How to Make a URL Shortener in Python](https://www.thepythoncode.com/article/make-url-shortener-in-python). ([code](general/url-shortener))
+    - [How to Get Google Page Ranking in Python](https://www.thepythoncode.com/article/get-google-page-ranking-by-keyword-in-python). ([code](general/getting-google-page-ranking))
 
 - ### [Database](https://www.thepythoncode.com/topic/using-databases-in-python)
     - [How to Use MySQL Database in Python](https://www.thepythoncode.com/article/using-mysql-database-in-python). ([code](database/mysql-connector))
diff --git a/general/getting-google-page-ranking/README.md b/general/getting-google-page-ranking/README.md
@@ -0,0 +1,17 @@
+# [How to Get Google Page Ranking in Python](https://www.thepythoncode.com/article/get-google-page-ranking-by-keyword-in-python)
+To run this:
+- `pip3 install -r requirements.txt`
+- Setup CSE API and retrieve `API_KEY` and `SEARCH_ENGINE_ID` as shown in [this tutorial](https://www.thepythoncode.com/article/use-google-custom-search-engine-api-in-python) and replace them in `page_ranking.py` script.
+- For instance, to get the page rank of `thepythoncode.com` of the keyword "google custom search engine api python":
+    ```
+    python page_ranking.py thepythoncode.com "google custom search engine api python"
+    ```
+    **Output:**
+    ```
+    [*] Going for page: 1
+    [+] thepythoncode.com is found on rank #3 for keyword: 'google custom search engine api python'
+    [+] Title: How to Use Google Custom Search Engine API in Python - Python ...
+    [+] Snippet: 10 results ... Learning how to create your own Google Custom Search Engine and use its 
+    Application Programming Interface (API) in Python.
+    [+] URL: https://www.thepythoncode.com/article/use-google-custom-search-engine-api-in-python 
+    ```
diff --git a/general/getting-google-page-ranking/page_ranking.py b/general/getting-google-page-ranking/page_ranking.py
@@ -0,0 +1,46 @@
+import requests
+import urllib.parse as p
+import sys
+
+# get the API KEY here: https://developers.google.com/custom-search/v1/overview
+API_KEY = "<INSERT_YOUR_API_KEY_HERE>"
+# get your Search Engine ID on your CSE control panel
+SEARCH_ENGINE_ID = "<INSERT_YOUR_SEARCH_ENGINE_ID_HERE>"
+# target domain you want to track
+target_domain = sys.argv[1]
+# target keywords
+query = sys.argv[2]
+
+for page in range(1, 11):
+    print("[*] Going for page:", page)
+    # calculating start 
+    start = (page - 1) * 10 + 1
+    # make API request
+    url = f"https://www.googleapis.com/customsearch/v1?key={API_KEY}&cx={SEARCH_ENGINE_ID}&q={query}&start={start}"
+    data = requests.get(url).json()
+    search_items = data.get("items")
+    # a boolean that indicates whether `target_domain` is found
+    found = False
+    for i, search_item in enumerate(search_items, start=1):
+        # get the page title
+        title = search_item.get("title")
+        # page snippet
+        snippet = search_item.get("snippet")
+        # alternatively, you can get the HTML snippet (bolded keywords)
+        html_snippet = search_item.get("htmlSnippet")
+        # extract the page url
+        link = search_item.get("link")
+        # extract the domain name from the URL
+        domain_name = p.urlparse(link).netloc
+        if domain_name.endswith(target_domain):
+            # get the page rank
+            rank = i + start - 1
+            print(f"[+] {target_domain} is found on rank #{rank} for keyword: '{query}'")
+            print("[+] Title:", title)
+            print("[+] Snippet:", snippet)
+            print("[+] URL:", link)
+            # target domain is found, exit out of the program
+            found = True
+            break
+    if found:
+        break
diff --git a/general/getting-google-page-ranking/requirements.txt b/general/getting-google-page-ranking/requirements.txt
@@ -0,0 +1 @@
+requests
