Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: flowercoder/ProxyPool
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: master
Choose a base ref
...
head repository: Python3WebSpider/ProxyPool
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: master
Choose a head ref
  • 12 commits
  • 16 files changed
  • 8 contributors

Commits on Jul 10, 2022

  1. add log settings

    @Germey
    Germey committed Jul 10, 2022
    Configuration menu
    Copy the full SHA
    2154cef View commit details
    Browse the repository at this point in the history

  2. add readme

    @Germey
    Germey committed Jul 10, 2022
    Configuration menu
    Copy the full SHA
    78325d0 View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2023

  1. 添加了 geonodedaili.py 爬取代理 (Python3WebSpider#186) 

    * add geonodedaili.py

* add headers through crawl function
    @MGMCN
    MGMCN authored Mar 1, 2023
    Configuration menu
    Copy the full SHA
    4c50711 View commit details
    Browse the repository at this point in the history

  2. requirements.txt modified (Python3WebSpider#187)

    @MGMCN
    MGMCN authored Mar 1, 2023
    Configuration menu
    Copy the full SHA
    0fd5e6c View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. 增加私人代理池场景中，带身份认证的代理的支持 (Python3WebSpider#198) 

    * 增加私人代理池场景中，带身份认证的代理的支持

* 修复忘记修改部分

---------

Co-authored-by: dashuai xu <xujianghuai@126.com>
    @dashuaixu
    dashuaixu and dashuai xu authored Aug 30, 2023
    Configuration menu
    Copy the full SHA
    a0edcb0 View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2023

  1. Python3WebSpider#140 及修改可环境变量配置的参数 (Python3WebSpider#202) 

    * 1、设置scheduler.py中dev模式的flask run，不进行启动时的自动重新加载reload

* 1、修改PROXY_SCORE_MAX，PROXY_SCORE_MIN，PROXY_SCORE_INIT三项配置，为可环境变量配置
2、添加可环境变量配置项TEST_DONT_SET_MAX_SCORE，允许设置当tester检测到某个proxy可用时，只是保持原score，而不将其score设置成max。

* 增加获取proxy接口的认证header, API-KEY。可配置，默认不需要
    @inVains
    inVains authored Nov 23, 2023
    Configuration menu
    Copy the full SHA
    0a6d861 View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2023

  1. 添加两个代理 (Python3WebSpider#203)

    @WangShayne
    WangShayne authored Dec 1, 2023
    Configuration menu
    Copy the full SHA
    2344ee1 View commit details
    Browse the repository at this point in the history

Commits on Dec 26, 2023

  1. fix docip bug & add support for python 3.11 (Python3WebSpider#205)

    @doraneko6
    doraneko6 authored Dec 26, 2023
    Configuration menu
    Copy the full SHA
    97229e6 View commit details
    Browse the repository at this point in the history

Commits on Jan 1, 2024

  1. fix: avoid error on "ip:port:port" format (Python3WebSpider#207)

    @cesaryuan
    cesaryuan authored Jan 1, 2024
    Configuration menu
    Copy the full SHA
    0033586 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. add sub proxy pool mechanics (Python3WebSpider#213)

    @inVains
    inVains authored Mar 25, 2024
    Configuration menu
    Copy the full SHA
    78b3244 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2024

  1. validate testing ip

    @Germey
    Germey committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    7c77ad0 View commit details
    Browse the repository at this point in the history

  2. add proxy

    @Germey
    Germey committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    3ed558b View commit details
    Browse the repository at this point in the history
Loading