Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: coder-hxl/x-crawl
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v4.0.1
Choose a base ref
...
head repository: coder-hxl/x-crawl
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v5.0.0
Choose a head ref
  • 20 commits
  • 31 files changed
  • 1 contributor

Commits on Mar 29, 2023

  1. Refactoring: Add a controller

    @coder-hxl
    coder-hxl committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    acf2cb9 View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2023

  1. Refactoring: API type adjustment - parameter adjustment - return valu… 

    …e adjustment - connection controller
    @coder-hxl
    coder-hxl committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    859b76a View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2023

  1. Refactoring: Scraping API dynamically adjusts return value and type h… 

    …ints - provides additional parameters for Scraping API
    @coder-hxl
    coder-hxl committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    971d76b View commit details
    Browse the repository at this point in the history

  2. Refactoring: crawling API configuration parameter type decoupling - c… 

    …rawlData API configuration parameter refactoring
    @coder-hxl
    coder-hxl committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    98abe0b View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2023

  1. Chores: Extract common parts for MergeConfig, reduce duplication of c… 

    …ode, and rename MergeConfig to LoaderConfig
    @coder-hxl
    coder-hxl committed Apr 1, 2023
    Configuration menu
    Copy the full SHA
    51cf1fe View commit details
    Browse the repository at this point in the history

  2. Bug Fixes: Retry

    @coder-hxl
    coder-hxl committed Apr 1, 2023
    Configuration menu
    Copy the full SHA
    ab53b87 View commit details
    Browse the repository at this point in the history

  3. Bug Fixes: CrawlPageConfigObject and CrawlDataConfigObject writing me… 

    …thods do not work due to reference issues
    @coder-hxl
    coder-hxl committed Apr 1, 2023
    Configuration menu
    Copy the full SHA
    c687a2c View commit details
    Browse the repository at this point in the history

  4. Update: Print capture log

    @coder-hxl
    coder-hxl committed Apr 1, 2023
    Configuration menu
    Copy the full SHA
    913b47e View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2023

  1. Bug Fixes: The intervalTime and maxRetry parameters passed in by craw… 

    …lFile API do not work
    @coder-hxl
    coder-hxl committed Apr 2, 2023
    Configuration menu
    Copy the full SHA
    41f6aa5 View commit details
    Browse the repository at this point in the history

  2. Chores: defaults and type tweaks

    @coder-hxl
    coder-hxl committed Apr 2, 2023
    Configuration menu
    Copy the full SHA
    2be3cda View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2023

  1. Add: Complete priority request function

    @coder-hxl
    coder-hxl committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    e1ea111 View commit details
    Browse the repository at this point in the history

  2. Bug Fixes: crawlData default type

    @coder-hxl
    coder-hxl committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    c8fcecc View commit details
    Browse the repository at this point in the history

  3. test

    @coder-hxl
    coder-hxl committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    c895399 View commit details
    Browse the repository at this point in the history

  4. Add: The crawlFile API adds a beforeSave callback function, allowing … 

    …users to customize the storage path and name of each requested file
    @coder-hxl
    coder-hxl committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    15639c4 View commit details
    Browse the repository at this point in the history

  5. Add: Allows to set proxy uniformly in crawling API

    @coder-hxl
    coder-hxl committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    49b2cac View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2023

  1. Bug Fixes: will be lost when keeping the file

    @coder-hxl
    coder-hxl committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    d936cee View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2023

  1. Update: crawlFile API configuration changes

    @coder-hxl
    coder-hxl committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    ef822cc View commit details
    Browse the repository at this point in the history

  2. Chores: Adjustments

    @coder-hxl
    coder-hxl committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    1e0ce3c View commit details
    Browse the repository at this point in the history

  3. Document: Complete v5.0.0

    @coder-hxl
    coder-hxl committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    552ce54 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'v5.0.0'

    @coder-hxl
    coder-hxl committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    a6d7e23 View commit details
    Browse the repository at this point in the history
Loading