Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: googleapis/python-bigquery-storage
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.7.0
Choose a base ref
...
head repository: googleapis/python-bigquery-storage
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v0.8.0
Choose a head ref
  • 17 commits
  • 109 files changed
  • 8 contributors

Commits on Aug 6, 2019

  1. Configuration menu
    Copy the full SHA
    a2fbda1 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2019

  1. Refactor system tests. (#8984)

    * Refactor system tests.
    
    Use parameterized tests for different source formats.
    
    * flake8
    tswast authored Aug 7, 2019
    Configuration menu
    Copy the full SHA
    aecec63 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2019

  1. Configuration menu
    Copy the full SHA
    1e0f479 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2019

  1. BigQuery Storage: Add more in-depth system tests (#8992)

    * Add additional BQ storage system test fixtures
    
    * Add reader column selection system test
    
    * Add basic reader system test
    
    * Add reader with row filter system test
    
    * Add reading data with snapshot system test
    
    * Add reading column partitioned table system test
    
    * Add system test for column types data conversions
    
    * Add ingestion time partitioned table system test
    
    * Add system test for resuming a read at an offset
    
    * Remove unnecessary protobuf install in noxfile
    
    * Add TODO comment to replace a test helper method
    
    A similar method is planned to be added to the library itself, and when
    done, the _add_rows() will not be needed anymore.
    
    * Extract BQ client to session fixture in tests
    
    Creating a client once per system tests session avoids the overhead
    of authenticating before each test case.
    
    * Only create BQ storage client once per test run
    
    Creating a client just once avoids the auth overhead on every system
    test case.
    
    * Add common credentials fixture for system tests
    plamut authored Aug 21, 2019
    Configuration menu
    Copy the full SHA
    884949c View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2019

  1. Add BigQuery to extra system test dependencies. (#9072)

    * Add BigQuery to extra system test dependencies.
    
    * Render with synthtool
    tswast authored Aug 23, 2019
    Configuration menu
    Copy the full SHA
    d151fcc View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2019

  1. BigQuery Storage: Replace obsolete test helper method (#9090)

    * Make all system tests table columns NULL-able
    
    Autodetected schema assumes NULLABLE fields, thus use NULLABLE columns
    in test fixture.
    
    * Replace helper function with BQ client method
    
    The _add_rows() helper function is no longer needed, since
    client.load_table_from_json() essentially does the same.
    
    * Use explicit schema in data types decoding test
    
    * Adjust a comment related to partial schemas
    plamut authored Aug 28, 2019
    Configuration menu
    Copy the full SHA
    925a24b View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2019

  1. chore(bigquery_storage): fix up protobuf messages w/o summary docstri…

    …ngs (#9333)
    
    Closes #9329.
    tseaver authored Sep 27, 2019
    Configuration menu
    Copy the full SHA
    9e09634 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2019

  1. Configuration menu
    Copy the full SHA
    f4f678a View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2019

  1. Configuration menu
    Copy the full SHA
    38ff80a View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2020

  1. fix(bigquerystorage): to_dataframe on an arrow stream uses 2x faster …

    …to_arrow + to_pandas, internally (#9997)
    
    Towards https://issuetracker.google.com/140579733
    tswast authored and plamut committed Jan 15, 2020
    Configuration menu
    Copy the full SHA
    fdfb21e View commit details
    Browse the repository at this point in the history
  2. fix(bigquerystorage): resume reader connection on EOS internal erro…

    …r (#9994)
    
    * fix(bigquerystorage): resume reader connection on `EOS` internal error
    
    It's infeasible for the backend to change the status of `EOS on DATA`
    internal errors, so instead we check the error message to see if it's
    an error that is resumable. We don't want to try to resume on *all*
    internal errors, so inspecting the message is the best we can do.
    
    * fix: update resumable errors to match string from test failure
    
    * refactor: use more readable any instead of loop
    tswast authored Jan 15, 2020
    Configuration menu
    Copy the full SHA
    acbd57f View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2020

  1. chore: add split repo templates (#1)

    * chore: add split repo templates
    
    * Adjust noxfile
    
    This commit makes sure that bigquery is installed as a stand-alone
    package, and not as an editable package from a local path (which does
    not exist anymore).
    
    In addition, it makes sure that unit tests are not run with Python 3.8,
    as that version is not supported yet.
    plamut authored Feb 5, 2020
    Configuration menu
    Copy the full SHA
    4d696f1 View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2020

  1. chore: parameterize synth to prepare for additional versions (#9)

    * reformat synthfile, include regen output
    
    * elide to_grpc_metadata pragma replace
    shollyman authored Feb 13, 2020
    Configuration menu
    Copy the full SHA
    0edb144 View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2020

  1. feat: update synth to generate v1beta2, v1 endpoints for bigquerystor…

    …age (#10)
    
    * feat: update synth to generate v1beta2, v1 endpoints for bigquerystorage
    
    There's also some work to try to accomodate v1alpha2 in this PR, but
    there exists further oddities that must be tackled before we can
    fully add generation of the alpha client here.
    
    Also, note that this PR does not include manual client modifications
    such as streaming offset resumption that are present in the v1beta1
    client.  Intent is to address further changes like that in subsequent
    PRs.
    shollyman authored Feb 21, 2020
    Configuration menu
    Copy the full SHA
    2ea5ac4 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2020

  1. fix: pass snapshot_millis to the main function (#8)

    Co-authored-by: Tim Swast <swast@google.com>
    alexander-fenster and tswast authored Mar 3, 2020
    Configuration menu
    Copy the full SHA
    e522bf8 View commit details
    Browse the repository at this point in the history
  2. feat: add manual layer for v1 endpoint (#16)

    * feat: add manual layer for v1 endpoint
    
    * migrate the manual client/reader work for v1
    * TableReferences went away as a first class message, now just a
      formatted string
    * changes to read rows
      * estimated_row_count removed due to differences in reported status
      * you no longer have to deal with a StreamPosition message, instead
        there's just a stream name and an offset as top-level request fields
    * session creation changes
      * you now provide a prototypical ReadSession message when requesting
        a new read session, and most options (like selected fields, table
        modifiers, and data format) have moved inside it.
      * requested_streams -> max_stream_count
    
    There's additional changes to the surface, but there wasn't much manual
    help in front of it so not reflected here.
    shollyman authored Mar 3, 2020
    Configuration menu
    Copy the full SHA
    a0fc0af View commit details
    Browse the repository at this point in the history
  3. chore: release 0.8.0 (#13)

    * updated CHANGELOG.md [ci skip]
    
    * updated setup.py [ci skip]
    release-please[bot] authored Mar 3, 2020
    Configuration menu
    Copy the full SHA
    0323439 View commit details
    Browse the repository at this point in the history
Loading