bigquery

Google BigQuery cloud data warehouse

Programming Increase BigQuery Storage API Batch Size for Better Performance

Learn how to overcome the 8-row limitation in BigQuery Storage API's to_arrow_iterable method. Optimize batch size for better performance when retrieving millions of rows.

#api
#batch-processing
#bigquery
#data-retrieval
#performance
#python

4 answers• 2 views

05/13/2026, 05:59 PM

DevOps AWS Glue BigQuery Connection Go SDK v2: Fix SparkProperties & secretId

Fix InvalidInputException when creating AWS Glue native BigQuery connection with Go SDK v2. Configure SparkProperties JSON with secretId for Secrets Manager GCP credentials correctly.

#aws-glue
#aws-sdk
#bigquery
#go
#secrets-manager

1 answer• 3 views

01/08/2026, 03:38 PM