If the data is in Cloud Storage, BigQuery can query it in-place without loading ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

lmkg on Feb 23, 2020 | parent | context | favorite | on: Modern Data Lakes Overview

If the data is in Cloud Storage, BigQuery can query it in-place without loading it. BigQuery calls this an External Data Source.

https://cloud.google.com/bigquery/external-data-sources

My biggest papercut with using this was having to make sure that all of the locations matched exactly.

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact