BigQuery Managed Python User-Defined Functions (UDFs) are now generally available, enabling data practitioners to run custom Python code directly within BigQuery SQL queries without managing containers or infrastructure. Key features include access to popular Python libraries (NumPy, SciPy, pandas, scikit-learn, BeautifulSoup), external API integration, vectorized processing via PyArrow RecordBatches for up to 10x performance gains, configurable container resources (up to 16 GB RAM, 4 vCPUs), configurable concurrency up to 1,000 concurrent operations, and real-time monitoring via Cloud Monitoring. Billing is handled through BigQuery Services SKU with support for commitment-based discounts.

5m read timeFrom cloud.google.com
Post cover image
Table of contents
Bridging SQL and the Rich Python EcosystemCode example
377 Impressions