I got an error during processing partitioned table in dataform:
Quota exceeded: Your table exceeded quota for Number of partition modifications to a column partitioned table.
How can I deal with it? I have some table, without incremental. I know that incremental is some way, but is there exist something different?
Best regards.
Hi @MarekK,
The error is commonly encountered in BigQuery and indicates that your column-partitioned table has reached the daily quota for partition modifications. This quota exists to prevent tables from becoming unusable for writes over time.
For more information on resolutions specific to BigQuery, you can refer to this documentation. In addition, when using Dataform, consider managing run frequency more efficiently, minimizing table re-creation, and optimizing operations on partitioned tables to avoid hitting this quota.