[source-facebook-marketing] Infinite attempts when consulting ad_insights for an account with more than 9000 ads.

[juancrivillalba]

Connector Name

source-facebook-marketing

Connector Version

4.0.1

What step the error happened?

During the sync

Relevant information

I have a connection that has the sream ads_insights. I am consulting an attribution window of 7 days. I have a particular account that is having errors, it is consulting the info day by day and those requests fail and then it tries to split job into smaller jobs. There i am getting the following error: "The reporting data you are trying to fetch has too many rows. Please use asynchronous query or restrict amount of ad IDs or time ranges to fetch the data."
This was not a problem before 26/09/2025.

Relevant log output

2025-09-26 21:11:46 source INFO InsightAsyncJob(id=3955764204673632, {
"account_id":"**********",
"id": "act_1653814571417795"
}, time_range=<Period [2025-09-18 -> 2025-09-18]>, breakdowns=[]): failed second time, trying to split job into smaller jobs.
2025-09-26 21:11:47 source ERROR Giving up call(...) after 1 tries (facebook_business.exceptions.FacebookRequestError:

Message: Call was not successful
Method: GET
Path: https://graph.facebook.com/v23.0/act_1653814571417795/insights
Params: {'level': 'campaign', 'action_breakdowns': '["action_type","action_target_id","action_destination"]', 'breakdowns': '[]', 'fields': '["campaign_id"]', 'action_attribution_windows': '["1d_click","7d_click","28d_click","1d_view","7d_view","28d_view"]', 'filtering': '[{"field":"ad.effective_status","operator":"IN","value":"**********"}]', 'time_range': '{"since":"2025-08-20","until":"2025-09-18"}'}

Status: 400
Response:
{
"error": {
"message": "Invalid parameter",
"type": "OAuthException",
"code": 100,
"error_subcode": 1487534,
"is_transient": false,
"error_user_title": "Too many rows",
"error_user_msg": "The reporting data you are trying to fetch has too many rows. Please use asynchronous query or restrict amount of ad IDs or time ranges to fetch the data.",
"fbtrace_id": "AGXsod8HqPYZwW-sc5KqnRb"
}
})
2025-09-26 21:11:47 source ERROR Encountered an exception while reading stream ads_insights
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/backoff/_sync.py", line 105, in retry
ret = target(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^
File "/airbyte/integration_code/source_facebook_marketing/api.py", line 171, in call
response = super().call(method, path, params, headers, files, url_override, api_version)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/facebook_business/api.py", line 336, in call
raise fb_response.error()
facebook_business.exceptions.FacebookRequestError:

Message: Call was not successful
Method: GET
Path: https://graph.facebook.com/v23.0/act_1653814571417795/insights
Params: {'level': 'campaign', 'action_breakdowns': '["action_type","action_target_id","action_destination"]', 'breakdowns': '[]', 'fields': '["campaign_id"]', 'action_attribution_windows': '["1d_click","7d_click","28d_click","1d_view","7d_view","28d_view"]', 'filtering': '[{"field":"ad.effective_status","operator":"IN","value":"**********"}]', 'time_range': '{"since":"2025-08-20","until":"2025-09-18"}'}

Status: 400
Response:
{
"error": {
"message": "Invalid parameter",
"type": "OAuthException",
"code": 100,
"error_subcode": 1487534,
"is_transient": false,
"error_user_title": "Too many rows",
"error_user_msg": "The reporting data you are trying to fetch has too many rows. Please use asynchronous query or restrict amount of ad IDs or time ranges to fetch the data.",
"fbtrace_id": "AGXsod8HqPYZwW-sc5KqnRb"
}
}
----- END POST REPLICATION OPERATIONS -----

2025-09-26 21:12:00 platform INFO Retry State: RetryManager(completeFailureBackoffPolicy=BackoffPolicy(minInterval=PT10S, maxInterval=PT30M, base=3), partialFailureBackoffPolicy=null, successiveCompleteFailureLimit=5, successivePartialFailureLimit=1000, totalCompleteFailureLimit=10, totalPartialFailureLimit=20, successiveCompleteFailures=0, successivePartialFailures=3, totalCompleteFailures=4, totalPartialFailures=16)
Backoff before next attempt: 0 seconds

### Contribute

- [ ] Yes, I want to contribute

[brodb]

I suddenly started seeing this issue in the Facebook connector as well, starting just in the last few days -- Meta returns error code 100, subcode 1487534.
Meta's documentation (see https://developers.facebook.com/docs/marketing-api/insights/best-practices/) indicates it is a rate limiting issue. I don't see any rate limit changes in their API changelog, and I'm not pulling any more than usual, which is strange. Might be an undocumented change?

[jjhale]

I'm seeing the same thing.

2025-10-02 23:35:58 source INFO InsightAsyncJob(id=1972115723632976, <AdAccount> {
    "account_id":"**********",
    "id": "act_REDACTED"
}, time_range=<Period [2025-10-02 -> 2025-10-02]>, breakdowns=[]): has status Job Failed after 456 seconds.
2025-10-02 23:35:58 source INFO InsightAsyncJob(id=780395981369481, <AdAccount> {
    "account_id":"**********",
    "id": "act_REDACTED"
}, time_range=<Period [2025-10-03 -> 2025-10-03]>, breakdowns=[]): is 0 complete (Job Started)
2025-10-02 23:35:58 source INFO InsightAsyncJob(id=1972115723632976, <AdAccount> {
    "account_id":"**********",
    "id": "act_REDACTED"
}, time_range=<Period [2025-10-02 -> 2025-10-02]>, breakdowns=[]): failed second time, trying to split job into smaller jobs.
2025-10-02 23:36:21 source INFO Backing off call(...) for 5.0s (facebook_business.exceptions.FacebookRequestError: 

  Message: Call was not successful
  Method:  GET
  Path:    https://graph.facebook.com/v23.0/act_REDACTED/insights
  Params:  {'level': 'campaign', 'action_breakdowns': '["action_type","action_target_id","action_destination"]', 'breakdowns': '[]', 'fields': '["campaign_id"]', 'action_attribution_windows': '["1d_click","7d_click","28d_click","1d_view","7d_view","28d_view"]', 'filtering': '[{"field":"ad.effective_status","operator":"IN","value":"**********"}]', 'time_range': '{"since":"2025-09-03","until":"2025-10-02"}'}

  Status:  500
  Response:
    {
      "error": {
        "code": 1,
        "message": "Please reduce the amount of data you're asking for, then retry your request"
      }
    })

I noticed that it claims it is trying to break it down into smaller jobs, but it looks like it is requesting a month's worth of data, rather than the day I would have expected:

'time_range': '{"since":"2025-09-03","until":"2025-10-02"}'

Could it be related to this commit: e6519f5 - no looks like that was not released yet (I'm seeing this problem in v4.0.1, but that PR #66000 looks like it is v4.1.0-rc1

There was a PR which tried to fix the 29 day attribution window, but it looks like it just got closed without getting merged.
#64922

[tolik0]

@juancrivillalba @brodb @jjhale Thanks for the detailed reports!

The issue was caused by the synchronous request used to fetch IDs for lower levels of the AdInsights report. In version 4.1.0, we switched this request to asynchronous and added field-level splitting for cases where the report fails at the lowest level (ad).

Version 4.1.0 is already available — please let us know if you still encounter the issue after upgrading.