Skip to content

Traffic

AI crawler requests to the brand’s site and AI-referred visits from it, from the connected Cloudflare and GA4 accounts. Beta: these shapes may change; see the changelog.

GET /audits/{auditId}/ai-referral-traffic

Sessions that arrived from an AI surface (ChatGPT, Perplexity, Gemini…), by day and source over the last 90 days, plus the 50 landing pages they reached most. Empty until a GA4 property is connected and pulled.

Terminal window
curl "https://api.beket.ai/api/v1/audits/AUDIT_ID/ai-referral-traffic" \
-H "Authorization: Bearer $BEKET_API_KEY"
NameInRequiredTypeDescription
auditIdpathyesstringThe audit’s id.
FieldTypeRequiredDescription
successbooleanyes
dataobjectyes
data.pointsobject[]yes
data.points[].sourcestringyes
data.points[].sessionsintegeryes
data.points[].reportDatestringyes
data.pagesobject[]yesAt most 50, most sessions first.
data.pages[].landingPagestringyes
data.pages[].sessionsintegeryes
data.pages[].keyEventsinteger | nullyes
data.connectionStatusstring | nullyesThe analytics connection’s state; null when none is connected.
data.connectionUpdatedAtstring | nullyes
data.lastPullReferralPullyes
{
"success": true,
"data": {
"points": [],
"pages": [],
"connectionStatus": null,
"connectionUpdatedAt": null,
"lastPull": null
}
}

POST /audits/{auditId}/crawl

Queues a crawl of the audit’s site. mode defaults to force_fresh, which always crawls; reuse_if_fresh keeps a completed crawl under 7 days old; skip keeps whatever crawl exists. This starts paid work.

Terminal window
curl -X POST "https://api.beket.ai/api/v1/audits/AUDIT_ID/crawl" \
-H "Authorization: Bearer $BEKET_API_KEY" \
-H "Content-Type: application/json" \
-d '{"mode":"<mode>"}'
NameInRequiredTypeDescription
auditIdpathyesstringThe audit’s id.
FieldTypeRequiredDescription
mode“skip” | “reuse_if_fresh” | “force_fresh”
FieldTypeRequiredDescription
successbooleanyes
dataobjectyes
data.messagestringyes

GET /audits/{auditId}/crawl-diagnostics

The last 30 days of AI crawler requests from the connected Cloudflare zone: one row per day, the 50 busiest bots, the 25 most-crawled pages broken down by the 6 busiest crawlers, and the 10 largest referral sources. A day with crawlPulled: false was not measured — its null counts are unknown, not zero.

Terminal window
curl "https://api.beket.ai/api/v1/audits/AUDIT_ID/crawl-diagnostics" \
-H "Authorization: Bearer $BEKET_API_KEY"
NameInRequiredTypeDescription
auditIdpathyesstringThe audit’s id.
FieldTypeRequiredDescription
successbooleanyes
dataobjectyes
data.connectionStatusstring | nullThe analytics connection’s state; null when none is connected.
data.connectionUpdatedAtstring | null
data.zoneTagstring | null
data.referralUnitstring | null
data.lastCrawlPullAtstring | null
data.daysCoveredintegeryes
data.lastReferralPullReferralPull
data.daysobject[]yesExactly 30, oldest first.
data.days[].daystringyes
data.days[].crawlPulledbooleanyes
data.days[].crawlRowsintegeryes
data.days[].requestsinteger | nullyes
data.days[].byPurposeobject | nullyes
data.days[].byPurpose.trainingintegeryes
data.days[].byPurpose.searchintegeryes
data.days[].byPurpose.browsingintegeryes
data.days[].referralsinteger | nullyes
data.days[].ga4Referralsinteger | null
data.botsobject[]yesAt most 50.
data.bots[].botNamestringyes
data.bots[].detectorstringyes
data.bots[].requestsintegeryes
data.bots[].blockedRequestsinteger | null
data.bots[].daysSeenintegeryes
data.bots[].sampleRatenumber | null
data.bots[].purpose“training” | “search” | “browsing” | null
data.pagesobject[]yesAt most 25.
data.pages[].pathstringyes
data.pages[].requestsintegeryes
data.pages[].byCrawlerinteger[]yesRequests per crawler, in pageColumns order.
data.pages[].otherintegeryesRequests from crawlers outside pageColumns.
data.pages[].daysSeenintegeryes
data.pageColumnsobject[]yesAt most 6.
data.pageColumns[].botNamestringyes
data.pageColumns[].livebooleanyesA user-triggered fetch rather than a crawl.
data.referralSourcesobject[]yesAt most 10.
data.referralSources[].providerstringyes
data.referralSources[].sourcestringyes
data.referralSources[].unitsintegeryes
data.referralSources[].unitstringyes
data.referralSources[].daysSeenintegeryes
data.liveDemandobject | nullUser-triggered fetches — an AI surface reading a page to answer someone now.
data.liveDemand.liveRequestsintegeryes
data.liveDemand.requestsintegeryes
data.liveDemand.daysMeasuredintegeryes
data.liveDemand.pagesobject[]yesAt most 5.
data.liveDemand.pages[].pathstringyes
data.liveDemand.pages[].requestsintegeryes
data.liveDemand.pages[].liveRequestsintegeryes
{
"success": true,
"data": {
"connectionStatus": null,
"connectionUpdatedAt": null,
"zoneTag": null,
"referralUnit": null,
"lastCrawlPullAt": null,
"daysCovered": 0,
"lastReferralPull": null,
"days": [],
"bots": [],
"pages": [],
"pageColumns": [],
"referralSources": [],
"liveDemand": null
}
}

The last referral pull; null before the first.

FieldTypeRequiredDescription
pulledAtstringyes
windowDaysintegeryes
rawRowsinteger | nullyes
sampleIntervalnumber | nullyesGA4’s sampling interval; null when the pull was unsampled.