How we measure
This translation is for reference only. The official document is the Japanese version, which prevails in case of any discrepancy.
GEO Hack Suite actually sends your registered questions to each AI, records the answers and sources returned, and determines whether your company was cited or mentioned. Here we disclose what we measure and how, including the limitations.
1. What we measure
| Citation (URL citation) | Whether a page on your site is among the answer's sources. We also record its position in the list of sources. |
|---|---|
| Site-level citation | Whether the source's domain is your site (it counts as “cited” if it is on your site, even if the page differs). |
| Mention | Whether your company or brand name (as registered) appears in the answer text. |
| Citation rate | The share of measurements in which your site was cited. |
| SoV (citation share) | Your company's share of the total appearances of your company and your registered competitors. |
| AI Overview and Bing AI display rate | The share of runs in which an AI answer was displayed on that search surface. Runs where it was not displayed are excluded from the citation rate denominator. |
2. How we collect the data
In every case, we use the APIs provided by each company (interfaces for calling the AI from a program), send the question text as is, and receive the answer. No one operates a screen manually to record results.
| ChatGPT | OpenAI API (answers with web search) |
|---|---|
| Perplexity | Perplexity API |
| Gemini | Google Gemini API (grounding with Google Search) |
| AI Overview | Retrieves AI Overview from Google Search (Japan, Japanese) through a search results service |
| Bing AI | Microsoft Azure AI (Grounding with Bing Search) |
| Claude | Anthropic API (answers with web search) |
3. Frequency and number of runs
- In each measurement, we ask each AI every registered question once. There is also a paid Repeat Search Option that asks the same question 3 times per measurement (focus questions can be asked 5 times), marks it as “cited” if it is cited even once, and shows the count as “1/3”. Questions covered by the option are labeled “Asked 3 times” (your contracted count) in the list. When covering all questions, you can choose to ask 3 times “up to once every 2 weeks” or “every week” (Standard and Pro only; questions measured every 7 days are also asked 3 times each time).
- When we repeatedly asked the same questions ourselves, whether your site was cited matched in 4 out of 5 runs on average. A single run gives a good sense of the trend, but results can change each time you ask.
- Automatic measurement runs every 15 days by default and can be shortened per question (minimum: Light: 14 days / Standard, Pro: 7 days). Each early morning, only the questions that are due are measured.
- You can re-measure individual questions you are concerned about. “Update now” (manual update) is available Light: 3 times / Standard: 7 times / Pro: 10 times per month, up to Light: 20 questions / Standard: 50 questions / Pro: 100 questions per run (questions with the oldest last measurement first).
4. Differences from using AI in a browser (limitations)
- Answers obtained through the API are not necessarily the same as those you get when using the AI in a browser. They are answers without login state, location, conversation history, or personalization.
- Source pages (URLs) tend to change each time you ask. We treat page-level matches as a reference value and recommend looking at site-level (domain) trends. Third-party research has also reported that sources obtained via the API do not match those shown on screen.
- If an AI changes how its answers are displayed (e.g. buttons or card-style answers), we may not be able to extract the sources. When that happens, we record it for that run.
- We cannot claim that you will always appear in AI answers or that we know exactly which page was cited. Measurements are input for improvement decisions and do not guarantee results.
5. Measurement costs and data retention
- AI usage fees for measurement are included in the monthly fee (except for BYOK plans).
- Answer text and raw data are deleted about 13 months after collection, while aggregate values (such as whether you were cited or mentioned) are retained.
6. Revision history
October 2026: First edition.
If you have any questions, please contact us. For pricing, see the pricing page.
© 2026 Jinrai Inc.(株式会社仁頼)