> For the complete documentation index, see [llms.txt](https://docs.clearfeed.ai/clearfeed-help-center/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.clearfeed.ai/clearfeed-help-center/clearfeed-ai/knowledge-sources/faqs.md).

# FAQs

1. **Does ClearFeed support indexing the knowledge sources partially?** **Answer:** Yes, knowledge sources can be indexed partially when some URLs/pages from the knowledge source are interested in ClearFeed and can be used for answer generation. You can see the status of the source as **Partially Indexed** on the KBs page as shown below.

<figure><img src="/files/KNWHardWW0gSffbETYad" alt="" width="563"><figcaption></figcaption></figure>

2. **I am getting a failure trying to index my web-site. What are the possible reasons?** **Answer:** These failures can be due to different reasons.
   * Unable to access the web-site or URL. This may happen if the web-site is not open to all IP addresses or wrong URL has been entered. Sometimes websites behind a WAF or a service like CloudFlare are not accessible from all crawlers. For such issues - please find the details of our crawler's IP address and user-agent string in the next FAQ entry and white-list them.
   * The web-site may be password-protected. In this case please reach out to ClearFeed support to integrate with the authentication mechanism.
3. **What is the User Agent and IP address of ClearFeed's web crawler?** **Answer:** The outbound IP address used by the ClearFeed web crawler is `3.209.240.136`. The User Agent is `Clearfeed/1.0`.
4. **Does ClearFeed use data from the knowledge base to train the AI models?** **Answer:** We do not use any customer data, messages, or knowledge sources to train our AI models. Our model is trained on synthetic data, and the feedback provided by users on answers is used only to display metrics. Any future changes to this policy would require explicit opt-ins from customers. Therefore, you can be assured that your data will not be used for model training.


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://docs.clearfeed.ai/clearfeed-help-center/clearfeed-ai/knowledge-sources/faqs.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
