The first time that you crawl the IBM
® Connections data, you must crawl all content, so it takes longer to perform this operation than it takes to perform subsequent crawls.
To crawl the data for the first time, complete the following steps:
- Send a GET request to the seedlist feed for the application whose data you want to crawl. Do not specify any parameters on the request.
The activities seedlist also contains content from community activities.
The blogs seedlist also contains content from community blogs.
EventsParent topic: Crawling data
The wikis seedlist also contains content from community wikis.
- Process the returned feed. Find the rel=next link and send a GET request to the web address specified by its href attribute.
- Repeat the previous two steps until the response includes a <wplc:timestamp> element in its body.
- Store the value of the <wplc:timestamp> element; you must pass that value as a parameter when you perform a subsequent crawl of the data.