Using the URL Property

Introduction

The URL property is designed for capturing and storing website links in the correct format. This ensures that URLs are always valid and ready for downstream use, whether they are extracted from documents, generated by models, or entered manually.

Why Use a URL Property?

• Correct Formatting: Ensures all website links are stored in a valid, clickable format.
• Flexible Input: URLs can be extracted from files, generated by other properties, or added manually by users.
• Automatic Scraping: When a URL is provided, the system will attempt to scrape the website's content. This context can then be used as input for other properties, enabling richer analysis and automation.

Example Use Cases

• Extracting company website URLs from a CIM or other business document for further research.
• Enabling downstream analysis or enrichment by using the scraped website content as input to other properties.

Step 1: Add a URL Property

• Add a new property to your agent and set its type to URL.
• Name it clearly, e.g., Company Website or Reference Link.

Step 2: Configure Extraction or Input

• Model Extraction: Use an AI tool to extract URLs from documents or other properties.
• Manual Input: Allow users to enter or edit URLs directly.

Step 3: Use Scraped Website Content

• When a valid URL is entered, the system will scrape the website and make its content available for use in other properties.
• If scraping fails, an error (red dot) will appear, indicating the issue.

The URL property is essential for workflows that rely on web data, ensuring links are always valid and that website content can be leveraged for deeper analysis.