Robots.txt & LLMs.txt Auditor
Enter a domain and the Agent fetches its robots.txt and llms.txt, parses every user-agent rule, and classifies access for 25+ known AI and search crawlers so you know whether a site is actually set up to be discovered and cited by AI answer engines.
Agent node overview
Execute Code
Write and execute custom Python or JavaScript code to manipulate inputs, format outputs, or build logic specific to your use case.
Web Page Scrape
Scrape the content from a single webpage.
LLM
Allows you to use an LLM to generate a response
Creator
Patrick Schofield
iPullRank
I am a Lead Relevance Engineer at iPullRank with over 10 years of experience in SEO, search relevance, and organic growth strategy. My work focuses on helping brands improve visibility across both traditional search engines and emerging GenAI platforms through technical innovation and data.