Enhanced extraction of links and metadata from PDFs for compliance checks.
Data from official release history and Softpedia changelog.
Released on March 16, 2023, Screaming Frog SEO Spider version 18.4 is a critical minor update that restores PageSpeed Insights (PSI) integration following unexpected API changes. This version solidifies stability for features introduced in the 18.0 cycle, including Google Analytics 4 integration and improved scheduling capabilities. For a full overview, visit the Screaming Frog Blog . Screaming Frog SEO Spider Update – Version 18.0
Rather than treating documents as un-crawlable text blobs, the tool reads PDFs to discover internal links and extract metadata. It catalogs PDF titles, word counts, and page counts, mapping broken outbound links hidden within embedded documentation directly to the panel. Step-by-Step Technical Audit Workflows in 18.4 Phase 1: Configuring High-Volume Hardware Requirements
For massive websites, navigate to Storage Mode and toggle instead of RAM. This forces the tool to write data directly to your local Solid State Drive (SSD), keeping memory clear. Phase 2: Integrating Real-Time UX & Performance Data
: The crawler looks inside hosted PDFs to map out links and automatically reads document metadata to discover titles.
Improvements to JavaScript rendering crawls to reduce high memory consumption.
The Screaming Frog SEO Spider is a popular tool used for website crawling and auditing. This report provides an overview of the website's (neverb-) SEO performance, highlighting areas of strength and weakness. The audit was conducted using Screaming Frog SEO Spider version 18.4.
(via headless Chrome) to find links and directives that basic crawlers miss. Case Study Idea
3. Scaling technical SEO: Database storage and custom extraction
The SEO Spider is a website crawler that emulates how search engines browse the internet. It collects key onsite data to help SEO professionals, developers, and site owners identify technical issues such as broken links, redirect chains, duplicate content, and missing metadata. The software is free for crawling up to 500 URLs, with an affordable license available for larger websites.
Look for and Server Error (5xx) .
