Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
From Crawl To Clarity Automating SEO Audits Wit...
Search
Jonathon Roberts
April 27, 2026
Marketing & SEO
560
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
From Crawl To Clarity Automating SEO Audits With Node.JS
Jonathon Roberts
April 27, 2026
Transcript
84 slides
None
Technical Lead, Fly High Media Interested in Speeding up SEO
auditing & workflows
WANT TO FOLLOW ALONG WITH THE SLIDES?
TECHNICAL AUDITS WERE TAKING TOO LONG!
None
TOOLS Web Server LLM of Choice Domain Name
HAS ANYONE USED NODE.JS BEFORE?
WHAT IS NODE.JS?
FREE JAVASCRIPT FRAMEWORK
ALLOWS DEVELOPERS TO CREATE CUSTOM TOOLS
WHY AUTOMATE SEO AUDITS THIS WAY?
REDUCE WORKLOAD
CUSTOMISABLE
LOW COST
WHAT CAN WE AUDIT?
HTML STATUS CODES (404, 301, ETC..)
CANONICAL TAG ISSUES
PAGINATION ISSUES
METADATA ISSUES AT SCALE
HREFLANG ISSUES
XML SITEMAP CHECKS
REDIRECT CHAINS & LOOPS
IMAGE ALT TEXT
URL STRUCTURE
PAGE SPEED ISSUES
BROKEN INTERNAL/EXTERNAL LINKS
SCHEMA MARKUP
PAGE SIZE IS LESS THAN 2MB GOOGLE NEW CRAWLING LIMIT
- FEB 2026
HOW CAN WE BUILD AN AUDITING TOOL?
LLMS CAN CREATE THE CODE FOR ME!
None
“I WANT TO CREATE A WEB APP THAT ALLOWS ME
TO CRAWL WEBSITES FOR ANY TECHNICAL SEO ISSUES USING NODEJS”
None
USE A CODE EDITOR LIKE VISUAL STUDIO CODE TO CREATE
THE DIRECTORY
None
None
WE NOW NEED TO SETUP A SERVER TO HOST THE
APP ON
None
HETZNER SERVER SETUP Use a Server Local to You (Helsinki
for UK) Ubuntu Server Shared vCPU or Dedicated vCPU
WHAT IS SSH? SSH is a secure digital tunnel that
allows you to safely log into a website's server to manage backend files directly.
HOW TO ACCESS SSH? Use the Hetzner’s Server Console SSH
software e.g. Termius
INSTALL APP FROM GITHUB cd ~/apps/ git clone https://github.com/yourusername/seo-crawler.git cd
seo-crawler
INSTALL NODE DEPENDENCIES npm install
RUN THE APP npm run dev
WANT TO PUT IT ON A DOMAIN/SUBDOMAIN?
REGISTER YOUR DOMAIN
POINT THE DOMAIN/SUBDOMAIN TO THE SERVER IP ADDRESS
None
DOMAIN WILL NOW LOAD YOUR SERVER
AN EASIER WAY TO SETUP (IF YOU HAVE THIS FEATURE
IN CPANEL)
BUILT INTO CPANEL
INSTALL USING WHM OR ASK YOUR HOSTING COMPANY
None
UPLOAD YOUR NODE.JS APP TO A DIRECTORY ON YOUR SERVER
AND MAKE A NOTE OF THE DIRECTORY YOU SAVED IT IN
None
None
ENTER THE DIRECTORY YOU PUT THE CODE IN
None
SELECT THE DOMAIN / SUBDIRECTORY YOU WANT TO LOAD THE
APP FROM
None
ENTER THE STARTUP FILE NORMALLY SOMETHING LIKE SERVER.JS / YOU
CAN ASK THE LLM YOU USE TO CREATE THE APP FOR THIS
None
IF USING A DIFFERENT DIRECTORY TO THE ONE YOU’RE LOADING
THE APP CODE FROM YOU NEED TO ADD BASE_URL TO THE ENVIRONMENT VARIABLES
None
THEN JUST CLICK ‘CREATE’
None
None
None
YOU DON’T HAVE TO USE CHATGPT/ANY OTHER AI
Google Antigravity App
Windsurf
Vercel App
IF THERE ARE NO ISSUES YOUR APP SHOULD LOAD UP
TROUBLESHOOTING
USE AI TOOLS
NPM AUDIT WILL FLAG VULNERABILITIES
COMMON ISSUES
500 ERROR ON SERVER
USE AI TOOLS
None
None
ASSESS THE TOP 5 PRIORITIES LONG TERM FIXES, QUICK WINS
ACCESS TO THE SLIDES SPEAKERDECK.COM/JONATHONROBERTSSEO
linkedin.com/in/jonathon-roberts-seo/ flyhighmedia.co.uk
[email protected]
More Decks by Jonathon Roberts
See All by Jonathon Roberts
Vibe Coding Your Way To Custom SEO Tools
jonathonrobertsseo
0
65
How to Use AI to harness Google APIs
jonathonrobertsseo
0
1.1k
TechSEO North Feb 2025 - How To Implement Schema to Custom CMSs
jonathonrobertsseo
0
110
BrightonSEO October 2024 - How to Speed Up Content Audits using ChatGPT
jonathonrobertsseo
3
1.1k
Other Decks in Marketing & SEO
See All in Marketing & SEO
「社外の学び」を組織の武器に 〜エンタープライズの『中の人』が コミュニティで得た知見の活かし方〜
ktkn1129
0
220
A Practical Guide to JavaScript SEO - BrightonSEO San Diego 2026
samtorres
0
220
What gets cited and clicked in AI Answers Today... and what should we do about it? - Masters of Search
aleyda
0
470
Google už nie je jediný v hre. Ako dostať značku do odpovedí AI
pavelungr
0
120
Built for browsers, invisible to agents: Bridging the rendering gap for AI and search
samtorres
1
370
Customer Reviews: The Secret Superpower for Online Visibility
greggifford
PRO
1
130
25% of Our Revenue Comes from AI Search: What Works, What Doesn't, and What We Learned Getting There
thomaspeham
0
190
Teaching SEO to Non-SEOs: Don't Be Ridiculous
portentint
PRO
0
200
Le copywriting SEO à l’ère de l’IA générative : reprendre la main sur la création éditoriale – SEO & GEO Summit 2026
syphaiwong
PRO
0
110
『Peatix』利用ユーザーインタビューサマリー【広告出稿のポイント】
sairu_inc
0
390
Understanding GEO: How to Optimise Content in the New AI Era and Compete Across Google and LLMs - FIPP 2026 - Clara Soteras
clarasoteras
0
280
Why Tier 2 Backlinks Aren't Indexed: The Stall Map
speedyindexteam
PRO
1
1.3k
Featured
See All Featured
Why Our Code Smells
bkeepers
PRO
340
58k
Into the Great Unknown - MozCon
thekraken
41
2.8k
Building a Modern Day E-commerce SEO Strategy
aleyda
45
9.3k
The agentic SEO stack - context over prompts
schlessera
0
1k
DevOps and Value Stream Thinking: Enabling flow, efficiency and business value
helenjbeal
2
450
My Coaching Mixtape
mlcsv
0
390
AI in Enterprises - Java and Open Source to the Rescue
ivargrimstad
0
1.6k
Believing is Seeing
oripsolob
1
280
Chasing Engaging Ingredients in Design
codingconduct
0
400
The B2B funnel & how to create a winning content strategy
katarinadahlin
PRO
1
620
From Legacy to Launchpad: Building Startup-Ready Communities
dugsong
0
380
Evolving SEO for Evolving Search Engines
ryanjones
0
360