Mining the SERPs with off the shelf tools to find SEO Gold

Discover how you can scrape the search engine result pages, including images, local search and Youtube using no code tools to extract valuable and actionable information

First presented at Brighton SEO October 2024

Transcript

1. Mining The SERPS With Off The Shelf Tools To Find SEO Gold Charles Meaden Digital Nation Speakerdeck.com/charlesmeaden charlesmeaden @charlesmeaden
2. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden I Can’t Code… My type of dyslexia means coding is confusing
3. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden I Create Processes Breaking down complex items into steps is my thing
4. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Famous Scrape / Hack “Hacking” a GCHQ website using a site: command
5. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Talking About 3 Things SERPS Tools SEO Gold
6. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Mining The SERPs So much more than ten blue links to grab
7. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Images Descriptions & Categories
8. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Adverts Titles, Supporting text and links
9. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden News Headlines, URLs & Publication Date
10. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden People Also Ask Question, Answer & Links
11. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Google Maps Locations. Descriptions & Reviews
12. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden YouTube Titles, Categories & Captions
13. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Bing Links and the same packs as Google
14. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden It Used To Be So Difficult You’d need a tech stack like this Code Proxies Databases
15. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Off The Shelf Tools Let these Saas tools do the heavy lifting
16. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Browser Based Tools ScaleSERP and ValueSERP have an easy to use web interface
17. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden No Code Tools Connect easily to tool API’s such as DataForSEO and Scraping Bee
18. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Query the Output with LLMs Push the scraped data into your favourite ML tool
19. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden My Favourite Tool Combo DataForSEO and Analytics Edge has revolutionised our approach
20. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Using Scraped Data Tools export in variety of formats
21. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden The SEO Gold Scraping SERP data used to be expensive Now.. Run 1000’s scrapes At a cost of 0.05p each 10,000 scrapes costs £5
22. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Mining The SERPs Let's go and find some gold
23. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Task 1: Who Dominates The SERPs for These Queries?
24. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Who Dominates The SERPs? Get 1,000 starter queries Download & Analyse SEO Gold Configure & Run
25. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden We’ve Just Saved Hours
26. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden We’ve Just Saved Hours If Not Days…
27. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Projects Become Possible
28. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Task 2: Who Owns The SERPs? Who is Listed Twice?
29. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden The SERPs Change
30. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Extract Results Pixel Heights Tools such as Data4SEO will calculate pixel heights
31. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Extract Results Pixel Heights Tools such as Data4SEO will calculate pixel heights
32. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden 1 Domain – Multiple Times Use pixel heights to understand the competition
33. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden 1 Domain – Multiple Times Use pixel heights to understand the competition
34. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Multiple Results – 1 domain Use pixel heights to understand the competition
35. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden More SEO Gold
36. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Task 3: Find Me Relevant Internal Links For This New Article
37. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Discover How Google Thinks Use site: to understand which pages are returned
38. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Discover How Google Thinks Use site: to understand which pages are returned
39. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Task 4: Find Me Some New Relevant Queries For Our Clients Services
40. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden People Also Search For Let Google do the hard work
41. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Autocomplete Results can change based on your cursor
42. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Even More SEO Gold
43. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Task 4: What Questions Are People Asking About These Services
44. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Most Common Questions Mine People Also Ask to discover intent
45. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Discover New Links Google uses a different algorithm for PAA
46. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden AlsoAsked.com Low cost tool to mine the PAA
47. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Minted
48. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Task 4: Categorise These New Products Our Clients Are Selling
49. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Find Categories Harness Googles ML image algorithms
50. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Ecommerce Taxonomies Context sensitive categories for millions of products
51. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Task 5: Which Competitors Are Advertising?
52. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Who Else is Advertising Extract your competitor’s adverts
53. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Task 6: Do Our Clients Appear in Google News?
54. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden What’s Trending in the News Download relevant news stories at scale
55. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Task 7: How Often Are AI Overviews Appearing
56. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden % of Queries Showing AIO Data from Sistrix
57. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden AIO Impact on CTR Data from Seer Interactive
58. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Do AI Overviews Appear? Detect whether AI Overviews are appearing
59. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Loaded
60. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Task 8: What Videos Are Popular About Tiles?
61. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Which Videos Do Well? Grab titles, views, channels
62. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Deep Dive into Video Content Go beyond titles and get transcriptions
63. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Task 9: Find me all the local coffee shops
64. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden What’s In The Local Pack What does Google show for a particular query
65. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Scrape Reviews Find out what real people are saying
66. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Scrape Reviews Find out what real people are saying
67. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Scrape Reviews Find out what real people are saying
68. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Rich Beyond Your Dreams
69. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Thank You So much you can do with all this data You’re only limited by your imagination
70. https://www.linkedin.com/in/charlesmeaden/ #brightonseo CharlesMeaden Connect with me LinkedIn