Home > Technical & Creative Skills >

A List Of 10 000+ Shopify Websites (7)

02-06-2021 05:16 PM #1 plutus (Member)
A List Of 10 000+ Shopify Websites

Another quickie for you to sweeten your saturday.

This one is a list that cosist of 10250 links to the Shopify websites sorted by ranking, where the biggest juggernauts are at the top.

It's only about a quarter of all the websites and I skipped the rest to make list more relevant. Want the rest? Do your own digging.

Happy spying,
plutus

https://drive.google.com/file/d/1eZU...ew?usp=sharing

02-07-2021 02:52 PM #2 twinaxe (Senior Moderator)

It´s not directly related to the thread but I have self scraped lists of websites using iDev Affiliate, Opencart, Refersion, Volusion and many more, all sorted by affiliate platform.

If anyone is interested just let me know and I can share the lists as well.

02-07-2021 04:15 PM #3 matuloo (Legendary Moderator)

Wow, that's quite some list

Thanks for sharing!

02-08-2021 03:58 AM #4 boomleebee (Member)

awesome, much appreciated!

02-10-2021 03:01 AM #5 vortex (Senior Moderator)

@plutus Did you use a commercial scraper and a footprint to scrape these lists? Or did you use a magic script you've coded yourself?

Thanks for another fantastic share!



Amy

02-10-2021 04:59 AM #6 plutus (Member)

Quote Originally Posted by vortex View Post
@plutus Did you use a commercial scraper and a footprint to scrape these lists? Or did you use a magic script you've coded yourself?

Thanks for another fantastic share!



Amy
I’ve got inspired to scrap it by one of the Nate Schmidt Youtube videos (dropshipping-based channel) where he explained how to research that manually by utilizing https://myip.ms/ and Shopify IP.

Then, I just coded a python script that requests each page and traverse over the fetched html response using xpath to extract what was needed (urls in that case).

This data is publicly available, but little bit restricted (max 25 pages views per ip) and since this list consists of about 200 pages I had to use VPN to bypass it.




Sent from my iPhone using STM Forums mobile app

02-10-2021 05:48 AM #7 vortex (Senior Moderator)

Quote Originally Posted by plutus View Post
I’ve got inspired to scrap it by one of the Nate Schmidt Youtube videos (dropshipping-based channel) where he explained how to research that manually by utilizing https://myip.ms/ and Shopify IP.

Then, I just coded a python script that requests each page and traverse over the fetched html response using xpath to extract what was needed (urls in that case).

This data is publicly available, but little bit restricted (max 25 pages views per ip) and since this list consists of about 200 pages I had to use VPN to bypass it.




Sent from my iPhone using STM Forums mobile app
Ingenius!





Amy

Home > Technical & Creative Skills >