Untitled Video
Let me show you how to take data from a website and use it for your own purposes. So I'm here on Y Combinator's website, but this works on a lot of other sites as well. Now what I really want is to download this entire startup directory, but instead of copying and pasting all the values one by one, chances are your browser is already doing a lot of the work. Right click and inspect, go over to the network tab and refresh. If you click this button right here, then you'll see all the calls for additional metadata. For example, this call is all the different metadata for the Y Combinator batches, regions, and industries. And this call right here is all the metadata for all the companies in the startup directory. I'm just going to right click, copy, and copy response. And I have 85,000 lines of metadata. For example, here's all the metadata for Airbnb. It's location, it's industry, launch time, tags. So try that out next time you want to take a lot of data from websites and let me know which other sites it works well on. Follow for more, I'm posting every day. Peace.
Summary
The video demonstrates how to extract large amounts of data from websites using the browser's inspect tool and network tab. This method allows for efficient data collection without manual copying.
Key Points
- Use browser's inspect tool to access website data.
- Navigate to the network tab and refresh the page.
- Identify and copy metadata calls for data extraction.
- This method can save time compared to manual copying.
- Test this technique on various websites for data collection.
Tags
Repurpose Ideas
- LinkedIn post: How to extract data from any website.
- Tweet: 3 steps to efficiently scrape website data.
- Checklist: Essential tools for web data extraction.
Save videos. Search everything.
Build your personal library of inspiration. Find any quote, hook, or idea in seconds.
Create Free Account No credit card required