How to do vision-based web scraping with Claude 3.5 #ai #aiforwork #aiforbusiness #chatgpt #openai #make #automation #aiforwork #aiskills #generativeai #genai #aiautomation #claude

This is how you do vision-based web scraping with Claude 3.5 using make.com. So it's actually quite simple. What you need to do is first take a screenshot of the page you wanna scrape, the webpage you wanna scrape. Now, every time I make these videos, people are gonna comment, why are you doing this? Why don't you just sort of do scraping normally? Why don't you just make HTTP requests, pass the HTML, all that sort of stuff? And my answer to that is yes, normal web scraping will work in most cases, but there are certain cases where the data you wanna scrape might be in an image or something like that. So a good example of this is some government websites. They will publish daily data, but they won't publish the data in a table format. For some reason, they'll just publish it as a screenshot of a chart. So doing vision-based scraping works for those sorts of use cases. So this is just an example of how to do vision-based web scraping. As to whether your use case is a good fit for it, I'll leave that up to you. Anyways, first block is around taking a screenshot. So I'm using Dumpling AI, using the screenshot module. So what I'm doing here is, so I'm just doing CoinMarketCap. Again, CoinMarketCap has an API, so you don't need to do this, but as an example, you can choose to screenshot the full page. I'm just gonna press no, and I'm not blocking the ads, but I am blocking cookie banners. And instead of doing full page, I'm just gonna manually set the height to a certain number. And I'm also gonna wait before taking the screenshot. So I'm waiting five seconds here. So 5,000 milliseconds is equal to five seconds. And the reason I'm doing that is on CoinMarketCap, sometimes these charts take a few seconds just to load and populate. So I just get Dumpling AI to wait five seconds before taking the screenshot. So what this will give you is a screenshot URL, which is this URL here that I've just shown you. So the next block is you will need the HTTP module and do get a file. And the reason for that is the Anthropic Cloud module within make.com does not take a URL. It only takes in a file, a file buffer more specifically. So you do the get a file via the HTTP module. And then this is where the setup for your vision-based scraping or extraction happens. So right now the Anthropic Cloud module within make.com does not support Cloud 3.5 yet. So you will need to press map and then sort of type this in manually. You can find this on the Anthropic docs. I've just said, NAX tokens for a thousand. You can sort of set this to whatever you want. And sort of the magic is really around the system prompt and then what I'm feeding in. So the system prompt is just extract the following data from the provided image, and I'm just typing in what I want to extract. So this is just something I've pasted from one of my real estate builds, not super relevant here, but so just paste in what you want to extract and get it to respond in JSON format. And then you just pass in the image that you've downloaded from the HTTP module here as a user and just set the type to image. So within the Anthropic Cloud module, you can set input as text language, set it to image. Now, once you've done that, ideally what will happen is Anthropic Cloud will respond in JSON. So your chances are you will need to pass the JSON. And for that, you can use the parse JSON module within make.com to turn it into something that you can use within your make.com build, your automation. And in most cases, what will happen after this is you write into a Google sheet, you write it into an air table or something like that for further processing. But that's basically it. That's how you do vision-based web scraping with Claude 3.5 in make.com. If you have any thoughts, questions, or feedback, feel free to leave a comment. I recently just launched a free AI course, completely free to sign up, link is in my bio. You learn how to use different AI tools to increase your productivity in your business and at work. So check that out. If you do need help implementing AI in your business, implementing automations in business, I do have a AI automation consulting service. So shoot me a DM if you do need help with that. But with that, I'm gonna wrap this video up and I'll see you in my next video.