"AI web scraper" actor #488
Description
This issue will be moved to another repo for generic actors later!!
Background:
We are competing with services like Firecrawl and Parsera who provide super easy way to extract data from the web.
In a basic scenario a user needs to submit just a URL and a prompt (which describes what is needed to extract in a human language) to start crawling.
These services are competing mainly with WCC, but provide a bit different (and much simpler) experience.
In the current state of WCC we won't be able to simplify it to such an extent as these tools.
So the initial idea was to create a new actor with a name like "AI web scraper" or something similar to create a competing solution.
Later we discussed with some seniors that we already have an AI-related actor which does something similar and even has some users: https://apify.com/drobnikj/gpt-scraper (and its similar alternative https://apify.com/drobnikj/extended-gpt-scraper)
So the updated idea is to take over this actor, rename it, update it under the hood, and start promoting it as a new solution.
This should make it much easier than to promote a completely new actor.
Next steps for product:
- Clarify with Marketing what could be the best name for such actor? Which obstacles could there be, what should be easy, etc.
- Define requirements for such actor and refine them into functional tickets.
Implementation ideas:
- Use Stagehand for this actor