The purpose of this tool is to make it easy collect seed information for use with LLM.
Just enter a query or a URL, it will search and scrape the web, to produce one markdown file with all the results.
Searching for a URL prefix to get result from a particular site only.
Example:
- https://llminer.deno.dev/?q=https%3A%2F%2Fdocs.deno.com%2F
- https://llminer.deno.dev/?q=cocktail%20recipes
Once the markdown file has been downloaded, you can insert it into LLM of your choice.
WIP, looking for feedback, thank you.
I'm seeing a lot of these pop up at the moment - but that's a good thing.
Some feedback:
- Tables are not rendered properly, it places cells on new lines without clear relationships.
- There needs to be a "concatenate and download all" button that takes all results and downloads a single markdown file.
- Add a link to the source code on the main page, you'll get people wanting to contribute and will be able to track bugs.