https://github.com/tryagi/firecrawl
Generated C# SDK based on official Firecrawl OpenAPI specification
https://github.com/tryagi/firecrawl
ai crawler crawling dotnet firecrawl generated generator langchain langchain-dotnet net8 netframework netstandard openapi scrape scraping sdk
Last synced: 10 months ago
JSON representation
Generated C# SDK based on official Firecrawl OpenAPI specification
- Host: GitHub
- URL: https://github.com/tryagi/firecrawl
- Owner: tryAGI
- License: mit
- Created: 2024-09-06T20:12:35.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-03-24T10:40:02.000Z (10 months ago)
- Last Synced: 2025-03-26T02:22:49.438Z (10 months ago)
- Topics: ai, crawler, crawling, dotnet, firecrawl, generated, generator, langchain, langchain-dotnet, net8, netframework, netstandard, openapi, scrape, scraping, sdk
- Language: C#
- Homepage: https://tryagi.github.io/Firecrawl/
- Size: 444 KB
- Stars: 3
- Watchers: 1
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Firecrawl
[](https://www.nuget.org/packages/Firecrawl/)
[](https://github.com/tryAGI/Firecrawl/actions/workflows/dotnet.yml)
[](https://github.com/tryAGI/Firecrawl/blob/main/LICENSE.txt)
[](https://discord.gg/Ca2xhfBf3v)
## Features 🔥
- Fully generated C# SDK based on [official Firecrawl OpenAPI specification](https://raw.githubusercontent.com/mendableai/firecrawl/main/apps/api/v1-openapi.json) using [AutoSDK](https://github.com/tryAGI/AutoSDK)
- Same day update to support new features
- Updated and supported automatically if there are no breaking changes
- All modern .NET features - nullability, trimming, NativeAOT, etc.
- Support .Net Framework/.Net Standard 2.0
### Usage
```csharp
using Firecrawl;
using var api = new FirecrawlApp(apiKey);
// Scrape
var response = await api.Scraping.ScrapeAndExtractFromUrlAsync("https://docs.firecrawl.dev/features/scrape");
string markdown = response.Data.Markdown;
// Crawl
var response = await api.Crawling.CrawlUrlsAsync(
url: "https://docs.firecrawl.dev/",
limit: 3,
scrapeOptions: new CrawlUrlsRequestScrapeOptions
{
OnlyMainContent = true,
});
var jobResponse = await api.Crawling.WaitJobAsync(
jobId: response.JobId);
foreach (var data in jobResponse.Data)
{
Console.WriteLine($"URL: {data.Metadata.SourceURL}");
Console.WriteLine($"Output file: {data.Markdown}");
}
```
### CLI
```bash
dotnet tool install -g Firecrawl.Cli
firecrawl auth
firecrawl scrape https://docs.firecrawl.dev/features/scrape // saves it to output.md
firecrawl crawl https://docs.firecrawl.dev/ --limit 5 // saves all .md files to docs.firecrawl.dev folder
```
## Support
Priority place for bugs: https://github.com/tryAGI/Firecrawl/issues
Priority place for ideas and general questions: https://github.com/tryAGI/Firecrawl/discussions
Discord: https://discord.gg/Ca2xhfBf3v
## Acknowledgments
This project is supported by JetBrains through the [Open Source Support Program](https://jb.gg/OpenSourceSupport).
This project is supported by CodeRabbit through the [Open Source Support Program](https://github.com/marketplace/coderabbitai).