Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/scale-tone/repeating-map-reduce-sample
https://github.com/scale-tone/repeating-map-reduce-sample
Last synced: 15 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/scale-tone/repeating-map-reduce-sample
- Owner: scale-tone
- Created: 2021-12-16T18:31:29.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2024-08-25T16:53:18.000Z (4 months ago)
- Last Synced: 2024-10-31T05:11:39.275Z (2 months ago)
- Language: C#
- Size: 11.7 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
```mermaid
graph LR
HttpStart{{"#32;HttpStart"}}:::function
style HttpStart fill:#D9D9FF,stroke-width:2px
HttpStart.httpTrigger>"#127760; http:[get,post]"]:::httpTrigger --> HttpStart
TestRestApiMethod{{"#32;TestRestApiMethod"}}:::function
style TestRestApiMethod fill:#D9D9FF,stroke-width:2px
TestRestApiMethod.httpTrigger>"#127760; http:[get]"]:::httpTrigger --> TestRestApiMethod
MapReduceOrchestrator[["#32;MapReduceOrchestrator"]]:::orchestrator
style MapReduceOrchestrator fill:#D9D9FF,stroke-width:2px
HttpStart ---> MapReduceOrchestrator
MapReduceOrchestrator -- "[ContinueAsNew]" --> MapReduceOrchestrator
ProcessingActivity[/"#32;ProcessingActivity"/]:::activity
style ProcessingActivity fill:#D9D9FF,stroke-width:2px
MapReduceOrchestrator ---> ProcessingActivity
```
# repeating-map-reduce-sample
Demonstrates how to:
1. Implement map/reduce scenarios with [Azure Durable Functions](https://docs.microsoft.com/en-us/azure/azure-functions/durable/durable-functions-overview?tabs=csharp).
2. Run an [eternal orchestration](https://docs.microsoft.com/en-us/azure/azure-functions/durable/durable-functions-eternal-orchestrations?tabs=csharp), that perpetually restarts itself, passing some data that resulted from previous execution as input.
## How to run locally
* Clone this repo.
* In the project's folder create a `local.settings.json` file, which should look like this:
```
{
"IsEncrypted": false,
"Values": {
"AzureWebJobsStorage": "your-azure-storage-connection-string",
"FUNCTIONS_WORKER_RUNTIME": "dotnet"
}
}
```
* Go to the project's folder with your command prompt and type the following:
```
func start
```
* Navigate to http://localhost:7071/api/HttpStart
This will start a singleton orchestration instance, which will proceed with executing some parallel activities, then sleep for a while and then restart itself. Invoking http://localhost:7071/api/HttpStart again will forcibly restart this orchestration (cancel all current execution history and start the process again).
Note, that because this is a *singleton* orchestration, there is no need to implement any periodic storage cleanup.
Also note this setting in [host.json](https://github.com/scale-tone/repeating-map-reduce-sample/blob/main/host.json) file:
```
"extensions": {
"durableTask": {
"overridableExistingInstanceStates": 0
}
}
```
This is essential for enabling the orchestration to be forcibly restarted (by default, `StartNewAsync()` method throws an exception if an instance with given id already exists).
Once up and running, you can monitor the orchestration's status with [Durable Functions Monitor](https://marketplace.visualstudio.com/items?itemName=DurableFunctionsMonitor.durablefunctionsmonitor):
## How to deploy to Azure
[](https://portal.azure.com/#create/Microsoft.Template/uri/https%3A%2F%2Fraw.githubusercontent.com%2Fscale-tone%2Frepeating-map-reduce-sample%2Fmain%2Farm-template.json)