TemporalReplay2026Talk

KO | EN

gitlite — search

#hacktoberfest #ai #llm #go #android #java #windows #awesome #awesome-list #pytorch #security #mcp #ios #open-source

TemporalReplay2026Talk

(★ 19)

Temporal Replay 2026 Talk

TemporalReplay2026Talk 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# How We Reliably Send Millions of Messages per Request

Companion resources for my Replay 2026 talk on scaling Temporal workflows
for massive fan-out.

---

## Talk Summary

Four lessons from evolving a high-volume messaging system on Temporal:

1. **Backpressure before Temporal.** Temporal is your orchestration layer,
   not a traffic absorber.
2. **The Action Budget.** Make cost proportional to processing time, not
   task count.
3. **The Sliding Window.** Bounded parallelism with event-driven handoff.
4. **The Entity Workflow.** One workflow per entity, ordered signals, no
   races.

---

## Patterns Covered

### Progressive Batching (long-running activity)

One activity that streams through work in batches, heartbeating between
batches. Restart from the last heartbeat on failure. Action cost is
`O(processing time)`, not `O(N)`.

- Temporal docs — Activity Heartbeating:
  https://docs.temporal.io/develop/go/failure-detection#activity-heartbeats
- Temporal docs — Long Running Activity Tuning: https://docs.temporal.io/serverless-workers#tuning-for-long-running-activities
- Go samples — heartbeating activity:
  https://github.com/temporalio/samples-go/tree/main/cancellation
- Java samples — heartbeating activity:
  https://github.com/temporalio/samples-java/tree/main/core/src/main/java/io/temporal/samples/hello/HelloActivityRetry.java

### Sliding Window

Workflow fires N activities in parallel. When one completes, fire the next.
Coordinate with `workflow.Selector` (Go) or `Workflow.await` (Java).

- Go sample — Batch sliding window:
  https://github.com/temporalio/samples-go/tree/main/batch-sliding-window
- Java sample — Batch sliding window:
  https://github.com/temporalio/samples-java/tree/main/core/src/main/java/io/temporal/samples/batch/slidingwindow
- Temporal docs — Selectors:
  https://docs.temporal.io/develop/go/workflows/selectors
- Temporal docs — Workflow.await (Java):
  https://docs.temporal.io/develop/java/message-passing#waiting-on-workflow-state
- Temporal docs — Worker tuning (executor slot options like
  `maxConcurrentActivityExecutionSize`, `maxConcurrentActivityTaskPollers`):
  https://docs.temporal.io/develop/worker-performance#executor-slot-options

### Entity Workflow (workflow-per-entity)

One workflow represents the lifecycle of a shared resource. Operations
arrive as signals, processed sequentially. `SignalWithStart` makes
"signal or create" atomic. Drain the signal channel before calling
continue-as-new so in-flight signals aren't lost at the restart boundary.

- Temporal design patterns — Entity Workflow pattern:
  https://learn.temporal.io/examples/#design-patterns
- Temporal docs — SignalWithStart (Go):
  https://docs.temporal.io/develop/go/message-passing#signal-with-start
- Community — Entity workflow pattern, continue-as-new and signal order:
  https://community.temporal.io/t/entity-workflow-pattern-continue-as-new-and-signal-order/18325
- Temporal blog — Very long-running workflows:
  https://temporal.io/blog/very-long-running-workflows

### Continue-as-New

Keep workflow history bounded. Two flavors:
- **Explicit threshold** — restart after N operations.
- **SDK-suggested** — restart when `isContinueAsNewSuggested()` returns true.

- Temporal docs — Continue-as-New:
  https://docs.temporal.io/develop/go/continue-as-new
- Temporal docs — Workflow event history limits:
  https://docs.temporal.io/workflow-execution/event#event-history-limits

### Backpressure in front of Temporal

A buffered queue between the API and Temporal decouples request ingestion
from workflow invocation. Protects against bursts that would otherwise
exhaust namespace APS limits.

- Temporal docs — Namespace limits:
  https://docs.temporal.io/cloud/limits

---

## Things to Watch Out For

### Task queue topology
One task queue per work type. Sharing queues across work types creates
head-of-line blocking: a slow provider stalls unrelated work.

- Temporal docs — Task queues:
  https://docs.temporal.io/task-queue

### Kubernetes graceful shutdown
`terminationGracePeriodSeconds` on the pod must be longer than the activity
heartbeat timeout. Otherwise Temporal doesn't detect the failure before
K8s kills the pod and work is lost.

- K8s - Graceful worker shutdown:
  https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle/#pod-termination
- Temporal worker shutdown: https://docs.temporal.io/encyclopedia/workers/worker-shutdown#graceful-shutdown

### Protect your downstreams
Temporal retries are a superpower. They become someone else's outage if
your activities don't rate-limit outbound calls. Add bulkheads.

---

## Temporal Features Used

- **FairnessKey** — multi-tenant fairness on the task queue.
  https://docs.temporal.io/develop/task-queue-priority-fairness
- **StartDelay** — scheduled delivery without a custom scheduler.
  https://docs.temporal.io/develop/go/workflows/schedules#start-delay
- **Workflow ID Reuse Policy (REJECT_DUPLICATE)** — deterministic dedup.
  https://docs.temporal.io/nexus/operations#exactly-once-execution-semantics

---

## Further Reading

- **Temporal Application Design Patterns:**
  https://docs.temporal.io/evaluate/use-cases-design-patterns#design-patterns
- **Temporal samples — Go:**
  https://github.com/temporalio/samples-go
- **Temporal samples — Java:**
  https://github.com/temporalio/samples-java

---

## Contact

Parth Nagori — Staff Engineer, Twilio

TemporalReplay2026Talk

TemporalReplay2026Talk 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

TemporalReplay2026Talk

TemporalReplay2026Talk 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README