fastify-reply-from

KO | EN

gitlite — search

#python #llm #go #golang #android #machine-learning #deep-learning #macos #java #cli #vue #openai #mcp #open-source

fastify-reply-from

(★ 167)

fastify plugin to forward the current http request to another server

File Explorer

Download Latest Version (.zip)

- - ci.yml
  - lock-threads.yml
- dependabot.yml
- example.js
- errors.js
- request.js
- utils.js
- - fastify.cert
  - fastify.key
  - file.txt
- async-route-handler.test.js
- balanced-pool.test.js
- base-get.test.js
- base-path.test.js
- base-querystring.test.js
- build-url.test.js
- connect-timeout.test.js
- core-with-path-in-base.test.js
- custom-undici-instance.test.js
- disable-request-logging.test.js
- fastify-multipart-incompatibility.test.js
- fix-GHSA-2q7r-29rg-6m5h.test.js
- fix-GHSA-v2v2-hph8-q5xp.test.js
- fix-GHSA-v574-6498-x57v.test.js
- full-delete-http2.test.js
- full-get-test.test.js
- full-https-get.test.js
- full-post-extended-content-type.test.js
- full-post-http2.test.js
- full-post-stream-core.test.js
- full-post-stream.test.js
- full-post.test.js
- full-querystring-rewrite-option-complex.test.js
- full-querystring-rewrite-option-empty-object.test.js
- full-querystring-rewrite-option-function-empty.test.js
- full-querystring-rewrite-option-function-request.test.js
- full-querystring-rewrite-option-function.test.js
- full-querystring-rewrite-option.test.js
- full-querystring-rewrite-string.test.js
- full-querystring-rewrite.test.js
- full-querystring-url.test.js
- full-querystring.test.js
- full-rewrite-body-content-type.test.js
- full-rewrite-body-http.test.js
- full-rewrite-body-to-empty-string.test.js
- full-rewrite-body-to-null.test.js
- full-rewrite-body.test.js
- get-upstream-cache.test.js
- get-upstream-http.test.js
- get-upstream-type.test.js
- get-upstream-undici.test.js
- host-header.test.js
- http-agents.test.js
- http-global-agent.test.js
- http-http2.test.js
- http-invalid-target.test.js
- http-retry.test.js
- http-timeout.test.js
- http1-aborted-request.test.js
- http2-canceled-streams-cleanup.test.js
- http2-goaway.test.js
- http2-http2.test.js
- http2-https.test.js
- http2-invalid-base.test.js
- http2-invalid-target.test.js
- http2-target-crash.test.js
- http2-target-multi-crash.test.js
- http2-te-header-not-stripped-if-trailing.test.js
- http2-timeout-disabled.test.js
- http2-timeout.test.js
- http2-unix-socket.test.js
- https-agents.test.js
- https-global-agent.test.js
- incomplete-request.test.js
- method.test.js
- modifyCoreObjects-false.test.js
- multipart-custom-parser.test.js
- no-body-opts-with-get.test.js
- no-body-opts-with-head.test.js
- no-stream-body-option.test.js
- on-error.test.js
- on-invalid-upstream-response.test.js
- onResponse.test.js
- padded-body.test.js
- post-formbody.test.js
- post-plain-text.test.js
- post-with-custom-encoded-contenttype.test.js
- post-with-octet-stream.test.js
- retry-on-503.test.js
- retry-with-a-custom-handler.test.js
- rewrite-headers-type.test.js
- rewrite-headers.test.js
- rewrite-request-headers-type.test.js
- rewrite-request-headers.test.js
- strip-connection-headers.test.js
- text-event-stream-custom-parser.test.js
- transform-body.test.js
- undici-agent.test.js
- undici-body.test.js
- undici-chaining.test.js
- undici-connect-timeout.test.js
- undici-custom-dispatcher.test.js
- undici-global-agent.test.js
- undici-no-destroy.test.js
- undici-options.test.js
- undici-proxy-agent.test.js
- undici-retry.test.js
- undici-timeout-body-partial.test.js
- undici-timeout-body.test.js
- undici-timeout.test.js
- undici-with-path-in-base.test.js
- undici.test.js
- unexpected-error.test.js
- unix-http-undici-from.test.js
- unix-http-undici.test.js
- unix-http.test.js
- unix-https-undici.test.js
- unix-https.test.js
- utils-filter-pseudo-headers.test.js
- index.d.ts
- index.tst.ts
.gitattributes
.gitignore
.npmrc
eslint.config.js
index.js
LICENSE
package.json
README.md

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# @fastify/reply-from

[![CI](https://github.com/fastify/fastify-reply-from/actions/workflows/ci.yml/badge.svg?branch=main)](https://github.com/fastify/fastify-reply-from/actions/workflows/ci.yml)
[![NPM version](https://img.shields.io/npm/v/@fastify/reply-from.svg?style=flat)](https://www.npmjs.com/package/@fastify/reply-from)
[![neostandard javascript style](https://img.shields.io/badge/code_style-neostandard-brightgreen?style=flat)](https://github.com/neostandard/neostandard)

Fastify plugin to forward the current HTTP request to another server.
HTTP2 to HTTP is supported too.

## Install

```
npm i @fastify/reply-from
```

## Usage

The following example set up two Fastify servers and forward the request
from one to the other:

```js
'use strict'

const Fastify = require('fastify')

const target = Fastify({
  logger: true
})

target.get('/', (request, reply) => {
  reply.send('hello world')
})

const proxy = Fastify({
  logger: true
})

proxy.register(require('@fastify/reply-from'), {
  base: 'http://localhost:3001/'
})

proxy.get('/', (request, reply) => {
  reply.from('/')
})

target.listen({ port: 3001 }, (err) => {
  if (err) {
    throw err
  }

proxy.listen({ port: 3000 }, (err) => {
    if (err) {
      throw err
    }
  })
})
```

## API

### Plugin options

#### `base`

Set the base URL for all the forwarded requests. Will be required if `http2` is set to `true`
Note that _every path will be discarded_.

Set the base URL for all the forwarded requests.
*String or String[]*:

* **Single string** → a normal `undici.Pool` / `http.request` client is used.
* **Array with ≥ 2 elements** → **[`undici.BalancedPool`](https://undici.nodejs.org/api/BalancedPool)** is automatically selected and requests are load-balanced round-robin across the given origins.

When you provide an array, only the *origin* (`protocol://host:port`) part of each URL is considered; any path component is ignored.

Custom URL protocols `unix+http:` and `unix+https:` can be used to forward requests to a unix
socket server by using `querystring.escape(socketPath)` as the hostname.  This is not supported
for http2 nor undici.  To illustrate:

```js
const socketPath = require('node:querystring').escape('/run/http-daemon.socket')
proxy.register(require('@fastify/reply-from'), {
  base: 'unix+http://${socketPath}/'
});
```

#### `undici`

By default, [undici](https://github.com/nodejs/undici) will be used to perform the HTTP/1.1
requests. Enabling this option should guarantee
20-50% more throughput.

This option controls the settings of the undici client, like so:

```js
proxy.register(require('@fastify/reply-from'), {
  base: 'http://localhost:3001/',
  // default settings
  undici: {
    connections: 128,
    pipelining: 1,
    keepAliveTimeout: 60 * 1000,
    tls: {
      rejectUnauthorized: false
    }
  }
})
```

You can also include a proxy for the undici client:

```js
proxy.register(require('@fastify/reply-from'), {
  base: 'http://localhost:3001/',
  undici: {
    proxy: 'http://my.proxy.server:8080',
  }
})
```

See undici own options for more configurations.

You can also pass the plugin a custom instance:

```js
proxy.register(require('@fastify/reply-from'), {
  base: 'http://localhost:3001/',
  undici: new undici.Pool('http://localhost:3001')
})
```

You can also use with BalancedPool:
 ```js
proxy.register(require('@fastify/reply-from'), {
  base: [
    'http://api-1.internal:8080',
    'http://api-2.internal:8080',
    'http://api-3.internal:8080'
  ]
})
```

#### `http`

Set the `http` option to an Object to use
Node's [`http.request`](https://nodejs.org/api/http.html#http_http_request_options_callback)
will be used if you do not enable [`http2`](#http2). To customize the `request`,
you can pass in [`agentOptions`](https://nodejs.org/api/http.html#http_new_agent_options) and
[`requestOptions`](https://nodejs.org/api/http.html#http_http_request_options_callback). To illustrate:

```js
proxy.register(require('@fastify/reply-from'), {
  base: 'http://localhost:3001/',
  http: {
    agentOptions: { // pass in any options from https://nodejs.org/api/http.html#http_new_agent_options
      keepAliveMsecs: 10 * 60 * 1000
    },
    requestOptions: { // pass in any options from https://nodejs.org/api/http.html#http_http_request_options_callback
      timeout: 5000 // timeout in msecs, defaults to 10000 (10 seconds)
    }
  }
})
```

You can also pass custom HTTP agents. If you pass the agents, then the http.agentOptions will be ignored. To illustrate:

```js
proxy.register(require('@fastify/reply-from'), {
  base: 'http://localhost:3001/',
  http: {
    agents: {
      'http:': new http.Agent({ keepAliveMsecs: 10 * 60 * 1000 }), // pass in any options from https://nodejs.org/api/http.html#http_new_agent_options
      'https:': new https.Agent({ keepAliveMsecs: 10 * 60 * 1000 })

},
    requestOptions: { // pass in any options from https://nodejs.org/api/http.html#http_http_request_options_callback
      timeout: 5000 // timeout in msecs, defaults to 10000 (10 seconds)
    }
  }
})
```

#### `http2`

You can either set `http2` to `true` or set the settings object to connect to an HTTP/2 server.
The `http2` settings object has the shape of:

```js
proxy.register(require('@fastify/reply-from'), {
  base: 'http://localhost:3001/',
  http2: {
    sessionTimeout: 10000, // HTTP/2 session timeout in msecs, defaults to 60000 (1 minute)
    requestTimeout: 5000, // HTTP/2 request timeout in msecs, defaults to 10000 (10 seconds)
    sessionOptions: { // HTTP/2 session connect options, pass in any options from https://nodejs.org/api/http2.html#http2_http2_connect_authority_options_listener
      rejectUnauthorized: true
    },
    requestOptions: { // HTTP/2 request options, pass in any options from https://nodejs.org/api/http2.html#clienthttp2sessionrequestheaders-options
      endStream: true
    }
  }
})
```

#### `disableRequestLogging`

By default, the package will issue log messages when a request is received. By setting this option to true, these log messages will be disabled.

Default for `disableRequestLogging` will be `false`. To disable the log messages set `disableRequestLogging` to `true`.

```js
proxy.register(require('@fastify/reply-from'), {
  base: 'http://localhost:3001/',
  disableRequestLogging: true // request log messages will be disabled
})
```

#### `cacheURLs`

The number of parsed URLs that will be cached. Default: `100`.

#### `disableCache`

This option will disable the URL caching.
This cache is dedicated to reducing the amount of URL object generation.
Generating URLs is a main bottleneck of this module, please disable this cache with caution.

#### `contentTypesToEncode`

An array of content types whose response body will be passed through `JSON.stringify()`.
This only applies when a custom [`body`](#body) is not passed in. Defaults to:

```js
[
  'application/json'
]
```

#### `retryMethods`

On which methods should the connection be retried in case of socket hang up.
**Be aware** that setting here not idempotent method may lead to unexpected results on target.

By default: `['GET', 'HEAD', 'OPTIONS', 'TRACE']`

This plugin will always retry on 503 errors, _unless_ `retryMethods` does not contain `GET`.

#### `globalAgent`

Enables the possibility to explicitly opt-in for global agents.

Usage for undici global agent:

```js
import { setGlobalDispatcher, ProxyAgent } from 'undici'

const proxyAgent = new ProxyAgent('my.proxy.server')
setGlobalDispatcher(proxyAgent)

fastify.register(FastifyReplyFrom, {
  base: 'http://localhost:3001/',
  globalAgent: true
})
```

Usage for http/https global agent:

```js
fastify.register(FastifyReplyFrom, {
  base: 'http://localhost:3001/',
  // http and https is allowed to use http.globalAgent or https.globalAgent
  globalAgent: true,
  http: {
  }
})
```

---

#### `destroyAgent`

If set to `true`, it will destroy all agents when the Fastify is closed.
If set to `false`, it will not destroy the agents.

By Default: `false`

---

#### `maxRetriesOn503`

This plugin will always retry on `GET` requests that returns 503 errors, _unless_ `retryMethods` does not contain `GET`.

This option sets the limit on how many times the plugin should retry the request, specifically for 503 errors.

By Default: 10

---

### `retryDelay`

- `handler`. Required

This plugin gives the client an option to pass their own retry callback to allow the client to define what retryDelay they would like on any retries
outside the scope of what is handled by default in fastify-reply-from. To see the default please refer to index.js `getDefaultDelay()`
If a `handler` is passed to the `retryDelay` object the onus is on the client to invoke the default retry logic in their callback otherwise default cases such as 500 will not be handled

- `err` is the error thrown by making a request using whichever agent is configured
- `req` is the raw request details sent to the underlying agent. __Note__: this object is not a Fastify request object, but instead the low-level request for the agent.
- `res` is the raw response returned by the underlying agent (if available) __Note__: this object is not a Fastify response, but instead the low-level response from the agent. This property may be null if no response was obtained at all, like from a connection reset or timeout.
- `attempt` in the object callback refers to the current retriesAttempt number. You are given the freedom to use this in concert with the retryCount property set to handle retries
- `getDefaultRetry` refers to the default retry handler. If this callback returns not null and you wish to handle those case of errors simply invoke it as done below.
- `retriesCount` refers to the retriesCount property a client passes to reply-from. Note if the client does not explicitly set this value it will default to 0. The objective value here is to avoid hard-coding and seeing the retriesCount set. It is your prerogative to ensure that you ensure the value here is as you wish (and not `0` if not intended to be as a result of a lack of not setting it).

Given example

```js
   const customRetryLogic = ({err, req, res, attempt, getDefaultRetry}) => {
    //If this block is not included all non 500 errors will not be retried
    const defaultDelay = getDefaultDelay(req, res, err, attempt);
    if (defaultDelay) return defaultDelay();

//Custom retry logic
    if (res && res.statusCode === 500 && req.method === 'GET') {
      return 300
    }

if (err && err.code == "UND_ERR_SOCKET"){
      return 600
    }

return null
  }

.......

fastify.register(FastifyReplyFrom, {
  base: 'http://localhost:3001/',
  retryDelay: customRetryLogic
})

```

Note the Typescript Equivalent
```
const customRetryLogic = ({req, res, err, getDefaultRetry}: RetryDetails) => {
  ...
}
...

```
---

### `reply.from(source, [opts])`

The plugin decorates the
[`Reply`](https://fastify.dev/docs/latest/Reference/Reply/)
instance with a `from` method, which will reply to the original request
__from the desired source__. The options allows overrides of any part of
the request or response being sent or received to/from the source.

**Note: If `base` is specified in plugin options, the `source` here should not override the host/origin.**

#### `onResponse(request, reply, response)`

Called when an HTTP response is received from the source. Passed the original source `request`, the in-progress reply to the source as `reply`, and the ongoing `response` from the upstream server.

The default behavior is `reply.send(response.stream)`, which will be disabled if the
option is specified.

When replying with a body of a different length it is necessary to remove
the `content-length` header.

```js
{
  onResponse: (request, reply, res) => {
    reply.removeHeader('content-length');
    reply.send('New body of different length');
  }
}
```

**Note**: `onResponse` is called after headers have already been sent. If you want to modify response headers, use the `rewriteHeaders` hook.

#### `onError(reply, error)`

Called when an HTTP response is received with error from the source.
The default behavior is `reply.send(error)`, which will be disabled if the
option is specified.
It must reply with the error.

#### `rewriteHeaders(headers, request)`

Called to rewrite the headers of the response, before them being copied
over to the outer response.
Parameters are the original headers and the Fastify request.
It must return the new headers object.

#### `rewriteRequestHeaders(request, headers)`

Called to rewrite the headers of the request, before them being sent to the other server.
Parameters are the Fastify request and the original request headers.
It must return the new headers object.

#### `getUpstream(request, base)`

Called to get upstream destination, before the request is sent. Useful when you want to decide which target server to call based on the request data.
Helpful for a gradual rollout of new services.
Parameters are the Fastify request and the base string from the plugin options.
It must return the upstream destination.

Only http1! As http2 uses one connection for the whole session only the base upstream is used. If you want to
have different upstreams based on the request you can add multiple Fastify.register's with different
ContraintStrategies.

e.g.:

Route grpc-web/http1 and grpc/http2 to different routes with a ContentType-ConstraintStrategy:

```
const contentTypeMatchContraintStrategy = {
    // strategy name for referencing in the route handler `constraints` options
    name: 'contentType',
    // storage factory for storing routes in the find-my-way route tree
    storage: function () {
      let handlers = {}
      return {
        get: (type: any) => { return handlers[type] || null },
        set: (type: any, store: any) => { handlers[type] = store }
      }
    },
    // function to get the value of the constraint from each incoming request
    deriveConstraint: (req: any, ctx: any) => {
      return req.headers['content-type']
    },
    // optional flag marking if handlers without constraints can match requests that have a value for this constraint
    mustMatchWhenDerived: true
  }

server.addConstraintStrategy(contentTypeMatchContraintStrategy);
```

and then 2 different upstreams with different register's:

```
// grpc-web / http1
server.register(fastifyHttpProxy, {
    // Although most browsers send with http2, nodejs cannot handle this http2 request
    // therefore we have to transport to the grpc-web-proxy via http1
    http2: false,
    upstream: 'http://grpc-web-proxy',
    constraints: { "contentType": "application/grpc-web+proto" }
});

// grpc / http2
server.register(fastifyHttpProxy, {
    http2: true,
    upstream: 'http://grpc.server',
    constraints: { "contentType": "application/grpc+proto" }
});
```

#### `queryString` or `queryString(search, reqUrl, request)`

Replaces the original querystring of the request with what is specified.
This will be passed to
[`querystring.stringify`](https://nodejs.org/api/querystring.html#querystring_querystring_stringify_obj_sep_eq_options).

- `object`: accepts an object that will be passed to `querystring.stringify`
- `function`: function that will return a string with the query parameters e.g. `name=test&type=user`

#### `body`

Replaces the original request body with what is specified. Unless
[`contentType`](#contentType) is specified, the content will be passed
through `JSON.stringify()`.
Setting this option for GET, HEAD requests will throw an error "Rewriting the body when doing a {GET|HEAD} is not allowed".
Setting this option to `null` will strip the body (and `content-type` header) entirely from the proxied request.

#### `method`

Replaces the original request method with what is specified.

#### `retriesCount`

How many times it will try to pick another connection on socket hangup (`ECONNRESET` error).
Useful when keeping the connection open (KeepAlive).
This number should be a function of the number of connections and the number of instances of a target.

By default: 0 (disabled)

#### `contentType`

Override the `'Content-Type'` header of the forwarded request, if we are
already overriding the [`body`](#body).

#### `timeout`

Set a specific timeout for the request. Override options `http.requestOptions.timeout`, `http2.requestOptions.timeout`, `undici.headersTimeout` and `undici.bodyTimeout` from the plugin config.

### Combining with [@fastify/formbody](https://github.com/fastify/fastify-formbody)

`formbody` expects the body to be returned as a string and not an object.
Use the [`contentTypesToEncode`](#contentTypesToEncode) option to pass in `['application/x-www-form-urlencoded']`

### HTTP & HTTP2 timeouts

This library has:

- `timeout` for `http` set by default. The default value is 10 seconds (`10000`).
- `requestTimeout` & `sessionTimeout` for `http2` set by default.
  - The default value for `requestTimeout` is 10 seconds (`10000`), a value of 0 disables the timeout.
  - The default value for `sessionTimeout` is 60 seconds (`60000`), a value of 0 disables the timeout.

When a timeout happens, [`504 Gateway Timeout`](https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Status/504)
will be returned to the client.

## Compatibility with @fastify/multipart

`@fastify/reply-from` and [`@fastify/multipart`](https://github.com/fastify/fastify-multipart) should not be registered as sibling plugins nor should they be registered in plugins that have a parent-child relationship.

The two plugins are incompatible, in the sense that the behavior of `@fastify/reply-from` might not be the expected one when the above-mentioned conditions are not respected.
This is due to the fact that `@fastify/multipart` consumes the multipart content by parsing it, hence this content is not forwarded to the target service by `@fastify/reply-from`.

However, the two plugins may be used within the same fastify instance, at the condition that they belong to disjoint branches of the fastify plugins hierarchy tree.

### Proxying specific content types without parsing

If you need to proxy certain content types (like `multipart/form-data` or `text/event-stream`) without parsing them, you can use custom content type parsers:

```js
// Register custom content type parsers that pass raw body through
fastify.addContentTypeParser('multipart/form-data', function (req, body, done) {
  done(null, body)
})

fastify.addContentTypeParser('text/event-stream', function (req, body, done) {
  done(null, body)
})

fastify.register(require('@fastify/reply-from'))

fastify.post('/upload', (request, reply) => {
  // The multipart data will be proxied as-is to the upstream server
  reply.from('http://upstream-server.com/upload')
})

fastify.post('/events', (request, reply) => {
  // The SSE data will be proxied as-is to the upstream server
  reply.from('http://upstream-server.com/events')
})
```

This approach allows these content types to be proxied correctly while avoiding parsing that would consume the request body.

## License

MIT

[http-agent]: https://nodejs.org/api/http.html#http_new_agent_options
[https-agent]: https://nodejs.org/api/https.html#https_class_https_agent

fastify-reply-from

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

fastify-reply-from

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

Download README