byte-stream

KO | EN

gitlite — search

#python #ai #llm #golang #linux #macos #windows #cli #awesome-list #pytorch #security #openai #mcp #open-source

(★ 394)

A non-blocking stream abstraction for PHP based on Amp.

File Explorer

Download Latest Version (.zip)

- - ci.yml
- benchmark-throughput.php
- gzip-compress.php
- gzip-decompress.php
- - Base64DecodingReadableStream.php
  - Base64DecodingWritableStream.php
  - Base64EncodingReadableStream.php
  - Base64EncodingWritableStream.php
- - CompressingReadableStream.php
  - CompressingWritableStream.php
  - DecompressingReadableStream.php
  - DecompressingWritableStream.php
- - ChannelParser.php
  - functions.php
- AsyncWriter.php
- BufferedReader.php
- BufferException.php
- ClosedException.php
- functions.php
- Payload.php
- PendingReadError.php
- Pipe.php
- ReadableBuffer.php
- ReadableIterableStream.php
- ReadableResourceStream.php
- ReadableStream.php
- ReadableStreamChain.php
- ReadableStreamIteratorAggregate.php
- ResourceStream.php
- StreamChannel.php
- StreamException.php
- WritableBuffer.php
- WritableIterableStream.php
- WritableResourceStream.php
- WritableStream.php
- - Base64DecodingInputStreamTest.php
  - Base64DecodingOutputStreamTest.php
  - Base64EncodingInputStreamTest.php
  - Base64EncodingOutputStreamTest.php
- - CompressingReadableStreamTest.php
  - CompressingWritableStreamTest.php
  - DecompressingReadableStreamTest.php
  - DecompressingWritableStreamTest.php
- - foobar.txt
  - foobar.txt.gz
- - ChannelParserTest.php
- AsyncWriterTest.php
- BufferedReaderTest.php
- BufferTest.php
- ParseLineDelimitedJsonTest.php
- PayloadTest.php
- PendingReadErrorTest.php
- PipeTest.php
- ReadableBufferTest.php
- ReadableIterableStreamTest.php
- ReadableResourceStreamTest.php
- ReadableStreamChainTest.php
- ResourceStreamTest.php
- SplitTest.php
- StdioStreamTest.php
- StreamChannelTest.php
- WritableBufferTest.php
- WritableResourceStreamTest.php
.editorconfig
.gitattributes
.gitignore
.php-cs-fixer.dist.php
composer-require-check.json
composer.json
infection.json.dist
LICENSE
phpunit.xml.dist
psalm.xml
README.md

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# amphp/byte-stream

AMPHP is a collection of event-driven libraries for PHP designed with fibers and concurrency in mind.
`amphp/byte-stream` specifically provides a stream abstraction to ease working with various byte streams.

## Installation

This package can be installed as a [Composer](https://getcomposer.org/) dependency.

```bash
composer require amphp/byte-stream
```

## Requirements

This package requires PHP 8.1 or later.

## Usage

Streams are an abstraction over ordered sequences of bytes. This package provides the fundamental interfaces `ReadableStream` and `WritableStream`.

> **Note**
> Previous versions used the terms `InputStream` and `OutputStream`, but these terms can be confusing depending on the use case.

### ReadableStream

`ReadableStream` offers a primary method: `read()`. It returns a `string` or `null`. `null` indicates that the stream has ended.

The following example shows a `ReadableStream` consumption that buffers the complete stream contents.

```php
$stream = ...;
$buffer = "";

while (($chunk = $stream->read()) !== null) {
    $buffer .= $chunk;
}

// do something with $buffer
```

> **Note**
> `Amp\ByteStream\buffer($stream)` can be used instead, but we'd like to demonstrate manual consumption here.

This package offers some basic implementations, other libraries might provide even more implementations, such as [`amphp/socket`](https://github.com/amphp/socket).

* [`Payload`](#payload)
* [`ReadableBuffer`](#readablebuffer)
* [`ReadableIterableStream`](#readableiterablestream)
* [`ReadableResourceStream`](#readableresourcestream)
* [`ReadableStreamChain`](#readablestreamchain)
* [`Base64DecodingReadableStream`](#base64decodingreadablestream)
* [`Base64EncodingReadableStream`](#base64encodingreadablestream)
* [`DecompressingReadableStream`](#decompressingreadablestream)

### Payload

`Payload` implements `ReadableStream` while also providing a `buffer()` method for buffering the entire contents.
This allows consuming a message either in chunks (streaming) or consume everything at once (buffering).
When the object is destructed, any remaining data in the stream is automatically consumed and discarded.
This class is useful for small payloads or when the entire contents of a stream is needed before any processing can be done.

#### Buffering

Buffering a complete readable stream can be accomplished using the `buffer()` method.

```php
$payload = new Payload($inputStream);
$content = $payload->buffer();
```

#### Streaming

Sometimes it's useful / possible to consume a payload in chunks rather than first buffering it completely, e.g. streaming a large HTTP response body directly to disk.

```php
while (null !== $chunk = $payload->read()) {
    // Use $chunk here, works just like any other ReadableStream
}
```

### ReadableBuffer

An `ReadableBuffer` allows creating a `ReadableStream` from a single known string chunk.
This is helpful if the complete stream contents are already known.

```php
$stream = new ReadableBuffer("foobar");
```

It also allows creating a stream without any chunks by passing `null` as chunk / omitting the constructor argument:

```php
$stream = new ReadableBuffer;

// The stream ends immediately
assert(null === $stream->read());
```

### ReadableIterableStream

`ReadableIterableStream` allows converting an `iterable` that yields strings into a `ReadableStream`:

```php
$inputStream = new Amp\ByteStream\ReadableIterableStream((function () {
    for ($i = 0; $i < 10; $i++) {
        Amp\delay(1);
        yield $emit(".");
    }
})());
```

### ReadableResourceStream

This package abstracts PHP's stream resources with `ReadableResourceStream` and `WritableResourceStream`.
They automatically set the passed resource to non-blocking mode and allow reading and writing like any other `ReadableStream` / `WritableStream`.
They also handle backpressure automatically by disabling the read watcher in case there's no read request and only activate a writability watcher if the underlying write buffer is already full, which makes them very efficient.

### DecompressingReadableStream

This package implements compression based on Zlib. `CompressingWritableStream` can be used for compression, while `DecompressingReadableStream` can be used for decompression. Both can simply wrap an existing stream to apply them. Both accept an `$encoding` and `$options` parameter in their constructor.

```php
$readableStream = new ReadableResourceStream(STDIN);
$decompressingReadableStream = new DecompressingReadableStream($readableStream, \ZLIB_ENCODING_GZIP);

while (null !== $chunk = $decompressingReadableStream) {
    print $chunk;
}
```

See also: [`./examples/gzip-decompress.php`](https://github.com/amphp/byte-stream/blob/v2/examples/gzip-decompress.php)

### WritableStream

`WritableStream` offers two primary methods: `write()` and `end()`.

#### WritableStream::write

`write()` writes the given string to the stream. Waiting for completion allows writing only as fast as the underlying stream can write and potentially send over a network. TCP streams will return immediately as long as the write buffer isn't full.

The writing order is always ensured, even if the writer doesn't wait for completion before issuing another write.

#### WritableStream::end

`end()` marks the stream as ended. TCP streams might close the underlying stream for writing, but MUST NOT close it. Instead, all resources should be freed and actual resource handles be closed by PHP's garbage collection process.

The following example uses the previous example to read from a stream and writes all data to a `WritableStream`:

```php
$readableStream = ...;
$writableStream = ...;
$buffer = "";

while (($chunk = $readableStream->read()) !== null) {
    $writableStream->write($chunk);
}

$writableStream->end();
```

> **Note**
> `Amp\ByteStream\pipe($readableStream, $writableStream)` can be used instead, but we'd like to demonstrate manual consumption / writing here.

This package offers some basic implementations, other libraries might provide even more implementations, such as [`amphp/socket`](https://github.com/amphp/socket).

* [`WritableBuffer`](#writablebuffer)
* [`WritableIterableStream`](#writableiterablestream)
* [`WritableResourceStream`](#writableresourcestream)
* [`Base64DecodingWritableStream`](#base64decodingwritablestream)
* [`Base64EncodingWritableStream`](#base64encodingwritablestream)
* [`CompressingWritableStream`](#compressingwritablestream)

### WritableResourceStream

### CompressingWritableStream

```php
$writableStream = new WritableResourceStream(STDOUT);
$compressedWritableStream = new CompressingWritableStream($writableStream, \ZLIB_ENCODING_GZIP);

for ($i = 0; $i < 100; $i++) {
    $compressedWritableStream->write(bin2hex(random_bytes(32));
}

$compressedWritableStream->end();
```

See also: [`./examples/gzip-compress.php`](https://github.com/amphp/byte-stream/blob/v2/examples/gzip-compress.php)

## Versioning

`amphp/byte-stream` follows the [semver](http://semver.org/) semantic versioning specification like all other `amphp` packages.

## Security

If you discover any security related issues, please email [`me@kelunik.com`](mailto:me@kelunik.com) instead of using the issue tracker.

## License

The MIT License (MIT). Please see [`LICENSE`](./LICENSE) for more information.

byte-stream

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

byte-stream

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

Download README