Data::Stream::Bulk::Chunked - combine streams into larger chunks
use Data::Stream::Bulk::Chunked;
Data::Stream::Bulk::Chunked->new(
stream => $s,
chunk_size => 10000,
);
This is a stream which wraps an existing stream to give more items in a single
block. This can simplify application code which does its own processing one
block at a time, and where processing larger blocks is more efficient.
- stream
- The stream to chunk. Required.
- chunk_size
- The minimum number of items to return in a block. Defaults to 1 (which
does nothing).
- get_more
- See Data::Stream::Bulk::DoneFlag.
Returns at least
"chunk_size" items. Note that this
isn't guaranteed to return exactly
"chunk_size" items - it just returns
multiple full blocks from the backend. Also, the final block returned
may have less than "chunk_size"
items.
Yuval Kogman <nothingmuch@woobling.org>
This software is copyright (c) 2012 by Yuval Kogman.
This is free software; you can redistribute it and/or modify it
under the same terms as the Perl 5 programming language system itself.