grain.experimental.WindowShuffleIterDataset

grain.experimental.WindowShuffleIterDataset#

class grain.experimental.WindowShuffleIterDataset(parent, *, window_size, seed)#

Shuffles the parent dataset within a given window.

Fetches window_size elements from the parent iterator and returns them in shuffled order. Each window is shuffled with different seed derived from the input seed.

Parameters:
__init__(parent, *, window_size, seed)#
Parameters:

Methods

__init__(parent, *, window_size, seed)

apply(transformations)

Returns a dataset with the given transformation(s) applied.

batch(batch_size, *[, drop_remainder, batch_fn])

Returns a dataset of elements batched along a new first dimension.

filter(transform)

Returns a dataset containing only the elements that match the filter.

map(transform)

Returns a dataset containing the elements transformed by transform.

map_with_index(transform)

Returns a dataset of the elements transformed by the transform.

mp_prefetch([options, worker_init_fn])

Returns a dataset prefetching elements in multiple processes.

pipe(func, /, *args, **kwargs)

Syntactic sugar for applying a callable to this dataset.

prefetch(multiprocessing_options)

Deprecated, use mp_prefetch instead.

random_map(transform, *[, seed])

Returns a dataset containing the elements transformed by transform.

seed(seed)

Returns a dataset that uses the seed for default seed generation.

Attributes

parents

Contents