Struct FileOrFiles 

pub struct FileOrFiles {
    pub partition_index: u64,
    pub start: u64,
    pub length: u64,
    pub path_type: Option<PathType>,
    pub file_format: Option<FileFormat>,
}

Many files consist of indivisible chunks (e.g. parquet row groups or CSV rows). If a slice partially selects an indivisible chunk then the consumer should employ some rule to decide which slice to include the chunk in (e.g. include it in the slice that contains the midpoint of the chunk)

Fields

partition_index: u64

The index of the partition this item belongs to

start: u64

The start position in byte to read from this item

length: u64

The length in byte to read from this item

path_type: Option<PathType>

URIs specify the location of files that are locally-accessible to the consumer. “Locally-accessible” means the consumer can access the files directly, which may include blob storage (e.g., S3, GCS, Azure Blob Storage) in addition to local filesystem paths. The protocol portion of the URI determines the storage type.

file_format: Option<FileFormat>

The format of the files along with options for reading those files.

Trait Implementations

impl Clone for FileOrFiles

fn clone(&self) -> FileOrFiles

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for FileOrFiles

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for FileOrFiles

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for FileOrFiles

fn deserialize<D>(deserializer: D) -> Result<Self, D::Error>

where D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Hash for FileOrFiles

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl Message for FileOrFiles

fn encoded_len(&self) -> usize

Returns the encoded length of the message without a length delimiter.

fn clear(&mut self)

Clears the message, resetting all fields to their default.

fn encode(&self, buf: &mut impl BufMut) -> Result<(), EncodeError>

where Self: Sized,

Encodes the message to a buffer.

fn encode_to_vec(&self) -> Vec<u8>

where Self: Sized,

Encodes the message to a newly allocated buffer.

fn encode_length_delimited( &self, buf: &mut impl BufMut, ) -> Result<(), EncodeError>

where Self: Sized,

Encodes the message with a length-delimiter to a buffer.

fn encode_length_delimited_to_vec(&self) -> Vec<u8>

where Self: Sized,

Encodes the message with a length-delimiter to a newly allocated buffer.

fn decode(buf: impl Buf) -> Result<Self, DecodeError>

where Self: Default,

Decodes an instance of the message from a buffer.

fn decode_length_delimited(buf: impl Buf) -> Result<Self, DecodeError>

where Self: Default,

Decodes a length-delimited instance of the message from the buffer.

fn merge(&mut self, buf: impl Buf) -> Result<(), DecodeError>

where Self: Sized,

Decodes an instance of the message from a buffer, and merges it into self.

fn merge_length_delimited(&mut self, buf: impl Buf) -> Result<(), DecodeError>

where Self: Sized,

Decodes a length-delimited instance of the message from buffer, and merges it into self.

impl PartialEq for FileOrFiles

fn eq(&self, other: &FileOrFiles) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for FileOrFiles

fn serialize<S>(&self, serializer: S) -> Result<S::Ok, S::Error>

where S: Serializer,

Serialize this value into the given Serde serializer.

impl Eq for FileOrFiles

impl StructuralPartialEq for FileOrFiles