datamodel#

Common data structures shared across the datakit pipeline.

The module groups the frozen dataclasses that represent discovered files, aligned timelines, and high-level dataset bundles so that explorers can see “what flows through the system” in one place.

class mesofield.datakit.datamodel.StreamPayload[source]#

Bases: object

Typed wrapper around arbitrary stream values.

Each payload records its kind (table/array/mapping/sequence/scalar), the raw data object, and lightweight attrs that describe shape or column metadata. Persisting this metadata makes it easier to reconstruct the original Python object on reload.

property data_view: Any#: Return the canonical data representation (DataFrame, ndarray, etc).

__init__(kind, data, attrs=<factory>)#

Parameters:

kind (str)
data (Any)
attrs (Dict[str, Any])

Return type:

None

class mesofield.datakit.datamodel.ManifestEntry[source]#

Bases: object

Single file discovered during manifest building.

__init__(tag, path, origin, subject, session, task=None)#

Parameters:

tag (str)
path (str)
origin (str)
subject (str)
session (str)
task (str | None)

Return type:

None

class mesofield.datakit.datamodel.LoadedStream[source]#

Bases: object

Hydrated data stream with timestamps and metadata.

__init__(tag, t, value, meta)#

Parameters:

tag (str)
t (ndarray)
value (object)
meta (dict)

Return type:

None

class mesofield.datakit.datamodel.Manifest[source]#

Bases: object

Manifest of files discovered for an experiment root.

__init__(root, entries)#

Parameters:

root (Path)
entries (list[ManifestEntry])

Return type:

None