DSI Development Plans
DSI 1.1 has a core set of capabilities with plans to add functionality in future releases. This is user-driven so feel free to raise an issue on the DSI GitHub repo for suggested capabilities.
Current capabilities include the DSI Core and associated DSI data services. The DSI data services include the functionality to store and retrieve user metadata in DSI accessible storage.
DSI Functionalities
DSI software/API (1.1) released via GitHub
Can be used on its own or as part of a data service workflow
Provides an API for users/services
Functionality |
DSI module |
Description |
Release |
|---|---|---|---|
Read data |
Plugins: Readers |
Ability to read in data; users can create data-specific readers |
DSI 1.0 |
Write data |
Plugins: Writers |
Ability to write data; users can create data-specific writers |
DSI 1.0 |
Ingest data |
Core: Terminal.artifact_handler (‘ingest’) |
Store metadata and data from Readers into backends |
DSI 1.0 |
Query data |
Core: Terminal.artifact_handler (‘query’) |
Query data from backends |
DSI 1.0 |
Process data |
Core: Terminal.artifact_handler (‘process’) |
Store metadata and data from backends in DSI abstraction layer |
DSI 1.1 |
Interact with data |
Core: Terminal.artifact_handler (‘notebook’) |
Generate Python notebook filled with data from a backend |
DSI 1.1 |
Find |
Core: find, find_table, find_column, find_cell |
Search across all parts of a backend to retrieve data matching a query |
DSI 1.1 |
Move |
Core: Sync |
Move data between file store types |
DSI 1.1 |
Versioning |
Core |
Track and identify different versions of the same data |
Future release |