Our EDGE Services
Data Lake provides services that enable users to find, save, and process data according to their needs. Learn more about Islet, Stack, Hook, Harmonized Data Access and Fresh Data Pool and join us in the quest of finding answers to the most important questions. All the services are managed in one place through My Data Lake Services Portal. Explore DestinE Data Lake and embark on a journey!
MY DATA LAKE SERVICES
The platform allows you to see and mange all the services that compose the DestinE Data Lake initiative. My Data Lake Services attends to the needs of organizations and institutions that utilize EO Data in their work. You can sign up your organization and become its administrator or simply join an existing group as a member via invitation code. The Portal allows you to manage access as well as set limits (quotas) to each service offered by DEDL. Keep in mind that those services will not be available for you to use until both access and quota roles are requested and granted by our Approval Board. To properly set up your organization, make sure that you request access to all the tools you would like to use immediately, as the approval process may take up to a few days.
ISLET
The Islet Service is a cloud computing service based on OpenStack providing Infrastructure-as-a-Service (IaaS) solutions, allowing users to manage and deploy virtualised ‘compute, network and storage’ resources on a scalable architecture. Virtual resources (e.g. Virtual Machines or Object Storage) can be managed using the Horizon GUI or CLI. In addition to Virtual Machines (VMs), Kubernetes can be used to deploy containerised workloads.
HOOK
Go to serviceA DestinE Data Lake Edge service providing high level pre-defined and user-defined functions (conceptually like FaaS) that users can invoke from their applications and apply on data accessible via the DestinE Data Lake.
STACK
Go to serviceA DestinE Data Lake Edge service providing hosted applications/environments such as JupyterHub, Dask/Dask Gateway, Open Data Cube in which users can bring their algorithms/code and execute them on DestinE Data Lake site, close to the data of interest.
HARMONIZED DATA ACCESS
An API to act as a unified and harmonized access to all DestinE Data Lake data (federated data and Digital Twin outputs) and services. It includes a STAC catalog allowing to browse through all datasets and services and an access service allowing both direct data download and data harvesting into a user location.
FRESH DATA POOL
DestinE Data Lake internal cache for fast data discovery and access. The Data Lake Fresh Data Pool is made of 2 parts: an internal cache with data stored on a S3 bucket on the central site and one on CREODIAS.