Skip to main content

System overview

FarEarth produces analysis-ready data in industry-standard formats. FarEarth Quality Reports, per product, include metadata and provide traceability based on science

FarEarth system overview

Director

  • The Director is the brain of FarEarth
  • It directs the execution of Workflows and assigns jobs to FarEarth's distributed components
  • The Director keeps track of data and monitors progress throughout the lifecycle of an order
  • It orchestrates access to resources and your data

Datapoint

  • The Datapoint is FarEarth's data management component
  • A Pickup is a specific configuration of a Datapoint
  • It is responsible for ingesting data from a specific location
  • The Datapoint component is the entry for your data into FarEarth. It monitors multiple pickup locations for your input data and triggers processing
  • Datapoints enables integration with your external data stores or acquisition service

Workflows

  • A FarEarth Workflow is the recipe to create a product. Each workflow defines the sequence of steps to create and archive a product. FarEarth has pre-defined scientific workflows to support your processing requirements. FarEarth allows you to define custom workflows that include your own custom-developed processing algorithms.

Processors

  • The Processing component manages all processing nodes within FarEarth
  • A FarEarth Processor orchestrates the Executors responsible for completing each step of the workflow. It manages the flow of data throughout the processing lifecycle
  • An Executor is a plug-in that contains processing algorithms
  • FarEarth includes pre-defined scientific Executors, it also allows you to create your own. For each step, a FarEarth Executor processes input and delivers output

Catalogue

  • The Catalogue in FarEarth is a searchable web front-end
  • The Catalogue is the central access point for all your FarEarth data and external data sources
  • It includes the Archive, a data storage subsystem
  • FarEarth delivers your products as STAC Items in a secure Archive data store
  • FarEarth provides storage, or you can attach your own storage accounts
  • FarEarth uses rules to dynamically manage data stored across multiple archives