Skip to main content

Feast

For context on getting started with ingestion, check out our metadata ingestion guide.

Setup#

Note: Feast ingestion requires Docker to be installed.

To install this plugin, run pip install 'acryl-datahub[feast]'.

Capabilities#

This plugin extracts the following:

Note: this uses a separate Docker container to extract Feast's metadata into a JSON file, which is then parsed to DataHub's native objects. This separation was performed because of a dependency conflict in the feast module.

Quickstart recipe#

Check out the following recipe to get started with ingestion! See below for full configuration options.

For general pointers on writing and running a recipe, see our main recipe guide.

source:  type: feast  config:    # Coordinates    core_url: "localhost:6565"
sink:  # sink configs

Config details#

Note that a . is used to denote nested fields in the YAML recipe.

FieldRequiredDefaultDescription
core_url"localhost:6565"URL of Feast Core instance.
env"PROD"Environment to use in namespace when constructing URNs.
use_local_buildFalseWhether to build Feast ingestion Docker image locally.

Compatibility#

Coming soon!

Questions#

If you've got any questions on configuring this source, feel free to ping us on our Slack!