For context on getting started with ingestion, check out our metadata ingestion guide.
Note: Feast ingestion requires Docker to be installed.
To install this plugin, run
pip install 'acryl-datahub[feast]'.
This plugin extracts the following:
- List of feature tables (modeled as
MLFeatureTables), features (
MLFeatures), and entities (
- Column types associated with each feature and entity
Note: this uses a separate Docker container to extract Feast's metadata into a JSON file, which is then
parsed to DataHub's native objects. This separation was performed because of a dependency conflict in the
Check out the following recipe to get started with ingestion! See below for full configuration options.
For general pointers on writing and running a recipe, see our main recipe guide.
source: type: feast config: # Coordinates core_url: "localhost:6565" sink: # sink configs
Note that a
. is used to denote nested fields in the YAML recipe.
|URL of Feast Core instance.|
|Environment to use in namespace when constructing URNs.|
|Whether to build Feast ingestion Docker image locally.|
If you've got any questions on configuring this source, feel free to ping us on our Slack!