📄️ Introduction
Marquez is an open source **metadata service** for the **collection**, **aggregation**, and **visualization** of a data ecosystem's metadata.
📄️ Abort a run
Marks the run as `ABORTED`.
📄️ Tag a dataset
Tag an existing dataset.
📄️ Tag a field
Tag an existing field of a dataset.
📄️ Complete a run
Marks the run as `COMPLETED`.
📄️ Create a run
Creates a new run object for a job.
📄️ Soft deletes dataset.
Soft deletes dataset. It will be un-deleted if new OpenLineage event containing this dataset comes.
📄️ Deletes a namespace
Soft deletes a namespace, and every job and dataset inside. On next event containing this namespace, the namespace will be undeleted.
📄️ Fail a run
Marks the run as `FAILED`.
📄️ Get a column lineage graph
Get a column lineage graph
📄️ Retrieve a dataset
Returns a dataset.
📄️ List all datasets
Returns a list of datasets.
📄️ Retrieve run or job facets for a run.
Retrieve run or job facets for a run.
📄️ List all received OpenLineage events.
Returns a list of OpenLineage events, sorted in direction of passed sort parameter. By default it is desc.
📄️ Get a lineage graph
Get a lineage graph
📄️ Retrieve a namespace
Returns a namespace.
📄️ List all namespaces
Returns a list of namespaces.
📄️ Retrieve a run
Retrieve a run.
📄️ List all runs
Returns a list of runs for a job.
📄️ Retrieve a source
Returns a source.
📄️ List all sources
Returns a list of sources.
📄️ List all tags
Returns a list of tags.
📄️ Create a dataset
Creates a new dataset.
📄️ Create a namespace
Creates a new namespace object. A namespace enables the contextual grouping of related jobs and datasets. Namespaces must contain only letters (`a-z`, `A-Z`), numbers (`0-9`), underscores (`_`), dashes (`-`), colons (`:`), slashes (`/`), or dots (`.`). A namespace is case-insensitive with a maximum length of `1024` characters. Note jobs and datasets will be unique within a namespace, but not across namespaces.
📄️ Create a source
Creates a new source object. A source is the physical location of a dataset such as a table in PostgreSQL, or topic in Kafka. A source enables the grouping of physical datasets to their physical source.
📄️ Create a tag
Creates a new tag object.
📄️ Record a single lineage event
Receive, process, and store lineage metadata using the [OpenLineage](https://github.com/OpenLineage/OpenLineage/blob/main/spec/OpenLineage.json) standard.
📄️ Query all datasets and jobs
Returns one or more datasets and jobs of your query.
📄️ Start a run
Marks the run as `RUNNING`.