Skip to content

Install

Install from your package index or source checkout:

Terminal window
pip install drtoller-framework
# development checkout
pip install -e /path/to/drtoller-framework

Core dependencies include PyArrow, Pydantic, PyYAML and Prometheus client support. Install optional Ray, PostgreSQL, Qdrant, Airflow and Streamlit dependencies only in images that use those integrations.

Run framework tests from its source distribution:

Terminal window
python -m pytest dev/tests -q

A step is a separate installable Python package containing importable processor code and packaged *.drtml files:

Terminal window
pip install acme-pipeline-steps
export DRTOLLER_STEPS_ROOTS=/opt/acme-pipeline-steps/manifests

Use DRTOLLER_STEPS_ROOTS_FILE for multiple roots in container deployments.

A production deployment may provide:

  • local/S3-compatible storage for parquet;
  • PostgreSQL and generic dataset metric procedures;
  • Qdrant for vector datasets;
  • Prometheus and Grafana;
  • Airflow, Streamlit and Ray.

Step code remains independent of which optional services are deployed; DRTML selects backends/integrations.

Dashboard generation and PostgreSQL DDL synchronization are deployment operations. Runtime steps do not create schemas or provision dashboards.

From the standalone docs project:

Terminal window
npm install
npm run dev
npm run build

The current site is configured with base path /docs.