kedro-pypi-to-snowflake

Overview

This project retrieves all PyPI download data for Kedro packages from the ClickHouse server clickpy-clickhouse.clickhouse.com and saves the data to Snowflake storage. It leverages Kedro for efficient data processing and pipeline management.

Installation

To install project dependencies, run:

pip install -r requirements.txt

How to run your Kedro pipeline

You can run your Kedro project with:

kedro run