Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handbook: add customer ops data workflows page #2952

Merged
merged 6 commits into from
Apr 21, 2021
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
s/customer ops data/data workflows
  • Loading branch information
attfarhan committed Apr 21, 2021
commit e5bf726c4208fb518b01aac55b994160b56dc9b7
2 changes: 1 addition & 1 deletion handbook/ops/bizops/analytics.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ We have [written policies about how we handle customer information](./customer_d
- Google Cloud Platform: BigQuery is our data warehouse and the database Looker runs on top of
- Google Sheets: There are a [number of spreadsheets](https://drive.google.com/drive/folders/1LIfVyhjhh_mpc0SNOFvpNfN2h4CmGQmI) that Looker queries (by way of BigQuery).
- BizOps builds ad-hoc tools to analyze data for various reasons. The projects are in the [Google Drive Analytics folder](https://drive.google.com/drive/folders/1mtrHKsB2Kv0IGQ829zbcRGDSYHQpzkfd) and the source code is available in the [analytics repo](https://github.com/sourcegraph/analytics).
- For further explanation on how we use these tools, see the [customer ops data workflows](customer_ops_data.md) page
- For further explanation on how we use these tools, see the [data workflows](data_workflows.md) page

### Data pipelines

Expand Down
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
# CustomerOps Data Workflows
# Data Workflows

This document outlines the processes we have in place to pull data from our various third-party customer ops tools and get it into BigQuery and Looker for analysis.
This document outlines the processes we have in place to pull data from our various third-party tools and get it into BigQuery and Looker for analysis.

We extract data from our customer ops tools using several methods, described in more detail below. The methods we use currently include reading data into Google Sheets using data connectors (add-ons), writing Python scripts to query the tools' APIs, and create workflows in Zapier.
We extract data from our tools using several methods, described in more detail below. The methods we use currently include reading data into Google Sheets using data connectors (add-ons), writing Python scripts to query the tools' APIs, and create workflows in Zapier.

## Google Sheets Add-Ons

We use Google Sheets as a data store after pulling data from some of our customer ops tools. Once the sheets are created with the data we want, we connect them to BigQuery to create database tables.
We use Google Sheets as a data store after pulling data from some of our tools. Once the sheets are created with the data we want, we connect them to BigQuery to create database tables.

The add-ons we use depend on the data source. Currently, we use:

Expand Down