Skip to content

Commit

Permalink
Update airflow.md
Browse files Browse the repository at this point in the history
  • Loading branch information
ppeiris committed Jan 26, 2021
1 parent fde715a commit 195b0b3
Showing 1 changed file with 4 additions and 3 deletions.
7 changes: 4 additions & 3 deletions airflow/airflow.md
Original file line number Diff line number Diff line change
Expand Up @@ -82,11 +82,12 @@ with DAG(dag_id="process-t3-label-data-feature-extraction",
- *BashOperator*: Execute bash operators
- *PythonOperator*: Call an arbitrary python function
- *EmailOperator*: Sends an email
- *MySqlOperator*, SqliteOperator, PorstgreOperator: execute SQl commands
- *TransferOperator*:
- *MySqlOperator*: SqliteOperator, PorstgreOperator: execute SQl commands
- *SensorOperator*: Monitor external processes. Has a poke method called repeatedly until it returns True
- *TransferOperator*: **_Do not use this operator if you are dealing with large amount of data_**
- Move data from one system to another.
- Data will be pulled out from the source, stages on the machine where the executor is running, and then transfered to the target system.
- **Do not use this operator if you are dealing with large amount of data**

![operators](img/operator1.png)


Expand Down

0 comments on commit 195b0b3

Please sign in to comment.