Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
f33f295
adding new gcp blog directory and sample dag for my blog
rachael-ds Apr 6, 2021
5cb325b
added required files and moved to gcp tech blog folder
rachael-ds Apr 12, 2021
732a6e9
adding licence to example dag
rachael-ds Apr 12, 2021
2711943
Apply suggestions from code review
rachael-ds Apr 13, 2021
928681e
Update composer/blog/gcp-tech-blog/data-orchestration-with-composer/r…
rachael-ds Apr 13, 2021
9e6be49
updated dataflow template and variables
rachael-ds Apr 13, 2021
f2dad47
updated source destinations and added init.py
rachael-ds Apr 23, 2021
89767b8
added beam package requirement and lint changes
rachael-ds Apr 23, 2021
2100efc
updated slack package and further lint changes
rachael-ds Apr 23, 2021
5b5b929
lint fix
rachael-ds Apr 23, 2021
38eecdd
Merge branch 'master' into data-orchestration-blog-sample
rachael-ds Apr 23, 2021
718bd01
Merge branch 'master' into data-orchestration-blog-sample
rachael-ds Apr 24, 2021
ff62adb
trigger build
rachael-ds Apr 26, 2021
a6e2170
Merge branch 'master' into data-orchestration-blog-sample
rachael-ds Apr 27, 2021
0011c56
Merge branch 'master' into data-orchestration-blog-sample
rachael-ds Jun 7, 2021
ba8e02b
updated to use Airflow 2.0
rachael-ds Jun 8, 2021
edd4aac
Fixed conftest.py file header and lint issues
rachael-ds Jun 8, 2021
72a80fb
Apply suggestions from code review
rachael-ds Jun 9, 2021
65a4059
Merge branch 'master' into data-orchestration-blog-sample
dinagraves Jun 15, 2021
e6e3a6f
formatting changes after running nox black
rachael-ds Jun 16, 2021
0422943
updated to use f-strings
rachael-ds Jun 16, 2021
35c3734
updated slack connection formatting
rachael-ds Jun 16, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Data Orchestration with Cloud Composer

Code found in this directory is part of a [blog post](https://cloud.google.com/blog/topics/developers-practitioners) published in June 2021
Empty file.
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
# Copyright 2021 Google LLC

# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at

# https://www.apache.org/licenses/LICENSE-2.0

# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.


import os

import pytest


# this fixture initializes the Airflow DB once per session
# it is used by DAGs in both the blogs and workflows directories,
# unless there exists a conftest at a lower level
@pytest.fixture(scope="session")
def airflow_database():
import airflow.utils.db

# We use separate directory for local db path per session
# by setting AIRFLOW_HOME env var, which is done in noxfile_config.py.

assert "AIRFLOW_HOME" in os.environ

airflow_home = os.environ["AIRFLOW_HOME"]
airflow_db = f"{airflow_home}/airflow.db"

# reset both resets and initializes a new database
airflow.utils.db.resetdb()

# Making sure we are using a data file there.
assert os.path.isfile(airflow_db)
Loading