@@ -11,7 +11,7 @@ This code allows you to create various works of art in Cloud Bigtable's [key vis
11
11
12
12
1 . Set your variables
13
13
```
14
- BIGTBALE_PROJECT =YOUR-PROJECT-ID OR $GOOGLE_CLOUD_PROJECT
14
+ BIGTABLE_PROJECT =YOUR-PROJECT-ID OR $GOOGLE_CLOUD_PROJECT
15
15
INSTANCE_ID=YOUR-INSTANCE-ID
16
16
TABLE_ID=YOUR-TABLE-ID
17
17
```
@@ -28,22 +28,27 @@ cbt createtable $TABLE_ID
28
28
cbt createfamily $TABLE_ID cf
29
29
```
30
30
31
+ 1 . Make sure your Dataflow API is enabled
32
+
33
+ ```
34
+ gcloud services enable dataflow.googleapis.com
35
+ ```
31
36
32
37
## Load data
33
38
Load 40GB of data with 5MB rows:
34
39
```
35
40
mvn compile exec:java -Dexec.mainClass=keyviz.LoadData \
36
- "-Dexec.args=--bigtableProjectId=$BIGTBALE_PROJECT \
41
+ "-Dexec.args=--bigtableProjectId=$BIGTABLE_PROJECT \
37
42
--bigtableInstanceId=$INSTANCE_ID --runner=dataflow \
38
- --bigtableTableId=$TABLE_ID"
43
+ --bigtableTableId=$TABLE_ID --project=$GOOGLE_CLOUD_PROJECT "
39
44
```
40
45
41
46
Load 50GB of data with 1MB rows:
42
47
```
43
48
mvn compile exec:java -Dexec.mainClass=keyviz.LoadData \
44
- "-Dexec.args=--bigtableProjectId=$BIGTBALE_PROJECT \
49
+ "-Dexec.args=--bigtableProjectId=$BIGTABLE_PROJECT \
45
50
--bigtableInstanceId=$INSTANCE_ID --runner=dataflow \
46
- --bigtableTableId=$TABLE_ID \
51
+ --bigtableTableId=$TABLE_ID --project=$GOOGLE_CLOUD_PROJECT \
47
52
--gigabytesWritten=50 \
48
53
--megabytesPerRow=1"
49
54
```
@@ -54,17 +59,17 @@ mvn compile exec:java -Dexec.mainClass=keyviz.LoadData \
54
59
Generate Mona Lisa with 40GB total and 5MB rows:
55
60
```
56
61
mvn compile exec:java -Dexec.mainClass=keyviz.ReadData \
57
- "-Dexec.args=--bigtableProjectId=$BIGTBALE_PROJECT \
62
+ "-Dexec.args=--bigtableProjectId=$BIGTABLE_PROJECT \
58
63
--bigtableInstanceId=$INSTANCE_ID --runner=dataflow \
59
- --bigtableTableId=$TABLE_ID"
64
+ --bigtableTableId=$TABLE_ID --project=$GOOGLE_CLOUD_PROJECT "
60
65
```
61
66
62
67
Generate American Gothic with 50GB total and 1MB rows:
63
68
```
64
69
mvn compile exec:java -Dexec.mainClass=keyviz.ReadData \
65
- "-Dexec.args=--bigtableProjectId=$BIGTBALE_PROJECT \
70
+ "-Dexec.args=--bigtableProjectId=$BIGTABLE_PROJECT \
66
71
--bigtableInstanceId=$INSTANCE_ID --runner=dataflow \
67
- --bigtableTableId=$TABLE_ID \
72
+ --bigtableTableId=$TABLE_ID --project=$GOOGLE_CLOUD_PROJECT \
68
73
--gigabytesWritten=50 \
69
74
--megabytesPerRow=1 \
70
75
--filePath=gs://keyviz-art/american_gothic_4h.txt"
@@ -105,4 +110,4 @@ This is a quick command to cancel all your dataflow jobs if you start a few.
105
110
106
111
```
107
112
gcloud dataflow jobs list --status=active --region=YOUR-REGION | tail -n +2 | sed 's/ .*//' | xargs gcloud dataflow jobs cancel
108
- ```
113
+ ```
0 commit comments