Skip to content

Commit f67597d

Browse files
author
Aniket Mokashi
committed
update readme with updated instructions on running benchmark
1 parent a482a61 commit f67597d

File tree

1 file changed

+7
-14
lines changed

1 file changed

+7
-14
lines changed

bigquery/README.md

Lines changed: 7 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,5 @@
11
As of 2025, Google Bigquery allow publishing benchmark results, which was not the case earlier.
22

3-
It's very difficult to find, how to create a database.
4-
Databases are named "datasets". You need to press on `` near project.
5-
6-
Create dataset `test`.
7-
Go to the query editor and paste the contents of `create.sql`.
8-
It will take two seconds to create a table.
9-
103
Download Google Cloud CLI:
114
```
125
wget --continue --progress=dot:giga https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-cli-linux-x86_64.tar.gz
@@ -16,6 +9,11 @@ source .bashrc
169
./google-cloud-sdk/bin/gcloud init
1710
```
1811

12+
Create the dataset and table:
13+
```
14+
./create.sh
15+
```
16+
1917
Load the data:
2018
```
2119
wget --continue --progress=dot:giga 'https://datasets.clickhouse.com/hits_compatible/hits.csv.gz'
@@ -28,11 +26,6 @@ command time -f '%e' bq load --source_format CSV --allow_quoted_newlines=1 test.
2826
Run the benchmark:
2927

3028
```
31-
./run.sh 2>&1 | tee log.txt
32-
33-
cat log.txt |
34-
grep -P '^real|^Error' |
35-
sed -r -e 's/^Error.*$/null/; s/^real\s*([0-9.]+)m([0-9.]+)s$/\1 \2/' |
36-
awk '{ if ($2 != "") { print $1 * 60 + $2 } else { print $1 } }' |
37-
awk '{ if ($1 == "null") { skip = 1 } else { if (i % 3 == 0) { printf "[" }; printf skip ? "null" : $1; if (i % 3 != 2) { printf "," } else { print "]," }; ++i; skip = 0; } }'
29+
pip install google-cloud-bigquery
30+
python3 run_queries.py > results.txt 2> log2.txt
3831
```

0 commit comments

Comments
 (0)