• Stars
    star
    135
  • Rank 259,861 (Top 6 %)
  • Language
    Jupyter Notebook
  • License
    MIT License
  • Created over 6 years ago
  • Updated over 4 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Google BigQuery Tutorial for Data Analyst

BigQuery-tutorial

  • Hits
  • Made by Seongyun Byeon
  • Last modified date : 18.05.20
  • ๊ณต์ง€ ์‚ฌํ•ญ
    • BigQuery ๊ด€๋ จ ๋ฐœํ‘œ๋ฅผ ํ–ˆ์Šต๋‹ˆ๋‹ค. ๋ฐœํ‘œ ์ž๋ฃŒ๋Š” ์Šฌ๋ผ์ด๋“œ์‰์–ด์— ์žˆ์Šต๋‹ˆ๋‹ค :)
    • ๋ฐ‘์— ๋‚ด์šฉ์„ ๋ณด๋Š” ๊ฒƒ๋ณด๋‹ค ์œ„ ์Šฌ๋ผ์ด๋“œ์‰์–ด ์œ„์ฃผ๋กœ ๋ณด์‹œ๋Š” ๊ฒƒ์„ ์ถ”์ฒœํ•ฉ๋‹ˆ๋‹ค!!
  • ์ˆ˜์ • ์‚ฌํ•ญ
    • 18.05.20 : ๋ฐ์ดํ„ฐ ๋ถ„์„์„ ์œ„ํ•œ SQL ๋ ˆ์‹œํ”ผ ์†Œ๊ฐœ ์ถ”๊ฐ€
    • 19.05.23 : BigQuery ๋ฐœํ‘œ ์ž๋ฃŒ ์ถ”๊ฐ€

Intro

  • Google Cloud BigQuery๋ฅผ 6๊ฐœ์›”๊ฐ„ ์‚ฌ์šฉํ•˜๋ฉด์„œ ์ ์–ด๋‘” ๋‚ด์šฉ์„ ๋ฌธ์„œํ™”ํ•ด๋ดค์Šต๋‹ˆ๋‹ค. ํ•œ๊ตญ์—์„œ ๋งŽ์€ ๋ถ„๋“ค์ด BigQuery๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ๊ทธ๋‚ ๊นŒ์ง€..!
  • ์กฐ๊ธˆ์ด๋ผ๋„ ๋„์›€์ด ๋˜์…จ์œผ๋ฉด, Star๋ฅผ ๋ˆŒ๋Ÿฌ์ฃผ์‹œ๋Š” ๊ฒƒ์€ ์–ด๋–จ๊นŒ์š”?
  • ํ‹€๋ฆฐ ๋‚ด์šฉ์ด ๋งŽ์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์–ด๋–ค ๊ฒฝ๋กœ๋“  ์—ฐ๋ฝ์ฃผ์‹œ๋ฉด ๋ฐ”๋กœ ์ˆ˜์ •ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค
  • ๊ถ๊ธˆํ•˜์‹  ๋‚ด์šฉ์€ ํŽ˜์ด์Šค๋ถ Google BigQuery Users์—์„œ ๋ฌผ์–ด๋ณด์…”๋„ ์ข‹์„ ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค :)

Contents

01 - Basic

  1. Google Bigquery
  2. Query syntax (legacy, standard)
  3. Run Query
  4. Loading Data(from GCS)
  5. Firebase์™€ ์—ฐ๋™
  6. MySQL to BigQuery(Using Embulk)

02 - Utils

  1. Connect Python(Jupyter)
  2. Connect Datalab
  3. Connect Zeppelin
  4. Connect Tableau
  5. Install Chrome Extension

03 - Intermediate

  1. Work Flow Management(using Airflow)
  2. Optimizing Query and Controlling Costs
  3. UDF(User Define Function)
  4. DML(Data Manipulation Language)

04 - Data Analysis Practice

  • ๋ฐ์ดํ„ฐ ๋ถ„์„์€ ๋ฐ์ดํ„ฐ ๋ถ„์„์„ ์œ„ํ•œ SQL ๋ ˆ์‹œํ”ผ ์ฑ…์„ ์ถ”์ฒœํ•ฉ๋‹ˆ๋‹ค!
  • ์ด ์ฑ…์€ SQL ๊ธฐ์ดˆ ์ฑ…์€ ์•„๋‹ˆ์ง€๋งŒ SQL์„ ํ™œ์šฉํ•ด ๋ฐ์ดํ„ฐ ๋ถ„์„์„ ํ•˜๋Š” ๋‚ด์šฉ์„ ๋‹ด๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ์‹ค๋ฌด์—์„œ ์‚ฌ์šฉํ•˜๋Š” ํ…Œํฌ๋‹‰๋“ค์ด ๊ฐ€๋“ ๋‹ด๊ฒจ์žˆ์œผ๋‹ˆ ๊ผญ ์ฐธ๊ณ ํ•˜์‹œ๋ฉด ์ข‹์„ ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค!

05 - ETC

  1. GOOGLE CLOUD CREDENTIALS json file setting

Reference

  • ๊ฐ ๋ฌธ์„œ์˜ ํ•˜๋‹จ์— Reference๋ฅผ ์ ์–ด๋‘์—ˆ๊ณ , ์ œ๊ฒŒ ๊ฐ•๋ ฅํ•˜๊ฒŒ ์˜๊ฐ์„ ์ค€ ์ž๋ฃŒ๋“ค์€ ์•„๋ž˜์™€ ๊ฐ™์Šต๋‹ˆ๋‹ค
  • BigQuery Document
  • ์ด์žฌ๊ด‘๋‹˜ SlideShare

More Repositories

1

Datascience-Interview-Questions

Datascience-Interview-Questions for Korean
762
star
2

Boostcamp-AI-Tech-Product-Serving

๋ถ€์ŠคํŠธ์บ ํ”„ AI Tech - Product Serving ์ž๋ฃŒ
Python
398
star
3

Kaggle-knowhow

Kaggle-Knowhow(Korean Ver) ํ•œ๊ตญ๋ถ„๋“ค์„ ์œ„ํ•œ Kaggle ์ž๋ฃŒ ๋ชจ์Œ์ž…๋‹ˆ๋‹ค
352
star
4

Awesome-Mobility-Machine-Learning-Contents

Machine Learning / Deep Learning Contents in Mobility Industry(Transportation)
260
star
5

kyle-school

์˜์นด ๋ฐ์ดํ„ฐ ๊ทธ๋ฃน ์‚ฌ๋‚ด ์‹ ์ž…/์ธํ„ด์„ ๋Œ€์ƒ์œผ๋กœ ํ•œ ์นด์ผ์Šค์ฟจ
Jupyter Notebook
232
star
6

github-action-with-python

Github Action with Python(Pytest, Crawling, etc)
Python
111
star
7

Deep_Learning_starting_with_the_latest_papers

์ตœ์‹  ๋…ผ๋ฌธ์œผ๋กœ ์‹œ์ž‘ํ•˜๋Š” ๋”ฅ๋Ÿฌ๋‹ ๊ฐ•์˜ (๊ฐœ์ •๋œ ๊ฐ•์˜ ์ด๋ฆ„ : ๋…ผ๋ฌธ์œผ๋กœ ์งš์–ด๋ณด๋Š” ๋”ฅ๋Ÿฌ๋‹์˜ ๋งฅ) ๊ธฐ๋ก
Jupyter Notebook
80
star
8

Perfect-Guide-about-Machine-Learning-Study

ํŒŒ์ด์ฌ ๋จธ์‹ ๋Ÿฌ๋‹ ์™„๋ฒฝ ๊ฐ€์ด๋“œ๋ฅผ ๊ต์žฌ๋กœ ์ง„ํ–‰ํ•œ ์˜์นด ๋ฐ์ดํ„ฐ ๊ทธ๋ฃน ์‚ฌ๋‚ด ์Šคํ„ฐ๋”” ๋ณด์™„ ์ž๋ฃŒ
Jupyter Notebook
62
star
9

shell-scripts

linux bash shell scripts code snippets
Shell
36
star
10

TIL

Today I Learned
Jupyter Notebook
22
star
11

fastcampus-machine-learning-project

ํŒจ์ŠคํŠธ์บ ํผ์Šค ๋จธ์‹ ๋Ÿฌ๋‹๊ณผ ๋ฐ์ดํ„ฐ๋ถ„์„ A-Z ์˜ฌ์ธ์› ํŒจํ‚ค์ง€ ๊ฐ•์˜ ์ค‘ "๋‰ด์š•(NYC) ํƒ์‹œ ์ˆ˜์š” ์˜ˆ์ธก Project" ๊ฐ•์˜ ์ž๋ฃŒ
Jupyter Notebook
16
star
12

I-am-an-ai-engineer

AI Engineer Party ๋ฌธ์ œ (MLOps, AIOps)
Python
14
star
13

zzsza

Github Profile README
8
star
14

bentoml-examples

BentoML Example Scripts
Python
8
star
15

bigquery-udfs

BigQuery UDF for me
TSQL
5
star
16

data-engineering-code

๋ฐ์ดํ„ฐ ์—”์ง€๋‹ˆ์–ด๋ง ๊ด€๋ จ ์ฝ”๋“œ ๋ชจ์Œ
5
star
17

streamlit-with-heroku

Streamlit App(NYC Uber Ridesharing Graph) with heroku
Python
4
star
18

Tensorflow2.0-studypie

์Šคํ„ฐ๋””ํŒŒ์ด [Tensorflow 2.0 ๋‹จ๊ธฐ ์ง‘์ค‘ ๊ณผ์ •] ์ง„ํ–‰์ƒํ™ฉ ๊ธฐ๋กํ•˜๋Š” Repo
Jupyter Notebook
4
star
19

mlops-examples-on-gcp

MLOps examples on Google Cloud Platform
Dockerfile
3
star