James-Wachuka/weather_data_pipeline James-Wachuka/weather_data_pipeline

  • Stars
    star
    3
  • Rank 3,961,342 (Top 79 %)
  • Language
    Python
  • Created over 1 year ago
  • Updated over 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
James-Wachuka/weather_data_pipeline
github

James-Wachuka

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

This is a PySpark-based data pipeline that fetches weather data for a few cities, performs some basic processing and transformation on the data, and then writes the processed data to a Google Cloud Storage bucket and a BigQuery table.The data is then viewed in a looker dashboard

More Repositories

1

python_etl

Using python-sql to create ETL between mysql and postgresql and windows scheduler to automate the job.
Python
2
star
2

event-driven-microservices

This project demonstrates an event-driven microservices architecture using Apache Kafka for event streaming and webhook integration with external services
Python
1
star
3

python_tel_chatbot

python telegram chatbot using telegram API
Python
1
star
4

python-kafka_distributed_task_queue

a simple implementation of a distributed task queue
Python
1
star