batcher

README

Batcher - Micro-batching Data Processing Service

The micro-batching data-processing Go service responsible for buffering incoming data from a MQTT broker, normalizing it, and writing to a destination.

🧭 Table of Contents

• Batcher - Micro-batching Data-processing Service
  • Table of Contents
  • Team
  • Contributing
  • Local Run
    • Prerequisites
    • Steps

👥 Team

Team Member	Role Title	Description
Matthew Collett	Technical Lead/Developer	Focus on architecture design and solving complex problems, with a focus on the micro-batching process.
Cooper Dickson	Project Manager/Developer	Ensure that the scope and timeline are feasible and overview project status, focus on UI and real-time transmission.
Eric Cuenat	Scrum Master/Developer	In charge of agile methods for the team such as organizing meetings, removing blockers, and team communication, focus on UI and web socket interaction.
Sam Keays	Product Owner/Developer	Manager of product backlog and updating board to reflect scope changes and requirements, focus on database operations and schema design.

⛑️ Contributing

For guidlines and instructions on contributing, please refer to CONTRIBUTING.md

🚀 Local Run

Prerequisites

• Ensure you have go installed

Steps

1. First, start by cloning this repository to your local machine

git clone https://github.com/grid-stream-org/batcher.git

1. Navigate to the project directory

cd batcher

1. Populate configs/config.json with valid config to run the batcher
2. Install the project dependencies

make download

1. Run the batcher

make run