api-hub_data-scraping-service

module
v1.1.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Aug 9, 2022 License: Apache-2.0

README

Data Scraping Service

pre-commit pre-commit.ci status

Description

Service asynchronously process user request to add new Open API. In other words this service processes content of Open API file, transforms it to the ASD (API Specification Document) model and sends next to the storage and update service.

Main functions (To Do)
  1. Listen to queue events (links to open API yaml/json files)
  2. Check link availability
  3. Retrieve file content
  4. Validate content
  5. Parse content into an ASD model
  6. Put ASD model with metadata to the storage and update service queue
Starting service

The easiest way to start an application is to do it with docker. If you have docker you just need to run a command from the project root docker-compose -f ./docker/docker-compose-dev.yml up -d --build. And docker-compose -f ./docker/docker-compose-dev.yml down to stop. You can observe queues, and send and retrieve messages from queues using the web interface available by address http://localhost:15672 .

Directories

Path Synopsis
dto
queue/handler/mocks
Package handler is a generated GoMock package.
Package handler is a generated GoMock package.
queue/mocks
Package mock_queue is a generated GoMock package.
Package mock_queue is a generated GoMock package.
queue/publisher/mocks
Package publisher is a generated GoMock package.
Package publisher is a generated GoMock package.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL