scrappers

package
v0.0.0-...-3ee0d69 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jan 28, 2022 License: MIT Imports: 12 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type Config

type Config struct {
	// contains filtered or unexported fields
}

Config is the database configuration struct.

func NewConfig

func NewConfig() *Config

NewConfig returns the configuration object.

type Kijiji

type Kijiji struct {
	// contains filtered or unexported fields
}

Kijiji is the kijiji scrapper.

func NewKijiji

func NewKijiji(log logger, repo serviceRepository) *Kijiji

NewKijiji creates a new Kijiji instance.

func (*Kijiji) Scrap

func (b *Kijiji) Scrap(wg *sync.WaitGroup)

Scrap scraps the websites

type Runner

type Runner struct {
	// contains filtered or unexported fields
}

Runner is the scrappers runner.

func NewRunner

func NewRunner(log logger, repo serviceRepository) *Runner

NewRunner creates a new Runner instance.

func (*Runner) Run

func (r *Runner) Run(names []string)

Run runs the scrappers.

type Uslugio

type Uslugio struct {
	// contains filtered or unexported fields
}

Uslugio is the uslugio scrapper.

func NewUslugio

func NewUslugio(log logger, repo serviceRepository) *Uslugio

NewUslugio creates a new uslugio instance.

func (*Uslugio) Scrap

func (b *Uslugio) Scrap(wg *sync.WaitGroup)

Scrap scraps the websites

type Yandex

type Yandex struct {
	// contains filtered or unexported fields
}

Yandex is the yandex scrapper.

func NewYandex

func NewYandex(log logger) *Yandex

NewYandex creates a new Yandex instance.

func (*Yandex) Scrap

func (k *Yandex) Scrap(wg *sync.WaitGroup)

Scrap runs the scrapper.

type Yellowpages

type Yellowpages struct {
	// contains filtered or unexported fields
}

Yellowpages is the yellowpages scrapper.

func NewYellowpages

func NewYellowpages(log logger, repo serviceRepository) *Yellowpages

NewYellowpages creates a new yellowpages instance.

func (*Yellowpages) Scrap

func (b *Yellowpages) Scrap(wg *sync.WaitGroup)

Scrap scraps the websites

type YellowpagesImagesData

type YellowpagesImagesData struct {
	Medias []struct {
		IsPhoto bool   `json:"isPhoto"`
		URL     string `json:"url"`
	}
}

YellowpagesImagesData is the image data struct

Directories

Path Synopsis

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL