scraper

package

v0.0.0-...-b6312d7 Latest Latest Go to latest Published: Jan 13, 2023 License: Apache-2.0 Imports: 14 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/lazywitt/youtubetrending

Links

Open Source Insights

Documentation ¶

Index ¶

func GetConf() *config
type YoutubeApiService
type YoutubeSeed
- func GetYoutubeSeed(SearchResource []string, SearchKey string, OrderBy string, ...) *YoutubeSeed

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func GetConf ¶

func GetConf() *config

Types ¶

type YoutubeApiService ¶

type YoutubeApiService interface {
	// InitialiseScraper orchestrates periodic call to scrape YouTube data after a fixed interval
	InitialiseScraper(ctx context.Context) error
	// MakeApiCall executes the api call to youtubeV3 api
	MakeApiCall(ctx context.Context, service *youtube.SearchService) (*youtube.SearchListResponse, error)
	// PersistVideoData to save the video meta data in postgres
	PersistVideoData(ctx context.Context, searchRes *youtube.SearchListResponse) error
}

type YoutubeSeed ¶

type YoutubeSeed struct {
	// contains filtered or unexported fields
}

func GetYoutubeSeed ¶

func GetYoutubeSeed(SearchResource []string, SearchKey string, OrderBy string, MaxResultPerCall int, ApiKey []string, LastSearchTime time.Time,
	dbClient *db.Handler) *YoutubeSeed

func (*YoutubeSeed) InitialiseScraper ¶

func (s *YoutubeSeed) InitialiseScraper(ctx context.Context) error

func (*YoutubeSeed) MakeApiCall ¶

func (s *YoutubeSeed) MakeApiCall(ctx context.Context,
	youtubeSearchService *youtube.SearchService) (*youtube.SearchListResponse, error)

func (*YoutubeSeed) PersistVideoData ¶

func (s *YoutubeSeed) PersistVideoData(ctx context.Context, searchRes *youtube.SearchListResponse) error

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL