scraper

package

v0.1.0-alpha.1 Latest Latest Go to latest Published: Jan 11, 2024 License: Apache-2.0 Imports: 16 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/jcbl1/tiktok_ugc_finder

Documentation ¶

Overview ¶

Package scraper provides a function to Scrape UGC info from a JSON file.

A couple of variables can be set to make it function properly. The results are saved in a JSON file or XLSX file according according to the variable resultFormat.

Index ¶

Constants
func Scrape(scrapedJSONFile string) error
func ScrapeUnscraped(filename string) error
func Search(hashtags string) error
func SetFromTo(f, t int)
func SetHeadless(h bool)
func SetLimit(l uint)
func SetRecentVideosNum(r uint)
func SetResultFormat(f string)
func SetVerbose(v bool)

Constants ¶

View Source

const (
	TIKTOK        = "https://www.tiktok.com"
	TIKTOK_SEARCH = TIKTOK + "/search?q="
)

Variables ¶

This section is empty.

Functions ¶

func Scrape ¶

func Scrape(scrapedJSONFile string) error

Scrape scrapes UGC info according to a JSON file providing their unique IDs.

It will supposingly save results anyway whether the process has finished successfully or not.

func ScrapeUnscraped ¶

func ScrapeUnscraped(filename string) error

TODO comments

func Search ¶

func Search(hashtags string) error

func SetFromTo ¶

func SetFromTo(f, t int)

func SetHeadless ¶

func SetHeadless(h bool)

func SetLimit ¶

func SetLimit(l uint)

func SetRecentVideosNum ¶

func SetRecentVideosNum(r uint)

func SetResultFormat ¶

func SetResultFormat(f string)

func SetVerbose ¶

func SetVerbose(v bool)

Types ¶

This section is empty.

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL