sqlite3

package

v0.0.0-...-45e8d74 Latest Latest Go to latest Published: Apr 10, 2024 License: Apache-2.0 Imports: 7 Imported by: 2

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

This section is empty.

This section is empty.

This section is empty.

type Storage struct {
	// Filename indicates the name of the sqlite file to use
	Filename string
	// contains filtered or unexported fields
}

Storage implements a SQLite3 storage backend for Colly

func (s *Storage) AddRequest(r []byte) error

AddRequest implements queue.Storage.AddRequest() function

func (s *Storage) Clear() error

Clear removes all entries from the storage

func (s *Storage) Close() error

Close the db

func (s *Storage) Cookies(u *url.URL) string

Cookies implements colly/storage.Cookies()

func (s *Storage) GetRequest() ([]byte, error)

GetRequest implements queue.Storage.GetRequest() function

func (s *Storage) Init() error

Init initializes the sqlite3 storage

func (s *Storage) IsVisited(requestID uint64) (bool, error)

IsVisited implements colly/storage.IsVisited()

func (s *Storage) QueueSize() (int, error)

QueueSize implements queue.Storage.QueueSize() function

func (s *Storage) SetCookies(u *url.URL, cookies string)

SetCookies implements colly/storage..SetCookies()

func (s *Storage) Visited(requestID uint64) error

Visited implements colly/storage.Visited()