Documentation ¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func RFPDupeFilterMiddleware ¶
func RFPDupeFilterMiddleware() antch.Middleware
Types ¶
type RFPDupeFilter ¶
type RFPDupeFilter struct { // IncludeHeaders specifies what header value is included to // fingerprint compute. IncludeHeaders []string // contains filtered or unexported fields }
RFPDupeFilter is a middleware of HTTP downloader to filter duplicate requests, based on request fingerprint.
Click to show internal directories.
Click to hide internal directories.