Documentation ¶
Index ¶
- type FileStore
- func (fs *FileStore) AssetFilePath(as *types.EmbeddedAsset) string
- func (fs *FileStore) HtmlDocPath() string
- func (fs *FileStore) LoadMetadata() (*types.Metadata, error)
- func (fs *FileStore) MetadataFilePath() string
- func (fs *FileStore) RelativeAssetFilePath(as *types.EmbeddedAsset) string
- func (fs *FileStore) SaveAsset(as *types.EmbeddedAsset) error
- func (fs *FileStore) SaveDoc(doc *goquery.Document) error
- func (fs *FileStore) SaveMetadata(metadata *types.Metadata) error
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type FileStore ¶
type FileStore struct {
// contains filtered or unexported fields
}
FileStore manages the storage of scraped HTML documents, downloaded asset files, and parsed metadata in a designated directory.
func NewFileStore ¶
func (*FileStore) AssetFilePath ¶
func (fs *FileStore) AssetFilePath(as *types.EmbeddedAsset) string
Absolute asset file path format: `${rootDir}/${docName}/${assetFilePath}/${assetFileName}`.
func (*FileStore) HtmlDocPath ¶
Abosulte HTML document file format: `${rootDir}/${docName}.html`.
func (*FileStore) LoadMetadata ¶
LoadMetadata loads metadata from json file.
func (*FileStore) MetadataFilePath ¶
Metadata file path format: `${rootDir}/${docName}.json`
func (*FileStore) RelativeAssetFilePath ¶
func (fs *FileStore) RelativeAssetFilePath(as *types.EmbeddedAsset) string
Relative asset file path format: `${docName}/${assetFilePath}/${assetFileName}`.
func (*FileStore) SaveAsset ¶
func (fs *FileStore) SaveAsset(as *types.EmbeddedAsset) error
SaveAsset saves embedded asset files.
Click to show internal directories.
Click to hide internal directories.