README
¶
Fetcher
Fetch news from a entrance url, filter update time in the range, and storage them into a json. So, Microservice can read this fetched data directly.
Skeleton
- fetcher.go: Fetch action implemented here
- links.go: Fetch links from an entrance url.
- article.go: Domain Object here to implement functions that microservice needed and invoked, such as Get, List and Search.
- db.go: This is for fetched data persistence, load and save data directly.
Fetch kernal methods
There are kernal methods used to modified to match and fetch better, you can clone and rewrite the parts to implement your microservice.
func (a *Article) fetchTitle() (string, error) {}func (a *Article) fetchUpdateTime() (*timestamppb.Timestamp, error) {}func (a *Article) fetchContent() (string, error) {}
Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
View Source
var ErrTimeOverDays error = errors.New("article update time out of range")
Functions ¶
Types ¶
type Article ¶
type Article struct {
Id string
Title string
Content string
WebsiteId string
WebsiteDomain string
WebsiteTitle string
UpdateTime *timestamppb.Timestamp
U *url.URL
// contains filtered or unexported fields
}
func NewArticle ¶
func NewArticle() *Article
type ByUpdateTime ¶ added in v0.0.2
type ByUpdateTime []*Article
func (ByUpdateTime) Len ¶ added in v0.0.2
func (u ByUpdateTime) Len() int
func (ByUpdateTime) Less ¶ added in v0.0.2
func (u ByUpdateTime) Less(i, j int) bool
func (ByUpdateTime) Swap ¶ added in v0.0.2
func (u ByUpdateTime) Swap(i, j int)
Source Files
Click to show internal directories.
Click to hide internal directories.