fetchnews

Fetch News

A web side to serve news crawl micro services

Usage

Add MS

Just edit https://gist.github.com/hi20160616/277faf779bee0d0d1525696eff6e8b56

gRPC

grpc-gateway

Refer:
https://github.com/grpc-ecosystem/grpc-gateway
https://grpc-ecosystem.github.io/grpc-gateway/docs/tutorials/introduction/
https://www.cnblogs.com/FireworksEasyCool/p/12782137.html

fix import "google/api/annotations.proto" error

Copy google/api/annotations.proto and google/api/http.proto

Refer:
https://github.com/grpc-ecosystem/grpc-gateway/issues/1935

mkdir -p google/api
wget https://raw.githubusercontent.com/googleapis/googleapis/master/google/api/annotations.proto -O google/api/annotations.proto
wget https://raw.githubusercontent.com/googleapis/googleapis/master/google/api/http.proto -O google/api/http.proto

Generate

protoc -I "./" -I "../../../" \
    --go_out=. --go_opt=paths=source_relative \
    --go-grpc_out=. --go-grpc_opt=paths=source_relative \
    api/fetchnews/web/v1/fetchnews.proto
go mod tidy

TODO

• add: content display
• add: search implement
• add: markdown view for content

• fix: Miscroservice client conns close action block on Miscroservice server closed.

• optimize: update skeleton to deal better for biz, data, service
• optimize: Miscroservice Client Conns open should display if success.
• optimize: error display elegant while runtime err: invalid memory address
• render.go: parseWithZone conditions on configs.json

Clone the ms project

Just clone the microservices, such as project ms-bbc, and run the command to replace all string in all files, that contains foo to bar:

cd /path/to/your/folder
# eg: sed -i 's/foo/bar/g' *
sed -i '' 's/foo/bar/g' *.mod *.md ./internal/*/* ./cmd/*/* ./configs/* ./api/*/*/*/*

rm git

rm -rf .git

git init

git init
git add .
git commit -m "first commit"
git branch -M main
git remote add origin https://github.com/<username>/<repo>.git
git push -u origin main

grpc generate

protoc -I "./" -I "../../../" \
    --go_out=. --go_opt=paths=source_relative \
    --go-grpc_out=. --go-grpc_opt=paths=source_relative \
    api/fetchnews/cna/v1/fetchnews.proto

go mod tidy

go mod tidy

Then, edit go files to fix new target:

• modified: configs/configs.json
• modified: internal/fetcher/article.go
• modified: internal/fetcher/article_test.go
• modified: internal/fetcher/links.go