21 lines
719 B
Markdown
21 lines
719 B
Markdown
# Fetcher
|
|
|
|
```
|
|
conda create -n matitos_fetcher python=3.12
|
|
conda activate matitos_fetcher
|
|
conda install -c conda-forge curl
|
|
pip install ipykernel "psycopg[binary]" git+https://github.com/ranahaani/GNews.git GoogleNews duckduckgo_search newspaper4k numpy beautifulsoup4 requests feedparser pytz redis fastapi uvicorn fastapi-utils lxml[html_clean]
|
|
```
|
|
|
|
|
|
* Fetcher app
|
|
- Contains several endpoints to perform a specific fetching type task
|
|
- For more details, check in [app.py](app.py) /{fetch_type}
|
|
|
|
* Build and run
|
|
- Important: To be deployed with other micro-services, [docker-compose.yml](../docker-compose.yml)
|
|
```
|
|
docker build -t fetch_app .
|
|
docker run --rm --name container_fetch_app fetch_app
|
|
```
|