Fetcher
conda create -n matitos_fetcher python=3.12
conda activate matitos_fetcher
conda install -c conda-forge curl
pip install ipykernel "psycopg[binary]" git+https://github.com/ranahaani/GNews.git GoogleNews duckduckgo_search newspaper4k numpy beautifulsoup4 requests feedparser pytz redis fastapi uvicorn fastapi-utils lxml[html_clean]
-
Fetcher app
- Contains several endpoints to perform a specific fetching type task
- For more details, check in app.py /{fetch_type}
- Contains several endpoints to perform a specific fetching type task
-
Build and run
- Important: To be deployed with other micro-services, docker-compose.yml
docker build -t fetch_app .
docker run --rm --name container_fetch_app fetch_app